Aug 09 15:10:55 user nova-compute[72382]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code.
Aug 09 15:10:57 user nova-compute[72382]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=72382) initialize /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:44}}
Aug 09 15:10:57 user nova-compute[72382]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=72382) initialize /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:44}}
Aug 09 15:10:57 user nova-compute[72382]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=72382) initialize /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:44}}
Aug 09 15:10:57 user nova-compute[72382]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Aug 09 15:10:57 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:10:57 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.020s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:10:57 user nova-compute[72382]: INFO nova.virt.driver [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] Loading compute driver 'libvirt.LibvirtDriver'
Aug 09 15:10:58 user nova-compute[72382]: INFO nova.compute.provider_config [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] Acquiring lock "singleton_lock" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] Acquired lock "singleton_lock" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] Releasing lock "singleton_lock" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] Full set of CONF: {{(pid=72382) _wait_for_exit_or_signal /usr/local/lib/python3.10/dist-packages/oslo_service/service.py:362}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] ******************************************************************************** {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] Configuration options gathered from: {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] ================================================================================ {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] allow_resize_to_same_host      = True {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] arq_binding_timeout            = 300 {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] backdoor_port                  = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] backdoor_socket                = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] block_device_allocate_retries  = 300 {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] block_device_allocate_retries_interval = 5 {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] cert                           = self.pem {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] compute_monitors               = [] {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] config_dir                     = [] {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] config_drive_format            = iso9660 {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] config_source                  = [] {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] console_host                   = user {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] control_exchange               = nova {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] cpu_allocation_ratio           = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] daemon                         = False {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] debug                          = True {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] default_access_ip_network_name = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] default_availability_zone      = nova {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] default_ephemeral_format       = ext4 {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] default_schedule_zone          = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] disk_allocation_ratio          = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] enable_new_services            = True {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] enabled_apis                   = ['osapi_compute'] {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] enabled_ssl_apis               = [] {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] flat_injected                  = False {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] force_config_drive             = False {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] force_raw_images               = True {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] graceful_shutdown_timeout      = 5 {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] heal_instance_info_cache_interval = 60 {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] host                           = user {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] initial_disk_allocation_ratio  = 1.0 {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] initial_ram_allocation_ratio   = 1.0 {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] instance_build_timeout         = 0 {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] instance_delete_interval       = 300 {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] instance_format                = [instance: %(uuid)s]  {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] instance_name_template         = instance-%08x {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] instance_usage_audit           = False {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] instance_usage_audit_period    = month {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] internal_service_availability_zone = internal {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] key                            = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] live_migration_retry_count     = 30 {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] log_config_append              = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] log_dir                        = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] log_file                       = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] log_options                    = True {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] log_rotate_interval            = 1 {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] log_rotate_interval_type       = days {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] log_rotation_type              = none {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] long_rpc_timeout               = 1800 {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] max_concurrent_builds          = 10 {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] max_concurrent_live_migrations = 1 {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] max_concurrent_snapshots       = 5 {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] max_local_block_devices        = 3 {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] max_logfile_count              = 30 {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] max_logfile_size_mb            = 200 {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] maximum_instance_delete_attempts = 5 {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] metadata_listen                = 0.0.0.0 {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] metadata_listen_port           = 8775 {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] metadata_workers               = 3 {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] migrate_max_retries            = -1 {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] mkisofs_cmd                    = genisoimage {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] my_block_storage_ip            = 10.0.0.210 {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] my_ip                          = 10.0.0.210 {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] network_allocate_retries       = 0 {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] osapi_compute_listen           = 0.0.0.0 {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] osapi_compute_listen_port      = 8774 {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] osapi_compute_unique_server_name_scope =  {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] osapi_compute_workers          = 3 {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] password_length                = 12 {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] periodic_enable                = True {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] periodic_fuzzy_delay           = 60 {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] pointer_model                  = ps2mouse {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] preallocate_images             = none {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] publish_errors                 = False {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] pybasedir                      = /opt/stack/nova {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] ram_allocation_ratio           = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] rate_limit_burst               = 0 {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] rate_limit_except_level        = CRITICAL {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] rate_limit_interval            = 0 {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] reboot_timeout                 = 0 {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] reclaim_instance_interval      = 0 {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] record                         = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] reimage_timeout_per_gb         = 60 {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] report_interval                = 120 {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] rescue_timeout                 = 0 {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] reserved_host_cpus             = 0 {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] reserved_host_disk_mb          = 0 {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] reserved_host_memory_mb        = 512 {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] reserved_huge_pages            = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] resize_confirm_window          = 0 {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] resize_fs_using_block_device   = False {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] resume_guests_state_on_host_boot = False {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] rpc_response_timeout           = 60 {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] run_external_periodic_tasks    = True {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] running_deleted_instance_action = reap {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] running_deleted_instance_poll_interval = 1800 {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] running_deleted_instance_timeout = 0 {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] scheduler_instance_sync_interval = 120 {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] service_down_time              = 720 {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] servicegroup_driver            = db {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] shelved_offload_time           = 0 {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] shelved_poll_interval          = 3600 {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] shutdown_timeout               = 0 {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] source_is_ipv6                 = False {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] ssl_only                       = False {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] state_path                     = /opt/stack/data/nova {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] sync_power_state_interval      = 600 {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] sync_power_state_pool_size     = 1000 {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] syslog_log_facility            = LOG_USER {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] tempdir                        = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] timeout_nbd                    = 10 {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] transport_url                  = **** {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] update_resources_interval      = 0 {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] use_cow_images                 = True {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] use_eventlog                   = False {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] use_journal                    = False {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] use_json                       = False {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] use_rootwrap_daemon            = False {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] use_stderr                     = False {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] use_syslog                     = False {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] vcpu_pin_set                   = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] vif_plugging_is_fatal          = False {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] vif_plugging_timeout           = 0 {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] virt_mkfs                      = [] {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] volume_usage_poll_interval     = 0 {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] watch_log_file                 = False {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] web                            = /usr/share/spice-html5 {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] oslo_concurrency.disable_process_locking = False {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] api.auth_strategy              = keystone {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] api.compute_link_prefix        = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] api.dhcp_domain                = novalocal {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] api.enable_instance_password   = True {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] api.glance_link_prefix         = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] api.instance_list_cells_batch_strategy = distributed {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] api.instance_list_per_project_cells = False {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] api.list_records_by_skipping_down_cells = True {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] api.local_metadata_per_cell    = False {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] api.max_limit                  = 1000 {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] api.metadata_cache_expiration  = 15 {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] api.neutron_default_tenant_id  = default {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] api.use_forwarded_for          = False {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] api.use_neutron_default_nets   = False {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] api.vendordata_dynamic_failure_fatal = False {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] api.vendordata_dynamic_targets = [] {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] api.vendordata_jsonfile_path   = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] cache.backend                  = dogpile.cache.memcached {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] cache.backend_argument         = **** {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] cache.config_prefix            = cache.oslo {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] cache.dead_timeout             = 60.0 {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] cache.debug_cache_backend      = False {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] cache.enable_retry_client      = False {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] cache.enable_socket_keepalive  = False {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] cache.enabled                  = True {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] cache.expiration_time          = 600 {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] cache.hashclient_retry_attempts = 2 {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] cache.hashclient_retry_delay   = 1.0 {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] cache.memcache_dead_retry      = 300 {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] cache.memcache_password        =  {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] cache.memcache_pool_maxsize    = 10 {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] cache.memcache_sasl_enabled    = False {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] cache.memcache_socket_timeout  = 1.0 {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] cache.memcache_username        =  {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] cache.proxies                  = [] {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] cache.retry_attempts           = 2 {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] cache.retry_delay              = 0.0 {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] cache.socket_keepalive_count   = 1 {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] cache.socket_keepalive_idle    = 1 {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] cache.socket_keepalive_interval = 1 {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] cache.tls_allowed_ciphers      = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] cache.tls_cafile               = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] cache.tls_certfile             = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] cache.tls_enabled              = False {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] cache.tls_keyfile              = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] cinder.auth_section            = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] cinder.auth_type               = password {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] cinder.cafile                  = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] cinder.catalog_info            = volumev3::publicURL {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] cinder.certfile                = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] cinder.collect_timing          = False {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] cinder.cross_az_attach         = True {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] cinder.debug                   = False {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] cinder.endpoint_template       = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] cinder.http_retries            = 3 {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] cinder.insecure                = False {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] cinder.keyfile                 = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] cinder.os_region_name          = RegionOne {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] cinder.split_loggers           = False {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] cinder.timeout                 = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] compute.cpu_dedicated_set      = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] compute.cpu_shared_set         = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] compute.image_type_exclude_list = [] {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] compute.live_migration_wait_for_vif_plug = True {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] compute.max_concurrent_disk_ops = 0 {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] compute.max_disk_devices_to_attach = -1 {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] compute.resource_provider_association_refresh = 300 {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] compute.shutdown_retry_interval = 10 {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] conductor.workers              = 3 {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] console.allowed_origins        = [] {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] console.ssl_ciphers            = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] console.ssl_minimum_version    = default {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] consoleauth.token_ttl          = 600 {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] cyborg.cafile                  = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] cyborg.certfile                = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] cyborg.collect_timing          = False {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] cyborg.connect_retries         = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] cyborg.connect_retry_delay     = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] cyborg.endpoint_override       = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] cyborg.insecure                = False {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] cyborg.keyfile                 = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] cyborg.max_version             = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] cyborg.min_version             = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] cyborg.region_name             = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] cyborg.service_name            = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] cyborg.service_type            = accelerator {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] cyborg.split_loggers           = False {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] cyborg.status_code_retries     = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] cyborg.status_code_retry_delay = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] cyborg.timeout                 = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] cyborg.version                 = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] database.backend               = sqlalchemy {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] database.connection            = **** {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] database.connection_debug      = 0 {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] database.connection_parameters =  {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] database.connection_recycle_time = 3600 {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] database.connection_trace      = False {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] database.db_inc_retry_interval = True {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] database.db_max_retries        = 20 {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] database.db_max_retry_interval = 10 {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] database.db_retry_interval     = 1 {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] database.max_overflow          = 50 {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] database.max_pool_size         = 5 {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] database.max_retries           = 10 {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] database.mysql_enable_ndb      = False {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] database.mysql_wsrep_sync_wait = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] database.pool_timeout          = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] database.retry_interval        = 10 {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] database.slave_connection      = **** {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] database.sqlite_synchronous    = True {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] api_database.backend           = sqlalchemy {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] api_database.connection        = **** {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] api_database.connection_debug  = 0 {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] api_database.connection_parameters =  {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] api_database.connection_recycle_time = 3600 {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] api_database.connection_trace  = False {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] api_database.db_inc_retry_interval = True {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] api_database.db_max_retries    = 20 {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] api_database.db_max_retry_interval = 10 {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] api_database.db_retry_interval = 1 {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] api_database.max_overflow      = 50 {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] api_database.max_pool_size     = 5 {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] api_database.max_retries       = 10 {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] api_database.mysql_enable_ndb  = False {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] api_database.mysql_wsrep_sync_wait = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] api_database.pool_timeout      = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] api_database.retry_interval    = 10 {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] api_database.slave_connection  = **** {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] api_database.sqlite_synchronous = True {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] devices.enabled_mdev_types     = [] {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] ephemeral_storage_encryption.enabled = False {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] ephemeral_storage_encryption.key_size = 512 {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] glance.api_servers             = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] glance.cafile                  = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] glance.certfile                = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] glance.collect_timing          = False {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] glance.connect_retries         = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] glance.connect_retry_delay     = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] glance.debug                   = False {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] glance.default_trusted_certificate_ids = [] {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] glance.enable_certificate_validation = False {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] glance.enable_rbd_download     = False {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] glance.endpoint_override       = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] glance.insecure                = False {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] glance.keyfile                 = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] glance.max_version             = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] glance.min_version             = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] glance.num_retries             = 3 {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] glance.rbd_ceph_conf           =  {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] glance.rbd_connect_timeout     = 5 {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] glance.rbd_pool                =  {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] glance.rbd_user                =  {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] glance.region_name             = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] glance.service_name            = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] glance.service_type            = image {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] glance.split_loggers           = False {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] glance.status_code_retries     = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] glance.status_code_retry_delay = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] glance.timeout                 = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] glance.verify_glance_signatures = False {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] glance.version                 = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] guestfs.debug                  = False {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] hyperv.config_drive_cdrom      = False {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] hyperv.config_drive_inject_password = False {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] hyperv.enable_instance_metrics_collection = False {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] hyperv.enable_remotefx         = False {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] hyperv.instances_path_share    =  {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] hyperv.iscsi_initiator_list    = [] {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] hyperv.limit_cpu_features      = False {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] hyperv.power_state_check_timeframe = 60 {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] hyperv.power_state_event_polling_interval = 2 {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] hyperv.use_multipath_io        = False {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] hyperv.volume_attach_retry_count = 10 {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] hyperv.volume_attach_retry_interval = 5 {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] hyperv.vswitch_name            = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] mks.enabled                    = False {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] image_cache.manager_interval   = 2400 {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] image_cache.precache_concurrency = 1 {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] image_cache.remove_unused_base_images = True {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] image_cache.subdirectory_name  = _base {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] ironic.api_max_retries         = 60 {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] ironic.api_retry_interval      = 2 {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] ironic.auth_section            = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] ironic.auth_type               = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] ironic.cafile                  = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] ironic.certfile                = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] ironic.collect_timing          = False {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] ironic.connect_retries         = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] ironic.connect_retry_delay     = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] ironic.endpoint_override       = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] ironic.insecure                = False {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] ironic.keyfile                 = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] ironic.max_version             = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] ironic.min_version             = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] ironic.partition_key           = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] ironic.peer_list               = [] {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] ironic.region_name             = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] ironic.serial_console_state_timeout = 10 {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] ironic.service_name            = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] ironic.service_type            = baremetal {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] ironic.split_loggers           = False {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] ironic.status_code_retries     = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] ironic.status_code_retry_delay = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] ironic.timeout                 = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] ironic.version                 = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] key_manager.fixed_key          = **** {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] barbican.barbican_api_version  = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] barbican.barbican_endpoint     = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] barbican.barbican_endpoint_type = public {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] barbican.barbican_region_name  = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] barbican.cafile                = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] barbican.certfile              = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] barbican.collect_timing        = False {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] barbican.insecure              = False {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] barbican.keyfile               = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] barbican.number_of_retries     = 60 {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] barbican.retry_delay           = 1 {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] barbican.send_service_user_token = False {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] barbican.split_loggers         = False {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] barbican.timeout               = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] barbican.verify_ssl            = True {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] barbican.verify_ssl_path       = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] barbican_service_user.auth_section = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] barbican_service_user.auth_type = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] barbican_service_user.cafile   = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] barbican_service_user.certfile = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] barbican_service_user.collect_timing = False {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] barbican_service_user.insecure = False {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] barbican_service_user.keyfile  = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] barbican_service_user.split_loggers = False {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] barbican_service_user.timeout  = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] vault.approle_role_id          = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] vault.approle_secret_id        = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] vault.cafile                   = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] vault.certfile                 = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] vault.collect_timing           = False {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] vault.insecure                 = False {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] vault.keyfile                  = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] vault.kv_mountpoint            = secret {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] vault.kv_version               = 2 {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] vault.namespace                = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] vault.root_token_id            = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] vault.split_loggers            = False {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] vault.ssl_ca_crt_file          = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] vault.timeout                  = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] vault.use_ssl                  = False {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] keystone.cafile                = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] keystone.certfile              = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] keystone.collect_timing        = False {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] keystone.connect_retries       = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] keystone.connect_retry_delay   = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] keystone.endpoint_override     = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] keystone.insecure              = False {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] keystone.keyfile               = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] keystone.max_version           = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] keystone.min_version           = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] keystone.region_name           = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] keystone.service_name          = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] keystone.service_type          = identity {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] keystone.split_loggers         = False {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] keystone.status_code_retries   = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] keystone.status_code_retry_delay = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] keystone.timeout               = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] keystone.version               = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] libvirt.connection_uri         =  {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] libvirt.cpu_mode               = custom {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] libvirt.cpu_model_extra_flags  = [] {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: WARNING oslo_config.cfg [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] libvirt.cpu_power_governor_high = performance {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] libvirt.cpu_power_governor_low = powersave {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] libvirt.cpu_power_management   = False {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] libvirt.device_detach_attempts = 8 {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] libvirt.device_detach_timeout  = 20 {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] libvirt.disk_cachemodes        = [] {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] libvirt.disk_prefix            = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] libvirt.enabled_perf_events    = [] {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] libvirt.file_backed_memory     = 0 {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] libvirt.gid_maps               = [] {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] libvirt.hw_disk_discard        = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] libvirt.hw_machine_type        = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] libvirt.images_rbd_ceph_conf   =  {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] libvirt.images_rbd_glance_store_name =  {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] libvirt.images_rbd_pool        = rbd {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] libvirt.images_type            = default {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] libvirt.images_volume_group    = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] libvirt.inject_key             = False {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] libvirt.inject_partition       = -2 {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] libvirt.inject_password        = False {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] libvirt.iscsi_iface            = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] libvirt.iser_use_multipath     = False {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] libvirt.live_migration_bandwidth = 0 {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] libvirt.live_migration_completion_timeout = 800 {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] libvirt.live_migration_downtime = 500 {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] libvirt.live_migration_downtime_delay = 75 {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] libvirt.live_migration_downtime_steps = 10 {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] libvirt.live_migration_inbound_addr = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] libvirt.live_migration_permit_auto_converge = False {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] libvirt.live_migration_permit_post_copy = False {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] libvirt.live_migration_scheme  = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] libvirt.live_migration_timeout_action = abort {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] libvirt.live_migration_tunnelled = False {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: WARNING oslo_config.cfg [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Aug 09 15:10:58 user nova-compute[72382]: live_migration_uri is deprecated for removal in favor of two other options that
Aug 09 15:10:58 user nova-compute[72382]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Aug 09 15:10:58 user nova-compute[72382]: and ``live_migration_inbound_addr`` respectively.
Aug 09 15:10:58 user nova-compute[72382]: ).  Its value may be silently ignored in the future.
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] libvirt.live_migration_with_native_tls = False {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] libvirt.max_queues             = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] libvirt.mem_stats_period_seconds = 10 {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] libvirt.nfs_mount_options      = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] libvirt.num_aoe_discover_tries = 3 {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] libvirt.num_iser_scan_tries    = 5 {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] libvirt.num_memory_encrypted_guests = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] libvirt.num_nvme_discover_tries = 5 {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] libvirt.num_pcie_ports         = 0 {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] libvirt.num_volume_scan_tries  = 5 {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] libvirt.pmem_namespaces        = [] {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] libvirt.quobyte_client_cfg     = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] libvirt.rbd_connect_timeout    = 5 {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] libvirt.rbd_secret_uuid        = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] libvirt.rbd_user               = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] libvirt.realtime_scheduler_priority = 1 {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] libvirt.remote_filesystem_transport = ssh {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] libvirt.rescue_image_id        = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] libvirt.rescue_kernel_id       = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] libvirt.rescue_ramdisk_id      = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] libvirt.rx_queue_size          = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] libvirt.smbfs_mount_options    =  {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] libvirt.snapshot_compression   = False {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] libvirt.snapshot_image_format  = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] libvirt.sparse_logical_volumes = False {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] libvirt.swtpm_enabled          = False {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] libvirt.swtpm_group            = tss {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] libvirt.swtpm_user             = tss {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] libvirt.sysinfo_serial         = unique {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] libvirt.tb_cache_size          = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] libvirt.tx_queue_size          = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] libvirt.uid_maps               = [] {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] libvirt.use_virtio_for_bridges = True {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] libvirt.virt_type              = kvm {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] libvirt.volume_clear           = zero {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] libvirt.volume_clear_size      = 0 {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] libvirt.volume_use_multipath   = False {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] libvirt.vzstorage_cache_path   = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] libvirt.vzstorage_mount_group  = qemu {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] libvirt.vzstorage_mount_opts   = [] {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] libvirt.vzstorage_mount_user   = stack {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] neutron.auth_section           = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] neutron.auth_type              = password {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] neutron.cafile                 = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] neutron.certfile               = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] neutron.collect_timing         = False {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] neutron.connect_retries        = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] neutron.connect_retry_delay    = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] neutron.default_floating_pool  = public {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] neutron.endpoint_override      = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] neutron.extension_sync_interval = 600 {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] neutron.http_retries           = 3 {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] neutron.insecure               = False {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] neutron.keyfile                = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] neutron.max_version            = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] neutron.metadata_proxy_shared_secret = **** {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] neutron.min_version            = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] neutron.ovs_bridge             = br-int {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] neutron.physnets               = [] {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] neutron.region_name            = RegionOne {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] neutron.service_metadata_proxy = True {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] neutron.service_name           = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] neutron.service_type           = network {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] neutron.split_loggers          = False {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] neutron.status_code_retries    = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] neutron.status_code_retry_delay = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] neutron.timeout                = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] neutron.version                = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] notifications.bdms_in_notifications = False {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] notifications.default_level    = INFO {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] notifications.notification_format = unversioned {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] notifications.notify_on_state_change = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] pci.alias                      = [] {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] pci.device_spec                = [] {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] pci.report_in_placement        = False {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] placement.auth_section         = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] placement.auth_type            = password {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] placement.cafile               = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] placement.certfile             = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] placement.collect_timing       = False {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] placement.connect_retries      = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] placement.connect_retry_delay  = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] placement.default_domain_id    = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] placement.default_domain_name  = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] placement.domain_id            = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] placement.domain_name          = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] placement.endpoint_override    = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] placement.insecure             = False {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] placement.keyfile              = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] placement.max_version          = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] placement.min_version          = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] placement.password             = **** {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] placement.project_domain_id    = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] placement.project_domain_name  = Default {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] placement.project_id           = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] placement.project_name         = service {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] placement.region_name          = RegionOne {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] placement.service_name         = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] placement.service_type         = placement {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] placement.split_loggers        = False {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] placement.status_code_retries  = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] placement.status_code_retry_delay = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] placement.system_scope         = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] placement.timeout              = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] placement.trust_id             = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] placement.user_domain_id       = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] placement.user_domain_name     = Default {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] placement.user_id              = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] placement.username             = placement {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] placement.version              = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] quota.cores                    = 20 {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] quota.count_usage_from_placement = False {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] quota.injected_file_content_bytes = 10240 {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] quota.injected_file_path_length = 255 {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] quota.injected_files           = 5 {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] quota.instances                = 10 {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] quota.key_pairs                = 100 {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] quota.metadata_items           = 128 {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] quota.ram                      = 51200 {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] quota.recheck_quota            = True {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] quota.server_group_members     = 10 {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] quota.server_groups            = 10 {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] rdp.enabled                    = False {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] scheduler.image_metadata_prefilter = False {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] scheduler.max_attempts         = 3 {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] scheduler.max_placement_results = 1000 {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] scheduler.query_placement_for_availability_zone = True {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] scheduler.query_placement_for_image_type_support = False {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] scheduler.workers              = 3 {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] filter_scheduler.host_subset_size = 1 {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] filter_scheduler.image_properties_default_architecture = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] filter_scheduler.isolated_hosts = [] {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] filter_scheduler.isolated_images = [] {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] filter_scheduler.max_instances_per_host = 50 {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] filter_scheduler.pci_in_placement = False {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] filter_scheduler.track_instance_changes = False {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] metrics.required               = True {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] metrics.weight_multiplier      = 1.0 {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] metrics.weight_setting         = [] {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] serial_console.enabled         = False {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] serial_console.port_range      = 10000:20000 {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] serial_console.serialproxy_port = 6083 {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] service_user.auth_section      = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] service_user.auth_type         = password {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] service_user.cafile            = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] service_user.certfile          = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] service_user.collect_timing    = False {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] service_user.insecure          = False {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] service_user.keyfile           = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] service_user.send_service_user_token = True {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] service_user.split_loggers     = False {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] service_user.timeout           = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] spice.agent_enabled            = True {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] spice.enabled                  = False {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] spice.html5proxy_port          = 6082 {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] spice.image_compression        = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] spice.jpeg_compression         = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] spice.playback_compression     = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] spice.server_listen            = 127.0.0.1 {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] spice.streaming_mode           = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] spice.zlib_compression         = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] upgrade_levels.baseapi         = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] upgrade_levels.cert            = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] upgrade_levels.compute         = auto {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] upgrade_levels.conductor       = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] upgrade_levels.scheduler       = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] vendordata_dynamic_auth.auth_section = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] vendordata_dynamic_auth.auth_type = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] vendordata_dynamic_auth.cafile = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] vendordata_dynamic_auth.certfile = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] vendordata_dynamic_auth.collect_timing = False {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] vendordata_dynamic_auth.insecure = False {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] vendordata_dynamic_auth.keyfile = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] vendordata_dynamic_auth.split_loggers = False {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] vendordata_dynamic_auth.timeout = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] vmware.api_retry_count         = 10 {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] vmware.ca_file                 = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] vmware.cache_prefix            = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] vmware.cluster_name            = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] vmware.connection_pool_size    = 10 {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] vmware.console_delay_seconds   = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] vmware.datastore_regex         = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] vmware.host_ip                 = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] vmware.host_password           = **** {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] vmware.host_port               = 443 {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] vmware.host_username           = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] vmware.insecure                = False {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] vmware.integration_bridge      = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] vmware.maximum_objects         = 100 {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] vmware.pbm_default_policy      = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] vmware.pbm_enabled             = False {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] vmware.pbm_wsdl_location       = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] vmware.serial_port_proxy_uri   = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] vmware.serial_port_service_uri = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] vmware.task_poll_interval      = 0.5 {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] vmware.use_linked_clone        = True {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] vmware.vnc_keymap              = en-us {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] vmware.vnc_port                = 5900 {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] vmware.vnc_port_total          = 10000 {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] vnc.auth_schemes               = ['none'] {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] vnc.enabled                    = True {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] vnc.novncproxy_port            = 6080 {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] vnc.server_listen              = 0.0.0.0 {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] vnc.vencrypt_ca_certs          = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] vnc.vencrypt_client_cert       = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] vnc.vencrypt_client_key        = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] workarounds.disable_fallback_pcpu_query = False {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] workarounds.disable_group_policy_check_upcall = True {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] workarounds.disable_rootwrap   = False {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] workarounds.enable_numa_live_migration = False {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] workarounds.handle_virt_lifecycle_events = True {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] workarounds.libvirt_disable_apic = False {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] workarounds.never_download_image_if_on_rbd = False {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] wsgi.client_socket_timeout     = 900 {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] wsgi.default_pool_size         = 1000 {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] wsgi.keep_alive                = True {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] wsgi.max_header_line           = 16384 {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] wsgi.secure_proxy_ssl_header   = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] wsgi.ssl_ca_file               = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] wsgi.ssl_cert_file             = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] wsgi.ssl_key_file              = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] wsgi.tcp_keepidle              = 600 {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] zvm.ca_file                    = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] zvm.cloud_connector_url        = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] zvm.reachable_timeout          = 300 {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] oslo_policy.enforce_new_defaults = True {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] oslo_policy.enforce_scope      = True {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] oslo_policy.policy_default_rule = default {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] oslo_policy.policy_file        = policy.yaml {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] profiler.connection_string     = messaging:// {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] profiler.enabled               = False {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] profiler.es_doc_type           = notification {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] profiler.es_scroll_size        = 10000 {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] profiler.es_scroll_time        = 2m {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] profiler.filter_error_trace    = False {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] profiler.hmac_keys             = **** {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] profiler.sentinel_service_name = mymaster {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] profiler.socket_timeout        = 0.1 {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] profiler.trace_requests        = False {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] profiler.trace_sqlalchemy      = False {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] profiler_jaeger.process_tags   = {} {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] profiler_jaeger.service_name_prefix = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] profiler_otlp.service_name_prefix = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] remote_debug.host              = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] remote_debug.port              = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] oslo_messaging_rabbit.ssl      = False {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] oslo_messaging_notifications.retry = -1 {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] oslo_messaging_notifications.transport_url = **** {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] oslo_limit.auth_section        = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] oslo_limit.auth_type           = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] oslo_limit.cafile              = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] oslo_limit.certfile            = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] oslo_limit.collect_timing      = False {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] oslo_limit.connect_retries     = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] oslo_limit.connect_retry_delay = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] oslo_limit.endpoint_id         = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] oslo_limit.endpoint_override   = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] oslo_limit.insecure            = False {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] oslo_limit.keyfile             = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] oslo_limit.max_version         = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] oslo_limit.min_version         = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] oslo_limit.region_name         = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] oslo_limit.service_name        = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] oslo_limit.service_type        = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] oslo_limit.split_loggers       = False {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] oslo_limit.status_code_retries = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] oslo_limit.status_code_retry_delay = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] oslo_limit.timeout             = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] oslo_limit.valid_interfaces    = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] oslo_limit.version             = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] oslo_reports.file_event_handler = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] oslo_reports.log_dir           = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] vif_plug_linux_bridge_privileged.group = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] vif_plug_linux_bridge_privileged.user = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] vif_plug_ovs_privileged.group  = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] vif_plug_ovs_privileged.helper_command = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] vif_plug_ovs_privileged.user   = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] os_vif_linux_bridge.flat_interface = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] os_vif_linux_bridge.vlan_interface = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] os_vif_ovs.isolate_vif         = False {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] os_vif_ovs.ovsdb_interface     = native {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] os_vif_ovs.per_port_bridge     = False {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] os_brick.lock_path             = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] privsep_osbrick.capabilities   = [21] {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] privsep_osbrick.group          = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] privsep_osbrick.helper_command = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] privsep_osbrick.thread_pool_size = 12 {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] privsep_osbrick.user           = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] nova_sys_admin.group           = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] nova_sys_admin.helper_command  = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] nova_sys_admin.thread_pool_size = 12 {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] nova_sys_admin.user            = None {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG oslo_service.service [None req-3e239b78-bd43-46a9-ba2f-2dc2ed77c526 None None] ******************************************************************************** {{(pid=72382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}}
Aug 09 15:10:58 user nova-compute[72382]: INFO nova.service [-] Starting compute node (version 0.0.0)
Aug 09 15:10:58 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Starting native event thread {{(pid=72382) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Starting green dispatch thread {{(pid=72382) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Starting connection event dispatch thread {{(pid=72382) initialize /opt/stack/nova/nova/virt/libvirt/host.py:620}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Connecting to libvirt: qemu:///system {{(pid=72382) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:503}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7f2a2e6d8af0> {{(pid=72382) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:509}}
Aug 09 15:10:58 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7f2a2e6d8af0> {{(pid=72382) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:530}}
Aug 09 15:10:58 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Connection event '1' reason 'None'
Aug 09 15:10:58 user nova-compute[72382]: WARNING nova.virt.libvirt.driver [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Aug 09 15:10:58 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.mount [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Initialising _HostMountState generation 0 {{(pid=72382) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Aug 09 15:11:05 user nova-compute[72382]: INFO nova.virt.libvirt.host [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Libvirt host capabilities <capabilities>
Aug 09 15:11:05 user nova-compute[72382]:   <host>
Aug 09 15:11:05 user nova-compute[72382]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Aug 09 15:11:05 user nova-compute[72382]:     <cpu>
Aug 09 15:11:05 user nova-compute[72382]:       <arch>x86_64</arch>
Aug 09 15:11:05 user nova-compute[72382]:       <model>IvyBridge-IBRS</model>
Aug 09 15:11:05 user nova-compute[72382]:       <vendor>Intel</vendor>
Aug 09 15:11:05 user nova-compute[72382]:       <microcode version='1070'/>
Aug 09 15:11:05 user nova-compute[72382]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Aug 09 15:11:05 user nova-compute[72382]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Aug 09 15:11:05 user nova-compute[72382]:       <feature name='ss'/>
Aug 09 15:11:05 user nova-compute[72382]:       <feature name='vmx'/>
Aug 09 15:11:05 user nova-compute[72382]:       <feature name='pcid'/>
Aug 09 15:11:05 user nova-compute[72382]:       <feature name='osxsave'/>
Aug 09 15:11:05 user nova-compute[72382]:       <feature name='hypervisor'/>
Aug 09 15:11:05 user nova-compute[72382]:       <feature name='arat'/>
Aug 09 15:11:05 user nova-compute[72382]:       <feature name='tsc_adjust'/>
Aug 09 15:11:05 user nova-compute[72382]:       <feature name='md-clear'/>
Aug 09 15:11:05 user nova-compute[72382]:       <feature name='stibp'/>
Aug 09 15:11:05 user nova-compute[72382]:       <feature name='arch-capabilities'/>
Aug 09 15:11:05 user nova-compute[72382]:       <feature name='ssbd'/>
Aug 09 15:11:05 user nova-compute[72382]:       <feature name='invtsc'/>
Aug 09 15:11:05 user nova-compute[72382]:       <feature name='rsba'/>
Aug 09 15:11:05 user nova-compute[72382]:       <feature name='skip-l1dfl-vmentry'/>
Aug 09 15:11:05 user nova-compute[72382]:       <pages unit='KiB' size='4'/>
Aug 09 15:11:05 user nova-compute[72382]:       <pages unit='KiB' size='2048'/>
Aug 09 15:11:05 user nova-compute[72382]:     </cpu>
Aug 09 15:11:05 user nova-compute[72382]:     <power_management>
Aug 09 15:11:05 user nova-compute[72382]:       <suspend_mem/>
Aug 09 15:11:05 user nova-compute[72382]:       <suspend_disk/>
Aug 09 15:11:05 user nova-compute[72382]:       <suspend_hybrid/>
Aug 09 15:11:05 user nova-compute[72382]:     </power_management>
Aug 09 15:11:05 user nova-compute[72382]:     <iommu support='no'/>
Aug 09 15:11:05 user nova-compute[72382]:     <migration_features>
Aug 09 15:11:05 user nova-compute[72382]:       <live/>
Aug 09 15:11:05 user nova-compute[72382]:       <uri_transports>
Aug 09 15:11:05 user nova-compute[72382]:         <uri_transport>tcp</uri_transport>
Aug 09 15:11:05 user nova-compute[72382]:         <uri_transport>rdma</uri_transport>
Aug 09 15:11:05 user nova-compute[72382]:       </uri_transports>
Aug 09 15:11:05 user nova-compute[72382]:     </migration_features>
Aug 09 15:11:05 user nova-compute[72382]:     <topology>
Aug 09 15:11:05 user nova-compute[72382]:       <cells num='2'>
Aug 09 15:11:05 user nova-compute[72382]:         <cell id='0'>
Aug 09 15:11:05 user nova-compute[72382]:           <memory unit='KiB'>8189224</memory>
Aug 09 15:11:05 user nova-compute[72382]:           <pages unit='KiB' size='4'>2047306</pages>
Aug 09 15:11:05 user nova-compute[72382]:           <pages unit='KiB' size='2048'>0</pages>
Aug 09 15:11:05 user nova-compute[72382]:           <distances>
Aug 09 15:11:05 user nova-compute[72382]:             <sibling id='0' value='10'/>
Aug 09 15:11:05 user nova-compute[72382]:             <sibling id='1' value='20'/>
Aug 09 15:11:05 user nova-compute[72382]:           </distances>
Aug 09 15:11:05 user nova-compute[72382]:           <cpus num='6'>
Aug 09 15:11:05 user nova-compute[72382]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Aug 09 15:11:05 user nova-compute[72382]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Aug 09 15:11:05 user nova-compute[72382]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Aug 09 15:11:05 user nova-compute[72382]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Aug 09 15:11:05 user nova-compute[72382]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Aug 09 15:11:05 user nova-compute[72382]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Aug 09 15:11:05 user nova-compute[72382]:           </cpus>
Aug 09 15:11:05 user nova-compute[72382]:         </cell>
Aug 09 15:11:05 user nova-compute[72382]:         <cell id='1'>
Aug 09 15:11:05 user nova-compute[72382]:           <memory unit='KiB'>8206460</memory>
Aug 09 15:11:05 user nova-compute[72382]:           <pages unit='KiB' size='4'>2051615</pages>
Aug 09 15:11:05 user nova-compute[72382]:           <pages unit='KiB' size='2048'>0</pages>
Aug 09 15:11:05 user nova-compute[72382]:           <distances>
Aug 09 15:11:05 user nova-compute[72382]:             <sibling id='0' value='20'/>
Aug 09 15:11:05 user nova-compute[72382]:             <sibling id='1' value='10'/>
Aug 09 15:11:05 user nova-compute[72382]:           </distances>
Aug 09 15:11:05 user nova-compute[72382]:           <cpus num='6'>
Aug 09 15:11:05 user nova-compute[72382]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Aug 09 15:11:05 user nova-compute[72382]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Aug 09 15:11:05 user nova-compute[72382]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Aug 09 15:11:05 user nova-compute[72382]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Aug 09 15:11:05 user nova-compute[72382]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Aug 09 15:11:05 user nova-compute[72382]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Aug 09 15:11:05 user nova-compute[72382]:           </cpus>
Aug 09 15:11:05 user nova-compute[72382]:         </cell>
Aug 09 15:11:05 user nova-compute[72382]:       </cells>
Aug 09 15:11:05 user nova-compute[72382]:     </topology>
Aug 09 15:11:05 user nova-compute[72382]:     <cache>
Aug 09 15:11:05 user nova-compute[72382]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Aug 09 15:11:05 user nova-compute[72382]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Aug 09 15:11:05 user nova-compute[72382]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Aug 09 15:11:05 user nova-compute[72382]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Aug 09 15:11:05 user nova-compute[72382]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Aug 09 15:11:05 user nova-compute[72382]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Aug 09 15:11:05 user nova-compute[72382]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Aug 09 15:11:05 user nova-compute[72382]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Aug 09 15:11:05 user nova-compute[72382]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Aug 09 15:11:05 user nova-compute[72382]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Aug 09 15:11:05 user nova-compute[72382]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Aug 09 15:11:05 user nova-compute[72382]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Aug 09 15:11:05 user nova-compute[72382]:     </cache>
Aug 09 15:11:05 user nova-compute[72382]:     <secmodel>
Aug 09 15:11:05 user nova-compute[72382]:       <model>apparmor</model>
Aug 09 15:11:05 user nova-compute[72382]:       <doi>0</doi>
Aug 09 15:11:05 user nova-compute[72382]:     </secmodel>
Aug 09 15:11:05 user nova-compute[72382]:     <secmodel>
Aug 09 15:11:05 user nova-compute[72382]:       <model>dac</model>
Aug 09 15:11:05 user nova-compute[72382]:       <doi>0</doi>
Aug 09 15:11:05 user nova-compute[72382]:       <baselabel type='kvm'>+64055:+108</baselabel>
Aug 09 15:11:05 user nova-compute[72382]:       <baselabel type='qemu'>+64055:+108</baselabel>
Aug 09 15:11:05 user nova-compute[72382]:     </secmodel>
Aug 09 15:11:05 user nova-compute[72382]:   </host>
Aug 09 15:11:05 user nova-compute[72382]:   <guest>
Aug 09 15:11:05 user nova-compute[72382]:     <os_type>hvm</os_type>
Aug 09 15:11:05 user nova-compute[72382]:     <arch name='alpha'>
Aug 09 15:11:05 user nova-compute[72382]:       <wordsize>64</wordsize>
Aug 09 15:11:05 user nova-compute[72382]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='4'>clipper</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <domain type='qemu'/>
Aug 09 15:11:05 user nova-compute[72382]:     </arch>
Aug 09 15:11:05 user nova-compute[72382]:     <features>
Aug 09 15:11:05 user nova-compute[72382]:       <cpuselection/>
Aug 09 15:11:05 user nova-compute[72382]:       <deviceboot/>
Aug 09 15:11:05 user nova-compute[72382]:       <disksnapshot default='on' toggle='no'/>
Aug 09 15:11:05 user nova-compute[72382]:     </features>
Aug 09 15:11:05 user nova-compute[72382]:   </guest>
Aug 09 15:11:05 user nova-compute[72382]:   <guest>
Aug 09 15:11:05 user nova-compute[72382]:     <os_type>hvm</os_type>
Aug 09 15:11:05 user nova-compute[72382]:     <arch name='armv6l'>
Aug 09 15:11:05 user nova-compute[72382]:       <wordsize>32</wordsize>
Aug 09 15:11:05 user nova-compute[72382]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='1'>integratorcp</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='2'>ast2600-evb</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='1'>borzoi</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='1'>spitz</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='255'>virt-2.7</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='2'>nuri</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='1'>romulus-bmc</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='512'>virt-3.0</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='512'>virt-5.0</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='2'>npcm750-evb</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='255'>virt-2.10</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='2'>rainier-bmc</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='1'>mps3-an547</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='2'>musca-b1</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='1'>versatileab</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='1'>kzm</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='255'>virt-2.8</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='2'>musca-a</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='512'>virt-3.1</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='512'>virt-5.1</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='2'>smdkc210</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='1'>sx1</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='255'>virt-2.11</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='1'>imx25-pdk</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='255'>virt-2.9</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='4'>orangepi-pc</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='1'>z2</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='512'>virt-5.2</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='1'>tosa</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='1'>mps2-an500</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='255'>virt-2.12</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='2'>mps2-an521</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='4'>sabrelite</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='1'>mps2-an511</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='1'>canon-a1100</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='1'>realview-eb</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='1'>emcraft-sf2</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='1'>realview-pb-a8</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='512'>virt-4.0</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='1'>raspi1ap</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='1'>palmetto-bmc</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='1'>sx1-v1</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='1'>n810</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='1'>g220a-bmc</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='1'>n800</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='2'>tacoma-bmc</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='512'>virt-4.1</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='2'>quanta-gsj</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='1'>versatilepb</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='1'>terrier</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='1'>mainstone</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='512'>virt-4.2</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='2'>mps3-an524</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='2'>kudo-bmc</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='4'>vexpress-a9</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='4'>midway</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='1'>musicpal</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='1'>lm3s811evb</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='1'>lm3s6965evb</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='1'>microbit</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='1'>mps2-an505</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='1'>mps2-an385</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='512'>virt-6.0</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='1'>cubieboard</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='1'>verdex</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='1'>netduino2</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='1'>mps2-an386</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='512'>virt-6.1</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='4'>raspi2b</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='4'>vexpress-a15</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='2'>fuji-bmc</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='512'>virt-6.2</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='1'>cheetah</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='255'>virt-2.6</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='1'>ast2500-evb</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='4'>highbank</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='1'>akita</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='1'>connex</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='1'>netduinoplus2</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='1'>collie</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='1'>raspi0</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <domain type='qemu'/>
Aug 09 15:11:05 user nova-compute[72382]:     </arch>
Aug 09 15:11:05 user nova-compute[72382]:     <features>
Aug 09 15:11:05 user nova-compute[72382]:       <cpuselection/>
Aug 09 15:11:05 user nova-compute[72382]:       <deviceboot/>
Aug 09 15:11:05 user nova-compute[72382]:       <disksnapshot default='on' toggle='no'/>
Aug 09 15:11:05 user nova-compute[72382]:     </features>
Aug 09 15:11:05 user nova-compute[72382]:   </guest>
Aug 09 15:11:05 user nova-compute[72382]:   <guest>
Aug 09 15:11:05 user nova-compute[72382]:     <os_type>hvm</os_type>
Aug 09 15:11:05 user nova-compute[72382]:     <arch name='armv7l'>
Aug 09 15:11:05 user nova-compute[72382]:       <wordsize>32</wordsize>
Aug 09 15:11:05 user nova-compute[72382]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='1'>integratorcp</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='2'>ast2600-evb</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='1'>borzoi</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='1'>spitz</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='255'>virt-2.7</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='2'>nuri</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='1'>romulus-bmc</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='512'>virt-3.0</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='512'>virt-5.0</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='2'>npcm750-evb</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='255'>virt-2.10</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='2'>rainier-bmc</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='1'>mps3-an547</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='2'>musca-b1</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='1'>versatileab</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='1'>kzm</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='255'>virt-2.8</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='2'>musca-a</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='512'>virt-3.1</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='512'>virt-5.1</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='2'>smdkc210</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='1'>sx1</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='255'>virt-2.11</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='1'>imx25-pdk</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='255'>virt-2.9</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='4'>orangepi-pc</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='1'>z2</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='512'>virt-5.2</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='1'>tosa</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='1'>mps2-an500</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='255'>virt-2.12</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='2'>mps2-an521</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='4'>sabrelite</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='1'>mps2-an511</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='1'>canon-a1100</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='1'>realview-eb</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='1'>emcraft-sf2</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='1'>realview-pb-a8</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='512'>virt-4.0</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='1'>raspi1ap</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='1'>palmetto-bmc</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='1'>sx1-v1</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='1'>n810</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='1'>g220a-bmc</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='1'>n800</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='2'>tacoma-bmc</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='512'>virt-4.1</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='2'>quanta-gsj</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='1'>versatilepb</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='1'>terrier</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='1'>mainstone</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='512'>virt-4.2</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='2'>mps3-an524</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='2'>kudo-bmc</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='4'>vexpress-a9</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='4'>midway</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='1'>musicpal</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='1'>lm3s811evb</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='1'>lm3s6965evb</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='1'>microbit</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='1'>mps2-an505</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='1'>mps2-an385</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='512'>virt-6.0</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='1'>cubieboard</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='1'>verdex</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='1'>netduino2</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='1'>mps2-an386</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='512'>virt-6.1</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='4'>raspi2b</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='4'>vexpress-a15</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='2'>fuji-bmc</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='512'>virt-6.2</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='1'>cheetah</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='255'>virt-2.6</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='1'>ast2500-evb</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='4'>highbank</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='1'>akita</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='1'>connex</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='1'>netduinoplus2</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='1'>collie</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='1'>raspi0</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <domain type='qemu'/>
Aug 09 15:11:05 user nova-compute[72382]:     </arch>
Aug 09 15:11:05 user nova-compute[72382]:     <features>
Aug 09 15:11:05 user nova-compute[72382]:       <cpuselection/>
Aug 09 15:11:05 user nova-compute[72382]:       <deviceboot/>
Aug 09 15:11:05 user nova-compute[72382]:       <disksnapshot default='on' toggle='no'/>
Aug 09 15:11:05 user nova-compute[72382]:     </features>
Aug 09 15:11:05 user nova-compute[72382]:   </guest>
Aug 09 15:11:05 user nova-compute[72382]:   <guest>
Aug 09 15:11:05 user nova-compute[72382]:     <os_type>hvm</os_type>
Aug 09 15:11:05 user nova-compute[72382]:     <arch name='aarch64'>
Aug 09 15:11:05 user nova-compute[72382]:       <wordsize>64</wordsize>
Aug 09 15:11:05 user nova-compute[72382]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='1'>integratorcp</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='2'>ast2600-evb</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='1'>borzoi</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='1'>spitz</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='255'>virt-2.7</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='2'>nuri</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='1'>romulus-bmc</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='512'>virt-3.0</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='512'>virt-5.0</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='2'>npcm750-evb</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='255'>virt-2.10</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='2'>rainier-bmc</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='1'>mps3-an547</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='255'>virt-2.8</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='2'>musca-b1</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='1'>versatileab</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='1'>kzm</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='2'>musca-a</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='512'>virt-3.1</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='512'>virt-5.1</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='2'>smdkc210</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='1'>sx1</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='255'>virt-2.11</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='1'>imx25-pdk</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='255'>virt-2.9</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='4'>orangepi-pc</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='1'>z2</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='512'>virt-5.2</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='1'>tosa</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='1'>mps2-an500</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='255'>virt-2.12</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='2'>mps2-an521</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='4'>sabrelite</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='1'>mps2-an511</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='1'>canon-a1100</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='1'>realview-eb</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='1'>emcraft-sf2</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='1'>realview-pb-a8</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='512'>sbsa-ref</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='512'>virt-4.0</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='1'>raspi1ap</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='1'>palmetto-bmc</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='1'>sx1-v1</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='1'>n810</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='1'>g220a-bmc</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='1'>n800</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='2'>tacoma-bmc</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='512'>virt-4.1</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='2'>quanta-gsj</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='1'>versatilepb</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='1'>terrier</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='1'>mainstone</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='512'>virt-4.2</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='2'>mps3-an524</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='2'>kudo-bmc</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='4'>vexpress-a9</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='4'>midway</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='1'>musicpal</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='1'>lm3s811evb</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='1'>lm3s6965evb</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='1'>microbit</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='1'>mps2-an505</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='1'>mps2-an385</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='512'>virt-6.0</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='4'>raspi3ap</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='1'>cubieboard</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='1'>verdex</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='1'>netduino2</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='1'>mps2-an386</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='512'>virt-6.1</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='4'>raspi3b</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='4'>raspi2b</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='4'>vexpress-a15</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='2'>fuji-bmc</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='512'>virt-6.2</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='1'>cheetah</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='255'>virt-2.6</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='1'>ast2500-evb</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='4'>highbank</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='1'>akita</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='1'>connex</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='1'>netduinoplus2</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='1'>collie</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='1'>raspi0</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <domain type='qemu'/>
Aug 09 15:11:05 user nova-compute[72382]:     </arch>
Aug 09 15:11:05 user nova-compute[72382]:     <features>
Aug 09 15:11:05 user nova-compute[72382]:       <acpi default='on' toggle='yes'/>
Aug 09 15:11:05 user nova-compute[72382]:       <cpuselection/>
Aug 09 15:11:05 user nova-compute[72382]:       <deviceboot/>
Aug 09 15:11:05 user nova-compute[72382]:       <disksnapshot default='on' toggle='no'/>
Aug 09 15:11:05 user nova-compute[72382]:     </features>
Aug 09 15:11:05 user nova-compute[72382]:   </guest>
Aug 09 15:11:05 user nova-compute[72382]:   <guest>
Aug 09 15:11:05 user nova-compute[72382]:     <os_type>hvm</os_type>
Aug 09 15:11:05 user nova-compute[72382]:     <arch name='cris'>
Aug 09 15:11:05 user nova-compute[72382]:       <wordsize>32</wordsize>
Aug 09 15:11:05 user nova-compute[72382]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='1'>axis-dev88</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <domain type='qemu'/>
Aug 09 15:11:05 user nova-compute[72382]:     </arch>
Aug 09 15:11:05 user nova-compute[72382]:     <features>
Aug 09 15:11:05 user nova-compute[72382]:       <cpuselection/>
Aug 09 15:11:05 user nova-compute[72382]:       <deviceboot/>
Aug 09 15:11:05 user nova-compute[72382]:       <disksnapshot default='on' toggle='no'/>
Aug 09 15:11:05 user nova-compute[72382]:     </features>
Aug 09 15:11:05 user nova-compute[72382]:   </guest>
Aug 09 15:11:05 user nova-compute[72382]:   <guest>
Aug 09 15:11:05 user nova-compute[72382]:     <os_type>hvm</os_type>
Aug 09 15:11:05 user nova-compute[72382]:     <arch name='i686'>
Aug 09 15:11:05 user nova-compute[72382]:       <wordsize>32</wordsize>
Aug 09 15:11:05 user nova-compute[72382]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='288'>pc-q35-artful</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='1'>x-remote</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='1'>isapc</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='288'>pc-q35-disco</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='288'>pc-q35-impish</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='288'>pc-q35-focal</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='288'>microvm</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <domain type='qemu'/>
Aug 09 15:11:05 user nova-compute[72382]:       <domain type='kvm'/>
Aug 09 15:11:05 user nova-compute[72382]:     </arch>
Aug 09 15:11:05 user nova-compute[72382]:     <features>
Aug 09 15:11:05 user nova-compute[72382]:       <pae/>
Aug 09 15:11:05 user nova-compute[72382]:       <nonpae/>
Aug 09 15:11:05 user nova-compute[72382]:       <acpi default='on' toggle='yes'/>
Aug 09 15:11:05 user nova-compute[72382]:       <apic default='on' toggle='no'/>
Aug 09 15:11:05 user nova-compute[72382]:       <cpuselection/>
Aug 09 15:11:05 user nova-compute[72382]:       <deviceboot/>
Aug 09 15:11:05 user nova-compute[72382]:       <disksnapshot default='on' toggle='no'/>
Aug 09 15:11:05 user nova-compute[72382]:     </features>
Aug 09 15:11:05 user nova-compute[72382]:   </guest>
Aug 09 15:11:05 user nova-compute[72382]:   <guest>
Aug 09 15:11:05 user nova-compute[72382]:     <os_type>hvm</os_type>
Aug 09 15:11:05 user nova-compute[72382]:     <arch name='m68k'>
Aug 09 15:11:05 user nova-compute[72382]:       <wordsize>32</wordsize>
Aug 09 15:11:05 user nova-compute[72382]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='1'>mcf5208evb</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='1'>an5206</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='1'>virt-6.0</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='1'>q800</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='1'>virt-6.2</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='1'>next-cube</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='1'>virt-6.1</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <domain type='qemu'/>
Aug 09 15:11:05 user nova-compute[72382]:     </arch>
Aug 09 15:11:05 user nova-compute[72382]:     <features>
Aug 09 15:11:05 user nova-compute[72382]:       <cpuselection/>
Aug 09 15:11:05 user nova-compute[72382]:       <deviceboot/>
Aug 09 15:11:05 user nova-compute[72382]:       <disksnapshot default='on' toggle='no'/>
Aug 09 15:11:05 user nova-compute[72382]:     </features>
Aug 09 15:11:05 user nova-compute[72382]:   </guest>
Aug 09 15:11:05 user nova-compute[72382]:   <guest>
Aug 09 15:11:05 user nova-compute[72382]:     <os_type>hvm</os_type>
Aug 09 15:11:05 user nova-compute[72382]:     <arch name='microblaze'>
Aug 09 15:11:05 user nova-compute[72382]:       <wordsize>32</wordsize>
Aug 09 15:11:05 user nova-compute[72382]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='1'>petalogix-ml605</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <domain type='qemu'/>
Aug 09 15:11:05 user nova-compute[72382]:     </arch>
Aug 09 15:11:05 user nova-compute[72382]:     <features>
Aug 09 15:11:05 user nova-compute[72382]:       <cpuselection/>
Aug 09 15:11:05 user nova-compute[72382]:       <deviceboot/>
Aug 09 15:11:05 user nova-compute[72382]:       <disksnapshot default='on' toggle='no'/>
Aug 09 15:11:05 user nova-compute[72382]:     </features>
Aug 09 15:11:05 user nova-compute[72382]:   </guest>
Aug 09 15:11:05 user nova-compute[72382]:   <guest>
Aug 09 15:11:05 user nova-compute[72382]:     <os_type>hvm</os_type>
Aug 09 15:11:05 user nova-compute[72382]:     <arch name='microblazeel'>
Aug 09 15:11:05 user nova-compute[72382]:       <wordsize>32</wordsize>
Aug 09 15:11:05 user nova-compute[72382]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='1'>petalogix-ml605</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <domain type='qemu'/>
Aug 09 15:11:05 user nova-compute[72382]:     </arch>
Aug 09 15:11:05 user nova-compute[72382]:     <features>
Aug 09 15:11:05 user nova-compute[72382]:       <cpuselection/>
Aug 09 15:11:05 user nova-compute[72382]:       <deviceboot/>
Aug 09 15:11:05 user nova-compute[72382]:       <disksnapshot default='on' toggle='no'/>
Aug 09 15:11:05 user nova-compute[72382]:     </features>
Aug 09 15:11:05 user nova-compute[72382]:   </guest>
Aug 09 15:11:05 user nova-compute[72382]:   <guest>
Aug 09 15:11:05 user nova-compute[72382]:     <os_type>hvm</os_type>
Aug 09 15:11:05 user nova-compute[72382]:     <arch name='mips'>
Aug 09 15:11:05 user nova-compute[72382]:       <wordsize>32</wordsize>
Aug 09 15:11:05 user nova-compute[72382]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='16'>malta</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='1'>mipssim</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <domain type='qemu'/>
Aug 09 15:11:05 user nova-compute[72382]:     </arch>
Aug 09 15:11:05 user nova-compute[72382]:     <features>
Aug 09 15:11:05 user nova-compute[72382]:       <cpuselection/>
Aug 09 15:11:05 user nova-compute[72382]:       <deviceboot/>
Aug 09 15:11:05 user nova-compute[72382]:       <disksnapshot default='on' toggle='no'/>
Aug 09 15:11:05 user nova-compute[72382]:     </features>
Aug 09 15:11:05 user nova-compute[72382]:   </guest>
Aug 09 15:11:05 user nova-compute[72382]:   <guest>
Aug 09 15:11:05 user nova-compute[72382]:     <os_type>hvm</os_type>
Aug 09 15:11:05 user nova-compute[72382]:     <arch name='mipsel'>
Aug 09 15:11:05 user nova-compute[72382]:       <wordsize>32</wordsize>
Aug 09 15:11:05 user nova-compute[72382]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='16'>malta</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='1'>mipssim</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <domain type='qemu'/>
Aug 09 15:11:05 user nova-compute[72382]:     </arch>
Aug 09 15:11:05 user nova-compute[72382]:     <features>
Aug 09 15:11:05 user nova-compute[72382]:       <cpuselection/>
Aug 09 15:11:05 user nova-compute[72382]:       <deviceboot/>
Aug 09 15:11:05 user nova-compute[72382]:       <disksnapshot default='on' toggle='no'/>
Aug 09 15:11:05 user nova-compute[72382]:     </features>
Aug 09 15:11:05 user nova-compute[72382]:   </guest>
Aug 09 15:11:05 user nova-compute[72382]:   <guest>
Aug 09 15:11:05 user nova-compute[72382]:     <os_type>hvm</os_type>
Aug 09 15:11:05 user nova-compute[72382]:     <arch name='mips64'>
Aug 09 15:11:05 user nova-compute[72382]:       <wordsize>64</wordsize>
Aug 09 15:11:05 user nova-compute[72382]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='16'>malta</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='1'>mipssim</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='1'>pica61</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='1'>magnum</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <domain type='qemu'/>
Aug 09 15:11:05 user nova-compute[72382]:     </arch>
Aug 09 15:11:05 user nova-compute[72382]:     <features>
Aug 09 15:11:05 user nova-compute[72382]:       <cpuselection/>
Aug 09 15:11:05 user nova-compute[72382]:       <deviceboot/>
Aug 09 15:11:05 user nova-compute[72382]:       <disksnapshot default='on' toggle='no'/>
Aug 09 15:11:05 user nova-compute[72382]:     </features>
Aug 09 15:11:05 user nova-compute[72382]:   </guest>
Aug 09 15:11:05 user nova-compute[72382]:   <guest>
Aug 09 15:11:05 user nova-compute[72382]:     <os_type>hvm</os_type>
Aug 09 15:11:05 user nova-compute[72382]:     <arch name='mips64el'>
Aug 09 15:11:05 user nova-compute[72382]:       <wordsize>64</wordsize>
Aug 09 15:11:05 user nova-compute[72382]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='16'>malta</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='16'>loongson3-virt</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='1'>mipssim</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='1'>pica61</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='1'>magnum</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='16'>boston</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='1'>fuloong2e</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <domain type='qemu'/>
Aug 09 15:11:05 user nova-compute[72382]:     </arch>
Aug 09 15:11:05 user nova-compute[72382]:     <features>
Aug 09 15:11:05 user nova-compute[72382]:       <cpuselection/>
Aug 09 15:11:05 user nova-compute[72382]:       <deviceboot/>
Aug 09 15:11:05 user nova-compute[72382]:       <disksnapshot default='on' toggle='no'/>
Aug 09 15:11:05 user nova-compute[72382]:     </features>
Aug 09 15:11:05 user nova-compute[72382]:   </guest>
Aug 09 15:11:05 user nova-compute[72382]:   <guest>
Aug 09 15:11:05 user nova-compute[72382]:     <os_type>hvm</os_type>
Aug 09 15:11:05 user nova-compute[72382]:     <arch name='ppc'>
Aug 09 15:11:05 user nova-compute[72382]:       <wordsize>32</wordsize>
Aug 09 15:11:05 user nova-compute[72382]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='1'>g3beige</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='1'>virtex-ml507</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='1'>mac99</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='32'>ppce500</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='1'>pegasos2</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='1'>sam460ex</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='1'>bamboo</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='1'>40p</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='1'>ref405ep</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='15'>mpc8544ds</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='1'>taihu</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <domain type='qemu'/>
Aug 09 15:11:05 user nova-compute[72382]:     </arch>
Aug 09 15:11:05 user nova-compute[72382]:     <features>
Aug 09 15:11:05 user nova-compute[72382]:       <cpuselection/>
Aug 09 15:11:05 user nova-compute[72382]:       <deviceboot/>
Aug 09 15:11:05 user nova-compute[72382]:       <disksnapshot default='on' toggle='no'/>
Aug 09 15:11:05 user nova-compute[72382]:     </features>
Aug 09 15:11:05 user nova-compute[72382]:   </guest>
Aug 09 15:11:05 user nova-compute[72382]:   <guest>
Aug 09 15:11:05 user nova-compute[72382]:     <os_type>hvm</os_type>
Aug 09 15:11:05 user nova-compute[72382]:     <arch name='ppc64'>
Aug 09 15:11:05 user nova-compute[72382]:       <wordsize>64</wordsize>
Aug 09 15:11:05 user nova-compute[72382]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='2048'>powernv9</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='1'>taihu</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='15'>mpc8544ds</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='2048'>powernv10</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='32'>ppce500</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='1'>40p</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='1'>pegasos2</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='1'>bamboo</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='1'>g3beige</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='1'>virtex-ml507</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='1'>mac99</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='1'>sam460ex</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='1'>ref405ep</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='2048'>powernv8</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <domain type='qemu'/>
Aug 09 15:11:05 user nova-compute[72382]:     </arch>
Aug 09 15:11:05 user nova-compute[72382]:     <features>
Aug 09 15:11:05 user nova-compute[72382]:       <cpuselection/>
Aug 09 15:11:05 user nova-compute[72382]:       <deviceboot/>
Aug 09 15:11:05 user nova-compute[72382]:       <disksnapshot default='on' toggle='no'/>
Aug 09 15:11:05 user nova-compute[72382]:     </features>
Aug 09 15:11:05 user nova-compute[72382]:   </guest>
Aug 09 15:11:05 user nova-compute[72382]:   <guest>
Aug 09 15:11:05 user nova-compute[72382]:     <os_type>hvm</os_type>
Aug 09 15:11:05 user nova-compute[72382]:     <arch name='ppc64le'>
Aug 09 15:11:05 user nova-compute[72382]:       <wordsize>64</wordsize>
Aug 09 15:11:05 user nova-compute[72382]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='2048'>powernv9</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='1'>taihu</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='15'>mpc8544ds</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='2048'>powernv10</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='32'>ppce500</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='1'>40p</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='1'>pegasos2</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='1'>bamboo</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='1'>g3beige</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='1'>virtex-ml507</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='1'>mac99</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='1'>sam460ex</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='1'>ref405ep</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='2048'>powernv8</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <domain type='qemu'/>
Aug 09 15:11:05 user nova-compute[72382]:     </arch>
Aug 09 15:11:05 user nova-compute[72382]:     <features>
Aug 09 15:11:05 user nova-compute[72382]:       <cpuselection/>
Aug 09 15:11:05 user nova-compute[72382]:       <deviceboot/>
Aug 09 15:11:05 user nova-compute[72382]:       <disksnapshot default='on' toggle='no'/>
Aug 09 15:11:05 user nova-compute[72382]:     </features>
Aug 09 15:11:05 user nova-compute[72382]:   </guest>
Aug 09 15:11:05 user nova-compute[72382]:   <guest>
Aug 09 15:11:05 user nova-compute[72382]:     <os_type>hvm</os_type>
Aug 09 15:11:05 user nova-compute[72382]:     <arch name='riscv32'>
Aug 09 15:11:05 user nova-compute[72382]:       <wordsize>32</wordsize>
Aug 09 15:11:05 user nova-compute[72382]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='8'>spike</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='1'>opentitan</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='5'>sifive_u</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='1'>sifive_e</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='8'>virt</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <domain type='qemu'/>
Aug 09 15:11:05 user nova-compute[72382]:     </arch>
Aug 09 15:11:05 user nova-compute[72382]:     <features>
Aug 09 15:11:05 user nova-compute[72382]:       <cpuselection/>
Aug 09 15:11:05 user nova-compute[72382]:       <deviceboot/>
Aug 09 15:11:05 user nova-compute[72382]:       <disksnapshot default='on' toggle='no'/>
Aug 09 15:11:05 user nova-compute[72382]:     </features>
Aug 09 15:11:05 user nova-compute[72382]:   </guest>
Aug 09 15:11:05 user nova-compute[72382]:   <guest>
Aug 09 15:11:05 user nova-compute[72382]:     <os_type>hvm</os_type>
Aug 09 15:11:05 user nova-compute[72382]:     <arch name='riscv64'>
Aug 09 15:11:05 user nova-compute[72382]:       <wordsize>64</wordsize>
Aug 09 15:11:05 user nova-compute[72382]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='8'>spike</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='5'>sifive_u</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='1'>shakti_c</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='1'>sifive_e</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='8'>virt</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <domain type='qemu'/>
Aug 09 15:11:05 user nova-compute[72382]:     </arch>
Aug 09 15:11:05 user nova-compute[72382]:     <features>
Aug 09 15:11:05 user nova-compute[72382]:       <cpuselection/>
Aug 09 15:11:05 user nova-compute[72382]:       <deviceboot/>
Aug 09 15:11:05 user nova-compute[72382]:       <disksnapshot default='on' toggle='no'/>
Aug 09 15:11:05 user nova-compute[72382]:     </features>
Aug 09 15:11:05 user nova-compute[72382]:   </guest>
Aug 09 15:11:05 user nova-compute[72382]:   <guest>
Aug 09 15:11:05 user nova-compute[72382]:     <os_type>hvm</os_type>
Aug 09 15:11:05 user nova-compute[72382]:     <arch name='s390x'>
Aug 09 15:11:05 user nova-compute[72382]:       <wordsize>64</wordsize>
Aug 09 15:11:05 user nova-compute[72382]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <domain type='qemu'/>
Aug 09 15:11:05 user nova-compute[72382]:     </arch>
Aug 09 15:11:05 user nova-compute[72382]:     <features>
Aug 09 15:11:05 user nova-compute[72382]:       <cpuselection/>
Aug 09 15:11:05 user nova-compute[72382]:       <deviceboot/>
Aug 09 15:11:05 user nova-compute[72382]:       <disksnapshot default='on' toggle='no'/>
Aug 09 15:11:05 user nova-compute[72382]:     </features>
Aug 09 15:11:05 user nova-compute[72382]:   </guest>
Aug 09 15:11:05 user nova-compute[72382]:   <guest>
Aug 09 15:11:05 user nova-compute[72382]:     <os_type>hvm</os_type>
Aug 09 15:11:05 user nova-compute[72382]:     <arch name='sh4'>
Aug 09 15:11:05 user nova-compute[72382]:       <wordsize>32</wordsize>
Aug 09 15:11:05 user nova-compute[72382]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='1'>shix</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='1'>r2d</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <domain type='qemu'/>
Aug 09 15:11:05 user nova-compute[72382]:     </arch>
Aug 09 15:11:05 user nova-compute[72382]:     <features>
Aug 09 15:11:05 user nova-compute[72382]:       <cpuselection/>
Aug 09 15:11:05 user nova-compute[72382]:       <deviceboot/>
Aug 09 15:11:05 user nova-compute[72382]:       <disksnapshot default='on' toggle='no'/>
Aug 09 15:11:05 user nova-compute[72382]:     </features>
Aug 09 15:11:05 user nova-compute[72382]:   </guest>
Aug 09 15:11:05 user nova-compute[72382]:   <guest>
Aug 09 15:11:05 user nova-compute[72382]:     <os_type>hvm</os_type>
Aug 09 15:11:05 user nova-compute[72382]:     <arch name='sh4eb'>
Aug 09 15:11:05 user nova-compute[72382]:       <wordsize>64</wordsize>
Aug 09 15:11:05 user nova-compute[72382]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='1'>shix</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='1'>r2d</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <domain type='qemu'/>
Aug 09 15:11:05 user nova-compute[72382]:     </arch>
Aug 09 15:11:05 user nova-compute[72382]:     <features>
Aug 09 15:11:05 user nova-compute[72382]:       <cpuselection/>
Aug 09 15:11:05 user nova-compute[72382]:       <deviceboot/>
Aug 09 15:11:05 user nova-compute[72382]:       <disksnapshot default='on' toggle='no'/>
Aug 09 15:11:05 user nova-compute[72382]:     </features>
Aug 09 15:11:05 user nova-compute[72382]:   </guest>
Aug 09 15:11:05 user nova-compute[72382]:   <guest>
Aug 09 15:11:05 user nova-compute[72382]:     <os_type>hvm</os_type>
Aug 09 15:11:05 user nova-compute[72382]:     <arch name='sparc'>
Aug 09 15:11:05 user nova-compute[72382]:       <wordsize>32</wordsize>
Aug 09 15:11:05 user nova-compute[72382]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='1'>SS-5</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='4'>SS-20</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='1'>LX</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='1'>SPARCClassic</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='1'>leon3_generic</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='1'>SPARCbook</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='1'>SS-4</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='4'>SS-600MP</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='4'>SS-10</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='1'>Voyager</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <domain type='qemu'/>
Aug 09 15:11:05 user nova-compute[72382]:     </arch>
Aug 09 15:11:05 user nova-compute[72382]:     <features>
Aug 09 15:11:05 user nova-compute[72382]:       <cpuselection/>
Aug 09 15:11:05 user nova-compute[72382]:       <deviceboot/>
Aug 09 15:11:05 user nova-compute[72382]:       <disksnapshot default='on' toggle='no'/>
Aug 09 15:11:05 user nova-compute[72382]:     </features>
Aug 09 15:11:05 user nova-compute[72382]:   </guest>
Aug 09 15:11:05 user nova-compute[72382]:   <guest>
Aug 09 15:11:05 user nova-compute[72382]:     <os_type>hvm</os_type>
Aug 09 15:11:05 user nova-compute[72382]:     <arch name='sparc64'>
Aug 09 15:11:05 user nova-compute[72382]:       <wordsize>64</wordsize>
Aug 09 15:11:05 user nova-compute[72382]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='1'>sun4u</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='1'>niagara</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='1'>sun4v</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <domain type='qemu'/>
Aug 09 15:11:05 user nova-compute[72382]:     </arch>
Aug 09 15:11:05 user nova-compute[72382]:     <features>
Aug 09 15:11:05 user nova-compute[72382]:       <cpuselection/>
Aug 09 15:11:05 user nova-compute[72382]:       <deviceboot/>
Aug 09 15:11:05 user nova-compute[72382]:       <disksnapshot default='on' toggle='no'/>
Aug 09 15:11:05 user nova-compute[72382]:     </features>
Aug 09 15:11:05 user nova-compute[72382]:   </guest>
Aug 09 15:11:05 user nova-compute[72382]:   <guest>
Aug 09 15:11:05 user nova-compute[72382]:     <os_type>hvm</os_type>
Aug 09 15:11:05 user nova-compute[72382]:     <arch name='x86_64'>
Aug 09 15:11:05 user nova-compute[72382]:       <wordsize>64</wordsize>
Aug 09 15:11:05 user nova-compute[72382]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='288'>pc-q35-artful</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='1'>x-remote</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='1'>isapc</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='288'>pc-q35-disco</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='288'>pc-q35-impish</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='288'>pc-q35-focal</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='288'>microvm</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <domain type='qemu'/>
Aug 09 15:11:05 user nova-compute[72382]:       <domain type='kvm'/>
Aug 09 15:11:05 user nova-compute[72382]:     </arch>
Aug 09 15:11:05 user nova-compute[72382]:     <features>
Aug 09 15:11:05 user nova-compute[72382]:       <acpi default='on' toggle='yes'/>
Aug 09 15:11:05 user nova-compute[72382]:       <apic default='on' toggle='no'/>
Aug 09 15:11:05 user nova-compute[72382]:       <cpuselection/>
Aug 09 15:11:05 user nova-compute[72382]:       <deviceboot/>
Aug 09 15:11:05 user nova-compute[72382]:       <disksnapshot default='on' toggle='no'/>
Aug 09 15:11:05 user nova-compute[72382]:     </features>
Aug 09 15:11:05 user nova-compute[72382]:   </guest>
Aug 09 15:11:05 user nova-compute[72382]:   <guest>
Aug 09 15:11:05 user nova-compute[72382]:     <os_type>hvm</os_type>
Aug 09 15:11:05 user nova-compute[72382]:     <arch name='xtensa'>
Aug 09 15:11:05 user nova-compute[72382]:       <wordsize>32</wordsize>
Aug 09 15:11:05 user nova-compute[72382]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='4'>sim</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='32'>kc705</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='32'>ml605</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='32'>ml605-nommu</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='32'>virt</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='32'>lx60-nommu</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='32'>lx200</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='32'>lx200-nommu</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='32'>lx60</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='32'>kc705-nommu</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <domain type='qemu'/>
Aug 09 15:11:05 user nova-compute[72382]:     </arch>
Aug 09 15:11:05 user nova-compute[72382]:     <features>
Aug 09 15:11:05 user nova-compute[72382]:       <cpuselection/>
Aug 09 15:11:05 user nova-compute[72382]:       <deviceboot/>
Aug 09 15:11:05 user nova-compute[72382]:       <disksnapshot default='on' toggle='no'/>
Aug 09 15:11:05 user nova-compute[72382]:     </features>
Aug 09 15:11:05 user nova-compute[72382]:   </guest>
Aug 09 15:11:05 user nova-compute[72382]:   <guest>
Aug 09 15:11:05 user nova-compute[72382]:     <os_type>hvm</os_type>
Aug 09 15:11:05 user nova-compute[72382]:     <arch name='xtensaeb'>
Aug 09 15:11:05 user nova-compute[72382]:       <wordsize>32</wordsize>
Aug 09 15:11:05 user nova-compute[72382]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='4'>sim</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='32'>kc705</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='32'>ml605</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='32'>ml605-nommu</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='32'>virt</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='32'>lx60-nommu</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='32'>lx200</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='32'>lx200-nommu</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='32'>lx60</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <machine maxCpus='32'>kc705-nommu</machine>
Aug 09 15:11:05 user nova-compute[72382]:       <domain type='qemu'/>
Aug 09 15:11:05 user nova-compute[72382]:     </arch>
Aug 09 15:11:05 user nova-compute[72382]:     <features>
Aug 09 15:11:05 user nova-compute[72382]:       <cpuselection/>
Aug 09 15:11:05 user nova-compute[72382]:       <deviceboot/>
Aug 09 15:11:05 user nova-compute[72382]:       <disksnapshot default='on' toggle='no'/>
Aug 09 15:11:05 user nova-compute[72382]:     </features>
Aug 09 15:11:05 user nova-compute[72382]:   </guest>
Aug 09 15:11:05 user nova-compute[72382]: </capabilities>
Aug 09 15:11:05 user nova-compute[72382]: 
Aug 09 15:11:05 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=72382) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 09 15:11:05 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=72382) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 15:11:05 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=72382) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 09 15:11:05 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=72382) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 15:11:05 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=72382) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 15:11:05 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=72382) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 09 15:11:05 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=72382) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 15:11:05 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=72382) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 09 15:11:05 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=72382) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 15:11:05 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Getting domain capabilities for cris via machine types: {None} {{(pid=72382) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 09 15:11:05 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=72382) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 15:11:05 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Getting domain capabilities for i686 via machine types: {'pc', 'q35', 'ubuntu', 'ubuntu-q35'} {{(pid=72382) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 09 15:11:05 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Aug 09 15:11:05 user nova-compute[72382]: <domainCapabilities>
Aug 09 15:11:05 user nova-compute[72382]:   <path>/usr/bin/qemu-system-i386</path>
Aug 09 15:11:05 user nova-compute[72382]:   <domain>kvm</domain>
Aug 09 15:11:05 user nova-compute[72382]:   <machine>pc-i440fx-6.2</machine>
Aug 09 15:11:05 user nova-compute[72382]:   <arch>i686</arch>
Aug 09 15:11:05 user nova-compute[72382]:   <vcpu max='255'/>
Aug 09 15:11:05 user nova-compute[72382]:   <iothreads supported='yes'/>
Aug 09 15:11:05 user nova-compute[72382]:   <os supported='yes'>
Aug 09 15:11:05 user nova-compute[72382]:     <enum name='firmware'/>
Aug 09 15:11:05 user nova-compute[72382]:     <loader supported='yes'>
Aug 09 15:11:05 user nova-compute[72382]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 09 15:11:05 user nova-compute[72382]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 09 15:11:05 user nova-compute[72382]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 09 15:11:05 user nova-compute[72382]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 09 15:11:05 user nova-compute[72382]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 09 15:11:05 user nova-compute[72382]:       <enum name='type'>
Aug 09 15:11:05 user nova-compute[72382]:         <value>rom</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>pflash</value>
Aug 09 15:11:05 user nova-compute[72382]:       </enum>
Aug 09 15:11:05 user nova-compute[72382]:       <enum name='readonly'>
Aug 09 15:11:05 user nova-compute[72382]:         <value>yes</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>no</value>
Aug 09 15:11:05 user nova-compute[72382]:       </enum>
Aug 09 15:11:05 user nova-compute[72382]:       <enum name='secure'>
Aug 09 15:11:05 user nova-compute[72382]:         <value>no</value>
Aug 09 15:11:05 user nova-compute[72382]:       </enum>
Aug 09 15:11:05 user nova-compute[72382]:     </loader>
Aug 09 15:11:05 user nova-compute[72382]:   </os>
Aug 09 15:11:05 user nova-compute[72382]:   <cpu>
Aug 09 15:11:05 user nova-compute[72382]:     <mode name='host-passthrough' supported='yes'>
Aug 09 15:11:05 user nova-compute[72382]:       <enum name='hostPassthroughMigratable'>
Aug 09 15:11:05 user nova-compute[72382]:         <value>off</value>
Aug 09 15:11:05 user nova-compute[72382]:       </enum>
Aug 09 15:11:05 user nova-compute[72382]:     </mode>
Aug 09 15:11:05 user nova-compute[72382]:     <mode name='maximum' supported='yes'>
Aug 09 15:11:05 user nova-compute[72382]:       <enum name='maximumMigratable'>
Aug 09 15:11:05 user nova-compute[72382]:         <value>on</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>off</value>
Aug 09 15:11:05 user nova-compute[72382]:       </enum>
Aug 09 15:11:05 user nova-compute[72382]:     </mode>
Aug 09 15:11:05 user nova-compute[72382]:     <mode name='host-model' supported='yes'>
Aug 09 15:11:05 user nova-compute[72382]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 09 15:11:05 user nova-compute[72382]:       <vendor>Intel</vendor>
Aug 09 15:11:05 user nova-compute[72382]:       <feature policy='require' name='ss'/>
Aug 09 15:11:05 user nova-compute[72382]:       <feature policy='require' name='vmx'/>
Aug 09 15:11:05 user nova-compute[72382]:       <feature policy='require' name='pcid'/>
Aug 09 15:11:05 user nova-compute[72382]:       <feature policy='require' name='hypervisor'/>
Aug 09 15:11:05 user nova-compute[72382]:       <feature policy='require' name='arat'/>
Aug 09 15:11:05 user nova-compute[72382]:       <feature policy='require' name='tsc_adjust'/>
Aug 09 15:11:05 user nova-compute[72382]:       <feature policy='require' name='umip'/>
Aug 09 15:11:05 user nova-compute[72382]:       <feature policy='require' name='md-clear'/>
Aug 09 15:11:05 user nova-compute[72382]:       <feature policy='require' name='stibp'/>
Aug 09 15:11:05 user nova-compute[72382]:       <feature policy='require' name='arch-capabilities'/>
Aug 09 15:11:05 user nova-compute[72382]:       <feature policy='require' name='ssbd'/>
Aug 09 15:11:05 user nova-compute[72382]:       <feature policy='require' name='ibpb'/>
Aug 09 15:11:05 user nova-compute[72382]:       <feature policy='require' name='ibrs'/>
Aug 09 15:11:05 user nova-compute[72382]:       <feature policy='require' name='amd-stibp'/>
Aug 09 15:11:05 user nova-compute[72382]:       <feature policy='require' name='amd-ssbd'/>
Aug 09 15:11:05 user nova-compute[72382]:       <feature policy='disable' name='erms'/>
Aug 09 15:11:05 user nova-compute[72382]:       <feature policy='disable' name='xsaveopt'/>
Aug 09 15:11:05 user nova-compute[72382]:       <feature policy='disable' name='lm'/>
Aug 09 15:11:05 user nova-compute[72382]:     </mode>
Aug 09 15:11:05 user nova-compute[72382]:     <mode name='custom' supported='yes'>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>qemu64</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='yes'>qemu32</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>phenom</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='yes'>pentium3</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='yes'>pentium2</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='yes'>pentium</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>n270</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>kvm64</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='yes'>kvm32</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='yes'>coreduo</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>core2duo</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>athlon</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>Westmere-IBRS</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>Westmere</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>Snowridge</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>Skylake-Server</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>Skylake-Client</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>SandyBridge</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>Penryn</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>Opteron_G5</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>Opteron_G4</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>Opteron_G3</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>Opteron_G2</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>Opteron_G1</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>Nehalem-IBRS</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>Nehalem</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>IvyBridge</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>Icelake-Server</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>Haswell-noTSX</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>Haswell-IBRS</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>Haswell</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>EPYC-Rome</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>EPYC-Milan</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>EPYC-IBPB</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>EPYC</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>Dhyana</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>Cooperlake</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>Conroe</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>Cascadelake-Server</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>Broadwell-noTSX</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>Broadwell-IBRS</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>Broadwell</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='yes'>486</model>
Aug 09 15:11:05 user nova-compute[72382]:     </mode>
Aug 09 15:11:05 user nova-compute[72382]:   </cpu>
Aug 09 15:11:05 user nova-compute[72382]:   <memoryBacking supported='yes'>
Aug 09 15:11:05 user nova-compute[72382]:     <enum name='sourceType'>
Aug 09 15:11:05 user nova-compute[72382]:       <value>file</value>
Aug 09 15:11:05 user nova-compute[72382]:       <value>anonymous</value>
Aug 09 15:11:05 user nova-compute[72382]:       <value>memfd</value>
Aug 09 15:11:05 user nova-compute[72382]:     </enum>
Aug 09 15:11:05 user nova-compute[72382]:   </memoryBacking>
Aug 09 15:11:05 user nova-compute[72382]:   <devices>
Aug 09 15:11:05 user nova-compute[72382]:     <disk supported='yes'>
Aug 09 15:11:05 user nova-compute[72382]:       <enum name='diskDevice'>
Aug 09 15:11:05 user nova-compute[72382]:         <value>disk</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>cdrom</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>floppy</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>lun</value>
Aug 09 15:11:05 user nova-compute[72382]:       </enum>
Aug 09 15:11:05 user nova-compute[72382]:       <enum name='bus'>
Aug 09 15:11:05 user nova-compute[72382]:         <value>ide</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>fdc</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>scsi</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>virtio</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>usb</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>sata</value>
Aug 09 15:11:05 user nova-compute[72382]:       </enum>
Aug 09 15:11:05 user nova-compute[72382]:       <enum name='model'>
Aug 09 15:11:05 user nova-compute[72382]:         <value>virtio</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>virtio-transitional</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>virtio-non-transitional</value>
Aug 09 15:11:05 user nova-compute[72382]:       </enum>
Aug 09 15:11:05 user nova-compute[72382]:     </disk>
Aug 09 15:11:05 user nova-compute[72382]:     <graphics supported='yes'>
Aug 09 15:11:05 user nova-compute[72382]:       <enum name='type'>
Aug 09 15:11:05 user nova-compute[72382]:         <value>sdl</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>vnc</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>spice</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>egl-headless</value>
Aug 09 15:11:05 user nova-compute[72382]:       </enum>
Aug 09 15:11:05 user nova-compute[72382]:     </graphics>
Aug 09 15:11:05 user nova-compute[72382]:     <video supported='yes'>
Aug 09 15:11:05 user nova-compute[72382]:       <enum name='modelType'>
Aug 09 15:11:05 user nova-compute[72382]:         <value>vga</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>cirrus</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>vmvga</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>qxl</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>virtio</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>none</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>bochs</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>ramfb</value>
Aug 09 15:11:05 user nova-compute[72382]:       </enum>
Aug 09 15:11:05 user nova-compute[72382]:     </video>
Aug 09 15:11:05 user nova-compute[72382]:     <hostdev supported='yes'>
Aug 09 15:11:05 user nova-compute[72382]:       <enum name='mode'>
Aug 09 15:11:05 user nova-compute[72382]:         <value>subsystem</value>
Aug 09 15:11:05 user nova-compute[72382]:       </enum>
Aug 09 15:11:05 user nova-compute[72382]:       <enum name='startupPolicy'>
Aug 09 15:11:05 user nova-compute[72382]:         <value>default</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>mandatory</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>requisite</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>optional</value>
Aug 09 15:11:05 user nova-compute[72382]:       </enum>
Aug 09 15:11:05 user nova-compute[72382]:       <enum name='subsysType'>
Aug 09 15:11:05 user nova-compute[72382]:         <value>usb</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>pci</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>scsi</value>
Aug 09 15:11:05 user nova-compute[72382]:       </enum>
Aug 09 15:11:05 user nova-compute[72382]:       <enum name='capsType'/>
Aug 09 15:11:05 user nova-compute[72382]:       <enum name='pciBackend'/>
Aug 09 15:11:05 user nova-compute[72382]:     </hostdev>
Aug 09 15:11:05 user nova-compute[72382]:     <rng supported='yes'>
Aug 09 15:11:05 user nova-compute[72382]:       <enum name='model'>
Aug 09 15:11:05 user nova-compute[72382]:         <value>virtio</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>virtio-transitional</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>virtio-non-transitional</value>
Aug 09 15:11:05 user nova-compute[72382]:       </enum>
Aug 09 15:11:05 user nova-compute[72382]:       <enum name='backendModel'>
Aug 09 15:11:05 user nova-compute[72382]:         <value>random</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>egd</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>builtin</value>
Aug 09 15:11:05 user nova-compute[72382]:       </enum>
Aug 09 15:11:05 user nova-compute[72382]:     </rng>
Aug 09 15:11:05 user nova-compute[72382]:     <filesystem supported='yes'>
Aug 09 15:11:05 user nova-compute[72382]:       <enum name='driverType'>
Aug 09 15:11:05 user nova-compute[72382]:         <value>path</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>handle</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>virtiofs</value>
Aug 09 15:11:05 user nova-compute[72382]:       </enum>
Aug 09 15:11:05 user nova-compute[72382]:     </filesystem>
Aug 09 15:11:05 user nova-compute[72382]:     <tpm supported='yes'>
Aug 09 15:11:05 user nova-compute[72382]:       <enum name='model'>
Aug 09 15:11:05 user nova-compute[72382]:         <value>tpm-tis</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>tpm-crb</value>
Aug 09 15:11:05 user nova-compute[72382]:       </enum>
Aug 09 15:11:05 user nova-compute[72382]:       <enum name='backendModel'>
Aug 09 15:11:05 user nova-compute[72382]:         <value>passthrough</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>emulator</value>
Aug 09 15:11:05 user nova-compute[72382]:       </enum>
Aug 09 15:11:05 user nova-compute[72382]:     </tpm>
Aug 09 15:11:05 user nova-compute[72382]:   </devices>
Aug 09 15:11:05 user nova-compute[72382]:   <features>
Aug 09 15:11:05 user nova-compute[72382]:     <gic supported='no'/>
Aug 09 15:11:05 user nova-compute[72382]:     <vmcoreinfo supported='yes'/>
Aug 09 15:11:05 user nova-compute[72382]:     <genid supported='yes'/>
Aug 09 15:11:05 user nova-compute[72382]:     <backingStoreInput supported='yes'/>
Aug 09 15:11:05 user nova-compute[72382]:     <backup supported='yes'/>
Aug 09 15:11:05 user nova-compute[72382]:     <sev supported='no'/>
Aug 09 15:11:05 user nova-compute[72382]:   </features>
Aug 09 15:11:05 user nova-compute[72382]: </domainCapabilities>
Aug 09 15:11:05 user nova-compute[72382]:  {{(pid=72382) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 09 15:11:05 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Aug 09 15:11:05 user nova-compute[72382]: <domainCapabilities>
Aug 09 15:11:05 user nova-compute[72382]:   <path>/usr/bin/qemu-system-i386</path>
Aug 09 15:11:05 user nova-compute[72382]:   <domain>kvm</domain>
Aug 09 15:11:05 user nova-compute[72382]:   <machine>pc-q35-6.2</machine>
Aug 09 15:11:05 user nova-compute[72382]:   <arch>i686</arch>
Aug 09 15:11:05 user nova-compute[72382]:   <vcpu max='288'/>
Aug 09 15:11:05 user nova-compute[72382]:   <iothreads supported='yes'/>
Aug 09 15:11:05 user nova-compute[72382]:   <os supported='yes'>
Aug 09 15:11:05 user nova-compute[72382]:     <enum name='firmware'/>
Aug 09 15:11:05 user nova-compute[72382]:     <loader supported='yes'>
Aug 09 15:11:05 user nova-compute[72382]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 09 15:11:05 user nova-compute[72382]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 09 15:11:05 user nova-compute[72382]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 09 15:11:05 user nova-compute[72382]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 09 15:11:05 user nova-compute[72382]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 09 15:11:05 user nova-compute[72382]:       <enum name='type'>
Aug 09 15:11:05 user nova-compute[72382]:         <value>rom</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>pflash</value>
Aug 09 15:11:05 user nova-compute[72382]:       </enum>
Aug 09 15:11:05 user nova-compute[72382]:       <enum name='readonly'>
Aug 09 15:11:05 user nova-compute[72382]:         <value>yes</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>no</value>
Aug 09 15:11:05 user nova-compute[72382]:       </enum>
Aug 09 15:11:05 user nova-compute[72382]:       <enum name='secure'>
Aug 09 15:11:05 user nova-compute[72382]:         <value>no</value>
Aug 09 15:11:05 user nova-compute[72382]:       </enum>
Aug 09 15:11:05 user nova-compute[72382]:     </loader>
Aug 09 15:11:05 user nova-compute[72382]:   </os>
Aug 09 15:11:05 user nova-compute[72382]:   <cpu>
Aug 09 15:11:05 user nova-compute[72382]:     <mode name='host-passthrough' supported='yes'>
Aug 09 15:11:05 user nova-compute[72382]:       <enum name='hostPassthroughMigratable'>
Aug 09 15:11:05 user nova-compute[72382]:         <value>off</value>
Aug 09 15:11:05 user nova-compute[72382]:       </enum>
Aug 09 15:11:05 user nova-compute[72382]:     </mode>
Aug 09 15:11:05 user nova-compute[72382]:     <mode name='maximum' supported='yes'>
Aug 09 15:11:05 user nova-compute[72382]:       <enum name='maximumMigratable'>
Aug 09 15:11:05 user nova-compute[72382]:         <value>on</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>off</value>
Aug 09 15:11:05 user nova-compute[72382]:       </enum>
Aug 09 15:11:05 user nova-compute[72382]:     </mode>
Aug 09 15:11:05 user nova-compute[72382]:     <mode name='host-model' supported='yes'>
Aug 09 15:11:05 user nova-compute[72382]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 09 15:11:05 user nova-compute[72382]:       <vendor>Intel</vendor>
Aug 09 15:11:05 user nova-compute[72382]:       <feature policy='require' name='ss'/>
Aug 09 15:11:05 user nova-compute[72382]:       <feature policy='require' name='vmx'/>
Aug 09 15:11:05 user nova-compute[72382]:       <feature policy='require' name='pcid'/>
Aug 09 15:11:05 user nova-compute[72382]:       <feature policy='require' name='hypervisor'/>
Aug 09 15:11:05 user nova-compute[72382]:       <feature policy='require' name='arat'/>
Aug 09 15:11:05 user nova-compute[72382]:       <feature policy='require' name='tsc_adjust'/>
Aug 09 15:11:05 user nova-compute[72382]:       <feature policy='require' name='umip'/>
Aug 09 15:11:05 user nova-compute[72382]:       <feature policy='require' name='md-clear'/>
Aug 09 15:11:05 user nova-compute[72382]:       <feature policy='require' name='stibp'/>
Aug 09 15:11:05 user nova-compute[72382]:       <feature policy='require' name='arch-capabilities'/>
Aug 09 15:11:05 user nova-compute[72382]:       <feature policy='require' name='ssbd'/>
Aug 09 15:11:05 user nova-compute[72382]:       <feature policy='require' name='ibpb'/>
Aug 09 15:11:05 user nova-compute[72382]:       <feature policy='require' name='ibrs'/>
Aug 09 15:11:05 user nova-compute[72382]:       <feature policy='require' name='amd-stibp'/>
Aug 09 15:11:05 user nova-compute[72382]:       <feature policy='require' name='amd-ssbd'/>
Aug 09 15:11:05 user nova-compute[72382]:       <feature policy='disable' name='erms'/>
Aug 09 15:11:05 user nova-compute[72382]:       <feature policy='disable' name='xsaveopt'/>
Aug 09 15:11:05 user nova-compute[72382]:       <feature policy='disable' name='lm'/>
Aug 09 15:11:05 user nova-compute[72382]:     </mode>
Aug 09 15:11:05 user nova-compute[72382]:     <mode name='custom' supported='yes'>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>qemu64</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='yes'>qemu32</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>phenom</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='yes'>pentium3</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='yes'>pentium2</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='yes'>pentium</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>n270</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>kvm64</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='yes'>kvm32</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='yes'>coreduo</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>core2duo</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>athlon</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>Westmere-IBRS</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>Westmere</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>Snowridge</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>Skylake-Server</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>Skylake-Client</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>SandyBridge</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>Penryn</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>Opteron_G5</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>Opteron_G4</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>Opteron_G3</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>Opteron_G2</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>Opteron_G1</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>Nehalem-IBRS</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>Nehalem</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>IvyBridge</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>Icelake-Server</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>Haswell-noTSX</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>Haswell-IBRS</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>Haswell</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>EPYC-Rome</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>EPYC-Milan</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>EPYC-IBPB</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>EPYC</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>Dhyana</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>Cooperlake</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>Conroe</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>Cascadelake-Server</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>Broadwell-noTSX</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>Broadwell-IBRS</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>Broadwell</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='yes'>486</model>
Aug 09 15:11:05 user nova-compute[72382]:     </mode>
Aug 09 15:11:05 user nova-compute[72382]:   </cpu>
Aug 09 15:11:05 user nova-compute[72382]:   <memoryBacking supported='yes'>
Aug 09 15:11:05 user nova-compute[72382]:     <enum name='sourceType'>
Aug 09 15:11:05 user nova-compute[72382]:       <value>file</value>
Aug 09 15:11:05 user nova-compute[72382]:       <value>anonymous</value>
Aug 09 15:11:05 user nova-compute[72382]:       <value>memfd</value>
Aug 09 15:11:05 user nova-compute[72382]:     </enum>
Aug 09 15:11:05 user nova-compute[72382]:   </memoryBacking>
Aug 09 15:11:05 user nova-compute[72382]:   <devices>
Aug 09 15:11:05 user nova-compute[72382]:     <disk supported='yes'>
Aug 09 15:11:05 user nova-compute[72382]:       <enum name='diskDevice'>
Aug 09 15:11:05 user nova-compute[72382]:         <value>disk</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>cdrom</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>floppy</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>lun</value>
Aug 09 15:11:05 user nova-compute[72382]:       </enum>
Aug 09 15:11:05 user nova-compute[72382]:       <enum name='bus'>
Aug 09 15:11:05 user nova-compute[72382]:         <value>fdc</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>scsi</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>virtio</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>usb</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>sata</value>
Aug 09 15:11:05 user nova-compute[72382]:       </enum>
Aug 09 15:11:05 user nova-compute[72382]:       <enum name='model'>
Aug 09 15:11:05 user nova-compute[72382]:         <value>virtio</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>virtio-transitional</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>virtio-non-transitional</value>
Aug 09 15:11:05 user nova-compute[72382]:       </enum>
Aug 09 15:11:05 user nova-compute[72382]:     </disk>
Aug 09 15:11:05 user nova-compute[72382]:     <graphics supported='yes'>
Aug 09 15:11:05 user nova-compute[72382]:       <enum name='type'>
Aug 09 15:11:05 user nova-compute[72382]:         <value>sdl</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>vnc</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>spice</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>egl-headless</value>
Aug 09 15:11:05 user nova-compute[72382]:       </enum>
Aug 09 15:11:05 user nova-compute[72382]:     </graphics>
Aug 09 15:11:05 user nova-compute[72382]:     <video supported='yes'>
Aug 09 15:11:05 user nova-compute[72382]:       <enum name='modelType'>
Aug 09 15:11:05 user nova-compute[72382]:         <value>vga</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>cirrus</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>vmvga</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>qxl</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>virtio</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>none</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>bochs</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>ramfb</value>
Aug 09 15:11:05 user nova-compute[72382]:       </enum>
Aug 09 15:11:05 user nova-compute[72382]:     </video>
Aug 09 15:11:05 user nova-compute[72382]:     <hostdev supported='yes'>
Aug 09 15:11:05 user nova-compute[72382]:       <enum name='mode'>
Aug 09 15:11:05 user nova-compute[72382]:         <value>subsystem</value>
Aug 09 15:11:05 user nova-compute[72382]:       </enum>
Aug 09 15:11:05 user nova-compute[72382]:       <enum name='startupPolicy'>
Aug 09 15:11:05 user nova-compute[72382]:         <value>default</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>mandatory</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>requisite</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>optional</value>
Aug 09 15:11:05 user nova-compute[72382]:       </enum>
Aug 09 15:11:05 user nova-compute[72382]:       <enum name='subsysType'>
Aug 09 15:11:05 user nova-compute[72382]:         <value>usb</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>pci</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>scsi</value>
Aug 09 15:11:05 user nova-compute[72382]:       </enum>
Aug 09 15:11:05 user nova-compute[72382]:       <enum name='capsType'/>
Aug 09 15:11:05 user nova-compute[72382]:       <enum name='pciBackend'/>
Aug 09 15:11:05 user nova-compute[72382]:     </hostdev>
Aug 09 15:11:05 user nova-compute[72382]:     <rng supported='yes'>
Aug 09 15:11:05 user nova-compute[72382]:       <enum name='model'>
Aug 09 15:11:05 user nova-compute[72382]:         <value>virtio</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>virtio-transitional</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>virtio-non-transitional</value>
Aug 09 15:11:05 user nova-compute[72382]:       </enum>
Aug 09 15:11:05 user nova-compute[72382]:       <enum name='backendModel'>
Aug 09 15:11:05 user nova-compute[72382]:         <value>random</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>egd</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>builtin</value>
Aug 09 15:11:05 user nova-compute[72382]:       </enum>
Aug 09 15:11:05 user nova-compute[72382]:     </rng>
Aug 09 15:11:05 user nova-compute[72382]:     <filesystem supported='yes'>
Aug 09 15:11:05 user nova-compute[72382]:       <enum name='driverType'>
Aug 09 15:11:05 user nova-compute[72382]:         <value>path</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>handle</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>virtiofs</value>
Aug 09 15:11:05 user nova-compute[72382]:       </enum>
Aug 09 15:11:05 user nova-compute[72382]:     </filesystem>
Aug 09 15:11:05 user nova-compute[72382]:     <tpm supported='yes'>
Aug 09 15:11:05 user nova-compute[72382]:       <enum name='model'>
Aug 09 15:11:05 user nova-compute[72382]:         <value>tpm-tis</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>tpm-crb</value>
Aug 09 15:11:05 user nova-compute[72382]:       </enum>
Aug 09 15:11:05 user nova-compute[72382]:       <enum name='backendModel'>
Aug 09 15:11:05 user nova-compute[72382]:         <value>passthrough</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>emulator</value>
Aug 09 15:11:05 user nova-compute[72382]:       </enum>
Aug 09 15:11:05 user nova-compute[72382]:     </tpm>
Aug 09 15:11:05 user nova-compute[72382]:   </devices>
Aug 09 15:11:05 user nova-compute[72382]:   <features>
Aug 09 15:11:05 user nova-compute[72382]:     <gic supported='no'/>
Aug 09 15:11:05 user nova-compute[72382]:     <vmcoreinfo supported='yes'/>
Aug 09 15:11:05 user nova-compute[72382]:     <genid supported='yes'/>
Aug 09 15:11:05 user nova-compute[72382]:     <backingStoreInput supported='yes'/>
Aug 09 15:11:05 user nova-compute[72382]:     <backup supported='yes'/>
Aug 09 15:11:05 user nova-compute[72382]:     <sev supported='no'/>
Aug 09 15:11:05 user nova-compute[72382]:   </features>
Aug 09 15:11:05 user nova-compute[72382]: </domainCapabilities>
Aug 09 15:11:05 user nova-compute[72382]:  {{(pid=72382) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 09 15:11:05 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Aug 09 15:11:05 user nova-compute[72382]: <domainCapabilities>
Aug 09 15:11:05 user nova-compute[72382]:   <path>/usr/bin/qemu-system-i386</path>
Aug 09 15:11:05 user nova-compute[72382]:   <domain>kvm</domain>
Aug 09 15:11:05 user nova-compute[72382]:   <machine>pc-i440fx-jammy</machine>
Aug 09 15:11:05 user nova-compute[72382]:   <arch>i686</arch>
Aug 09 15:11:05 user nova-compute[72382]:   <vcpu max='255'/>
Aug 09 15:11:05 user nova-compute[72382]:   <iothreads supported='yes'/>
Aug 09 15:11:05 user nova-compute[72382]:   <os supported='yes'>
Aug 09 15:11:05 user nova-compute[72382]:     <enum name='firmware'/>
Aug 09 15:11:05 user nova-compute[72382]:     <loader supported='yes'>
Aug 09 15:11:05 user nova-compute[72382]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 09 15:11:05 user nova-compute[72382]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 09 15:11:05 user nova-compute[72382]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 09 15:11:05 user nova-compute[72382]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 09 15:11:05 user nova-compute[72382]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 09 15:11:05 user nova-compute[72382]:       <enum name='type'>
Aug 09 15:11:05 user nova-compute[72382]:         <value>rom</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>pflash</value>
Aug 09 15:11:05 user nova-compute[72382]:       </enum>
Aug 09 15:11:05 user nova-compute[72382]:       <enum name='readonly'>
Aug 09 15:11:05 user nova-compute[72382]:         <value>yes</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>no</value>
Aug 09 15:11:05 user nova-compute[72382]:       </enum>
Aug 09 15:11:05 user nova-compute[72382]:       <enum name='secure'>
Aug 09 15:11:05 user nova-compute[72382]:         <value>no</value>
Aug 09 15:11:05 user nova-compute[72382]:       </enum>
Aug 09 15:11:05 user nova-compute[72382]:     </loader>
Aug 09 15:11:05 user nova-compute[72382]:   </os>
Aug 09 15:11:05 user nova-compute[72382]:   <cpu>
Aug 09 15:11:05 user nova-compute[72382]:     <mode name='host-passthrough' supported='yes'>
Aug 09 15:11:05 user nova-compute[72382]:       <enum name='hostPassthroughMigratable'>
Aug 09 15:11:05 user nova-compute[72382]:         <value>off</value>
Aug 09 15:11:05 user nova-compute[72382]:       </enum>
Aug 09 15:11:05 user nova-compute[72382]:     </mode>
Aug 09 15:11:05 user nova-compute[72382]:     <mode name='maximum' supported='yes'>
Aug 09 15:11:05 user nova-compute[72382]:       <enum name='maximumMigratable'>
Aug 09 15:11:05 user nova-compute[72382]:         <value>on</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>off</value>
Aug 09 15:11:05 user nova-compute[72382]:       </enum>
Aug 09 15:11:05 user nova-compute[72382]:     </mode>
Aug 09 15:11:05 user nova-compute[72382]:     <mode name='host-model' supported='yes'>
Aug 09 15:11:05 user nova-compute[72382]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 09 15:11:05 user nova-compute[72382]:       <vendor>Intel</vendor>
Aug 09 15:11:05 user nova-compute[72382]:       <feature policy='require' name='ss'/>
Aug 09 15:11:05 user nova-compute[72382]:       <feature policy='require' name='vmx'/>
Aug 09 15:11:05 user nova-compute[72382]:       <feature policy='require' name='pcid'/>
Aug 09 15:11:05 user nova-compute[72382]:       <feature policy='require' name='hypervisor'/>
Aug 09 15:11:05 user nova-compute[72382]:       <feature policy='require' name='arat'/>
Aug 09 15:11:05 user nova-compute[72382]:       <feature policy='require' name='tsc_adjust'/>
Aug 09 15:11:05 user nova-compute[72382]:       <feature policy='require' name='umip'/>
Aug 09 15:11:05 user nova-compute[72382]:       <feature policy='require' name='md-clear'/>
Aug 09 15:11:05 user nova-compute[72382]:       <feature policy='require' name='stibp'/>
Aug 09 15:11:05 user nova-compute[72382]:       <feature policy='require' name='arch-capabilities'/>
Aug 09 15:11:05 user nova-compute[72382]:       <feature policy='require' name='ssbd'/>
Aug 09 15:11:05 user nova-compute[72382]:       <feature policy='require' name='ibpb'/>
Aug 09 15:11:05 user nova-compute[72382]:       <feature policy='require' name='ibrs'/>
Aug 09 15:11:05 user nova-compute[72382]:       <feature policy='require' name='amd-stibp'/>
Aug 09 15:11:05 user nova-compute[72382]:       <feature policy='require' name='amd-ssbd'/>
Aug 09 15:11:05 user nova-compute[72382]:       <feature policy='disable' name='erms'/>
Aug 09 15:11:05 user nova-compute[72382]:       <feature policy='disable' name='xsaveopt'/>
Aug 09 15:11:05 user nova-compute[72382]:       <feature policy='disable' name='lm'/>
Aug 09 15:11:05 user nova-compute[72382]:     </mode>
Aug 09 15:11:05 user nova-compute[72382]:     <mode name='custom' supported='yes'>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>qemu64</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='yes'>qemu32</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>phenom</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='yes'>pentium3</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='yes'>pentium2</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='yes'>pentium</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>n270</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>kvm64</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='yes'>kvm32</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='yes'>coreduo</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>core2duo</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>athlon</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>Westmere-IBRS</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>Westmere</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>Snowridge</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>Skylake-Server</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>Skylake-Client</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>SandyBridge</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>Penryn</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>Opteron_G5</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>Opteron_G4</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>Opteron_G3</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>Opteron_G2</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>Opteron_G1</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>Nehalem-IBRS</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>Nehalem</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>IvyBridge</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>Icelake-Server</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>Haswell-noTSX</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>Haswell-IBRS</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>Haswell</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>EPYC-Rome</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>EPYC-Milan</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>EPYC-IBPB</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>EPYC</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>Dhyana</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>Cooperlake</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>Conroe</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>Cascadelake-Server</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>Broadwell-noTSX</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>Broadwell-IBRS</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>Broadwell</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='yes'>486</model>
Aug 09 15:11:05 user nova-compute[72382]:     </mode>
Aug 09 15:11:05 user nova-compute[72382]:   </cpu>
Aug 09 15:11:05 user nova-compute[72382]:   <memoryBacking supported='yes'>
Aug 09 15:11:05 user nova-compute[72382]:     <enum name='sourceType'>
Aug 09 15:11:05 user nova-compute[72382]:       <value>file</value>
Aug 09 15:11:05 user nova-compute[72382]:       <value>anonymous</value>
Aug 09 15:11:05 user nova-compute[72382]:       <value>memfd</value>
Aug 09 15:11:05 user nova-compute[72382]:     </enum>
Aug 09 15:11:05 user nova-compute[72382]:   </memoryBacking>
Aug 09 15:11:05 user nova-compute[72382]:   <devices>
Aug 09 15:11:05 user nova-compute[72382]:     <disk supported='yes'>
Aug 09 15:11:05 user nova-compute[72382]:       <enum name='diskDevice'>
Aug 09 15:11:05 user nova-compute[72382]:         <value>disk</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>cdrom</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>floppy</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>lun</value>
Aug 09 15:11:05 user nova-compute[72382]:       </enum>
Aug 09 15:11:05 user nova-compute[72382]:       <enum name='bus'>
Aug 09 15:11:05 user nova-compute[72382]:         <value>ide</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>fdc</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>scsi</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>virtio</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>usb</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>sata</value>
Aug 09 15:11:05 user nova-compute[72382]:       </enum>
Aug 09 15:11:05 user nova-compute[72382]:       <enum name='model'>
Aug 09 15:11:05 user nova-compute[72382]:         <value>virtio</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>virtio-transitional</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>virtio-non-transitional</value>
Aug 09 15:11:05 user nova-compute[72382]:       </enum>
Aug 09 15:11:05 user nova-compute[72382]:     </disk>
Aug 09 15:11:05 user nova-compute[72382]:     <graphics supported='yes'>
Aug 09 15:11:05 user nova-compute[72382]:       <enum name='type'>
Aug 09 15:11:05 user nova-compute[72382]:         <value>sdl</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>vnc</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>spice</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>egl-headless</value>
Aug 09 15:11:05 user nova-compute[72382]:       </enum>
Aug 09 15:11:05 user nova-compute[72382]:     </graphics>
Aug 09 15:11:05 user nova-compute[72382]:     <video supported='yes'>
Aug 09 15:11:05 user nova-compute[72382]:       <enum name='modelType'>
Aug 09 15:11:05 user nova-compute[72382]:         <value>vga</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>cirrus</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>vmvga</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>qxl</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>virtio</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>none</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>bochs</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>ramfb</value>
Aug 09 15:11:05 user nova-compute[72382]:       </enum>
Aug 09 15:11:05 user nova-compute[72382]:     </video>
Aug 09 15:11:05 user nova-compute[72382]:     <hostdev supported='yes'>
Aug 09 15:11:05 user nova-compute[72382]:       <enum name='mode'>
Aug 09 15:11:05 user nova-compute[72382]:         <value>subsystem</value>
Aug 09 15:11:05 user nova-compute[72382]:       </enum>
Aug 09 15:11:05 user nova-compute[72382]:       <enum name='startupPolicy'>
Aug 09 15:11:05 user nova-compute[72382]:         <value>default</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>mandatory</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>requisite</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>optional</value>
Aug 09 15:11:05 user nova-compute[72382]:       </enum>
Aug 09 15:11:05 user nova-compute[72382]:       <enum name='subsysType'>
Aug 09 15:11:05 user nova-compute[72382]:         <value>usb</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>pci</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>scsi</value>
Aug 09 15:11:05 user nova-compute[72382]:       </enum>
Aug 09 15:11:05 user nova-compute[72382]:       <enum name='capsType'/>
Aug 09 15:11:05 user nova-compute[72382]:       <enum name='pciBackend'/>
Aug 09 15:11:05 user nova-compute[72382]:     </hostdev>
Aug 09 15:11:05 user nova-compute[72382]:     <rng supported='yes'>
Aug 09 15:11:05 user nova-compute[72382]:       <enum name='model'>
Aug 09 15:11:05 user nova-compute[72382]:         <value>virtio</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>virtio-transitional</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>virtio-non-transitional</value>
Aug 09 15:11:05 user nova-compute[72382]:       </enum>
Aug 09 15:11:05 user nova-compute[72382]:       <enum name='backendModel'>
Aug 09 15:11:05 user nova-compute[72382]:         <value>random</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>egd</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>builtin</value>
Aug 09 15:11:05 user nova-compute[72382]:       </enum>
Aug 09 15:11:05 user nova-compute[72382]:     </rng>
Aug 09 15:11:05 user nova-compute[72382]:     <filesystem supported='yes'>
Aug 09 15:11:05 user nova-compute[72382]:       <enum name='driverType'>
Aug 09 15:11:05 user nova-compute[72382]:         <value>path</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>handle</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>virtiofs</value>
Aug 09 15:11:05 user nova-compute[72382]:       </enum>
Aug 09 15:11:05 user nova-compute[72382]:     </filesystem>
Aug 09 15:11:05 user nova-compute[72382]:     <tpm supported='yes'>
Aug 09 15:11:05 user nova-compute[72382]:       <enum name='model'>
Aug 09 15:11:05 user nova-compute[72382]:         <value>tpm-tis</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>tpm-crb</value>
Aug 09 15:11:05 user nova-compute[72382]:       </enum>
Aug 09 15:11:05 user nova-compute[72382]:       <enum name='backendModel'>
Aug 09 15:11:05 user nova-compute[72382]:         <value>passthrough</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>emulator</value>
Aug 09 15:11:05 user nova-compute[72382]:       </enum>
Aug 09 15:11:05 user nova-compute[72382]:     </tpm>
Aug 09 15:11:05 user nova-compute[72382]:   </devices>
Aug 09 15:11:05 user nova-compute[72382]:   <features>
Aug 09 15:11:05 user nova-compute[72382]:     <gic supported='no'/>
Aug 09 15:11:05 user nova-compute[72382]:     <vmcoreinfo supported='yes'/>
Aug 09 15:11:05 user nova-compute[72382]:     <genid supported='yes'/>
Aug 09 15:11:05 user nova-compute[72382]:     <backingStoreInput supported='yes'/>
Aug 09 15:11:05 user nova-compute[72382]:     <backup supported='yes'/>
Aug 09 15:11:05 user nova-compute[72382]:     <sev supported='no'/>
Aug 09 15:11:05 user nova-compute[72382]:   </features>
Aug 09 15:11:05 user nova-compute[72382]: </domainCapabilities>
Aug 09 15:11:05 user nova-compute[72382]:  {{(pid=72382) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 09 15:11:05 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Aug 09 15:11:05 user nova-compute[72382]: <domainCapabilities>
Aug 09 15:11:05 user nova-compute[72382]:   <path>/usr/bin/qemu-system-i386</path>
Aug 09 15:11:05 user nova-compute[72382]:   <domain>kvm</domain>
Aug 09 15:11:05 user nova-compute[72382]:   <machine>pc-q35-jammy</machine>
Aug 09 15:11:05 user nova-compute[72382]:   <arch>i686</arch>
Aug 09 15:11:05 user nova-compute[72382]:   <vcpu max='288'/>
Aug 09 15:11:05 user nova-compute[72382]:   <iothreads supported='yes'/>
Aug 09 15:11:05 user nova-compute[72382]:   <os supported='yes'>
Aug 09 15:11:05 user nova-compute[72382]:     <enum name='firmware'/>
Aug 09 15:11:05 user nova-compute[72382]:     <loader supported='yes'>
Aug 09 15:11:05 user nova-compute[72382]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 09 15:11:05 user nova-compute[72382]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 09 15:11:05 user nova-compute[72382]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 09 15:11:05 user nova-compute[72382]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 09 15:11:05 user nova-compute[72382]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 09 15:11:05 user nova-compute[72382]:       <enum name='type'>
Aug 09 15:11:05 user nova-compute[72382]:         <value>rom</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>pflash</value>
Aug 09 15:11:05 user nova-compute[72382]:       </enum>
Aug 09 15:11:05 user nova-compute[72382]:       <enum name='readonly'>
Aug 09 15:11:05 user nova-compute[72382]:         <value>yes</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>no</value>
Aug 09 15:11:05 user nova-compute[72382]:       </enum>
Aug 09 15:11:05 user nova-compute[72382]:       <enum name='secure'>
Aug 09 15:11:05 user nova-compute[72382]:         <value>no</value>
Aug 09 15:11:05 user nova-compute[72382]:       </enum>
Aug 09 15:11:05 user nova-compute[72382]:     </loader>
Aug 09 15:11:05 user nova-compute[72382]:   </os>
Aug 09 15:11:05 user nova-compute[72382]:   <cpu>
Aug 09 15:11:05 user nova-compute[72382]:     <mode name='host-passthrough' supported='yes'>
Aug 09 15:11:05 user nova-compute[72382]:       <enum name='hostPassthroughMigratable'>
Aug 09 15:11:05 user nova-compute[72382]:         <value>off</value>
Aug 09 15:11:05 user nova-compute[72382]:       </enum>
Aug 09 15:11:05 user nova-compute[72382]:     </mode>
Aug 09 15:11:05 user nova-compute[72382]:     <mode name='maximum' supported='yes'>
Aug 09 15:11:05 user nova-compute[72382]:       <enum name='maximumMigratable'>
Aug 09 15:11:05 user nova-compute[72382]:         <value>on</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>off</value>
Aug 09 15:11:05 user nova-compute[72382]:       </enum>
Aug 09 15:11:05 user nova-compute[72382]:     </mode>
Aug 09 15:11:05 user nova-compute[72382]:     <mode name='host-model' supported='yes'>
Aug 09 15:11:05 user nova-compute[72382]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 09 15:11:05 user nova-compute[72382]:       <vendor>Intel</vendor>
Aug 09 15:11:05 user nova-compute[72382]:       <feature policy='require' name='ss'/>
Aug 09 15:11:05 user nova-compute[72382]:       <feature policy='require' name='vmx'/>
Aug 09 15:11:05 user nova-compute[72382]:       <feature policy='require' name='pcid'/>
Aug 09 15:11:05 user nova-compute[72382]:       <feature policy='require' name='hypervisor'/>
Aug 09 15:11:05 user nova-compute[72382]:       <feature policy='require' name='arat'/>
Aug 09 15:11:05 user nova-compute[72382]:       <feature policy='require' name='tsc_adjust'/>
Aug 09 15:11:05 user nova-compute[72382]:       <feature policy='require' name='umip'/>
Aug 09 15:11:05 user nova-compute[72382]:       <feature policy='require' name='md-clear'/>
Aug 09 15:11:05 user nova-compute[72382]:       <feature policy='require' name='stibp'/>
Aug 09 15:11:05 user nova-compute[72382]:       <feature policy='require' name='arch-capabilities'/>
Aug 09 15:11:05 user nova-compute[72382]:       <feature policy='require' name='ssbd'/>
Aug 09 15:11:05 user nova-compute[72382]:       <feature policy='require' name='ibpb'/>
Aug 09 15:11:05 user nova-compute[72382]:       <feature policy='require' name='ibrs'/>
Aug 09 15:11:05 user nova-compute[72382]:       <feature policy='require' name='amd-stibp'/>
Aug 09 15:11:05 user nova-compute[72382]:       <feature policy='require' name='amd-ssbd'/>
Aug 09 15:11:05 user nova-compute[72382]:       <feature policy='disable' name='erms'/>
Aug 09 15:11:05 user nova-compute[72382]:       <feature policy='disable' name='xsaveopt'/>
Aug 09 15:11:05 user nova-compute[72382]:       <feature policy='disable' name='lm'/>
Aug 09 15:11:05 user nova-compute[72382]:     </mode>
Aug 09 15:11:05 user nova-compute[72382]:     <mode name='custom' supported='yes'>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>qemu64</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='yes'>qemu32</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>phenom</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='yes'>pentium3</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='yes'>pentium2</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='yes'>pentium</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>n270</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>kvm64</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='yes'>kvm32</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='yes'>coreduo</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>core2duo</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>athlon</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>Westmere-IBRS</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>Westmere</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>Snowridge</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>Skylake-Server</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>Skylake-Client</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>SandyBridge</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>Penryn</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>Opteron_G5</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>Opteron_G4</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>Opteron_G3</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>Opteron_G2</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>Opteron_G1</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>Nehalem-IBRS</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>Nehalem</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>IvyBridge</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>Icelake-Server</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>Haswell-noTSX</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>Haswell-IBRS</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>Haswell</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>EPYC-Rome</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>EPYC-Milan</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>EPYC-IBPB</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>EPYC</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>Dhyana</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>Cooperlake</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>Conroe</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>Cascadelake-Server</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>Broadwell-noTSX</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>Broadwell-IBRS</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>Broadwell</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='yes'>486</model>
Aug 09 15:11:05 user nova-compute[72382]:     </mode>
Aug 09 15:11:05 user nova-compute[72382]:   </cpu>
Aug 09 15:11:05 user nova-compute[72382]:   <memoryBacking supported='yes'>
Aug 09 15:11:05 user nova-compute[72382]:     <enum name='sourceType'>
Aug 09 15:11:05 user nova-compute[72382]:       <value>file</value>
Aug 09 15:11:05 user nova-compute[72382]:       <value>anonymous</value>
Aug 09 15:11:05 user nova-compute[72382]:       <value>memfd</value>
Aug 09 15:11:05 user nova-compute[72382]:     </enum>
Aug 09 15:11:05 user nova-compute[72382]:   </memoryBacking>
Aug 09 15:11:05 user nova-compute[72382]:   <devices>
Aug 09 15:11:05 user nova-compute[72382]:     <disk supported='yes'>
Aug 09 15:11:05 user nova-compute[72382]:       <enum name='diskDevice'>
Aug 09 15:11:05 user nova-compute[72382]:         <value>disk</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>cdrom</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>floppy</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>lun</value>
Aug 09 15:11:05 user nova-compute[72382]:       </enum>
Aug 09 15:11:05 user nova-compute[72382]:       <enum name='bus'>
Aug 09 15:11:05 user nova-compute[72382]:         <value>fdc</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>scsi</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>virtio</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>usb</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>sata</value>
Aug 09 15:11:05 user nova-compute[72382]:       </enum>
Aug 09 15:11:05 user nova-compute[72382]:       <enum name='model'>
Aug 09 15:11:05 user nova-compute[72382]:         <value>virtio</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>virtio-transitional</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>virtio-non-transitional</value>
Aug 09 15:11:05 user nova-compute[72382]:       </enum>
Aug 09 15:11:05 user nova-compute[72382]:     </disk>
Aug 09 15:11:05 user nova-compute[72382]:     <graphics supported='yes'>
Aug 09 15:11:05 user nova-compute[72382]:       <enum name='type'>
Aug 09 15:11:05 user nova-compute[72382]:         <value>sdl</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>vnc</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>spice</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>egl-headless</value>
Aug 09 15:11:05 user nova-compute[72382]:       </enum>
Aug 09 15:11:05 user nova-compute[72382]:     </graphics>
Aug 09 15:11:05 user nova-compute[72382]:     <video supported='yes'>
Aug 09 15:11:05 user nova-compute[72382]:       <enum name='modelType'>
Aug 09 15:11:05 user nova-compute[72382]:         <value>vga</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>cirrus</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>vmvga</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>qxl</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>virtio</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>none</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>bochs</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>ramfb</value>
Aug 09 15:11:05 user nova-compute[72382]:       </enum>
Aug 09 15:11:05 user nova-compute[72382]:     </video>
Aug 09 15:11:05 user nova-compute[72382]:     <hostdev supported='yes'>
Aug 09 15:11:05 user nova-compute[72382]:       <enum name='mode'>
Aug 09 15:11:05 user nova-compute[72382]:         <value>subsystem</value>
Aug 09 15:11:05 user nova-compute[72382]:       </enum>
Aug 09 15:11:05 user nova-compute[72382]:       <enum name='startupPolicy'>
Aug 09 15:11:05 user nova-compute[72382]:         <value>default</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>mandatory</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>requisite</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>optional</value>
Aug 09 15:11:05 user nova-compute[72382]:       </enum>
Aug 09 15:11:05 user nova-compute[72382]:       <enum name='subsysType'>
Aug 09 15:11:05 user nova-compute[72382]:         <value>usb</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>pci</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>scsi</value>
Aug 09 15:11:05 user nova-compute[72382]:       </enum>
Aug 09 15:11:05 user nova-compute[72382]:       <enum name='capsType'/>
Aug 09 15:11:05 user nova-compute[72382]:       <enum name='pciBackend'/>
Aug 09 15:11:05 user nova-compute[72382]:     </hostdev>
Aug 09 15:11:05 user nova-compute[72382]:     <rng supported='yes'>
Aug 09 15:11:05 user nova-compute[72382]:       <enum name='model'>
Aug 09 15:11:05 user nova-compute[72382]:         <value>virtio</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>virtio-transitional</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>virtio-non-transitional</value>
Aug 09 15:11:05 user nova-compute[72382]:       </enum>
Aug 09 15:11:05 user nova-compute[72382]:       <enum name='backendModel'>
Aug 09 15:11:05 user nova-compute[72382]:         <value>random</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>egd</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>builtin</value>
Aug 09 15:11:05 user nova-compute[72382]:       </enum>
Aug 09 15:11:05 user nova-compute[72382]:     </rng>
Aug 09 15:11:05 user nova-compute[72382]:     <filesystem supported='yes'>
Aug 09 15:11:05 user nova-compute[72382]:       <enum name='driverType'>
Aug 09 15:11:05 user nova-compute[72382]:         <value>path</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>handle</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>virtiofs</value>
Aug 09 15:11:05 user nova-compute[72382]:       </enum>
Aug 09 15:11:05 user nova-compute[72382]:     </filesystem>
Aug 09 15:11:05 user nova-compute[72382]:     <tpm supported='yes'>
Aug 09 15:11:05 user nova-compute[72382]:       <enum name='model'>
Aug 09 15:11:05 user nova-compute[72382]:         <value>tpm-tis</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>tpm-crb</value>
Aug 09 15:11:05 user nova-compute[72382]:       </enum>
Aug 09 15:11:05 user nova-compute[72382]:       <enum name='backendModel'>
Aug 09 15:11:05 user nova-compute[72382]:         <value>passthrough</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>emulator</value>
Aug 09 15:11:05 user nova-compute[72382]:       </enum>
Aug 09 15:11:05 user nova-compute[72382]:     </tpm>
Aug 09 15:11:05 user nova-compute[72382]:   </devices>
Aug 09 15:11:05 user nova-compute[72382]:   <features>
Aug 09 15:11:05 user nova-compute[72382]:     <gic supported='no'/>
Aug 09 15:11:05 user nova-compute[72382]:     <vmcoreinfo supported='yes'/>
Aug 09 15:11:05 user nova-compute[72382]:     <genid supported='yes'/>
Aug 09 15:11:05 user nova-compute[72382]:     <backingStoreInput supported='yes'/>
Aug 09 15:11:05 user nova-compute[72382]:     <backup supported='yes'/>
Aug 09 15:11:05 user nova-compute[72382]:     <sev supported='no'/>
Aug 09 15:11:05 user nova-compute[72382]:   </features>
Aug 09 15:11:05 user nova-compute[72382]: </domainCapabilities>
Aug 09 15:11:05 user nova-compute[72382]:  {{(pid=72382) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 09 15:11:05 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=72382) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 09 15:11:05 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=72382) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 15:11:05 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=72382) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 15:11:05 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=72382) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 09 15:11:05 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=72382) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 15:11:05 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=72382) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 09 15:11:05 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=72382) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 15:11:05 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Getting domain capabilities for mips via machine types: {None} {{(pid=72382) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 09 15:11:05 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=72382) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 15:11:05 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=72382) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 09 15:11:05 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=72382) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 15:11:05 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=72382) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 09 15:11:05 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=72382) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 15:11:05 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=72382) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 09 15:11:05 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=72382) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 15:11:05 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=72382) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 09 15:11:05 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=72382) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 15:11:05 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Getting domain capabilities for ppc64 via machine types: {'pseries', 'powernv', None} {{(pid=72382) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 09 15:11:05 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=72382) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 15:11:05 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=72382) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 15:11:05 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=72382) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 15:11:05 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Getting domain capabilities for ppc64le via machine types: {'pseries', 'powernv'} {{(pid=72382) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 09 15:11:05 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=72382) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 15:11:05 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=72382) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 15:11:05 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=72382) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 09 15:11:05 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=72382) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 15:11:05 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=72382) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 09 15:11:05 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=72382) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 15:11:05 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=72382) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 09 15:11:05 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=72382) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 15:11:05 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=72382) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 09 15:11:05 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=72382) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 15:11:05 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=72382) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 09 15:11:05 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=72382) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 15:11:05 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=72382) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 09 15:11:05 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=72382) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 15:11:05 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=72382) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 09 15:11:05 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=72382) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 15:11:05 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Getting domain capabilities for x86_64 via machine types: {'pc', 'q35', 'ubuntu', 'ubuntu-q35'} {{(pid=72382) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 09 15:11:05 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Aug 09 15:11:05 user nova-compute[72382]: <domainCapabilities>
Aug 09 15:11:05 user nova-compute[72382]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 09 15:11:05 user nova-compute[72382]:   <domain>kvm</domain>
Aug 09 15:11:05 user nova-compute[72382]:   <machine>pc-i440fx-6.2</machine>
Aug 09 15:11:05 user nova-compute[72382]:   <arch>x86_64</arch>
Aug 09 15:11:05 user nova-compute[72382]:   <vcpu max='255'/>
Aug 09 15:11:05 user nova-compute[72382]:   <iothreads supported='yes'/>
Aug 09 15:11:05 user nova-compute[72382]:   <os supported='yes'>
Aug 09 15:11:05 user nova-compute[72382]:     <enum name='firmware'>
Aug 09 15:11:05 user nova-compute[72382]:       <value>efi</value>
Aug 09 15:11:05 user nova-compute[72382]:     </enum>
Aug 09 15:11:05 user nova-compute[72382]:     <loader supported='yes'>
Aug 09 15:11:05 user nova-compute[72382]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 09 15:11:05 user nova-compute[72382]:       <enum name='type'>
Aug 09 15:11:05 user nova-compute[72382]:         <value>rom</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>pflash</value>
Aug 09 15:11:05 user nova-compute[72382]:       </enum>
Aug 09 15:11:05 user nova-compute[72382]:       <enum name='readonly'>
Aug 09 15:11:05 user nova-compute[72382]:         <value>yes</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>no</value>
Aug 09 15:11:05 user nova-compute[72382]:       </enum>
Aug 09 15:11:05 user nova-compute[72382]:       <enum name='secure'>
Aug 09 15:11:05 user nova-compute[72382]:         <value>no</value>
Aug 09 15:11:05 user nova-compute[72382]:       </enum>
Aug 09 15:11:05 user nova-compute[72382]:     </loader>
Aug 09 15:11:05 user nova-compute[72382]:   </os>
Aug 09 15:11:05 user nova-compute[72382]:   <cpu>
Aug 09 15:11:05 user nova-compute[72382]:     <mode name='host-passthrough' supported='yes'>
Aug 09 15:11:05 user nova-compute[72382]:       <enum name='hostPassthroughMigratable'>
Aug 09 15:11:05 user nova-compute[72382]:         <value>on</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>off</value>
Aug 09 15:11:05 user nova-compute[72382]:       </enum>
Aug 09 15:11:05 user nova-compute[72382]:     </mode>
Aug 09 15:11:05 user nova-compute[72382]:     <mode name='maximum' supported='yes'>
Aug 09 15:11:05 user nova-compute[72382]:       <enum name='maximumMigratable'>
Aug 09 15:11:05 user nova-compute[72382]:         <value>on</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>off</value>
Aug 09 15:11:05 user nova-compute[72382]:       </enum>
Aug 09 15:11:05 user nova-compute[72382]:     </mode>
Aug 09 15:11:05 user nova-compute[72382]:     <mode name='host-model' supported='yes'>
Aug 09 15:11:05 user nova-compute[72382]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 09 15:11:05 user nova-compute[72382]:       <vendor>Intel</vendor>
Aug 09 15:11:05 user nova-compute[72382]:       <feature policy='require' name='ss'/>
Aug 09 15:11:05 user nova-compute[72382]:       <feature policy='require' name='vmx'/>
Aug 09 15:11:05 user nova-compute[72382]:       <feature policy='require' name='pcid'/>
Aug 09 15:11:05 user nova-compute[72382]:       <feature policy='require' name='hypervisor'/>
Aug 09 15:11:05 user nova-compute[72382]:       <feature policy='require' name='arat'/>
Aug 09 15:11:05 user nova-compute[72382]:       <feature policy='require' name='tsc_adjust'/>
Aug 09 15:11:05 user nova-compute[72382]:       <feature policy='require' name='umip'/>
Aug 09 15:11:05 user nova-compute[72382]:       <feature policy='require' name='md-clear'/>
Aug 09 15:11:05 user nova-compute[72382]:       <feature policy='require' name='stibp'/>
Aug 09 15:11:05 user nova-compute[72382]:       <feature policy='require' name='arch-capabilities'/>
Aug 09 15:11:05 user nova-compute[72382]:       <feature policy='require' name='ssbd'/>
Aug 09 15:11:05 user nova-compute[72382]:       <feature policy='require' name='invtsc'/>
Aug 09 15:11:05 user nova-compute[72382]:       <feature policy='require' name='ibpb'/>
Aug 09 15:11:05 user nova-compute[72382]:       <feature policy='require' name='ibrs'/>
Aug 09 15:11:05 user nova-compute[72382]:       <feature policy='require' name='amd-stibp'/>
Aug 09 15:11:05 user nova-compute[72382]:       <feature policy='require' name='amd-ssbd'/>
Aug 09 15:11:05 user nova-compute[72382]:       <feature policy='require' name='rsba'/>
Aug 09 15:11:05 user nova-compute[72382]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 09 15:11:05 user nova-compute[72382]:       <feature policy='require' name='pschange-mc-no'/>
Aug 09 15:11:05 user nova-compute[72382]:       <feature policy='disable' name='erms'/>
Aug 09 15:11:05 user nova-compute[72382]:       <feature policy='disable' name='xsaveopt'/>
Aug 09 15:11:05 user nova-compute[72382]:     </mode>
Aug 09 15:11:05 user nova-compute[72382]:     <mode name='custom' supported='yes'>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>qemu64</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='yes'>qemu32</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>phenom</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='yes'>pentium3</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='yes'>pentium2</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='yes'>pentium</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>n270</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='yes'>kvm64</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='yes'>kvm32</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='yes'>coreduo</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='yes'>core2duo</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>athlon</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='yes'>Westmere-IBRS</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='yes'>Westmere</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>Snowridge</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>Skylake-Server</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>Skylake-Client</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>SandyBridge</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='yes'>Penryn</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>Opteron_G5</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>Opteron_G4</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>Opteron_G3</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>Opteron_G2</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='yes'>Opteron_G1</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='yes'>Nehalem</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>IvyBridge</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>Icelake-Server</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>Haswell-noTSX</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>Haswell-IBRS</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>Haswell</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>EPYC-Rome</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>EPYC-Milan</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>EPYC-IBPB</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>EPYC</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>Dhyana</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>Cooperlake</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='yes'>Conroe</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>Cascadelake-Server</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>Broadwell-noTSX</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>Broadwell-IBRS</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>Broadwell</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='yes'>486</model>
Aug 09 15:11:05 user nova-compute[72382]:     </mode>
Aug 09 15:11:05 user nova-compute[72382]:   </cpu>
Aug 09 15:11:05 user nova-compute[72382]:   <memoryBacking supported='yes'>
Aug 09 15:11:05 user nova-compute[72382]:     <enum name='sourceType'>
Aug 09 15:11:05 user nova-compute[72382]:       <value>file</value>
Aug 09 15:11:05 user nova-compute[72382]:       <value>anonymous</value>
Aug 09 15:11:05 user nova-compute[72382]:       <value>memfd</value>
Aug 09 15:11:05 user nova-compute[72382]:     </enum>
Aug 09 15:11:05 user nova-compute[72382]:   </memoryBacking>
Aug 09 15:11:05 user nova-compute[72382]:   <devices>
Aug 09 15:11:05 user nova-compute[72382]:     <disk supported='yes'>
Aug 09 15:11:05 user nova-compute[72382]:       <enum name='diskDevice'>
Aug 09 15:11:05 user nova-compute[72382]:         <value>disk</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>cdrom</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>floppy</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>lun</value>
Aug 09 15:11:05 user nova-compute[72382]:       </enum>
Aug 09 15:11:05 user nova-compute[72382]:       <enum name='bus'>
Aug 09 15:11:05 user nova-compute[72382]:         <value>ide</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>fdc</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>scsi</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>virtio</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>usb</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>sata</value>
Aug 09 15:11:05 user nova-compute[72382]:       </enum>
Aug 09 15:11:05 user nova-compute[72382]:       <enum name='model'>
Aug 09 15:11:05 user nova-compute[72382]:         <value>virtio</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>virtio-transitional</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>virtio-non-transitional</value>
Aug 09 15:11:05 user nova-compute[72382]:       </enum>
Aug 09 15:11:05 user nova-compute[72382]:     </disk>
Aug 09 15:11:05 user nova-compute[72382]:     <graphics supported='yes'>
Aug 09 15:11:05 user nova-compute[72382]:       <enum name='type'>
Aug 09 15:11:05 user nova-compute[72382]:         <value>sdl</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>vnc</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>spice</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>egl-headless</value>
Aug 09 15:11:05 user nova-compute[72382]:       </enum>
Aug 09 15:11:05 user nova-compute[72382]:     </graphics>
Aug 09 15:11:05 user nova-compute[72382]:     <video supported='yes'>
Aug 09 15:11:05 user nova-compute[72382]:       <enum name='modelType'>
Aug 09 15:11:05 user nova-compute[72382]:         <value>vga</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>cirrus</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>vmvga</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>qxl</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>virtio</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>none</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>bochs</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>ramfb</value>
Aug 09 15:11:05 user nova-compute[72382]:       </enum>
Aug 09 15:11:05 user nova-compute[72382]:     </video>
Aug 09 15:11:05 user nova-compute[72382]:     <hostdev supported='yes'>
Aug 09 15:11:05 user nova-compute[72382]:       <enum name='mode'>
Aug 09 15:11:05 user nova-compute[72382]:         <value>subsystem</value>
Aug 09 15:11:05 user nova-compute[72382]:       </enum>
Aug 09 15:11:05 user nova-compute[72382]:       <enum name='startupPolicy'>
Aug 09 15:11:05 user nova-compute[72382]:         <value>default</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>mandatory</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>requisite</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>optional</value>
Aug 09 15:11:05 user nova-compute[72382]:       </enum>
Aug 09 15:11:05 user nova-compute[72382]:       <enum name='subsysType'>
Aug 09 15:11:05 user nova-compute[72382]:         <value>usb</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>pci</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>scsi</value>
Aug 09 15:11:05 user nova-compute[72382]:       </enum>
Aug 09 15:11:05 user nova-compute[72382]:       <enum name='capsType'/>
Aug 09 15:11:05 user nova-compute[72382]:       <enum name='pciBackend'/>
Aug 09 15:11:05 user nova-compute[72382]:     </hostdev>
Aug 09 15:11:05 user nova-compute[72382]:     <rng supported='yes'>
Aug 09 15:11:05 user nova-compute[72382]:       <enum name='model'>
Aug 09 15:11:05 user nova-compute[72382]:         <value>virtio</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>virtio-transitional</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>virtio-non-transitional</value>
Aug 09 15:11:05 user nova-compute[72382]:       </enum>
Aug 09 15:11:05 user nova-compute[72382]:       <enum name='backendModel'>
Aug 09 15:11:05 user nova-compute[72382]:         <value>random</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>egd</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>builtin</value>
Aug 09 15:11:05 user nova-compute[72382]:       </enum>
Aug 09 15:11:05 user nova-compute[72382]:     </rng>
Aug 09 15:11:05 user nova-compute[72382]:     <filesystem supported='yes'>
Aug 09 15:11:05 user nova-compute[72382]:       <enum name='driverType'>
Aug 09 15:11:05 user nova-compute[72382]:         <value>path</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>handle</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>virtiofs</value>
Aug 09 15:11:05 user nova-compute[72382]:       </enum>
Aug 09 15:11:05 user nova-compute[72382]:     </filesystem>
Aug 09 15:11:05 user nova-compute[72382]:     <tpm supported='yes'>
Aug 09 15:11:05 user nova-compute[72382]:       <enum name='model'>
Aug 09 15:11:05 user nova-compute[72382]:         <value>tpm-tis</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>tpm-crb</value>
Aug 09 15:11:05 user nova-compute[72382]:       </enum>
Aug 09 15:11:05 user nova-compute[72382]:       <enum name='backendModel'>
Aug 09 15:11:05 user nova-compute[72382]:         <value>passthrough</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>emulator</value>
Aug 09 15:11:05 user nova-compute[72382]:       </enum>
Aug 09 15:11:05 user nova-compute[72382]:     </tpm>
Aug 09 15:11:05 user nova-compute[72382]:   </devices>
Aug 09 15:11:05 user nova-compute[72382]:   <features>
Aug 09 15:11:05 user nova-compute[72382]:     <gic supported='no'/>
Aug 09 15:11:05 user nova-compute[72382]:     <vmcoreinfo supported='yes'/>
Aug 09 15:11:05 user nova-compute[72382]:     <genid supported='yes'/>
Aug 09 15:11:05 user nova-compute[72382]:     <backingStoreInput supported='yes'/>
Aug 09 15:11:05 user nova-compute[72382]:     <backup supported='yes'/>
Aug 09 15:11:05 user nova-compute[72382]:     <sev supported='no'/>
Aug 09 15:11:05 user nova-compute[72382]:   </features>
Aug 09 15:11:05 user nova-compute[72382]: </domainCapabilities>
Aug 09 15:11:05 user nova-compute[72382]:  {{(pid=72382) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 09 15:11:05 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Aug 09 15:11:05 user nova-compute[72382]: <domainCapabilities>
Aug 09 15:11:05 user nova-compute[72382]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 09 15:11:05 user nova-compute[72382]:   <domain>kvm</domain>
Aug 09 15:11:05 user nova-compute[72382]:   <machine>pc-q35-6.2</machine>
Aug 09 15:11:05 user nova-compute[72382]:   <arch>x86_64</arch>
Aug 09 15:11:05 user nova-compute[72382]:   <vcpu max='288'/>
Aug 09 15:11:05 user nova-compute[72382]:   <iothreads supported='yes'/>
Aug 09 15:11:05 user nova-compute[72382]:   <os supported='yes'>
Aug 09 15:11:05 user nova-compute[72382]:     <enum name='firmware'>
Aug 09 15:11:05 user nova-compute[72382]:       <value>efi</value>
Aug 09 15:11:05 user nova-compute[72382]:     </enum>
Aug 09 15:11:05 user nova-compute[72382]:     <loader supported='yes'>
Aug 09 15:11:05 user nova-compute[72382]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Aug 09 15:11:05 user nova-compute[72382]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Aug 09 15:11:05 user nova-compute[72382]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 09 15:11:05 user nova-compute[72382]:       <enum name='type'>
Aug 09 15:11:05 user nova-compute[72382]:         <value>rom</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>pflash</value>
Aug 09 15:11:05 user nova-compute[72382]:       </enum>
Aug 09 15:11:05 user nova-compute[72382]:       <enum name='readonly'>
Aug 09 15:11:05 user nova-compute[72382]:         <value>yes</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>no</value>
Aug 09 15:11:05 user nova-compute[72382]:       </enum>
Aug 09 15:11:05 user nova-compute[72382]:       <enum name='secure'>
Aug 09 15:11:05 user nova-compute[72382]:         <value>yes</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>no</value>
Aug 09 15:11:05 user nova-compute[72382]:       </enum>
Aug 09 15:11:05 user nova-compute[72382]:     </loader>
Aug 09 15:11:05 user nova-compute[72382]:   </os>
Aug 09 15:11:05 user nova-compute[72382]:   <cpu>
Aug 09 15:11:05 user nova-compute[72382]:     <mode name='host-passthrough' supported='yes'>
Aug 09 15:11:05 user nova-compute[72382]:       <enum name='hostPassthroughMigratable'>
Aug 09 15:11:05 user nova-compute[72382]:         <value>on</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>off</value>
Aug 09 15:11:05 user nova-compute[72382]:       </enum>
Aug 09 15:11:05 user nova-compute[72382]:     </mode>
Aug 09 15:11:05 user nova-compute[72382]:     <mode name='maximum' supported='yes'>
Aug 09 15:11:05 user nova-compute[72382]:       <enum name='maximumMigratable'>
Aug 09 15:11:05 user nova-compute[72382]:         <value>on</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>off</value>
Aug 09 15:11:05 user nova-compute[72382]:       </enum>
Aug 09 15:11:05 user nova-compute[72382]:     </mode>
Aug 09 15:11:05 user nova-compute[72382]:     <mode name='host-model' supported='yes'>
Aug 09 15:11:05 user nova-compute[72382]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 09 15:11:05 user nova-compute[72382]:       <vendor>Intel</vendor>
Aug 09 15:11:05 user nova-compute[72382]:       <feature policy='require' name='ss'/>
Aug 09 15:11:05 user nova-compute[72382]:       <feature policy='require' name='vmx'/>
Aug 09 15:11:05 user nova-compute[72382]:       <feature policy='require' name='pcid'/>
Aug 09 15:11:05 user nova-compute[72382]:       <feature policy='require' name='hypervisor'/>
Aug 09 15:11:05 user nova-compute[72382]:       <feature policy='require' name='arat'/>
Aug 09 15:11:05 user nova-compute[72382]:       <feature policy='require' name='tsc_adjust'/>
Aug 09 15:11:05 user nova-compute[72382]:       <feature policy='require' name='umip'/>
Aug 09 15:11:05 user nova-compute[72382]:       <feature policy='require' name='md-clear'/>
Aug 09 15:11:05 user nova-compute[72382]:       <feature policy='require' name='stibp'/>
Aug 09 15:11:05 user nova-compute[72382]:       <feature policy='require' name='arch-capabilities'/>
Aug 09 15:11:05 user nova-compute[72382]:       <feature policy='require' name='ssbd'/>
Aug 09 15:11:05 user nova-compute[72382]:       <feature policy='require' name='invtsc'/>
Aug 09 15:11:05 user nova-compute[72382]:       <feature policy='require' name='ibpb'/>
Aug 09 15:11:05 user nova-compute[72382]:       <feature policy='require' name='ibrs'/>
Aug 09 15:11:05 user nova-compute[72382]:       <feature policy='require' name='amd-stibp'/>
Aug 09 15:11:05 user nova-compute[72382]:       <feature policy='require' name='amd-ssbd'/>
Aug 09 15:11:05 user nova-compute[72382]:       <feature policy='require' name='rsba'/>
Aug 09 15:11:05 user nova-compute[72382]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 09 15:11:05 user nova-compute[72382]:       <feature policy='require' name='pschange-mc-no'/>
Aug 09 15:11:05 user nova-compute[72382]:       <feature policy='disable' name='erms'/>
Aug 09 15:11:05 user nova-compute[72382]:       <feature policy='disable' name='xsaveopt'/>
Aug 09 15:11:05 user nova-compute[72382]:     </mode>
Aug 09 15:11:05 user nova-compute[72382]:     <mode name='custom' supported='yes'>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>qemu64</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='yes'>qemu32</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>phenom</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='yes'>pentium3</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='yes'>pentium2</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='yes'>pentium</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>n270</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='yes'>kvm64</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='yes'>kvm32</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='yes'>coreduo</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='yes'>core2duo</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>athlon</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='yes'>Westmere-IBRS</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='yes'>Westmere</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>Snowridge</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>Skylake-Server</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>Skylake-Client</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>SandyBridge</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='yes'>Penryn</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>Opteron_G5</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>Opteron_G4</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>Opteron_G3</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>Opteron_G2</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='yes'>Opteron_G1</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='yes'>Nehalem</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>IvyBridge</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>Icelake-Server</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>Haswell-noTSX</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>Haswell-IBRS</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>Haswell</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>EPYC-Rome</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>EPYC-Milan</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>EPYC-IBPB</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>EPYC</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>Dhyana</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>Cooperlake</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='yes'>Conroe</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>Cascadelake-Server</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>Broadwell-noTSX</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>Broadwell-IBRS</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>Broadwell</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='yes'>486</model>
Aug 09 15:11:05 user nova-compute[72382]:     </mode>
Aug 09 15:11:05 user nova-compute[72382]:   </cpu>
Aug 09 15:11:05 user nova-compute[72382]:   <memoryBacking supported='yes'>
Aug 09 15:11:05 user nova-compute[72382]:     <enum name='sourceType'>
Aug 09 15:11:05 user nova-compute[72382]:       <value>file</value>
Aug 09 15:11:05 user nova-compute[72382]:       <value>anonymous</value>
Aug 09 15:11:05 user nova-compute[72382]:       <value>memfd</value>
Aug 09 15:11:05 user nova-compute[72382]:     </enum>
Aug 09 15:11:05 user nova-compute[72382]:   </memoryBacking>
Aug 09 15:11:05 user nova-compute[72382]:   <devices>
Aug 09 15:11:05 user nova-compute[72382]:     <disk supported='yes'>
Aug 09 15:11:05 user nova-compute[72382]:       <enum name='diskDevice'>
Aug 09 15:11:05 user nova-compute[72382]:         <value>disk</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>cdrom</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>floppy</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>lun</value>
Aug 09 15:11:05 user nova-compute[72382]:       </enum>
Aug 09 15:11:05 user nova-compute[72382]:       <enum name='bus'>
Aug 09 15:11:05 user nova-compute[72382]:         <value>fdc</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>scsi</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>virtio</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>usb</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>sata</value>
Aug 09 15:11:05 user nova-compute[72382]:       </enum>
Aug 09 15:11:05 user nova-compute[72382]:       <enum name='model'>
Aug 09 15:11:05 user nova-compute[72382]:         <value>virtio</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>virtio-transitional</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>virtio-non-transitional</value>
Aug 09 15:11:05 user nova-compute[72382]:       </enum>
Aug 09 15:11:05 user nova-compute[72382]:     </disk>
Aug 09 15:11:05 user nova-compute[72382]:     <graphics supported='yes'>
Aug 09 15:11:05 user nova-compute[72382]:       <enum name='type'>
Aug 09 15:11:05 user nova-compute[72382]:         <value>sdl</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>vnc</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>spice</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>egl-headless</value>
Aug 09 15:11:05 user nova-compute[72382]:       </enum>
Aug 09 15:11:05 user nova-compute[72382]:     </graphics>
Aug 09 15:11:05 user nova-compute[72382]:     <video supported='yes'>
Aug 09 15:11:05 user nova-compute[72382]:       <enum name='modelType'>
Aug 09 15:11:05 user nova-compute[72382]:         <value>vga</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>cirrus</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>vmvga</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>qxl</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>virtio</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>none</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>bochs</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>ramfb</value>
Aug 09 15:11:05 user nova-compute[72382]:       </enum>
Aug 09 15:11:05 user nova-compute[72382]:     </video>
Aug 09 15:11:05 user nova-compute[72382]:     <hostdev supported='yes'>
Aug 09 15:11:05 user nova-compute[72382]:       <enum name='mode'>
Aug 09 15:11:05 user nova-compute[72382]:         <value>subsystem</value>
Aug 09 15:11:05 user nova-compute[72382]:       </enum>
Aug 09 15:11:05 user nova-compute[72382]:       <enum name='startupPolicy'>
Aug 09 15:11:05 user nova-compute[72382]:         <value>default</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>mandatory</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>requisite</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>optional</value>
Aug 09 15:11:05 user nova-compute[72382]:       </enum>
Aug 09 15:11:05 user nova-compute[72382]:       <enum name='subsysType'>
Aug 09 15:11:05 user nova-compute[72382]:         <value>usb</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>pci</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>scsi</value>
Aug 09 15:11:05 user nova-compute[72382]:       </enum>
Aug 09 15:11:05 user nova-compute[72382]:       <enum name='capsType'/>
Aug 09 15:11:05 user nova-compute[72382]:       <enum name='pciBackend'/>
Aug 09 15:11:05 user nova-compute[72382]:     </hostdev>
Aug 09 15:11:05 user nova-compute[72382]:     <rng supported='yes'>
Aug 09 15:11:05 user nova-compute[72382]:       <enum name='model'>
Aug 09 15:11:05 user nova-compute[72382]:         <value>virtio</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>virtio-transitional</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>virtio-non-transitional</value>
Aug 09 15:11:05 user nova-compute[72382]:       </enum>
Aug 09 15:11:05 user nova-compute[72382]:       <enum name='backendModel'>
Aug 09 15:11:05 user nova-compute[72382]:         <value>random</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>egd</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>builtin</value>
Aug 09 15:11:05 user nova-compute[72382]:       </enum>
Aug 09 15:11:05 user nova-compute[72382]:     </rng>
Aug 09 15:11:05 user nova-compute[72382]:     <filesystem supported='yes'>
Aug 09 15:11:05 user nova-compute[72382]:       <enum name='driverType'>
Aug 09 15:11:05 user nova-compute[72382]:         <value>path</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>handle</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>virtiofs</value>
Aug 09 15:11:05 user nova-compute[72382]:       </enum>
Aug 09 15:11:05 user nova-compute[72382]:     </filesystem>
Aug 09 15:11:05 user nova-compute[72382]:     <tpm supported='yes'>
Aug 09 15:11:05 user nova-compute[72382]:       <enum name='model'>
Aug 09 15:11:05 user nova-compute[72382]:         <value>tpm-tis</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>tpm-crb</value>
Aug 09 15:11:05 user nova-compute[72382]:       </enum>
Aug 09 15:11:05 user nova-compute[72382]:       <enum name='backendModel'>
Aug 09 15:11:05 user nova-compute[72382]:         <value>passthrough</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>emulator</value>
Aug 09 15:11:05 user nova-compute[72382]:       </enum>
Aug 09 15:11:05 user nova-compute[72382]:     </tpm>
Aug 09 15:11:05 user nova-compute[72382]:   </devices>
Aug 09 15:11:05 user nova-compute[72382]:   <features>
Aug 09 15:11:05 user nova-compute[72382]:     <gic supported='no'/>
Aug 09 15:11:05 user nova-compute[72382]:     <vmcoreinfo supported='yes'/>
Aug 09 15:11:05 user nova-compute[72382]:     <genid supported='yes'/>
Aug 09 15:11:05 user nova-compute[72382]:     <backingStoreInput supported='yes'/>
Aug 09 15:11:05 user nova-compute[72382]:     <backup supported='yes'/>
Aug 09 15:11:05 user nova-compute[72382]:     <sev supported='no'/>
Aug 09 15:11:05 user nova-compute[72382]:   </features>
Aug 09 15:11:05 user nova-compute[72382]: </domainCapabilities>
Aug 09 15:11:05 user nova-compute[72382]:  {{(pid=72382) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 09 15:11:05 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Aug 09 15:11:05 user nova-compute[72382]: <domainCapabilities>
Aug 09 15:11:05 user nova-compute[72382]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 09 15:11:05 user nova-compute[72382]:   <domain>kvm</domain>
Aug 09 15:11:05 user nova-compute[72382]:   <machine>pc-i440fx-jammy</machine>
Aug 09 15:11:05 user nova-compute[72382]:   <arch>x86_64</arch>
Aug 09 15:11:05 user nova-compute[72382]:   <vcpu max='255'/>
Aug 09 15:11:05 user nova-compute[72382]:   <iothreads supported='yes'/>
Aug 09 15:11:05 user nova-compute[72382]:   <os supported='yes'>
Aug 09 15:11:05 user nova-compute[72382]:     <enum name='firmware'>
Aug 09 15:11:05 user nova-compute[72382]:       <value>efi</value>
Aug 09 15:11:05 user nova-compute[72382]:     </enum>
Aug 09 15:11:05 user nova-compute[72382]:     <loader supported='yes'>
Aug 09 15:11:05 user nova-compute[72382]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 09 15:11:05 user nova-compute[72382]:       <enum name='type'>
Aug 09 15:11:05 user nova-compute[72382]:         <value>rom</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>pflash</value>
Aug 09 15:11:05 user nova-compute[72382]:       </enum>
Aug 09 15:11:05 user nova-compute[72382]:       <enum name='readonly'>
Aug 09 15:11:05 user nova-compute[72382]:         <value>yes</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>no</value>
Aug 09 15:11:05 user nova-compute[72382]:       </enum>
Aug 09 15:11:05 user nova-compute[72382]:       <enum name='secure'>
Aug 09 15:11:05 user nova-compute[72382]:         <value>no</value>
Aug 09 15:11:05 user nova-compute[72382]:       </enum>
Aug 09 15:11:05 user nova-compute[72382]:     </loader>
Aug 09 15:11:05 user nova-compute[72382]:   </os>
Aug 09 15:11:05 user nova-compute[72382]:   <cpu>
Aug 09 15:11:05 user nova-compute[72382]:     <mode name='host-passthrough' supported='yes'>
Aug 09 15:11:05 user nova-compute[72382]:       <enum name='hostPassthroughMigratable'>
Aug 09 15:11:05 user nova-compute[72382]:         <value>on</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>off</value>
Aug 09 15:11:05 user nova-compute[72382]:       </enum>
Aug 09 15:11:05 user nova-compute[72382]:     </mode>
Aug 09 15:11:05 user nova-compute[72382]:     <mode name='maximum' supported='yes'>
Aug 09 15:11:05 user nova-compute[72382]:       <enum name='maximumMigratable'>
Aug 09 15:11:05 user nova-compute[72382]:         <value>on</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>off</value>
Aug 09 15:11:05 user nova-compute[72382]:       </enum>
Aug 09 15:11:05 user nova-compute[72382]:     </mode>
Aug 09 15:11:05 user nova-compute[72382]:     <mode name='host-model' supported='yes'>
Aug 09 15:11:05 user nova-compute[72382]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 09 15:11:05 user nova-compute[72382]:       <vendor>Intel</vendor>
Aug 09 15:11:05 user nova-compute[72382]:       <feature policy='require' name='ss'/>
Aug 09 15:11:05 user nova-compute[72382]:       <feature policy='require' name='vmx'/>
Aug 09 15:11:05 user nova-compute[72382]:       <feature policy='require' name='pcid'/>
Aug 09 15:11:05 user nova-compute[72382]:       <feature policy='require' name='hypervisor'/>
Aug 09 15:11:05 user nova-compute[72382]:       <feature policy='require' name='arat'/>
Aug 09 15:11:05 user nova-compute[72382]:       <feature policy='require' name='tsc_adjust'/>
Aug 09 15:11:05 user nova-compute[72382]:       <feature policy='require' name='umip'/>
Aug 09 15:11:05 user nova-compute[72382]:       <feature policy='require' name='md-clear'/>
Aug 09 15:11:05 user nova-compute[72382]:       <feature policy='require' name='stibp'/>
Aug 09 15:11:05 user nova-compute[72382]:       <feature policy='require' name='arch-capabilities'/>
Aug 09 15:11:05 user nova-compute[72382]:       <feature policy='require' name='ssbd'/>
Aug 09 15:11:05 user nova-compute[72382]:       <feature policy='require' name='invtsc'/>
Aug 09 15:11:05 user nova-compute[72382]:       <feature policy='require' name='ibpb'/>
Aug 09 15:11:05 user nova-compute[72382]:       <feature policy='require' name='ibrs'/>
Aug 09 15:11:05 user nova-compute[72382]:       <feature policy='require' name='amd-stibp'/>
Aug 09 15:11:05 user nova-compute[72382]:       <feature policy='require' name='amd-ssbd'/>
Aug 09 15:11:05 user nova-compute[72382]:       <feature policy='require' name='rsba'/>
Aug 09 15:11:05 user nova-compute[72382]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 09 15:11:05 user nova-compute[72382]:       <feature policy='require' name='pschange-mc-no'/>
Aug 09 15:11:05 user nova-compute[72382]:       <feature policy='disable' name='erms'/>
Aug 09 15:11:05 user nova-compute[72382]:       <feature policy='disable' name='xsaveopt'/>
Aug 09 15:11:05 user nova-compute[72382]:     </mode>
Aug 09 15:11:05 user nova-compute[72382]:     <mode name='custom' supported='yes'>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>qemu64</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='yes'>qemu32</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>phenom</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='yes'>pentium3</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='yes'>pentium2</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='yes'>pentium</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>n270</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='yes'>kvm64</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='yes'>kvm32</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='yes'>coreduo</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='yes'>core2duo</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>athlon</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='yes'>Westmere-IBRS</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='yes'>Westmere</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>Snowridge</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>Skylake-Server</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>Skylake-Client</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>SandyBridge</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='yes'>Penryn</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>Opteron_G5</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>Opteron_G4</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>Opteron_G3</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>Opteron_G2</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='yes'>Opteron_G1</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='yes'>Nehalem</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>IvyBridge</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>Icelake-Server</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>Haswell-noTSX</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>Haswell-IBRS</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>Haswell</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>EPYC-Rome</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>EPYC-Milan</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>EPYC-IBPB</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>EPYC</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>Dhyana</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>Cooperlake</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='yes'>Conroe</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>Cascadelake-Server</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>Broadwell-noTSX</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>Broadwell-IBRS</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>Broadwell</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='yes'>486</model>
Aug 09 15:11:05 user nova-compute[72382]:     </mode>
Aug 09 15:11:05 user nova-compute[72382]:   </cpu>
Aug 09 15:11:05 user nova-compute[72382]:   <memoryBacking supported='yes'>
Aug 09 15:11:05 user nova-compute[72382]:     <enum name='sourceType'>
Aug 09 15:11:05 user nova-compute[72382]:       <value>file</value>
Aug 09 15:11:05 user nova-compute[72382]:       <value>anonymous</value>
Aug 09 15:11:05 user nova-compute[72382]:       <value>memfd</value>
Aug 09 15:11:05 user nova-compute[72382]:     </enum>
Aug 09 15:11:05 user nova-compute[72382]:   </memoryBacking>
Aug 09 15:11:05 user nova-compute[72382]:   <devices>
Aug 09 15:11:05 user nova-compute[72382]:     <disk supported='yes'>
Aug 09 15:11:05 user nova-compute[72382]:       <enum name='diskDevice'>
Aug 09 15:11:05 user nova-compute[72382]:         <value>disk</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>cdrom</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>floppy</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>lun</value>
Aug 09 15:11:05 user nova-compute[72382]:       </enum>
Aug 09 15:11:05 user nova-compute[72382]:       <enum name='bus'>
Aug 09 15:11:05 user nova-compute[72382]:         <value>ide</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>fdc</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>scsi</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>virtio</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>usb</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>sata</value>
Aug 09 15:11:05 user nova-compute[72382]:       </enum>
Aug 09 15:11:05 user nova-compute[72382]:       <enum name='model'>
Aug 09 15:11:05 user nova-compute[72382]:         <value>virtio</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>virtio-transitional</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>virtio-non-transitional</value>
Aug 09 15:11:05 user nova-compute[72382]:       </enum>
Aug 09 15:11:05 user nova-compute[72382]:     </disk>
Aug 09 15:11:05 user nova-compute[72382]:     <graphics supported='yes'>
Aug 09 15:11:05 user nova-compute[72382]:       <enum name='type'>
Aug 09 15:11:05 user nova-compute[72382]:         <value>sdl</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>vnc</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>spice</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>egl-headless</value>
Aug 09 15:11:05 user nova-compute[72382]:       </enum>
Aug 09 15:11:05 user nova-compute[72382]:     </graphics>
Aug 09 15:11:05 user nova-compute[72382]:     <video supported='yes'>
Aug 09 15:11:05 user nova-compute[72382]:       <enum name='modelType'>
Aug 09 15:11:05 user nova-compute[72382]:         <value>vga</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>cirrus</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>vmvga</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>qxl</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>virtio</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>none</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>bochs</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>ramfb</value>
Aug 09 15:11:05 user nova-compute[72382]:       </enum>
Aug 09 15:11:05 user nova-compute[72382]:     </video>
Aug 09 15:11:05 user nova-compute[72382]:     <hostdev supported='yes'>
Aug 09 15:11:05 user nova-compute[72382]:       <enum name='mode'>
Aug 09 15:11:05 user nova-compute[72382]:         <value>subsystem</value>
Aug 09 15:11:05 user nova-compute[72382]:       </enum>
Aug 09 15:11:05 user nova-compute[72382]:       <enum name='startupPolicy'>
Aug 09 15:11:05 user nova-compute[72382]:         <value>default</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>mandatory</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>requisite</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>optional</value>
Aug 09 15:11:05 user nova-compute[72382]:       </enum>
Aug 09 15:11:05 user nova-compute[72382]:       <enum name='subsysType'>
Aug 09 15:11:05 user nova-compute[72382]:         <value>usb</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>pci</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>scsi</value>
Aug 09 15:11:05 user nova-compute[72382]:       </enum>
Aug 09 15:11:05 user nova-compute[72382]:       <enum name='capsType'/>
Aug 09 15:11:05 user nova-compute[72382]:       <enum name='pciBackend'/>
Aug 09 15:11:05 user nova-compute[72382]:     </hostdev>
Aug 09 15:11:05 user nova-compute[72382]:     <rng supported='yes'>
Aug 09 15:11:05 user nova-compute[72382]:       <enum name='model'>
Aug 09 15:11:05 user nova-compute[72382]:         <value>virtio</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>virtio-transitional</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>virtio-non-transitional</value>
Aug 09 15:11:05 user nova-compute[72382]:       </enum>
Aug 09 15:11:05 user nova-compute[72382]:       <enum name='backendModel'>
Aug 09 15:11:05 user nova-compute[72382]:         <value>random</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>egd</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>builtin</value>
Aug 09 15:11:05 user nova-compute[72382]:       </enum>
Aug 09 15:11:05 user nova-compute[72382]:     </rng>
Aug 09 15:11:05 user nova-compute[72382]:     <filesystem supported='yes'>
Aug 09 15:11:05 user nova-compute[72382]:       <enum name='driverType'>
Aug 09 15:11:05 user nova-compute[72382]:         <value>path</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>handle</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>virtiofs</value>
Aug 09 15:11:05 user nova-compute[72382]:       </enum>
Aug 09 15:11:05 user nova-compute[72382]:     </filesystem>
Aug 09 15:11:05 user nova-compute[72382]:     <tpm supported='yes'>
Aug 09 15:11:05 user nova-compute[72382]:       <enum name='model'>
Aug 09 15:11:05 user nova-compute[72382]:         <value>tpm-tis</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>tpm-crb</value>
Aug 09 15:11:05 user nova-compute[72382]:       </enum>
Aug 09 15:11:05 user nova-compute[72382]:       <enum name='backendModel'>
Aug 09 15:11:05 user nova-compute[72382]:         <value>passthrough</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>emulator</value>
Aug 09 15:11:05 user nova-compute[72382]:       </enum>
Aug 09 15:11:05 user nova-compute[72382]:     </tpm>
Aug 09 15:11:05 user nova-compute[72382]:   </devices>
Aug 09 15:11:05 user nova-compute[72382]:   <features>
Aug 09 15:11:05 user nova-compute[72382]:     <gic supported='no'/>
Aug 09 15:11:05 user nova-compute[72382]:     <vmcoreinfo supported='yes'/>
Aug 09 15:11:05 user nova-compute[72382]:     <genid supported='yes'/>
Aug 09 15:11:05 user nova-compute[72382]:     <backingStoreInput supported='yes'/>
Aug 09 15:11:05 user nova-compute[72382]:     <backup supported='yes'/>
Aug 09 15:11:05 user nova-compute[72382]:     <sev supported='no'/>
Aug 09 15:11:05 user nova-compute[72382]:   </features>
Aug 09 15:11:05 user nova-compute[72382]: </domainCapabilities>
Aug 09 15:11:05 user nova-compute[72382]:  {{(pid=72382) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 09 15:11:05 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Aug 09 15:11:05 user nova-compute[72382]: <domainCapabilities>
Aug 09 15:11:05 user nova-compute[72382]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 09 15:11:05 user nova-compute[72382]:   <domain>kvm</domain>
Aug 09 15:11:05 user nova-compute[72382]:   <machine>pc-q35-jammy</machine>
Aug 09 15:11:05 user nova-compute[72382]:   <arch>x86_64</arch>
Aug 09 15:11:05 user nova-compute[72382]:   <vcpu max='288'/>
Aug 09 15:11:05 user nova-compute[72382]:   <iothreads supported='yes'/>
Aug 09 15:11:05 user nova-compute[72382]:   <os supported='yes'>
Aug 09 15:11:05 user nova-compute[72382]:     <enum name='firmware'>
Aug 09 15:11:05 user nova-compute[72382]:       <value>efi</value>
Aug 09 15:11:05 user nova-compute[72382]:     </enum>
Aug 09 15:11:05 user nova-compute[72382]:     <loader supported='yes'>
Aug 09 15:11:05 user nova-compute[72382]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Aug 09 15:11:05 user nova-compute[72382]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Aug 09 15:11:05 user nova-compute[72382]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 09 15:11:05 user nova-compute[72382]:       <enum name='type'>
Aug 09 15:11:05 user nova-compute[72382]:         <value>rom</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>pflash</value>
Aug 09 15:11:05 user nova-compute[72382]:       </enum>
Aug 09 15:11:05 user nova-compute[72382]:       <enum name='readonly'>
Aug 09 15:11:05 user nova-compute[72382]:         <value>yes</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>no</value>
Aug 09 15:11:05 user nova-compute[72382]:       </enum>
Aug 09 15:11:05 user nova-compute[72382]:       <enum name='secure'>
Aug 09 15:11:05 user nova-compute[72382]:         <value>yes</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>no</value>
Aug 09 15:11:05 user nova-compute[72382]:       </enum>
Aug 09 15:11:05 user nova-compute[72382]:     </loader>
Aug 09 15:11:05 user nova-compute[72382]:   </os>
Aug 09 15:11:05 user nova-compute[72382]:   <cpu>
Aug 09 15:11:05 user nova-compute[72382]:     <mode name='host-passthrough' supported='yes'>
Aug 09 15:11:05 user nova-compute[72382]:       <enum name='hostPassthroughMigratable'>
Aug 09 15:11:05 user nova-compute[72382]:         <value>on</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>off</value>
Aug 09 15:11:05 user nova-compute[72382]:       </enum>
Aug 09 15:11:05 user nova-compute[72382]:     </mode>
Aug 09 15:11:05 user nova-compute[72382]:     <mode name='maximum' supported='yes'>
Aug 09 15:11:05 user nova-compute[72382]:       <enum name='maximumMigratable'>
Aug 09 15:11:05 user nova-compute[72382]:         <value>on</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>off</value>
Aug 09 15:11:05 user nova-compute[72382]:       </enum>
Aug 09 15:11:05 user nova-compute[72382]:     </mode>
Aug 09 15:11:05 user nova-compute[72382]:     <mode name='host-model' supported='yes'>
Aug 09 15:11:05 user nova-compute[72382]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 09 15:11:05 user nova-compute[72382]:       <vendor>Intel</vendor>
Aug 09 15:11:05 user nova-compute[72382]:       <feature policy='require' name='ss'/>
Aug 09 15:11:05 user nova-compute[72382]:       <feature policy='require' name='vmx'/>
Aug 09 15:11:05 user nova-compute[72382]:       <feature policy='require' name='pcid'/>
Aug 09 15:11:05 user nova-compute[72382]:       <feature policy='require' name='hypervisor'/>
Aug 09 15:11:05 user nova-compute[72382]:       <feature policy='require' name='arat'/>
Aug 09 15:11:05 user nova-compute[72382]:       <feature policy='require' name='tsc_adjust'/>
Aug 09 15:11:05 user nova-compute[72382]:       <feature policy='require' name='umip'/>
Aug 09 15:11:05 user nova-compute[72382]:       <feature policy='require' name='md-clear'/>
Aug 09 15:11:05 user nova-compute[72382]:       <feature policy='require' name='stibp'/>
Aug 09 15:11:05 user nova-compute[72382]:       <feature policy='require' name='arch-capabilities'/>
Aug 09 15:11:05 user nova-compute[72382]:       <feature policy='require' name='ssbd'/>
Aug 09 15:11:05 user nova-compute[72382]:       <feature policy='require' name='invtsc'/>
Aug 09 15:11:05 user nova-compute[72382]:       <feature policy='require' name='ibpb'/>
Aug 09 15:11:05 user nova-compute[72382]:       <feature policy='require' name='ibrs'/>
Aug 09 15:11:05 user nova-compute[72382]:       <feature policy='require' name='amd-stibp'/>
Aug 09 15:11:05 user nova-compute[72382]:       <feature policy='require' name='amd-ssbd'/>
Aug 09 15:11:05 user nova-compute[72382]:       <feature policy='require' name='rsba'/>
Aug 09 15:11:05 user nova-compute[72382]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 09 15:11:05 user nova-compute[72382]:       <feature policy='require' name='pschange-mc-no'/>
Aug 09 15:11:05 user nova-compute[72382]:       <feature policy='disable' name='erms'/>
Aug 09 15:11:05 user nova-compute[72382]:       <feature policy='disable' name='xsaveopt'/>
Aug 09 15:11:05 user nova-compute[72382]:     </mode>
Aug 09 15:11:05 user nova-compute[72382]:     <mode name='custom' supported='yes'>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>qemu64</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='yes'>qemu32</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>phenom</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='yes'>pentium3</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='yes'>pentium2</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='yes'>pentium</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>n270</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='yes'>kvm64</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='yes'>kvm32</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='yes'>coreduo</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='yes'>core2duo</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>athlon</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='yes'>Westmere-IBRS</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='yes'>Westmere</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>Snowridge</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>Skylake-Server</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>Skylake-Client</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>SandyBridge</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='yes'>Penryn</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>Opteron_G5</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>Opteron_G4</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>Opteron_G3</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>Opteron_G2</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='yes'>Opteron_G1</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='yes'>Nehalem</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>IvyBridge</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>Icelake-Server</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>Haswell-noTSX</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>Haswell-IBRS</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>Haswell</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>EPYC-Rome</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>EPYC-Milan</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>EPYC-IBPB</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>EPYC</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>Dhyana</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>Cooperlake</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='yes'>Conroe</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>Cascadelake-Server</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>Broadwell-noTSX</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>Broadwell-IBRS</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='no'>Broadwell</model>
Aug 09 15:11:05 user nova-compute[72382]:       <model usable='yes'>486</model>
Aug 09 15:11:05 user nova-compute[72382]:     </mode>
Aug 09 15:11:05 user nova-compute[72382]:   </cpu>
Aug 09 15:11:05 user nova-compute[72382]:   <memoryBacking supported='yes'>
Aug 09 15:11:05 user nova-compute[72382]:     <enum name='sourceType'>
Aug 09 15:11:05 user nova-compute[72382]:       <value>file</value>
Aug 09 15:11:05 user nova-compute[72382]:       <value>anonymous</value>
Aug 09 15:11:05 user nova-compute[72382]:       <value>memfd</value>
Aug 09 15:11:05 user nova-compute[72382]:     </enum>
Aug 09 15:11:05 user nova-compute[72382]:   </memoryBacking>
Aug 09 15:11:05 user nova-compute[72382]:   <devices>
Aug 09 15:11:05 user nova-compute[72382]:     <disk supported='yes'>
Aug 09 15:11:05 user nova-compute[72382]:       <enum name='diskDevice'>
Aug 09 15:11:05 user nova-compute[72382]:         <value>disk</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>cdrom</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>floppy</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>lun</value>
Aug 09 15:11:05 user nova-compute[72382]:       </enum>
Aug 09 15:11:05 user nova-compute[72382]:       <enum name='bus'>
Aug 09 15:11:05 user nova-compute[72382]:         <value>fdc</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>scsi</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>virtio</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>usb</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>sata</value>
Aug 09 15:11:05 user nova-compute[72382]:       </enum>
Aug 09 15:11:05 user nova-compute[72382]:       <enum name='model'>
Aug 09 15:11:05 user nova-compute[72382]:         <value>virtio</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>virtio-transitional</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>virtio-non-transitional</value>
Aug 09 15:11:05 user nova-compute[72382]:       </enum>
Aug 09 15:11:05 user nova-compute[72382]:     </disk>
Aug 09 15:11:05 user nova-compute[72382]:     <graphics supported='yes'>
Aug 09 15:11:05 user nova-compute[72382]:       <enum name='type'>
Aug 09 15:11:05 user nova-compute[72382]:         <value>sdl</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>vnc</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>spice</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>egl-headless</value>
Aug 09 15:11:05 user nova-compute[72382]:       </enum>
Aug 09 15:11:05 user nova-compute[72382]:     </graphics>
Aug 09 15:11:05 user nova-compute[72382]:     <video supported='yes'>
Aug 09 15:11:05 user nova-compute[72382]:       <enum name='modelType'>
Aug 09 15:11:05 user nova-compute[72382]:         <value>vga</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>cirrus</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>vmvga</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>qxl</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>virtio</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>none</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>bochs</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>ramfb</value>
Aug 09 15:11:05 user nova-compute[72382]:       </enum>
Aug 09 15:11:05 user nova-compute[72382]:     </video>
Aug 09 15:11:05 user nova-compute[72382]:     <hostdev supported='yes'>
Aug 09 15:11:05 user nova-compute[72382]:       <enum name='mode'>
Aug 09 15:11:05 user nova-compute[72382]:         <value>subsystem</value>
Aug 09 15:11:05 user nova-compute[72382]:       </enum>
Aug 09 15:11:05 user nova-compute[72382]:       <enum name='startupPolicy'>
Aug 09 15:11:05 user nova-compute[72382]:         <value>default</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>mandatory</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>requisite</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>optional</value>
Aug 09 15:11:05 user nova-compute[72382]:       </enum>
Aug 09 15:11:05 user nova-compute[72382]:       <enum name='subsysType'>
Aug 09 15:11:05 user nova-compute[72382]:         <value>usb</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>pci</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>scsi</value>
Aug 09 15:11:05 user nova-compute[72382]:       </enum>
Aug 09 15:11:05 user nova-compute[72382]:       <enum name='capsType'/>
Aug 09 15:11:05 user nova-compute[72382]:       <enum name='pciBackend'/>
Aug 09 15:11:05 user nova-compute[72382]:     </hostdev>
Aug 09 15:11:05 user nova-compute[72382]:     <rng supported='yes'>
Aug 09 15:11:05 user nova-compute[72382]:       <enum name='model'>
Aug 09 15:11:05 user nova-compute[72382]:         <value>virtio</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>virtio-transitional</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>virtio-non-transitional</value>
Aug 09 15:11:05 user nova-compute[72382]:       </enum>
Aug 09 15:11:05 user nova-compute[72382]:       <enum name='backendModel'>
Aug 09 15:11:05 user nova-compute[72382]:         <value>random</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>egd</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>builtin</value>
Aug 09 15:11:05 user nova-compute[72382]:       </enum>
Aug 09 15:11:05 user nova-compute[72382]:     </rng>
Aug 09 15:11:05 user nova-compute[72382]:     <filesystem supported='yes'>
Aug 09 15:11:05 user nova-compute[72382]:       <enum name='driverType'>
Aug 09 15:11:05 user nova-compute[72382]:         <value>path</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>handle</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>virtiofs</value>
Aug 09 15:11:05 user nova-compute[72382]:       </enum>
Aug 09 15:11:05 user nova-compute[72382]:     </filesystem>
Aug 09 15:11:05 user nova-compute[72382]:     <tpm supported='yes'>
Aug 09 15:11:05 user nova-compute[72382]:       <enum name='model'>
Aug 09 15:11:05 user nova-compute[72382]:         <value>tpm-tis</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>tpm-crb</value>
Aug 09 15:11:05 user nova-compute[72382]:       </enum>
Aug 09 15:11:05 user nova-compute[72382]:       <enum name='backendModel'>
Aug 09 15:11:05 user nova-compute[72382]:         <value>passthrough</value>
Aug 09 15:11:05 user nova-compute[72382]:         <value>emulator</value>
Aug 09 15:11:05 user nova-compute[72382]:       </enum>
Aug 09 15:11:05 user nova-compute[72382]:     </tpm>
Aug 09 15:11:05 user nova-compute[72382]:   </devices>
Aug 09 15:11:05 user nova-compute[72382]:   <features>
Aug 09 15:11:05 user nova-compute[72382]:     <gic supported='no'/>
Aug 09 15:11:05 user nova-compute[72382]:     <vmcoreinfo supported='yes'/>
Aug 09 15:11:05 user nova-compute[72382]:     <genid supported='yes'/>
Aug 09 15:11:05 user nova-compute[72382]:     <backingStoreInput supported='yes'/>
Aug 09 15:11:05 user nova-compute[72382]:     <backup supported='yes'/>
Aug 09 15:11:05 user nova-compute[72382]:     <sev supported='no'/>
Aug 09 15:11:05 user nova-compute[72382]:   </features>
Aug 09 15:11:05 user nova-compute[72382]: </domainCapabilities>
Aug 09 15:11:05 user nova-compute[72382]:  {{(pid=72382) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 09 15:11:05 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=72382) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 09 15:11:05 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=72382) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 15:11:05 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=72382) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 09 15:11:05 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=72382) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 15:11:05 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Checking secure boot support for host arch (x86_64) {{(pid=72382) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Aug 09 15:11:05 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Checking secure boot support for host arch (x86_64) {{(pid=72382) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Aug 09 15:11:05 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Checking secure boot support for host arch (x86_64) {{(pid=72382) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Aug 09 15:11:05 user nova-compute[72382]: INFO nova.virt.libvirt.host [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Secure Boot support detected
Aug 09 15:11:05 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] cpu compare xml: <cpu match="exact">
Aug 09 15:11:05 user nova-compute[72382]:   <model>Nehalem</model>
Aug 09 15:11:05 user nova-compute[72382]: </cpu>
Aug 09 15:11:05 user nova-compute[72382]:  {{(pid=72382) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10023}}
Aug 09 15:11:05 user nova-compute[72382]: INFO nova.virt.node [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Generated node identity 7b15b0e5-df4d-49db-833b-2855d21d10ae
Aug 09 15:11:05 user nova-compute[72382]: INFO nova.virt.node [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Wrote node identity 7b15b0e5-df4d-49db-833b-2855d21d10ae to /opt/stack/data/nova/compute_id
Aug 09 15:11:05 user nova-compute[72382]: WARNING nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Compute nodes ['7b15b0e5-df4d-49db-833b-2855d21d10ae'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Aug 09 15:11:05 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Aug 09 15:11:06 user nova-compute[72382]: WARNING nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Aug 09 15:11:06 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:11:06 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:11:06 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:11:06 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Auditing locally available compute resources for user (node: user) {{(pid=72382) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 15:11:06 user nova-compute[72382]: WARNING nova.virt.libvirt.driver [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 15:11:06 user nova-compute[72382]: WARNING nova.virt.libvirt.driver [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 15:11:06 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Hypervisor/Node resource view: name=user free_ram=10909MB free_disk=26.431324005126953GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72382) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 15:11:06 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:11:06 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:11:06 user nova-compute[72382]: WARNING nova.compute.resource_tracker [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] No compute node record for user:7b15b0e5-df4d-49db-833b-2855d21d10ae: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host 7b15b0e5-df4d-49db-833b-2855d21d10ae could not be found.
Aug 09 15:11:06 user nova-compute[72382]: INFO nova.compute.resource_tracker [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Compute node record created for user:user with uuid: 7b15b0e5-df4d-49db-833b-2855d21d10ae
Aug 09 15:11:06 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72382) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 15:11:06 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72382) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 15:11:06 user nova-compute[72382]: INFO nova.scheduler.client.report [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [req-34a18fb3-6bdc-45c1-a11d-925902eb3d81] Created resource provider record via placement API for resource provider with UUID 7b15b0e5-df4d-49db-833b-2855d21d10ae and name user.
Aug 09 15:11:06 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=72382) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1795}}
Aug 09 15:11:06 user nova-compute[72382]: INFO nova.virt.libvirt.host [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] kernel doesn't support AMD SEV
Aug 09 15:11:06 user nova-compute[72382]: DEBUG nova.compute.provider_tree [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Updating inventory in ProviderTree for provider 7b15b0e5-df4d-49db-833b-2855d21d10ae with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=72382) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 09 15:11:06 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72382) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 15:11:06 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Libvirt baseline CPU <cpu>
Aug 09 15:11:06 user nova-compute[72382]:   <arch>x86_64</arch>
Aug 09 15:11:06 user nova-compute[72382]:   <model>Nehalem</model>
Aug 09 15:11:06 user nova-compute[72382]:   <vendor>Intel</vendor>
Aug 09 15:11:06 user nova-compute[72382]:   <topology sockets="6" cores="1" threads="1"/>
Aug 09 15:11:06 user nova-compute[72382]: </cpu>
Aug 09 15:11:06 user nova-compute[72382]:  {{(pid=72382) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12513}}
Aug 09 15:11:06 user nova-compute[72382]: DEBUG nova.scheduler.client.report [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Updated inventory for provider 7b15b0e5-df4d-49db-833b-2855d21d10ae with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=72382) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Aug 09 15:11:06 user nova-compute[72382]: DEBUG nova.compute.provider_tree [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Updating resource provider 7b15b0e5-df4d-49db-833b-2855d21d10ae generation from 0 to 1 during operation: update_inventory {{(pid=72382) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Aug 09 15:11:06 user nova-compute[72382]: DEBUG nova.compute.provider_tree [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Updating inventory in ProviderTree for provider 7b15b0e5-df4d-49db-833b-2855d21d10ae with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72382) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 09 15:11:06 user nova-compute[72382]: DEBUG nova.compute.provider_tree [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Updating resource provider 7b15b0e5-df4d-49db-833b-2855d21d10ae generation from 1 to 2 during operation: update_traits {{(pid=72382) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Aug 09 15:11:06 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Compute_service record updated for user:user {{(pid=72382) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 15:11:06 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.627s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:11:06 user nova-compute[72382]: DEBUG nova.service [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Creating RPC server for service compute {{(pid=72382) start /opt/stack/nova/nova/service.py:182}}
Aug 09 15:11:06 user nova-compute[72382]: DEBUG nova.service [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Join ServiceGroup membership for this service compute {{(pid=72382) start /opt/stack/nova/nova/service.py:199}}
Aug 09 15:11:06 user nova-compute[72382]: DEBUG nova.servicegroup.drivers.db [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=72382) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Aug 09 15:11:49 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._sync_power_states {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:11:50 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:11:57 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:11:57 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:11:57 user nova-compute[72382]: DEBUG nova.compute.manager [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Starting heal instance info cache {{(pid=72382) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 15:11:57 user nova-compute[72382]: DEBUG nova.compute.manager [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Rebuilding the list of instances to heal {{(pid=72382) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 09 15:11:57 user nova-compute[72382]: DEBUG nova.compute.manager [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Didn't find any instances for network info cache update. {{(pid=72382) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 09 15:11:57 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:11:57 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:11:57 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:11:57 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:11:57 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:11:57 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:11:57 user nova-compute[72382]: DEBUG nova.compute.manager [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72382) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 15:11:57 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:11:57 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:11:57 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:11:57 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:11:57 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Auditing locally available compute resources for user (node: user) {{(pid=72382) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 15:11:58 user nova-compute[72382]: WARNING nova.virt.libvirt.driver [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 15:11:58 user nova-compute[72382]: WARNING nova.virt.libvirt.driver [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 15:11:58 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Hypervisor/Node resource view: name=user free_ram=10273MB free_disk=26.335079193115234GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72382) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 15:11:58 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:11:58 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:11:58 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72382) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 15:11:58 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72382) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 15:11:58 user nova-compute[72382]: DEBUG nova.compute.provider_tree [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Inventory has not changed in ProviderTree for provider: 7b15b0e5-df4d-49db-833b-2855d21d10ae {{(pid=72382) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 15:11:58 user nova-compute[72382]: DEBUG nova.scheduler.client.report [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Inventory has not changed for provider 7b15b0e5-df4d-49db-833b-2855d21d10ae based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72382) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 15:11:58 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Compute_service record updated for user:user {{(pid=72382) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 15:11:58 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.136s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:12:58 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:12:58 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:12:58 user nova-compute[72382]: DEBUG nova.compute.manager [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Starting heal instance info cache {{(pid=72382) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 15:12:58 user nova-compute[72382]: DEBUG nova.compute.manager [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Rebuilding the list of instances to heal {{(pid=72382) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 09 15:12:58 user nova-compute[72382]: DEBUG nova.compute.manager [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Didn't find any instances for network info cache update. {{(pid=72382) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 09 15:12:58 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:12:58 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:12:58 user nova-compute[72382]: DEBUG nova.compute.manager [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72382) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 15:12:58 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:12:58 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:12:58 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:12:58 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:12:58 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:12:58 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:12:58 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:12:58 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Auditing locally available compute resources for user (node: user) {{(pid=72382) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 15:12:59 user nova-compute[72382]: WARNING nova.virt.libvirt.driver [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 15:12:59 user nova-compute[72382]: WARNING nova.virt.libvirt.driver [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 15:12:59 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Hypervisor/Node resource view: name=user free_ram=10241MB free_disk=26.380146026611328GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72382) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 15:12:59 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:12:59 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:12:59 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72382) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 15:12:59 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72382) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 15:12:59 user nova-compute[72382]: DEBUG nova.compute.provider_tree [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Inventory has not changed in ProviderTree for provider: 7b15b0e5-df4d-49db-833b-2855d21d10ae {{(pid=72382) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 15:12:59 user nova-compute[72382]: DEBUG nova.scheduler.client.report [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Inventory has not changed for provider 7b15b0e5-df4d-49db-833b-2855d21d10ae based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72382) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 15:12:59 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Compute_service record updated for user:user {{(pid=72382) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 15:12:59 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.145s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:13:00 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:13:00 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:13:57 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:13:57 user nova-compute[72382]: DEBUG nova.compute.manager [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Starting heal instance info cache {{(pid=72382) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 15:13:57 user nova-compute[72382]: DEBUG nova.compute.manager [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Rebuilding the list of instances to heal {{(pid=72382) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 09 15:13:57 user nova-compute[72382]: DEBUG nova.compute.manager [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Didn't find any instances for network info cache update. {{(pid=72382) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 09 15:13:58 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:13:59 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:13:59 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:13:59 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:13:59 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:13:59 user nova-compute[72382]: DEBUG nova.compute.manager [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72382) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 15:13:59 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:13:59 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:13:59 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:13:59 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:13:59 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Auditing locally available compute resources for user (node: user) {{(pid=72382) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 15:14:00 user nova-compute[72382]: WARNING nova.virt.libvirt.driver [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 15:14:00 user nova-compute[72382]: WARNING nova.virt.libvirt.driver [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 15:14:00 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Hypervisor/Node resource view: name=user free_ram=10248MB free_disk=26.15420150756836GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72382) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 15:14:00 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:14:00 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:14:00 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72382) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 15:14:00 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72382) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 15:14:00 user nova-compute[72382]: DEBUG nova.compute.provider_tree [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Inventory has not changed in ProviderTree for provider: 7b15b0e5-df4d-49db-833b-2855d21d10ae {{(pid=72382) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 15:14:00 user nova-compute[72382]: DEBUG nova.scheduler.client.report [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Inventory has not changed for provider 7b15b0e5-df4d-49db-833b-2855d21d10ae based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72382) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 15:14:00 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Compute_service record updated for user:user {{(pid=72382) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 15:14:00 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.101s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:14:01 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:14:01 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:14:58 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:14:59 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:14:59 user nova-compute[72382]: DEBUG nova.compute.manager [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Starting heal instance info cache {{(pid=72382) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 15:14:59 user nova-compute[72382]: DEBUG nova.compute.manager [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Rebuilding the list of instances to heal {{(pid=72382) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 09 15:14:59 user nova-compute[72382]: DEBUG nova.compute.manager [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Didn't find any instances for network info cache update. {{(pid=72382) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 09 15:15:00 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:15:00 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:15:00 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:15:00 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:15:00 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:15:01 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:15:01 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:15:01 user nova-compute[72382]: DEBUG nova.compute.manager [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72382) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 15:15:01 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:15:01 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:15:01 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:15:01 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:15:01 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Auditing locally available compute resources for user (node: user) {{(pid=72382) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 15:15:02 user nova-compute[72382]: WARNING nova.virt.libvirt.driver [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 15:15:02 user nova-compute[72382]: WARNING nova.virt.libvirt.driver [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 15:15:02 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Hypervisor/Node resource view: name=user free_ram=9487MB free_disk=26.136486053466797GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72382) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 15:15:02 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:15:02 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:15:02 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72382) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 15:15:02 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72382) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 15:15:02 user nova-compute[72382]: DEBUG nova.compute.provider_tree [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Inventory has not changed in ProviderTree for provider: 7b15b0e5-df4d-49db-833b-2855d21d10ae {{(pid=72382) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 15:15:02 user nova-compute[72382]: DEBUG nova.scheduler.client.report [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Inventory has not changed for provider 7b15b0e5-df4d-49db-833b-2855d21d10ae based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72382) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 15:15:02 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Compute_service record updated for user:user {{(pid=72382) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 15:15:02 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.118s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:15:07 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-8e2bee7f-ea21-4bef-a0fc-19a14939acd1 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Acquiring lock "f780040f-b789-4b72-8986-813c7b9fe4a6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:15:07 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-8e2bee7f-ea21-4bef-a0fc-19a14939acd1 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Lock "f780040f-b789-4b72-8986-813c7b9fe4a6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:15:07 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8e2bee7f-ea21-4bef-a0fc-19a14939acd1 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] [instance: f780040f-b789-4b72-8986-813c7b9fe4a6] Starting instance... {{(pid=72382) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 15:15:07 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-8e2bee7f-ea21-4bef-a0fc-19a14939acd1 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:15:07 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-8e2bee7f-ea21-4bef-a0fc-19a14939acd1 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:15:07 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-8e2bee7f-ea21-4bef-a0fc-19a14939acd1 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72382) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 15:15:07 user nova-compute[72382]: INFO nova.compute.claims [None req-8e2bee7f-ea21-4bef-a0fc-19a14939acd1 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] [instance: f780040f-b789-4b72-8986-813c7b9fe4a6] Claim successful on node user
Aug 09 15:15:08 user nova-compute[72382]: DEBUG nova.compute.provider_tree [None req-8e2bee7f-ea21-4bef-a0fc-19a14939acd1 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Inventory has not changed in ProviderTree for provider: 7b15b0e5-df4d-49db-833b-2855d21d10ae {{(pid=72382) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 15:15:08 user nova-compute[72382]: DEBUG nova.scheduler.client.report [None req-8e2bee7f-ea21-4bef-a0fc-19a14939acd1 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Inventory has not changed for provider 7b15b0e5-df4d-49db-833b-2855d21d10ae based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72382) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 15:15:08 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-8e2bee7f-ea21-4bef-a0fc-19a14939acd1 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.449s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:15:08 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8e2bee7f-ea21-4bef-a0fc-19a14939acd1 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] [instance: f780040f-b789-4b72-8986-813c7b9fe4a6] Start building networks asynchronously for instance. {{(pid=72382) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 15:15:08 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8e2bee7f-ea21-4bef-a0fc-19a14939acd1 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] [instance: f780040f-b789-4b72-8986-813c7b9fe4a6] Allocating IP information in the background. {{(pid=72382) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 15:15:08 user nova-compute[72382]: DEBUG nova.network.neutron [None req-8e2bee7f-ea21-4bef-a0fc-19a14939acd1 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] [instance: f780040f-b789-4b72-8986-813c7b9fe4a6] allocate_for_instance() {{(pid=72382) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 15:15:08 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-8e2bee7f-ea21-4bef-a0fc-19a14939acd1 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] [instance: f780040f-b789-4b72-8986-813c7b9fe4a6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 15:15:08 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8e2bee7f-ea21-4bef-a0fc-19a14939acd1 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] [instance: f780040f-b789-4b72-8986-813c7b9fe4a6] Start building block device mappings for instance. {{(pid=72382) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 15:15:08 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8e2bee7f-ea21-4bef-a0fc-19a14939acd1 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] [instance: f780040f-b789-4b72-8986-813c7b9fe4a6] Start spawning the instance on the hypervisor. {{(pid=72382) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 15:15:08 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-8e2bee7f-ea21-4bef-a0fc-19a14939acd1 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] [instance: f780040f-b789-4b72-8986-813c7b9fe4a6] Creating instance directory {{(pid=72382) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 15:15:08 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-8e2bee7f-ea21-4bef-a0fc-19a14939acd1 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] [instance: f780040f-b789-4b72-8986-813c7b9fe4a6] Creating image(s)
Aug 09 15:15:08 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-8e2bee7f-ea21-4bef-a0fc-19a14939acd1 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Acquiring lock "/opt/stack/data/nova/instances/f780040f-b789-4b72-8986-813c7b9fe4a6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:15:08 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-8e2bee7f-ea21-4bef-a0fc-19a14939acd1 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Lock "/opt/stack/data/nova/instances/f780040f-b789-4b72-8986-813c7b9fe4a6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:15:08 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-8e2bee7f-ea21-4bef-a0fc-19a14939acd1 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Lock "/opt/stack/data/nova/instances/f780040f-b789-4b72-8986-813c7b9fe4a6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:15:08 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-8e2bee7f-ea21-4bef-a0fc-19a14939acd1 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Acquiring lock "383812ff437283e0191ed5b9ecc04c27f1162b0b" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:15:08 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-8e2bee7f-ea21-4bef-a0fc-19a14939acd1 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Lock "383812ff437283e0191ed5b9ecc04c27f1162b0b" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:15:09 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-8e2bee7f-ea21-4bef-a0fc-19a14939acd1 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b.part --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:15:09 user nova-compute[72382]: DEBUG nova.policy [None req-8e2bee7f-ea21-4bef-a0fc-19a14939acd1 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e71af7a4912147cd9fab070cb77b275c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080d1ded4cd94e5083ee0b7e691b7363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72382) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 15:15:09 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-8e2bee7f-ea21-4bef-a0fc-19a14939acd1 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b.part --force-share --output=json" returned: 0 in 0.135s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:15:09 user nova-compute[72382]: DEBUG nova.virt.images [None req-8e2bee7f-ea21-4bef-a0fc-19a14939acd1 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] a79f2cea-eb27-4631-aaf3-05e7d9e411b4 was qcow2, converting to raw {{(pid=72382) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 09 15:15:09 user nova-compute[72382]: DEBUG nova.privsep.utils [None req-8e2bee7f-ea21-4bef-a0fc-19a14939acd1 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72382) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 09 15:15:09 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-8e2bee7f-ea21-4bef-a0fc-19a14939acd1 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b.part /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b.converted {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:15:09 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-8e2bee7f-ea21-4bef-a0fc-19a14939acd1 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b.part /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b.converted" returned: 0 in 0.239s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:15:09 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-8e2bee7f-ea21-4bef-a0fc-19a14939acd1 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b.converted --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:15:09 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-8e2bee7f-ea21-4bef-a0fc-19a14939acd1 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b.converted --force-share --output=json" returned: 0 in 0.143s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:15:09 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-8e2bee7f-ea21-4bef-a0fc-19a14939acd1 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Lock "383812ff437283e0191ed5b9ecc04c27f1162b0b" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.101s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:15:09 user nova-compute[72382]: INFO oslo.privsep.daemon [None req-8e2bee7f-ea21-4bef-a0fc-19a14939acd1 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpoh5rr_vg/privsep.sock']
Aug 09 15:15:09 user sudo[81560]:    stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpoh5rr_vg/privsep.sock
Aug 09 15:15:09 user sudo[81560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Aug 09 15:15:11 user sudo[81560]: pam_unix(sudo:session): session closed for user root
Aug 09 15:15:11 user nova-compute[72382]: INFO oslo.privsep.daemon [None req-8e2bee7f-ea21-4bef-a0fc-19a14939acd1 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Spawned new privsep daemon via rootwrap
Aug 09 15:15:12 user nova-compute[72382]: INFO oslo.privsep.daemon [-] privsep daemon starting
Aug 09 15:15:12 user nova-compute[72382]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Aug 09 15:15:12 user nova-compute[72382]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Aug 09 15:15:12 user nova-compute[72382]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 81567
Aug 09 15:15:12 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-f816da71-40e8-4952-90c2-f2c3ed3b228b tempest-ServersNegativeTestJSON-1671359082 tempest-ServersNegativeTestJSON-1671359082-project-member] Acquiring lock "777e49ea-b674-4c3f-9cdd-ac2113032632" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:15:12 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-f816da71-40e8-4952-90c2-f2c3ed3b228b tempest-ServersNegativeTestJSON-1671359082 tempest-ServersNegativeTestJSON-1671359082-project-member] Lock "777e49ea-b674-4c3f-9cdd-ac2113032632" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:15:12 user nova-compute[72382]: DEBUG nova.network.neutron [None req-8e2bee7f-ea21-4bef-a0fc-19a14939acd1 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] [instance: f780040f-b789-4b72-8986-813c7b9fe4a6] Successfully created port: 3c9b6983-5682-4eaa-866c-1baf9f2ede26 {{(pid=72382) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 15:15:12 user nova-compute[72382]: DEBUG nova.compute.manager [None req-f816da71-40e8-4952-90c2-f2c3ed3b228b tempest-ServersNegativeTestJSON-1671359082 tempest-ServersNegativeTestJSON-1671359082-project-member] [instance: 777e49ea-b674-4c3f-9cdd-ac2113032632] Starting instance... {{(pid=72382) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 15:15:12 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-8e2bee7f-ea21-4bef-a0fc-19a14939acd1 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:15:12 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-8e2bee7f-ea21-4bef-a0fc-19a14939acd1 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b --force-share --output=json" returned: 0 in 0.136s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:15:12 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-8e2bee7f-ea21-4bef-a0fc-19a14939acd1 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Acquiring lock "383812ff437283e0191ed5b9ecc04c27f1162b0b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:15:12 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-8e2bee7f-ea21-4bef-a0fc-19a14939acd1 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Lock "383812ff437283e0191ed5b9ecc04c27f1162b0b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:15:12 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-8e2bee7f-ea21-4bef-a0fc-19a14939acd1 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:15:12 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-f816da71-40e8-4952-90c2-f2c3ed3b228b tempest-ServersNegativeTestJSON-1671359082 tempest-ServersNegativeTestJSON-1671359082-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:15:12 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-f816da71-40e8-4952-90c2-f2c3ed3b228b tempest-ServersNegativeTestJSON-1671359082 tempest-ServersNegativeTestJSON-1671359082-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:15:12 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-f816da71-40e8-4952-90c2-f2c3ed3b228b tempest-ServersNegativeTestJSON-1671359082 tempest-ServersNegativeTestJSON-1671359082-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72382) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 15:15:12 user nova-compute[72382]: INFO nova.compute.claims [None req-f816da71-40e8-4952-90c2-f2c3ed3b228b tempest-ServersNegativeTestJSON-1671359082 tempest-ServersNegativeTestJSON-1671359082-project-member] [instance: 777e49ea-b674-4c3f-9cdd-ac2113032632] Claim successful on node user
Aug 09 15:15:12 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-8e2bee7f-ea21-4bef-a0fc-19a14939acd1 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b --force-share --output=json" returned: 0 in 0.138s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:15:12 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-8e2bee7f-ea21-4bef-a0fc-19a14939acd1 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b,backing_fmt=raw /opt/stack/data/nova/instances/f780040f-b789-4b72-8986-813c7b9fe4a6/disk 1073741824 {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:15:12 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-8e2bee7f-ea21-4bef-a0fc-19a14939acd1 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b,backing_fmt=raw /opt/stack/data/nova/instances/f780040f-b789-4b72-8986-813c7b9fe4a6/disk 1073741824" returned: 0 in 0.048s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:15:12 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-8e2bee7f-ea21-4bef-a0fc-19a14939acd1 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Lock "383812ff437283e0191ed5b9ecc04c27f1162b0b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.190s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:15:12 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-8e2bee7f-ea21-4bef-a0fc-19a14939acd1 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:15:12 user nova-compute[72382]: DEBUG nova.compute.provider_tree [None req-f816da71-40e8-4952-90c2-f2c3ed3b228b tempest-ServersNegativeTestJSON-1671359082 tempest-ServersNegativeTestJSON-1671359082-project-member] Inventory has not changed in ProviderTree for provider: 7b15b0e5-df4d-49db-833b-2855d21d10ae {{(pid=72382) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 15:15:12 user nova-compute[72382]: DEBUG nova.scheduler.client.report [None req-f816da71-40e8-4952-90c2-f2c3ed3b228b tempest-ServersNegativeTestJSON-1671359082 tempest-ServersNegativeTestJSON-1671359082-project-member] Inventory has not changed for provider 7b15b0e5-df4d-49db-833b-2855d21d10ae based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72382) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 15:15:12 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-8e2bee7f-ea21-4bef-a0fc-19a14939acd1 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b --force-share --output=json" returned: 0 in 0.156s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:15:12 user nova-compute[72382]: DEBUG nova.virt.disk.api [None req-8e2bee7f-ea21-4bef-a0fc-19a14939acd1 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f780040f-b789-4b72-8986-813c7b9fe4a6/disk. size=1073741824 {{(pid=72382) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 15:15:12 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-8e2bee7f-ea21-4bef-a0fc-19a14939acd1 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f780040f-b789-4b72-8986-813c7b9fe4a6/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:15:12 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-f816da71-40e8-4952-90c2-f2c3ed3b228b tempest-ServersNegativeTestJSON-1671359082 tempest-ServersNegativeTestJSON-1671359082-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.352s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:15:12 user nova-compute[72382]: DEBUG nova.compute.manager [None req-f816da71-40e8-4952-90c2-f2c3ed3b228b tempest-ServersNegativeTestJSON-1671359082 tempest-ServersNegativeTestJSON-1671359082-project-member] [instance: 777e49ea-b674-4c3f-9cdd-ac2113032632] Start building networks asynchronously for instance. {{(pid=72382) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 15:15:12 user nova-compute[72382]: DEBUG nova.compute.manager [None req-f816da71-40e8-4952-90c2-f2c3ed3b228b tempest-ServersNegativeTestJSON-1671359082 tempest-ServersNegativeTestJSON-1671359082-project-member] [instance: 777e49ea-b674-4c3f-9cdd-ac2113032632] Allocating IP information in the background. {{(pid=72382) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 15:15:12 user nova-compute[72382]: DEBUG nova.network.neutron [None req-f816da71-40e8-4952-90c2-f2c3ed3b228b tempest-ServersNegativeTestJSON-1671359082 tempest-ServersNegativeTestJSON-1671359082-project-member] [instance: 777e49ea-b674-4c3f-9cdd-ac2113032632] allocate_for_instance() {{(pid=72382) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 15:15:12 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-f816da71-40e8-4952-90c2-f2c3ed3b228b tempest-ServersNegativeTestJSON-1671359082 tempest-ServersNegativeTestJSON-1671359082-project-member] [instance: 777e49ea-b674-4c3f-9cdd-ac2113032632] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 15:15:12 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-8e2bee7f-ea21-4bef-a0fc-19a14939acd1 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f780040f-b789-4b72-8986-813c7b9fe4a6/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:15:12 user nova-compute[72382]: DEBUG nova.virt.disk.api [None req-8e2bee7f-ea21-4bef-a0fc-19a14939acd1 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Cannot resize image /opt/stack/data/nova/instances/f780040f-b789-4b72-8986-813c7b9fe4a6/disk to a smaller size. {{(pid=72382) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 15:15:12 user nova-compute[72382]: DEBUG nova.objects.instance [None req-8e2bee7f-ea21-4bef-a0fc-19a14939acd1 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Lazy-loading 'migration_context' on Instance uuid f780040f-b789-4b72-8986-813c7b9fe4a6 {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:15:12 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-8e2bee7f-ea21-4bef-a0fc-19a14939acd1 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] [instance: f780040f-b789-4b72-8986-813c7b9fe4a6] Created local disks {{(pid=72382) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 15:15:12 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-8e2bee7f-ea21-4bef-a0fc-19a14939acd1 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] [instance: f780040f-b789-4b72-8986-813c7b9fe4a6] Ensure instance console log exists: /opt/stack/data/nova/instances/f780040f-b789-4b72-8986-813c7b9fe4a6/console.log {{(pid=72382) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 15:15:12 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-8e2bee7f-ea21-4bef-a0fc-19a14939acd1 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:15:12 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-8e2bee7f-ea21-4bef-a0fc-19a14939acd1 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:15:12 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-8e2bee7f-ea21-4bef-a0fc-19a14939acd1 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:15:12 user nova-compute[72382]: DEBUG nova.compute.manager [None req-f816da71-40e8-4952-90c2-f2c3ed3b228b tempest-ServersNegativeTestJSON-1671359082 tempest-ServersNegativeTestJSON-1671359082-project-member] [instance: 777e49ea-b674-4c3f-9cdd-ac2113032632] Start building block device mappings for instance. {{(pid=72382) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 15:15:12 user nova-compute[72382]: DEBUG nova.compute.manager [None req-f816da71-40e8-4952-90c2-f2c3ed3b228b tempest-ServersNegativeTestJSON-1671359082 tempest-ServersNegativeTestJSON-1671359082-project-member] [instance: 777e49ea-b674-4c3f-9cdd-ac2113032632] Start spawning the instance on the hypervisor. {{(pid=72382) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 15:15:12 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-f816da71-40e8-4952-90c2-f2c3ed3b228b tempest-ServersNegativeTestJSON-1671359082 tempest-ServersNegativeTestJSON-1671359082-project-member] [instance: 777e49ea-b674-4c3f-9cdd-ac2113032632] Creating instance directory {{(pid=72382) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 15:15:12 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-f816da71-40e8-4952-90c2-f2c3ed3b228b tempest-ServersNegativeTestJSON-1671359082 tempest-ServersNegativeTestJSON-1671359082-project-member] [instance: 777e49ea-b674-4c3f-9cdd-ac2113032632] Creating image(s)
Aug 09 15:15:12 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-f816da71-40e8-4952-90c2-f2c3ed3b228b tempest-ServersNegativeTestJSON-1671359082 tempest-ServersNegativeTestJSON-1671359082-project-member] Acquiring lock "/opt/stack/data/nova/instances/777e49ea-b674-4c3f-9cdd-ac2113032632/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:15:12 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-f816da71-40e8-4952-90c2-f2c3ed3b228b tempest-ServersNegativeTestJSON-1671359082 tempest-ServersNegativeTestJSON-1671359082-project-member] Lock "/opt/stack/data/nova/instances/777e49ea-b674-4c3f-9cdd-ac2113032632/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:15:12 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-f816da71-40e8-4952-90c2-f2c3ed3b228b tempest-ServersNegativeTestJSON-1671359082 tempest-ServersNegativeTestJSON-1671359082-project-member] Lock "/opt/stack/data/nova/instances/777e49ea-b674-4c3f-9cdd-ac2113032632/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:15:12 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-f816da71-40e8-4952-90c2-f2c3ed3b228b tempest-ServersNegativeTestJSON-1671359082 tempest-ServersNegativeTestJSON-1671359082-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:15:13 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-f816da71-40e8-4952-90c2-f2c3ed3b228b tempest-ServersNegativeTestJSON-1671359082 tempest-ServersNegativeTestJSON-1671359082-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b --force-share --output=json" returned: 0 in 0.138s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:15:13 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-f816da71-40e8-4952-90c2-f2c3ed3b228b tempest-ServersNegativeTestJSON-1671359082 tempest-ServersNegativeTestJSON-1671359082-project-member] Acquiring lock "383812ff437283e0191ed5b9ecc04c27f1162b0b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:15:13 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-f816da71-40e8-4952-90c2-f2c3ed3b228b tempest-ServersNegativeTestJSON-1671359082 tempest-ServersNegativeTestJSON-1671359082-project-member] Lock "383812ff437283e0191ed5b9ecc04c27f1162b0b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:15:13 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-f816da71-40e8-4952-90c2-f2c3ed3b228b tempest-ServersNegativeTestJSON-1671359082 tempest-ServersNegativeTestJSON-1671359082-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:15:13 user nova-compute[72382]: DEBUG nova.policy [None req-f816da71-40e8-4952-90c2-f2c3ed3b228b tempest-ServersNegativeTestJSON-1671359082 tempest-ServersNegativeTestJSON-1671359082-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5e4b3ed6be8f4c99ba979398388bf12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8995b21c93c24ab19fcfad5c4939509f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72382) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 15:15:13 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-16966d1a-588d-41b9-ae61-b46d67b5d3b8 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Acquiring lock "44afd1bf-fa5c-4b3e-8752-b16853fef54e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:15:13 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-16966d1a-588d-41b9-ae61-b46d67b5d3b8 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Lock "44afd1bf-fa5c-4b3e-8752-b16853fef54e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:15:13 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-f816da71-40e8-4952-90c2-f2c3ed3b228b tempest-ServersNegativeTestJSON-1671359082 tempest-ServersNegativeTestJSON-1671359082-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b --force-share --output=json" returned: 0 in 0.136s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:15:13 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-f816da71-40e8-4952-90c2-f2c3ed3b228b tempest-ServersNegativeTestJSON-1671359082 tempest-ServersNegativeTestJSON-1671359082-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b,backing_fmt=raw /opt/stack/data/nova/instances/777e49ea-b674-4c3f-9cdd-ac2113032632/disk 1073741824 {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:15:13 user nova-compute[72382]: DEBUG nova.compute.manager [None req-16966d1a-588d-41b9-ae61-b46d67b5d3b8 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] [instance: 44afd1bf-fa5c-4b3e-8752-b16853fef54e] Starting instance... {{(pid=72382) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 15:15:13 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-f816da71-40e8-4952-90c2-f2c3ed3b228b tempest-ServersNegativeTestJSON-1671359082 tempest-ServersNegativeTestJSON-1671359082-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b,backing_fmt=raw /opt/stack/data/nova/instances/777e49ea-b674-4c3f-9cdd-ac2113032632/disk 1073741824" returned: 0 in 0.056s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:15:13 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-f816da71-40e8-4952-90c2-f2c3ed3b228b tempest-ServersNegativeTestJSON-1671359082 tempest-ServersNegativeTestJSON-1671359082-project-member] Lock "383812ff437283e0191ed5b9ecc04c27f1162b0b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.197s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:15:13 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-f816da71-40e8-4952-90c2-f2c3ed3b228b tempest-ServersNegativeTestJSON-1671359082 tempest-ServersNegativeTestJSON-1671359082-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:15:13 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-16966d1a-588d-41b9-ae61-b46d67b5d3b8 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:15:13 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-16966d1a-588d-41b9-ae61-b46d67b5d3b8 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:15:13 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-16966d1a-588d-41b9-ae61-b46d67b5d3b8 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72382) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 15:15:13 user nova-compute[72382]: INFO nova.compute.claims [None req-16966d1a-588d-41b9-ae61-b46d67b5d3b8 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] [instance: 44afd1bf-fa5c-4b3e-8752-b16853fef54e] Claim successful on node user
Aug 09 15:15:13 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-f816da71-40e8-4952-90c2-f2c3ed3b228b tempest-ServersNegativeTestJSON-1671359082 tempest-ServersNegativeTestJSON-1671359082-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b --force-share --output=json" returned: 0 in 0.151s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:15:13 user nova-compute[72382]: DEBUG nova.virt.disk.api [None req-f816da71-40e8-4952-90c2-f2c3ed3b228b tempest-ServersNegativeTestJSON-1671359082 tempest-ServersNegativeTestJSON-1671359082-project-member] Checking if we can resize image /opt/stack/data/nova/instances/777e49ea-b674-4c3f-9cdd-ac2113032632/disk. size=1073741824 {{(pid=72382) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 15:15:13 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-f816da71-40e8-4952-90c2-f2c3ed3b228b tempest-ServersNegativeTestJSON-1671359082 tempest-ServersNegativeTestJSON-1671359082-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/777e49ea-b674-4c3f-9cdd-ac2113032632/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:15:13 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-f816da71-40e8-4952-90c2-f2c3ed3b228b tempest-ServersNegativeTestJSON-1671359082 tempest-ServersNegativeTestJSON-1671359082-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/777e49ea-b674-4c3f-9cdd-ac2113032632/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:15:13 user nova-compute[72382]: DEBUG nova.virt.disk.api [None req-f816da71-40e8-4952-90c2-f2c3ed3b228b tempest-ServersNegativeTestJSON-1671359082 tempest-ServersNegativeTestJSON-1671359082-project-member] Cannot resize image /opt/stack/data/nova/instances/777e49ea-b674-4c3f-9cdd-ac2113032632/disk to a smaller size. {{(pid=72382) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 15:15:13 user nova-compute[72382]: DEBUG nova.objects.instance [None req-f816da71-40e8-4952-90c2-f2c3ed3b228b tempest-ServersNegativeTestJSON-1671359082 tempest-ServersNegativeTestJSON-1671359082-project-member] Lazy-loading 'migration_context' on Instance uuid 777e49ea-b674-4c3f-9cdd-ac2113032632 {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:15:13 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-f816da71-40e8-4952-90c2-f2c3ed3b228b tempest-ServersNegativeTestJSON-1671359082 tempest-ServersNegativeTestJSON-1671359082-project-member] [instance: 777e49ea-b674-4c3f-9cdd-ac2113032632] Created local disks {{(pid=72382) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 15:15:13 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-f816da71-40e8-4952-90c2-f2c3ed3b228b tempest-ServersNegativeTestJSON-1671359082 tempest-ServersNegativeTestJSON-1671359082-project-member] [instance: 777e49ea-b674-4c3f-9cdd-ac2113032632] Ensure instance console log exists: /opt/stack/data/nova/instances/777e49ea-b674-4c3f-9cdd-ac2113032632/console.log {{(pid=72382) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 15:15:13 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-f816da71-40e8-4952-90c2-f2c3ed3b228b tempest-ServersNegativeTestJSON-1671359082 tempest-ServersNegativeTestJSON-1671359082-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:15:13 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-f816da71-40e8-4952-90c2-f2c3ed3b228b tempest-ServersNegativeTestJSON-1671359082 tempest-ServersNegativeTestJSON-1671359082-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:15:13 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-f816da71-40e8-4952-90c2-f2c3ed3b228b tempest-ServersNegativeTestJSON-1671359082 tempest-ServersNegativeTestJSON-1671359082-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:15:13 user nova-compute[72382]: DEBUG nova.compute.provider_tree [None req-16966d1a-588d-41b9-ae61-b46d67b5d3b8 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Inventory has not changed in ProviderTree for provider: 7b15b0e5-df4d-49db-833b-2855d21d10ae {{(pid=72382) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 15:15:13 user nova-compute[72382]: DEBUG nova.scheduler.client.report [None req-16966d1a-588d-41b9-ae61-b46d67b5d3b8 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Inventory has not changed for provider 7b15b0e5-df4d-49db-833b-2855d21d10ae based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72382) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 15:15:13 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-16966d1a-588d-41b9-ae61-b46d67b5d3b8 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.350s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:15:13 user nova-compute[72382]: DEBUG nova.compute.manager [None req-16966d1a-588d-41b9-ae61-b46d67b5d3b8 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] [instance: 44afd1bf-fa5c-4b3e-8752-b16853fef54e] Start building networks asynchronously for instance. {{(pid=72382) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 15:15:13 user nova-compute[72382]: DEBUG nova.compute.manager [None req-16966d1a-588d-41b9-ae61-b46d67b5d3b8 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] [instance: 44afd1bf-fa5c-4b3e-8752-b16853fef54e] Allocating IP information in the background. {{(pid=72382) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 15:15:13 user nova-compute[72382]: DEBUG nova.network.neutron [None req-16966d1a-588d-41b9-ae61-b46d67b5d3b8 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] [instance: 44afd1bf-fa5c-4b3e-8752-b16853fef54e] allocate_for_instance() {{(pid=72382) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 15:15:13 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-16966d1a-588d-41b9-ae61-b46d67b5d3b8 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] [instance: 44afd1bf-fa5c-4b3e-8752-b16853fef54e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 15:15:13 user nova-compute[72382]: DEBUG nova.compute.manager [None req-16966d1a-588d-41b9-ae61-b46d67b5d3b8 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] [instance: 44afd1bf-fa5c-4b3e-8752-b16853fef54e] Start building block device mappings for instance. {{(pid=72382) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 15:15:14 user nova-compute[72382]: DEBUG nova.compute.manager [None req-16966d1a-588d-41b9-ae61-b46d67b5d3b8 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] [instance: 44afd1bf-fa5c-4b3e-8752-b16853fef54e] Start spawning the instance on the hypervisor. {{(pid=72382) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 15:15:14 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-16966d1a-588d-41b9-ae61-b46d67b5d3b8 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] [instance: 44afd1bf-fa5c-4b3e-8752-b16853fef54e] Creating instance directory {{(pid=72382) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 15:15:14 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-16966d1a-588d-41b9-ae61-b46d67b5d3b8 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] [instance: 44afd1bf-fa5c-4b3e-8752-b16853fef54e] Creating image(s)
Aug 09 15:15:14 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-16966d1a-588d-41b9-ae61-b46d67b5d3b8 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Acquiring lock "/opt/stack/data/nova/instances/44afd1bf-fa5c-4b3e-8752-b16853fef54e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:15:14 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-16966d1a-588d-41b9-ae61-b46d67b5d3b8 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Lock "/opt/stack/data/nova/instances/44afd1bf-fa5c-4b3e-8752-b16853fef54e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:15:14 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-16966d1a-588d-41b9-ae61-b46d67b5d3b8 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Lock "/opt/stack/data/nova/instances/44afd1bf-fa5c-4b3e-8752-b16853fef54e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:15:14 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-16966d1a-588d-41b9-ae61-b46d67b5d3b8 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:15:14 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-16966d1a-588d-41b9-ae61-b46d67b5d3b8 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b --force-share --output=json" returned: 0 in 0.153s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:15:14 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-16966d1a-588d-41b9-ae61-b46d67b5d3b8 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Acquiring lock "383812ff437283e0191ed5b9ecc04c27f1162b0b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:15:14 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-16966d1a-588d-41b9-ae61-b46d67b5d3b8 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Lock "383812ff437283e0191ed5b9ecc04c27f1162b0b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:15:14 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-16966d1a-588d-41b9-ae61-b46d67b5d3b8 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:15:14 user nova-compute[72382]: DEBUG nova.policy [None req-16966d1a-588d-41b9-ae61-b46d67b5d3b8 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f94ca386a2be42cfbc2407bb7520cd25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990ba791030940d38360af5879c853c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72382) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 15:15:14 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-16966d1a-588d-41b9-ae61-b46d67b5d3b8 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b --force-share --output=json" returned: 0 in 0.153s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:15:14 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-16966d1a-588d-41b9-ae61-b46d67b5d3b8 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b,backing_fmt=raw /opt/stack/data/nova/instances/44afd1bf-fa5c-4b3e-8752-b16853fef54e/disk 1073741824 {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:15:14 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-16966d1a-588d-41b9-ae61-b46d67b5d3b8 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b,backing_fmt=raw /opt/stack/data/nova/instances/44afd1bf-fa5c-4b3e-8752-b16853fef54e/disk 1073741824" returned: 0 in 0.047s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:15:14 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-16966d1a-588d-41b9-ae61-b46d67b5d3b8 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Lock "383812ff437283e0191ed5b9ecc04c27f1162b0b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.205s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:15:14 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-16966d1a-588d-41b9-ae61-b46d67b5d3b8 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:15:14 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-16966d1a-588d-41b9-ae61-b46d67b5d3b8 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b --force-share --output=json" returned: 0 in 0.126s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:15:14 user nova-compute[72382]: DEBUG nova.virt.disk.api [None req-16966d1a-588d-41b9-ae61-b46d67b5d3b8 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Checking if we can resize image /opt/stack/data/nova/instances/44afd1bf-fa5c-4b3e-8752-b16853fef54e/disk. size=1073741824 {{(pid=72382) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 15:15:14 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-16966d1a-588d-41b9-ae61-b46d67b5d3b8 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44afd1bf-fa5c-4b3e-8752-b16853fef54e/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:15:14 user nova-compute[72382]: DEBUG nova.network.neutron [None req-8e2bee7f-ea21-4bef-a0fc-19a14939acd1 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] [instance: f780040f-b789-4b72-8986-813c7b9fe4a6] Successfully updated port: 3c9b6983-5682-4eaa-866c-1baf9f2ede26 {{(pid=72382) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 15:15:14 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-8e2bee7f-ea21-4bef-a0fc-19a14939acd1 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Acquiring lock "refresh_cache-f780040f-b789-4b72-8986-813c7b9fe4a6" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 15:15:14 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-8e2bee7f-ea21-4bef-a0fc-19a14939acd1 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Acquired lock "refresh_cache-f780040f-b789-4b72-8986-813c7b9fe4a6" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 15:15:14 user nova-compute[72382]: DEBUG nova.network.neutron [None req-8e2bee7f-ea21-4bef-a0fc-19a14939acd1 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] [instance: f780040f-b789-4b72-8986-813c7b9fe4a6] Building network info cache for instance {{(pid=72382) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 15:15:14 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-16966d1a-588d-41b9-ae61-b46d67b5d3b8 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44afd1bf-fa5c-4b3e-8752-b16853fef54e/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:15:14 user nova-compute[72382]: DEBUG nova.virt.disk.api [None req-16966d1a-588d-41b9-ae61-b46d67b5d3b8 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Cannot resize image /opt/stack/data/nova/instances/44afd1bf-fa5c-4b3e-8752-b16853fef54e/disk to a smaller size. {{(pid=72382) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 15:15:14 user nova-compute[72382]: DEBUG nova.objects.instance [None req-16966d1a-588d-41b9-ae61-b46d67b5d3b8 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Lazy-loading 'migration_context' on Instance uuid 44afd1bf-fa5c-4b3e-8752-b16853fef54e {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:15:14 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-16966d1a-588d-41b9-ae61-b46d67b5d3b8 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] [instance: 44afd1bf-fa5c-4b3e-8752-b16853fef54e] Created local disks {{(pid=72382) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 15:15:14 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-16966d1a-588d-41b9-ae61-b46d67b5d3b8 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] [instance: 44afd1bf-fa5c-4b3e-8752-b16853fef54e] Ensure instance console log exists: /opt/stack/data/nova/instances/44afd1bf-fa5c-4b3e-8752-b16853fef54e/console.log {{(pid=72382) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 15:15:14 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-16966d1a-588d-41b9-ae61-b46d67b5d3b8 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:15:14 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-16966d1a-588d-41b9-ae61-b46d67b5d3b8 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:15:14 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-16966d1a-588d-41b9-ae61-b46d67b5d3b8 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:15:14 user nova-compute[72382]: DEBUG nova.network.neutron [None req-8e2bee7f-ea21-4bef-a0fc-19a14939acd1 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] [instance: f780040f-b789-4b72-8986-813c7b9fe4a6] Instance cache missing network info. {{(pid=72382) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 15:15:14 user nova-compute[72382]: DEBUG nova.compute.manager [req-460b1d4a-519c-432d-8e31-175605e5bafb req-5b0645cd-ea3b-428a-a10d-38ec48bf9d61 service nova] [instance: f780040f-b789-4b72-8986-813c7b9fe4a6] Received event network-changed-3c9b6983-5682-4eaa-866c-1baf9f2ede26 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:15:14 user nova-compute[72382]: DEBUG nova.compute.manager [req-460b1d4a-519c-432d-8e31-175605e5bafb req-5b0645cd-ea3b-428a-a10d-38ec48bf9d61 service nova] [instance: f780040f-b789-4b72-8986-813c7b9fe4a6] Refreshing instance network info cache due to event network-changed-3c9b6983-5682-4eaa-866c-1baf9f2ede26. {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 15:15:14 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-460b1d4a-519c-432d-8e31-175605e5bafb req-5b0645cd-ea3b-428a-a10d-38ec48bf9d61 service nova] Acquiring lock "refresh_cache-f780040f-b789-4b72-8986-813c7b9fe4a6" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 15:15:15 user nova-compute[72382]: DEBUG nova.network.neutron [None req-8e2bee7f-ea21-4bef-a0fc-19a14939acd1 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] [instance: f780040f-b789-4b72-8986-813c7b9fe4a6] Updating instance_info_cache with network_info: [{"id": "3c9b6983-5682-4eaa-866c-1baf9f2ede26", "address": "fa:16:3e:20:d4:ea", "network": {"id": "d47e3749-fdff-4112-bd72-69ca584efe1f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-302967634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "080d1ded4cd94e5083ee0b7e691b7363", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c9b6983-56", "ovs_interfaceid": "3c9b6983-5682-4eaa-866c-1baf9f2ede26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:15:15 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-8e2bee7f-ea21-4bef-a0fc-19a14939acd1 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Releasing lock "refresh_cache-f780040f-b789-4b72-8986-813c7b9fe4a6" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 15:15:15 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8e2bee7f-ea21-4bef-a0fc-19a14939acd1 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] [instance: f780040f-b789-4b72-8986-813c7b9fe4a6] Instance network_info: |[{"id": "3c9b6983-5682-4eaa-866c-1baf9f2ede26", "address": "fa:16:3e:20:d4:ea", "network": {"id": "d47e3749-fdff-4112-bd72-69ca584efe1f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-302967634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "080d1ded4cd94e5083ee0b7e691b7363", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c9b6983-56", "ovs_interfaceid": "3c9b6983-5682-4eaa-866c-1baf9f2ede26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72382) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 15:15:15 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-460b1d4a-519c-432d-8e31-175605e5bafb req-5b0645cd-ea3b-428a-a10d-38ec48bf9d61 service nova] Acquired lock "refresh_cache-f780040f-b789-4b72-8986-813c7b9fe4a6" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 15:15:15 user nova-compute[72382]: DEBUG nova.network.neutron [req-460b1d4a-519c-432d-8e31-175605e5bafb req-5b0645cd-ea3b-428a-a10d-38ec48bf9d61 service nova] [instance: f780040f-b789-4b72-8986-813c7b9fe4a6] Refreshing network info cache for port 3c9b6983-5682-4eaa-866c-1baf9f2ede26 {{(pid=72382) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 15:15:15 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-8e2bee7f-ea21-4bef-a0fc-19a14939acd1 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] [instance: f780040f-b789-4b72-8986-813c7b9fe4a6] Start _get_guest_xml network_info=[{"id": "3c9b6983-5682-4eaa-866c-1baf9f2ede26", "address": "fa:16:3e:20:d4:ea", "network": {"id": "d47e3749-fdff-4112-bd72-69ca584efe1f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-302967634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "080d1ded4cd94e5083ee0b7e691b7363", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c9b6983-56", "ovs_interfaceid": "3c9b6983-5682-4eaa-866c-1baf9f2ede26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T15:11:25Z,direct_url=<?>,disk_format='qcow2',id=a79f2cea-eb27-4631-aaf3-05e7d9e411b4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a638990e12cc4d6eabb6d55e13be6bdf',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T15:11:27Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'a79f2cea-eb27-4631-aaf3-05e7d9e411b4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72382) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 15:15:15 user nova-compute[72382]: WARNING nova.virt.libvirt.driver [None req-8e2bee7f-ea21-4bef-a0fc-19a14939acd1 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 15:15:15 user nova-compute[72382]: WARNING nova.virt.libvirt.driver [None req-8e2bee7f-ea21-4bef-a0fc-19a14939acd1 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 15:15:15 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-8e2bee7f-ea21-4bef-a0fc-19a14939acd1 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72382) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 15:15:15 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-8e2bee7f-ea21-4bef-a0fc-19a14939acd1 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] CPU controller missing on host. {{(pid=72382) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 15:15:15 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-8e2bee7f-ea21-4bef-a0fc-19a14939acd1 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72382) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 15:15:15 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-8e2bee7f-ea21-4bef-a0fc-19a14939acd1 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] CPU controller found on host. {{(pid=72382) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 15:15:15 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-8e2bee7f-ea21-4bef-a0fc-19a14939acd1 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72382) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 15:15:15 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-8e2bee7f-ea21-4bef-a0fc-19a14939acd1 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T15:11:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T15:11:25Z,direct_url=<?>,disk_format='qcow2',id=a79f2cea-eb27-4631-aaf3-05e7d9e411b4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a638990e12cc4d6eabb6d55e13be6bdf',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T15:11:27Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 15:15:15 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-8e2bee7f-ea21-4bef-a0fc-19a14939acd1 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Flavor limits 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 15:15:15 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-8e2bee7f-ea21-4bef-a0fc-19a14939acd1 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Image limits 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 15:15:15 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-8e2bee7f-ea21-4bef-a0fc-19a14939acd1 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Flavor pref 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 15:15:15 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-8e2bee7f-ea21-4bef-a0fc-19a14939acd1 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Image pref 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 15:15:15 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-8e2bee7f-ea21-4bef-a0fc-19a14939acd1 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 15:15:15 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-8e2bee7f-ea21-4bef-a0fc-19a14939acd1 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 15:15:15 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-8e2bee7f-ea21-4bef-a0fc-19a14939acd1 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72382) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 15:15:15 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-8e2bee7f-ea21-4bef-a0fc-19a14939acd1 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Got 1 possible topologies {{(pid=72382) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 15:15:15 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-8e2bee7f-ea21-4bef-a0fc-19a14939acd1 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 15:15:15 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-8e2bee7f-ea21-4bef-a0fc-19a14939acd1 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 15:15:15 user nova-compute[72382]: DEBUG nova.privsep.utils [None req-8e2bee7f-ea21-4bef-a0fc-19a14939acd1 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72382) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 09 15:15:15 user nova-compute[72382]: DEBUG nova.virt.libvirt.vif [None req-8e2bee7f-ea21-4bef-a0fc-19a14939acd1 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T15:15:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-639252285',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-639252285',id=1,image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='080d1ded4cd94e5083ee0b7e691b7363',ramdisk_id='',reservation_id='r-603sw5mw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1187177274',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T15:15:09Z,user_data=None,user_id='e71af7a4912147cd9fab070cb77b275c',uuid=f780040f-b789-4b72-8986-813c7b9fe4a6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3c9b6983-5682-4eaa-866c-1baf9f2ede26", "address": "fa:16:3e:20:d4:ea", "network": {"id": "d47e3749-fdff-4112-bd72-69ca584efe1f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-302967634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "080d1ded4cd94e5083ee0b7e691b7363", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c9b6983-56", "ovs_interfaceid": "3c9b6983-5682-4eaa-866c-1baf9f2ede26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72382) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 15:15:15 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-8e2bee7f-ea21-4bef-a0fc-19a14939acd1 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Converting VIF {"id": "3c9b6983-5682-4eaa-866c-1baf9f2ede26", "address": "fa:16:3e:20:d4:ea", "network": {"id": "d47e3749-fdff-4112-bd72-69ca584efe1f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-302967634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "080d1ded4cd94e5083ee0b7e691b7363", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c9b6983-56", "ovs_interfaceid": "3c9b6983-5682-4eaa-866c-1baf9f2ede26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 15:15:15 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-8e2bee7f-ea21-4bef-a0fc-19a14939acd1 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:20:d4:ea,bridge_name='br-int',has_traffic_filtering=True,id=3c9b6983-5682-4eaa-866c-1baf9f2ede26,network=Network(d47e3749-fdff-4112-bd72-69ca584efe1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c9b6983-56') {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 15:15:15 user nova-compute[72382]: DEBUG nova.objects.instance [None req-8e2bee7f-ea21-4bef-a0fc-19a14939acd1 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Lazy-loading 'pci_devices' on Instance uuid f780040f-b789-4b72-8986-813c7b9fe4a6 {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:15:15 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-8e2bee7f-ea21-4bef-a0fc-19a14939acd1 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] [instance: f780040f-b789-4b72-8986-813c7b9fe4a6] End _get_guest_xml xml=<domain type="kvm">
Aug 09 15:15:15 user nova-compute[72382]:   <uuid>f780040f-b789-4b72-8986-813c7b9fe4a6</uuid>
Aug 09 15:15:15 user nova-compute[72382]:   <name>instance-00000001</name>
Aug 09 15:15:15 user nova-compute[72382]:   <memory>524288</memory>
Aug 09 15:15:15 user nova-compute[72382]:   <vcpu>1</vcpu>
Aug 09 15:15:15 user nova-compute[72382]:   <metadata>
Aug 09 15:15:15 user nova-compute[72382]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 15:15:15 user nova-compute[72382]:       <nova:package version="0.0.0"/>
Aug 09 15:15:15 user nova-compute[72382]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-639252285</nova:name>
Aug 09 15:15:15 user nova-compute[72382]:       <nova:creationTime>2023-08-09 15:15:15</nova:creationTime>
Aug 09 15:15:15 user nova-compute[72382]:       <nova:flavor name="m1.tiny">
Aug 09 15:15:15 user nova-compute[72382]:         <nova:memory>512</nova:memory>
Aug 09 15:15:15 user nova-compute[72382]:         <nova:disk>1</nova:disk>
Aug 09 15:15:15 user nova-compute[72382]:         <nova:swap>0</nova:swap>
Aug 09 15:15:15 user nova-compute[72382]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 15:15:15 user nova-compute[72382]:         <nova:vcpus>1</nova:vcpus>
Aug 09 15:15:15 user nova-compute[72382]:       </nova:flavor>
Aug 09 15:15:15 user nova-compute[72382]:       <nova:owner>
Aug 09 15:15:15 user nova-compute[72382]:         <nova:user uuid="e71af7a4912147cd9fab070cb77b275c">tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member</nova:user>
Aug 09 15:15:15 user nova-compute[72382]:         <nova:project uuid="080d1ded4cd94e5083ee0b7e691b7363">tempest-ServerBootFromVolumeStableRescueTest-1187177274</nova:project>
Aug 09 15:15:15 user nova-compute[72382]:       </nova:owner>
Aug 09 15:15:15 user nova-compute[72382]:       <nova:root type="image" uuid="a79f2cea-eb27-4631-aaf3-05e7d9e411b4"/>
Aug 09 15:15:15 user nova-compute[72382]:       <nova:ports>
Aug 09 15:15:15 user nova-compute[72382]:         <nova:port uuid="3c9b6983-5682-4eaa-866c-1baf9f2ede26">
Aug 09 15:15:15 user nova-compute[72382]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 09 15:15:15 user nova-compute[72382]:         </nova:port>
Aug 09 15:15:15 user nova-compute[72382]:       </nova:ports>
Aug 09 15:15:15 user nova-compute[72382]:     </nova:instance>
Aug 09 15:15:15 user nova-compute[72382]:   </metadata>
Aug 09 15:15:15 user nova-compute[72382]:   <sysinfo type="smbios">
Aug 09 15:15:15 user nova-compute[72382]:     <system>
Aug 09 15:15:15 user nova-compute[72382]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 15:15:15 user nova-compute[72382]:       <entry name="product">OpenStack Nova</entry>
Aug 09 15:15:15 user nova-compute[72382]:       <entry name="version">0.0.0</entry>
Aug 09 15:15:15 user nova-compute[72382]:       <entry name="serial">f780040f-b789-4b72-8986-813c7b9fe4a6</entry>
Aug 09 15:15:15 user nova-compute[72382]:       <entry name="uuid">f780040f-b789-4b72-8986-813c7b9fe4a6</entry>
Aug 09 15:15:15 user nova-compute[72382]:       <entry name="family">Virtual Machine</entry>
Aug 09 15:15:15 user nova-compute[72382]:     </system>
Aug 09 15:15:15 user nova-compute[72382]:   </sysinfo>
Aug 09 15:15:15 user nova-compute[72382]:   <os>
Aug 09 15:15:15 user nova-compute[72382]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 15:15:15 user nova-compute[72382]:     <boot dev="hd"/>
Aug 09 15:15:15 user nova-compute[72382]:     <smbios mode="sysinfo"/>
Aug 09 15:15:15 user nova-compute[72382]:   </os>
Aug 09 15:15:15 user nova-compute[72382]:   <features>
Aug 09 15:15:15 user nova-compute[72382]:     <acpi/>
Aug 09 15:15:15 user nova-compute[72382]:     <apic/>
Aug 09 15:15:15 user nova-compute[72382]:     <vmcoreinfo/>
Aug 09 15:15:15 user nova-compute[72382]:   </features>
Aug 09 15:15:15 user nova-compute[72382]:   <clock offset="utc">
Aug 09 15:15:15 user nova-compute[72382]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 15:15:15 user nova-compute[72382]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 15:15:15 user nova-compute[72382]:     <timer name="hpet" present="no"/>
Aug 09 15:15:15 user nova-compute[72382]:   </clock>
Aug 09 15:15:15 user nova-compute[72382]:   <cpu mode="custom" match="exact">
Aug 09 15:15:15 user nova-compute[72382]:     <model>Nehalem</model>
Aug 09 15:15:15 user nova-compute[72382]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 15:15:15 user nova-compute[72382]:   </cpu>
Aug 09 15:15:15 user nova-compute[72382]:   <devices>
Aug 09 15:15:15 user nova-compute[72382]:     <disk type="file" device="disk">
Aug 09 15:15:15 user nova-compute[72382]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 15:15:15 user nova-compute[72382]:       <source file="/opt/stack/data/nova/instances/f780040f-b789-4b72-8986-813c7b9fe4a6/disk"/>
Aug 09 15:15:15 user nova-compute[72382]:       <target dev="vda" bus="virtio"/>
Aug 09 15:15:15 user nova-compute[72382]:     </disk>
Aug 09 15:15:15 user nova-compute[72382]:     <interface type="ethernet">
Aug 09 15:15:15 user nova-compute[72382]:       <mac address="fa:16:3e:20:d4:ea"/>
Aug 09 15:15:15 user nova-compute[72382]:       <model type="virtio"/>
Aug 09 15:15:15 user nova-compute[72382]:       <mtu size="1442"/>
Aug 09 15:15:15 user nova-compute[72382]:       <target dev="tap3c9b6983-56"/>
Aug 09 15:15:15 user nova-compute[72382]:     </interface>
Aug 09 15:15:15 user nova-compute[72382]:     <serial type="pty">
Aug 09 15:15:15 user nova-compute[72382]:       <log file="/opt/stack/data/nova/instances/f780040f-b789-4b72-8986-813c7b9fe4a6/console.log" append="off"/>
Aug 09 15:15:15 user nova-compute[72382]:     </serial>
Aug 09 15:15:15 user nova-compute[72382]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 15:15:15 user nova-compute[72382]:     <video>
Aug 09 15:15:15 user nova-compute[72382]:       <model type="virtio"/>
Aug 09 15:15:15 user nova-compute[72382]:     </video>
Aug 09 15:15:15 user nova-compute[72382]:     <rng model="virtio">
Aug 09 15:15:15 user nova-compute[72382]:       <backend model="random">/dev/urandom</backend>
Aug 09 15:15:15 user nova-compute[72382]:     </rng>
Aug 09 15:15:15 user nova-compute[72382]:     <controller type="usb" index="0" model="none"/>
Aug 09 15:15:15 user nova-compute[72382]:     <memballoon model="virtio">
Aug 09 15:15:15 user nova-compute[72382]:       <stats period="10"/>
Aug 09 15:15:15 user nova-compute[72382]:     </memballoon>
Aug 09 15:15:15 user nova-compute[72382]:   </devices>
Aug 09 15:15:15 user nova-compute[72382]: </domain>
Aug 09 15:15:15 user nova-compute[72382]:  {{(pid=72382) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 15:15:15 user nova-compute[72382]: DEBUG nova.virt.libvirt.vif [None req-8e2bee7f-ea21-4bef-a0fc-19a14939acd1 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T15:15:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-639252285',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-639252285',id=1,image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='080d1ded4cd94e5083ee0b7e691b7363',ramdisk_id='',reservation_id='r-603sw5mw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1187177274',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T15:15:09Z,user_data=None,user_id='e71af7a4912147cd9fab070cb77b275c',uuid=f780040f-b789-4b72-8986-813c7b9fe4a6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3c9b6983-5682-4eaa-866c-1baf9f2ede26", "address": "fa:16:3e:20:d4:ea", "network": {"id": "d47e3749-fdff-4112-bd72-69ca584efe1f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-302967634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "080d1ded4cd94e5083ee0b7e691b7363", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c9b6983-56", "ovs_interfaceid": "3c9b6983-5682-4eaa-866c-1baf9f2ede26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 15:15:15 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-8e2bee7f-ea21-4bef-a0fc-19a14939acd1 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Converting VIF {"id": "3c9b6983-5682-4eaa-866c-1baf9f2ede26", "address": "fa:16:3e:20:d4:ea", "network": {"id": "d47e3749-fdff-4112-bd72-69ca584efe1f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-302967634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "080d1ded4cd94e5083ee0b7e691b7363", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c9b6983-56", "ovs_interfaceid": "3c9b6983-5682-4eaa-866c-1baf9f2ede26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 15:15:15 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-8e2bee7f-ea21-4bef-a0fc-19a14939acd1 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:20:d4:ea,bridge_name='br-int',has_traffic_filtering=True,id=3c9b6983-5682-4eaa-866c-1baf9f2ede26,network=Network(d47e3749-fdff-4112-bd72-69ca584efe1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c9b6983-56') {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 15:15:15 user nova-compute[72382]: DEBUG os_vif [None req-8e2bee7f-ea21-4bef-a0fc-19a14939acd1 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:20:d4:ea,bridge_name='br-int',has_traffic_filtering=True,id=3c9b6983-5682-4eaa-866c-1baf9f2ede26,network=Network(d47e3749-fdff-4112-bd72-69ca584efe1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c9b6983-56') {{(pid=72382) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 15:15:15 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl [None req-8e2bee7f-ea21-4bef-a0fc-19a14939acd1 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Created schema index Interface.name {{(pid=72382) autocreate_indices /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Aug 09 15:15:15 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl [None req-8e2bee7f-ea21-4bef-a0fc-19a14939acd1 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Created schema index Port.name {{(pid=72382) autocreate_indices /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Aug 09 15:15:15 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl [None req-8e2bee7f-ea21-4bef-a0fc-19a14939acd1 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Created schema index Bridge.name {{(pid=72382) autocreate_indices /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Aug 09 15:15:15 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-8e2bee7f-ea21-4bef-a0fc-19a14939acd1 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=72382) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 15:15:15 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-8e2bee7f-ea21-4bef-a0fc-19a14939acd1 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] [POLLOUT] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:15:15 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-8e2bee7f-ea21-4bef-a0fc-19a14939acd1 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72382) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 15:15:15 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-8e2bee7f-ea21-4bef-a0fc-19a14939acd1 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:15:15 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-8e2bee7f-ea21-4bef-a0fc-19a14939acd1 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:15:15 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-8e2bee7f-ea21-4bef-a0fc-19a14939acd1 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:15:15 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:15:15 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:15:15 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 15:15:15 user nova-compute[72382]: INFO oslo.privsep.daemon [None req-8e2bee7f-ea21-4bef-a0fc-19a14939acd1 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmpfj0d52qm/privsep.sock']
Aug 09 15:15:15 user sudo[81628]:    stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmpfj0d52qm/privsep.sock
Aug 09 15:15:15 user sudo[81628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Aug 09 15:15:16 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-bd0bf5c4-b736-4591-85ca-5fff7abbf4d1 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Acquiring lock "266be814-4a2b-4f8e-a0f6-e8821fdeb95d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:15:16 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-bd0bf5c4-b736-4591-85ca-5fff7abbf4d1 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Lock "266be814-4a2b-4f8e-a0f6-e8821fdeb95d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:15:16 user nova-compute[72382]: DEBUG nova.compute.manager [None req-bd0bf5c4-b736-4591-85ca-5fff7abbf4d1 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] [instance: 266be814-4a2b-4f8e-a0f6-e8821fdeb95d] Starting instance... {{(pid=72382) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 15:15:16 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-bd0bf5c4-b736-4591-85ca-5fff7abbf4d1 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:15:16 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-bd0bf5c4-b736-4591-85ca-5fff7abbf4d1 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:15:16 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-bd0bf5c4-b736-4591-85ca-5fff7abbf4d1 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72382) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 15:15:16 user nova-compute[72382]: INFO nova.compute.claims [None req-bd0bf5c4-b736-4591-85ca-5fff7abbf4d1 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] [instance: 266be814-4a2b-4f8e-a0f6-e8821fdeb95d] Claim successful on node user
Aug 09 15:15:16 user nova-compute[72382]: DEBUG nova.compute.provider_tree [None req-bd0bf5c4-b736-4591-85ca-5fff7abbf4d1 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Inventory has not changed in ProviderTree for provider: 7b15b0e5-df4d-49db-833b-2855d21d10ae {{(pid=72382) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 15:15:16 user nova-compute[72382]: DEBUG nova.scheduler.client.report [None req-bd0bf5c4-b736-4591-85ca-5fff7abbf4d1 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Inventory has not changed for provider 7b15b0e5-df4d-49db-833b-2855d21d10ae based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72382) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 15:15:16 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-bd0bf5c4-b736-4591-85ca-5fff7abbf4d1 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.269s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:15:16 user nova-compute[72382]: DEBUG nova.compute.manager [None req-bd0bf5c4-b736-4591-85ca-5fff7abbf4d1 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] [instance: 266be814-4a2b-4f8e-a0f6-e8821fdeb95d] Start building networks asynchronously for instance. {{(pid=72382) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 15:15:16 user nova-compute[72382]: DEBUG nova.compute.manager [None req-bd0bf5c4-b736-4591-85ca-5fff7abbf4d1 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] [instance: 266be814-4a2b-4f8e-a0f6-e8821fdeb95d] Allocating IP information in the background. {{(pid=72382) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 15:15:16 user nova-compute[72382]: DEBUG nova.network.neutron [None req-bd0bf5c4-b736-4591-85ca-5fff7abbf4d1 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] [instance: 266be814-4a2b-4f8e-a0f6-e8821fdeb95d] allocate_for_instance() {{(pid=72382) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 15:15:16 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-bd0bf5c4-b736-4591-85ca-5fff7abbf4d1 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] [instance: 266be814-4a2b-4f8e-a0f6-e8821fdeb95d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 15:15:16 user nova-compute[72382]: DEBUG nova.compute.manager [None req-bd0bf5c4-b736-4591-85ca-5fff7abbf4d1 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] [instance: 266be814-4a2b-4f8e-a0f6-e8821fdeb95d] Start building block device mappings for instance. {{(pid=72382) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 15:15:16 user nova-compute[72382]: DEBUG nova.network.neutron [req-460b1d4a-519c-432d-8e31-175605e5bafb req-5b0645cd-ea3b-428a-a10d-38ec48bf9d61 service nova] [instance: f780040f-b789-4b72-8986-813c7b9fe4a6] Updated VIF entry in instance network info cache for port 3c9b6983-5682-4eaa-866c-1baf9f2ede26. {{(pid=72382) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 15:15:16 user nova-compute[72382]: DEBUG nova.network.neutron [req-460b1d4a-519c-432d-8e31-175605e5bafb req-5b0645cd-ea3b-428a-a10d-38ec48bf9d61 service nova] [instance: f780040f-b789-4b72-8986-813c7b9fe4a6] Updating instance_info_cache with network_info: [{"id": "3c9b6983-5682-4eaa-866c-1baf9f2ede26", "address": "fa:16:3e:20:d4:ea", "network": {"id": "d47e3749-fdff-4112-bd72-69ca584efe1f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-302967634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "080d1ded4cd94e5083ee0b7e691b7363", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c9b6983-56", "ovs_interfaceid": "3c9b6983-5682-4eaa-866c-1baf9f2ede26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:15:16 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-460b1d4a-519c-432d-8e31-175605e5bafb req-5b0645cd-ea3b-428a-a10d-38ec48bf9d61 service nova] Releasing lock "refresh_cache-f780040f-b789-4b72-8986-813c7b9fe4a6" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 15:15:16 user nova-compute[72382]: DEBUG nova.compute.manager [None req-bd0bf5c4-b736-4591-85ca-5fff7abbf4d1 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] [instance: 266be814-4a2b-4f8e-a0f6-e8821fdeb95d] Start spawning the instance on the hypervisor. {{(pid=72382) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 15:15:16 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-bd0bf5c4-b736-4591-85ca-5fff7abbf4d1 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] [instance: 266be814-4a2b-4f8e-a0f6-e8821fdeb95d] Creating instance directory {{(pid=72382) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 15:15:16 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-bd0bf5c4-b736-4591-85ca-5fff7abbf4d1 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] [instance: 266be814-4a2b-4f8e-a0f6-e8821fdeb95d] Creating image(s)
Aug 09 15:15:16 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-bd0bf5c4-b736-4591-85ca-5fff7abbf4d1 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Acquiring lock "/opt/stack/data/nova/instances/266be814-4a2b-4f8e-a0f6-e8821fdeb95d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:15:16 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-bd0bf5c4-b736-4591-85ca-5fff7abbf4d1 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Lock "/opt/stack/data/nova/instances/266be814-4a2b-4f8e-a0f6-e8821fdeb95d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:15:16 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-bd0bf5c4-b736-4591-85ca-5fff7abbf4d1 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Lock "/opt/stack/data/nova/instances/266be814-4a2b-4f8e-a0f6-e8821fdeb95d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:15:16 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:15:16 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-bd0bf5c4-b736-4591-85ca-5fff7abbf4d1 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:15:16 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-bd0bf5c4-b736-4591-85ca-5fff7abbf4d1 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b --force-share --output=json" returned: 0 in 0.140s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:15:16 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-bd0bf5c4-b736-4591-85ca-5fff7abbf4d1 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Acquiring lock "383812ff437283e0191ed5b9ecc04c27f1162b0b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:15:16 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-bd0bf5c4-b736-4591-85ca-5fff7abbf4d1 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Lock "383812ff437283e0191ed5b9ecc04c27f1162b0b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:15:16 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-bd0bf5c4-b736-4591-85ca-5fff7abbf4d1 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:15:17 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:15:17 user nova-compute[72382]: DEBUG nova.network.neutron [None req-f816da71-40e8-4952-90c2-f2c3ed3b228b tempest-ServersNegativeTestJSON-1671359082 tempest-ServersNegativeTestJSON-1671359082-project-member] [instance: 777e49ea-b674-4c3f-9cdd-ac2113032632] Successfully created port: 80b78279-76f9-46c8-a54d-413116bc37c6 {{(pid=72382) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 15:15:17 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-bd0bf5c4-b736-4591-85ca-5fff7abbf4d1 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b --force-share --output=json" returned: 0 in 0.143s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:15:17 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-bd0bf5c4-b736-4591-85ca-5fff7abbf4d1 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b,backing_fmt=raw /opt/stack/data/nova/instances/266be814-4a2b-4f8e-a0f6-e8821fdeb95d/disk 1073741824 {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:15:17 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-bd0bf5c4-b736-4591-85ca-5fff7abbf4d1 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b,backing_fmt=raw /opt/stack/data/nova/instances/266be814-4a2b-4f8e-a0f6-e8821fdeb95d/disk 1073741824" returned: 0 in 0.051s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:15:17 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-bd0bf5c4-b736-4591-85ca-5fff7abbf4d1 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Lock "383812ff437283e0191ed5b9ecc04c27f1162b0b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.197s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:15:17 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-bd0bf5c4-b736-4591-85ca-5fff7abbf4d1 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:15:17 user nova-compute[72382]: DEBUG nova.policy [None req-bd0bf5c4-b736-4591-85ca-5fff7abbf4d1 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f94ca386a2be42cfbc2407bb7520cd25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990ba791030940d38360af5879c853c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72382) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 15:15:17 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-bd0bf5c4-b736-4591-85ca-5fff7abbf4d1 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b --force-share --output=json" returned: 0 in 0.133s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:15:17 user nova-compute[72382]: DEBUG nova.virt.disk.api [None req-bd0bf5c4-b736-4591-85ca-5fff7abbf4d1 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Checking if we can resize image /opt/stack/data/nova/instances/266be814-4a2b-4f8e-a0f6-e8821fdeb95d/disk. size=1073741824 {{(pid=72382) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 15:15:17 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-bd0bf5c4-b736-4591-85ca-5fff7abbf4d1 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/266be814-4a2b-4f8e-a0f6-e8821fdeb95d/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:15:17 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-bd0bf5c4-b736-4591-85ca-5fff7abbf4d1 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/266be814-4a2b-4f8e-a0f6-e8821fdeb95d/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:15:17 user nova-compute[72382]: DEBUG nova.virt.disk.api [None req-bd0bf5c4-b736-4591-85ca-5fff7abbf4d1 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Cannot resize image /opt/stack/data/nova/instances/266be814-4a2b-4f8e-a0f6-e8821fdeb95d/disk to a smaller size. {{(pid=72382) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 15:15:17 user nova-compute[72382]: DEBUG nova.objects.instance [None req-bd0bf5c4-b736-4591-85ca-5fff7abbf4d1 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Lazy-loading 'migration_context' on Instance uuid 266be814-4a2b-4f8e-a0f6-e8821fdeb95d {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:15:17 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-bd0bf5c4-b736-4591-85ca-5fff7abbf4d1 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] [instance: 266be814-4a2b-4f8e-a0f6-e8821fdeb95d] Created local disks {{(pid=72382) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 15:15:17 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-bd0bf5c4-b736-4591-85ca-5fff7abbf4d1 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] [instance: 266be814-4a2b-4f8e-a0f6-e8821fdeb95d] Ensure instance console log exists: /opt/stack/data/nova/instances/266be814-4a2b-4f8e-a0f6-e8821fdeb95d/console.log {{(pid=72382) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 15:15:17 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-bd0bf5c4-b736-4591-85ca-5fff7abbf4d1 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:15:17 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-bd0bf5c4-b736-4591-85ca-5fff7abbf4d1 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:15:17 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-bd0bf5c4-b736-4591-85ca-5fff7abbf4d1 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:15:17 user sudo[81628]: pam_unix(sudo:session): session closed for user root
Aug 09 15:15:17 user nova-compute[72382]: INFO oslo.privsep.daemon [None req-8e2bee7f-ea21-4bef-a0fc-19a14939acd1 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Spawned new privsep daemon via rootwrap
Aug 09 15:15:17 user nova-compute[72382]: INFO oslo.privsep.daemon [-] privsep daemon starting
Aug 09 15:15:17 user nova-compute[72382]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Aug 09 15:15:17 user nova-compute[72382]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Aug 09 15:15:17 user nova-compute[72382]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 81649
Aug 09 15:15:18 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:15:18 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3c9b6983-56, may_exist=True, interface_attrs={}) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:15:18 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3c9b6983-56, col_values=(('external_ids', {'iface-id': '3c9b6983-5682-4eaa-866c-1baf9f2ede26', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:20:d4:ea', 'vm-uuid': 'f780040f-b789-4b72-8986-813c7b9fe4a6'}),), if_exists=True) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:15:18 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:15:18 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:15:18 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:15:18 user nova-compute[72382]: INFO os_vif [None req-8e2bee7f-ea21-4bef-a0fc-19a14939acd1 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:20:d4:ea,bridge_name='br-int',has_traffic_filtering=True,id=3c9b6983-5682-4eaa-866c-1baf9f2ede26,network=Network(d47e3749-fdff-4112-bd72-69ca584efe1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c9b6983-56')
Aug 09 15:15:18 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-8e2bee7f-ea21-4bef-a0fc-19a14939acd1 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] No BDM found with device name vda, not building metadata. {{(pid=72382) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 15:15:18 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-8e2bee7f-ea21-4bef-a0fc-19a14939acd1 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] No VIF found with MAC fa:16:3e:20:d4:ea, not building metadata {{(pid=72382) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 15:15:18 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:15:18 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-48177f7f-2ba7-494f-8af2-3b8ef01c79c3 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Acquiring lock "c9766433-4c5a-40ed-a212-715a24f42b91" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:15:18 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-48177f7f-2ba7-494f-8af2-3b8ef01c79c3 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Lock "c9766433-4c5a-40ed-a212-715a24f42b91" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:15:18 user nova-compute[72382]: DEBUG nova.compute.manager [None req-48177f7f-2ba7-494f-8af2-3b8ef01c79c3 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] [instance: c9766433-4c5a-40ed-a212-715a24f42b91] Starting instance... {{(pid=72382) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 15:15:18 user nova-compute[72382]: DEBUG nova.network.neutron [None req-16966d1a-588d-41b9-ae61-b46d67b5d3b8 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] [instance: 44afd1bf-fa5c-4b3e-8752-b16853fef54e] Successfully created port: 2a1d4c60-bc2a-4530-b3bd-2a12ae2d2098 {{(pid=72382) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 15:15:18 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:15:18 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-48177f7f-2ba7-494f-8af2-3b8ef01c79c3 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:15:18 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-48177f7f-2ba7-494f-8af2-3b8ef01c79c3 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:15:18 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-48177f7f-2ba7-494f-8af2-3b8ef01c79c3 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72382) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 15:15:18 user nova-compute[72382]: INFO nova.compute.claims [None req-48177f7f-2ba7-494f-8af2-3b8ef01c79c3 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] [instance: c9766433-4c5a-40ed-a212-715a24f42b91] Claim successful on node user
Aug 09 15:15:19 user nova-compute[72382]: DEBUG nova.compute.provider_tree [None req-48177f7f-2ba7-494f-8af2-3b8ef01c79c3 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Inventory has not changed in ProviderTree for provider: 7b15b0e5-df4d-49db-833b-2855d21d10ae {{(pid=72382) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 15:15:19 user nova-compute[72382]: DEBUG nova.scheduler.client.report [None req-48177f7f-2ba7-494f-8af2-3b8ef01c79c3 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Inventory has not changed for provider 7b15b0e5-df4d-49db-833b-2855d21d10ae based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72382) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 15:15:19 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-48177f7f-2ba7-494f-8af2-3b8ef01c79c3 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.505s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:15:19 user nova-compute[72382]: DEBUG nova.compute.manager [None req-48177f7f-2ba7-494f-8af2-3b8ef01c79c3 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] [instance: c9766433-4c5a-40ed-a212-715a24f42b91] Start building networks asynchronously for instance. {{(pid=72382) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 15:15:19 user nova-compute[72382]: DEBUG nova.compute.manager [None req-48177f7f-2ba7-494f-8af2-3b8ef01c79c3 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] [instance: c9766433-4c5a-40ed-a212-715a24f42b91] Allocating IP information in the background. {{(pid=72382) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 15:15:19 user nova-compute[72382]: DEBUG nova.network.neutron [None req-48177f7f-2ba7-494f-8af2-3b8ef01c79c3 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] [instance: c9766433-4c5a-40ed-a212-715a24f42b91] allocate_for_instance() {{(pid=72382) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 15:15:19 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-48177f7f-2ba7-494f-8af2-3b8ef01c79c3 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] [instance: c9766433-4c5a-40ed-a212-715a24f42b91] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 15:15:19 user nova-compute[72382]: DEBUG nova.compute.manager [None req-48177f7f-2ba7-494f-8af2-3b8ef01c79c3 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] [instance: c9766433-4c5a-40ed-a212-715a24f42b91] Start building block device mappings for instance. {{(pid=72382) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 15:15:19 user nova-compute[72382]: DEBUG nova.compute.manager [None req-48177f7f-2ba7-494f-8af2-3b8ef01c79c3 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] [instance: c9766433-4c5a-40ed-a212-715a24f42b91] Start spawning the instance on the hypervisor. {{(pid=72382) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 15:15:19 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-48177f7f-2ba7-494f-8af2-3b8ef01c79c3 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] [instance: c9766433-4c5a-40ed-a212-715a24f42b91] Creating instance directory {{(pid=72382) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 15:15:19 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-48177f7f-2ba7-494f-8af2-3b8ef01c79c3 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] [instance: c9766433-4c5a-40ed-a212-715a24f42b91] Creating image(s)
Aug 09 15:15:19 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-48177f7f-2ba7-494f-8af2-3b8ef01c79c3 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Acquiring lock "/opt/stack/data/nova/instances/c9766433-4c5a-40ed-a212-715a24f42b91/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:15:19 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-48177f7f-2ba7-494f-8af2-3b8ef01c79c3 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Lock "/opt/stack/data/nova/instances/c9766433-4c5a-40ed-a212-715a24f42b91/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:15:19 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-48177f7f-2ba7-494f-8af2-3b8ef01c79c3 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Lock "/opt/stack/data/nova/instances/c9766433-4c5a-40ed-a212-715a24f42b91/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:15:19 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-48177f7f-2ba7-494f-8af2-3b8ef01c79c3 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:15:19 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-48177f7f-2ba7-494f-8af2-3b8ef01c79c3 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b --force-share --output=json" returned: 0 in 0.151s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:15:19 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-48177f7f-2ba7-494f-8af2-3b8ef01c79c3 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Acquiring lock "383812ff437283e0191ed5b9ecc04c27f1162b0b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:15:19 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-48177f7f-2ba7-494f-8af2-3b8ef01c79c3 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Lock "383812ff437283e0191ed5b9ecc04c27f1162b0b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:15:19 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-48177f7f-2ba7-494f-8af2-3b8ef01c79c3 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:15:19 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:15:19 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:15:19 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:15:19 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:15:19 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-48177f7f-2ba7-494f-8af2-3b8ef01c79c3 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b --force-share --output=json" returned: 0 in 0.123s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:15:19 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-48177f7f-2ba7-494f-8af2-3b8ef01c79c3 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b,backing_fmt=raw /opt/stack/data/nova/instances/c9766433-4c5a-40ed-a212-715a24f42b91/disk 1073741824 {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:15:19 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-48177f7f-2ba7-494f-8af2-3b8ef01c79c3 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b,backing_fmt=raw /opt/stack/data/nova/instances/c9766433-4c5a-40ed-a212-715a24f42b91/disk 1073741824" returned: 0 in 0.067s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:15:19 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-48177f7f-2ba7-494f-8af2-3b8ef01c79c3 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Lock "383812ff437283e0191ed5b9ecc04c27f1162b0b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.195s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:15:19 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-48177f7f-2ba7-494f-8af2-3b8ef01c79c3 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:15:20 user nova-compute[72382]: DEBUG nova.policy [None req-48177f7f-2ba7-494f-8af2-3b8ef01c79c3 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '232fbbd15fea4894be7cebb13ea45cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f45d010dd474c92a6b24bf977564ad1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72382) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 15:15:20 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-48177f7f-2ba7-494f-8af2-3b8ef01c79c3 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b --force-share --output=json" returned: 0 in 0.127s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:15:20 user nova-compute[72382]: DEBUG nova.virt.disk.api [None req-48177f7f-2ba7-494f-8af2-3b8ef01c79c3 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c9766433-4c5a-40ed-a212-715a24f42b91/disk. size=1073741824 {{(pid=72382) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 15:15:20 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-48177f7f-2ba7-494f-8af2-3b8ef01c79c3 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9766433-4c5a-40ed-a212-715a24f42b91/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:15:20 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:15:20 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-48177f7f-2ba7-494f-8af2-3b8ef01c79c3 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9766433-4c5a-40ed-a212-715a24f42b91/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:15:20 user nova-compute[72382]: DEBUG nova.virt.disk.api [None req-48177f7f-2ba7-494f-8af2-3b8ef01c79c3 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Cannot resize image /opt/stack/data/nova/instances/c9766433-4c5a-40ed-a212-715a24f42b91/disk to a smaller size. {{(pid=72382) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 15:15:20 user nova-compute[72382]: DEBUG nova.objects.instance [None req-48177f7f-2ba7-494f-8af2-3b8ef01c79c3 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Lazy-loading 'migration_context' on Instance uuid c9766433-4c5a-40ed-a212-715a24f42b91 {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:15:20 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-48177f7f-2ba7-494f-8af2-3b8ef01c79c3 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] [instance: c9766433-4c5a-40ed-a212-715a24f42b91] Created local disks {{(pid=72382) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 15:15:20 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-48177f7f-2ba7-494f-8af2-3b8ef01c79c3 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] [instance: c9766433-4c5a-40ed-a212-715a24f42b91] Ensure instance console log exists: /opt/stack/data/nova/instances/c9766433-4c5a-40ed-a212-715a24f42b91/console.log {{(pid=72382) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 15:15:20 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-48177f7f-2ba7-494f-8af2-3b8ef01c79c3 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:15:20 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-48177f7f-2ba7-494f-8af2-3b8ef01c79c3 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:15:20 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-48177f7f-2ba7-494f-8af2-3b8ef01c79c3 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:15:20 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:15:20 user nova-compute[72382]: DEBUG nova.network.neutron [None req-bd0bf5c4-b736-4591-85ca-5fff7abbf4d1 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] [instance: 266be814-4a2b-4f8e-a0f6-e8821fdeb95d] Successfully created port: 48650c01-c5a9-44f2-a481-5120c429a5a5 {{(pid=72382) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 15:15:21 user nova-compute[72382]: DEBUG nova.compute.manager [req-c1270bed-5a02-461f-a395-6865441188ff req-0b6340e7-76df-4960-ba01-9408c3eaf68c service nova] [instance: f780040f-b789-4b72-8986-813c7b9fe4a6] Received event network-vif-plugged-3c9b6983-5682-4eaa-866c-1baf9f2ede26 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:15:21 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-c1270bed-5a02-461f-a395-6865441188ff req-0b6340e7-76df-4960-ba01-9408c3eaf68c service nova] Acquiring lock "f780040f-b789-4b72-8986-813c7b9fe4a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:15:21 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-c1270bed-5a02-461f-a395-6865441188ff req-0b6340e7-76df-4960-ba01-9408c3eaf68c service nova] Lock "f780040f-b789-4b72-8986-813c7b9fe4a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:15:21 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-c1270bed-5a02-461f-a395-6865441188ff req-0b6340e7-76df-4960-ba01-9408c3eaf68c service nova] Lock "f780040f-b789-4b72-8986-813c7b9fe4a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:15:21 user nova-compute[72382]: DEBUG nova.compute.manager [req-c1270bed-5a02-461f-a395-6865441188ff req-0b6340e7-76df-4960-ba01-9408c3eaf68c service nova] [instance: f780040f-b789-4b72-8986-813c7b9fe4a6] No waiting events found dispatching network-vif-plugged-3c9b6983-5682-4eaa-866c-1baf9f2ede26 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:15:21 user nova-compute[72382]: WARNING nova.compute.manager [req-c1270bed-5a02-461f-a395-6865441188ff req-0b6340e7-76df-4960-ba01-9408c3eaf68c service nova] [instance: f780040f-b789-4b72-8986-813c7b9fe4a6] Received unexpected event network-vif-plugged-3c9b6983-5682-4eaa-866c-1baf9f2ede26 for instance with vm_state building and task_state spawning.
Aug 09 15:15:21 user nova-compute[72382]: DEBUG nova.virt.driver [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Emitting event <LifecycleEvent: 1691594121.4941766, f780040f-b789-4b72-8986-813c7b9fe4a6 => Resumed> {{(pid=72382) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 15:15:21 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: f780040f-b789-4b72-8986-813c7b9fe4a6] VM Resumed (Lifecycle Event)
Aug 09 15:15:21 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8e2bee7f-ea21-4bef-a0fc-19a14939acd1 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] [instance: f780040f-b789-4b72-8986-813c7b9fe4a6] Instance event wait completed in 0 seconds for  {{(pid=72382) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 15:15:21 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-8e2bee7f-ea21-4bef-a0fc-19a14939acd1 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] [instance: f780040f-b789-4b72-8986-813c7b9fe4a6] Guest created on hypervisor {{(pid=72382) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 15:15:21 user nova-compute[72382]: INFO nova.virt.libvirt.driver [-] [instance: f780040f-b789-4b72-8986-813c7b9fe4a6] Instance spawned successfully.
Aug 09 15:15:21 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-8e2bee7f-ea21-4bef-a0fc-19a14939acd1 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] [instance: f780040f-b789-4b72-8986-813c7b9fe4a6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 15:15:21 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-8e2bee7f-ea21-4bef-a0fc-19a14939acd1 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] [instance: f780040f-b789-4b72-8986-813c7b9fe4a6] Found default for hw_cdrom_bus of ide {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:15:21 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-8e2bee7f-ea21-4bef-a0fc-19a14939acd1 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] [instance: f780040f-b789-4b72-8986-813c7b9fe4a6] Found default for hw_disk_bus of virtio {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:15:21 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-8e2bee7f-ea21-4bef-a0fc-19a14939acd1 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] [instance: f780040f-b789-4b72-8986-813c7b9fe4a6] Found default for hw_input_bus of None {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:15:21 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-8e2bee7f-ea21-4bef-a0fc-19a14939acd1 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] [instance: f780040f-b789-4b72-8986-813c7b9fe4a6] Found default for hw_pointer_model of None {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:15:21 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-8e2bee7f-ea21-4bef-a0fc-19a14939acd1 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] [instance: f780040f-b789-4b72-8986-813c7b9fe4a6] Found default for hw_video_model of virtio {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:15:21 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-8e2bee7f-ea21-4bef-a0fc-19a14939acd1 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] [instance: f780040f-b789-4b72-8986-813c7b9fe4a6] Found default for hw_vif_model of virtio {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:15:21 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: f780040f-b789-4b72-8986-813c7b9fe4a6] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:15:21 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: f780040f-b789-4b72-8986-813c7b9fe4a6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72382) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 15:15:21 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: f780040f-b789-4b72-8986-813c7b9fe4a6] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 15:15:21 user nova-compute[72382]: DEBUG nova.virt.driver [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Emitting event <LifecycleEvent: 1691594121.4985797, f780040f-b789-4b72-8986-813c7b9fe4a6 => Started> {{(pid=72382) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 15:15:21 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: f780040f-b789-4b72-8986-813c7b9fe4a6] VM Started (Lifecycle Event)
Aug 09 15:15:21 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: f780040f-b789-4b72-8986-813c7b9fe4a6] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:15:21 user nova-compute[72382]: INFO nova.compute.manager [None req-8e2bee7f-ea21-4bef-a0fc-19a14939acd1 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] [instance: f780040f-b789-4b72-8986-813c7b9fe4a6] Took 12.91 seconds to spawn the instance on the hypervisor.
Aug 09 15:15:21 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8e2bee7f-ea21-4bef-a0fc-19a14939acd1 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] [instance: f780040f-b789-4b72-8986-813c7b9fe4a6] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:15:21 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: f780040f-b789-4b72-8986-813c7b9fe4a6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72382) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 15:15:21 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: f780040f-b789-4b72-8986-813c7b9fe4a6] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 15:15:21 user nova-compute[72382]: INFO nova.compute.manager [None req-8e2bee7f-ea21-4bef-a0fc-19a14939acd1 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] [instance: f780040f-b789-4b72-8986-813c7b9fe4a6] Took 13.94 seconds to build instance.
Aug 09 15:15:21 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-8e2bee7f-ea21-4bef-a0fc-19a14939acd1 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Lock "f780040f-b789-4b72-8986-813c7b9fe4a6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.180s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:15:22 user nova-compute[72382]: DEBUG nova.network.neutron [None req-48177f7f-2ba7-494f-8af2-3b8ef01c79c3 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] [instance: c9766433-4c5a-40ed-a212-715a24f42b91] Successfully created port: 599dae3b-13bb-47af-b889-0037e03d5e31 {{(pid=72382) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 15:15:22 user nova-compute[72382]: DEBUG nova.network.neutron [None req-f816da71-40e8-4952-90c2-f2c3ed3b228b tempest-ServersNegativeTestJSON-1671359082 tempest-ServersNegativeTestJSON-1671359082-project-member] [instance: 777e49ea-b674-4c3f-9cdd-ac2113032632] Successfully updated port: 80b78279-76f9-46c8-a54d-413116bc37c6 {{(pid=72382) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 15:15:22 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-f816da71-40e8-4952-90c2-f2c3ed3b228b tempest-ServersNegativeTestJSON-1671359082 tempest-ServersNegativeTestJSON-1671359082-project-member] Acquiring lock "refresh_cache-777e49ea-b674-4c3f-9cdd-ac2113032632" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 15:15:22 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-f816da71-40e8-4952-90c2-f2c3ed3b228b tempest-ServersNegativeTestJSON-1671359082 tempest-ServersNegativeTestJSON-1671359082-project-member] Acquired lock "refresh_cache-777e49ea-b674-4c3f-9cdd-ac2113032632" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 15:15:22 user nova-compute[72382]: DEBUG nova.network.neutron [None req-f816da71-40e8-4952-90c2-f2c3ed3b228b tempest-ServersNegativeTestJSON-1671359082 tempest-ServersNegativeTestJSON-1671359082-project-member] [instance: 777e49ea-b674-4c3f-9cdd-ac2113032632] Building network info cache for instance {{(pid=72382) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 15:15:23 user nova-compute[72382]: DEBUG nova.network.neutron [None req-f816da71-40e8-4952-90c2-f2c3ed3b228b tempest-ServersNegativeTestJSON-1671359082 tempest-ServersNegativeTestJSON-1671359082-project-member] [instance: 777e49ea-b674-4c3f-9cdd-ac2113032632] Instance cache missing network info. {{(pid=72382) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 15:15:23 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:15:23 user nova-compute[72382]: DEBUG nova.compute.manager [req-78d2c299-27e0-4c99-9545-315ded0b2d9e req-af49b9ed-397b-4426-9856-96f4d66d8eaf service nova] [instance: 777e49ea-b674-4c3f-9cdd-ac2113032632] Received event network-changed-80b78279-76f9-46c8-a54d-413116bc37c6 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:15:23 user nova-compute[72382]: DEBUG nova.compute.manager [req-78d2c299-27e0-4c99-9545-315ded0b2d9e req-af49b9ed-397b-4426-9856-96f4d66d8eaf service nova] [instance: 777e49ea-b674-4c3f-9cdd-ac2113032632] Refreshing instance network info cache due to event network-changed-80b78279-76f9-46c8-a54d-413116bc37c6. {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 15:15:23 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-78d2c299-27e0-4c99-9545-315ded0b2d9e req-af49b9ed-397b-4426-9856-96f4d66d8eaf service nova] Acquiring lock "refresh_cache-777e49ea-b674-4c3f-9cdd-ac2113032632" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 15:15:23 user nova-compute[72382]: DEBUG nova.compute.manager [req-1ef290fb-cfb9-44d0-a3d9-4d14c3631c0d req-1d01a8f2-1592-468e-b7b8-f854acf83663 service nova] [instance: f780040f-b789-4b72-8986-813c7b9fe4a6] Received event network-vif-plugged-3c9b6983-5682-4eaa-866c-1baf9f2ede26 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:15:23 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-1ef290fb-cfb9-44d0-a3d9-4d14c3631c0d req-1d01a8f2-1592-468e-b7b8-f854acf83663 service nova] Acquiring lock "f780040f-b789-4b72-8986-813c7b9fe4a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:15:23 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-1ef290fb-cfb9-44d0-a3d9-4d14c3631c0d req-1d01a8f2-1592-468e-b7b8-f854acf83663 service nova] Lock "f780040f-b789-4b72-8986-813c7b9fe4a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:15:23 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-1ef290fb-cfb9-44d0-a3d9-4d14c3631c0d req-1d01a8f2-1592-468e-b7b8-f854acf83663 service nova] Lock "f780040f-b789-4b72-8986-813c7b9fe4a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:15:23 user nova-compute[72382]: DEBUG nova.compute.manager [req-1ef290fb-cfb9-44d0-a3d9-4d14c3631c0d req-1d01a8f2-1592-468e-b7b8-f854acf83663 service nova] [instance: f780040f-b789-4b72-8986-813c7b9fe4a6] No waiting events found dispatching network-vif-plugged-3c9b6983-5682-4eaa-866c-1baf9f2ede26 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:15:23 user nova-compute[72382]: WARNING nova.compute.manager [req-1ef290fb-cfb9-44d0-a3d9-4d14c3631c0d req-1d01a8f2-1592-468e-b7b8-f854acf83663 service nova] [instance: f780040f-b789-4b72-8986-813c7b9fe4a6] Received unexpected event network-vif-plugged-3c9b6983-5682-4eaa-866c-1baf9f2ede26 for instance with vm_state active and task_state None.
Aug 09 15:15:23 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:15:24 user nova-compute[72382]: DEBUG nova.network.neutron [None req-16966d1a-588d-41b9-ae61-b46d67b5d3b8 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] [instance: 44afd1bf-fa5c-4b3e-8752-b16853fef54e] Successfully updated port: 2a1d4c60-bc2a-4530-b3bd-2a12ae2d2098 {{(pid=72382) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 15:15:24 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-16966d1a-588d-41b9-ae61-b46d67b5d3b8 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Acquiring lock "refresh_cache-44afd1bf-fa5c-4b3e-8752-b16853fef54e" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 15:15:24 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-16966d1a-588d-41b9-ae61-b46d67b5d3b8 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Acquired lock "refresh_cache-44afd1bf-fa5c-4b3e-8752-b16853fef54e" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 15:15:24 user nova-compute[72382]: DEBUG nova.network.neutron [None req-16966d1a-588d-41b9-ae61-b46d67b5d3b8 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] [instance: 44afd1bf-fa5c-4b3e-8752-b16853fef54e] Building network info cache for instance {{(pid=72382) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 15:15:24 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:15:24 user nova-compute[72382]: DEBUG nova.network.neutron [None req-16966d1a-588d-41b9-ae61-b46d67b5d3b8 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] [instance: 44afd1bf-fa5c-4b3e-8752-b16853fef54e] Instance cache missing network info. {{(pid=72382) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 15:15:24 user nova-compute[72382]: DEBUG nova.network.neutron [None req-48177f7f-2ba7-494f-8af2-3b8ef01c79c3 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] [instance: c9766433-4c5a-40ed-a212-715a24f42b91] Successfully updated port: 599dae3b-13bb-47af-b889-0037e03d5e31 {{(pid=72382) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 15:15:24 user nova-compute[72382]: DEBUG nova.network.neutron [None req-f816da71-40e8-4952-90c2-f2c3ed3b228b tempest-ServersNegativeTestJSON-1671359082 tempest-ServersNegativeTestJSON-1671359082-project-member] [instance: 777e49ea-b674-4c3f-9cdd-ac2113032632] Updating instance_info_cache with network_info: [{"id": "80b78279-76f9-46c8-a54d-413116bc37c6", "address": "fa:16:3e:37:26:34", "network": {"id": "32d8bb03-1dc6-499b-8b79-48938664dd3b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1565950502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8995b21c93c24ab19fcfad5c4939509f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80b78279-76", "ovs_interfaceid": "80b78279-76f9-46c8-a54d-413116bc37c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:15:24 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-48177f7f-2ba7-494f-8af2-3b8ef01c79c3 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Acquiring lock "refresh_cache-c9766433-4c5a-40ed-a212-715a24f42b91" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 15:15:24 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-48177f7f-2ba7-494f-8af2-3b8ef01c79c3 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Acquired lock "refresh_cache-c9766433-4c5a-40ed-a212-715a24f42b91" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 15:15:24 user nova-compute[72382]: DEBUG nova.network.neutron [None req-48177f7f-2ba7-494f-8af2-3b8ef01c79c3 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] [instance: c9766433-4c5a-40ed-a212-715a24f42b91] Building network info cache for instance {{(pid=72382) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 15:15:24 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-f816da71-40e8-4952-90c2-f2c3ed3b228b tempest-ServersNegativeTestJSON-1671359082 tempest-ServersNegativeTestJSON-1671359082-project-member] Releasing lock "refresh_cache-777e49ea-b674-4c3f-9cdd-ac2113032632" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 15:15:24 user nova-compute[72382]: DEBUG nova.compute.manager [None req-f816da71-40e8-4952-90c2-f2c3ed3b228b tempest-ServersNegativeTestJSON-1671359082 tempest-ServersNegativeTestJSON-1671359082-project-member] [instance: 777e49ea-b674-4c3f-9cdd-ac2113032632] Instance network_info: |[{"id": "80b78279-76f9-46c8-a54d-413116bc37c6", "address": "fa:16:3e:37:26:34", "network": {"id": "32d8bb03-1dc6-499b-8b79-48938664dd3b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1565950502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8995b21c93c24ab19fcfad5c4939509f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80b78279-76", "ovs_interfaceid": "80b78279-76f9-46c8-a54d-413116bc37c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72382) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 15:15:24 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-78d2c299-27e0-4c99-9545-315ded0b2d9e req-af49b9ed-397b-4426-9856-96f4d66d8eaf service nova] Acquired lock "refresh_cache-777e49ea-b674-4c3f-9cdd-ac2113032632" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 15:15:24 user nova-compute[72382]: DEBUG nova.network.neutron [req-78d2c299-27e0-4c99-9545-315ded0b2d9e req-af49b9ed-397b-4426-9856-96f4d66d8eaf service nova] [instance: 777e49ea-b674-4c3f-9cdd-ac2113032632] Refreshing network info cache for port 80b78279-76f9-46c8-a54d-413116bc37c6 {{(pid=72382) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 15:15:24 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-f816da71-40e8-4952-90c2-f2c3ed3b228b tempest-ServersNegativeTestJSON-1671359082 tempest-ServersNegativeTestJSON-1671359082-project-member] [instance: 777e49ea-b674-4c3f-9cdd-ac2113032632] Start _get_guest_xml network_info=[{"id": "80b78279-76f9-46c8-a54d-413116bc37c6", "address": "fa:16:3e:37:26:34", "network": {"id": "32d8bb03-1dc6-499b-8b79-48938664dd3b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1565950502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8995b21c93c24ab19fcfad5c4939509f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80b78279-76", "ovs_interfaceid": "80b78279-76f9-46c8-a54d-413116bc37c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T15:11:25Z,direct_url=<?>,disk_format='qcow2',id=a79f2cea-eb27-4631-aaf3-05e7d9e411b4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a638990e12cc4d6eabb6d55e13be6bdf',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T15:11:27Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'a79f2cea-eb27-4631-aaf3-05e7d9e411b4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72382) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 15:15:24 user nova-compute[72382]: WARNING nova.virt.libvirt.driver [None req-f816da71-40e8-4952-90c2-f2c3ed3b228b tempest-ServersNegativeTestJSON-1671359082 tempest-ServersNegativeTestJSON-1671359082-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 15:15:24 user nova-compute[72382]: WARNING nova.virt.libvirt.driver [None req-f816da71-40e8-4952-90c2-f2c3ed3b228b tempest-ServersNegativeTestJSON-1671359082 tempest-ServersNegativeTestJSON-1671359082-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 15:15:24 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-f816da71-40e8-4952-90c2-f2c3ed3b228b tempest-ServersNegativeTestJSON-1671359082 tempest-ServersNegativeTestJSON-1671359082-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72382) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 15:15:24 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-f816da71-40e8-4952-90c2-f2c3ed3b228b tempest-ServersNegativeTestJSON-1671359082 tempest-ServersNegativeTestJSON-1671359082-project-member] CPU controller missing on host. {{(pid=72382) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 15:15:24 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-f816da71-40e8-4952-90c2-f2c3ed3b228b tempest-ServersNegativeTestJSON-1671359082 tempest-ServersNegativeTestJSON-1671359082-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72382) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 15:15:24 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-f816da71-40e8-4952-90c2-f2c3ed3b228b tempest-ServersNegativeTestJSON-1671359082 tempest-ServersNegativeTestJSON-1671359082-project-member] CPU controller found on host. {{(pid=72382) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 15:15:24 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-f816da71-40e8-4952-90c2-f2c3ed3b228b tempest-ServersNegativeTestJSON-1671359082 tempest-ServersNegativeTestJSON-1671359082-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72382) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 15:15:24 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-f816da71-40e8-4952-90c2-f2c3ed3b228b tempest-ServersNegativeTestJSON-1671359082 tempest-ServersNegativeTestJSON-1671359082-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T15:11:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T15:11:25Z,direct_url=<?>,disk_format='qcow2',id=a79f2cea-eb27-4631-aaf3-05e7d9e411b4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a638990e12cc4d6eabb6d55e13be6bdf',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T15:11:27Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 15:15:24 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-f816da71-40e8-4952-90c2-f2c3ed3b228b tempest-ServersNegativeTestJSON-1671359082 tempest-ServersNegativeTestJSON-1671359082-project-member] Flavor limits 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 15:15:24 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-f816da71-40e8-4952-90c2-f2c3ed3b228b tempest-ServersNegativeTestJSON-1671359082 tempest-ServersNegativeTestJSON-1671359082-project-member] Image limits 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 15:15:24 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-f816da71-40e8-4952-90c2-f2c3ed3b228b tempest-ServersNegativeTestJSON-1671359082 tempest-ServersNegativeTestJSON-1671359082-project-member] Flavor pref 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 15:15:24 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-f816da71-40e8-4952-90c2-f2c3ed3b228b tempest-ServersNegativeTestJSON-1671359082 tempest-ServersNegativeTestJSON-1671359082-project-member] Image pref 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 15:15:24 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-f816da71-40e8-4952-90c2-f2c3ed3b228b tempest-ServersNegativeTestJSON-1671359082 tempest-ServersNegativeTestJSON-1671359082-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 15:15:24 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-f816da71-40e8-4952-90c2-f2c3ed3b228b tempest-ServersNegativeTestJSON-1671359082 tempest-ServersNegativeTestJSON-1671359082-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 15:15:24 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-f816da71-40e8-4952-90c2-f2c3ed3b228b tempest-ServersNegativeTestJSON-1671359082 tempest-ServersNegativeTestJSON-1671359082-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72382) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 15:15:24 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-f816da71-40e8-4952-90c2-f2c3ed3b228b tempest-ServersNegativeTestJSON-1671359082 tempest-ServersNegativeTestJSON-1671359082-project-member] Got 1 possible topologies {{(pid=72382) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 15:15:24 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-f816da71-40e8-4952-90c2-f2c3ed3b228b tempest-ServersNegativeTestJSON-1671359082 tempest-ServersNegativeTestJSON-1671359082-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 15:15:24 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-f816da71-40e8-4952-90c2-f2c3ed3b228b tempest-ServersNegativeTestJSON-1671359082 tempest-ServersNegativeTestJSON-1671359082-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 15:15:24 user nova-compute[72382]: DEBUG nova.virt.libvirt.vif [None req-f816da71-40e8-4952-90c2-f2c3ed3b228b tempest-ServersNegativeTestJSON-1671359082 tempest-ServersNegativeTestJSON-1671359082-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T15:15:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1344356585',display_name='tempest-ServersNegativeTestJSON-server-1344356585',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1344356585',id=2,image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8995b21c93c24ab19fcfad5c4939509f',ramdisk_id='',reservation_id='r-6l53mf74',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1671359082',owner_user_name='tempest-ServersNegativeTestJSON-1671359082-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T15:15:13Z,user_data=None,user_id='5e4b3ed6be8f4c99ba979398388bf12d',uuid=777e49ea-b674-4c3f-9cdd-ac2113032632,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "80b78279-76f9-46c8-a54d-413116bc37c6", "address": "fa:16:3e:37:26:34", "network": {"id": "32d8bb03-1dc6-499b-8b79-48938664dd3b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1565950502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8995b21c93c24ab19fcfad5c4939509f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80b78279-76", "ovs_interfaceid": "80b78279-76f9-46c8-a54d-413116bc37c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72382) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 15:15:24 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-f816da71-40e8-4952-90c2-f2c3ed3b228b tempest-ServersNegativeTestJSON-1671359082 tempest-ServersNegativeTestJSON-1671359082-project-member] Converting VIF {"id": "80b78279-76f9-46c8-a54d-413116bc37c6", "address": "fa:16:3e:37:26:34", "network": {"id": "32d8bb03-1dc6-499b-8b79-48938664dd3b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1565950502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8995b21c93c24ab19fcfad5c4939509f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80b78279-76", "ovs_interfaceid": "80b78279-76f9-46c8-a54d-413116bc37c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 15:15:24 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-f816da71-40e8-4952-90c2-f2c3ed3b228b tempest-ServersNegativeTestJSON-1671359082 tempest-ServersNegativeTestJSON-1671359082-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:37:26:34,bridge_name='br-int',has_traffic_filtering=True,id=80b78279-76f9-46c8-a54d-413116bc37c6,network=Network(32d8bb03-1dc6-499b-8b79-48938664dd3b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80b78279-76') {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 15:15:24 user nova-compute[72382]: DEBUG nova.objects.instance [None req-f816da71-40e8-4952-90c2-f2c3ed3b228b tempest-ServersNegativeTestJSON-1671359082 tempest-ServersNegativeTestJSON-1671359082-project-member] Lazy-loading 'pci_devices' on Instance uuid 777e49ea-b674-4c3f-9cdd-ac2113032632 {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:15:25 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-f816da71-40e8-4952-90c2-f2c3ed3b228b tempest-ServersNegativeTestJSON-1671359082 tempest-ServersNegativeTestJSON-1671359082-project-member] [instance: 777e49ea-b674-4c3f-9cdd-ac2113032632] End _get_guest_xml xml=<domain type="kvm">
Aug 09 15:15:25 user nova-compute[72382]:   <uuid>777e49ea-b674-4c3f-9cdd-ac2113032632</uuid>
Aug 09 15:15:25 user nova-compute[72382]:   <name>instance-00000002</name>
Aug 09 15:15:25 user nova-compute[72382]:   <memory>524288</memory>
Aug 09 15:15:25 user nova-compute[72382]:   <vcpu>1</vcpu>
Aug 09 15:15:25 user nova-compute[72382]:   <metadata>
Aug 09 15:15:25 user nova-compute[72382]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 15:15:25 user nova-compute[72382]:       <nova:package version="0.0.0"/>
Aug 09 15:15:25 user nova-compute[72382]:       <nova:name>tempest-ServersNegativeTestJSON-server-1344356585</nova:name>
Aug 09 15:15:25 user nova-compute[72382]:       <nova:creationTime>2023-08-09 15:15:24</nova:creationTime>
Aug 09 15:15:25 user nova-compute[72382]:       <nova:flavor name="m1.tiny">
Aug 09 15:15:25 user nova-compute[72382]:         <nova:memory>512</nova:memory>
Aug 09 15:15:25 user nova-compute[72382]:         <nova:disk>1</nova:disk>
Aug 09 15:15:25 user nova-compute[72382]:         <nova:swap>0</nova:swap>
Aug 09 15:15:25 user nova-compute[72382]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 15:15:25 user nova-compute[72382]:         <nova:vcpus>1</nova:vcpus>
Aug 09 15:15:25 user nova-compute[72382]:       </nova:flavor>
Aug 09 15:15:25 user nova-compute[72382]:       <nova:owner>
Aug 09 15:15:25 user nova-compute[72382]:         <nova:user uuid="5e4b3ed6be8f4c99ba979398388bf12d">tempest-ServersNegativeTestJSON-1671359082-project-member</nova:user>
Aug 09 15:15:25 user nova-compute[72382]:         <nova:project uuid="8995b21c93c24ab19fcfad5c4939509f">tempest-ServersNegativeTestJSON-1671359082</nova:project>
Aug 09 15:15:25 user nova-compute[72382]:       </nova:owner>
Aug 09 15:15:25 user nova-compute[72382]:       <nova:root type="image" uuid="a79f2cea-eb27-4631-aaf3-05e7d9e411b4"/>
Aug 09 15:15:25 user nova-compute[72382]:       <nova:ports>
Aug 09 15:15:25 user nova-compute[72382]:         <nova:port uuid="80b78279-76f9-46c8-a54d-413116bc37c6">
Aug 09 15:15:25 user nova-compute[72382]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 09 15:15:25 user nova-compute[72382]:         </nova:port>
Aug 09 15:15:25 user nova-compute[72382]:       </nova:ports>
Aug 09 15:15:25 user nova-compute[72382]:     </nova:instance>
Aug 09 15:15:25 user nova-compute[72382]:   </metadata>
Aug 09 15:15:25 user nova-compute[72382]:   <sysinfo type="smbios">
Aug 09 15:15:25 user nova-compute[72382]:     <system>
Aug 09 15:15:25 user nova-compute[72382]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 15:15:25 user nova-compute[72382]:       <entry name="product">OpenStack Nova</entry>
Aug 09 15:15:25 user nova-compute[72382]:       <entry name="version">0.0.0</entry>
Aug 09 15:15:25 user nova-compute[72382]:       <entry name="serial">777e49ea-b674-4c3f-9cdd-ac2113032632</entry>
Aug 09 15:15:25 user nova-compute[72382]:       <entry name="uuid">777e49ea-b674-4c3f-9cdd-ac2113032632</entry>
Aug 09 15:15:25 user nova-compute[72382]:       <entry name="family">Virtual Machine</entry>
Aug 09 15:15:25 user nova-compute[72382]:     </system>
Aug 09 15:15:25 user nova-compute[72382]:   </sysinfo>
Aug 09 15:15:25 user nova-compute[72382]:   <os>
Aug 09 15:15:25 user nova-compute[72382]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 15:15:25 user nova-compute[72382]:     <boot dev="hd"/>
Aug 09 15:15:25 user nova-compute[72382]:     <smbios mode="sysinfo"/>
Aug 09 15:15:25 user nova-compute[72382]:   </os>
Aug 09 15:15:25 user nova-compute[72382]:   <features>
Aug 09 15:15:25 user nova-compute[72382]:     <acpi/>
Aug 09 15:15:25 user nova-compute[72382]:     <apic/>
Aug 09 15:15:25 user nova-compute[72382]:     <vmcoreinfo/>
Aug 09 15:15:25 user nova-compute[72382]:   </features>
Aug 09 15:15:25 user nova-compute[72382]:   <clock offset="utc">
Aug 09 15:15:25 user nova-compute[72382]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 15:15:25 user nova-compute[72382]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 15:15:25 user nova-compute[72382]:     <timer name="hpet" present="no"/>
Aug 09 15:15:25 user nova-compute[72382]:   </clock>
Aug 09 15:15:25 user nova-compute[72382]:   <cpu mode="custom" match="exact">
Aug 09 15:15:25 user nova-compute[72382]:     <model>Nehalem</model>
Aug 09 15:15:25 user nova-compute[72382]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 15:15:25 user nova-compute[72382]:   </cpu>
Aug 09 15:15:25 user nova-compute[72382]:   <devices>
Aug 09 15:15:25 user nova-compute[72382]:     <disk type="file" device="disk">
Aug 09 15:15:25 user nova-compute[72382]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 15:15:25 user nova-compute[72382]:       <source file="/opt/stack/data/nova/instances/777e49ea-b674-4c3f-9cdd-ac2113032632/disk"/>
Aug 09 15:15:25 user nova-compute[72382]:       <target dev="vda" bus="virtio"/>
Aug 09 15:15:25 user nova-compute[72382]:     </disk>
Aug 09 15:15:25 user nova-compute[72382]:     <interface type="ethernet">
Aug 09 15:15:25 user nova-compute[72382]:       <mac address="fa:16:3e:37:26:34"/>
Aug 09 15:15:25 user nova-compute[72382]:       <model type="virtio"/>
Aug 09 15:15:25 user nova-compute[72382]:       <mtu size="1442"/>
Aug 09 15:15:25 user nova-compute[72382]:       <target dev="tap80b78279-76"/>
Aug 09 15:15:25 user nova-compute[72382]:     </interface>
Aug 09 15:15:25 user nova-compute[72382]:     <serial type="pty">
Aug 09 15:15:25 user nova-compute[72382]:       <log file="/opt/stack/data/nova/instances/777e49ea-b674-4c3f-9cdd-ac2113032632/console.log" append="off"/>
Aug 09 15:15:25 user nova-compute[72382]:     </serial>
Aug 09 15:15:25 user nova-compute[72382]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 15:15:25 user nova-compute[72382]:     <video>
Aug 09 15:15:25 user nova-compute[72382]:       <model type="virtio"/>
Aug 09 15:15:25 user nova-compute[72382]:     </video>
Aug 09 15:15:25 user nova-compute[72382]:     <rng model="virtio">
Aug 09 15:15:25 user nova-compute[72382]:       <backend model="random">/dev/urandom</backend>
Aug 09 15:15:25 user nova-compute[72382]:     </rng>
Aug 09 15:15:25 user nova-compute[72382]:     <controller type="usb" index="0" model="none"/>
Aug 09 15:15:25 user nova-compute[72382]:     <memballoon model="virtio">
Aug 09 15:15:25 user nova-compute[72382]:       <stats period="10"/>
Aug 09 15:15:25 user nova-compute[72382]:     </memballoon>
Aug 09 15:15:25 user nova-compute[72382]:   </devices>
Aug 09 15:15:25 user nova-compute[72382]: </domain>
Aug 09 15:15:25 user nova-compute[72382]:  {{(pid=72382) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 15:15:25 user nova-compute[72382]: DEBUG nova.virt.libvirt.vif [None req-f816da71-40e8-4952-90c2-f2c3ed3b228b tempest-ServersNegativeTestJSON-1671359082 tempest-ServersNegativeTestJSON-1671359082-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T15:15:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1344356585',display_name='tempest-ServersNegativeTestJSON-server-1344356585',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1344356585',id=2,image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8995b21c93c24ab19fcfad5c4939509f',ramdisk_id='',reservation_id='r-6l53mf74',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1671359082',owner_user_name='tempest-ServersNegativeTestJSON-1671359082-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T15:15:13Z,user_data=None,user_id='5e4b3ed6be8f4c99ba979398388bf12d',uuid=777e49ea-b674-4c3f-9cdd-ac2113032632,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "80b78279-76f9-46c8-a54d-413116bc37c6", "address": "fa:16:3e:37:26:34", "network": {"id": "32d8bb03-1dc6-499b-8b79-48938664dd3b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1565950502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8995b21c93c24ab19fcfad5c4939509f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80b78279-76", "ovs_interfaceid": "80b78279-76f9-46c8-a54d-413116bc37c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 15:15:25 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-f816da71-40e8-4952-90c2-f2c3ed3b228b tempest-ServersNegativeTestJSON-1671359082 tempest-ServersNegativeTestJSON-1671359082-project-member] Converting VIF {"id": "80b78279-76f9-46c8-a54d-413116bc37c6", "address": "fa:16:3e:37:26:34", "network": {"id": "32d8bb03-1dc6-499b-8b79-48938664dd3b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1565950502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8995b21c93c24ab19fcfad5c4939509f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80b78279-76", "ovs_interfaceid": "80b78279-76f9-46c8-a54d-413116bc37c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 15:15:25 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-f816da71-40e8-4952-90c2-f2c3ed3b228b tempest-ServersNegativeTestJSON-1671359082 tempest-ServersNegativeTestJSON-1671359082-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:37:26:34,bridge_name='br-int',has_traffic_filtering=True,id=80b78279-76f9-46c8-a54d-413116bc37c6,network=Network(32d8bb03-1dc6-499b-8b79-48938664dd3b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80b78279-76') {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 15:15:25 user nova-compute[72382]: DEBUG os_vif [None req-f816da71-40e8-4952-90c2-f2c3ed3b228b tempest-ServersNegativeTestJSON-1671359082 tempest-ServersNegativeTestJSON-1671359082-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:37:26:34,bridge_name='br-int',has_traffic_filtering=True,id=80b78279-76f9-46c8-a54d-413116bc37c6,network=Network(32d8bb03-1dc6-499b-8b79-48938664dd3b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80b78279-76') {{(pid=72382) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 15:15:25 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:15:25 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:15:25 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 15:15:25 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:15:25 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap80b78279-76, may_exist=True, interface_attrs={}) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:15:25 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap80b78279-76, col_values=(('external_ids', {'iface-id': '80b78279-76f9-46c8-a54d-413116bc37c6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:37:26:34', 'vm-uuid': '777e49ea-b674-4c3f-9cdd-ac2113032632'}),), if_exists=True) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:15:25 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:15:25 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:15:25 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:15:25 user nova-compute[72382]: INFO os_vif [None req-f816da71-40e8-4952-90c2-f2c3ed3b228b tempest-ServersNegativeTestJSON-1671359082 tempest-ServersNegativeTestJSON-1671359082-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:37:26:34,bridge_name='br-int',has_traffic_filtering=True,id=80b78279-76f9-46c8-a54d-413116bc37c6,network=Network(32d8bb03-1dc6-499b-8b79-48938664dd3b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80b78279-76')
Aug 09 15:15:25 user nova-compute[72382]: DEBUG nova.network.neutron [None req-48177f7f-2ba7-494f-8af2-3b8ef01c79c3 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] [instance: c9766433-4c5a-40ed-a212-715a24f42b91] Instance cache missing network info. {{(pid=72382) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 15:15:25 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-f816da71-40e8-4952-90c2-f2c3ed3b228b tempest-ServersNegativeTestJSON-1671359082 tempest-ServersNegativeTestJSON-1671359082-project-member] No BDM found with device name vda, not building metadata. {{(pid=72382) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 15:15:25 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-f816da71-40e8-4952-90c2-f2c3ed3b228b tempest-ServersNegativeTestJSON-1671359082 tempest-ServersNegativeTestJSON-1671359082-project-member] No VIF found with MAC fa:16:3e:37:26:34, not building metadata {{(pid=72382) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 15:15:25 user nova-compute[72382]: DEBUG nova.compute.manager [req-0103d393-643a-4183-8041-19b237766266 req-994b929a-9134-48c3-a81e-ef7420208588 service nova] [instance: c9766433-4c5a-40ed-a212-715a24f42b91] Received event network-changed-599dae3b-13bb-47af-b889-0037e03d5e31 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:15:25 user nova-compute[72382]: DEBUG nova.compute.manager [req-0103d393-643a-4183-8041-19b237766266 req-994b929a-9134-48c3-a81e-ef7420208588 service nova] [instance: c9766433-4c5a-40ed-a212-715a24f42b91] Refreshing instance network info cache due to event network-changed-599dae3b-13bb-47af-b889-0037e03d5e31. {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 15:15:25 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-0103d393-643a-4183-8041-19b237766266 req-994b929a-9134-48c3-a81e-ef7420208588 service nova] Acquiring lock "refresh_cache-c9766433-4c5a-40ed-a212-715a24f42b91" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 15:15:25 user nova-compute[72382]: DEBUG nova.compute.manager [req-b1aee14e-0ab5-4f26-a673-4e656ae1e39b req-75bea069-36ff-431d-b6a2-776dbb7a45f0 service nova] [instance: 44afd1bf-fa5c-4b3e-8752-b16853fef54e] Received event network-changed-2a1d4c60-bc2a-4530-b3bd-2a12ae2d2098 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:15:25 user nova-compute[72382]: DEBUG nova.compute.manager [req-b1aee14e-0ab5-4f26-a673-4e656ae1e39b req-75bea069-36ff-431d-b6a2-776dbb7a45f0 service nova] [instance: 44afd1bf-fa5c-4b3e-8752-b16853fef54e] Refreshing instance network info cache due to event network-changed-2a1d4c60-bc2a-4530-b3bd-2a12ae2d2098. {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 15:15:25 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-b1aee14e-0ab5-4f26-a673-4e656ae1e39b req-75bea069-36ff-431d-b6a2-776dbb7a45f0 service nova] Acquiring lock "refresh_cache-44afd1bf-fa5c-4b3e-8752-b16853fef54e" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 15:15:25 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:15:26 user nova-compute[72382]: DEBUG nova.network.neutron [None req-bd0bf5c4-b736-4591-85ca-5fff7abbf4d1 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] [instance: 266be814-4a2b-4f8e-a0f6-e8821fdeb95d] Successfully updated port: 48650c01-c5a9-44f2-a481-5120c429a5a5 {{(pid=72382) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 15:15:26 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-bd0bf5c4-b736-4591-85ca-5fff7abbf4d1 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Acquiring lock "refresh_cache-266be814-4a2b-4f8e-a0f6-e8821fdeb95d" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 15:15:26 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-bd0bf5c4-b736-4591-85ca-5fff7abbf4d1 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Acquired lock "refresh_cache-266be814-4a2b-4f8e-a0f6-e8821fdeb95d" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 15:15:26 user nova-compute[72382]: DEBUG nova.network.neutron [None req-bd0bf5c4-b736-4591-85ca-5fff7abbf4d1 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] [instance: 266be814-4a2b-4f8e-a0f6-e8821fdeb95d] Building network info cache for instance {{(pid=72382) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 15:15:26 user nova-compute[72382]: DEBUG nova.network.neutron [req-78d2c299-27e0-4c99-9545-315ded0b2d9e req-af49b9ed-397b-4426-9856-96f4d66d8eaf service nova] [instance: 777e49ea-b674-4c3f-9cdd-ac2113032632] Updated VIF entry in instance network info cache for port 80b78279-76f9-46c8-a54d-413116bc37c6. {{(pid=72382) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 15:15:26 user nova-compute[72382]: DEBUG nova.network.neutron [req-78d2c299-27e0-4c99-9545-315ded0b2d9e req-af49b9ed-397b-4426-9856-96f4d66d8eaf service nova] [instance: 777e49ea-b674-4c3f-9cdd-ac2113032632] Updating instance_info_cache with network_info: [{"id": "80b78279-76f9-46c8-a54d-413116bc37c6", "address": "fa:16:3e:37:26:34", "network": {"id": "32d8bb03-1dc6-499b-8b79-48938664dd3b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1565950502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8995b21c93c24ab19fcfad5c4939509f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80b78279-76", "ovs_interfaceid": "80b78279-76f9-46c8-a54d-413116bc37c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:15:26 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-78d2c299-27e0-4c99-9545-315ded0b2d9e req-af49b9ed-397b-4426-9856-96f4d66d8eaf service nova] Releasing lock "refresh_cache-777e49ea-b674-4c3f-9cdd-ac2113032632" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 15:15:26 user nova-compute[72382]: DEBUG nova.network.neutron [None req-bd0bf5c4-b736-4591-85ca-5fff7abbf4d1 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] [instance: 266be814-4a2b-4f8e-a0f6-e8821fdeb95d] Instance cache missing network info. {{(pid=72382) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 15:15:26 user nova-compute[72382]: DEBUG nova.network.neutron [None req-16966d1a-588d-41b9-ae61-b46d67b5d3b8 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] [instance: 44afd1bf-fa5c-4b3e-8752-b16853fef54e] Updating instance_info_cache with network_info: [{"id": "2a1d4c60-bc2a-4530-b3bd-2a12ae2d2098", "address": "fa:16:3e:6c:50:29", "network": {"id": "46ef00c7-17ee-4e45-ba1d-dcc0a417ea85", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1360012261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "990ba791030940d38360af5879c853c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a1d4c60-bc", "ovs_interfaceid": "2a1d4c60-bc2a-4530-b3bd-2a12ae2d2098", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:15:26 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-16966d1a-588d-41b9-ae61-b46d67b5d3b8 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Releasing lock "refresh_cache-44afd1bf-fa5c-4b3e-8752-b16853fef54e" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 15:15:26 user nova-compute[72382]: DEBUG nova.compute.manager [None req-16966d1a-588d-41b9-ae61-b46d67b5d3b8 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] [instance: 44afd1bf-fa5c-4b3e-8752-b16853fef54e] Instance network_info: |[{"id": "2a1d4c60-bc2a-4530-b3bd-2a12ae2d2098", "address": "fa:16:3e:6c:50:29", "network": {"id": "46ef00c7-17ee-4e45-ba1d-dcc0a417ea85", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1360012261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "990ba791030940d38360af5879c853c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a1d4c60-bc", "ovs_interfaceid": "2a1d4c60-bc2a-4530-b3bd-2a12ae2d2098", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72382) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 15:15:26 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-b1aee14e-0ab5-4f26-a673-4e656ae1e39b req-75bea069-36ff-431d-b6a2-776dbb7a45f0 service nova] Acquired lock "refresh_cache-44afd1bf-fa5c-4b3e-8752-b16853fef54e" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 15:15:26 user nova-compute[72382]: DEBUG nova.network.neutron [req-b1aee14e-0ab5-4f26-a673-4e656ae1e39b req-75bea069-36ff-431d-b6a2-776dbb7a45f0 service nova] [instance: 44afd1bf-fa5c-4b3e-8752-b16853fef54e] Refreshing network info cache for port 2a1d4c60-bc2a-4530-b3bd-2a12ae2d2098 {{(pid=72382) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 15:15:26 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-16966d1a-588d-41b9-ae61-b46d67b5d3b8 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] [instance: 44afd1bf-fa5c-4b3e-8752-b16853fef54e] Start _get_guest_xml network_info=[{"id": "2a1d4c60-bc2a-4530-b3bd-2a12ae2d2098", "address": "fa:16:3e:6c:50:29", "network": {"id": "46ef00c7-17ee-4e45-ba1d-dcc0a417ea85", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1360012261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "990ba791030940d38360af5879c853c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a1d4c60-bc", "ovs_interfaceid": "2a1d4c60-bc2a-4530-b3bd-2a12ae2d2098", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T15:11:25Z,direct_url=<?>,disk_format='qcow2',id=a79f2cea-eb27-4631-aaf3-05e7d9e411b4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a638990e12cc4d6eabb6d55e13be6bdf',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T15:11:27Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'a79f2cea-eb27-4631-aaf3-05e7d9e411b4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72382) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 15:15:26 user nova-compute[72382]: WARNING nova.virt.libvirt.driver [None req-16966d1a-588d-41b9-ae61-b46d67b5d3b8 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 15:15:26 user nova-compute[72382]: WARNING nova.virt.libvirt.driver [None req-16966d1a-588d-41b9-ae61-b46d67b5d3b8 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 15:15:26 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-16966d1a-588d-41b9-ae61-b46d67b5d3b8 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72382) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 15:15:26 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-16966d1a-588d-41b9-ae61-b46d67b5d3b8 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] CPU controller missing on host. {{(pid=72382) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 15:15:26 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-16966d1a-588d-41b9-ae61-b46d67b5d3b8 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72382) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 15:15:26 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-16966d1a-588d-41b9-ae61-b46d67b5d3b8 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] CPU controller found on host. {{(pid=72382) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 15:15:26 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-16966d1a-588d-41b9-ae61-b46d67b5d3b8 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72382) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 15:15:26 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-16966d1a-588d-41b9-ae61-b46d67b5d3b8 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T15:11:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T15:11:25Z,direct_url=<?>,disk_format='qcow2',id=a79f2cea-eb27-4631-aaf3-05e7d9e411b4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a638990e12cc4d6eabb6d55e13be6bdf',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T15:11:27Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 15:15:26 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-16966d1a-588d-41b9-ae61-b46d67b5d3b8 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Flavor limits 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 15:15:26 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-16966d1a-588d-41b9-ae61-b46d67b5d3b8 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Image limits 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 15:15:26 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-16966d1a-588d-41b9-ae61-b46d67b5d3b8 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Flavor pref 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 15:15:26 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-16966d1a-588d-41b9-ae61-b46d67b5d3b8 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Image pref 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 15:15:26 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-16966d1a-588d-41b9-ae61-b46d67b5d3b8 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 15:15:26 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-16966d1a-588d-41b9-ae61-b46d67b5d3b8 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 15:15:26 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-16966d1a-588d-41b9-ae61-b46d67b5d3b8 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72382) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 15:15:26 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-16966d1a-588d-41b9-ae61-b46d67b5d3b8 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Got 1 possible topologies {{(pid=72382) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 15:15:26 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-16966d1a-588d-41b9-ae61-b46d67b5d3b8 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 15:15:26 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-16966d1a-588d-41b9-ae61-b46d67b5d3b8 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 15:15:26 user nova-compute[72382]: DEBUG nova.virt.libvirt.vif [None req-16966d1a-588d-41b9-ae61-b46d67b5d3b8 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T15:15:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-201849157',display_name='tempest-ServerRescueNegativeTestJSON-server-201849157',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-201849157',id=3,image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='990ba791030940d38360af5879c853c5',ramdisk_id='',reservation_id='r-fqm5h5sw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-867522113',owner_user_name='tempest-ServerRescueNegativeTestJSON-867522113-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T15:15:14Z,user_data=None,user_id='f94ca386a2be42cfbc2407bb7520cd25',uuid=44afd1bf-fa5c-4b3e-8752-b16853fef54e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2a1d4c60-bc2a-4530-b3bd-2a12ae2d2098", "address": "fa:16:3e:6c:50:29", "network": {"id": "46ef00c7-17ee-4e45-ba1d-dcc0a417ea85", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1360012261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "990ba791030940d38360af5879c853c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a1d4c60-bc", "ovs_interfaceid": "2a1d4c60-bc2a-4530-b3bd-2a12ae2d2098", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72382) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 15:15:26 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-16966d1a-588d-41b9-ae61-b46d67b5d3b8 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Converting VIF {"id": "2a1d4c60-bc2a-4530-b3bd-2a12ae2d2098", "address": "fa:16:3e:6c:50:29", "network": {"id": "46ef00c7-17ee-4e45-ba1d-dcc0a417ea85", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1360012261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "990ba791030940d38360af5879c853c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a1d4c60-bc", "ovs_interfaceid": "2a1d4c60-bc2a-4530-b3bd-2a12ae2d2098", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 15:15:26 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-16966d1a-588d-41b9-ae61-b46d67b5d3b8 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6c:50:29,bridge_name='br-int',has_traffic_filtering=True,id=2a1d4c60-bc2a-4530-b3bd-2a12ae2d2098,network=Network(46ef00c7-17ee-4e45-ba1d-dcc0a417ea85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a1d4c60-bc') {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 15:15:26 user nova-compute[72382]: DEBUG nova.objects.instance [None req-16966d1a-588d-41b9-ae61-b46d67b5d3b8 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Lazy-loading 'pci_devices' on Instance uuid 44afd1bf-fa5c-4b3e-8752-b16853fef54e {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:15:26 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-16966d1a-588d-41b9-ae61-b46d67b5d3b8 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] [instance: 44afd1bf-fa5c-4b3e-8752-b16853fef54e] End _get_guest_xml xml=<domain type="kvm">
Aug 09 15:15:26 user nova-compute[72382]:   <uuid>44afd1bf-fa5c-4b3e-8752-b16853fef54e</uuid>
Aug 09 15:15:26 user nova-compute[72382]:   <name>instance-00000003</name>
Aug 09 15:15:26 user nova-compute[72382]:   <memory>524288</memory>
Aug 09 15:15:26 user nova-compute[72382]:   <vcpu>1</vcpu>
Aug 09 15:15:26 user nova-compute[72382]:   <metadata>
Aug 09 15:15:26 user nova-compute[72382]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 15:15:26 user nova-compute[72382]:       <nova:package version="0.0.0"/>
Aug 09 15:15:26 user nova-compute[72382]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-201849157</nova:name>
Aug 09 15:15:26 user nova-compute[72382]:       <nova:creationTime>2023-08-09 15:15:26</nova:creationTime>
Aug 09 15:15:26 user nova-compute[72382]:       <nova:flavor name="m1.tiny">
Aug 09 15:15:26 user nova-compute[72382]:         <nova:memory>512</nova:memory>
Aug 09 15:15:26 user nova-compute[72382]:         <nova:disk>1</nova:disk>
Aug 09 15:15:26 user nova-compute[72382]:         <nova:swap>0</nova:swap>
Aug 09 15:15:26 user nova-compute[72382]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 15:15:26 user nova-compute[72382]:         <nova:vcpus>1</nova:vcpus>
Aug 09 15:15:26 user nova-compute[72382]:       </nova:flavor>
Aug 09 15:15:26 user nova-compute[72382]:       <nova:owner>
Aug 09 15:15:26 user nova-compute[72382]:         <nova:user uuid="f94ca386a2be42cfbc2407bb7520cd25">tempest-ServerRescueNegativeTestJSON-867522113-project-member</nova:user>
Aug 09 15:15:26 user nova-compute[72382]:         <nova:project uuid="990ba791030940d38360af5879c853c5">tempest-ServerRescueNegativeTestJSON-867522113</nova:project>
Aug 09 15:15:26 user nova-compute[72382]:       </nova:owner>
Aug 09 15:15:26 user nova-compute[72382]:       <nova:root type="image" uuid="a79f2cea-eb27-4631-aaf3-05e7d9e411b4"/>
Aug 09 15:15:26 user nova-compute[72382]:       <nova:ports>
Aug 09 15:15:26 user nova-compute[72382]:         <nova:port uuid="2a1d4c60-bc2a-4530-b3bd-2a12ae2d2098">
Aug 09 15:15:26 user nova-compute[72382]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 09 15:15:26 user nova-compute[72382]:         </nova:port>
Aug 09 15:15:26 user nova-compute[72382]:       </nova:ports>
Aug 09 15:15:26 user nova-compute[72382]:     </nova:instance>
Aug 09 15:15:26 user nova-compute[72382]:   </metadata>
Aug 09 15:15:26 user nova-compute[72382]:   <sysinfo type="smbios">
Aug 09 15:15:26 user nova-compute[72382]:     <system>
Aug 09 15:15:26 user nova-compute[72382]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 15:15:26 user nova-compute[72382]:       <entry name="product">OpenStack Nova</entry>
Aug 09 15:15:26 user nova-compute[72382]:       <entry name="version">0.0.0</entry>
Aug 09 15:15:26 user nova-compute[72382]:       <entry name="serial">44afd1bf-fa5c-4b3e-8752-b16853fef54e</entry>
Aug 09 15:15:26 user nova-compute[72382]:       <entry name="uuid">44afd1bf-fa5c-4b3e-8752-b16853fef54e</entry>
Aug 09 15:15:26 user nova-compute[72382]:       <entry name="family">Virtual Machine</entry>
Aug 09 15:15:26 user nova-compute[72382]:     </system>
Aug 09 15:15:26 user nova-compute[72382]:   </sysinfo>
Aug 09 15:15:26 user nova-compute[72382]:   <os>
Aug 09 15:15:26 user nova-compute[72382]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 15:15:26 user nova-compute[72382]:     <boot dev="hd"/>
Aug 09 15:15:26 user nova-compute[72382]:     <smbios mode="sysinfo"/>
Aug 09 15:15:26 user nova-compute[72382]:   </os>
Aug 09 15:15:26 user nova-compute[72382]:   <features>
Aug 09 15:15:26 user nova-compute[72382]:     <acpi/>
Aug 09 15:15:26 user nova-compute[72382]:     <apic/>
Aug 09 15:15:26 user nova-compute[72382]:     <vmcoreinfo/>
Aug 09 15:15:26 user nova-compute[72382]:   </features>
Aug 09 15:15:26 user nova-compute[72382]:   <clock offset="utc">
Aug 09 15:15:26 user nova-compute[72382]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 15:15:26 user nova-compute[72382]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 15:15:26 user nova-compute[72382]:     <timer name="hpet" present="no"/>
Aug 09 15:15:26 user nova-compute[72382]:   </clock>
Aug 09 15:15:26 user nova-compute[72382]:   <cpu mode="custom" match="exact">
Aug 09 15:15:26 user nova-compute[72382]:     <model>Nehalem</model>
Aug 09 15:15:26 user nova-compute[72382]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 15:15:26 user nova-compute[72382]:   </cpu>
Aug 09 15:15:26 user nova-compute[72382]:   <devices>
Aug 09 15:15:26 user nova-compute[72382]:     <disk type="file" device="disk">
Aug 09 15:15:26 user nova-compute[72382]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 15:15:26 user nova-compute[72382]:       <source file="/opt/stack/data/nova/instances/44afd1bf-fa5c-4b3e-8752-b16853fef54e/disk"/>
Aug 09 15:15:26 user nova-compute[72382]:       <target dev="vda" bus="virtio"/>
Aug 09 15:15:26 user nova-compute[72382]:     </disk>
Aug 09 15:15:26 user nova-compute[72382]:     <interface type="ethernet">
Aug 09 15:15:26 user nova-compute[72382]:       <mac address="fa:16:3e:6c:50:29"/>
Aug 09 15:15:26 user nova-compute[72382]:       <model type="virtio"/>
Aug 09 15:15:26 user nova-compute[72382]:       <mtu size="1442"/>
Aug 09 15:15:26 user nova-compute[72382]:       <target dev="tap2a1d4c60-bc"/>
Aug 09 15:15:26 user nova-compute[72382]:     </interface>
Aug 09 15:15:26 user nova-compute[72382]:     <serial type="pty">
Aug 09 15:15:26 user nova-compute[72382]:       <log file="/opt/stack/data/nova/instances/44afd1bf-fa5c-4b3e-8752-b16853fef54e/console.log" append="off"/>
Aug 09 15:15:26 user nova-compute[72382]:     </serial>
Aug 09 15:15:26 user nova-compute[72382]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 15:15:26 user nova-compute[72382]:     <video>
Aug 09 15:15:26 user nova-compute[72382]:       <model type="virtio"/>
Aug 09 15:15:26 user nova-compute[72382]:     </video>
Aug 09 15:15:26 user nova-compute[72382]:     <rng model="virtio">
Aug 09 15:15:26 user nova-compute[72382]:       <backend model="random">/dev/urandom</backend>
Aug 09 15:15:26 user nova-compute[72382]:     </rng>
Aug 09 15:15:26 user nova-compute[72382]:     <controller type="usb" index="0" model="none"/>
Aug 09 15:15:26 user nova-compute[72382]:     <memballoon model="virtio">
Aug 09 15:15:26 user nova-compute[72382]:       <stats period="10"/>
Aug 09 15:15:26 user nova-compute[72382]:     </memballoon>
Aug 09 15:15:26 user nova-compute[72382]:   </devices>
Aug 09 15:15:26 user nova-compute[72382]: </domain>
Aug 09 15:15:26 user nova-compute[72382]:  {{(pid=72382) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 15:15:26 user nova-compute[72382]: DEBUG nova.virt.libvirt.vif [None req-16966d1a-588d-41b9-ae61-b46d67b5d3b8 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T15:15:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-201849157',display_name='tempest-ServerRescueNegativeTestJSON-server-201849157',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-201849157',id=3,image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='990ba791030940d38360af5879c853c5',ramdisk_id='',reservation_id='r-fqm5h5sw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-867522113',owner_user_name='tempest-ServerRescueNegativeTestJSON-867522113-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T15:15:14Z,user_data=None,user_id='f94ca386a2be42cfbc2407bb7520cd25',uuid=44afd1bf-fa5c-4b3e-8752-b16853fef54e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2a1d4c60-bc2a-4530-b3bd-2a12ae2d2098", "address": "fa:16:3e:6c:50:29", "network": {"id": "46ef00c7-17ee-4e45-ba1d-dcc0a417ea85", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1360012261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "990ba791030940d38360af5879c853c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a1d4c60-bc", "ovs_interfaceid": "2a1d4c60-bc2a-4530-b3bd-2a12ae2d2098", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 15:15:26 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-16966d1a-588d-41b9-ae61-b46d67b5d3b8 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Converting VIF {"id": "2a1d4c60-bc2a-4530-b3bd-2a12ae2d2098", "address": "fa:16:3e:6c:50:29", "network": {"id": "46ef00c7-17ee-4e45-ba1d-dcc0a417ea85", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1360012261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "990ba791030940d38360af5879c853c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a1d4c60-bc", "ovs_interfaceid": "2a1d4c60-bc2a-4530-b3bd-2a12ae2d2098", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 15:15:26 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-16966d1a-588d-41b9-ae61-b46d67b5d3b8 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6c:50:29,bridge_name='br-int',has_traffic_filtering=True,id=2a1d4c60-bc2a-4530-b3bd-2a12ae2d2098,network=Network(46ef00c7-17ee-4e45-ba1d-dcc0a417ea85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a1d4c60-bc') {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 15:15:26 user nova-compute[72382]: DEBUG os_vif [None req-16966d1a-588d-41b9-ae61-b46d67b5d3b8 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:50:29,bridge_name='br-int',has_traffic_filtering=True,id=2a1d4c60-bc2a-4530-b3bd-2a12ae2d2098,network=Network(46ef00c7-17ee-4e45-ba1d-dcc0a417ea85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a1d4c60-bc') {{(pid=72382) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 15:15:26 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:15:26 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:15:26 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 15:15:26 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:15:26 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2a1d4c60-bc, may_exist=True, interface_attrs={}) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:15:26 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2a1d4c60-bc, col_values=(('external_ids', {'iface-id': '2a1d4c60-bc2a-4530-b3bd-2a12ae2d2098', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6c:50:29', 'vm-uuid': '44afd1bf-fa5c-4b3e-8752-b16853fef54e'}),), if_exists=True) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:15:26 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:15:26 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:15:26 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:15:26 user nova-compute[72382]: INFO os_vif [None req-16966d1a-588d-41b9-ae61-b46d67b5d3b8 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:50:29,bridge_name='br-int',has_traffic_filtering=True,id=2a1d4c60-bc2a-4530-b3bd-2a12ae2d2098,network=Network(46ef00c7-17ee-4e45-ba1d-dcc0a417ea85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a1d4c60-bc')
Aug 09 15:15:26 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:15:26 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:15:26 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-16966d1a-588d-41b9-ae61-b46d67b5d3b8 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] No BDM found with device name vda, not building metadata. {{(pid=72382) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 15:15:26 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-16966d1a-588d-41b9-ae61-b46d67b5d3b8 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] No VIF found with MAC fa:16:3e:6c:50:29, not building metadata {{(pid=72382) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 15:15:26 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:15:26 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:15:26 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:15:26 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:15:26 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:15:27 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:15:27 user nova-compute[72382]: DEBUG nova.network.neutron [None req-48177f7f-2ba7-494f-8af2-3b8ef01c79c3 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] [instance: c9766433-4c5a-40ed-a212-715a24f42b91] Updating instance_info_cache with network_info: [{"id": "599dae3b-13bb-47af-b889-0037e03d5e31", "address": "fa:16:3e:66:9f:0b", "network": {"id": "63303ac8-d370-4386-a6bc-576677b64740", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1379220233-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f45d010dd474c92a6b24bf977564ad1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap599dae3b-13", "ovs_interfaceid": "599dae3b-13bb-47af-b889-0037e03d5e31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:15:27 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-48177f7f-2ba7-494f-8af2-3b8ef01c79c3 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Releasing lock "refresh_cache-c9766433-4c5a-40ed-a212-715a24f42b91" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 15:15:27 user nova-compute[72382]: DEBUG nova.compute.manager [None req-48177f7f-2ba7-494f-8af2-3b8ef01c79c3 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] [instance: c9766433-4c5a-40ed-a212-715a24f42b91] Instance network_info: |[{"id": "599dae3b-13bb-47af-b889-0037e03d5e31", "address": "fa:16:3e:66:9f:0b", "network": {"id": "63303ac8-d370-4386-a6bc-576677b64740", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1379220233-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f45d010dd474c92a6b24bf977564ad1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap599dae3b-13", "ovs_interfaceid": "599dae3b-13bb-47af-b889-0037e03d5e31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72382) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 15:15:27 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-0103d393-643a-4183-8041-19b237766266 req-994b929a-9134-48c3-a81e-ef7420208588 service nova] Acquired lock "refresh_cache-c9766433-4c5a-40ed-a212-715a24f42b91" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 15:15:27 user nova-compute[72382]: DEBUG nova.network.neutron [req-0103d393-643a-4183-8041-19b237766266 req-994b929a-9134-48c3-a81e-ef7420208588 service nova] [instance: c9766433-4c5a-40ed-a212-715a24f42b91] Refreshing network info cache for port 599dae3b-13bb-47af-b889-0037e03d5e31 {{(pid=72382) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 15:15:27 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-48177f7f-2ba7-494f-8af2-3b8ef01c79c3 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] [instance: c9766433-4c5a-40ed-a212-715a24f42b91] Start _get_guest_xml network_info=[{"id": "599dae3b-13bb-47af-b889-0037e03d5e31", "address": "fa:16:3e:66:9f:0b", "network": {"id": "63303ac8-d370-4386-a6bc-576677b64740", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1379220233-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f45d010dd474c92a6b24bf977564ad1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap599dae3b-13", "ovs_interfaceid": "599dae3b-13bb-47af-b889-0037e03d5e31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T15:11:25Z,direct_url=<?>,disk_format='qcow2',id=a79f2cea-eb27-4631-aaf3-05e7d9e411b4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a638990e12cc4d6eabb6d55e13be6bdf',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T15:11:27Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'a79f2cea-eb27-4631-aaf3-05e7d9e411b4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72382) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 15:15:27 user nova-compute[72382]: WARNING nova.virt.libvirt.driver [None req-48177f7f-2ba7-494f-8af2-3b8ef01c79c3 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 15:15:27 user nova-compute[72382]: WARNING nova.virt.libvirt.driver [None req-48177f7f-2ba7-494f-8af2-3b8ef01c79c3 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 15:15:27 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-48177f7f-2ba7-494f-8af2-3b8ef01c79c3 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72382) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 15:15:27 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-48177f7f-2ba7-494f-8af2-3b8ef01c79c3 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] CPU controller missing on host. {{(pid=72382) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 15:15:27 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-48177f7f-2ba7-494f-8af2-3b8ef01c79c3 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72382) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 15:15:27 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-48177f7f-2ba7-494f-8af2-3b8ef01c79c3 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] CPU controller found on host. {{(pid=72382) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 15:15:27 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-48177f7f-2ba7-494f-8af2-3b8ef01c79c3 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72382) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 15:15:27 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-48177f7f-2ba7-494f-8af2-3b8ef01c79c3 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T15:11:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T15:11:25Z,direct_url=<?>,disk_format='qcow2',id=a79f2cea-eb27-4631-aaf3-05e7d9e411b4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a638990e12cc4d6eabb6d55e13be6bdf',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T15:11:27Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 15:15:27 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-48177f7f-2ba7-494f-8af2-3b8ef01c79c3 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Flavor limits 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 15:15:27 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-48177f7f-2ba7-494f-8af2-3b8ef01c79c3 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Image limits 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 15:15:27 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-48177f7f-2ba7-494f-8af2-3b8ef01c79c3 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Flavor pref 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 15:15:27 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-48177f7f-2ba7-494f-8af2-3b8ef01c79c3 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Image pref 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 15:15:27 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-48177f7f-2ba7-494f-8af2-3b8ef01c79c3 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 15:15:27 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-48177f7f-2ba7-494f-8af2-3b8ef01c79c3 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 15:15:27 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-48177f7f-2ba7-494f-8af2-3b8ef01c79c3 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72382) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 15:15:27 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-48177f7f-2ba7-494f-8af2-3b8ef01c79c3 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Got 1 possible topologies {{(pid=72382) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 15:15:27 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-48177f7f-2ba7-494f-8af2-3b8ef01c79c3 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 15:15:27 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-48177f7f-2ba7-494f-8af2-3b8ef01c79c3 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 15:15:27 user nova-compute[72382]: DEBUG nova.virt.libvirt.vif [None req-48177f7f-2ba7-494f-8af2-3b8ef01c79c3 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T15:15:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-2120220558',display_name='tempest-ServerActionsTestOtherB-server-2120220558',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-2120220558',id=5,image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOdAPO5nl2/3VDHoi/8yD5s8l1+mDVit5A+n/HDnoxJgZMgOR9rAXiFsYVLEG+MsUeEQU8np4/pg88xwFSbi1vuFZkvV9b5532CTazhkqSlb4YuAKF8mo8fSFbyD8FwytA==',key_name='tempest-keypair-1399201542',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9f45d010dd474c92a6b24bf977564ad1',ramdisk_id='',reservation_id='r-rng7ms7j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-250545160',owner_user_name='tempest-ServerActionsTestOtherB-250545160-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T15:15:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='232fbbd15fea4894be7cebb13ea45cf9',uuid=c9766433-4c5a-40ed-a212-715a24f42b91,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "599dae3b-13bb-47af-b889-0037e03d5e31", "address": "fa:16:3e:66:9f:0b", "network": {"id": "63303ac8-d370-4386-a6bc-576677b64740", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1379220233-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f45d010dd474c92a6b24bf977564ad1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap599dae3b-13", "ovs_interfaceid": "599dae3b-13bb-47af-b889-0037e03d5e31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72382) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 15:15:27 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-48177f7f-2ba7-494f-8af2-3b8ef01c79c3 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Converting VIF {"id": "599dae3b-13bb-47af-b889-0037e03d5e31", "address": "fa:16:3e:66:9f:0b", "network": {"id": "63303ac8-d370-4386-a6bc-576677b64740", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1379220233-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f45d010dd474c92a6b24bf977564ad1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap599dae3b-13", "ovs_interfaceid": "599dae3b-13bb-47af-b889-0037e03d5e31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 15:15:27 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-48177f7f-2ba7-494f-8af2-3b8ef01c79c3 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:66:9f:0b,bridge_name='br-int',has_traffic_filtering=True,id=599dae3b-13bb-47af-b889-0037e03d5e31,network=Network(63303ac8-d370-4386-a6bc-576677b64740),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap599dae3b-13') {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 15:15:27 user nova-compute[72382]: DEBUG nova.objects.instance [None req-48177f7f-2ba7-494f-8af2-3b8ef01c79c3 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Lazy-loading 'pci_devices' on Instance uuid c9766433-4c5a-40ed-a212-715a24f42b91 {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:15:27 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-48177f7f-2ba7-494f-8af2-3b8ef01c79c3 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] [instance: c9766433-4c5a-40ed-a212-715a24f42b91] End _get_guest_xml xml=<domain type="kvm">
Aug 09 15:15:27 user nova-compute[72382]:   <uuid>c9766433-4c5a-40ed-a212-715a24f42b91</uuid>
Aug 09 15:15:27 user nova-compute[72382]:   <name>instance-00000005</name>
Aug 09 15:15:27 user nova-compute[72382]:   <memory>524288</memory>
Aug 09 15:15:27 user nova-compute[72382]:   <vcpu>1</vcpu>
Aug 09 15:15:27 user nova-compute[72382]:   <metadata>
Aug 09 15:15:27 user nova-compute[72382]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 15:15:27 user nova-compute[72382]:       <nova:package version="0.0.0"/>
Aug 09 15:15:27 user nova-compute[72382]:       <nova:name>tempest-ServerActionsTestOtherB-server-2120220558</nova:name>
Aug 09 15:15:27 user nova-compute[72382]:       <nova:creationTime>2023-08-09 15:15:27</nova:creationTime>
Aug 09 15:15:27 user nova-compute[72382]:       <nova:flavor name="m1.tiny">
Aug 09 15:15:27 user nova-compute[72382]:         <nova:memory>512</nova:memory>
Aug 09 15:15:27 user nova-compute[72382]:         <nova:disk>1</nova:disk>
Aug 09 15:15:27 user nova-compute[72382]:         <nova:swap>0</nova:swap>
Aug 09 15:15:27 user nova-compute[72382]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 15:15:27 user nova-compute[72382]:         <nova:vcpus>1</nova:vcpus>
Aug 09 15:15:27 user nova-compute[72382]:       </nova:flavor>
Aug 09 15:15:27 user nova-compute[72382]:       <nova:owner>
Aug 09 15:15:27 user nova-compute[72382]:         <nova:user uuid="232fbbd15fea4894be7cebb13ea45cf9">tempest-ServerActionsTestOtherB-250545160-project-member</nova:user>
Aug 09 15:15:27 user nova-compute[72382]:         <nova:project uuid="9f45d010dd474c92a6b24bf977564ad1">tempest-ServerActionsTestOtherB-250545160</nova:project>
Aug 09 15:15:27 user nova-compute[72382]:       </nova:owner>
Aug 09 15:15:27 user nova-compute[72382]:       <nova:root type="image" uuid="a79f2cea-eb27-4631-aaf3-05e7d9e411b4"/>
Aug 09 15:15:27 user nova-compute[72382]:       <nova:ports>
Aug 09 15:15:27 user nova-compute[72382]:         <nova:port uuid="599dae3b-13bb-47af-b889-0037e03d5e31">
Aug 09 15:15:27 user nova-compute[72382]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 09 15:15:27 user nova-compute[72382]:         </nova:port>
Aug 09 15:15:27 user nova-compute[72382]:       </nova:ports>
Aug 09 15:15:27 user nova-compute[72382]:     </nova:instance>
Aug 09 15:15:27 user nova-compute[72382]:   </metadata>
Aug 09 15:15:27 user nova-compute[72382]:   <sysinfo type="smbios">
Aug 09 15:15:27 user nova-compute[72382]:     <system>
Aug 09 15:15:27 user nova-compute[72382]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 15:15:27 user nova-compute[72382]:       <entry name="product">OpenStack Nova</entry>
Aug 09 15:15:27 user nova-compute[72382]:       <entry name="version">0.0.0</entry>
Aug 09 15:15:27 user nova-compute[72382]:       <entry name="serial">c9766433-4c5a-40ed-a212-715a24f42b91</entry>
Aug 09 15:15:27 user nova-compute[72382]:       <entry name="uuid">c9766433-4c5a-40ed-a212-715a24f42b91</entry>
Aug 09 15:15:27 user nova-compute[72382]:       <entry name="family">Virtual Machine</entry>
Aug 09 15:15:27 user nova-compute[72382]:     </system>
Aug 09 15:15:27 user nova-compute[72382]:   </sysinfo>
Aug 09 15:15:27 user nova-compute[72382]:   <os>
Aug 09 15:15:27 user nova-compute[72382]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 15:15:27 user nova-compute[72382]:     <boot dev="hd"/>
Aug 09 15:15:27 user nova-compute[72382]:     <smbios mode="sysinfo"/>
Aug 09 15:15:27 user nova-compute[72382]:   </os>
Aug 09 15:15:27 user nova-compute[72382]:   <features>
Aug 09 15:15:27 user nova-compute[72382]:     <acpi/>
Aug 09 15:15:27 user nova-compute[72382]:     <apic/>
Aug 09 15:15:27 user nova-compute[72382]:     <vmcoreinfo/>
Aug 09 15:15:27 user nova-compute[72382]:   </features>
Aug 09 15:15:27 user nova-compute[72382]:   <clock offset="utc">
Aug 09 15:15:27 user nova-compute[72382]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 15:15:27 user nova-compute[72382]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 15:15:27 user nova-compute[72382]:     <timer name="hpet" present="no"/>
Aug 09 15:15:27 user nova-compute[72382]:   </clock>
Aug 09 15:15:27 user nova-compute[72382]:   <cpu mode="custom" match="exact">
Aug 09 15:15:27 user nova-compute[72382]:     <model>Nehalem</model>
Aug 09 15:15:27 user nova-compute[72382]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 15:15:27 user nova-compute[72382]:   </cpu>
Aug 09 15:15:27 user nova-compute[72382]:   <devices>
Aug 09 15:15:27 user nova-compute[72382]:     <disk type="file" device="disk">
Aug 09 15:15:27 user nova-compute[72382]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 15:15:27 user nova-compute[72382]:       <source file="/opt/stack/data/nova/instances/c9766433-4c5a-40ed-a212-715a24f42b91/disk"/>
Aug 09 15:15:27 user nova-compute[72382]:       <target dev="vda" bus="virtio"/>
Aug 09 15:15:27 user nova-compute[72382]:     </disk>
Aug 09 15:15:27 user nova-compute[72382]:     <interface type="ethernet">
Aug 09 15:15:27 user nova-compute[72382]:       <mac address="fa:16:3e:66:9f:0b"/>
Aug 09 15:15:27 user nova-compute[72382]:       <model type="virtio"/>
Aug 09 15:15:27 user nova-compute[72382]:       <mtu size="1442"/>
Aug 09 15:15:27 user nova-compute[72382]:       <target dev="tap599dae3b-13"/>
Aug 09 15:15:27 user nova-compute[72382]:     </interface>
Aug 09 15:15:27 user nova-compute[72382]:     <serial type="pty">
Aug 09 15:15:27 user nova-compute[72382]:       <log file="/opt/stack/data/nova/instances/c9766433-4c5a-40ed-a212-715a24f42b91/console.log" append="off"/>
Aug 09 15:15:27 user nova-compute[72382]:     </serial>
Aug 09 15:15:27 user nova-compute[72382]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 15:15:27 user nova-compute[72382]:     <video>
Aug 09 15:15:27 user nova-compute[72382]:       <model type="virtio"/>
Aug 09 15:15:27 user nova-compute[72382]:     </video>
Aug 09 15:15:27 user nova-compute[72382]:     <rng model="virtio">
Aug 09 15:15:27 user nova-compute[72382]:       <backend model="random">/dev/urandom</backend>
Aug 09 15:15:27 user nova-compute[72382]:     </rng>
Aug 09 15:15:27 user nova-compute[72382]:     <controller type="usb" index="0" model="none"/>
Aug 09 15:15:27 user nova-compute[72382]:     <memballoon model="virtio">
Aug 09 15:15:27 user nova-compute[72382]:       <stats period="10"/>
Aug 09 15:15:27 user nova-compute[72382]:     </memballoon>
Aug 09 15:15:27 user nova-compute[72382]:   </devices>
Aug 09 15:15:27 user nova-compute[72382]: </domain>
Aug 09 15:15:27 user nova-compute[72382]:  {{(pid=72382) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 15:15:27 user nova-compute[72382]: DEBUG nova.virt.libvirt.vif [None req-48177f7f-2ba7-494f-8af2-3b8ef01c79c3 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T15:15:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-2120220558',display_name='tempest-ServerActionsTestOtherB-server-2120220558',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-2120220558',id=5,image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOdAPO5nl2/3VDHoi/8yD5s8l1+mDVit5A+n/HDnoxJgZMgOR9rAXiFsYVLEG+MsUeEQU8np4/pg88xwFSbi1vuFZkvV9b5532CTazhkqSlb4YuAKF8mo8fSFbyD8FwytA==',key_name='tempest-keypair-1399201542',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9f45d010dd474c92a6b24bf977564ad1',ramdisk_id='',reservation_id='r-rng7ms7j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-250545160',owner_user_name='tempest-ServerActionsTestOtherB-250545160-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T15:15:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='232fbbd15fea4894be7cebb13ea45cf9',uuid=c9766433-4c5a-40ed-a212-715a24f42b91,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "599dae3b-13bb-47af-b889-0037e03d5e31", "address": "fa:16:3e:66:9f:0b", "network": {"id": "63303ac8-d370-4386-a6bc-576677b64740", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1379220233-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f45d010dd474c92a6b24bf977564ad1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap599dae3b-13", "ovs_interfaceid": "599dae3b-13bb-47af-b889-0037e03d5e31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 15:15:27 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-48177f7f-2ba7-494f-8af2-3b8ef01c79c3 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Converting VIF {"id": "599dae3b-13bb-47af-b889-0037e03d5e31", "address": "fa:16:3e:66:9f:0b", "network": {"id": "63303ac8-d370-4386-a6bc-576677b64740", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1379220233-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f45d010dd474c92a6b24bf977564ad1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap599dae3b-13", "ovs_interfaceid": "599dae3b-13bb-47af-b889-0037e03d5e31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 15:15:27 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-48177f7f-2ba7-494f-8af2-3b8ef01c79c3 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:66:9f:0b,bridge_name='br-int',has_traffic_filtering=True,id=599dae3b-13bb-47af-b889-0037e03d5e31,network=Network(63303ac8-d370-4386-a6bc-576677b64740),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap599dae3b-13') {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 15:15:27 user nova-compute[72382]: DEBUG os_vif [None req-48177f7f-2ba7-494f-8af2-3b8ef01c79c3 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:9f:0b,bridge_name='br-int',has_traffic_filtering=True,id=599dae3b-13bb-47af-b889-0037e03d5e31,network=Network(63303ac8-d370-4386-a6bc-576677b64740),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap599dae3b-13') {{(pid=72382) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 15:15:27 user nova-compute[72382]: DEBUG nova.compute.manager [req-3407ab74-dfbd-4ccf-a529-5a3312560bdd req-1ffb858a-7895-4bbb-a992-f6832eeb838c service nova] [instance: 266be814-4a2b-4f8e-a0f6-e8821fdeb95d] Received event network-changed-48650c01-c5a9-44f2-a481-5120c429a5a5 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:15:27 user nova-compute[72382]: DEBUG nova.compute.manager [req-3407ab74-dfbd-4ccf-a529-5a3312560bdd req-1ffb858a-7895-4bbb-a992-f6832eeb838c service nova] [instance: 266be814-4a2b-4f8e-a0f6-e8821fdeb95d] Refreshing instance network info cache due to event network-changed-48650c01-c5a9-44f2-a481-5120c429a5a5. {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 15:15:27 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-3407ab74-dfbd-4ccf-a529-5a3312560bdd req-1ffb858a-7895-4bbb-a992-f6832eeb838c service nova] Acquiring lock "refresh_cache-266be814-4a2b-4f8e-a0f6-e8821fdeb95d" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 15:15:27 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:15:27 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:15:27 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 15:15:27 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:15:27 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap599dae3b-13, may_exist=True, interface_attrs={}) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:15:27 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap599dae3b-13, col_values=(('external_ids', {'iface-id': '599dae3b-13bb-47af-b889-0037e03d5e31', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:66:9f:0b', 'vm-uuid': 'c9766433-4c5a-40ed-a212-715a24f42b91'}),), if_exists=True) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:15:27 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:15:27 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:15:27 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:15:27 user nova-compute[72382]: INFO os_vif [None req-48177f7f-2ba7-494f-8af2-3b8ef01c79c3 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:9f:0b,bridge_name='br-int',has_traffic_filtering=True,id=599dae3b-13bb-47af-b889-0037e03d5e31,network=Network(63303ac8-d370-4386-a6bc-576677b64740),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap599dae3b-13')
Aug 09 15:15:27 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-48177f7f-2ba7-494f-8af2-3b8ef01c79c3 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] No BDM found with device name vda, not building metadata. {{(pid=72382) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 15:15:27 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-48177f7f-2ba7-494f-8af2-3b8ef01c79c3 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] No VIF found with MAC fa:16:3e:66:9f:0b, not building metadata {{(pid=72382) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 15:15:28 user nova-compute[72382]: DEBUG nova.network.neutron [None req-bd0bf5c4-b736-4591-85ca-5fff7abbf4d1 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] [instance: 266be814-4a2b-4f8e-a0f6-e8821fdeb95d] Updating instance_info_cache with network_info: [{"id": "48650c01-c5a9-44f2-a481-5120c429a5a5", "address": "fa:16:3e:25:0d:d4", "network": {"id": "46ef00c7-17ee-4e45-ba1d-dcc0a417ea85", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1360012261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "990ba791030940d38360af5879c853c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48650c01-c5", "ovs_interfaceid": "48650c01-c5a9-44f2-a481-5120c429a5a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:15:28 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-bd0bf5c4-b736-4591-85ca-5fff7abbf4d1 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Releasing lock "refresh_cache-266be814-4a2b-4f8e-a0f6-e8821fdeb95d" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 15:15:28 user nova-compute[72382]: DEBUG nova.compute.manager [None req-bd0bf5c4-b736-4591-85ca-5fff7abbf4d1 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] [instance: 266be814-4a2b-4f8e-a0f6-e8821fdeb95d] Instance network_info: |[{"id": "48650c01-c5a9-44f2-a481-5120c429a5a5", "address": "fa:16:3e:25:0d:d4", "network": {"id": "46ef00c7-17ee-4e45-ba1d-dcc0a417ea85", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1360012261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "990ba791030940d38360af5879c853c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48650c01-c5", "ovs_interfaceid": "48650c01-c5a9-44f2-a481-5120c429a5a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72382) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 15:15:28 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-3407ab74-dfbd-4ccf-a529-5a3312560bdd req-1ffb858a-7895-4bbb-a992-f6832eeb838c service nova] Acquired lock "refresh_cache-266be814-4a2b-4f8e-a0f6-e8821fdeb95d" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 15:15:28 user nova-compute[72382]: DEBUG nova.network.neutron [req-3407ab74-dfbd-4ccf-a529-5a3312560bdd req-1ffb858a-7895-4bbb-a992-f6832eeb838c service nova] [instance: 266be814-4a2b-4f8e-a0f6-e8821fdeb95d] Refreshing network info cache for port 48650c01-c5a9-44f2-a481-5120c429a5a5 {{(pid=72382) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 15:15:28 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-bd0bf5c4-b736-4591-85ca-5fff7abbf4d1 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] [instance: 266be814-4a2b-4f8e-a0f6-e8821fdeb95d] Start _get_guest_xml network_info=[{"id": "48650c01-c5a9-44f2-a481-5120c429a5a5", "address": "fa:16:3e:25:0d:d4", "network": {"id": "46ef00c7-17ee-4e45-ba1d-dcc0a417ea85", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1360012261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "990ba791030940d38360af5879c853c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48650c01-c5", "ovs_interfaceid": "48650c01-c5a9-44f2-a481-5120c429a5a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T15:11:25Z,direct_url=<?>,disk_format='qcow2',id=a79f2cea-eb27-4631-aaf3-05e7d9e411b4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a638990e12cc4d6eabb6d55e13be6bdf',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T15:11:27Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'a79f2cea-eb27-4631-aaf3-05e7d9e411b4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72382) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 15:15:28 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:15:28 user nova-compute[72382]: WARNING nova.virt.libvirt.driver [None req-bd0bf5c4-b736-4591-85ca-5fff7abbf4d1 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 15:15:28 user nova-compute[72382]: WARNING nova.virt.libvirt.driver [None req-bd0bf5c4-b736-4591-85ca-5fff7abbf4d1 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 15:15:28 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:15:28 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-bd0bf5c4-b736-4591-85ca-5fff7abbf4d1 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72382) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 15:15:28 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-bd0bf5c4-b736-4591-85ca-5fff7abbf4d1 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] CPU controller missing on host. {{(pid=72382) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 15:15:28 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-bd0bf5c4-b736-4591-85ca-5fff7abbf4d1 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72382) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 15:15:28 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-bd0bf5c4-b736-4591-85ca-5fff7abbf4d1 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] CPU controller found on host. {{(pid=72382) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 15:15:28 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-bd0bf5c4-b736-4591-85ca-5fff7abbf4d1 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72382) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 15:15:28 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-bd0bf5c4-b736-4591-85ca-5fff7abbf4d1 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T15:11:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T15:11:25Z,direct_url=<?>,disk_format='qcow2',id=a79f2cea-eb27-4631-aaf3-05e7d9e411b4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a638990e12cc4d6eabb6d55e13be6bdf',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T15:11:27Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 15:15:28 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-bd0bf5c4-b736-4591-85ca-5fff7abbf4d1 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Flavor limits 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 15:15:28 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-bd0bf5c4-b736-4591-85ca-5fff7abbf4d1 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Image limits 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 15:15:28 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-bd0bf5c4-b736-4591-85ca-5fff7abbf4d1 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Flavor pref 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 15:15:28 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-bd0bf5c4-b736-4591-85ca-5fff7abbf4d1 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Image pref 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 15:15:28 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-bd0bf5c4-b736-4591-85ca-5fff7abbf4d1 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 15:15:28 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-bd0bf5c4-b736-4591-85ca-5fff7abbf4d1 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 15:15:28 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-bd0bf5c4-b736-4591-85ca-5fff7abbf4d1 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72382) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 15:15:28 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-bd0bf5c4-b736-4591-85ca-5fff7abbf4d1 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Got 1 possible topologies {{(pid=72382) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 15:15:28 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-bd0bf5c4-b736-4591-85ca-5fff7abbf4d1 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 15:15:28 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-bd0bf5c4-b736-4591-85ca-5fff7abbf4d1 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 15:15:28 user nova-compute[72382]: DEBUG nova.virt.libvirt.vif [None req-bd0bf5c4-b736-4591-85ca-5fff7abbf4d1 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T15:15:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1904336264',display_name='tempest-ServerRescueNegativeTestJSON-server-1904336264',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1904336264',id=4,image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='990ba791030940d38360af5879c853c5',ramdisk_id='',reservation_id='r-odim6gvi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-867522113',owner_user_name='tempest-ServerRescueNegativeTestJSON-867522113-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T15:15:17Z,user_data=None,user_id='f94ca386a2be42cfbc2407bb7520cd25',uuid=266be814-4a2b-4f8e-a0f6-e8821fdeb95d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "48650c01-c5a9-44f2-a481-5120c429a5a5", "address": "fa:16:3e:25:0d:d4", "network": {"id": "46ef00c7-17ee-4e45-ba1d-dcc0a417ea85", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1360012261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "990ba791030940d38360af5879c853c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48650c01-c5", "ovs_interfaceid": "48650c01-c5a9-44f2-a481-5120c429a5a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72382) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 15:15:28 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-bd0bf5c4-b736-4591-85ca-5fff7abbf4d1 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Converting VIF {"id": "48650c01-c5a9-44f2-a481-5120c429a5a5", "address": "fa:16:3e:25:0d:d4", "network": {"id": "46ef00c7-17ee-4e45-ba1d-dcc0a417ea85", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1360012261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "990ba791030940d38360af5879c853c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48650c01-c5", "ovs_interfaceid": "48650c01-c5a9-44f2-a481-5120c429a5a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 15:15:28 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-bd0bf5c4-b736-4591-85ca-5fff7abbf4d1 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:25:0d:d4,bridge_name='br-int',has_traffic_filtering=True,id=48650c01-c5a9-44f2-a481-5120c429a5a5,network=Network(46ef00c7-17ee-4e45-ba1d-dcc0a417ea85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48650c01-c5') {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 15:15:28 user nova-compute[72382]: DEBUG nova.objects.instance [None req-bd0bf5c4-b736-4591-85ca-5fff7abbf4d1 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Lazy-loading 'pci_devices' on Instance uuid 266be814-4a2b-4f8e-a0f6-e8821fdeb95d {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:15:28 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:15:28 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-bd0bf5c4-b736-4591-85ca-5fff7abbf4d1 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] [instance: 266be814-4a2b-4f8e-a0f6-e8821fdeb95d] End _get_guest_xml xml=<domain type="kvm">
Aug 09 15:15:28 user nova-compute[72382]:   <uuid>266be814-4a2b-4f8e-a0f6-e8821fdeb95d</uuid>
Aug 09 15:15:28 user nova-compute[72382]:   <name>instance-00000004</name>
Aug 09 15:15:28 user nova-compute[72382]:   <memory>524288</memory>
Aug 09 15:15:28 user nova-compute[72382]:   <vcpu>1</vcpu>
Aug 09 15:15:28 user nova-compute[72382]:   <metadata>
Aug 09 15:15:28 user nova-compute[72382]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 15:15:28 user nova-compute[72382]:       <nova:package version="0.0.0"/>
Aug 09 15:15:28 user nova-compute[72382]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1904336264</nova:name>
Aug 09 15:15:28 user nova-compute[72382]:       <nova:creationTime>2023-08-09 15:15:28</nova:creationTime>
Aug 09 15:15:28 user nova-compute[72382]:       <nova:flavor name="m1.tiny">
Aug 09 15:15:28 user nova-compute[72382]:         <nova:memory>512</nova:memory>
Aug 09 15:15:28 user nova-compute[72382]:         <nova:disk>1</nova:disk>
Aug 09 15:15:28 user nova-compute[72382]:         <nova:swap>0</nova:swap>
Aug 09 15:15:28 user nova-compute[72382]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 15:15:28 user nova-compute[72382]:         <nova:vcpus>1</nova:vcpus>
Aug 09 15:15:28 user nova-compute[72382]:       </nova:flavor>
Aug 09 15:15:28 user nova-compute[72382]:       <nova:owner>
Aug 09 15:15:28 user nova-compute[72382]:         <nova:user uuid="f94ca386a2be42cfbc2407bb7520cd25">tempest-ServerRescueNegativeTestJSON-867522113-project-member</nova:user>
Aug 09 15:15:28 user nova-compute[72382]:         <nova:project uuid="990ba791030940d38360af5879c853c5">tempest-ServerRescueNegativeTestJSON-867522113</nova:project>
Aug 09 15:15:28 user nova-compute[72382]:       </nova:owner>
Aug 09 15:15:28 user nova-compute[72382]:       <nova:root type="image" uuid="a79f2cea-eb27-4631-aaf3-05e7d9e411b4"/>
Aug 09 15:15:28 user nova-compute[72382]:       <nova:ports>
Aug 09 15:15:28 user nova-compute[72382]:         <nova:port uuid="48650c01-c5a9-44f2-a481-5120c429a5a5">
Aug 09 15:15:28 user nova-compute[72382]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 09 15:15:28 user nova-compute[72382]:         </nova:port>
Aug 09 15:15:28 user nova-compute[72382]:       </nova:ports>
Aug 09 15:15:28 user nova-compute[72382]:     </nova:instance>
Aug 09 15:15:28 user nova-compute[72382]:   </metadata>
Aug 09 15:15:28 user nova-compute[72382]:   <sysinfo type="smbios">
Aug 09 15:15:28 user nova-compute[72382]:     <system>
Aug 09 15:15:28 user nova-compute[72382]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 15:15:28 user nova-compute[72382]:       <entry name="product">OpenStack Nova</entry>
Aug 09 15:15:28 user nova-compute[72382]:       <entry name="version">0.0.0</entry>
Aug 09 15:15:28 user nova-compute[72382]:       <entry name="serial">266be814-4a2b-4f8e-a0f6-e8821fdeb95d</entry>
Aug 09 15:15:28 user nova-compute[72382]:       <entry name="uuid">266be814-4a2b-4f8e-a0f6-e8821fdeb95d</entry>
Aug 09 15:15:28 user nova-compute[72382]:       <entry name="family">Virtual Machine</entry>
Aug 09 15:15:28 user nova-compute[72382]:     </system>
Aug 09 15:15:28 user nova-compute[72382]:   </sysinfo>
Aug 09 15:15:28 user nova-compute[72382]:   <os>
Aug 09 15:15:28 user nova-compute[72382]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 15:15:28 user nova-compute[72382]:     <boot dev="hd"/>
Aug 09 15:15:28 user nova-compute[72382]:     <smbios mode="sysinfo"/>
Aug 09 15:15:28 user nova-compute[72382]:   </os>
Aug 09 15:15:28 user nova-compute[72382]:   <features>
Aug 09 15:15:28 user nova-compute[72382]:     <acpi/>
Aug 09 15:15:28 user nova-compute[72382]:     <apic/>
Aug 09 15:15:28 user nova-compute[72382]:     <vmcoreinfo/>
Aug 09 15:15:28 user nova-compute[72382]:   </features>
Aug 09 15:15:28 user nova-compute[72382]:   <clock offset="utc">
Aug 09 15:15:28 user nova-compute[72382]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 15:15:28 user nova-compute[72382]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 15:15:28 user nova-compute[72382]:     <timer name="hpet" present="no"/>
Aug 09 15:15:28 user nova-compute[72382]:   </clock>
Aug 09 15:15:28 user nova-compute[72382]:   <cpu mode="custom" match="exact">
Aug 09 15:15:28 user nova-compute[72382]:     <model>Nehalem</model>
Aug 09 15:15:28 user nova-compute[72382]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 15:15:28 user nova-compute[72382]:   </cpu>
Aug 09 15:15:28 user nova-compute[72382]:   <devices>
Aug 09 15:15:28 user nova-compute[72382]:     <disk type="file" device="disk">
Aug 09 15:15:28 user nova-compute[72382]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 15:15:28 user nova-compute[72382]:       <source file="/opt/stack/data/nova/instances/266be814-4a2b-4f8e-a0f6-e8821fdeb95d/disk"/>
Aug 09 15:15:28 user nova-compute[72382]:       <target dev="vda" bus="virtio"/>
Aug 09 15:15:28 user nova-compute[72382]:     </disk>
Aug 09 15:15:28 user nova-compute[72382]:     <interface type="ethernet">
Aug 09 15:15:28 user nova-compute[72382]:       <mac address="fa:16:3e:25:0d:d4"/>
Aug 09 15:15:28 user nova-compute[72382]:       <model type="virtio"/>
Aug 09 15:15:28 user nova-compute[72382]:       <mtu size="1442"/>
Aug 09 15:15:28 user nova-compute[72382]:       <target dev="tap48650c01-c5"/>
Aug 09 15:15:28 user nova-compute[72382]:     </interface>
Aug 09 15:15:28 user nova-compute[72382]:     <serial type="pty">
Aug 09 15:15:28 user nova-compute[72382]:       <log file="/opt/stack/data/nova/instances/266be814-4a2b-4f8e-a0f6-e8821fdeb95d/console.log" append="off"/>
Aug 09 15:15:28 user nova-compute[72382]:     </serial>
Aug 09 15:15:28 user nova-compute[72382]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 15:15:28 user nova-compute[72382]:     <video>
Aug 09 15:15:28 user nova-compute[72382]:       <model type="virtio"/>
Aug 09 15:15:28 user nova-compute[72382]:     </video>
Aug 09 15:15:28 user nova-compute[72382]:     <rng model="virtio">
Aug 09 15:15:28 user nova-compute[72382]:       <backend model="random">/dev/urandom</backend>
Aug 09 15:15:28 user nova-compute[72382]:     </rng>
Aug 09 15:15:28 user nova-compute[72382]:     <controller type="usb" index="0" model="none"/>
Aug 09 15:15:28 user nova-compute[72382]:     <memballoon model="virtio">
Aug 09 15:15:28 user nova-compute[72382]:       <stats period="10"/>
Aug 09 15:15:28 user nova-compute[72382]:     </memballoon>
Aug 09 15:15:28 user nova-compute[72382]:   </devices>
Aug 09 15:15:28 user nova-compute[72382]: </domain>
Aug 09 15:15:28 user nova-compute[72382]:  {{(pid=72382) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 15:15:28 user nova-compute[72382]: DEBUG nova.virt.libvirt.vif [None req-bd0bf5c4-b736-4591-85ca-5fff7abbf4d1 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T15:15:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1904336264',display_name='tempest-ServerRescueNegativeTestJSON-server-1904336264',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1904336264',id=4,image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='990ba791030940d38360af5879c853c5',ramdisk_id='',reservation_id='r-odim6gvi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-867522113',owner_user_name='tempest-ServerRescueNegativeTestJSON-867522113-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T15:15:17Z,user_data=None,user_id='f94ca386a2be42cfbc2407bb7520cd25',uuid=266be814-4a2b-4f8e-a0f6-e8821fdeb95d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "48650c01-c5a9-44f2-a481-5120c429a5a5", "address": "fa:16:3e:25:0d:d4", "network": {"id": "46ef00c7-17ee-4e45-ba1d-dcc0a417ea85", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1360012261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "990ba791030940d38360af5879c853c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48650c01-c5", "ovs_interfaceid": "48650c01-c5a9-44f2-a481-5120c429a5a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 15:15:28 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-bd0bf5c4-b736-4591-85ca-5fff7abbf4d1 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Converting VIF {"id": "48650c01-c5a9-44f2-a481-5120c429a5a5", "address": "fa:16:3e:25:0d:d4", "network": {"id": "46ef00c7-17ee-4e45-ba1d-dcc0a417ea85", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1360012261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "990ba791030940d38360af5879c853c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48650c01-c5", "ovs_interfaceid": "48650c01-c5a9-44f2-a481-5120c429a5a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 15:15:28 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-bd0bf5c4-b736-4591-85ca-5fff7abbf4d1 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:25:0d:d4,bridge_name='br-int',has_traffic_filtering=True,id=48650c01-c5a9-44f2-a481-5120c429a5a5,network=Network(46ef00c7-17ee-4e45-ba1d-dcc0a417ea85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48650c01-c5') {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 15:15:28 user nova-compute[72382]: DEBUG os_vif [None req-bd0bf5c4-b736-4591-85ca-5fff7abbf4d1 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:25:0d:d4,bridge_name='br-int',has_traffic_filtering=True,id=48650c01-c5a9-44f2-a481-5120c429a5a5,network=Network(46ef00c7-17ee-4e45-ba1d-dcc0a417ea85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48650c01-c5') {{(pid=72382) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 15:15:28 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:15:28 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:15:28 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 15:15:28 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:15:28 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap48650c01-c5, may_exist=True, interface_attrs={}) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:15:28 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap48650c01-c5, col_values=(('external_ids', {'iface-id': '48650c01-c5a9-44f2-a481-5120c429a5a5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:25:0d:d4', 'vm-uuid': '266be814-4a2b-4f8e-a0f6-e8821fdeb95d'}),), if_exists=True) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:15:28 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:15:28 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:15:28 user nova-compute[72382]: INFO os_vif [None req-bd0bf5c4-b736-4591-85ca-5fff7abbf4d1 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:25:0d:d4,bridge_name='br-int',has_traffic_filtering=True,id=48650c01-c5a9-44f2-a481-5120c429a5a5,network=Network(46ef00c7-17ee-4e45-ba1d-dcc0a417ea85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48650c01-c5')
Aug 09 15:15:28 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:15:28 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-bd0bf5c4-b736-4591-85ca-5fff7abbf4d1 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] No BDM found with device name vda, not building metadata. {{(pid=72382) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 15:15:28 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-bd0bf5c4-b736-4591-85ca-5fff7abbf4d1 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] No VIF found with MAC fa:16:3e:25:0d:d4, not building metadata {{(pid=72382) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 15:15:29 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:15:29 user nova-compute[72382]: DEBUG nova.network.neutron [req-b1aee14e-0ab5-4f26-a673-4e656ae1e39b req-75bea069-36ff-431d-b6a2-776dbb7a45f0 service nova] [instance: 44afd1bf-fa5c-4b3e-8752-b16853fef54e] Updated VIF entry in instance network info cache for port 2a1d4c60-bc2a-4530-b3bd-2a12ae2d2098. {{(pid=72382) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 15:15:29 user nova-compute[72382]: DEBUG nova.network.neutron [req-b1aee14e-0ab5-4f26-a673-4e656ae1e39b req-75bea069-36ff-431d-b6a2-776dbb7a45f0 service nova] [instance: 44afd1bf-fa5c-4b3e-8752-b16853fef54e] Updating instance_info_cache with network_info: [{"id": "2a1d4c60-bc2a-4530-b3bd-2a12ae2d2098", "address": "fa:16:3e:6c:50:29", "network": {"id": "46ef00c7-17ee-4e45-ba1d-dcc0a417ea85", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1360012261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "990ba791030940d38360af5879c853c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a1d4c60-bc", "ovs_interfaceid": "2a1d4c60-bc2a-4530-b3bd-2a12ae2d2098", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:15:29 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-b1aee14e-0ab5-4f26-a673-4e656ae1e39b req-75bea069-36ff-431d-b6a2-776dbb7a45f0 service nova] Releasing lock "refresh_cache-44afd1bf-fa5c-4b3e-8752-b16853fef54e" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 15:15:29 user nova-compute[72382]: DEBUG nova.compute.manager [req-40bd596d-2826-42e0-adfb-7cda41e125e5 req-2cc49c90-95a4-4a57-9119-b9ac1d202cdc service nova] [instance: 777e49ea-b674-4c3f-9cdd-ac2113032632] Received event network-vif-plugged-80b78279-76f9-46c8-a54d-413116bc37c6 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:15:29 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-40bd596d-2826-42e0-adfb-7cda41e125e5 req-2cc49c90-95a4-4a57-9119-b9ac1d202cdc service nova] Acquiring lock "777e49ea-b674-4c3f-9cdd-ac2113032632-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:15:29 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-40bd596d-2826-42e0-adfb-7cda41e125e5 req-2cc49c90-95a4-4a57-9119-b9ac1d202cdc service nova] Lock "777e49ea-b674-4c3f-9cdd-ac2113032632-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:15:29 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-40bd596d-2826-42e0-adfb-7cda41e125e5 req-2cc49c90-95a4-4a57-9119-b9ac1d202cdc service nova] Lock "777e49ea-b674-4c3f-9cdd-ac2113032632-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:15:29 user nova-compute[72382]: DEBUG nova.compute.manager [req-40bd596d-2826-42e0-adfb-7cda41e125e5 req-2cc49c90-95a4-4a57-9119-b9ac1d202cdc service nova] [instance: 777e49ea-b674-4c3f-9cdd-ac2113032632] No waiting events found dispatching network-vif-plugged-80b78279-76f9-46c8-a54d-413116bc37c6 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:15:29 user nova-compute[72382]: WARNING nova.compute.manager [req-40bd596d-2826-42e0-adfb-7cda41e125e5 req-2cc49c90-95a4-4a57-9119-b9ac1d202cdc service nova] [instance: 777e49ea-b674-4c3f-9cdd-ac2113032632] Received unexpected event network-vif-plugged-80b78279-76f9-46c8-a54d-413116bc37c6 for instance with vm_state building and task_state spawning.
Aug 09 15:15:30 user nova-compute[72382]: DEBUG nova.network.neutron [req-0103d393-643a-4183-8041-19b237766266 req-994b929a-9134-48c3-a81e-ef7420208588 service nova] [instance: c9766433-4c5a-40ed-a212-715a24f42b91] Updated VIF entry in instance network info cache for port 599dae3b-13bb-47af-b889-0037e03d5e31. {{(pid=72382) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 15:15:30 user nova-compute[72382]: DEBUG nova.network.neutron [req-0103d393-643a-4183-8041-19b237766266 req-994b929a-9134-48c3-a81e-ef7420208588 service nova] [instance: c9766433-4c5a-40ed-a212-715a24f42b91] Updating instance_info_cache with network_info: [{"id": "599dae3b-13bb-47af-b889-0037e03d5e31", "address": "fa:16:3e:66:9f:0b", "network": {"id": "63303ac8-d370-4386-a6bc-576677b64740", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1379220233-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f45d010dd474c92a6b24bf977564ad1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap599dae3b-13", "ovs_interfaceid": "599dae3b-13bb-47af-b889-0037e03d5e31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:15:30 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-0103d393-643a-4183-8041-19b237766266 req-994b929a-9134-48c3-a81e-ef7420208588 service nova] Releasing lock "refresh_cache-c9766433-4c5a-40ed-a212-715a24f42b91" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 15:15:30 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:15:30 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:15:30 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:15:31 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:15:31 user nova-compute[72382]: DEBUG nova.network.neutron [req-3407ab74-dfbd-4ccf-a529-5a3312560bdd req-1ffb858a-7895-4bbb-a992-f6832eeb838c service nova] [instance: 266be814-4a2b-4f8e-a0f6-e8821fdeb95d] Updated VIF entry in instance network info cache for port 48650c01-c5a9-44f2-a481-5120c429a5a5. {{(pid=72382) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 15:15:31 user nova-compute[72382]: DEBUG nova.network.neutron [req-3407ab74-dfbd-4ccf-a529-5a3312560bdd req-1ffb858a-7895-4bbb-a992-f6832eeb838c service nova] [instance: 266be814-4a2b-4f8e-a0f6-e8821fdeb95d] Updating instance_info_cache with network_info: [{"id": "48650c01-c5a9-44f2-a481-5120c429a5a5", "address": "fa:16:3e:25:0d:d4", "network": {"id": "46ef00c7-17ee-4e45-ba1d-dcc0a417ea85", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1360012261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "990ba791030940d38360af5879c853c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48650c01-c5", "ovs_interfaceid": "48650c01-c5a9-44f2-a481-5120c429a5a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:15:31 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-3407ab74-dfbd-4ccf-a529-5a3312560bdd req-1ffb858a-7895-4bbb-a992-f6832eeb838c service nova] Releasing lock "refresh_cache-266be814-4a2b-4f8e-a0f6-e8821fdeb95d" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 15:15:31 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:15:31 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:15:31 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:15:31 user nova-compute[72382]: DEBUG nova.compute.manager [req-d0a412fa-b7eb-4630-80ab-b137f15b3e26 req-46e81b71-6c41-4ce6-8bca-3c316a5aa948 service nova] [instance: 777e49ea-b674-4c3f-9cdd-ac2113032632] Received event network-vif-plugged-80b78279-76f9-46c8-a54d-413116bc37c6 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:15:31 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-d0a412fa-b7eb-4630-80ab-b137f15b3e26 req-46e81b71-6c41-4ce6-8bca-3c316a5aa948 service nova] Acquiring lock "777e49ea-b674-4c3f-9cdd-ac2113032632-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:15:31 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-d0a412fa-b7eb-4630-80ab-b137f15b3e26 req-46e81b71-6c41-4ce6-8bca-3c316a5aa948 service nova] Lock "777e49ea-b674-4c3f-9cdd-ac2113032632-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:15:31 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-d0a412fa-b7eb-4630-80ab-b137f15b3e26 req-46e81b71-6c41-4ce6-8bca-3c316a5aa948 service nova] Lock "777e49ea-b674-4c3f-9cdd-ac2113032632-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:15:31 user nova-compute[72382]: DEBUG nova.compute.manager [req-d0a412fa-b7eb-4630-80ab-b137f15b3e26 req-46e81b71-6c41-4ce6-8bca-3c316a5aa948 service nova] [instance: 777e49ea-b674-4c3f-9cdd-ac2113032632] No waiting events found dispatching network-vif-plugged-80b78279-76f9-46c8-a54d-413116bc37c6 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:15:31 user nova-compute[72382]: WARNING nova.compute.manager [req-d0a412fa-b7eb-4630-80ab-b137f15b3e26 req-46e81b71-6c41-4ce6-8bca-3c316a5aa948 service nova] [instance: 777e49ea-b674-4c3f-9cdd-ac2113032632] Received unexpected event network-vif-plugged-80b78279-76f9-46c8-a54d-413116bc37c6 for instance with vm_state building and task_state spawning.
Aug 09 15:15:32 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:15:32 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:15:32 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:15:32 user nova-compute[72382]: DEBUG nova.compute.manager [req-3609a413-52c3-4ae1-9aa0-5a8272f29940 req-b3ce4c72-7628-4856-97b3-65336bc4d4e5 service nova] [instance: c9766433-4c5a-40ed-a212-715a24f42b91] Received event network-vif-plugged-599dae3b-13bb-47af-b889-0037e03d5e31 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:15:32 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-3609a413-52c3-4ae1-9aa0-5a8272f29940 req-b3ce4c72-7628-4856-97b3-65336bc4d4e5 service nova] Acquiring lock "c9766433-4c5a-40ed-a212-715a24f42b91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:15:32 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-3609a413-52c3-4ae1-9aa0-5a8272f29940 req-b3ce4c72-7628-4856-97b3-65336bc4d4e5 service nova] Lock "c9766433-4c5a-40ed-a212-715a24f42b91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:15:32 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-3609a413-52c3-4ae1-9aa0-5a8272f29940 req-b3ce4c72-7628-4856-97b3-65336bc4d4e5 service nova] Lock "c9766433-4c5a-40ed-a212-715a24f42b91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:15:32 user nova-compute[72382]: DEBUG nova.compute.manager [req-3609a413-52c3-4ae1-9aa0-5a8272f29940 req-b3ce4c72-7628-4856-97b3-65336bc4d4e5 service nova] [instance: c9766433-4c5a-40ed-a212-715a24f42b91] No waiting events found dispatching network-vif-plugged-599dae3b-13bb-47af-b889-0037e03d5e31 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:15:32 user nova-compute[72382]: WARNING nova.compute.manager [req-3609a413-52c3-4ae1-9aa0-5a8272f29940 req-b3ce4c72-7628-4856-97b3-65336bc4d4e5 service nova] [instance: c9766433-4c5a-40ed-a212-715a24f42b91] Received unexpected event network-vif-plugged-599dae3b-13bb-47af-b889-0037e03d5e31 for instance with vm_state building and task_state spawning.
Aug 09 15:15:32 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:15:32 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:15:32 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:15:33 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:15:33 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:15:33 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:15:33 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:15:33 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:15:33 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:15:33 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:15:33 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-da354ed4-e0c5-47bc-b068-b96062ddd053 tempest-AttachSCSIVolumeTestJSON-1083630769 tempest-AttachSCSIVolumeTestJSON-1083630769-project-member] Acquiring lock "24b63f7a-be32-424b-b72c-d5bec43c408e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:15:33 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-da354ed4-e0c5-47bc-b068-b96062ddd053 tempest-AttachSCSIVolumeTestJSON-1083630769 tempest-AttachSCSIVolumeTestJSON-1083630769-project-member] Lock "24b63f7a-be32-424b-b72c-d5bec43c408e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:15:33 user nova-compute[72382]: DEBUG nova.compute.manager [None req-da354ed4-e0c5-47bc-b068-b96062ddd053 tempest-AttachSCSIVolumeTestJSON-1083630769 tempest-AttachSCSIVolumeTestJSON-1083630769-project-member] [instance: 24b63f7a-be32-424b-b72c-d5bec43c408e] Starting instance... {{(pid=72382) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 15:15:33 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-da354ed4-e0c5-47bc-b068-b96062ddd053 tempest-AttachSCSIVolumeTestJSON-1083630769 tempest-AttachSCSIVolumeTestJSON-1083630769-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:15:33 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-da354ed4-e0c5-47bc-b068-b96062ddd053 tempest-AttachSCSIVolumeTestJSON-1083630769 tempest-AttachSCSIVolumeTestJSON-1083630769-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:15:33 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-da354ed4-e0c5-47bc-b068-b96062ddd053 tempest-AttachSCSIVolumeTestJSON-1083630769 tempest-AttachSCSIVolumeTestJSON-1083630769-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72382) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 15:15:33 user nova-compute[72382]: INFO nova.compute.claims [None req-da354ed4-e0c5-47bc-b068-b96062ddd053 tempest-AttachSCSIVolumeTestJSON-1083630769 tempest-AttachSCSIVolumeTestJSON-1083630769-project-member] [instance: 24b63f7a-be32-424b-b72c-d5bec43c408e] Claim successful on node user
Aug 09 15:15:33 user nova-compute[72382]: DEBUG nova.virt.driver [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Emitting event <LifecycleEvent: 1691594133.9431043, 777e49ea-b674-4c3f-9cdd-ac2113032632 => Resumed> {{(pid=72382) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 15:15:33 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 777e49ea-b674-4c3f-9cdd-ac2113032632] VM Resumed (Lifecycle Event)
Aug 09 15:15:33 user nova-compute[72382]: DEBUG nova.compute.manager [None req-f816da71-40e8-4952-90c2-f2c3ed3b228b tempest-ServersNegativeTestJSON-1671359082 tempest-ServersNegativeTestJSON-1671359082-project-member] [instance: 777e49ea-b674-4c3f-9cdd-ac2113032632] Instance event wait completed in 0 seconds for  {{(pid=72382) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 15:15:33 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-f816da71-40e8-4952-90c2-f2c3ed3b228b tempest-ServersNegativeTestJSON-1671359082 tempest-ServersNegativeTestJSON-1671359082-project-member] [instance: 777e49ea-b674-4c3f-9cdd-ac2113032632] Guest created on hypervisor {{(pid=72382) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 15:15:33 user nova-compute[72382]: INFO nova.virt.libvirt.driver [-] [instance: 777e49ea-b674-4c3f-9cdd-ac2113032632] Instance spawned successfully.
Aug 09 15:15:33 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-f816da71-40e8-4952-90c2-f2c3ed3b228b tempest-ServersNegativeTestJSON-1671359082 tempest-ServersNegativeTestJSON-1671359082-project-member] [instance: 777e49ea-b674-4c3f-9cdd-ac2113032632] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 15:15:33 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 777e49ea-b674-4c3f-9cdd-ac2113032632] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:15:33 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 777e49ea-b674-4c3f-9cdd-ac2113032632] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72382) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 15:15:34 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 777e49ea-b674-4c3f-9cdd-ac2113032632] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 15:15:34 user nova-compute[72382]: DEBUG nova.virt.driver [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Emitting event <LifecycleEvent: 1691594133.9479089, 777e49ea-b674-4c3f-9cdd-ac2113032632 => Started> {{(pid=72382) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 15:15:34 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 777e49ea-b674-4c3f-9cdd-ac2113032632] VM Started (Lifecycle Event)
Aug 09 15:15:34 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-f816da71-40e8-4952-90c2-f2c3ed3b228b tempest-ServersNegativeTestJSON-1671359082 tempest-ServersNegativeTestJSON-1671359082-project-member] [instance: 777e49ea-b674-4c3f-9cdd-ac2113032632] Found default for hw_cdrom_bus of ide {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:15:34 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-f816da71-40e8-4952-90c2-f2c3ed3b228b tempest-ServersNegativeTestJSON-1671359082 tempest-ServersNegativeTestJSON-1671359082-project-member] [instance: 777e49ea-b674-4c3f-9cdd-ac2113032632] Found default for hw_disk_bus of virtio {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:15:34 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-f816da71-40e8-4952-90c2-f2c3ed3b228b tempest-ServersNegativeTestJSON-1671359082 tempest-ServersNegativeTestJSON-1671359082-project-member] [instance: 777e49ea-b674-4c3f-9cdd-ac2113032632] Found default for hw_input_bus of None {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:15:34 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-f816da71-40e8-4952-90c2-f2c3ed3b228b tempest-ServersNegativeTestJSON-1671359082 tempest-ServersNegativeTestJSON-1671359082-project-member] [instance: 777e49ea-b674-4c3f-9cdd-ac2113032632] Found default for hw_pointer_model of None {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:15:34 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-f816da71-40e8-4952-90c2-f2c3ed3b228b tempest-ServersNegativeTestJSON-1671359082 tempest-ServersNegativeTestJSON-1671359082-project-member] [instance: 777e49ea-b674-4c3f-9cdd-ac2113032632] Found default for hw_video_model of virtio {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:15:34 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-f816da71-40e8-4952-90c2-f2c3ed3b228b tempest-ServersNegativeTestJSON-1671359082 tempest-ServersNegativeTestJSON-1671359082-project-member] [instance: 777e49ea-b674-4c3f-9cdd-ac2113032632] Found default for hw_vif_model of virtio {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:15:34 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 777e49ea-b674-4c3f-9cdd-ac2113032632] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:15:34 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 777e49ea-b674-4c3f-9cdd-ac2113032632] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72382) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 15:15:34 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 777e49ea-b674-4c3f-9cdd-ac2113032632] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 15:15:34 user nova-compute[72382]: INFO nova.compute.manager [None req-f816da71-40e8-4952-90c2-f2c3ed3b228b tempest-ServersNegativeTestJSON-1671359082 tempest-ServersNegativeTestJSON-1671359082-project-member] [instance: 777e49ea-b674-4c3f-9cdd-ac2113032632] Took 21.24 seconds to spawn the instance on the hypervisor.
Aug 09 15:15:34 user nova-compute[72382]: DEBUG nova.compute.manager [None req-f816da71-40e8-4952-90c2-f2c3ed3b228b tempest-ServersNegativeTestJSON-1671359082 tempest-ServersNegativeTestJSON-1671359082-project-member] [instance: 777e49ea-b674-4c3f-9cdd-ac2113032632] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:15:34 user nova-compute[72382]: INFO nova.compute.manager [None req-f816da71-40e8-4952-90c2-f2c3ed3b228b tempest-ServersNegativeTestJSON-1671359082 tempest-ServersNegativeTestJSON-1671359082-project-member] [instance: 777e49ea-b674-4c3f-9cdd-ac2113032632] Took 22.12 seconds to build instance.
Aug 09 15:15:34 user nova-compute[72382]: DEBUG nova.compute.provider_tree [None req-da354ed4-e0c5-47bc-b068-b96062ddd053 tempest-AttachSCSIVolumeTestJSON-1083630769 tempest-AttachSCSIVolumeTestJSON-1083630769-project-member] Inventory has not changed in ProviderTree for provider: 7b15b0e5-df4d-49db-833b-2855d21d10ae {{(pid=72382) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 15:15:34 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-f816da71-40e8-4952-90c2-f2c3ed3b228b tempest-ServersNegativeTestJSON-1671359082 tempest-ServersNegativeTestJSON-1671359082-project-member] Lock "777e49ea-b674-4c3f-9cdd-ac2113032632" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 22.342s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:15:34 user nova-compute[72382]: DEBUG nova.scheduler.client.report [None req-da354ed4-e0c5-47bc-b068-b96062ddd053 tempest-AttachSCSIVolumeTestJSON-1083630769 tempest-AttachSCSIVolumeTestJSON-1083630769-project-member] Inventory has not changed for provider 7b15b0e5-df4d-49db-833b-2855d21d10ae based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72382) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 15:15:34 user nova-compute[72382]: DEBUG nova.compute.manager [req-3389faed-ea32-499a-b42f-6abff39773f7 req-863d7238-540f-4fc0-a86e-d0728bfc119b service nova] [instance: c9766433-4c5a-40ed-a212-715a24f42b91] Received event network-vif-plugged-599dae3b-13bb-47af-b889-0037e03d5e31 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:15:34 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-3389faed-ea32-499a-b42f-6abff39773f7 req-863d7238-540f-4fc0-a86e-d0728bfc119b service nova] Acquiring lock "c9766433-4c5a-40ed-a212-715a24f42b91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:15:34 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-3389faed-ea32-499a-b42f-6abff39773f7 req-863d7238-540f-4fc0-a86e-d0728bfc119b service nova] Lock "c9766433-4c5a-40ed-a212-715a24f42b91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:15:34 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-3389faed-ea32-499a-b42f-6abff39773f7 req-863d7238-540f-4fc0-a86e-d0728bfc119b service nova] Lock "c9766433-4c5a-40ed-a212-715a24f42b91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:15:34 user nova-compute[72382]: DEBUG nova.compute.manager [req-3389faed-ea32-499a-b42f-6abff39773f7 req-863d7238-540f-4fc0-a86e-d0728bfc119b service nova] [instance: c9766433-4c5a-40ed-a212-715a24f42b91] No waiting events found dispatching network-vif-plugged-599dae3b-13bb-47af-b889-0037e03d5e31 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:15:34 user nova-compute[72382]: WARNING nova.compute.manager [req-3389faed-ea32-499a-b42f-6abff39773f7 req-863d7238-540f-4fc0-a86e-d0728bfc119b service nova] [instance: c9766433-4c5a-40ed-a212-715a24f42b91] Received unexpected event network-vif-plugged-599dae3b-13bb-47af-b889-0037e03d5e31 for instance with vm_state building and task_state spawning.
Aug 09 15:15:34 user nova-compute[72382]: DEBUG nova.compute.manager [req-3389faed-ea32-499a-b42f-6abff39773f7 req-863d7238-540f-4fc0-a86e-d0728bfc119b service nova] [instance: 266be814-4a2b-4f8e-a0f6-e8821fdeb95d] Received event network-vif-plugged-48650c01-c5a9-44f2-a481-5120c429a5a5 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:15:34 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-3389faed-ea32-499a-b42f-6abff39773f7 req-863d7238-540f-4fc0-a86e-d0728bfc119b service nova] Acquiring lock "266be814-4a2b-4f8e-a0f6-e8821fdeb95d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:15:34 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-3389faed-ea32-499a-b42f-6abff39773f7 req-863d7238-540f-4fc0-a86e-d0728bfc119b service nova] Lock "266be814-4a2b-4f8e-a0f6-e8821fdeb95d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:15:34 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-3389faed-ea32-499a-b42f-6abff39773f7 req-863d7238-540f-4fc0-a86e-d0728bfc119b service nova] Lock "266be814-4a2b-4f8e-a0f6-e8821fdeb95d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:15:34 user nova-compute[72382]: DEBUG nova.compute.manager [req-3389faed-ea32-499a-b42f-6abff39773f7 req-863d7238-540f-4fc0-a86e-d0728bfc119b service nova] [instance: 266be814-4a2b-4f8e-a0f6-e8821fdeb95d] No waiting events found dispatching network-vif-plugged-48650c01-c5a9-44f2-a481-5120c429a5a5 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:15:34 user nova-compute[72382]: WARNING nova.compute.manager [req-3389faed-ea32-499a-b42f-6abff39773f7 req-863d7238-540f-4fc0-a86e-d0728bfc119b service nova] [instance: 266be814-4a2b-4f8e-a0f6-e8821fdeb95d] Received unexpected event network-vif-plugged-48650c01-c5a9-44f2-a481-5120c429a5a5 for instance with vm_state building and task_state spawning.
Aug 09 15:15:34 user nova-compute[72382]: DEBUG nova.compute.manager [req-3389faed-ea32-499a-b42f-6abff39773f7 req-863d7238-540f-4fc0-a86e-d0728bfc119b service nova] [instance: 266be814-4a2b-4f8e-a0f6-e8821fdeb95d] Received event network-vif-plugged-48650c01-c5a9-44f2-a481-5120c429a5a5 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:15:34 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-3389faed-ea32-499a-b42f-6abff39773f7 req-863d7238-540f-4fc0-a86e-d0728bfc119b service nova] Acquiring lock "266be814-4a2b-4f8e-a0f6-e8821fdeb95d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:15:34 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-3389faed-ea32-499a-b42f-6abff39773f7 req-863d7238-540f-4fc0-a86e-d0728bfc119b service nova] Lock "266be814-4a2b-4f8e-a0f6-e8821fdeb95d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:15:34 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-3389faed-ea32-499a-b42f-6abff39773f7 req-863d7238-540f-4fc0-a86e-d0728bfc119b service nova] Lock "266be814-4a2b-4f8e-a0f6-e8821fdeb95d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:15:34 user nova-compute[72382]: DEBUG nova.compute.manager [req-3389faed-ea32-499a-b42f-6abff39773f7 req-863d7238-540f-4fc0-a86e-d0728bfc119b service nova] [instance: 266be814-4a2b-4f8e-a0f6-e8821fdeb95d] No waiting events found dispatching network-vif-plugged-48650c01-c5a9-44f2-a481-5120c429a5a5 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:15:34 user nova-compute[72382]: WARNING nova.compute.manager [req-3389faed-ea32-499a-b42f-6abff39773f7 req-863d7238-540f-4fc0-a86e-d0728bfc119b service nova] [instance: 266be814-4a2b-4f8e-a0f6-e8821fdeb95d] Received unexpected event network-vif-plugged-48650c01-c5a9-44f2-a481-5120c429a5a5 for instance with vm_state building and task_state spawning.
Aug 09 15:15:34 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-da354ed4-e0c5-47bc-b068-b96062ddd053 tempest-AttachSCSIVolumeTestJSON-1083630769 tempest-AttachSCSIVolumeTestJSON-1083630769-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.682s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:15:34 user nova-compute[72382]: DEBUG nova.compute.manager [None req-da354ed4-e0c5-47bc-b068-b96062ddd053 tempest-AttachSCSIVolumeTestJSON-1083630769 tempest-AttachSCSIVolumeTestJSON-1083630769-project-member] [instance: 24b63f7a-be32-424b-b72c-d5bec43c408e] Start building networks asynchronously for instance. {{(pid=72382) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 15:15:34 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:15:34 user nova-compute[72382]: DEBUG nova.compute.manager [None req-da354ed4-e0c5-47bc-b068-b96062ddd053 tempest-AttachSCSIVolumeTestJSON-1083630769 tempest-AttachSCSIVolumeTestJSON-1083630769-project-member] [instance: 24b63f7a-be32-424b-b72c-d5bec43c408e] Allocating IP information in the background. {{(pid=72382) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 15:15:34 user nova-compute[72382]: DEBUG nova.network.neutron [None req-da354ed4-e0c5-47bc-b068-b96062ddd053 tempest-AttachSCSIVolumeTestJSON-1083630769 tempest-AttachSCSIVolumeTestJSON-1083630769-project-member] [instance: 24b63f7a-be32-424b-b72c-d5bec43c408e] allocate_for_instance() {{(pid=72382) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 15:15:34 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-da354ed4-e0c5-47bc-b068-b96062ddd053 tempest-AttachSCSIVolumeTestJSON-1083630769 tempest-AttachSCSIVolumeTestJSON-1083630769-project-member] [instance: 24b63f7a-be32-424b-b72c-d5bec43c408e] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Aug 09 15:15:34 user nova-compute[72382]: DEBUG nova.compute.manager [None req-da354ed4-e0c5-47bc-b068-b96062ddd053 tempest-AttachSCSIVolumeTestJSON-1083630769 tempest-AttachSCSIVolumeTestJSON-1083630769-project-member] [instance: 24b63f7a-be32-424b-b72c-d5bec43c408e] Start building block device mappings for instance. {{(pid=72382) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 15:15:34 user nova-compute[72382]: DEBUG nova.compute.manager [req-9c51de14-550d-416b-ade4-cf6676d2d34d req-531e7ef3-382e-4fae-8ae3-7b2277519075 service nova] [instance: 44afd1bf-fa5c-4b3e-8752-b16853fef54e] Received event network-vif-plugged-2a1d4c60-bc2a-4530-b3bd-2a12ae2d2098 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:15:34 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-9c51de14-550d-416b-ade4-cf6676d2d34d req-531e7ef3-382e-4fae-8ae3-7b2277519075 service nova] Acquiring lock "44afd1bf-fa5c-4b3e-8752-b16853fef54e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:15:34 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-9c51de14-550d-416b-ade4-cf6676d2d34d req-531e7ef3-382e-4fae-8ae3-7b2277519075 service nova] Lock "44afd1bf-fa5c-4b3e-8752-b16853fef54e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:15:34 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-9c51de14-550d-416b-ade4-cf6676d2d34d req-531e7ef3-382e-4fae-8ae3-7b2277519075 service nova] Lock "44afd1bf-fa5c-4b3e-8752-b16853fef54e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:15:34 user nova-compute[72382]: DEBUG nova.compute.manager [req-9c51de14-550d-416b-ade4-cf6676d2d34d req-531e7ef3-382e-4fae-8ae3-7b2277519075 service nova] [instance: 44afd1bf-fa5c-4b3e-8752-b16853fef54e] No waiting events found dispatching network-vif-plugged-2a1d4c60-bc2a-4530-b3bd-2a12ae2d2098 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:15:34 user nova-compute[72382]: WARNING nova.compute.manager [req-9c51de14-550d-416b-ade4-cf6676d2d34d req-531e7ef3-382e-4fae-8ae3-7b2277519075 service nova] [instance: 44afd1bf-fa5c-4b3e-8752-b16853fef54e] Received unexpected event network-vif-plugged-2a1d4c60-bc2a-4530-b3bd-2a12ae2d2098 for instance with vm_state building and task_state spawning.
Aug 09 15:15:35 user nova-compute[72382]: DEBUG nova.compute.manager [None req-da354ed4-e0c5-47bc-b068-b96062ddd053 tempest-AttachSCSIVolumeTestJSON-1083630769 tempest-AttachSCSIVolumeTestJSON-1083630769-project-member] [instance: 24b63f7a-be32-424b-b72c-d5bec43c408e] Start spawning the instance on the hypervisor. {{(pid=72382) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 15:15:35 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-da354ed4-e0c5-47bc-b068-b96062ddd053 tempest-AttachSCSIVolumeTestJSON-1083630769 tempest-AttachSCSIVolumeTestJSON-1083630769-project-member] [instance: 24b63f7a-be32-424b-b72c-d5bec43c408e] Creating instance directory {{(pid=72382) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 15:15:35 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-da354ed4-e0c5-47bc-b068-b96062ddd053 tempest-AttachSCSIVolumeTestJSON-1083630769 tempest-AttachSCSIVolumeTestJSON-1083630769-project-member] [instance: 24b63f7a-be32-424b-b72c-d5bec43c408e] Creating image(s)
Aug 09 15:15:35 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-da354ed4-e0c5-47bc-b068-b96062ddd053 tempest-AttachSCSIVolumeTestJSON-1083630769 tempest-AttachSCSIVolumeTestJSON-1083630769-project-member] Acquiring lock "/opt/stack/data/nova/instances/24b63f7a-be32-424b-b72c-d5bec43c408e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:15:35 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-da354ed4-e0c5-47bc-b068-b96062ddd053 tempest-AttachSCSIVolumeTestJSON-1083630769 tempest-AttachSCSIVolumeTestJSON-1083630769-project-member] Lock "/opt/stack/data/nova/instances/24b63f7a-be32-424b-b72c-d5bec43c408e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:15:35 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-da354ed4-e0c5-47bc-b068-b96062ddd053 tempest-AttachSCSIVolumeTestJSON-1083630769 tempest-AttachSCSIVolumeTestJSON-1083630769-project-member] Lock "/opt/stack/data/nova/instances/24b63f7a-be32-424b-b72c-d5bec43c408e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:15:35 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-da354ed4-e0c5-47bc-b068-b96062ddd053 tempest-AttachSCSIVolumeTestJSON-1083630769 tempest-AttachSCSIVolumeTestJSON-1083630769-project-member] Acquiring lock "833a4b5481e57761a95d6384779cacacf7c5926a" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:15:35 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-da354ed4-e0c5-47bc-b068-b96062ddd053 tempest-AttachSCSIVolumeTestJSON-1083630769 tempest-AttachSCSIVolumeTestJSON-1083630769-project-member] Lock "833a4b5481e57761a95d6384779cacacf7c5926a" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:15:35 user nova-compute[72382]: DEBUG nova.policy [None req-da354ed4-e0c5-47bc-b068-b96062ddd053 tempest-AttachSCSIVolumeTestJSON-1083630769 tempest-AttachSCSIVolumeTestJSON-1083630769-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '100263f546ec45938377bcbdfcf6ea0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33e667025294028aa560b26d80d81a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72382) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 15:15:35 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-da354ed4-e0c5-47bc-b068-b96062ddd053 tempest-AttachSCSIVolumeTestJSON-1083630769 tempest-AttachSCSIVolumeTestJSON-1083630769-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/833a4b5481e57761a95d6384779cacacf7c5926a.part --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:15:35 user nova-compute[72382]: DEBUG nova.virt.driver [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Emitting event <LifecycleEvent: 1691594135.4040694, 44afd1bf-fa5c-4b3e-8752-b16853fef54e => Resumed> {{(pid=72382) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 15:15:35 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 44afd1bf-fa5c-4b3e-8752-b16853fef54e] VM Resumed (Lifecycle Event)
Aug 09 15:15:35 user nova-compute[72382]: DEBUG nova.compute.manager [None req-16966d1a-588d-41b9-ae61-b46d67b5d3b8 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] [instance: 44afd1bf-fa5c-4b3e-8752-b16853fef54e] Instance event wait completed in 0 seconds for  {{(pid=72382) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 15:15:35 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-16966d1a-588d-41b9-ae61-b46d67b5d3b8 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] [instance: 44afd1bf-fa5c-4b3e-8752-b16853fef54e] Guest created on hypervisor {{(pid=72382) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 15:15:35 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 44afd1bf-fa5c-4b3e-8752-b16853fef54e] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:15:35 user nova-compute[72382]: INFO nova.virt.libvirt.driver [-] [instance: 44afd1bf-fa5c-4b3e-8752-b16853fef54e] Instance spawned successfully.
Aug 09 15:15:35 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-16966d1a-588d-41b9-ae61-b46d67b5d3b8 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] [instance: 44afd1bf-fa5c-4b3e-8752-b16853fef54e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 15:15:35 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-da354ed4-e0c5-47bc-b068-b96062ddd053 tempest-AttachSCSIVolumeTestJSON-1083630769 tempest-AttachSCSIVolumeTestJSON-1083630769-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/833a4b5481e57761a95d6384779cacacf7c5926a.part --force-share --output=json" returned: 0 in 0.152s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:15:35 user nova-compute[72382]: DEBUG nova.virt.images [None req-da354ed4-e0c5-47bc-b068-b96062ddd053 tempest-AttachSCSIVolumeTestJSON-1083630769 tempest-AttachSCSIVolumeTestJSON-1083630769-project-member] b177d706-cfc5-43a0-af20-d585b803cf65 was qcow2, converting to raw {{(pid=72382) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 09 15:15:35 user nova-compute[72382]: DEBUG nova.privsep.utils [None req-da354ed4-e0c5-47bc-b068-b96062ddd053 tempest-AttachSCSIVolumeTestJSON-1083630769 tempest-AttachSCSIVolumeTestJSON-1083630769-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72382) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 09 15:15:35 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-da354ed4-e0c5-47bc-b068-b96062ddd053 tempest-AttachSCSIVolumeTestJSON-1083630769 tempest-AttachSCSIVolumeTestJSON-1083630769-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/833a4b5481e57761a95d6384779cacacf7c5926a.part /opt/stack/data/nova/instances/_base/833a4b5481e57761a95d6384779cacacf7c5926a.converted {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:15:35 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 44afd1bf-fa5c-4b3e-8752-b16853fef54e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72382) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 15:15:35 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-16966d1a-588d-41b9-ae61-b46d67b5d3b8 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] [instance: 44afd1bf-fa5c-4b3e-8752-b16853fef54e] Found default for hw_cdrom_bus of ide {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:15:35 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-16966d1a-588d-41b9-ae61-b46d67b5d3b8 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] [instance: 44afd1bf-fa5c-4b3e-8752-b16853fef54e] Found default for hw_disk_bus of virtio {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:15:35 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-16966d1a-588d-41b9-ae61-b46d67b5d3b8 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] [instance: 44afd1bf-fa5c-4b3e-8752-b16853fef54e] Found default for hw_input_bus of None {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:15:35 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-16966d1a-588d-41b9-ae61-b46d67b5d3b8 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] [instance: 44afd1bf-fa5c-4b3e-8752-b16853fef54e] Found default for hw_pointer_model of None {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:15:35 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-16966d1a-588d-41b9-ae61-b46d67b5d3b8 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] [instance: 44afd1bf-fa5c-4b3e-8752-b16853fef54e] Found default for hw_video_model of virtio {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:15:35 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-16966d1a-588d-41b9-ae61-b46d67b5d3b8 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] [instance: 44afd1bf-fa5c-4b3e-8752-b16853fef54e] Found default for hw_vif_model of virtio {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:15:35 user nova-compute[72382]: DEBUG nova.compute.manager [None req-bd0bf5c4-b736-4591-85ca-5fff7abbf4d1 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] [instance: 266be814-4a2b-4f8e-a0f6-e8821fdeb95d] Instance event wait completed in 0 seconds for  {{(pid=72382) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 15:15:35 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-bd0bf5c4-b736-4591-85ca-5fff7abbf4d1 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] [instance: 266be814-4a2b-4f8e-a0f6-e8821fdeb95d] Guest created on hypervisor {{(pid=72382) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 15:15:35 user nova-compute[72382]: INFO nova.virt.libvirt.driver [-] [instance: 266be814-4a2b-4f8e-a0f6-e8821fdeb95d] Instance spawned successfully.
Aug 09 15:15:35 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-bd0bf5c4-b736-4591-85ca-5fff7abbf4d1 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] [instance: 266be814-4a2b-4f8e-a0f6-e8821fdeb95d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 15:15:35 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 44afd1bf-fa5c-4b3e-8752-b16853fef54e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 15:15:35 user nova-compute[72382]: DEBUG nova.virt.driver [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Emitting event <LifecycleEvent: 1691594135.4049263, 44afd1bf-fa5c-4b3e-8752-b16853fef54e => Started> {{(pid=72382) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 15:15:35 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 44afd1bf-fa5c-4b3e-8752-b16853fef54e] VM Started (Lifecycle Event)
Aug 09 15:15:35 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 44afd1bf-fa5c-4b3e-8752-b16853fef54e] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:15:35 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-bd0bf5c4-b736-4591-85ca-5fff7abbf4d1 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] [instance: 266be814-4a2b-4f8e-a0f6-e8821fdeb95d] Found default for hw_cdrom_bus of ide {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:15:35 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-bd0bf5c4-b736-4591-85ca-5fff7abbf4d1 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] [instance: 266be814-4a2b-4f8e-a0f6-e8821fdeb95d] Found default for hw_disk_bus of virtio {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:15:35 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-bd0bf5c4-b736-4591-85ca-5fff7abbf4d1 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] [instance: 266be814-4a2b-4f8e-a0f6-e8821fdeb95d] Found default for hw_input_bus of None {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:15:35 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-bd0bf5c4-b736-4591-85ca-5fff7abbf4d1 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] [instance: 266be814-4a2b-4f8e-a0f6-e8821fdeb95d] Found default for hw_pointer_model of None {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:15:35 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-bd0bf5c4-b736-4591-85ca-5fff7abbf4d1 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] [instance: 266be814-4a2b-4f8e-a0f6-e8821fdeb95d] Found default for hw_video_model of virtio {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:15:35 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-bd0bf5c4-b736-4591-85ca-5fff7abbf4d1 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] [instance: 266be814-4a2b-4f8e-a0f6-e8821fdeb95d] Found default for hw_vif_model of virtio {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:15:35 user nova-compute[72382]: INFO nova.compute.manager [None req-16966d1a-588d-41b9-ae61-b46d67b5d3b8 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] [instance: 44afd1bf-fa5c-4b3e-8752-b16853fef54e] Took 21.89 seconds to spawn the instance on the hypervisor.
Aug 09 15:15:35 user nova-compute[72382]: DEBUG nova.compute.manager [None req-16966d1a-588d-41b9-ae61-b46d67b5d3b8 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] [instance: 44afd1bf-fa5c-4b3e-8752-b16853fef54e] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:15:35 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 44afd1bf-fa5c-4b3e-8752-b16853fef54e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72382) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 15:15:36 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 44afd1bf-fa5c-4b3e-8752-b16853fef54e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 15:15:36 user nova-compute[72382]: DEBUG nova.virt.driver [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Emitting event <LifecycleEvent: 1691594135.8475218, 266be814-4a2b-4f8e-a0f6-e8821fdeb95d => Resumed> {{(pid=72382) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 15:15:36 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 266be814-4a2b-4f8e-a0f6-e8821fdeb95d] VM Resumed (Lifecycle Event)
Aug 09 15:15:36 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-da354ed4-e0c5-47bc-b068-b96062ddd053 tempest-AttachSCSIVolumeTestJSON-1083630769 tempest-AttachSCSIVolumeTestJSON-1083630769-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/833a4b5481e57761a95d6384779cacacf7c5926a.part /opt/stack/data/nova/instances/_base/833a4b5481e57761a95d6384779cacacf7c5926a.converted" returned: 0 in 0.315s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:15:36 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-da354ed4-e0c5-47bc-b068-b96062ddd053 tempest-AttachSCSIVolumeTestJSON-1083630769 tempest-AttachSCSIVolumeTestJSON-1083630769-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/833a4b5481e57761a95d6384779cacacf7c5926a.converted --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:15:36 user nova-compute[72382]: DEBUG nova.compute.manager [None req-48177f7f-2ba7-494f-8af2-3b8ef01c79c3 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] [instance: c9766433-4c5a-40ed-a212-715a24f42b91] Instance event wait completed in 0 seconds for  {{(pid=72382) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 15:15:36 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-48177f7f-2ba7-494f-8af2-3b8ef01c79c3 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] [instance: c9766433-4c5a-40ed-a212-715a24f42b91] Guest created on hypervisor {{(pid=72382) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 15:15:36 user nova-compute[72382]: INFO nova.compute.manager [None req-bd0bf5c4-b736-4591-85ca-5fff7abbf4d1 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] [instance: 266be814-4a2b-4f8e-a0f6-e8821fdeb95d] Took 19.31 seconds to spawn the instance on the hypervisor.
Aug 09 15:15:36 user nova-compute[72382]: DEBUG nova.compute.manager [None req-bd0bf5c4-b736-4591-85ca-5fff7abbf4d1 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] [instance: 266be814-4a2b-4f8e-a0f6-e8821fdeb95d] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:15:36 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 266be814-4a2b-4f8e-a0f6-e8821fdeb95d] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:15:36 user nova-compute[72382]: INFO nova.compute.manager [None req-16966d1a-588d-41b9-ae61-b46d67b5d3b8 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] [instance: 44afd1bf-fa5c-4b3e-8752-b16853fef54e] Took 22.76 seconds to build instance.
Aug 09 15:15:36 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 266be814-4a2b-4f8e-a0f6-e8821fdeb95d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72382) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 15:15:36 user nova-compute[72382]: INFO nova.virt.libvirt.driver [-] [instance: c9766433-4c5a-40ed-a212-715a24f42b91] Instance spawned successfully.
Aug 09 15:15:36 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-48177f7f-2ba7-494f-8af2-3b8ef01c79c3 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] [instance: c9766433-4c5a-40ed-a212-715a24f42b91] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 15:15:36 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-16966d1a-588d-41b9-ae61-b46d67b5d3b8 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Lock "44afd1bf-fa5c-4b3e-8752-b16853fef54e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 22.963s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:15:36 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-48177f7f-2ba7-494f-8af2-3b8ef01c79c3 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] [instance: c9766433-4c5a-40ed-a212-715a24f42b91] Found default for hw_cdrom_bus of ide {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:15:36 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-48177f7f-2ba7-494f-8af2-3b8ef01c79c3 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] [instance: c9766433-4c5a-40ed-a212-715a24f42b91] Found default for hw_disk_bus of virtio {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:15:36 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-48177f7f-2ba7-494f-8af2-3b8ef01c79c3 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] [instance: c9766433-4c5a-40ed-a212-715a24f42b91] Found default for hw_input_bus of None {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:15:36 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-48177f7f-2ba7-494f-8af2-3b8ef01c79c3 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] [instance: c9766433-4c5a-40ed-a212-715a24f42b91] Found default for hw_pointer_model of None {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:15:36 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-48177f7f-2ba7-494f-8af2-3b8ef01c79c3 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] [instance: c9766433-4c5a-40ed-a212-715a24f42b91] Found default for hw_video_model of virtio {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:15:36 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-48177f7f-2ba7-494f-8af2-3b8ef01c79c3 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] [instance: c9766433-4c5a-40ed-a212-715a24f42b91] Found default for hw_vif_model of virtio {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:15:36 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 266be814-4a2b-4f8e-a0f6-e8821fdeb95d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 15:15:36 user nova-compute[72382]: DEBUG nova.virt.driver [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Emitting event <LifecycleEvent: 1691594135.8530712, 266be814-4a2b-4f8e-a0f6-e8821fdeb95d => Started> {{(pid=72382) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 15:15:36 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 266be814-4a2b-4f8e-a0f6-e8821fdeb95d] VM Started (Lifecycle Event)
Aug 09 15:15:36 user nova-compute[72382]: INFO nova.compute.manager [None req-bd0bf5c4-b736-4591-85ca-5fff7abbf4d1 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] [instance: 266be814-4a2b-4f8e-a0f6-e8821fdeb95d] Took 20.05 seconds to build instance.
Aug 09 15:15:36 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 266be814-4a2b-4f8e-a0f6-e8821fdeb95d] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:15:36 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-da354ed4-e0c5-47bc-b068-b96062ddd053 tempest-AttachSCSIVolumeTestJSON-1083630769 tempest-AttachSCSIVolumeTestJSON-1083630769-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/833a4b5481e57761a95d6384779cacacf7c5926a.converted --force-share --output=json" returned: 0 in 0.255s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:15:36 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-da354ed4-e0c5-47bc-b068-b96062ddd053 tempest-AttachSCSIVolumeTestJSON-1083630769 tempest-AttachSCSIVolumeTestJSON-1083630769-project-member] Lock "833a4b5481e57761a95d6384779cacacf7c5926a" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.263s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:15:36 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-da354ed4-e0c5-47bc-b068-b96062ddd053 tempest-AttachSCSIVolumeTestJSON-1083630769 tempest-AttachSCSIVolumeTestJSON-1083630769-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/833a4b5481e57761a95d6384779cacacf7c5926a --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:15:36 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-bd0bf5c4-b736-4591-85ca-5fff7abbf4d1 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Lock "266be814-4a2b-4f8e-a0f6-e8821fdeb95d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.337s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:15:36 user nova-compute[72382]: INFO nova.compute.manager [None req-48177f7f-2ba7-494f-8af2-3b8ef01c79c3 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] [instance: c9766433-4c5a-40ed-a212-715a24f42b91] Took 16.77 seconds to spawn the instance on the hypervisor.
Aug 09 15:15:36 user nova-compute[72382]: DEBUG nova.compute.manager [None req-48177f7f-2ba7-494f-8af2-3b8ef01c79c3 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] [instance: c9766433-4c5a-40ed-a212-715a24f42b91] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:15:36 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 266be814-4a2b-4f8e-a0f6-e8821fdeb95d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72382) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 15:15:36 user nova-compute[72382]: DEBUG nova.virt.driver [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Emitting event <LifecycleEvent: 1691594136.0864446, c9766433-4c5a-40ed-a212-715a24f42b91 => Resumed> {{(pid=72382) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 15:15:36 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: c9766433-4c5a-40ed-a212-715a24f42b91] VM Resumed (Lifecycle Event)
Aug 09 15:15:36 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: c9766433-4c5a-40ed-a212-715a24f42b91] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:15:36 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-da354ed4-e0c5-47bc-b068-b96062ddd053 tempest-AttachSCSIVolumeTestJSON-1083630769 tempest-AttachSCSIVolumeTestJSON-1083630769-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/833a4b5481e57761a95d6384779cacacf7c5926a --force-share --output=json" returned: 0 in 0.186s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:15:36 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-da354ed4-e0c5-47bc-b068-b96062ddd053 tempest-AttachSCSIVolumeTestJSON-1083630769 tempest-AttachSCSIVolumeTestJSON-1083630769-project-member] Acquiring lock "833a4b5481e57761a95d6384779cacacf7c5926a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:15:36 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-da354ed4-e0c5-47bc-b068-b96062ddd053 tempest-AttachSCSIVolumeTestJSON-1083630769 tempest-AttachSCSIVolumeTestJSON-1083630769-project-member] Lock "833a4b5481e57761a95d6384779cacacf7c5926a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:15:36 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-da354ed4-e0c5-47bc-b068-b96062ddd053 tempest-AttachSCSIVolumeTestJSON-1083630769 tempest-AttachSCSIVolumeTestJSON-1083630769-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/833a4b5481e57761a95d6384779cacacf7c5926a --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:15:36 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: c9766433-4c5a-40ed-a212-715a24f42b91] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72382) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 15:15:36 user nova-compute[72382]: DEBUG nova.network.neutron [None req-da354ed4-e0c5-47bc-b068-b96062ddd053 tempest-AttachSCSIVolumeTestJSON-1083630769 tempest-AttachSCSIVolumeTestJSON-1083630769-project-member] [instance: 24b63f7a-be32-424b-b72c-d5bec43c408e] Successfully created port: f21a4544-6f79-47c6-8577-f5e8d2b440bd {{(pid=72382) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 15:15:36 user nova-compute[72382]: INFO nova.compute.manager [None req-48177f7f-2ba7-494f-8af2-3b8ef01c79c3 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] [instance: c9766433-4c5a-40ed-a212-715a24f42b91] Took 17.81 seconds to build instance.
Aug 09 15:15:36 user nova-compute[72382]: DEBUG nova.virt.driver [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Emitting event <LifecycleEvent: 1691594136.0880075, c9766433-4c5a-40ed-a212-715a24f42b91 => Started> {{(pid=72382) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 15:15:36 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: c9766433-4c5a-40ed-a212-715a24f42b91] VM Started (Lifecycle Event)
Aug 09 15:15:36 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: c9766433-4c5a-40ed-a212-715a24f42b91] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:15:36 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-da354ed4-e0c5-47bc-b068-b96062ddd053 tempest-AttachSCSIVolumeTestJSON-1083630769 tempest-AttachSCSIVolumeTestJSON-1083630769-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/833a4b5481e57761a95d6384779cacacf7c5926a --force-share --output=json" returned: 0 in 0.212s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:15:36 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-da354ed4-e0c5-47bc-b068-b96062ddd053 tempest-AttachSCSIVolumeTestJSON-1083630769 tempest-AttachSCSIVolumeTestJSON-1083630769-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/833a4b5481e57761a95d6384779cacacf7c5926a,backing_fmt=raw /opt/stack/data/nova/instances/24b63f7a-be32-424b-b72c-d5bec43c408e/disk 1073741824 {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:15:36 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-48177f7f-2ba7-494f-8af2-3b8ef01c79c3 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Lock "c9766433-4c5a-40ed-a212-715a24f42b91" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.044s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:15:36 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: c9766433-4c5a-40ed-a212-715a24f42b91] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72382) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 15:15:36 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-da354ed4-e0c5-47bc-b068-b96062ddd053 tempest-AttachSCSIVolumeTestJSON-1083630769 tempest-AttachSCSIVolumeTestJSON-1083630769-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/833a4b5481e57761a95d6384779cacacf7c5926a,backing_fmt=raw /opt/stack/data/nova/instances/24b63f7a-be32-424b-b72c-d5bec43c408e/disk 1073741824" returned: 0 in 0.077s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:15:36 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-da354ed4-e0c5-47bc-b068-b96062ddd053 tempest-AttachSCSIVolumeTestJSON-1083630769 tempest-AttachSCSIVolumeTestJSON-1083630769-project-member] Lock "833a4b5481e57761a95d6384779cacacf7c5926a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.293s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:15:36 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-da354ed4-e0c5-47bc-b068-b96062ddd053 tempest-AttachSCSIVolumeTestJSON-1083630769 tempest-AttachSCSIVolumeTestJSON-1083630769-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/833a4b5481e57761a95d6384779cacacf7c5926a --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:15:37 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-da354ed4-e0c5-47bc-b068-b96062ddd053 tempest-AttachSCSIVolumeTestJSON-1083630769 tempest-AttachSCSIVolumeTestJSON-1083630769-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/833a4b5481e57761a95d6384779cacacf7c5926a --force-share --output=json" returned: 0 in 0.265s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:15:37 user nova-compute[72382]: DEBUG nova.compute.manager [req-01757de5-15ca-4cea-ba20-fb8a773ae98d req-4e907c7e-0911-48e0-aeae-57d88dd2164c service nova] [instance: 44afd1bf-fa5c-4b3e-8752-b16853fef54e] Received event network-vif-plugged-2a1d4c60-bc2a-4530-b3bd-2a12ae2d2098 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:15:37 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-01757de5-15ca-4cea-ba20-fb8a773ae98d req-4e907c7e-0911-48e0-aeae-57d88dd2164c service nova] Acquiring lock "44afd1bf-fa5c-4b3e-8752-b16853fef54e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:15:37 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-01757de5-15ca-4cea-ba20-fb8a773ae98d req-4e907c7e-0911-48e0-aeae-57d88dd2164c service nova] Lock "44afd1bf-fa5c-4b3e-8752-b16853fef54e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:15:37 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-01757de5-15ca-4cea-ba20-fb8a773ae98d req-4e907c7e-0911-48e0-aeae-57d88dd2164c service nova] Lock "44afd1bf-fa5c-4b3e-8752-b16853fef54e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:15:37 user nova-compute[72382]: DEBUG nova.compute.manager [req-01757de5-15ca-4cea-ba20-fb8a773ae98d req-4e907c7e-0911-48e0-aeae-57d88dd2164c service nova] [instance: 44afd1bf-fa5c-4b3e-8752-b16853fef54e] No waiting events found dispatching network-vif-plugged-2a1d4c60-bc2a-4530-b3bd-2a12ae2d2098 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:15:37 user nova-compute[72382]: WARNING nova.compute.manager [req-01757de5-15ca-4cea-ba20-fb8a773ae98d req-4e907c7e-0911-48e0-aeae-57d88dd2164c service nova] [instance: 44afd1bf-fa5c-4b3e-8752-b16853fef54e] Received unexpected event network-vif-plugged-2a1d4c60-bc2a-4530-b3bd-2a12ae2d2098 for instance with vm_state active and task_state None.
Aug 09 15:15:37 user nova-compute[72382]: DEBUG nova.virt.disk.api [None req-da354ed4-e0c5-47bc-b068-b96062ddd053 tempest-AttachSCSIVolumeTestJSON-1083630769 tempest-AttachSCSIVolumeTestJSON-1083630769-project-member] Checking if we can resize image /opt/stack/data/nova/instances/24b63f7a-be32-424b-b72c-d5bec43c408e/disk. size=1073741824 {{(pid=72382) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 15:15:37 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-da354ed4-e0c5-47bc-b068-b96062ddd053 tempest-AttachSCSIVolumeTestJSON-1083630769 tempest-AttachSCSIVolumeTestJSON-1083630769-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24b63f7a-be32-424b-b72c-d5bec43c408e/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:15:37 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-da354ed4-e0c5-47bc-b068-b96062ddd053 tempest-AttachSCSIVolumeTestJSON-1083630769 tempest-AttachSCSIVolumeTestJSON-1083630769-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24b63f7a-be32-424b-b72c-d5bec43c408e/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:15:37 user nova-compute[72382]: DEBUG nova.virt.disk.api [None req-da354ed4-e0c5-47bc-b068-b96062ddd053 tempest-AttachSCSIVolumeTestJSON-1083630769 tempest-AttachSCSIVolumeTestJSON-1083630769-project-member] Cannot resize image /opt/stack/data/nova/instances/24b63f7a-be32-424b-b72c-d5bec43c408e/disk to a smaller size. {{(pid=72382) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 15:15:37 user nova-compute[72382]: DEBUG nova.objects.instance [None req-da354ed4-e0c5-47bc-b068-b96062ddd053 tempest-AttachSCSIVolumeTestJSON-1083630769 tempest-AttachSCSIVolumeTestJSON-1083630769-project-member] Lazy-loading 'migration_context' on Instance uuid 24b63f7a-be32-424b-b72c-d5bec43c408e {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:15:37 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-da354ed4-e0c5-47bc-b068-b96062ddd053 tempest-AttachSCSIVolumeTestJSON-1083630769 tempest-AttachSCSIVolumeTestJSON-1083630769-project-member] [instance: 24b63f7a-be32-424b-b72c-d5bec43c408e] Created local disks {{(pid=72382) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 15:15:37 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-da354ed4-e0c5-47bc-b068-b96062ddd053 tempest-AttachSCSIVolumeTestJSON-1083630769 tempest-AttachSCSIVolumeTestJSON-1083630769-project-member] [instance: 24b63f7a-be32-424b-b72c-d5bec43c408e] Ensure instance console log exists: /opt/stack/data/nova/instances/24b63f7a-be32-424b-b72c-d5bec43c408e/console.log {{(pid=72382) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 15:15:37 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-da354ed4-e0c5-47bc-b068-b96062ddd053 tempest-AttachSCSIVolumeTestJSON-1083630769 tempest-AttachSCSIVolumeTestJSON-1083630769-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:15:37 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-da354ed4-e0c5-47bc-b068-b96062ddd053 tempest-AttachSCSIVolumeTestJSON-1083630769 tempest-AttachSCSIVolumeTestJSON-1083630769-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:15:37 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-da354ed4-e0c5-47bc-b068-b96062ddd053 tempest-AttachSCSIVolumeTestJSON-1083630769 tempest-AttachSCSIVolumeTestJSON-1083630769-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:15:38 user nova-compute[72382]: DEBUG nova.network.neutron [None req-da354ed4-e0c5-47bc-b068-b96062ddd053 tempest-AttachSCSIVolumeTestJSON-1083630769 tempest-AttachSCSIVolumeTestJSON-1083630769-project-member] [instance: 24b63f7a-be32-424b-b72c-d5bec43c408e] Successfully updated port: f21a4544-6f79-47c6-8577-f5e8d2b440bd {{(pid=72382) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 15:15:38 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:15:38 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:15:38 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-da354ed4-e0c5-47bc-b068-b96062ddd053 tempest-AttachSCSIVolumeTestJSON-1083630769 tempest-AttachSCSIVolumeTestJSON-1083630769-project-member] Acquiring lock "refresh_cache-24b63f7a-be32-424b-b72c-d5bec43c408e" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 15:15:38 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-da354ed4-e0c5-47bc-b068-b96062ddd053 tempest-AttachSCSIVolumeTestJSON-1083630769 tempest-AttachSCSIVolumeTestJSON-1083630769-project-member] Acquired lock "refresh_cache-24b63f7a-be32-424b-b72c-d5bec43c408e" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 15:15:38 user nova-compute[72382]: DEBUG nova.network.neutron [None req-da354ed4-e0c5-47bc-b068-b96062ddd053 tempest-AttachSCSIVolumeTestJSON-1083630769 tempest-AttachSCSIVolumeTestJSON-1083630769-project-member] [instance: 24b63f7a-be32-424b-b72c-d5bec43c408e] Building network info cache for instance {{(pid=72382) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 15:15:38 user nova-compute[72382]: DEBUG nova.network.neutron [None req-da354ed4-e0c5-47bc-b068-b96062ddd053 tempest-AttachSCSIVolumeTestJSON-1083630769 tempest-AttachSCSIVolumeTestJSON-1083630769-project-member] [instance: 24b63f7a-be32-424b-b72c-d5bec43c408e] Instance cache missing network info. {{(pid=72382) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 15:15:39 user nova-compute[72382]: DEBUG nova.compute.manager [req-28da1d97-6836-40b3-afbf-85ed4ec1018a req-1cc67cb4-d889-4db4-8806-313eb39b51b1 service nova] [instance: 24b63f7a-be32-424b-b72c-d5bec43c408e] Received event network-changed-f21a4544-6f79-47c6-8577-f5e8d2b440bd {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:15:39 user nova-compute[72382]: DEBUG nova.compute.manager [req-28da1d97-6836-40b3-afbf-85ed4ec1018a req-1cc67cb4-d889-4db4-8806-313eb39b51b1 service nova] [instance: 24b63f7a-be32-424b-b72c-d5bec43c408e] Refreshing instance network info cache due to event network-changed-f21a4544-6f79-47c6-8577-f5e8d2b440bd. {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 15:15:39 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-28da1d97-6836-40b3-afbf-85ed4ec1018a req-1cc67cb4-d889-4db4-8806-313eb39b51b1 service nova] Acquiring lock "refresh_cache-24b63f7a-be32-424b-b72c-d5bec43c408e" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 15:15:40 user nova-compute[72382]: DEBUG nova.network.neutron [None req-da354ed4-e0c5-47bc-b068-b96062ddd053 tempest-AttachSCSIVolumeTestJSON-1083630769 tempest-AttachSCSIVolumeTestJSON-1083630769-project-member] [instance: 24b63f7a-be32-424b-b72c-d5bec43c408e] Updating instance_info_cache with network_info: [{"id": "f21a4544-6f79-47c6-8577-f5e8d2b440bd", "address": "fa:16:3e:58:ca:e4", "network": {"id": "a87fbfc3-5f2b-427c-9337-e00cf40d8896", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1094857259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f33e667025294028aa560b26d80d81a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf21a4544-6f", "ovs_interfaceid": "f21a4544-6f79-47c6-8577-f5e8d2b440bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:15:40 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-1be031b3-15c8-4cce-9487-45bdffa176b1 tempest-VolumesAssistedSnapshotsTest-459543424 tempest-VolumesAssistedSnapshotsTest-459543424-project-member] Acquiring lock "f0a7fa25-4520-4f40-9515-b88e3d2fd910" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:15:40 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-1be031b3-15c8-4cce-9487-45bdffa176b1 tempest-VolumesAssistedSnapshotsTest-459543424 tempest-VolumesAssistedSnapshotsTest-459543424-project-member] Lock "f0a7fa25-4520-4f40-9515-b88e3d2fd910" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:15:40 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-da354ed4-e0c5-47bc-b068-b96062ddd053 tempest-AttachSCSIVolumeTestJSON-1083630769 tempest-AttachSCSIVolumeTestJSON-1083630769-project-member] Releasing lock "refresh_cache-24b63f7a-be32-424b-b72c-d5bec43c408e" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 15:15:40 user nova-compute[72382]: DEBUG nova.compute.manager [None req-da354ed4-e0c5-47bc-b068-b96062ddd053 tempest-AttachSCSIVolumeTestJSON-1083630769 tempest-AttachSCSIVolumeTestJSON-1083630769-project-member] [instance: 24b63f7a-be32-424b-b72c-d5bec43c408e] Instance network_info: |[{"id": "f21a4544-6f79-47c6-8577-f5e8d2b440bd", "address": "fa:16:3e:58:ca:e4", "network": {"id": "a87fbfc3-5f2b-427c-9337-e00cf40d8896", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1094857259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f33e667025294028aa560b26d80d81a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf21a4544-6f", "ovs_interfaceid": "f21a4544-6f79-47c6-8577-f5e8d2b440bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72382) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 15:15:40 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-28da1d97-6836-40b3-afbf-85ed4ec1018a req-1cc67cb4-d889-4db4-8806-313eb39b51b1 service nova] Acquired lock "refresh_cache-24b63f7a-be32-424b-b72c-d5bec43c408e" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 15:15:40 user nova-compute[72382]: DEBUG nova.network.neutron [req-28da1d97-6836-40b3-afbf-85ed4ec1018a req-1cc67cb4-d889-4db4-8806-313eb39b51b1 service nova] [instance: 24b63f7a-be32-424b-b72c-d5bec43c408e] Refreshing network info cache for port f21a4544-6f79-47c6-8577-f5e8d2b440bd {{(pid=72382) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 15:15:40 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-da354ed4-e0c5-47bc-b068-b96062ddd053 tempest-AttachSCSIVolumeTestJSON-1083630769 tempest-AttachSCSIVolumeTestJSON-1083630769-project-member] [instance: 24b63f7a-be32-424b-b72c-d5bec43c408e] Start _get_guest_xml network_info=[{"id": "f21a4544-6f79-47c6-8577-f5e8d2b440bd", "address": "fa:16:3e:58:ca:e4", "network": {"id": "a87fbfc3-5f2b-427c-9337-e00cf40d8896", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1094857259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f33e667025294028aa560b26d80d81a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf21a4544-6f", "ovs_interfaceid": "f21a4544-6f79-47c6-8577-f5e8d2b440bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T15:15:22Z,direct_url=<?>,disk_format='qcow2',id=b177d706-cfc5-43a0-af20-d585b803cf65,min_disk=0,min_ram=0,name='',owner='bf702312997d4203a23901f2ef603e59',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T15:15:25Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'size': 0, 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/sda', 'boot_index': 0, 'encryption_format': None, 'disk_bus': 'scsi', 'encrypted': False, 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'b177d706-cfc5-43a0-af20-d585b803cf65'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72382) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 15:15:40 user nova-compute[72382]: DEBUG nova.compute.manager [None req-1be031b3-15c8-4cce-9487-45bdffa176b1 tempest-VolumesAssistedSnapshotsTest-459543424 tempest-VolumesAssistedSnapshotsTest-459543424-project-member] [instance: f0a7fa25-4520-4f40-9515-b88e3d2fd910] Starting instance... {{(pid=72382) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 15:15:40 user nova-compute[72382]: WARNING nova.virt.libvirt.driver [None req-da354ed4-e0c5-47bc-b068-b96062ddd053 tempest-AttachSCSIVolumeTestJSON-1083630769 tempest-AttachSCSIVolumeTestJSON-1083630769-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 15:15:40 user nova-compute[72382]: WARNING nova.virt.libvirt.driver [None req-da354ed4-e0c5-47bc-b068-b96062ddd053 tempest-AttachSCSIVolumeTestJSON-1083630769 tempest-AttachSCSIVolumeTestJSON-1083630769-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 15:15:40 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-da354ed4-e0c5-47bc-b068-b96062ddd053 tempest-AttachSCSIVolumeTestJSON-1083630769 tempest-AttachSCSIVolumeTestJSON-1083630769-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72382) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 15:15:40 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-da354ed4-e0c5-47bc-b068-b96062ddd053 tempest-AttachSCSIVolumeTestJSON-1083630769 tempest-AttachSCSIVolumeTestJSON-1083630769-project-member] CPU controller missing on host. {{(pid=72382) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 15:15:40 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-da354ed4-e0c5-47bc-b068-b96062ddd053 tempest-AttachSCSIVolumeTestJSON-1083630769 tempest-AttachSCSIVolumeTestJSON-1083630769-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72382) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 15:15:40 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-da354ed4-e0c5-47bc-b068-b96062ddd053 tempest-AttachSCSIVolumeTestJSON-1083630769 tempest-AttachSCSIVolumeTestJSON-1083630769-project-member] CPU controller found on host. {{(pid=72382) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 15:15:40 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-da354ed4-e0c5-47bc-b068-b96062ddd053 tempest-AttachSCSIVolumeTestJSON-1083630769 tempest-AttachSCSIVolumeTestJSON-1083630769-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72382) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 15:15:40 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-da354ed4-e0c5-47bc-b068-b96062ddd053 tempest-AttachSCSIVolumeTestJSON-1083630769 tempest-AttachSCSIVolumeTestJSON-1083630769-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T15:11:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T15:15:22Z,direct_url=<?>,disk_format='qcow2',id=b177d706-cfc5-43a0-af20-d585b803cf65,min_disk=0,min_ram=0,name='',owner='bf702312997d4203a23901f2ef603e59',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T15:15:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 15:15:40 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-da354ed4-e0c5-47bc-b068-b96062ddd053 tempest-AttachSCSIVolumeTestJSON-1083630769 tempest-AttachSCSIVolumeTestJSON-1083630769-project-member] Flavor limits 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 15:15:40 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-da354ed4-e0c5-47bc-b068-b96062ddd053 tempest-AttachSCSIVolumeTestJSON-1083630769 tempest-AttachSCSIVolumeTestJSON-1083630769-project-member] Image limits 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 15:15:40 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-da354ed4-e0c5-47bc-b068-b96062ddd053 tempest-AttachSCSIVolumeTestJSON-1083630769 tempest-AttachSCSIVolumeTestJSON-1083630769-project-member] Flavor pref 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 15:15:40 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-da354ed4-e0c5-47bc-b068-b96062ddd053 tempest-AttachSCSIVolumeTestJSON-1083630769 tempest-AttachSCSIVolumeTestJSON-1083630769-project-member] Image pref 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 15:15:40 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-da354ed4-e0c5-47bc-b068-b96062ddd053 tempest-AttachSCSIVolumeTestJSON-1083630769 tempest-AttachSCSIVolumeTestJSON-1083630769-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 15:15:40 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-da354ed4-e0c5-47bc-b068-b96062ddd053 tempest-AttachSCSIVolumeTestJSON-1083630769 tempest-AttachSCSIVolumeTestJSON-1083630769-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 15:15:40 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-da354ed4-e0c5-47bc-b068-b96062ddd053 tempest-AttachSCSIVolumeTestJSON-1083630769 tempest-AttachSCSIVolumeTestJSON-1083630769-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72382) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 15:15:40 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-da354ed4-e0c5-47bc-b068-b96062ddd053 tempest-AttachSCSIVolumeTestJSON-1083630769 tempest-AttachSCSIVolumeTestJSON-1083630769-project-member] Got 1 possible topologies {{(pid=72382) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 15:15:40 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-da354ed4-e0c5-47bc-b068-b96062ddd053 tempest-AttachSCSIVolumeTestJSON-1083630769 tempest-AttachSCSIVolumeTestJSON-1083630769-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 15:15:40 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-da354ed4-e0c5-47bc-b068-b96062ddd053 tempest-AttachSCSIVolumeTestJSON-1083630769 tempest-AttachSCSIVolumeTestJSON-1083630769-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 15:15:40 user nova-compute[72382]: DEBUG nova.virt.libvirt.vif [None req-da354ed4-e0c5-47bc-b068-b96062ddd053 tempest-AttachSCSIVolumeTestJSON-1083630769 tempest-AttachSCSIVolumeTestJSON-1083630769-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T15:15:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1271599526',display_name='tempest-AttachSCSIVolumeTestJSON-server-1271599526',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1271599526',id=6,image_ref='b177d706-cfc5-43a0-af20-d585b803cf65',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK/qkZ8Ev63QMbaDRtKoVhIB/B4zKrrzbWwNqmRbQUpWKNgI+nx/zypByKPNdhfyzldpCqOzD6zbm38ZLHrvJNQONRhwoe/rbduu7DVaeWIUknSst2+q72d49Ao0tjpaEg==',key_name='tempest-keypair-766974151',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f33e667025294028aa560b26d80d81a5',ramdisk_id='',reservation_id='r-qvtivipu',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b177d706-cfc5-43a0-af20-d585b803cf65',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1083630769',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1083630769-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T15:15:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='100263f546ec45938377bcbdfcf6ea0f',uuid=24b63f7a-be32-424b-b72c-d5bec43c408e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f21a4544-6f79-47c6-8577-f5e8d2b440bd", "address": "fa:16:3e:58:ca:e4", "network": {"id": "a87fbfc3-5f2b-427c-9337-e00cf40d8896", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1094857259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f33e667025294028aa560b26d80d81a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf21a4544-6f", "ovs_interfaceid": "f21a4544-6f79-47c6-8577-f5e8d2b440bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72382) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 15:15:40 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-da354ed4-e0c5-47bc-b068-b96062ddd053 tempest-AttachSCSIVolumeTestJSON-1083630769 tempest-AttachSCSIVolumeTestJSON-1083630769-project-member] Converting VIF {"id": "f21a4544-6f79-47c6-8577-f5e8d2b440bd", "address": "fa:16:3e:58:ca:e4", "network": {"id": "a87fbfc3-5f2b-427c-9337-e00cf40d8896", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1094857259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f33e667025294028aa560b26d80d81a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf21a4544-6f", "ovs_interfaceid": "f21a4544-6f79-47c6-8577-f5e8d2b440bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 15:15:40 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-da354ed4-e0c5-47bc-b068-b96062ddd053 tempest-AttachSCSIVolumeTestJSON-1083630769 tempest-AttachSCSIVolumeTestJSON-1083630769-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:58:ca:e4,bridge_name='br-int',has_traffic_filtering=True,id=f21a4544-6f79-47c6-8577-f5e8d2b440bd,network=Network(a87fbfc3-5f2b-427c-9337-e00cf40d8896),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf21a4544-6f') {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 15:15:40 user nova-compute[72382]: DEBUG nova.objects.instance [None req-da354ed4-e0c5-47bc-b068-b96062ddd053 tempest-AttachSCSIVolumeTestJSON-1083630769 tempest-AttachSCSIVolumeTestJSON-1083630769-project-member] Lazy-loading 'pci_devices' on Instance uuid 24b63f7a-be32-424b-b72c-d5bec43c408e {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:15:40 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-da354ed4-e0c5-47bc-b068-b96062ddd053 tempest-AttachSCSIVolumeTestJSON-1083630769 tempest-AttachSCSIVolumeTestJSON-1083630769-project-member] [instance: 24b63f7a-be32-424b-b72c-d5bec43c408e] End _get_guest_xml xml=<domain type="kvm">
Aug 09 15:15:40 user nova-compute[72382]:   <uuid>24b63f7a-be32-424b-b72c-d5bec43c408e</uuid>
Aug 09 15:15:40 user nova-compute[72382]:   <name>instance-00000006</name>
Aug 09 15:15:40 user nova-compute[72382]:   <memory>524288</memory>
Aug 09 15:15:40 user nova-compute[72382]:   <vcpu>1</vcpu>
Aug 09 15:15:40 user nova-compute[72382]:   <metadata>
Aug 09 15:15:40 user nova-compute[72382]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 15:15:40 user nova-compute[72382]:       <nova:package version="0.0.0"/>
Aug 09 15:15:40 user nova-compute[72382]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-1271599526</nova:name>
Aug 09 15:15:40 user nova-compute[72382]:       <nova:creationTime>2023-08-09 15:15:40</nova:creationTime>
Aug 09 15:15:40 user nova-compute[72382]:       <nova:flavor name="m1.tiny">
Aug 09 15:15:40 user nova-compute[72382]:         <nova:memory>512</nova:memory>
Aug 09 15:15:40 user nova-compute[72382]:         <nova:disk>1</nova:disk>
Aug 09 15:15:40 user nova-compute[72382]:         <nova:swap>0</nova:swap>
Aug 09 15:15:40 user nova-compute[72382]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 15:15:40 user nova-compute[72382]:         <nova:vcpus>1</nova:vcpus>
Aug 09 15:15:40 user nova-compute[72382]:       </nova:flavor>
Aug 09 15:15:40 user nova-compute[72382]:       <nova:owner>
Aug 09 15:15:40 user nova-compute[72382]:         <nova:user uuid="100263f546ec45938377bcbdfcf6ea0f">tempest-AttachSCSIVolumeTestJSON-1083630769-project-member</nova:user>
Aug 09 15:15:40 user nova-compute[72382]:         <nova:project uuid="f33e667025294028aa560b26d80d81a5">tempest-AttachSCSIVolumeTestJSON-1083630769</nova:project>
Aug 09 15:15:40 user nova-compute[72382]:       </nova:owner>
Aug 09 15:15:40 user nova-compute[72382]:       <nova:root type="image" uuid="b177d706-cfc5-43a0-af20-d585b803cf65"/>
Aug 09 15:15:40 user nova-compute[72382]:       <nova:ports>
Aug 09 15:15:40 user nova-compute[72382]:         <nova:port uuid="f21a4544-6f79-47c6-8577-f5e8d2b440bd">
Aug 09 15:15:40 user nova-compute[72382]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 09 15:15:40 user nova-compute[72382]:         </nova:port>
Aug 09 15:15:40 user nova-compute[72382]:       </nova:ports>
Aug 09 15:15:40 user nova-compute[72382]:     </nova:instance>
Aug 09 15:15:40 user nova-compute[72382]:   </metadata>
Aug 09 15:15:40 user nova-compute[72382]:   <sysinfo type="smbios">
Aug 09 15:15:40 user nova-compute[72382]:     <system>
Aug 09 15:15:40 user nova-compute[72382]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 15:15:40 user nova-compute[72382]:       <entry name="product">OpenStack Nova</entry>
Aug 09 15:15:40 user nova-compute[72382]:       <entry name="version">0.0.0</entry>
Aug 09 15:15:40 user nova-compute[72382]:       <entry name="serial">24b63f7a-be32-424b-b72c-d5bec43c408e</entry>
Aug 09 15:15:40 user nova-compute[72382]:       <entry name="uuid">24b63f7a-be32-424b-b72c-d5bec43c408e</entry>
Aug 09 15:15:40 user nova-compute[72382]:       <entry name="family">Virtual Machine</entry>
Aug 09 15:15:40 user nova-compute[72382]:     </system>
Aug 09 15:15:40 user nova-compute[72382]:   </sysinfo>
Aug 09 15:15:40 user nova-compute[72382]:   <os>
Aug 09 15:15:40 user nova-compute[72382]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 15:15:40 user nova-compute[72382]:     <boot dev="hd"/>
Aug 09 15:15:40 user nova-compute[72382]:     <smbios mode="sysinfo"/>
Aug 09 15:15:40 user nova-compute[72382]:   </os>
Aug 09 15:15:40 user nova-compute[72382]:   <features>
Aug 09 15:15:40 user nova-compute[72382]:     <acpi/>
Aug 09 15:15:40 user nova-compute[72382]:     <apic/>
Aug 09 15:15:40 user nova-compute[72382]:     <vmcoreinfo/>
Aug 09 15:15:40 user nova-compute[72382]:   </features>
Aug 09 15:15:40 user nova-compute[72382]:   <clock offset="utc">
Aug 09 15:15:40 user nova-compute[72382]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 15:15:40 user nova-compute[72382]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 15:15:40 user nova-compute[72382]:     <timer name="hpet" present="no"/>
Aug 09 15:15:40 user nova-compute[72382]:   </clock>
Aug 09 15:15:40 user nova-compute[72382]:   <cpu mode="custom" match="exact">
Aug 09 15:15:40 user nova-compute[72382]:     <model>Nehalem</model>
Aug 09 15:15:40 user nova-compute[72382]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 15:15:40 user nova-compute[72382]:   </cpu>
Aug 09 15:15:40 user nova-compute[72382]:   <devices>
Aug 09 15:15:40 user nova-compute[72382]:     <disk type="file" device="disk">
Aug 09 15:15:40 user nova-compute[72382]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 15:15:40 user nova-compute[72382]:       <source file="/opt/stack/data/nova/instances/24b63f7a-be32-424b-b72c-d5bec43c408e/disk"/>
Aug 09 15:15:40 user nova-compute[72382]:       <target dev="sda" bus="scsi"/>
Aug 09 15:15:40 user nova-compute[72382]:       <address type="drive" controller="0" unit="0"/>
Aug 09 15:15:40 user nova-compute[72382]:     </disk>
Aug 09 15:15:40 user nova-compute[72382]:     <disk type="file" device="cdrom">
Aug 09 15:15:40 user nova-compute[72382]:       <driver name="qemu" type="raw" cache="none"/>
Aug 09 15:15:40 user nova-compute[72382]:       <source file="/opt/stack/data/nova/instances/24b63f7a-be32-424b-b72c-d5bec43c408e/disk.config"/>
Aug 09 15:15:40 user nova-compute[72382]:       <target dev="sdb" bus="scsi"/>
Aug 09 15:15:40 user nova-compute[72382]:       <address type="drive" controller="0" unit="1"/>
Aug 09 15:15:40 user nova-compute[72382]:     </disk>
Aug 09 15:15:40 user nova-compute[72382]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Aug 09 15:15:40 user nova-compute[72382]:     <interface type="ethernet">
Aug 09 15:15:40 user nova-compute[72382]:       <mac address="fa:16:3e:58:ca:e4"/>
Aug 09 15:15:40 user nova-compute[72382]:       <model type="virtio"/>
Aug 09 15:15:40 user nova-compute[72382]:       <mtu size="1442"/>
Aug 09 15:15:40 user nova-compute[72382]:       <target dev="tapf21a4544-6f"/>
Aug 09 15:15:40 user nova-compute[72382]:     </interface>
Aug 09 15:15:40 user nova-compute[72382]:     <serial type="pty">
Aug 09 15:15:40 user nova-compute[72382]:       <log file="/opt/stack/data/nova/instances/24b63f7a-be32-424b-b72c-d5bec43c408e/console.log" append="off"/>
Aug 09 15:15:40 user nova-compute[72382]:     </serial>
Aug 09 15:15:40 user nova-compute[72382]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 15:15:40 user nova-compute[72382]:     <video>
Aug 09 15:15:40 user nova-compute[72382]:       <model type="virtio"/>
Aug 09 15:15:40 user nova-compute[72382]:     </video>
Aug 09 15:15:40 user nova-compute[72382]:     <rng model="virtio">
Aug 09 15:15:40 user nova-compute[72382]:       <backend model="random">/dev/urandom</backend>
Aug 09 15:15:40 user nova-compute[72382]:     </rng>
Aug 09 15:15:40 user nova-compute[72382]:     <controller type="usb" index="0" model="none"/>
Aug 09 15:15:40 user nova-compute[72382]:     <memballoon model="virtio">
Aug 09 15:15:40 user nova-compute[72382]:       <stats period="10"/>
Aug 09 15:15:40 user nova-compute[72382]:     </memballoon>
Aug 09 15:15:40 user nova-compute[72382]:   </devices>
Aug 09 15:15:40 user nova-compute[72382]: </domain>
Aug 09 15:15:40 user nova-compute[72382]:  {{(pid=72382) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 15:15:40 user nova-compute[72382]: DEBUG nova.virt.libvirt.vif [None req-da354ed4-e0c5-47bc-b068-b96062ddd053 tempest-AttachSCSIVolumeTestJSON-1083630769 tempest-AttachSCSIVolumeTestJSON-1083630769-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T15:15:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1271599526',display_name='tempest-AttachSCSIVolumeTestJSON-server-1271599526',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1271599526',id=6,image_ref='b177d706-cfc5-43a0-af20-d585b803cf65',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK/qkZ8Ev63QMbaDRtKoVhIB/B4zKrrzbWwNqmRbQUpWKNgI+nx/zypByKPNdhfyzldpCqOzD6zbm38ZLHrvJNQONRhwoe/rbduu7DVaeWIUknSst2+q72d49Ao0tjpaEg==',key_name='tempest-keypair-766974151',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f33e667025294028aa560b26d80d81a5',ramdisk_id='',reservation_id='r-qvtivipu',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b177d706-cfc5-43a0-af20-d585b803cf65',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1083630769',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1083630769-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T15:15:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='100263f546ec45938377bcbdfcf6ea0f',uuid=24b63f7a-be32-424b-b72c-d5bec43c408e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f21a4544-6f79-47c6-8577-f5e8d2b440bd", "address": "fa:16:3e:58:ca:e4", "network": {"id": "a87fbfc3-5f2b-427c-9337-e00cf40d8896", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1094857259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f33e667025294028aa560b26d80d81a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf21a4544-6f", "ovs_interfaceid": "f21a4544-6f79-47c6-8577-f5e8d2b440bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 15:15:40 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-da354ed4-e0c5-47bc-b068-b96062ddd053 tempest-AttachSCSIVolumeTestJSON-1083630769 tempest-AttachSCSIVolumeTestJSON-1083630769-project-member] Converting VIF {"id": "f21a4544-6f79-47c6-8577-f5e8d2b440bd", "address": "fa:16:3e:58:ca:e4", "network": {"id": "a87fbfc3-5f2b-427c-9337-e00cf40d8896", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1094857259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f33e667025294028aa560b26d80d81a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf21a4544-6f", "ovs_interfaceid": "f21a4544-6f79-47c6-8577-f5e8d2b440bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 15:15:40 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-da354ed4-e0c5-47bc-b068-b96062ddd053 tempest-AttachSCSIVolumeTestJSON-1083630769 tempest-AttachSCSIVolumeTestJSON-1083630769-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:58:ca:e4,bridge_name='br-int',has_traffic_filtering=True,id=f21a4544-6f79-47c6-8577-f5e8d2b440bd,network=Network(a87fbfc3-5f2b-427c-9337-e00cf40d8896),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf21a4544-6f') {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 15:15:40 user nova-compute[72382]: DEBUG os_vif [None req-da354ed4-e0c5-47bc-b068-b96062ddd053 tempest-AttachSCSIVolumeTestJSON-1083630769 tempest-AttachSCSIVolumeTestJSON-1083630769-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:ca:e4,bridge_name='br-int',has_traffic_filtering=True,id=f21a4544-6f79-47c6-8577-f5e8d2b440bd,network=Network(a87fbfc3-5f2b-427c-9337-e00cf40d8896),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf21a4544-6f') {{(pid=72382) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 15:15:40 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:15:40 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:15:40 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 15:15:40 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:15:40 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf21a4544-6f, may_exist=True, interface_attrs={}) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:15:40 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf21a4544-6f, col_values=(('external_ids', {'iface-id': 'f21a4544-6f79-47c6-8577-f5e8d2b440bd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:58:ca:e4', 'vm-uuid': '24b63f7a-be32-424b-b72c-d5bec43c408e'}),), if_exists=True) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:15:40 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:15:40 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-1be031b3-15c8-4cce-9487-45bdffa176b1 tempest-VolumesAssistedSnapshotsTest-459543424 tempest-VolumesAssistedSnapshotsTest-459543424-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:15:40 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-1be031b3-15c8-4cce-9487-45bdffa176b1 tempest-VolumesAssistedSnapshotsTest-459543424 tempest-VolumesAssistedSnapshotsTest-459543424-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:15:40 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:15:40 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:15:40 user nova-compute[72382]: INFO os_vif [None req-da354ed4-e0c5-47bc-b068-b96062ddd053 tempest-AttachSCSIVolumeTestJSON-1083630769 tempest-AttachSCSIVolumeTestJSON-1083630769-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:ca:e4,bridge_name='br-int',has_traffic_filtering=True,id=f21a4544-6f79-47c6-8577-f5e8d2b440bd,network=Network(a87fbfc3-5f2b-427c-9337-e00cf40d8896),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf21a4544-6f')
Aug 09 15:15:40 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-1be031b3-15c8-4cce-9487-45bdffa176b1 tempest-VolumesAssistedSnapshotsTest-459543424 tempest-VolumesAssistedSnapshotsTest-459543424-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72382) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 15:15:40 user nova-compute[72382]: INFO nova.compute.claims [None req-1be031b3-15c8-4cce-9487-45bdffa176b1 tempest-VolumesAssistedSnapshotsTest-459543424 tempest-VolumesAssistedSnapshotsTest-459543424-project-member] [instance: f0a7fa25-4520-4f40-9515-b88e3d2fd910] Claim successful on node user
Aug 09 15:15:40 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-da354ed4-e0c5-47bc-b068-b96062ddd053 tempest-AttachSCSIVolumeTestJSON-1083630769 tempest-AttachSCSIVolumeTestJSON-1083630769-project-member] No BDM found with device name sda, not building metadata. {{(pid=72382) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 15:15:40 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-da354ed4-e0c5-47bc-b068-b96062ddd053 tempest-AttachSCSIVolumeTestJSON-1083630769 tempest-AttachSCSIVolumeTestJSON-1083630769-project-member] No BDM found with device name sdb, not building metadata. {{(pid=72382) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 15:15:40 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-da354ed4-e0c5-47bc-b068-b96062ddd053 tempest-AttachSCSIVolumeTestJSON-1083630769 tempest-AttachSCSIVolumeTestJSON-1083630769-project-member] No VIF found with MAC fa:16:3e:58:ca:e4, not building metadata {{(pid=72382) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 15:15:40 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-da354ed4-e0c5-47bc-b068-b96062ddd053 tempest-AttachSCSIVolumeTestJSON-1083630769 tempest-AttachSCSIVolumeTestJSON-1083630769-project-member] [instance: 24b63f7a-be32-424b-b72c-d5bec43c408e] Using config drive
Aug 09 15:15:41 user nova-compute[72382]: DEBUG nova.compute.provider_tree [None req-1be031b3-15c8-4cce-9487-45bdffa176b1 tempest-VolumesAssistedSnapshotsTest-459543424 tempest-VolumesAssistedSnapshotsTest-459543424-project-member] Inventory has not changed in ProviderTree for provider: 7b15b0e5-df4d-49db-833b-2855d21d10ae {{(pid=72382) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 15:15:41 user nova-compute[72382]: DEBUG nova.scheduler.client.report [None req-1be031b3-15c8-4cce-9487-45bdffa176b1 tempest-VolumesAssistedSnapshotsTest-459543424 tempest-VolumesAssistedSnapshotsTest-459543424-project-member] Inventory has not changed for provider 7b15b0e5-df4d-49db-833b-2855d21d10ae based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72382) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 15:15:41 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-1be031b3-15c8-4cce-9487-45bdffa176b1 tempest-VolumesAssistedSnapshotsTest-459543424 tempest-VolumesAssistedSnapshotsTest-459543424-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.627s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:15:41 user nova-compute[72382]: DEBUG nova.compute.manager [None req-1be031b3-15c8-4cce-9487-45bdffa176b1 tempest-VolumesAssistedSnapshotsTest-459543424 tempest-VolumesAssistedSnapshotsTest-459543424-project-member] [instance: f0a7fa25-4520-4f40-9515-b88e3d2fd910] Start building networks asynchronously for instance. {{(pid=72382) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 15:15:41 user nova-compute[72382]: DEBUG nova.compute.manager [None req-1be031b3-15c8-4cce-9487-45bdffa176b1 tempest-VolumesAssistedSnapshotsTest-459543424 tempest-VolumesAssistedSnapshotsTest-459543424-project-member] [instance: f0a7fa25-4520-4f40-9515-b88e3d2fd910] Allocating IP information in the background. {{(pid=72382) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 15:15:41 user nova-compute[72382]: DEBUG nova.network.neutron [None req-1be031b3-15c8-4cce-9487-45bdffa176b1 tempest-VolumesAssistedSnapshotsTest-459543424 tempest-VolumesAssistedSnapshotsTest-459543424-project-member] [instance: f0a7fa25-4520-4f40-9515-b88e3d2fd910] allocate_for_instance() {{(pid=72382) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 15:15:41 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-1be031b3-15c8-4cce-9487-45bdffa176b1 tempest-VolumesAssistedSnapshotsTest-459543424 tempest-VolumesAssistedSnapshotsTest-459543424-project-member] [instance: f0a7fa25-4520-4f40-9515-b88e3d2fd910] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 15:15:41 user nova-compute[72382]: DEBUG nova.compute.manager [None req-1be031b3-15c8-4cce-9487-45bdffa176b1 tempest-VolumesAssistedSnapshotsTest-459543424 tempest-VolumesAssistedSnapshotsTest-459543424-project-member] [instance: f0a7fa25-4520-4f40-9515-b88e3d2fd910] Start building block device mappings for instance. {{(pid=72382) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 15:15:41 user nova-compute[72382]: DEBUG nova.compute.manager [None req-1be031b3-15c8-4cce-9487-45bdffa176b1 tempest-VolumesAssistedSnapshotsTest-459543424 tempest-VolumesAssistedSnapshotsTest-459543424-project-member] [instance: f0a7fa25-4520-4f40-9515-b88e3d2fd910] Start spawning the instance on the hypervisor. {{(pid=72382) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 15:15:41 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-1be031b3-15c8-4cce-9487-45bdffa176b1 tempest-VolumesAssistedSnapshotsTest-459543424 tempest-VolumesAssistedSnapshotsTest-459543424-project-member] [instance: f0a7fa25-4520-4f40-9515-b88e3d2fd910] Creating instance directory {{(pid=72382) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 15:15:41 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-1be031b3-15c8-4cce-9487-45bdffa176b1 tempest-VolumesAssistedSnapshotsTest-459543424 tempest-VolumesAssistedSnapshotsTest-459543424-project-member] [instance: f0a7fa25-4520-4f40-9515-b88e3d2fd910] Creating image(s)
Aug 09 15:15:41 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-1be031b3-15c8-4cce-9487-45bdffa176b1 tempest-VolumesAssistedSnapshotsTest-459543424 tempest-VolumesAssistedSnapshotsTest-459543424-project-member] Acquiring lock "/opt/stack/data/nova/instances/f0a7fa25-4520-4f40-9515-b88e3d2fd910/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:15:41 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-1be031b3-15c8-4cce-9487-45bdffa176b1 tempest-VolumesAssistedSnapshotsTest-459543424 tempest-VolumesAssistedSnapshotsTest-459543424-project-member] Lock "/opt/stack/data/nova/instances/f0a7fa25-4520-4f40-9515-b88e3d2fd910/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:15:41 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-1be031b3-15c8-4cce-9487-45bdffa176b1 tempest-VolumesAssistedSnapshotsTest-459543424 tempest-VolumesAssistedSnapshotsTest-459543424-project-member] Lock "/opt/stack/data/nova/instances/f0a7fa25-4520-4f40-9515-b88e3d2fd910/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:15:41 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-1be031b3-15c8-4cce-9487-45bdffa176b1 tempest-VolumesAssistedSnapshotsTest-459543424 tempest-VolumesAssistedSnapshotsTest-459543424-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:15:41 user nova-compute[72382]: DEBUG nova.policy [None req-1be031b3-15c8-4cce-9487-45bdffa176b1 tempest-VolumesAssistedSnapshotsTest-459543424 tempest-VolumesAssistedSnapshotsTest-459543424-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '51c6aec879314db3a142d69bcfbd18f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcde0eaf3243471280e72b35b04a1022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72382) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 15:15:41 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-1be031b3-15c8-4cce-9487-45bdffa176b1 tempest-VolumesAssistedSnapshotsTest-459543424 tempest-VolumesAssistedSnapshotsTest-459543424-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b --force-share --output=json" returned: 0 in 0.217s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:15:41 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-1be031b3-15c8-4cce-9487-45bdffa176b1 tempest-VolumesAssistedSnapshotsTest-459543424 tempest-VolumesAssistedSnapshotsTest-459543424-project-member] Acquiring lock "383812ff437283e0191ed5b9ecc04c27f1162b0b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:15:41 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-1be031b3-15c8-4cce-9487-45bdffa176b1 tempest-VolumesAssistedSnapshotsTest-459543424 tempest-VolumesAssistedSnapshotsTest-459543424-project-member] Lock "383812ff437283e0191ed5b9ecc04c27f1162b0b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:15:41 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-1be031b3-15c8-4cce-9487-45bdffa176b1 tempest-VolumesAssistedSnapshotsTest-459543424 tempest-VolumesAssistedSnapshotsTest-459543424-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:15:42 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-1be031b3-15c8-4cce-9487-45bdffa176b1 tempest-VolumesAssistedSnapshotsTest-459543424 tempest-VolumesAssistedSnapshotsTest-459543424-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b --force-share --output=json" returned: 0 in 0.236s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:15:42 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-1be031b3-15c8-4cce-9487-45bdffa176b1 tempest-VolumesAssistedSnapshotsTest-459543424 tempest-VolumesAssistedSnapshotsTest-459543424-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b,backing_fmt=raw /opt/stack/data/nova/instances/f0a7fa25-4520-4f40-9515-b88e3d2fd910/disk 1073741824 {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:15:42 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-1be031b3-15c8-4cce-9487-45bdffa176b1 tempest-VolumesAssistedSnapshotsTest-459543424 tempest-VolumesAssistedSnapshotsTest-459543424-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b,backing_fmt=raw /opt/stack/data/nova/instances/f0a7fa25-4520-4f40-9515-b88e3d2fd910/disk 1073741824" returned: 0 in 0.086s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:15:42 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-1be031b3-15c8-4cce-9487-45bdffa176b1 tempest-VolumesAssistedSnapshotsTest-459543424 tempest-VolumesAssistedSnapshotsTest-459543424-project-member] Lock "383812ff437283e0191ed5b9ecc04c27f1162b0b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.333s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:15:42 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-1be031b3-15c8-4cce-9487-45bdffa176b1 tempest-VolumesAssistedSnapshotsTest-459543424 tempest-VolumesAssistedSnapshotsTest-459543424-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:15:42 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-1be031b3-15c8-4cce-9487-45bdffa176b1 tempest-VolumesAssistedSnapshotsTest-459543424 tempest-VolumesAssistedSnapshotsTest-459543424-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b --force-share --output=json" returned: 0 in 0.232s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:15:42 user nova-compute[72382]: DEBUG nova.virt.disk.api [None req-1be031b3-15c8-4cce-9487-45bdffa176b1 tempest-VolumesAssistedSnapshotsTest-459543424 tempest-VolumesAssistedSnapshotsTest-459543424-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f0a7fa25-4520-4f40-9515-b88e3d2fd910/disk. size=1073741824 {{(pid=72382) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 15:15:42 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-1be031b3-15c8-4cce-9487-45bdffa176b1 tempest-VolumesAssistedSnapshotsTest-459543424 tempest-VolumesAssistedSnapshotsTest-459543424-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0a7fa25-4520-4f40-9515-b88e3d2fd910/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:15:42 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-b5acb247-093b-4b95-8211-714e6c7f6f60 tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] Acquiring lock "a33515b3-3ef4-4f76-a8d8-e7008b5bbb79" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:15:42 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-b5acb247-093b-4b95-8211-714e6c7f6f60 tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] Lock "a33515b3-3ef4-4f76-a8d8-e7008b5bbb79" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:15:42 user nova-compute[72382]: DEBUG nova.compute.manager [None req-b5acb247-093b-4b95-8211-714e6c7f6f60 tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] [instance: a33515b3-3ef4-4f76-a8d8-e7008b5bbb79] Starting instance... {{(pid=72382) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 15:15:42 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-da354ed4-e0c5-47bc-b068-b96062ddd053 tempest-AttachSCSIVolumeTestJSON-1083630769 tempest-AttachSCSIVolumeTestJSON-1083630769-project-member] [instance: 24b63f7a-be32-424b-b72c-d5bec43c408e] Creating config drive at /opt/stack/data/nova/instances/24b63f7a-be32-424b-b72c-d5bec43c408e/disk.config
Aug 09 15:15:42 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-da354ed4-e0c5-47bc-b068-b96062ddd053 tempest-AttachSCSIVolumeTestJSON-1083630769 tempest-AttachSCSIVolumeTestJSON-1083630769-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/24b63f7a-be32-424b-b72c-d5bec43c408e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpnjr32krj {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:15:42 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-1be031b3-15c8-4cce-9487-45bdffa176b1 tempest-VolumesAssistedSnapshotsTest-459543424 tempest-VolumesAssistedSnapshotsTest-459543424-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0a7fa25-4520-4f40-9515-b88e3d2fd910/disk --force-share --output=json" returned: 0 in 0.335s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:15:42 user nova-compute[72382]: DEBUG nova.virt.disk.api [None req-1be031b3-15c8-4cce-9487-45bdffa176b1 tempest-VolumesAssistedSnapshotsTest-459543424 tempest-VolumesAssistedSnapshotsTest-459543424-project-member] Cannot resize image /opt/stack/data/nova/instances/f0a7fa25-4520-4f40-9515-b88e3d2fd910/disk to a smaller size. {{(pid=72382) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 15:15:42 user nova-compute[72382]: DEBUG nova.objects.instance [None req-1be031b3-15c8-4cce-9487-45bdffa176b1 tempest-VolumesAssistedSnapshotsTest-459543424 tempest-VolumesAssistedSnapshotsTest-459543424-project-member] Lazy-loading 'migration_context' on Instance uuid f0a7fa25-4520-4f40-9515-b88e3d2fd910 {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:15:42 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-da354ed4-e0c5-47bc-b068-b96062ddd053 tempest-AttachSCSIVolumeTestJSON-1083630769 tempest-AttachSCSIVolumeTestJSON-1083630769-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/24b63f7a-be32-424b-b72c-d5bec43c408e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpnjr32krj" returned: 0 in 0.121s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:15:42 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-1be031b3-15c8-4cce-9487-45bdffa176b1 tempest-VolumesAssistedSnapshotsTest-459543424 tempest-VolumesAssistedSnapshotsTest-459543424-project-member] [instance: f0a7fa25-4520-4f40-9515-b88e3d2fd910] Created local disks {{(pid=72382) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 15:15:42 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-1be031b3-15c8-4cce-9487-45bdffa176b1 tempest-VolumesAssistedSnapshotsTest-459543424 tempest-VolumesAssistedSnapshotsTest-459543424-project-member] [instance: f0a7fa25-4520-4f40-9515-b88e3d2fd910] Ensure instance console log exists: /opt/stack/data/nova/instances/f0a7fa25-4520-4f40-9515-b88e3d2fd910/console.log {{(pid=72382) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 15:15:42 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-1be031b3-15c8-4cce-9487-45bdffa176b1 tempest-VolumesAssistedSnapshotsTest-459543424 tempest-VolumesAssistedSnapshotsTest-459543424-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:15:42 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-1be031b3-15c8-4cce-9487-45bdffa176b1 tempest-VolumesAssistedSnapshotsTest-459543424 tempest-VolumesAssistedSnapshotsTest-459543424-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:15:42 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-1be031b3-15c8-4cce-9487-45bdffa176b1 tempest-VolumesAssistedSnapshotsTest-459543424 tempest-VolumesAssistedSnapshotsTest-459543424-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:15:42 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-b5acb247-093b-4b95-8211-714e6c7f6f60 tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:15:42 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-b5acb247-093b-4b95-8211-714e6c7f6f60 tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:15:42 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-b5acb247-093b-4b95-8211-714e6c7f6f60 tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72382) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 15:15:42 user nova-compute[72382]: INFO nova.compute.claims [None req-b5acb247-093b-4b95-8211-714e6c7f6f60 tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] [instance: a33515b3-3ef4-4f76-a8d8-e7008b5bbb79] Claim successful on node user
Aug 09 15:15:42 user nova-compute[72382]: DEBUG nova.network.neutron [req-28da1d97-6836-40b3-afbf-85ed4ec1018a req-1cc67cb4-d889-4db4-8806-313eb39b51b1 service nova] [instance: 24b63f7a-be32-424b-b72c-d5bec43c408e] Updated VIF entry in instance network info cache for port f21a4544-6f79-47c6-8577-f5e8d2b440bd. {{(pid=72382) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 15:15:42 user nova-compute[72382]: DEBUG nova.network.neutron [req-28da1d97-6836-40b3-afbf-85ed4ec1018a req-1cc67cb4-d889-4db4-8806-313eb39b51b1 service nova] [instance: 24b63f7a-be32-424b-b72c-d5bec43c408e] Updating instance_info_cache with network_info: [{"id": "f21a4544-6f79-47c6-8577-f5e8d2b440bd", "address": "fa:16:3e:58:ca:e4", "network": {"id": "a87fbfc3-5f2b-427c-9337-e00cf40d8896", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1094857259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f33e667025294028aa560b26d80d81a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf21a4544-6f", "ovs_interfaceid": "f21a4544-6f79-47c6-8577-f5e8d2b440bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:15:42 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-28da1d97-6836-40b3-afbf-85ed4ec1018a req-1cc67cb4-d889-4db4-8806-313eb39b51b1 service nova] Releasing lock "refresh_cache-24b63f7a-be32-424b-b72c-d5bec43c408e" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 15:15:43 user nova-compute[72382]: DEBUG nova.network.neutron [None req-1be031b3-15c8-4cce-9487-45bdffa176b1 tempest-VolumesAssistedSnapshotsTest-459543424 tempest-VolumesAssistedSnapshotsTest-459543424-project-member] [instance: f0a7fa25-4520-4f40-9515-b88e3d2fd910] Successfully created port: 5b8a4395-5fb8-4ae6-a987-127e82862327 {{(pid=72382) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 15:15:43 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:15:43 user nova-compute[72382]: DEBUG nova.compute.provider_tree [None req-b5acb247-093b-4b95-8211-714e6c7f6f60 tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] Inventory has not changed in ProviderTree for provider: 7b15b0e5-df4d-49db-833b-2855d21d10ae {{(pid=72382) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 15:15:43 user nova-compute[72382]: DEBUG nova.scheduler.client.report [None req-b5acb247-093b-4b95-8211-714e6c7f6f60 tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] Inventory has not changed for provider 7b15b0e5-df4d-49db-833b-2855d21d10ae based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72382) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 15:15:43 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-b5acb247-093b-4b95-8211-714e6c7f6f60 tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.041s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:15:43 user nova-compute[72382]: DEBUG nova.compute.manager [None req-b5acb247-093b-4b95-8211-714e6c7f6f60 tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] [instance: a33515b3-3ef4-4f76-a8d8-e7008b5bbb79] Start building networks asynchronously for instance. {{(pid=72382) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 15:15:44 user nova-compute[72382]: DEBUG nova.compute.manager [None req-b5acb247-093b-4b95-8211-714e6c7f6f60 tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] [instance: a33515b3-3ef4-4f76-a8d8-e7008b5bbb79] Allocating IP information in the background. {{(pid=72382) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 15:15:44 user nova-compute[72382]: DEBUG nova.network.neutron [None req-b5acb247-093b-4b95-8211-714e6c7f6f60 tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] [instance: a33515b3-3ef4-4f76-a8d8-e7008b5bbb79] allocate_for_instance() {{(pid=72382) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 15:15:44 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-b5acb247-093b-4b95-8211-714e6c7f6f60 tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] [instance: a33515b3-3ef4-4f76-a8d8-e7008b5bbb79] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 15:15:44 user nova-compute[72382]: DEBUG nova.compute.manager [None req-b5acb247-093b-4b95-8211-714e6c7f6f60 tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] [instance: a33515b3-3ef4-4f76-a8d8-e7008b5bbb79] Start building block device mappings for instance. {{(pid=72382) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 15:15:44 user nova-compute[72382]: DEBUG nova.policy [None req-b5acb247-093b-4b95-8211-714e6c7f6f60 tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '374f2148fb524924acc7e1e968e73fe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b98e20f61c34fd6aa28cef7ceadf0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72382) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 15:15:44 user nova-compute[72382]: DEBUG nova.compute.manager [None req-b5acb247-093b-4b95-8211-714e6c7f6f60 tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] [instance: a33515b3-3ef4-4f76-a8d8-e7008b5bbb79] Start spawning the instance on the hypervisor. {{(pid=72382) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 15:15:44 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-b5acb247-093b-4b95-8211-714e6c7f6f60 tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] [instance: a33515b3-3ef4-4f76-a8d8-e7008b5bbb79] Creating instance directory {{(pid=72382) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 15:15:44 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-b5acb247-093b-4b95-8211-714e6c7f6f60 tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] [instance: a33515b3-3ef4-4f76-a8d8-e7008b5bbb79] Creating image(s)
Aug 09 15:15:44 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-b5acb247-093b-4b95-8211-714e6c7f6f60 tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] Acquiring lock "/opt/stack/data/nova/instances/a33515b3-3ef4-4f76-a8d8-e7008b5bbb79/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:15:44 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-b5acb247-093b-4b95-8211-714e6c7f6f60 tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] Lock "/opt/stack/data/nova/instances/a33515b3-3ef4-4f76-a8d8-e7008b5bbb79/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:15:44 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-b5acb247-093b-4b95-8211-714e6c7f6f60 tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] Lock "/opt/stack/data/nova/instances/a33515b3-3ef4-4f76-a8d8-e7008b5bbb79/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:15:44 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-b5acb247-093b-4b95-8211-714e6c7f6f60 tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:15:44 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:15:44 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:15:44 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-b5acb247-093b-4b95-8211-714e6c7f6f60 tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b --force-share --output=json" returned: 0 in 0.325s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:15:44 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-b5acb247-093b-4b95-8211-714e6c7f6f60 tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] Acquiring lock "383812ff437283e0191ed5b9ecc04c27f1162b0b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:15:44 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-b5acb247-093b-4b95-8211-714e6c7f6f60 tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] Lock "383812ff437283e0191ed5b9ecc04c27f1162b0b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:15:44 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-b5acb247-093b-4b95-8211-714e6c7f6f60 tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:15:45 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-b5acb247-093b-4b95-8211-714e6c7f6f60 tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b --force-share --output=json" returned: 0 in 0.178s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:15:45 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-b5acb247-093b-4b95-8211-714e6c7f6f60 tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b,backing_fmt=raw /opt/stack/data/nova/instances/a33515b3-3ef4-4f76-a8d8-e7008b5bbb79/disk 1073741824 {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:15:45 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-b5acb247-093b-4b95-8211-714e6c7f6f60 tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b,backing_fmt=raw /opt/stack/data/nova/instances/a33515b3-3ef4-4f76-a8d8-e7008b5bbb79/disk 1073741824" returned: 0 in 0.139s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:15:45 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-b5acb247-093b-4b95-8211-714e6c7f6f60 tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] Lock "383812ff437283e0191ed5b9ecc04c27f1162b0b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.323s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:15:45 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-b5acb247-093b-4b95-8211-714e6c7f6f60 tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:15:45 user nova-compute[72382]: DEBUG nova.compute.manager [req-b9801ea1-cd5a-4397-a11d-49b32d8e05cc req-b43d4525-b265-4e3a-aef7-3beec513a191 service nova] [instance: 24b63f7a-be32-424b-b72c-d5bec43c408e] Received event network-vif-plugged-f21a4544-6f79-47c6-8577-f5e8d2b440bd {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:15:45 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-b9801ea1-cd5a-4397-a11d-49b32d8e05cc req-b43d4525-b265-4e3a-aef7-3beec513a191 service nova] Acquiring lock "24b63f7a-be32-424b-b72c-d5bec43c408e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:15:45 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-b9801ea1-cd5a-4397-a11d-49b32d8e05cc req-b43d4525-b265-4e3a-aef7-3beec513a191 service nova] Lock "24b63f7a-be32-424b-b72c-d5bec43c408e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:15:45 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-b9801ea1-cd5a-4397-a11d-49b32d8e05cc req-b43d4525-b265-4e3a-aef7-3beec513a191 service nova] Lock "24b63f7a-be32-424b-b72c-d5bec43c408e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:15:45 user nova-compute[72382]: DEBUG nova.compute.manager [req-b9801ea1-cd5a-4397-a11d-49b32d8e05cc req-b43d4525-b265-4e3a-aef7-3beec513a191 service nova] [instance: 24b63f7a-be32-424b-b72c-d5bec43c408e] No waiting events found dispatching network-vif-plugged-f21a4544-6f79-47c6-8577-f5e8d2b440bd {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:15:45 user nova-compute[72382]: WARNING nova.compute.manager [req-b9801ea1-cd5a-4397-a11d-49b32d8e05cc req-b43d4525-b265-4e3a-aef7-3beec513a191 service nova] [instance: 24b63f7a-be32-424b-b72c-d5bec43c408e] Received unexpected event network-vif-plugged-f21a4544-6f79-47c6-8577-f5e8d2b440bd for instance with vm_state building and task_state spawning.
Aug 09 15:15:45 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:15:45 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-b5acb247-093b-4b95-8211-714e6c7f6f60 tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b --force-share --output=json" returned: 0 in 0.368s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:15:45 user nova-compute[72382]: DEBUG nova.virt.disk.api [None req-b5acb247-093b-4b95-8211-714e6c7f6f60 tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a33515b3-3ef4-4f76-a8d8-e7008b5bbb79/disk. size=1073741824 {{(pid=72382) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 15:15:45 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-b5acb247-093b-4b95-8211-714e6c7f6f60 tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a33515b3-3ef4-4f76-a8d8-e7008b5bbb79/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:15:45 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-dab17cc8-d663-431f-881c-dfe633a6de11 tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] Acquiring lock "23f25946-de3a-43fb-97a4-1f9a787e6e51" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:15:45 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-dab17cc8-d663-431f-881c-dfe633a6de11 tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] Lock "23f25946-de3a-43fb-97a4-1f9a787e6e51" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.022s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:15:45 user nova-compute[72382]: DEBUG nova.compute.manager [None req-dab17cc8-d663-431f-881c-dfe633a6de11 tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] [instance: 23f25946-de3a-43fb-97a4-1f9a787e6e51] Starting instance... {{(pid=72382) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 15:15:45 user nova-compute[72382]: DEBUG nova.network.neutron [None req-1be031b3-15c8-4cce-9487-45bdffa176b1 tempest-VolumesAssistedSnapshotsTest-459543424 tempest-VolumesAssistedSnapshotsTest-459543424-project-member] [instance: f0a7fa25-4520-4f40-9515-b88e3d2fd910] Successfully updated port: 5b8a4395-5fb8-4ae6-a987-127e82862327 {{(pid=72382) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 15:15:45 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-1be031b3-15c8-4cce-9487-45bdffa176b1 tempest-VolumesAssistedSnapshotsTest-459543424 tempest-VolumesAssistedSnapshotsTest-459543424-project-member] Acquiring lock "refresh_cache-f0a7fa25-4520-4f40-9515-b88e3d2fd910" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 15:15:45 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-1be031b3-15c8-4cce-9487-45bdffa176b1 tempest-VolumesAssistedSnapshotsTest-459543424 tempest-VolumesAssistedSnapshotsTest-459543424-project-member] Acquired lock "refresh_cache-f0a7fa25-4520-4f40-9515-b88e3d2fd910" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 15:15:45 user nova-compute[72382]: DEBUG nova.network.neutron [None req-1be031b3-15c8-4cce-9487-45bdffa176b1 tempest-VolumesAssistedSnapshotsTest-459543424 tempest-VolumesAssistedSnapshotsTest-459543424-project-member] [instance: f0a7fa25-4520-4f40-9515-b88e3d2fd910] Building network info cache for instance {{(pid=72382) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 15:15:45 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-b5acb247-093b-4b95-8211-714e6c7f6f60 tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a33515b3-3ef4-4f76-a8d8-e7008b5bbb79/disk --force-share --output=json" returned: 0 in 0.346s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:15:45 user nova-compute[72382]: DEBUG nova.virt.disk.api [None req-b5acb247-093b-4b95-8211-714e6c7f6f60 tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] Cannot resize image /opt/stack/data/nova/instances/a33515b3-3ef4-4f76-a8d8-e7008b5bbb79/disk to a smaller size. {{(pid=72382) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 15:15:45 user nova-compute[72382]: DEBUG nova.objects.instance [None req-b5acb247-093b-4b95-8211-714e6c7f6f60 tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] Lazy-loading 'migration_context' on Instance uuid a33515b3-3ef4-4f76-a8d8-e7008b5bbb79 {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:15:45 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:15:45 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:15:46 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-b5acb247-093b-4b95-8211-714e6c7f6f60 tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] [instance: a33515b3-3ef4-4f76-a8d8-e7008b5bbb79] Created local disks {{(pid=72382) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 15:15:46 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-b5acb247-093b-4b95-8211-714e6c7f6f60 tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] [instance: a33515b3-3ef4-4f76-a8d8-e7008b5bbb79] Ensure instance console log exists: /opt/stack/data/nova/instances/a33515b3-3ef4-4f76-a8d8-e7008b5bbb79/console.log {{(pid=72382) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 15:15:46 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-b5acb247-093b-4b95-8211-714e6c7f6f60 tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:15:46 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-b5acb247-093b-4b95-8211-714e6c7f6f60 tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:15:46 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-b5acb247-093b-4b95-8211-714e6c7f6f60 tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:15:46 user nova-compute[72382]: DEBUG nova.compute.manager [req-e212c040-0125-48a5-80e2-53037cc7173b req-c8d04fc1-1e72-4683-a742-ffaabb4566be service nova] [instance: f0a7fa25-4520-4f40-9515-b88e3d2fd910] Received event network-changed-5b8a4395-5fb8-4ae6-a987-127e82862327 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:15:46 user nova-compute[72382]: DEBUG nova.compute.manager [req-e212c040-0125-48a5-80e2-53037cc7173b req-c8d04fc1-1e72-4683-a742-ffaabb4566be service nova] [instance: f0a7fa25-4520-4f40-9515-b88e3d2fd910] Refreshing instance network info cache due to event network-changed-5b8a4395-5fb8-4ae6-a987-127e82862327. {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 15:15:46 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-e212c040-0125-48a5-80e2-53037cc7173b req-c8d04fc1-1e72-4683-a742-ffaabb4566be service nova] Acquiring lock "refresh_cache-f0a7fa25-4520-4f40-9515-b88e3d2fd910" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 15:15:46 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-dab17cc8-d663-431f-881c-dfe633a6de11 tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:15:46 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-dab17cc8-d663-431f-881c-dfe633a6de11 tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:15:46 user nova-compute[72382]: DEBUG nova.network.neutron [None req-1be031b3-15c8-4cce-9487-45bdffa176b1 tempest-VolumesAssistedSnapshotsTest-459543424 tempest-VolumesAssistedSnapshotsTest-459543424-project-member] [instance: f0a7fa25-4520-4f40-9515-b88e3d2fd910] Instance cache missing network info. {{(pid=72382) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 15:15:46 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-dab17cc8-d663-431f-881c-dfe633a6de11 tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72382) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 15:15:46 user nova-compute[72382]: INFO nova.compute.claims [None req-dab17cc8-d663-431f-881c-dfe633a6de11 tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] [instance: 23f25946-de3a-43fb-97a4-1f9a787e6e51] Claim successful on node user
Aug 09 15:15:46 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:15:46 user nova-compute[72382]: DEBUG nova.network.neutron [None req-b5acb247-093b-4b95-8211-714e6c7f6f60 tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] [instance: a33515b3-3ef4-4f76-a8d8-e7008b5bbb79] Successfully created port: 32c23c7b-6885-4276-bca1-7d8a8cb924c1 {{(pid=72382) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 15:15:47 user nova-compute[72382]: DEBUG nova.compute.provider_tree [None req-dab17cc8-d663-431f-881c-dfe633a6de11 tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] Inventory has not changed in ProviderTree for provider: 7b15b0e5-df4d-49db-833b-2855d21d10ae {{(pid=72382) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 15:15:47 user nova-compute[72382]: DEBUG nova.network.neutron [None req-1be031b3-15c8-4cce-9487-45bdffa176b1 tempest-VolumesAssistedSnapshotsTest-459543424 tempest-VolumesAssistedSnapshotsTest-459543424-project-member] [instance: f0a7fa25-4520-4f40-9515-b88e3d2fd910] Updating instance_info_cache with network_info: [{"id": "5b8a4395-5fb8-4ae6-a987-127e82862327", "address": "fa:16:3e:55:d7:da", "network": {"id": "cdb7cc30-fb6f-4cb2-8162-a15463a93a4a", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1417098143-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dcde0eaf3243471280e72b35b04a1022", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b8a4395-5f", "ovs_interfaceid": "5b8a4395-5fb8-4ae6-a987-127e82862327", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:15:47 user nova-compute[72382]: DEBUG nova.scheduler.client.report [None req-dab17cc8-d663-431f-881c-dfe633a6de11 tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] Inventory has not changed for provider 7b15b0e5-df4d-49db-833b-2855d21d10ae based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72382) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 15:15:47 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-1be031b3-15c8-4cce-9487-45bdffa176b1 tempest-VolumesAssistedSnapshotsTest-459543424 tempest-VolumesAssistedSnapshotsTest-459543424-project-member] Releasing lock "refresh_cache-f0a7fa25-4520-4f40-9515-b88e3d2fd910" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 15:15:47 user nova-compute[72382]: DEBUG nova.compute.manager [None req-1be031b3-15c8-4cce-9487-45bdffa176b1 tempest-VolumesAssistedSnapshotsTest-459543424 tempest-VolumesAssistedSnapshotsTest-459543424-project-member] [instance: f0a7fa25-4520-4f40-9515-b88e3d2fd910] Instance network_info: |[{"id": "5b8a4395-5fb8-4ae6-a987-127e82862327", "address": "fa:16:3e:55:d7:da", "network": {"id": "cdb7cc30-fb6f-4cb2-8162-a15463a93a4a", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1417098143-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dcde0eaf3243471280e72b35b04a1022", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b8a4395-5f", "ovs_interfaceid": "5b8a4395-5fb8-4ae6-a987-127e82862327", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72382) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 15:15:47 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-e212c040-0125-48a5-80e2-53037cc7173b req-c8d04fc1-1e72-4683-a742-ffaabb4566be service nova] Acquired lock "refresh_cache-f0a7fa25-4520-4f40-9515-b88e3d2fd910" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 15:15:47 user nova-compute[72382]: DEBUG nova.network.neutron [req-e212c040-0125-48a5-80e2-53037cc7173b req-c8d04fc1-1e72-4683-a742-ffaabb4566be service nova] [instance: f0a7fa25-4520-4f40-9515-b88e3d2fd910] Refreshing network info cache for port 5b8a4395-5fb8-4ae6-a987-127e82862327 {{(pid=72382) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 15:15:47 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-1be031b3-15c8-4cce-9487-45bdffa176b1 tempest-VolumesAssistedSnapshotsTest-459543424 tempest-VolumesAssistedSnapshotsTest-459543424-project-member] [instance: f0a7fa25-4520-4f40-9515-b88e3d2fd910] Start _get_guest_xml network_info=[{"id": "5b8a4395-5fb8-4ae6-a987-127e82862327", "address": "fa:16:3e:55:d7:da", "network": {"id": "cdb7cc30-fb6f-4cb2-8162-a15463a93a4a", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1417098143-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dcde0eaf3243471280e72b35b04a1022", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b8a4395-5f", "ovs_interfaceid": "5b8a4395-5fb8-4ae6-a987-127e82862327", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T15:11:25Z,direct_url=<?>,disk_format='qcow2',id=a79f2cea-eb27-4631-aaf3-05e7d9e411b4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a638990e12cc4d6eabb6d55e13be6bdf',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T15:11:27Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'a79f2cea-eb27-4631-aaf3-05e7d9e411b4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72382) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 15:15:47 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-dab17cc8-d663-431f-881c-dfe633a6de11 tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.940s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:15:47 user nova-compute[72382]: DEBUG nova.compute.manager [None req-dab17cc8-d663-431f-881c-dfe633a6de11 tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] [instance: 23f25946-de3a-43fb-97a4-1f9a787e6e51] Start building networks asynchronously for instance. {{(pid=72382) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 15:15:47 user nova-compute[72382]: WARNING nova.virt.libvirt.driver [None req-1be031b3-15c8-4cce-9487-45bdffa176b1 tempest-VolumesAssistedSnapshotsTest-459543424 tempest-VolumesAssistedSnapshotsTest-459543424-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 15:15:47 user nova-compute[72382]: WARNING nova.virt.libvirt.driver [None req-1be031b3-15c8-4cce-9487-45bdffa176b1 tempest-VolumesAssistedSnapshotsTest-459543424 tempest-VolumesAssistedSnapshotsTest-459543424-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 15:15:47 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-1be031b3-15c8-4cce-9487-45bdffa176b1 tempest-VolumesAssistedSnapshotsTest-459543424 tempest-VolumesAssistedSnapshotsTest-459543424-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72382) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 15:15:47 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-1be031b3-15c8-4cce-9487-45bdffa176b1 tempest-VolumesAssistedSnapshotsTest-459543424 tempest-VolumesAssistedSnapshotsTest-459543424-project-member] CPU controller missing on host. {{(pid=72382) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 15:15:47 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-1be031b3-15c8-4cce-9487-45bdffa176b1 tempest-VolumesAssistedSnapshotsTest-459543424 tempest-VolumesAssistedSnapshotsTest-459543424-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72382) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 15:15:47 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-1be031b3-15c8-4cce-9487-45bdffa176b1 tempest-VolumesAssistedSnapshotsTest-459543424 tempest-VolumesAssistedSnapshotsTest-459543424-project-member] CPU controller found on host. {{(pid=72382) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 15:15:47 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-1be031b3-15c8-4cce-9487-45bdffa176b1 tempest-VolumesAssistedSnapshotsTest-459543424 tempest-VolumesAssistedSnapshotsTest-459543424-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72382) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 15:15:47 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-1be031b3-15c8-4cce-9487-45bdffa176b1 tempest-VolumesAssistedSnapshotsTest-459543424 tempest-VolumesAssistedSnapshotsTest-459543424-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T15:11:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T15:11:25Z,direct_url=<?>,disk_format='qcow2',id=a79f2cea-eb27-4631-aaf3-05e7d9e411b4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a638990e12cc4d6eabb6d55e13be6bdf',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T15:11:27Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 15:15:47 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-1be031b3-15c8-4cce-9487-45bdffa176b1 tempest-VolumesAssistedSnapshotsTest-459543424 tempest-VolumesAssistedSnapshotsTest-459543424-project-member] Flavor limits 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 15:15:47 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-1be031b3-15c8-4cce-9487-45bdffa176b1 tempest-VolumesAssistedSnapshotsTest-459543424 tempest-VolumesAssistedSnapshotsTest-459543424-project-member] Image limits 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 15:15:47 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-1be031b3-15c8-4cce-9487-45bdffa176b1 tempest-VolumesAssistedSnapshotsTest-459543424 tempest-VolumesAssistedSnapshotsTest-459543424-project-member] Flavor pref 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 15:15:47 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-1be031b3-15c8-4cce-9487-45bdffa176b1 tempest-VolumesAssistedSnapshotsTest-459543424 tempest-VolumesAssistedSnapshotsTest-459543424-project-member] Image pref 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 15:15:47 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-1be031b3-15c8-4cce-9487-45bdffa176b1 tempest-VolumesAssistedSnapshotsTest-459543424 tempest-VolumesAssistedSnapshotsTest-459543424-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 15:15:47 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-1be031b3-15c8-4cce-9487-45bdffa176b1 tempest-VolumesAssistedSnapshotsTest-459543424 tempest-VolumesAssistedSnapshotsTest-459543424-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 15:15:47 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-1be031b3-15c8-4cce-9487-45bdffa176b1 tempest-VolumesAssistedSnapshotsTest-459543424 tempest-VolumesAssistedSnapshotsTest-459543424-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72382) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 15:15:47 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-1be031b3-15c8-4cce-9487-45bdffa176b1 tempest-VolumesAssistedSnapshotsTest-459543424 tempest-VolumesAssistedSnapshotsTest-459543424-project-member] Got 1 possible topologies {{(pid=72382) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 15:15:47 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-1be031b3-15c8-4cce-9487-45bdffa176b1 tempest-VolumesAssistedSnapshotsTest-459543424 tempest-VolumesAssistedSnapshotsTest-459543424-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 15:15:47 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-1be031b3-15c8-4cce-9487-45bdffa176b1 tempest-VolumesAssistedSnapshotsTest-459543424 tempest-VolumesAssistedSnapshotsTest-459543424-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 15:15:47 user nova-compute[72382]: DEBUG nova.virt.libvirt.vif [None req-1be031b3-15c8-4cce-9487-45bdffa176b1 tempest-VolumesAssistedSnapshotsTest-459543424 tempest-VolumesAssistedSnapshotsTest-459543424-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T15:15:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-199751692',display_name='tempest-VolumesAssistedSnapshotsTest-server-199751692',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-199751692',id=7,image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNxu0OS/NToDrwr8TZFshbe/JIUtEnU+tqzMSpGlDt7M12sNrzWEZR3BYOGiTVgImoLFrkmYFhFMHDKabEh2A0WEQqvaAu83twZck9/QqR2weIDWA2VeJXxATgkR1efc8Q==',key_name='tempest-keypair-1457840792',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dcde0eaf3243471280e72b35b04a1022',ramdisk_id='',reservation_id='r-rdk0kvj2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-459543424',owner_user_name='tempest-VolumesAssistedSnapshotsTest-459543424-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T15:15:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='51c6aec879314db3a142d69bcfbd18f3',uuid=f0a7fa25-4520-4f40-9515-b88e3d2fd910,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5b8a4395-5fb8-4ae6-a987-127e82862327", "address": "fa:16:3e:55:d7:da", "network": {"id": "cdb7cc30-fb6f-4cb2-8162-a15463a93a4a", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1417098143-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dcde0eaf3243471280e72b35b04a1022", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b8a4395-5f", "ovs_interfaceid": "5b8a4395-5fb8-4ae6-a987-127e82862327", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72382) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 15:15:47 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-1be031b3-15c8-4cce-9487-45bdffa176b1 tempest-VolumesAssistedSnapshotsTest-459543424 tempest-VolumesAssistedSnapshotsTest-459543424-project-member] Converting VIF {"id": "5b8a4395-5fb8-4ae6-a987-127e82862327", "address": "fa:16:3e:55:d7:da", "network": {"id": "cdb7cc30-fb6f-4cb2-8162-a15463a93a4a", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1417098143-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dcde0eaf3243471280e72b35b04a1022", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b8a4395-5f", "ovs_interfaceid": "5b8a4395-5fb8-4ae6-a987-127e82862327", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 15:15:47 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-1be031b3-15c8-4cce-9487-45bdffa176b1 tempest-VolumesAssistedSnapshotsTest-459543424 tempest-VolumesAssistedSnapshotsTest-459543424-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:55:d7:da,bridge_name='br-int',has_traffic_filtering=True,id=5b8a4395-5fb8-4ae6-a987-127e82862327,network=Network(cdb7cc30-fb6f-4cb2-8162-a15463a93a4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b8a4395-5f') {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 15:15:47 user nova-compute[72382]: DEBUG nova.objects.instance [None req-1be031b3-15c8-4cce-9487-45bdffa176b1 tempest-VolumesAssistedSnapshotsTest-459543424 tempest-VolumesAssistedSnapshotsTest-459543424-project-member] Lazy-loading 'pci_devices' on Instance uuid f0a7fa25-4520-4f40-9515-b88e3d2fd910 {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:15:47 user nova-compute[72382]: DEBUG nova.compute.manager [None req-dab17cc8-d663-431f-881c-dfe633a6de11 tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] [instance: 23f25946-de3a-43fb-97a4-1f9a787e6e51] Allocating IP information in the background. {{(pid=72382) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 15:15:47 user nova-compute[72382]: DEBUG nova.network.neutron [None req-dab17cc8-d663-431f-881c-dfe633a6de11 tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] [instance: 23f25946-de3a-43fb-97a4-1f9a787e6e51] allocate_for_instance() {{(pid=72382) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 15:15:47 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-1be031b3-15c8-4cce-9487-45bdffa176b1 tempest-VolumesAssistedSnapshotsTest-459543424 tempest-VolumesAssistedSnapshotsTest-459543424-project-member] [instance: f0a7fa25-4520-4f40-9515-b88e3d2fd910] End _get_guest_xml xml=<domain type="kvm">
Aug 09 15:15:47 user nova-compute[72382]:   <uuid>f0a7fa25-4520-4f40-9515-b88e3d2fd910</uuid>
Aug 09 15:15:47 user nova-compute[72382]:   <name>instance-00000007</name>
Aug 09 15:15:47 user nova-compute[72382]:   <memory>524288</memory>
Aug 09 15:15:47 user nova-compute[72382]:   <vcpu>1</vcpu>
Aug 09 15:15:47 user nova-compute[72382]:   <metadata>
Aug 09 15:15:47 user nova-compute[72382]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 15:15:47 user nova-compute[72382]:       <nova:package version="0.0.0"/>
Aug 09 15:15:47 user nova-compute[72382]:       <nova:name>tempest-VolumesAssistedSnapshotsTest-server-199751692</nova:name>
Aug 09 15:15:47 user nova-compute[72382]:       <nova:creationTime>2023-08-09 15:15:47</nova:creationTime>
Aug 09 15:15:47 user nova-compute[72382]:       <nova:flavor name="m1.tiny">
Aug 09 15:15:47 user nova-compute[72382]:         <nova:memory>512</nova:memory>
Aug 09 15:15:47 user nova-compute[72382]:         <nova:disk>1</nova:disk>
Aug 09 15:15:47 user nova-compute[72382]:         <nova:swap>0</nova:swap>
Aug 09 15:15:47 user nova-compute[72382]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 15:15:47 user nova-compute[72382]:         <nova:vcpus>1</nova:vcpus>
Aug 09 15:15:47 user nova-compute[72382]:       </nova:flavor>
Aug 09 15:15:47 user nova-compute[72382]:       <nova:owner>
Aug 09 15:15:47 user nova-compute[72382]:         <nova:user uuid="51c6aec879314db3a142d69bcfbd18f3">tempest-VolumesAssistedSnapshotsTest-459543424-project-member</nova:user>
Aug 09 15:15:47 user nova-compute[72382]:         <nova:project uuid="dcde0eaf3243471280e72b35b04a1022">tempest-VolumesAssistedSnapshotsTest-459543424</nova:project>
Aug 09 15:15:47 user nova-compute[72382]:       </nova:owner>
Aug 09 15:15:47 user nova-compute[72382]:       <nova:root type="image" uuid="a79f2cea-eb27-4631-aaf3-05e7d9e411b4"/>
Aug 09 15:15:47 user nova-compute[72382]:       <nova:ports>
Aug 09 15:15:47 user nova-compute[72382]:         <nova:port uuid="5b8a4395-5fb8-4ae6-a987-127e82862327">
Aug 09 15:15:47 user nova-compute[72382]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 09 15:15:47 user nova-compute[72382]:         </nova:port>
Aug 09 15:15:47 user nova-compute[72382]:       </nova:ports>
Aug 09 15:15:47 user nova-compute[72382]:     </nova:instance>
Aug 09 15:15:47 user nova-compute[72382]:   </metadata>
Aug 09 15:15:47 user nova-compute[72382]:   <sysinfo type="smbios">
Aug 09 15:15:47 user nova-compute[72382]:     <system>
Aug 09 15:15:47 user nova-compute[72382]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 15:15:47 user nova-compute[72382]:       <entry name="product">OpenStack Nova</entry>
Aug 09 15:15:47 user nova-compute[72382]:       <entry name="version">0.0.0</entry>
Aug 09 15:15:47 user nova-compute[72382]:       <entry name="serial">f0a7fa25-4520-4f40-9515-b88e3d2fd910</entry>
Aug 09 15:15:47 user nova-compute[72382]:       <entry name="uuid">f0a7fa25-4520-4f40-9515-b88e3d2fd910</entry>
Aug 09 15:15:47 user nova-compute[72382]:       <entry name="family">Virtual Machine</entry>
Aug 09 15:15:47 user nova-compute[72382]:     </system>
Aug 09 15:15:47 user nova-compute[72382]:   </sysinfo>
Aug 09 15:15:47 user nova-compute[72382]:   <os>
Aug 09 15:15:47 user nova-compute[72382]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 15:15:47 user nova-compute[72382]:     <boot dev="hd"/>
Aug 09 15:15:47 user nova-compute[72382]:     <smbios mode="sysinfo"/>
Aug 09 15:15:47 user nova-compute[72382]:   </os>
Aug 09 15:15:47 user nova-compute[72382]:   <features>
Aug 09 15:15:47 user nova-compute[72382]:     <acpi/>
Aug 09 15:15:47 user nova-compute[72382]:     <apic/>
Aug 09 15:15:47 user nova-compute[72382]:     <vmcoreinfo/>
Aug 09 15:15:47 user nova-compute[72382]:   </features>
Aug 09 15:15:47 user nova-compute[72382]:   <clock offset="utc">
Aug 09 15:15:47 user nova-compute[72382]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 15:15:47 user nova-compute[72382]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 15:15:47 user nova-compute[72382]:     <timer name="hpet" present="no"/>
Aug 09 15:15:47 user nova-compute[72382]:   </clock>
Aug 09 15:15:47 user nova-compute[72382]:   <cpu mode="custom" match="exact">
Aug 09 15:15:47 user nova-compute[72382]:     <model>Nehalem</model>
Aug 09 15:15:47 user nova-compute[72382]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 15:15:47 user nova-compute[72382]:   </cpu>
Aug 09 15:15:47 user nova-compute[72382]:   <devices>
Aug 09 15:15:47 user nova-compute[72382]:     <disk type="file" device="disk">
Aug 09 15:15:47 user nova-compute[72382]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 15:15:47 user nova-compute[72382]:       <source file="/opt/stack/data/nova/instances/f0a7fa25-4520-4f40-9515-b88e3d2fd910/disk"/>
Aug 09 15:15:47 user nova-compute[72382]:       <target dev="vda" bus="virtio"/>
Aug 09 15:15:47 user nova-compute[72382]:     </disk>
Aug 09 15:15:47 user nova-compute[72382]:     <interface type="ethernet">
Aug 09 15:15:47 user nova-compute[72382]:       <mac address="fa:16:3e:55:d7:da"/>
Aug 09 15:15:47 user nova-compute[72382]:       <model type="virtio"/>
Aug 09 15:15:47 user nova-compute[72382]:       <mtu size="1442"/>
Aug 09 15:15:47 user nova-compute[72382]:       <target dev="tap5b8a4395-5f"/>
Aug 09 15:15:47 user nova-compute[72382]:     </interface>
Aug 09 15:15:47 user nova-compute[72382]:     <serial type="pty">
Aug 09 15:15:47 user nova-compute[72382]:       <log file="/opt/stack/data/nova/instances/f0a7fa25-4520-4f40-9515-b88e3d2fd910/console.log" append="off"/>
Aug 09 15:15:47 user nova-compute[72382]:     </serial>
Aug 09 15:15:47 user nova-compute[72382]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 15:15:47 user nova-compute[72382]:     <video>
Aug 09 15:15:47 user nova-compute[72382]:       <model type="virtio"/>
Aug 09 15:15:47 user nova-compute[72382]:     </video>
Aug 09 15:15:47 user nova-compute[72382]:     <rng model="virtio">
Aug 09 15:15:47 user nova-compute[72382]:       <backend model="random">/dev/urandom</backend>
Aug 09 15:15:47 user nova-compute[72382]:     </rng>
Aug 09 15:15:47 user nova-compute[72382]:     <controller type="usb" index="0" model="none"/>
Aug 09 15:15:47 user nova-compute[72382]:     <memballoon model="virtio">
Aug 09 15:15:47 user nova-compute[72382]:       <stats period="10"/>
Aug 09 15:15:47 user nova-compute[72382]:     </memballoon>
Aug 09 15:15:47 user nova-compute[72382]:   </devices>
Aug 09 15:15:47 user nova-compute[72382]: </domain>
Aug 09 15:15:47 user nova-compute[72382]:  {{(pid=72382) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 15:15:47 user nova-compute[72382]: DEBUG nova.virt.libvirt.vif [None req-1be031b3-15c8-4cce-9487-45bdffa176b1 tempest-VolumesAssistedSnapshotsTest-459543424 tempest-VolumesAssistedSnapshotsTest-459543424-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T15:15:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-199751692',display_name='tempest-VolumesAssistedSnapshotsTest-server-199751692',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-199751692',id=7,image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNxu0OS/NToDrwr8TZFshbe/JIUtEnU+tqzMSpGlDt7M12sNrzWEZR3BYOGiTVgImoLFrkmYFhFMHDKabEh2A0WEQqvaAu83twZck9/QqR2weIDWA2VeJXxATgkR1efc8Q==',key_name='tempest-keypair-1457840792',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dcde0eaf3243471280e72b35b04a1022',ramdisk_id='',reservation_id='r-rdk0kvj2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-459543424',owner_user_name='tempest-VolumesAssistedSnapshotsTest-459543424-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T15:15:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='51c6aec879314db3a142d69bcfbd18f3',uuid=f0a7fa25-4520-4f40-9515-b88e3d2fd910,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5b8a4395-5fb8-4ae6-a987-127e82862327", "address": "fa:16:3e:55:d7:da", "network": {"id": "cdb7cc30-fb6f-4cb2-8162-a15463a93a4a", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1417098143-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dcde0eaf3243471280e72b35b04a1022", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b8a4395-5f", "ovs_interfaceid": "5b8a4395-5fb8-4ae6-a987-127e82862327", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 15:15:47 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-1be031b3-15c8-4cce-9487-45bdffa176b1 tempest-VolumesAssistedSnapshotsTest-459543424 tempest-VolumesAssistedSnapshotsTest-459543424-project-member] Converting VIF {"id": "5b8a4395-5fb8-4ae6-a987-127e82862327", "address": "fa:16:3e:55:d7:da", "network": {"id": "cdb7cc30-fb6f-4cb2-8162-a15463a93a4a", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1417098143-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dcde0eaf3243471280e72b35b04a1022", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b8a4395-5f", "ovs_interfaceid": "5b8a4395-5fb8-4ae6-a987-127e82862327", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 15:15:47 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-1be031b3-15c8-4cce-9487-45bdffa176b1 tempest-VolumesAssistedSnapshotsTest-459543424 tempest-VolumesAssistedSnapshotsTest-459543424-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:55:d7:da,bridge_name='br-int',has_traffic_filtering=True,id=5b8a4395-5fb8-4ae6-a987-127e82862327,network=Network(cdb7cc30-fb6f-4cb2-8162-a15463a93a4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b8a4395-5f') {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 15:15:47 user nova-compute[72382]: DEBUG os_vif [None req-1be031b3-15c8-4cce-9487-45bdffa176b1 tempest-VolumesAssistedSnapshotsTest-459543424 tempest-VolumesAssistedSnapshotsTest-459543424-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:55:d7:da,bridge_name='br-int',has_traffic_filtering=True,id=5b8a4395-5fb8-4ae6-a987-127e82862327,network=Network(cdb7cc30-fb6f-4cb2-8162-a15463a93a4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b8a4395-5f') {{(pid=72382) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 15:15:47 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:15:47 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:15:47 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 15:15:47 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-dab17cc8-d663-431f-881c-dfe633a6de11 tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] [instance: 23f25946-de3a-43fb-97a4-1f9a787e6e51] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 15:15:47 user nova-compute[72382]: DEBUG nova.compute.manager [req-05163456-4b10-49c9-8979-2478d5894dbd req-765591f1-f085-4965-bbed-f474983d884d service nova] [instance: 24b63f7a-be32-424b-b72c-d5bec43c408e] Received event network-vif-plugged-f21a4544-6f79-47c6-8577-f5e8d2b440bd {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:15:47 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-05163456-4b10-49c9-8979-2478d5894dbd req-765591f1-f085-4965-bbed-f474983d884d service nova] Acquiring lock "24b63f7a-be32-424b-b72c-d5bec43c408e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:15:47 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-05163456-4b10-49c9-8979-2478d5894dbd req-765591f1-f085-4965-bbed-f474983d884d service nova] Lock "24b63f7a-be32-424b-b72c-d5bec43c408e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:15:47 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-05163456-4b10-49c9-8979-2478d5894dbd req-765591f1-f085-4965-bbed-f474983d884d service nova] Lock "24b63f7a-be32-424b-b72c-d5bec43c408e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:15:47 user nova-compute[72382]: DEBUG nova.compute.manager [req-05163456-4b10-49c9-8979-2478d5894dbd req-765591f1-f085-4965-bbed-f474983d884d service nova] [instance: 24b63f7a-be32-424b-b72c-d5bec43c408e] No waiting events found dispatching network-vif-plugged-f21a4544-6f79-47c6-8577-f5e8d2b440bd {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:15:47 user nova-compute[72382]: WARNING nova.compute.manager [req-05163456-4b10-49c9-8979-2478d5894dbd req-765591f1-f085-4965-bbed-f474983d884d service nova] [instance: 24b63f7a-be32-424b-b72c-d5bec43c408e] Received unexpected event network-vif-plugged-f21a4544-6f79-47c6-8577-f5e8d2b440bd for instance with vm_state building and task_state spawning.
Aug 09 15:15:47 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:15:47 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5b8a4395-5f, may_exist=True, interface_attrs={}) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:15:47 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5b8a4395-5f, col_values=(('external_ids', {'iface-id': '5b8a4395-5fb8-4ae6-a987-127e82862327', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:55:d7:da', 'vm-uuid': 'f0a7fa25-4520-4f40-9515-b88e3d2fd910'}),), if_exists=True) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:15:47 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:15:47 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:15:47 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:15:47 user nova-compute[72382]: INFO os_vif [None req-1be031b3-15c8-4cce-9487-45bdffa176b1 tempest-VolumesAssistedSnapshotsTest-459543424 tempest-VolumesAssistedSnapshotsTest-459543424-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:55:d7:da,bridge_name='br-int',has_traffic_filtering=True,id=5b8a4395-5fb8-4ae6-a987-127e82862327,network=Network(cdb7cc30-fb6f-4cb2-8162-a15463a93a4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b8a4395-5f')
Aug 09 15:15:47 user nova-compute[72382]: DEBUG nova.compute.manager [None req-dab17cc8-d663-431f-881c-dfe633a6de11 tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] [instance: 23f25946-de3a-43fb-97a4-1f9a787e6e51] Start building block device mappings for instance. {{(pid=72382) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 15:15:47 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-1be031b3-15c8-4cce-9487-45bdffa176b1 tempest-VolumesAssistedSnapshotsTest-459543424 tempest-VolumesAssistedSnapshotsTest-459543424-project-member] No BDM found with device name vda, not building metadata. {{(pid=72382) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 15:15:47 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-1be031b3-15c8-4cce-9487-45bdffa176b1 tempest-VolumesAssistedSnapshotsTest-459543424 tempest-VolumesAssistedSnapshotsTest-459543424-project-member] No VIF found with MAC fa:16:3e:55:d7:da, not building metadata {{(pid=72382) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 15:15:47 user nova-compute[72382]: DEBUG nova.compute.manager [None req-dab17cc8-d663-431f-881c-dfe633a6de11 tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] [instance: 23f25946-de3a-43fb-97a4-1f9a787e6e51] Start spawning the instance on the hypervisor. {{(pid=72382) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 15:15:47 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-dab17cc8-d663-431f-881c-dfe633a6de11 tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] [instance: 23f25946-de3a-43fb-97a4-1f9a787e6e51] Creating instance directory {{(pid=72382) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 15:15:47 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-dab17cc8-d663-431f-881c-dfe633a6de11 tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] [instance: 23f25946-de3a-43fb-97a4-1f9a787e6e51] Creating image(s)
Aug 09 15:15:47 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-dab17cc8-d663-431f-881c-dfe633a6de11 tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] Acquiring lock "/opt/stack/data/nova/instances/23f25946-de3a-43fb-97a4-1f9a787e6e51/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:15:47 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-dab17cc8-d663-431f-881c-dfe633a6de11 tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] Lock "/opt/stack/data/nova/instances/23f25946-de3a-43fb-97a4-1f9a787e6e51/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:15:47 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-dab17cc8-d663-431f-881c-dfe633a6de11 tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] Lock "/opt/stack/data/nova/instances/23f25946-de3a-43fb-97a4-1f9a787e6e51/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:15:47 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-dab17cc8-d663-431f-881c-dfe633a6de11 tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:15:47 user nova-compute[72382]: DEBUG nova.policy [None req-dab17cc8-d663-431f-881c-dfe633a6de11 tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '97fa102d2fed4045a326b0f5efbd1b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84d09ad643146859e76996c09ba02c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72382) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 15:15:47 user nova-compute[72382]: DEBUG nova.virt.driver [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Emitting event <LifecycleEvent: 1691594147.8820565, 24b63f7a-be32-424b-b72c-d5bec43c408e => Resumed> {{(pid=72382) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 15:15:47 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 24b63f7a-be32-424b-b72c-d5bec43c408e] VM Resumed (Lifecycle Event)
Aug 09 15:15:47 user nova-compute[72382]: DEBUG nova.compute.manager [None req-da354ed4-e0c5-47bc-b068-b96062ddd053 tempest-AttachSCSIVolumeTestJSON-1083630769 tempest-AttachSCSIVolumeTestJSON-1083630769-project-member] [instance: 24b63f7a-be32-424b-b72c-d5bec43c408e] Instance event wait completed in 0 seconds for  {{(pid=72382) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 15:15:47 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-da354ed4-e0c5-47bc-b068-b96062ddd053 tempest-AttachSCSIVolumeTestJSON-1083630769 tempest-AttachSCSIVolumeTestJSON-1083630769-project-member] [instance: 24b63f7a-be32-424b-b72c-d5bec43c408e] Guest created on hypervisor {{(pid=72382) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 15:15:47 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 24b63f7a-be32-424b-b72c-d5bec43c408e] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:15:47 user nova-compute[72382]: INFO nova.virt.libvirt.driver [-] [instance: 24b63f7a-be32-424b-b72c-d5bec43c408e] Instance spawned successfully.
Aug 09 15:15:47 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-da354ed4-e0c5-47bc-b068-b96062ddd053 tempest-AttachSCSIVolumeTestJSON-1083630769 tempest-AttachSCSIVolumeTestJSON-1083630769-project-member] [instance: 24b63f7a-be32-424b-b72c-d5bec43c408e] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 15:15:47 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 24b63f7a-be32-424b-b72c-d5bec43c408e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72382) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 15:15:47 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-da354ed4-e0c5-47bc-b068-b96062ddd053 tempest-AttachSCSIVolumeTestJSON-1083630769 tempest-AttachSCSIVolumeTestJSON-1083630769-project-member] [instance: 24b63f7a-be32-424b-b72c-d5bec43c408e] Found default for hw_input_bus of None {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:15:47 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-da354ed4-e0c5-47bc-b068-b96062ddd053 tempest-AttachSCSIVolumeTestJSON-1083630769 tempest-AttachSCSIVolumeTestJSON-1083630769-project-member] [instance: 24b63f7a-be32-424b-b72c-d5bec43c408e] Found default for hw_pointer_model of None {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:15:47 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-da354ed4-e0c5-47bc-b068-b96062ddd053 tempest-AttachSCSIVolumeTestJSON-1083630769 tempest-AttachSCSIVolumeTestJSON-1083630769-project-member] [instance: 24b63f7a-be32-424b-b72c-d5bec43c408e] Found default for hw_video_model of virtio {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:15:47 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-da354ed4-e0c5-47bc-b068-b96062ddd053 tempest-AttachSCSIVolumeTestJSON-1083630769 tempest-AttachSCSIVolumeTestJSON-1083630769-project-member] [instance: 24b63f7a-be32-424b-b72c-d5bec43c408e] Found default for hw_vif_model of virtio {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:15:47 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-dab17cc8-d663-431f-881c-dfe633a6de11 tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b --force-share --output=json" returned: 0 in 0.305s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:15:47 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-dab17cc8-d663-431f-881c-dfe633a6de11 tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] Acquiring lock "383812ff437283e0191ed5b9ecc04c27f1162b0b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:15:47 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-dab17cc8-d663-431f-881c-dfe633a6de11 tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] Lock "383812ff437283e0191ed5b9ecc04c27f1162b0b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:15:47 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-dab17cc8-d663-431f-881c-dfe633a6de11 tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:15:48 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 24b63f7a-be32-424b-b72c-d5bec43c408e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 15:15:48 user nova-compute[72382]: DEBUG nova.virt.driver [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Emitting event <LifecycleEvent: 1691594147.8970354, 24b63f7a-be32-424b-b72c-d5bec43c408e => Started> {{(pid=72382) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 15:15:48 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 24b63f7a-be32-424b-b72c-d5bec43c408e] VM Started (Lifecycle Event)
Aug 09 15:15:48 user nova-compute[72382]: INFO nova.compute.manager [None req-da354ed4-e0c5-47bc-b068-b96062ddd053 tempest-AttachSCSIVolumeTestJSON-1083630769 tempest-AttachSCSIVolumeTestJSON-1083630769-project-member] [instance: 24b63f7a-be32-424b-b72c-d5bec43c408e] Took 13.13 seconds to spawn the instance on the hypervisor.
Aug 09 15:15:48 user nova-compute[72382]: DEBUG nova.compute.manager [None req-da354ed4-e0c5-47bc-b068-b96062ddd053 tempest-AttachSCSIVolumeTestJSON-1083630769 tempest-AttachSCSIVolumeTestJSON-1083630769-project-member] [instance: 24b63f7a-be32-424b-b72c-d5bec43c408e] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:15:48 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 24b63f7a-be32-424b-b72c-d5bec43c408e] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:15:48 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 24b63f7a-be32-424b-b72c-d5bec43c408e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72382) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 15:15:48 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-dab17cc8-d663-431f-881c-dfe633a6de11 tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b --force-share --output=json" returned: 0 in 0.307s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:15:48 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-dab17cc8-d663-431f-881c-dfe633a6de11 tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b,backing_fmt=raw /opt/stack/data/nova/instances/23f25946-de3a-43fb-97a4-1f9a787e6e51/disk 1073741824 {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:15:48 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 24b63f7a-be32-424b-b72c-d5bec43c408e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 15:15:48 user nova-compute[72382]: INFO nova.compute.manager [None req-da354ed4-e0c5-47bc-b068-b96062ddd053 tempest-AttachSCSIVolumeTestJSON-1083630769 tempest-AttachSCSIVolumeTestJSON-1083630769-project-member] [instance: 24b63f7a-be32-424b-b72c-d5bec43c408e] Took 14.62 seconds to build instance.
Aug 09 15:15:48 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-dab17cc8-d663-431f-881c-dfe633a6de11 tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b,backing_fmt=raw /opt/stack/data/nova/instances/23f25946-de3a-43fb-97a4-1f9a787e6e51/disk 1073741824" returned: 0 in 0.154s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:15:48 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-dab17cc8-d663-431f-881c-dfe633a6de11 tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] Lock "383812ff437283e0191ed5b9ecc04c27f1162b0b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.497s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:15:48 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-dab17cc8-d663-431f-881c-dfe633a6de11 tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:15:48 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-da354ed4-e0c5-47bc-b068-b96062ddd053 tempest-AttachSCSIVolumeTestJSON-1083630769 tempest-AttachSCSIVolumeTestJSON-1083630769-project-member] Lock "24b63f7a-be32-424b-b72c-d5bec43c408e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.875s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:15:48 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:15:48 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-dab17cc8-d663-431f-881c-dfe633a6de11 tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b --force-share --output=json" returned: 0 in 0.298s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:15:48 user nova-compute[72382]: DEBUG nova.virt.disk.api [None req-dab17cc8-d663-431f-881c-dfe633a6de11 tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] Checking if we can resize image /opt/stack/data/nova/instances/23f25946-de3a-43fb-97a4-1f9a787e6e51/disk. size=1073741824 {{(pid=72382) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 15:15:48 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-dab17cc8-d663-431f-881c-dfe633a6de11 tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23f25946-de3a-43fb-97a4-1f9a787e6e51/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:15:49 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-dab17cc8-d663-431f-881c-dfe633a6de11 tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23f25946-de3a-43fb-97a4-1f9a787e6e51/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:15:49 user nova-compute[72382]: DEBUG nova.virt.disk.api [None req-dab17cc8-d663-431f-881c-dfe633a6de11 tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] Cannot resize image /opt/stack/data/nova/instances/23f25946-de3a-43fb-97a4-1f9a787e6e51/disk to a smaller size. {{(pid=72382) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 15:15:49 user nova-compute[72382]: DEBUG nova.objects.instance [None req-dab17cc8-d663-431f-881c-dfe633a6de11 tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] Lazy-loading 'migration_context' on Instance uuid 23f25946-de3a-43fb-97a4-1f9a787e6e51 {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:15:49 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-dab17cc8-d663-431f-881c-dfe633a6de11 tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] [instance: 23f25946-de3a-43fb-97a4-1f9a787e6e51] Created local disks {{(pid=72382) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 15:15:49 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-dab17cc8-d663-431f-881c-dfe633a6de11 tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] [instance: 23f25946-de3a-43fb-97a4-1f9a787e6e51] Ensure instance console log exists: /opt/stack/data/nova/instances/23f25946-de3a-43fb-97a4-1f9a787e6e51/console.log {{(pid=72382) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 15:15:49 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-dab17cc8-d663-431f-881c-dfe633a6de11 tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:15:49 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-dab17cc8-d663-431f-881c-dfe633a6de11 tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:15:49 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-dab17cc8-d663-431f-881c-dfe633a6de11 tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:15:49 user nova-compute[72382]: DEBUG nova.network.neutron [req-e212c040-0125-48a5-80e2-53037cc7173b req-c8d04fc1-1e72-4683-a742-ffaabb4566be service nova] [instance: f0a7fa25-4520-4f40-9515-b88e3d2fd910] Updated VIF entry in instance network info cache for port 5b8a4395-5fb8-4ae6-a987-127e82862327. {{(pid=72382) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 15:15:49 user nova-compute[72382]: DEBUG nova.network.neutron [req-e212c040-0125-48a5-80e2-53037cc7173b req-c8d04fc1-1e72-4683-a742-ffaabb4566be service nova] [instance: f0a7fa25-4520-4f40-9515-b88e3d2fd910] Updating instance_info_cache with network_info: [{"id": "5b8a4395-5fb8-4ae6-a987-127e82862327", "address": "fa:16:3e:55:d7:da", "network": {"id": "cdb7cc30-fb6f-4cb2-8162-a15463a93a4a", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1417098143-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dcde0eaf3243471280e72b35b04a1022", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b8a4395-5f", "ovs_interfaceid": "5b8a4395-5fb8-4ae6-a987-127e82862327", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:15:49 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-e212c040-0125-48a5-80e2-53037cc7173b req-c8d04fc1-1e72-4683-a742-ffaabb4566be service nova] Releasing lock "refresh_cache-f0a7fa25-4520-4f40-9515-b88e3d2fd910" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 15:15:49 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:15:49 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:15:49 user nova-compute[72382]: DEBUG nova.network.neutron [None req-b5acb247-093b-4b95-8211-714e6c7f6f60 tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] [instance: a33515b3-3ef4-4f76-a8d8-e7008b5bbb79] Successfully updated port: 32c23c7b-6885-4276-bca1-7d8a8cb924c1 {{(pid=72382) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 15:15:49 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-b5acb247-093b-4b95-8211-714e6c7f6f60 tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] Acquiring lock "refresh_cache-a33515b3-3ef4-4f76-a8d8-e7008b5bbb79" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 15:15:49 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-b5acb247-093b-4b95-8211-714e6c7f6f60 tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] Acquired lock "refresh_cache-a33515b3-3ef4-4f76-a8d8-e7008b5bbb79" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 15:15:49 user nova-compute[72382]: DEBUG nova.network.neutron [None req-b5acb247-093b-4b95-8211-714e6c7f6f60 tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] [instance: a33515b3-3ef4-4f76-a8d8-e7008b5bbb79] Building network info cache for instance {{(pid=72382) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 15:15:49 user nova-compute[72382]: DEBUG nova.compute.manager [req-150af819-2f4d-4af7-bb24-9ff707919e96 req-215c4ed0-0a6c-47ed-8ff5-d38ac94eaada service nova] [instance: a33515b3-3ef4-4f76-a8d8-e7008b5bbb79] Received event network-changed-32c23c7b-6885-4276-bca1-7d8a8cb924c1 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:15:49 user nova-compute[72382]: DEBUG nova.compute.manager [req-150af819-2f4d-4af7-bb24-9ff707919e96 req-215c4ed0-0a6c-47ed-8ff5-d38ac94eaada service nova] [instance: a33515b3-3ef4-4f76-a8d8-e7008b5bbb79] Refreshing instance network info cache due to event network-changed-32c23c7b-6885-4276-bca1-7d8a8cb924c1. {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 15:15:49 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-150af819-2f4d-4af7-bb24-9ff707919e96 req-215c4ed0-0a6c-47ed-8ff5-d38ac94eaada service nova] Acquiring lock "refresh_cache-a33515b3-3ef4-4f76-a8d8-e7008b5bbb79" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 15:15:49 user nova-compute[72382]: DEBUG nova.network.neutron [None req-b5acb247-093b-4b95-8211-714e6c7f6f60 tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] [instance: a33515b3-3ef4-4f76-a8d8-e7008b5bbb79] Instance cache missing network info. {{(pid=72382) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 15:15:50 user nova-compute[72382]: DEBUG nova.network.neutron [None req-dab17cc8-d663-431f-881c-dfe633a6de11 tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] [instance: 23f25946-de3a-43fb-97a4-1f9a787e6e51] Successfully created port: 1c588f02-cc2c-47f1-8918-bf9b1d3ea215 {{(pid=72382) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 15:15:50 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:15:50 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:15:50 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:15:51 user nova-compute[72382]: DEBUG nova.network.neutron [None req-b5acb247-093b-4b95-8211-714e6c7f6f60 tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] [instance: a33515b3-3ef4-4f76-a8d8-e7008b5bbb79] Updating instance_info_cache with network_info: [{"id": "32c23c7b-6885-4276-bca1-7d8a8cb924c1", "address": "fa:16:3e:e9:da:b6", "network": {"id": "1a0f18df-96f2-4c90-8e53-fcbfc8f17bc4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1771770150-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b98e20f61c34fd6aa28cef7ceadf0d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32c23c7b-68", "ovs_interfaceid": "32c23c7b-6885-4276-bca1-7d8a8cb924c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:15:51 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-b5acb247-093b-4b95-8211-714e6c7f6f60 tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] Releasing lock "refresh_cache-a33515b3-3ef4-4f76-a8d8-e7008b5bbb79" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 15:15:51 user nova-compute[72382]: DEBUG nova.compute.manager [None req-b5acb247-093b-4b95-8211-714e6c7f6f60 tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] [instance: a33515b3-3ef4-4f76-a8d8-e7008b5bbb79] Instance network_info: |[{"id": "32c23c7b-6885-4276-bca1-7d8a8cb924c1", "address": "fa:16:3e:e9:da:b6", "network": {"id": "1a0f18df-96f2-4c90-8e53-fcbfc8f17bc4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1771770150-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b98e20f61c34fd6aa28cef7ceadf0d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32c23c7b-68", "ovs_interfaceid": "32c23c7b-6885-4276-bca1-7d8a8cb924c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72382) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 15:15:51 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-150af819-2f4d-4af7-bb24-9ff707919e96 req-215c4ed0-0a6c-47ed-8ff5-d38ac94eaada service nova] Acquired lock "refresh_cache-a33515b3-3ef4-4f76-a8d8-e7008b5bbb79" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 15:15:51 user nova-compute[72382]: DEBUG nova.network.neutron [req-150af819-2f4d-4af7-bb24-9ff707919e96 req-215c4ed0-0a6c-47ed-8ff5-d38ac94eaada service nova] [instance: a33515b3-3ef4-4f76-a8d8-e7008b5bbb79] Refreshing network info cache for port 32c23c7b-6885-4276-bca1-7d8a8cb924c1 {{(pid=72382) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 15:15:51 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-b5acb247-093b-4b95-8211-714e6c7f6f60 tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] [instance: a33515b3-3ef4-4f76-a8d8-e7008b5bbb79] Start _get_guest_xml network_info=[{"id": "32c23c7b-6885-4276-bca1-7d8a8cb924c1", "address": "fa:16:3e:e9:da:b6", "network": {"id": "1a0f18df-96f2-4c90-8e53-fcbfc8f17bc4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1771770150-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b98e20f61c34fd6aa28cef7ceadf0d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32c23c7b-68", "ovs_interfaceid": "32c23c7b-6885-4276-bca1-7d8a8cb924c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T15:11:25Z,direct_url=<?>,disk_format='qcow2',id=a79f2cea-eb27-4631-aaf3-05e7d9e411b4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a638990e12cc4d6eabb6d55e13be6bdf',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T15:11:27Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'a79f2cea-eb27-4631-aaf3-05e7d9e411b4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72382) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 15:15:51 user nova-compute[72382]: WARNING nova.virt.libvirt.driver [None req-b5acb247-093b-4b95-8211-714e6c7f6f60 tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 15:15:51 user nova-compute[72382]: WARNING nova.virt.libvirt.driver [None req-b5acb247-093b-4b95-8211-714e6c7f6f60 tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 15:15:51 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-b5acb247-093b-4b95-8211-714e6c7f6f60 tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72382) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 15:15:51 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-b5acb247-093b-4b95-8211-714e6c7f6f60 tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] CPU controller missing on host. {{(pid=72382) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 15:15:51 user nova-compute[72382]: DEBUG nova.compute.manager [req-c66a8faa-ed87-4b90-a738-9e5ddc2b9d59 req-a43cfb5b-e8fa-4a32-aaa8-d5b8dc1fc88c service nova] [instance: f0a7fa25-4520-4f40-9515-b88e3d2fd910] Received event network-vif-plugged-5b8a4395-5fb8-4ae6-a987-127e82862327 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:15:51 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-c66a8faa-ed87-4b90-a738-9e5ddc2b9d59 req-a43cfb5b-e8fa-4a32-aaa8-d5b8dc1fc88c service nova] Acquiring lock "f0a7fa25-4520-4f40-9515-b88e3d2fd910-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:15:51 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-c66a8faa-ed87-4b90-a738-9e5ddc2b9d59 req-a43cfb5b-e8fa-4a32-aaa8-d5b8dc1fc88c service nova] Lock "f0a7fa25-4520-4f40-9515-b88e3d2fd910-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:15:51 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-c66a8faa-ed87-4b90-a738-9e5ddc2b9d59 req-a43cfb5b-e8fa-4a32-aaa8-d5b8dc1fc88c service nova] Lock "f0a7fa25-4520-4f40-9515-b88e3d2fd910-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:15:51 user nova-compute[72382]: DEBUG nova.compute.manager [req-c66a8faa-ed87-4b90-a738-9e5ddc2b9d59 req-a43cfb5b-e8fa-4a32-aaa8-d5b8dc1fc88c service nova] [instance: f0a7fa25-4520-4f40-9515-b88e3d2fd910] No waiting events found dispatching network-vif-plugged-5b8a4395-5fb8-4ae6-a987-127e82862327 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:15:51 user nova-compute[72382]: WARNING nova.compute.manager [req-c66a8faa-ed87-4b90-a738-9e5ddc2b9d59 req-a43cfb5b-e8fa-4a32-aaa8-d5b8dc1fc88c service nova] [instance: f0a7fa25-4520-4f40-9515-b88e3d2fd910] Received unexpected event network-vif-plugged-5b8a4395-5fb8-4ae6-a987-127e82862327 for instance with vm_state building and task_state spawning.
Aug 09 15:15:51 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-b5acb247-093b-4b95-8211-714e6c7f6f60 tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72382) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 15:15:51 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-b5acb247-093b-4b95-8211-714e6c7f6f60 tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] CPU controller found on host. {{(pid=72382) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 15:15:51 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-b5acb247-093b-4b95-8211-714e6c7f6f60 tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72382) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 15:15:51 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-b5acb247-093b-4b95-8211-714e6c7f6f60 tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T15:11:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T15:11:25Z,direct_url=<?>,disk_format='qcow2',id=a79f2cea-eb27-4631-aaf3-05e7d9e411b4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a638990e12cc4d6eabb6d55e13be6bdf',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T15:11:27Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 15:15:51 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-b5acb247-093b-4b95-8211-714e6c7f6f60 tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] Flavor limits 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 15:15:51 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-b5acb247-093b-4b95-8211-714e6c7f6f60 tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] Image limits 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 15:15:51 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-b5acb247-093b-4b95-8211-714e6c7f6f60 tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] Flavor pref 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 15:15:51 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-b5acb247-093b-4b95-8211-714e6c7f6f60 tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] Image pref 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 15:15:51 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-b5acb247-093b-4b95-8211-714e6c7f6f60 tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 15:15:51 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-b5acb247-093b-4b95-8211-714e6c7f6f60 tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 15:15:51 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-b5acb247-093b-4b95-8211-714e6c7f6f60 tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72382) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 15:15:51 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-b5acb247-093b-4b95-8211-714e6c7f6f60 tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] Got 1 possible topologies {{(pid=72382) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 15:15:51 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-b5acb247-093b-4b95-8211-714e6c7f6f60 tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 15:15:51 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-b5acb247-093b-4b95-8211-714e6c7f6f60 tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 15:15:51 user nova-compute[72382]: DEBUG nova.virt.libvirt.vif [None req-b5acb247-093b-4b95-8211-714e6c7f6f60 tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T15:15:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-121310467',display_name='tempest-VolumesAdminNegativeTest-server-121310467',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-121310467',id=8,image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKtYYEScFXJJjXJKGs0FnYAmbxicTlVOICxG+4SQB/KUvoHhfJalbCph72m5nmpmoaO5/jQ2UjSHelByuWETKf6HGow4GS1Fc/gbHLkBERck7WUV5SqSTz/+fBQjPgtJnA==',key_name='tempest-keypair-1511525227',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3b98e20f61c34fd6aa28cef7ceadf0d3',ramdisk_id='',reservation_id='r-f0luiylm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-993781103',owner_user_name='tempest-VolumesAdminNegativeTest-993781103-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T15:15:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='374f2148fb524924acc7e1e968e73fe1',uuid=a33515b3-3ef4-4f76-a8d8-e7008b5bbb79,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "32c23c7b-6885-4276-bca1-7d8a8cb924c1", "address": "fa:16:3e:e9:da:b6", "network": {"id": "1a0f18df-96f2-4c90-8e53-fcbfc8f17bc4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1771770150-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b98e20f61c34fd6aa28cef7ceadf0d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32c23c7b-68", "ovs_interfaceid": "32c23c7b-6885-4276-bca1-7d8a8cb924c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72382) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 15:15:51 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-b5acb247-093b-4b95-8211-714e6c7f6f60 tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] Converting VIF {"id": "32c23c7b-6885-4276-bca1-7d8a8cb924c1", "address": "fa:16:3e:e9:da:b6", "network": {"id": "1a0f18df-96f2-4c90-8e53-fcbfc8f17bc4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1771770150-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b98e20f61c34fd6aa28cef7ceadf0d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32c23c7b-68", "ovs_interfaceid": "32c23c7b-6885-4276-bca1-7d8a8cb924c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 15:15:51 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-b5acb247-093b-4b95-8211-714e6c7f6f60 tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e9:da:b6,bridge_name='br-int',has_traffic_filtering=True,id=32c23c7b-6885-4276-bca1-7d8a8cb924c1,network=Network(1a0f18df-96f2-4c90-8e53-fcbfc8f17bc4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32c23c7b-68') {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 15:15:51 user nova-compute[72382]: DEBUG nova.objects.instance [None req-b5acb247-093b-4b95-8211-714e6c7f6f60 tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] Lazy-loading 'pci_devices' on Instance uuid a33515b3-3ef4-4f76-a8d8-e7008b5bbb79 {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:15:51 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-b5acb247-093b-4b95-8211-714e6c7f6f60 tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] [instance: a33515b3-3ef4-4f76-a8d8-e7008b5bbb79] End _get_guest_xml xml=<domain type="kvm">
Aug 09 15:15:51 user nova-compute[72382]:   <uuid>a33515b3-3ef4-4f76-a8d8-e7008b5bbb79</uuid>
Aug 09 15:15:51 user nova-compute[72382]:   <name>instance-00000008</name>
Aug 09 15:15:51 user nova-compute[72382]:   <memory>524288</memory>
Aug 09 15:15:51 user nova-compute[72382]:   <vcpu>1</vcpu>
Aug 09 15:15:51 user nova-compute[72382]:   <metadata>
Aug 09 15:15:51 user nova-compute[72382]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 15:15:51 user nova-compute[72382]:       <nova:package version="0.0.0"/>
Aug 09 15:15:51 user nova-compute[72382]:       <nova:name>tempest-VolumesAdminNegativeTest-server-121310467</nova:name>
Aug 09 15:15:51 user nova-compute[72382]:       <nova:creationTime>2023-08-09 15:15:51</nova:creationTime>
Aug 09 15:15:51 user nova-compute[72382]:       <nova:flavor name="m1.tiny">
Aug 09 15:15:51 user nova-compute[72382]:         <nova:memory>512</nova:memory>
Aug 09 15:15:51 user nova-compute[72382]:         <nova:disk>1</nova:disk>
Aug 09 15:15:51 user nova-compute[72382]:         <nova:swap>0</nova:swap>
Aug 09 15:15:51 user nova-compute[72382]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 15:15:51 user nova-compute[72382]:         <nova:vcpus>1</nova:vcpus>
Aug 09 15:15:51 user nova-compute[72382]:       </nova:flavor>
Aug 09 15:15:51 user nova-compute[72382]:       <nova:owner>
Aug 09 15:15:51 user nova-compute[72382]:         <nova:user uuid="374f2148fb524924acc7e1e968e73fe1">tempest-VolumesAdminNegativeTest-993781103-project-member</nova:user>
Aug 09 15:15:51 user nova-compute[72382]:         <nova:project uuid="3b98e20f61c34fd6aa28cef7ceadf0d3">tempest-VolumesAdminNegativeTest-993781103</nova:project>
Aug 09 15:15:51 user nova-compute[72382]:       </nova:owner>
Aug 09 15:15:51 user nova-compute[72382]:       <nova:root type="image" uuid="a79f2cea-eb27-4631-aaf3-05e7d9e411b4"/>
Aug 09 15:15:51 user nova-compute[72382]:       <nova:ports>
Aug 09 15:15:51 user nova-compute[72382]:         <nova:port uuid="32c23c7b-6885-4276-bca1-7d8a8cb924c1">
Aug 09 15:15:51 user nova-compute[72382]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 09 15:15:51 user nova-compute[72382]:         </nova:port>
Aug 09 15:15:51 user nova-compute[72382]:       </nova:ports>
Aug 09 15:15:51 user nova-compute[72382]:     </nova:instance>
Aug 09 15:15:51 user nova-compute[72382]:   </metadata>
Aug 09 15:15:51 user nova-compute[72382]:   <sysinfo type="smbios">
Aug 09 15:15:51 user nova-compute[72382]:     <system>
Aug 09 15:15:51 user nova-compute[72382]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 15:15:51 user nova-compute[72382]:       <entry name="product">OpenStack Nova</entry>
Aug 09 15:15:51 user nova-compute[72382]:       <entry name="version">0.0.0</entry>
Aug 09 15:15:51 user nova-compute[72382]:       <entry name="serial">a33515b3-3ef4-4f76-a8d8-e7008b5bbb79</entry>
Aug 09 15:15:51 user nova-compute[72382]:       <entry name="uuid">a33515b3-3ef4-4f76-a8d8-e7008b5bbb79</entry>
Aug 09 15:15:51 user nova-compute[72382]:       <entry name="family">Virtual Machine</entry>
Aug 09 15:15:51 user nova-compute[72382]:     </system>
Aug 09 15:15:51 user nova-compute[72382]:   </sysinfo>
Aug 09 15:15:51 user nova-compute[72382]:   <os>
Aug 09 15:15:51 user nova-compute[72382]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 15:15:51 user nova-compute[72382]:     <boot dev="hd"/>
Aug 09 15:15:51 user nova-compute[72382]:     <smbios mode="sysinfo"/>
Aug 09 15:15:51 user nova-compute[72382]:   </os>
Aug 09 15:15:51 user nova-compute[72382]:   <features>
Aug 09 15:15:51 user nova-compute[72382]:     <acpi/>
Aug 09 15:15:51 user nova-compute[72382]:     <apic/>
Aug 09 15:15:51 user nova-compute[72382]:     <vmcoreinfo/>
Aug 09 15:15:51 user nova-compute[72382]:   </features>
Aug 09 15:15:51 user nova-compute[72382]:   <clock offset="utc">
Aug 09 15:15:51 user nova-compute[72382]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 15:15:51 user nova-compute[72382]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 15:15:51 user nova-compute[72382]:     <timer name="hpet" present="no"/>
Aug 09 15:15:51 user nova-compute[72382]:   </clock>
Aug 09 15:15:51 user nova-compute[72382]:   <cpu mode="custom" match="exact">
Aug 09 15:15:51 user nova-compute[72382]:     <model>Nehalem</model>
Aug 09 15:15:51 user nova-compute[72382]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 15:15:51 user nova-compute[72382]:   </cpu>
Aug 09 15:15:51 user nova-compute[72382]:   <devices>
Aug 09 15:15:51 user nova-compute[72382]:     <disk type="file" device="disk">
Aug 09 15:15:51 user nova-compute[72382]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 15:15:51 user nova-compute[72382]:       <source file="/opt/stack/data/nova/instances/a33515b3-3ef4-4f76-a8d8-e7008b5bbb79/disk"/>
Aug 09 15:15:51 user nova-compute[72382]:       <target dev="vda" bus="virtio"/>
Aug 09 15:15:51 user nova-compute[72382]:     </disk>
Aug 09 15:15:51 user nova-compute[72382]:     <interface type="ethernet">
Aug 09 15:15:51 user nova-compute[72382]:       <mac address="fa:16:3e:e9:da:b6"/>
Aug 09 15:15:51 user nova-compute[72382]:       <model type="virtio"/>
Aug 09 15:15:51 user nova-compute[72382]:       <mtu size="1442"/>
Aug 09 15:15:51 user nova-compute[72382]:       <target dev="tap32c23c7b-68"/>
Aug 09 15:15:51 user nova-compute[72382]:     </interface>
Aug 09 15:15:51 user nova-compute[72382]:     <serial type="pty">
Aug 09 15:15:51 user nova-compute[72382]:       <log file="/opt/stack/data/nova/instances/a33515b3-3ef4-4f76-a8d8-e7008b5bbb79/console.log" append="off"/>
Aug 09 15:15:51 user nova-compute[72382]:     </serial>
Aug 09 15:15:51 user nova-compute[72382]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 15:15:51 user nova-compute[72382]:     <video>
Aug 09 15:15:51 user nova-compute[72382]:       <model type="virtio"/>
Aug 09 15:15:51 user nova-compute[72382]:     </video>
Aug 09 15:15:51 user nova-compute[72382]:     <rng model="virtio">
Aug 09 15:15:51 user nova-compute[72382]:       <backend model="random">/dev/urandom</backend>
Aug 09 15:15:51 user nova-compute[72382]:     </rng>
Aug 09 15:15:51 user nova-compute[72382]:     <controller type="usb" index="0" model="none"/>
Aug 09 15:15:51 user nova-compute[72382]:     <memballoon model="virtio">
Aug 09 15:15:51 user nova-compute[72382]:       <stats period="10"/>
Aug 09 15:15:51 user nova-compute[72382]:     </memballoon>
Aug 09 15:15:51 user nova-compute[72382]:   </devices>
Aug 09 15:15:51 user nova-compute[72382]: </domain>
Aug 09 15:15:51 user nova-compute[72382]:  {{(pid=72382) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 15:15:51 user nova-compute[72382]: DEBUG nova.virt.libvirt.vif [None req-b5acb247-093b-4b95-8211-714e6c7f6f60 tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T15:15:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-121310467',display_name='tempest-VolumesAdminNegativeTest-server-121310467',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-121310467',id=8,image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKtYYEScFXJJjXJKGs0FnYAmbxicTlVOICxG+4SQB/KUvoHhfJalbCph72m5nmpmoaO5/jQ2UjSHelByuWETKf6HGow4GS1Fc/gbHLkBERck7WUV5SqSTz/+fBQjPgtJnA==',key_name='tempest-keypair-1511525227',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3b98e20f61c34fd6aa28cef7ceadf0d3',ramdisk_id='',reservation_id='r-f0luiylm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-993781103',owner_user_name='tempest-VolumesAdminNegativeTest-993781103-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T15:15:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='374f2148fb524924acc7e1e968e73fe1',uuid=a33515b3-3ef4-4f76-a8d8-e7008b5bbb79,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "32c23c7b-6885-4276-bca1-7d8a8cb924c1", "address": "fa:16:3e:e9:da:b6", "network": {"id": "1a0f18df-96f2-4c90-8e53-fcbfc8f17bc4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1771770150-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b98e20f61c34fd6aa28cef7ceadf0d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32c23c7b-68", "ovs_interfaceid": "32c23c7b-6885-4276-bca1-7d8a8cb924c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 15:15:51 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-b5acb247-093b-4b95-8211-714e6c7f6f60 tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] Converting VIF {"id": "32c23c7b-6885-4276-bca1-7d8a8cb924c1", "address": "fa:16:3e:e9:da:b6", "network": {"id": "1a0f18df-96f2-4c90-8e53-fcbfc8f17bc4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1771770150-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b98e20f61c34fd6aa28cef7ceadf0d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32c23c7b-68", "ovs_interfaceid": "32c23c7b-6885-4276-bca1-7d8a8cb924c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 15:15:51 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-b5acb247-093b-4b95-8211-714e6c7f6f60 tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e9:da:b6,bridge_name='br-int',has_traffic_filtering=True,id=32c23c7b-6885-4276-bca1-7d8a8cb924c1,network=Network(1a0f18df-96f2-4c90-8e53-fcbfc8f17bc4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32c23c7b-68') {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 15:15:51 user nova-compute[72382]: DEBUG os_vif [None req-b5acb247-093b-4b95-8211-714e6c7f6f60 tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e9:da:b6,bridge_name='br-int',has_traffic_filtering=True,id=32c23c7b-6885-4276-bca1-7d8a8cb924c1,network=Network(1a0f18df-96f2-4c90-8e53-fcbfc8f17bc4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32c23c7b-68') {{(pid=72382) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 15:15:51 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:15:51 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:15:51 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 15:15:51 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:15:51 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap32c23c7b-68, may_exist=True, interface_attrs={}) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:15:51 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap32c23c7b-68, col_values=(('external_ids', {'iface-id': '32c23c7b-6885-4276-bca1-7d8a8cb924c1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e9:da:b6', 'vm-uuid': 'a33515b3-3ef4-4f76-a8d8-e7008b5bbb79'}),), if_exists=True) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:15:51 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:15:51 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:15:51 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:15:51 user nova-compute[72382]: INFO os_vif [None req-b5acb247-093b-4b95-8211-714e6c7f6f60 tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e9:da:b6,bridge_name='br-int',has_traffic_filtering=True,id=32c23c7b-6885-4276-bca1-7d8a8cb924c1,network=Network(1a0f18df-96f2-4c90-8e53-fcbfc8f17bc4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32c23c7b-68')
Aug 09 15:15:51 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-b5acb247-093b-4b95-8211-714e6c7f6f60 tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] No BDM found with device name vda, not building metadata. {{(pid=72382) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 15:15:51 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-b5acb247-093b-4b95-8211-714e6c7f6f60 tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] No VIF found with MAC fa:16:3e:e9:da:b6, not building metadata {{(pid=72382) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 15:15:52 user nova-compute[72382]: DEBUG nova.network.neutron [req-150af819-2f4d-4af7-bb24-9ff707919e96 req-215c4ed0-0a6c-47ed-8ff5-d38ac94eaada service nova] [instance: a33515b3-3ef4-4f76-a8d8-e7008b5bbb79] Updated VIF entry in instance network info cache for port 32c23c7b-6885-4276-bca1-7d8a8cb924c1. {{(pid=72382) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 15:15:52 user nova-compute[72382]: DEBUG nova.network.neutron [req-150af819-2f4d-4af7-bb24-9ff707919e96 req-215c4ed0-0a6c-47ed-8ff5-d38ac94eaada service nova] [instance: a33515b3-3ef4-4f76-a8d8-e7008b5bbb79] Updating instance_info_cache with network_info: [{"id": "32c23c7b-6885-4276-bca1-7d8a8cb924c1", "address": "fa:16:3e:e9:da:b6", "network": {"id": "1a0f18df-96f2-4c90-8e53-fcbfc8f17bc4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1771770150-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b98e20f61c34fd6aa28cef7ceadf0d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32c23c7b-68", "ovs_interfaceid": "32c23c7b-6885-4276-bca1-7d8a8cb924c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:15:52 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-150af819-2f4d-4af7-bb24-9ff707919e96 req-215c4ed0-0a6c-47ed-8ff5-d38ac94eaada service nova] Releasing lock "refresh_cache-a33515b3-3ef4-4f76-a8d8-e7008b5bbb79" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 15:15:52 user nova-compute[72382]: DEBUG nova.virt.driver [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Emitting event <LifecycleEvent: 1691594152.549181, f0a7fa25-4520-4f40-9515-b88e3d2fd910 => Resumed> {{(pid=72382) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 15:15:52 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: f0a7fa25-4520-4f40-9515-b88e3d2fd910] VM Resumed (Lifecycle Event)
Aug 09 15:15:52 user nova-compute[72382]: DEBUG nova.compute.manager [None req-1be031b3-15c8-4cce-9487-45bdffa176b1 tempest-VolumesAssistedSnapshotsTest-459543424 tempest-VolumesAssistedSnapshotsTest-459543424-project-member] [instance: f0a7fa25-4520-4f40-9515-b88e3d2fd910] Instance event wait completed in 0 seconds for  {{(pid=72382) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 15:15:52 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-1be031b3-15c8-4cce-9487-45bdffa176b1 tempest-VolumesAssistedSnapshotsTest-459543424 tempest-VolumesAssistedSnapshotsTest-459543424-project-member] [instance: f0a7fa25-4520-4f40-9515-b88e3d2fd910] Guest created on hypervisor {{(pid=72382) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 15:15:52 user nova-compute[72382]: INFO nova.virt.libvirt.driver [-] [instance: f0a7fa25-4520-4f40-9515-b88e3d2fd910] Instance spawned successfully.
Aug 09 15:15:52 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-1be031b3-15c8-4cce-9487-45bdffa176b1 tempest-VolumesAssistedSnapshotsTest-459543424 tempest-VolumesAssistedSnapshotsTest-459543424-project-member] [instance: f0a7fa25-4520-4f40-9515-b88e3d2fd910] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 15:15:52 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: f0a7fa25-4520-4f40-9515-b88e3d2fd910] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:15:52 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: f0a7fa25-4520-4f40-9515-b88e3d2fd910] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72382) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 15:15:52 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-1be031b3-15c8-4cce-9487-45bdffa176b1 tempest-VolumesAssistedSnapshotsTest-459543424 tempest-VolumesAssistedSnapshotsTest-459543424-project-member] [instance: f0a7fa25-4520-4f40-9515-b88e3d2fd910] Found default for hw_cdrom_bus of ide {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:15:52 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-1be031b3-15c8-4cce-9487-45bdffa176b1 tempest-VolumesAssistedSnapshotsTest-459543424 tempest-VolumesAssistedSnapshotsTest-459543424-project-member] [instance: f0a7fa25-4520-4f40-9515-b88e3d2fd910] Found default for hw_disk_bus of virtio {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:15:52 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-1be031b3-15c8-4cce-9487-45bdffa176b1 tempest-VolumesAssistedSnapshotsTest-459543424 tempest-VolumesAssistedSnapshotsTest-459543424-project-member] [instance: f0a7fa25-4520-4f40-9515-b88e3d2fd910] Found default for hw_input_bus of None {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:15:52 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-1be031b3-15c8-4cce-9487-45bdffa176b1 tempest-VolumesAssistedSnapshotsTest-459543424 tempest-VolumesAssistedSnapshotsTest-459543424-project-member] [instance: f0a7fa25-4520-4f40-9515-b88e3d2fd910] Found default for hw_pointer_model of None {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:15:52 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-1be031b3-15c8-4cce-9487-45bdffa176b1 tempest-VolumesAssistedSnapshotsTest-459543424 tempest-VolumesAssistedSnapshotsTest-459543424-project-member] [instance: f0a7fa25-4520-4f40-9515-b88e3d2fd910] Found default for hw_video_model of virtio {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:15:52 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-1be031b3-15c8-4cce-9487-45bdffa176b1 tempest-VolumesAssistedSnapshotsTest-459543424 tempest-VolumesAssistedSnapshotsTest-459543424-project-member] [instance: f0a7fa25-4520-4f40-9515-b88e3d2fd910] Found default for hw_vif_model of virtio {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:15:52 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: f0a7fa25-4520-4f40-9515-b88e3d2fd910] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 15:15:52 user nova-compute[72382]: DEBUG nova.virt.driver [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Emitting event <LifecycleEvent: 1691594152.5608785, f0a7fa25-4520-4f40-9515-b88e3d2fd910 => Started> {{(pid=72382) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 15:15:52 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: f0a7fa25-4520-4f40-9515-b88e3d2fd910] VM Started (Lifecycle Event)
Aug 09 15:15:52 user nova-compute[72382]: DEBUG nova.network.neutron [None req-dab17cc8-d663-431f-881c-dfe633a6de11 tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] [instance: 23f25946-de3a-43fb-97a4-1f9a787e6e51] Successfully updated port: 1c588f02-cc2c-47f1-8918-bf9b1d3ea215 {{(pid=72382) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 15:15:52 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: f0a7fa25-4520-4f40-9515-b88e3d2fd910] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:15:52 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-dab17cc8-d663-431f-881c-dfe633a6de11 tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] Acquiring lock "refresh_cache-23f25946-de3a-43fb-97a4-1f9a787e6e51" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 15:15:52 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-dab17cc8-d663-431f-881c-dfe633a6de11 tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] Acquired lock "refresh_cache-23f25946-de3a-43fb-97a4-1f9a787e6e51" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 15:15:52 user nova-compute[72382]: DEBUG nova.network.neutron [None req-dab17cc8-d663-431f-881c-dfe633a6de11 tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] [instance: 23f25946-de3a-43fb-97a4-1f9a787e6e51] Building network info cache for instance {{(pid=72382) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 15:15:52 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: f0a7fa25-4520-4f40-9515-b88e3d2fd910] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72382) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 15:15:52 user nova-compute[72382]: DEBUG nova.compute.manager [req-bb522ab8-ab8d-42d5-96c9-156055cbdd1d req-dfc9ef85-2e66-4670-8a40-832f1630383d service nova] [instance: 23f25946-de3a-43fb-97a4-1f9a787e6e51] Received event network-changed-1c588f02-cc2c-47f1-8918-bf9b1d3ea215 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:15:52 user nova-compute[72382]: DEBUG nova.compute.manager [req-bb522ab8-ab8d-42d5-96c9-156055cbdd1d req-dfc9ef85-2e66-4670-8a40-832f1630383d service nova] [instance: 23f25946-de3a-43fb-97a4-1f9a787e6e51] Refreshing instance network info cache due to event network-changed-1c588f02-cc2c-47f1-8918-bf9b1d3ea215. {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 15:15:52 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-bb522ab8-ab8d-42d5-96c9-156055cbdd1d req-dfc9ef85-2e66-4670-8a40-832f1630383d service nova] Acquiring lock "refresh_cache-23f25946-de3a-43fb-97a4-1f9a787e6e51" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 15:15:52 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: f0a7fa25-4520-4f40-9515-b88e3d2fd910] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 15:15:52 user nova-compute[72382]: INFO nova.compute.manager [None req-1be031b3-15c8-4cce-9487-45bdffa176b1 tempest-VolumesAssistedSnapshotsTest-459543424 tempest-VolumesAssistedSnapshotsTest-459543424-project-member] [instance: f0a7fa25-4520-4f40-9515-b88e3d2fd910] Took 11.27 seconds to spawn the instance on the hypervisor.
Aug 09 15:15:52 user nova-compute[72382]: DEBUG nova.compute.manager [None req-1be031b3-15c8-4cce-9487-45bdffa176b1 tempest-VolumesAssistedSnapshotsTest-459543424 tempest-VolumesAssistedSnapshotsTest-459543424-project-member] [instance: f0a7fa25-4520-4f40-9515-b88e3d2fd910] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:15:52 user nova-compute[72382]: INFO nova.compute.manager [None req-1be031b3-15c8-4cce-9487-45bdffa176b1 tempest-VolumesAssistedSnapshotsTest-459543424 tempest-VolumesAssistedSnapshotsTest-459543424-project-member] [instance: f0a7fa25-4520-4f40-9515-b88e3d2fd910] Took 12.48 seconds to build instance.
Aug 09 15:15:52 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-1be031b3-15c8-4cce-9487-45bdffa176b1 tempest-VolumesAssistedSnapshotsTest-459543424 tempest-VolumesAssistedSnapshotsTest-459543424-project-member] Lock "f0a7fa25-4520-4f40-9515-b88e3d2fd910" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.679s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:15:53 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:15:53 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:15:53 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:15:53 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:15:53 user nova-compute[72382]: DEBUG nova.network.neutron [None req-dab17cc8-d663-431f-881c-dfe633a6de11 tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] [instance: 23f25946-de3a-43fb-97a4-1f9a787e6e51] Instance cache missing network info. {{(pid=72382) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 15:15:53 user nova-compute[72382]: DEBUG nova.compute.manager [req-f5efbe60-475c-466c-836a-4c60bb8b3158 req-1e069751-3cdd-492d-813a-23aa45a3a153 service nova] [instance: f0a7fa25-4520-4f40-9515-b88e3d2fd910] Received event network-vif-plugged-5b8a4395-5fb8-4ae6-a987-127e82862327 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:15:53 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-f5efbe60-475c-466c-836a-4c60bb8b3158 req-1e069751-3cdd-492d-813a-23aa45a3a153 service nova] Acquiring lock "f0a7fa25-4520-4f40-9515-b88e3d2fd910-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:15:53 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-f5efbe60-475c-466c-836a-4c60bb8b3158 req-1e069751-3cdd-492d-813a-23aa45a3a153 service nova] Lock "f0a7fa25-4520-4f40-9515-b88e3d2fd910-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:15:53 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-f5efbe60-475c-466c-836a-4c60bb8b3158 req-1e069751-3cdd-492d-813a-23aa45a3a153 service nova] Lock "f0a7fa25-4520-4f40-9515-b88e3d2fd910-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:15:53 user nova-compute[72382]: DEBUG nova.compute.manager [req-f5efbe60-475c-466c-836a-4c60bb8b3158 req-1e069751-3cdd-492d-813a-23aa45a3a153 service nova] [instance: f0a7fa25-4520-4f40-9515-b88e3d2fd910] No waiting events found dispatching network-vif-plugged-5b8a4395-5fb8-4ae6-a987-127e82862327 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:15:53 user nova-compute[72382]: WARNING nova.compute.manager [req-f5efbe60-475c-466c-836a-4c60bb8b3158 req-1e069751-3cdd-492d-813a-23aa45a3a153 service nova] [instance: f0a7fa25-4520-4f40-9515-b88e3d2fd910] Received unexpected event network-vif-plugged-5b8a4395-5fb8-4ae6-a987-127e82862327 for instance with vm_state active and task_state None.
Aug 09 15:15:53 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:15:54 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:15:54 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:15:54 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:15:54 user nova-compute[72382]: DEBUG nova.network.neutron [None req-dab17cc8-d663-431f-881c-dfe633a6de11 tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] [instance: 23f25946-de3a-43fb-97a4-1f9a787e6e51] Updating instance_info_cache with network_info: [{"id": "1c588f02-cc2c-47f1-8918-bf9b1d3ea215", "address": "fa:16:3e:b1:4d:7d", "network": {"id": "e5132afa-231c-471e-b11a-a6e972603b0c", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2085484007-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b84d09ad643146859e76996c09ba02c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c588f02-cc", "ovs_interfaceid": "1c588f02-cc2c-47f1-8918-bf9b1d3ea215", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:15:54 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-dab17cc8-d663-431f-881c-dfe633a6de11 tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] Releasing lock "refresh_cache-23f25946-de3a-43fb-97a4-1f9a787e6e51" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 15:15:54 user nova-compute[72382]: DEBUG nova.compute.manager [None req-dab17cc8-d663-431f-881c-dfe633a6de11 tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] [instance: 23f25946-de3a-43fb-97a4-1f9a787e6e51] Instance network_info: |[{"id": "1c588f02-cc2c-47f1-8918-bf9b1d3ea215", "address": "fa:16:3e:b1:4d:7d", "network": {"id": "e5132afa-231c-471e-b11a-a6e972603b0c", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2085484007-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b84d09ad643146859e76996c09ba02c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c588f02-cc", "ovs_interfaceid": "1c588f02-cc2c-47f1-8918-bf9b1d3ea215", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72382) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 15:15:54 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-bb522ab8-ab8d-42d5-96c9-156055cbdd1d req-dfc9ef85-2e66-4670-8a40-832f1630383d service nova] Acquired lock "refresh_cache-23f25946-de3a-43fb-97a4-1f9a787e6e51" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 15:15:54 user nova-compute[72382]: DEBUG nova.network.neutron [req-bb522ab8-ab8d-42d5-96c9-156055cbdd1d req-dfc9ef85-2e66-4670-8a40-832f1630383d service nova] [instance: 23f25946-de3a-43fb-97a4-1f9a787e6e51] Refreshing network info cache for port 1c588f02-cc2c-47f1-8918-bf9b1d3ea215 {{(pid=72382) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 15:15:54 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-dab17cc8-d663-431f-881c-dfe633a6de11 tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] [instance: 23f25946-de3a-43fb-97a4-1f9a787e6e51] Start _get_guest_xml network_info=[{"id": "1c588f02-cc2c-47f1-8918-bf9b1d3ea215", "address": "fa:16:3e:b1:4d:7d", "network": {"id": "e5132afa-231c-471e-b11a-a6e972603b0c", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2085484007-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b84d09ad643146859e76996c09ba02c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c588f02-cc", "ovs_interfaceid": "1c588f02-cc2c-47f1-8918-bf9b1d3ea215", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T15:11:25Z,direct_url=<?>,disk_format='qcow2',id=a79f2cea-eb27-4631-aaf3-05e7d9e411b4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a638990e12cc4d6eabb6d55e13be6bdf',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T15:11:27Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'a79f2cea-eb27-4631-aaf3-05e7d9e411b4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72382) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 15:15:54 user nova-compute[72382]: WARNING nova.virt.libvirt.driver [None req-dab17cc8-d663-431f-881c-dfe633a6de11 tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 15:15:54 user nova-compute[72382]: WARNING nova.virt.libvirt.driver [None req-dab17cc8-d663-431f-881c-dfe633a6de11 tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 15:15:54 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-dab17cc8-d663-431f-881c-dfe633a6de11 tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72382) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 15:15:54 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-dab17cc8-d663-431f-881c-dfe633a6de11 tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] CPU controller missing on host. {{(pid=72382) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 15:15:54 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-dab17cc8-d663-431f-881c-dfe633a6de11 tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72382) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 15:15:54 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-dab17cc8-d663-431f-881c-dfe633a6de11 tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] CPU controller found on host. {{(pid=72382) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 15:15:54 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-dab17cc8-d663-431f-881c-dfe633a6de11 tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72382) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 15:15:54 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-dab17cc8-d663-431f-881c-dfe633a6de11 tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T15:11:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T15:11:25Z,direct_url=<?>,disk_format='qcow2',id=a79f2cea-eb27-4631-aaf3-05e7d9e411b4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a638990e12cc4d6eabb6d55e13be6bdf',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T15:11:27Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 15:15:54 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-dab17cc8-d663-431f-881c-dfe633a6de11 tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] Flavor limits 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 15:15:54 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-dab17cc8-d663-431f-881c-dfe633a6de11 tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] Image limits 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 15:15:54 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-dab17cc8-d663-431f-881c-dfe633a6de11 tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] Flavor pref 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 15:15:54 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-dab17cc8-d663-431f-881c-dfe633a6de11 tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] Image pref 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 15:15:54 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-dab17cc8-d663-431f-881c-dfe633a6de11 tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 15:15:54 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-dab17cc8-d663-431f-881c-dfe633a6de11 tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 15:15:54 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-dab17cc8-d663-431f-881c-dfe633a6de11 tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72382) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 15:15:54 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-dab17cc8-d663-431f-881c-dfe633a6de11 tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] Got 1 possible topologies {{(pid=72382) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 15:15:54 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-dab17cc8-d663-431f-881c-dfe633a6de11 tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 15:15:54 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-dab17cc8-d663-431f-881c-dfe633a6de11 tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 15:15:54 user nova-compute[72382]: DEBUG nova.virt.libvirt.vif [None req-dab17cc8-d663-431f-881c-dfe633a6de11 tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T15:15:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-176087286',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-176087286',id=9,image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF4pKUdXj5zZfLZFWCxFHz8jMa5yp/7/IPCXi1mkSKd0mYycvxd7H8zaZJVqn1Nt7uBCqZDaWzic3f3975RUjfs8oAsAozBRZ/XXtDelWRnO6lHLhAgDLjQA+jzema7e1g==',key_name='tempest-keypair-1955626579',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b84d09ad643146859e76996c09ba02c7',ramdisk_id='',reservation_id='r-sy0nsoiy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-605331854',owner_user_name='tempest-TaggedAttachmentsTest-605331854-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T15:15:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='97fa102d2fed4045a326b0f5efbd1b1c',uuid=23f25946-de3a-43fb-97a4-1f9a787e6e51,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1c588f02-cc2c-47f1-8918-bf9b1d3ea215", "address": "fa:16:3e:b1:4d:7d", "network": {"id": "e5132afa-231c-471e-b11a-a6e972603b0c", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2085484007-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b84d09ad643146859e76996c09ba02c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c588f02-cc", "ovs_interfaceid": "1c588f02-cc2c-47f1-8918-bf9b1d3ea215", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72382) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 15:15:54 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-dab17cc8-d663-431f-881c-dfe633a6de11 tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] Converting VIF {"id": "1c588f02-cc2c-47f1-8918-bf9b1d3ea215", "address": "fa:16:3e:b1:4d:7d", "network": {"id": "e5132afa-231c-471e-b11a-a6e972603b0c", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2085484007-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b84d09ad643146859e76996c09ba02c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c588f02-cc", "ovs_interfaceid": "1c588f02-cc2c-47f1-8918-bf9b1d3ea215", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 15:15:54 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-dab17cc8-d663-431f-881c-dfe633a6de11 tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b1:4d:7d,bridge_name='br-int',has_traffic_filtering=True,id=1c588f02-cc2c-47f1-8918-bf9b1d3ea215,network=Network(e5132afa-231c-471e-b11a-a6e972603b0c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c588f02-cc') {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 15:15:54 user nova-compute[72382]: DEBUG nova.objects.instance [None req-dab17cc8-d663-431f-881c-dfe633a6de11 tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] Lazy-loading 'pci_devices' on Instance uuid 23f25946-de3a-43fb-97a4-1f9a787e6e51 {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:15:54 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-dab17cc8-d663-431f-881c-dfe633a6de11 tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] [instance: 23f25946-de3a-43fb-97a4-1f9a787e6e51] End _get_guest_xml xml=<domain type="kvm">
Aug 09 15:15:54 user nova-compute[72382]:   <uuid>23f25946-de3a-43fb-97a4-1f9a787e6e51</uuid>
Aug 09 15:15:54 user nova-compute[72382]:   <name>instance-00000009</name>
Aug 09 15:15:54 user nova-compute[72382]:   <memory>524288</memory>
Aug 09 15:15:54 user nova-compute[72382]:   <vcpu>1</vcpu>
Aug 09 15:15:54 user nova-compute[72382]:   <metadata>
Aug 09 15:15:54 user nova-compute[72382]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 15:15:54 user nova-compute[72382]:       <nova:package version="0.0.0"/>
Aug 09 15:15:54 user nova-compute[72382]:       <nova:name>tempest-device-tagging-server-176087286</nova:name>
Aug 09 15:15:54 user nova-compute[72382]:       <nova:creationTime>2023-08-09 15:15:54</nova:creationTime>
Aug 09 15:15:54 user nova-compute[72382]:       <nova:flavor name="m1.tiny">
Aug 09 15:15:54 user nova-compute[72382]:         <nova:memory>512</nova:memory>
Aug 09 15:15:54 user nova-compute[72382]:         <nova:disk>1</nova:disk>
Aug 09 15:15:54 user nova-compute[72382]:         <nova:swap>0</nova:swap>
Aug 09 15:15:54 user nova-compute[72382]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 15:15:54 user nova-compute[72382]:         <nova:vcpus>1</nova:vcpus>
Aug 09 15:15:54 user nova-compute[72382]:       </nova:flavor>
Aug 09 15:15:54 user nova-compute[72382]:       <nova:owner>
Aug 09 15:15:54 user nova-compute[72382]:         <nova:user uuid="97fa102d2fed4045a326b0f5efbd1b1c">tempest-TaggedAttachmentsTest-605331854-project-member</nova:user>
Aug 09 15:15:54 user nova-compute[72382]:         <nova:project uuid="b84d09ad643146859e76996c09ba02c7">tempest-TaggedAttachmentsTest-605331854</nova:project>
Aug 09 15:15:54 user nova-compute[72382]:       </nova:owner>
Aug 09 15:15:54 user nova-compute[72382]:       <nova:root type="image" uuid="a79f2cea-eb27-4631-aaf3-05e7d9e411b4"/>
Aug 09 15:15:54 user nova-compute[72382]:       <nova:ports>
Aug 09 15:15:54 user nova-compute[72382]:         <nova:port uuid="1c588f02-cc2c-47f1-8918-bf9b1d3ea215">
Aug 09 15:15:54 user nova-compute[72382]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 09 15:15:54 user nova-compute[72382]:         </nova:port>
Aug 09 15:15:54 user nova-compute[72382]:       </nova:ports>
Aug 09 15:15:54 user nova-compute[72382]:     </nova:instance>
Aug 09 15:15:54 user nova-compute[72382]:   </metadata>
Aug 09 15:15:54 user nova-compute[72382]:   <sysinfo type="smbios">
Aug 09 15:15:54 user nova-compute[72382]:     <system>
Aug 09 15:15:54 user nova-compute[72382]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 15:15:54 user nova-compute[72382]:       <entry name="product">OpenStack Nova</entry>
Aug 09 15:15:54 user nova-compute[72382]:       <entry name="version">0.0.0</entry>
Aug 09 15:15:54 user nova-compute[72382]:       <entry name="serial">23f25946-de3a-43fb-97a4-1f9a787e6e51</entry>
Aug 09 15:15:54 user nova-compute[72382]:       <entry name="uuid">23f25946-de3a-43fb-97a4-1f9a787e6e51</entry>
Aug 09 15:15:54 user nova-compute[72382]:       <entry name="family">Virtual Machine</entry>
Aug 09 15:15:54 user nova-compute[72382]:     </system>
Aug 09 15:15:54 user nova-compute[72382]:   </sysinfo>
Aug 09 15:15:54 user nova-compute[72382]:   <os>
Aug 09 15:15:54 user nova-compute[72382]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 15:15:54 user nova-compute[72382]:     <boot dev="hd"/>
Aug 09 15:15:54 user nova-compute[72382]:     <smbios mode="sysinfo"/>
Aug 09 15:15:54 user nova-compute[72382]:   </os>
Aug 09 15:15:54 user nova-compute[72382]:   <features>
Aug 09 15:15:54 user nova-compute[72382]:     <acpi/>
Aug 09 15:15:54 user nova-compute[72382]:     <apic/>
Aug 09 15:15:54 user nova-compute[72382]:     <vmcoreinfo/>
Aug 09 15:15:54 user nova-compute[72382]:   </features>
Aug 09 15:15:54 user nova-compute[72382]:   <clock offset="utc">
Aug 09 15:15:54 user nova-compute[72382]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 15:15:54 user nova-compute[72382]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 15:15:54 user nova-compute[72382]:     <timer name="hpet" present="no"/>
Aug 09 15:15:54 user nova-compute[72382]:   </clock>
Aug 09 15:15:54 user nova-compute[72382]:   <cpu mode="custom" match="exact">
Aug 09 15:15:54 user nova-compute[72382]:     <model>Nehalem</model>
Aug 09 15:15:54 user nova-compute[72382]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 15:15:54 user nova-compute[72382]:   </cpu>
Aug 09 15:15:54 user nova-compute[72382]:   <devices>
Aug 09 15:15:54 user nova-compute[72382]:     <disk type="file" device="disk">
Aug 09 15:15:54 user nova-compute[72382]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 15:15:54 user nova-compute[72382]:       <source file="/opt/stack/data/nova/instances/23f25946-de3a-43fb-97a4-1f9a787e6e51/disk"/>
Aug 09 15:15:54 user nova-compute[72382]:       <target dev="vda" bus="virtio"/>
Aug 09 15:15:54 user nova-compute[72382]:     </disk>
Aug 09 15:15:54 user nova-compute[72382]:     <disk type="file" device="cdrom">
Aug 09 15:15:54 user nova-compute[72382]:       <driver name="qemu" type="raw" cache="none"/>
Aug 09 15:15:54 user nova-compute[72382]:       <source file="/opt/stack/data/nova/instances/23f25946-de3a-43fb-97a4-1f9a787e6e51/disk.config"/>
Aug 09 15:15:54 user nova-compute[72382]:       <target dev="hda" bus="ide"/>
Aug 09 15:15:54 user nova-compute[72382]:     </disk>
Aug 09 15:15:54 user nova-compute[72382]:     <interface type="ethernet">
Aug 09 15:15:54 user nova-compute[72382]:       <mac address="fa:16:3e:b1:4d:7d"/>
Aug 09 15:15:54 user nova-compute[72382]:       <model type="virtio"/>
Aug 09 15:15:54 user nova-compute[72382]:       <mtu size="1442"/>
Aug 09 15:15:54 user nova-compute[72382]:       <target dev="tap1c588f02-cc"/>
Aug 09 15:15:54 user nova-compute[72382]:     </interface>
Aug 09 15:15:54 user nova-compute[72382]:     <serial type="pty">
Aug 09 15:15:54 user nova-compute[72382]:       <log file="/opt/stack/data/nova/instances/23f25946-de3a-43fb-97a4-1f9a787e6e51/console.log" append="off"/>
Aug 09 15:15:54 user nova-compute[72382]:     </serial>
Aug 09 15:15:54 user nova-compute[72382]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 15:15:54 user nova-compute[72382]:     <video>
Aug 09 15:15:54 user nova-compute[72382]:       <model type="virtio"/>
Aug 09 15:15:54 user nova-compute[72382]:     </video>
Aug 09 15:15:54 user nova-compute[72382]:     <rng model="virtio">
Aug 09 15:15:54 user nova-compute[72382]:       <backend model="random">/dev/urandom</backend>
Aug 09 15:15:54 user nova-compute[72382]:     </rng>
Aug 09 15:15:54 user nova-compute[72382]:     <controller type="usb" index="0" model="none"/>
Aug 09 15:15:54 user nova-compute[72382]:     <memballoon model="virtio">
Aug 09 15:15:54 user nova-compute[72382]:       <stats period="10"/>
Aug 09 15:15:54 user nova-compute[72382]:     </memballoon>
Aug 09 15:15:54 user nova-compute[72382]:   </devices>
Aug 09 15:15:54 user nova-compute[72382]: </domain>
Aug 09 15:15:54 user nova-compute[72382]:  {{(pid=72382) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 15:15:54 user nova-compute[72382]: DEBUG nova.virt.libvirt.vif [None req-dab17cc8-d663-431f-881c-dfe633a6de11 tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T15:15:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-176087286',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-176087286',id=9,image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF4pKUdXj5zZfLZFWCxFHz8jMa5yp/7/IPCXi1mkSKd0mYycvxd7H8zaZJVqn1Nt7uBCqZDaWzic3f3975RUjfs8oAsAozBRZ/XXtDelWRnO6lHLhAgDLjQA+jzema7e1g==',key_name='tempest-keypair-1955626579',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b84d09ad643146859e76996c09ba02c7',ramdisk_id='',reservation_id='r-sy0nsoiy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-605331854',owner_user_name='tempest-TaggedAttachmentsTest-605331854-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T15:15:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='97fa102d2fed4045a326b0f5efbd1b1c',uuid=23f25946-de3a-43fb-97a4-1f9a787e6e51,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1c588f02-cc2c-47f1-8918-bf9b1d3ea215", "address": "fa:16:3e:b1:4d:7d", "network": {"id": "e5132afa-231c-471e-b11a-a6e972603b0c", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2085484007-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b84d09ad643146859e76996c09ba02c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c588f02-cc", "ovs_interfaceid": "1c588f02-cc2c-47f1-8918-bf9b1d3ea215", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 15:15:54 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-dab17cc8-d663-431f-881c-dfe633a6de11 tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] Converting VIF {"id": "1c588f02-cc2c-47f1-8918-bf9b1d3ea215", "address": "fa:16:3e:b1:4d:7d", "network": {"id": "e5132afa-231c-471e-b11a-a6e972603b0c", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2085484007-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b84d09ad643146859e76996c09ba02c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c588f02-cc", "ovs_interfaceid": "1c588f02-cc2c-47f1-8918-bf9b1d3ea215", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 15:15:54 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-dab17cc8-d663-431f-881c-dfe633a6de11 tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b1:4d:7d,bridge_name='br-int',has_traffic_filtering=True,id=1c588f02-cc2c-47f1-8918-bf9b1d3ea215,network=Network(e5132afa-231c-471e-b11a-a6e972603b0c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c588f02-cc') {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 15:15:54 user nova-compute[72382]: DEBUG os_vif [None req-dab17cc8-d663-431f-881c-dfe633a6de11 tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b1:4d:7d,bridge_name='br-int',has_traffic_filtering=True,id=1c588f02-cc2c-47f1-8918-bf9b1d3ea215,network=Network(e5132afa-231c-471e-b11a-a6e972603b0c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c588f02-cc') {{(pid=72382) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 15:15:54 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:15:54 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:15:54 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 15:15:54 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:15:54 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1c588f02-cc, may_exist=True, interface_attrs={}) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:15:54 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1c588f02-cc, col_values=(('external_ids', {'iface-id': '1c588f02-cc2c-47f1-8918-bf9b1d3ea215', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b1:4d:7d', 'vm-uuid': '23f25946-de3a-43fb-97a4-1f9a787e6e51'}),), if_exists=True) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:15:54 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:15:54 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:15:54 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:15:54 user nova-compute[72382]: INFO os_vif [None req-dab17cc8-d663-431f-881c-dfe633a6de11 tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b1:4d:7d,bridge_name='br-int',has_traffic_filtering=True,id=1c588f02-cc2c-47f1-8918-bf9b1d3ea215,network=Network(e5132afa-231c-471e-b11a-a6e972603b0c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c588f02-cc')
Aug 09 15:15:54 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-be32bc62-bc81-44aa-9f55-4b650c885f9a tempest-TestVolumeSwap-583684665 tempest-TestVolumeSwap-583684665-project-member] Acquiring lock "9a82f146-97ce-4319-8b25-c1b090965e53" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:15:54 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-be32bc62-bc81-44aa-9f55-4b650c885f9a tempest-TestVolumeSwap-583684665 tempest-TestVolumeSwap-583684665-project-member] Lock "9a82f146-97ce-4319-8b25-c1b090965e53" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:15:54 user nova-compute[72382]: DEBUG nova.compute.manager [None req-be32bc62-bc81-44aa-9f55-4b650c885f9a tempest-TestVolumeSwap-583684665 tempest-TestVolumeSwap-583684665-project-member] [instance: 9a82f146-97ce-4319-8b25-c1b090965e53] Starting instance... {{(pid=72382) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 15:15:54 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-dab17cc8-d663-431f-881c-dfe633a6de11 tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] No BDM found with device name vda, not building metadata. {{(pid=72382) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 15:15:54 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-dab17cc8-d663-431f-881c-dfe633a6de11 tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] No BDM found with device name hda, not building metadata. {{(pid=72382) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 15:15:54 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-dab17cc8-d663-431f-881c-dfe633a6de11 tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] No VIF found with MAC fa:16:3e:b1:4d:7d, not building metadata {{(pid=72382) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 15:15:54 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-dab17cc8-d663-431f-881c-dfe633a6de11 tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] [instance: 23f25946-de3a-43fb-97a4-1f9a787e6e51] Using config drive
Aug 09 15:15:54 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-be32bc62-bc81-44aa-9f55-4b650c885f9a tempest-TestVolumeSwap-583684665 tempest-TestVolumeSwap-583684665-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:15:54 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-be32bc62-bc81-44aa-9f55-4b650c885f9a tempest-TestVolumeSwap-583684665 tempest-TestVolumeSwap-583684665-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:15:54 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-be32bc62-bc81-44aa-9f55-4b650c885f9a tempest-TestVolumeSwap-583684665 tempest-TestVolumeSwap-583684665-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72382) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 15:15:54 user nova-compute[72382]: INFO nova.compute.claims [None req-be32bc62-bc81-44aa-9f55-4b650c885f9a tempest-TestVolumeSwap-583684665 tempest-TestVolumeSwap-583684665-project-member] [instance: 9a82f146-97ce-4319-8b25-c1b090965e53] Claim successful on node user
Aug 09 15:15:55 user nova-compute[72382]: DEBUG nova.compute.provider_tree [None req-be32bc62-bc81-44aa-9f55-4b650c885f9a tempest-TestVolumeSwap-583684665 tempest-TestVolumeSwap-583684665-project-member] Inventory has not changed in ProviderTree for provider: 7b15b0e5-df4d-49db-833b-2855d21d10ae {{(pid=72382) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 15:15:55 user nova-compute[72382]: DEBUG nova.scheduler.client.report [None req-be32bc62-bc81-44aa-9f55-4b650c885f9a tempest-TestVolumeSwap-583684665 tempest-TestVolumeSwap-583684665-project-member] Inventory has not changed for provider 7b15b0e5-df4d-49db-833b-2855d21d10ae based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72382) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 15:15:55 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-be32bc62-bc81-44aa-9f55-4b650c885f9a tempest-TestVolumeSwap-583684665 tempest-TestVolumeSwap-583684665-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.578s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:15:55 user nova-compute[72382]: DEBUG nova.compute.manager [None req-be32bc62-bc81-44aa-9f55-4b650c885f9a tempest-TestVolumeSwap-583684665 tempest-TestVolumeSwap-583684665-project-member] [instance: 9a82f146-97ce-4319-8b25-c1b090965e53] Start building networks asynchronously for instance. {{(pid=72382) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 15:15:55 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-dab17cc8-d663-431f-881c-dfe633a6de11 tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] [instance: 23f25946-de3a-43fb-97a4-1f9a787e6e51] Creating config drive at /opt/stack/data/nova/instances/23f25946-de3a-43fb-97a4-1f9a787e6e51/disk.config
Aug 09 15:15:55 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-dab17cc8-d663-431f-881c-dfe633a6de11 tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/23f25946-de3a-43fb-97a4-1f9a787e6e51/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpn_qdcuwx {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:15:55 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-dab17cc8-d663-431f-881c-dfe633a6de11 tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/23f25946-de3a-43fb-97a4-1f9a787e6e51/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpn_qdcuwx" returned: 0 in 0.097s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:15:55 user nova-compute[72382]: DEBUG nova.compute.manager [None req-be32bc62-bc81-44aa-9f55-4b650c885f9a tempest-TestVolumeSwap-583684665 tempest-TestVolumeSwap-583684665-project-member] [instance: 9a82f146-97ce-4319-8b25-c1b090965e53] Allocating IP information in the background. {{(pid=72382) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 15:15:55 user nova-compute[72382]: DEBUG nova.network.neutron [None req-be32bc62-bc81-44aa-9f55-4b650c885f9a tempest-TestVolumeSwap-583684665 tempest-TestVolumeSwap-583684665-project-member] [instance: 9a82f146-97ce-4319-8b25-c1b090965e53] allocate_for_instance() {{(pid=72382) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 15:15:55 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-be32bc62-bc81-44aa-9f55-4b650c885f9a tempest-TestVolumeSwap-583684665 tempest-TestVolumeSwap-583684665-project-member] [instance: 9a82f146-97ce-4319-8b25-c1b090965e53] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 15:15:55 user nova-compute[72382]: DEBUG nova.compute.manager [None req-be32bc62-bc81-44aa-9f55-4b650c885f9a tempest-TestVolumeSwap-583684665 tempest-TestVolumeSwap-583684665-project-member] [instance: 9a82f146-97ce-4319-8b25-c1b090965e53] Start building block device mappings for instance. {{(pid=72382) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 15:15:55 user nova-compute[72382]: DEBUG nova.compute.manager [req-f193728c-ba28-4f2f-83f1-46bc992f92d2 req-ef93d0b4-4c40-4788-8fd5-f91c43da8c41 service nova] [instance: a33515b3-3ef4-4f76-a8d8-e7008b5bbb79] Received event network-vif-plugged-32c23c7b-6885-4276-bca1-7d8a8cb924c1 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:15:55 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-f193728c-ba28-4f2f-83f1-46bc992f92d2 req-ef93d0b4-4c40-4788-8fd5-f91c43da8c41 service nova] Acquiring lock "a33515b3-3ef4-4f76-a8d8-e7008b5bbb79-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:15:55 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-f193728c-ba28-4f2f-83f1-46bc992f92d2 req-ef93d0b4-4c40-4788-8fd5-f91c43da8c41 service nova] Lock "a33515b3-3ef4-4f76-a8d8-e7008b5bbb79-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:15:55 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-f193728c-ba28-4f2f-83f1-46bc992f92d2 req-ef93d0b4-4c40-4788-8fd5-f91c43da8c41 service nova] Lock "a33515b3-3ef4-4f76-a8d8-e7008b5bbb79-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:15:55 user nova-compute[72382]: DEBUG nova.compute.manager [req-f193728c-ba28-4f2f-83f1-46bc992f92d2 req-ef93d0b4-4c40-4788-8fd5-f91c43da8c41 service nova] [instance: a33515b3-3ef4-4f76-a8d8-e7008b5bbb79] No waiting events found dispatching network-vif-plugged-32c23c7b-6885-4276-bca1-7d8a8cb924c1 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:15:55 user nova-compute[72382]: WARNING nova.compute.manager [req-f193728c-ba28-4f2f-83f1-46bc992f92d2 req-ef93d0b4-4c40-4788-8fd5-f91c43da8c41 service nova] [instance: a33515b3-3ef4-4f76-a8d8-e7008b5bbb79] Received unexpected event network-vif-plugged-32c23c7b-6885-4276-bca1-7d8a8cb924c1 for instance with vm_state building and task_state spawning.
Aug 09 15:15:55 user nova-compute[72382]: DEBUG nova.compute.manager [req-f193728c-ba28-4f2f-83f1-46bc992f92d2 req-ef93d0b4-4c40-4788-8fd5-f91c43da8c41 service nova] [instance: a33515b3-3ef4-4f76-a8d8-e7008b5bbb79] Received event network-vif-plugged-32c23c7b-6885-4276-bca1-7d8a8cb924c1 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:15:55 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-f193728c-ba28-4f2f-83f1-46bc992f92d2 req-ef93d0b4-4c40-4788-8fd5-f91c43da8c41 service nova] Acquiring lock "a33515b3-3ef4-4f76-a8d8-e7008b5bbb79-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:15:55 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-f193728c-ba28-4f2f-83f1-46bc992f92d2 req-ef93d0b4-4c40-4788-8fd5-f91c43da8c41 service nova] Lock "a33515b3-3ef4-4f76-a8d8-e7008b5bbb79-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:15:55 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-f193728c-ba28-4f2f-83f1-46bc992f92d2 req-ef93d0b4-4c40-4788-8fd5-f91c43da8c41 service nova] Lock "a33515b3-3ef4-4f76-a8d8-e7008b5bbb79-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:15:55 user nova-compute[72382]: DEBUG nova.compute.manager [req-f193728c-ba28-4f2f-83f1-46bc992f92d2 req-ef93d0b4-4c40-4788-8fd5-f91c43da8c41 service nova] [instance: a33515b3-3ef4-4f76-a8d8-e7008b5bbb79] No waiting events found dispatching network-vif-plugged-32c23c7b-6885-4276-bca1-7d8a8cb924c1 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:15:55 user nova-compute[72382]: WARNING nova.compute.manager [req-f193728c-ba28-4f2f-83f1-46bc992f92d2 req-ef93d0b4-4c40-4788-8fd5-f91c43da8c41 service nova] [instance: a33515b3-3ef4-4f76-a8d8-e7008b5bbb79] Received unexpected event network-vif-plugged-32c23c7b-6885-4276-bca1-7d8a8cb924c1 for instance with vm_state building and task_state spawning.
Aug 09 15:15:55 user nova-compute[72382]: DEBUG nova.compute.manager [None req-be32bc62-bc81-44aa-9f55-4b650c885f9a tempest-TestVolumeSwap-583684665 tempest-TestVolumeSwap-583684665-project-member] [instance: 9a82f146-97ce-4319-8b25-c1b090965e53] Start spawning the instance on the hypervisor. {{(pid=72382) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 15:15:55 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-be32bc62-bc81-44aa-9f55-4b650c885f9a tempest-TestVolumeSwap-583684665 tempest-TestVolumeSwap-583684665-project-member] [instance: 9a82f146-97ce-4319-8b25-c1b090965e53] Creating instance directory {{(pid=72382) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 15:15:55 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-be32bc62-bc81-44aa-9f55-4b650c885f9a tempest-TestVolumeSwap-583684665 tempest-TestVolumeSwap-583684665-project-member] [instance: 9a82f146-97ce-4319-8b25-c1b090965e53] Creating image(s)
Aug 09 15:15:55 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-be32bc62-bc81-44aa-9f55-4b650c885f9a tempest-TestVolumeSwap-583684665 tempest-TestVolumeSwap-583684665-project-member] Acquiring lock "/opt/stack/data/nova/instances/9a82f146-97ce-4319-8b25-c1b090965e53/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:15:55 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-be32bc62-bc81-44aa-9f55-4b650c885f9a tempest-TestVolumeSwap-583684665 tempest-TestVolumeSwap-583684665-project-member] Lock "/opt/stack/data/nova/instances/9a82f146-97ce-4319-8b25-c1b090965e53/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:15:55 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-be32bc62-bc81-44aa-9f55-4b650c885f9a tempest-TestVolumeSwap-583684665 tempest-TestVolumeSwap-583684665-project-member] Lock "/opt/stack/data/nova/instances/9a82f146-97ce-4319-8b25-c1b090965e53/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:15:55 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-be32bc62-bc81-44aa-9f55-4b650c885f9a tempest-TestVolumeSwap-583684665 tempest-TestVolumeSwap-583684665-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:15:55 user nova-compute[72382]: DEBUG nova.policy [None req-be32bc62-bc81-44aa-9f55-4b650c885f9a tempest-TestVolumeSwap-583684665 tempest-TestVolumeSwap-583684665-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '02c5e77225644b918b4c675aad3b946b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd83791b742c0403ab043a6a41c81042e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72382) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 15:15:55 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-be32bc62-bc81-44aa-9f55-4b650c885f9a tempest-TestVolumeSwap-583684665 tempest-TestVolumeSwap-583684665-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b --force-share --output=json" returned: 0 in 0.151s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:15:55 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-be32bc62-bc81-44aa-9f55-4b650c885f9a tempest-TestVolumeSwap-583684665 tempest-TestVolumeSwap-583684665-project-member] Acquiring lock "383812ff437283e0191ed5b9ecc04c27f1162b0b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:15:55 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-be32bc62-bc81-44aa-9f55-4b650c885f9a tempest-TestVolumeSwap-583684665 tempest-TestVolumeSwap-583684665-project-member] Lock "383812ff437283e0191ed5b9ecc04c27f1162b0b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:15:55 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-be32bc62-bc81-44aa-9f55-4b650c885f9a tempest-TestVolumeSwap-583684665 tempest-TestVolumeSwap-583684665-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:15:55 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-be32bc62-bc81-44aa-9f55-4b650c885f9a tempest-TestVolumeSwap-583684665 tempest-TestVolumeSwap-583684665-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b --force-share --output=json" returned: 0 in 0.139s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:15:55 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-be32bc62-bc81-44aa-9f55-4b650c885f9a tempest-TestVolumeSwap-583684665 tempest-TestVolumeSwap-583684665-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b,backing_fmt=raw /opt/stack/data/nova/instances/9a82f146-97ce-4319-8b25-c1b090965e53/disk 1073741824 {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:15:55 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-be32bc62-bc81-44aa-9f55-4b650c885f9a tempest-TestVolumeSwap-583684665 tempest-TestVolumeSwap-583684665-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b,backing_fmt=raw /opt/stack/data/nova/instances/9a82f146-97ce-4319-8b25-c1b090965e53/disk 1073741824" returned: 0 in 0.070s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:15:55 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-be32bc62-bc81-44aa-9f55-4b650c885f9a tempest-TestVolumeSwap-583684665 tempest-TestVolumeSwap-583684665-project-member] Lock "383812ff437283e0191ed5b9ecc04c27f1162b0b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.224s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:15:55 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-be32bc62-bc81-44aa-9f55-4b650c885f9a tempest-TestVolumeSwap-583684665 tempest-TestVolumeSwap-583684665-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:15:55 user nova-compute[72382]: DEBUG nova.virt.driver [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Emitting event <LifecycleEvent: 1691594155.8608968, a33515b3-3ef4-4f76-a8d8-e7008b5bbb79 => Resumed> {{(pid=72382) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 15:15:55 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: a33515b3-3ef4-4f76-a8d8-e7008b5bbb79] VM Resumed (Lifecycle Event)
Aug 09 15:15:55 user nova-compute[72382]: DEBUG nova.compute.manager [None req-b5acb247-093b-4b95-8211-714e6c7f6f60 tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] [instance: a33515b3-3ef4-4f76-a8d8-e7008b5bbb79] Instance event wait completed in 0 seconds for  {{(pid=72382) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 15:15:55 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-b5acb247-093b-4b95-8211-714e6c7f6f60 tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] [instance: a33515b3-3ef4-4f76-a8d8-e7008b5bbb79] Guest created on hypervisor {{(pid=72382) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 15:15:55 user nova-compute[72382]: INFO nova.virt.libvirt.driver [-] [instance: a33515b3-3ef4-4f76-a8d8-e7008b5bbb79] Instance spawned successfully.
Aug 09 15:15:55 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-b5acb247-093b-4b95-8211-714e6c7f6f60 tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] [instance: a33515b3-3ef4-4f76-a8d8-e7008b5bbb79] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 15:15:55 user nova-compute[72382]: DEBUG nova.network.neutron [req-bb522ab8-ab8d-42d5-96c9-156055cbdd1d req-dfc9ef85-2e66-4670-8a40-832f1630383d service nova] [instance: 23f25946-de3a-43fb-97a4-1f9a787e6e51] Updated VIF entry in instance network info cache for port 1c588f02-cc2c-47f1-8918-bf9b1d3ea215. {{(pid=72382) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 15:15:55 user nova-compute[72382]: DEBUG nova.network.neutron [req-bb522ab8-ab8d-42d5-96c9-156055cbdd1d req-dfc9ef85-2e66-4670-8a40-832f1630383d service nova] [instance: 23f25946-de3a-43fb-97a4-1f9a787e6e51] Updating instance_info_cache with network_info: [{"id": "1c588f02-cc2c-47f1-8918-bf9b1d3ea215", "address": "fa:16:3e:b1:4d:7d", "network": {"id": "e5132afa-231c-471e-b11a-a6e972603b0c", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2085484007-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b84d09ad643146859e76996c09ba02c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c588f02-cc", "ovs_interfaceid": "1c588f02-cc2c-47f1-8918-bf9b1d3ea215", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:15:55 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: a33515b3-3ef4-4f76-a8d8-e7008b5bbb79] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:15:55 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: a33515b3-3ef4-4f76-a8d8-e7008b5bbb79] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72382) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 15:15:55 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-bb522ab8-ab8d-42d5-96c9-156055cbdd1d req-dfc9ef85-2e66-4670-8a40-832f1630383d service nova] Releasing lock "refresh_cache-23f25946-de3a-43fb-97a4-1f9a787e6e51" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 15:15:55 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-b5acb247-093b-4b95-8211-714e6c7f6f60 tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] [instance: a33515b3-3ef4-4f76-a8d8-e7008b5bbb79] Found default for hw_cdrom_bus of ide {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:15:55 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-b5acb247-093b-4b95-8211-714e6c7f6f60 tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] [instance: a33515b3-3ef4-4f76-a8d8-e7008b5bbb79] Found default for hw_disk_bus of virtio {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:15:55 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-b5acb247-093b-4b95-8211-714e6c7f6f60 tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] [instance: a33515b3-3ef4-4f76-a8d8-e7008b5bbb79] Found default for hw_input_bus of None {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:15:55 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-b5acb247-093b-4b95-8211-714e6c7f6f60 tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] [instance: a33515b3-3ef4-4f76-a8d8-e7008b5bbb79] Found default for hw_pointer_model of None {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:15:56 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-b5acb247-093b-4b95-8211-714e6c7f6f60 tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] [instance: a33515b3-3ef4-4f76-a8d8-e7008b5bbb79] Found default for hw_video_model of virtio {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:15:56 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-b5acb247-093b-4b95-8211-714e6c7f6f60 tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] [instance: a33515b3-3ef4-4f76-a8d8-e7008b5bbb79] Found default for hw_vif_model of virtio {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:15:56 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: a33515b3-3ef4-4f76-a8d8-e7008b5bbb79] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 15:15:56 user nova-compute[72382]: DEBUG nova.virt.driver [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Emitting event <LifecycleEvent: 1691594155.875269, a33515b3-3ef4-4f76-a8d8-e7008b5bbb79 => Started> {{(pid=72382) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 15:15:56 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: a33515b3-3ef4-4f76-a8d8-e7008b5bbb79] VM Started (Lifecycle Event)
Aug 09 15:15:56 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-be32bc62-bc81-44aa-9f55-4b650c885f9a tempest-TestVolumeSwap-583684665 tempest-TestVolumeSwap-583684665-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b --force-share --output=json" returned: 0 in 0.184s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:15:56 user nova-compute[72382]: DEBUG nova.virt.disk.api [None req-be32bc62-bc81-44aa-9f55-4b650c885f9a tempest-TestVolumeSwap-583684665 tempest-TestVolumeSwap-583684665-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9a82f146-97ce-4319-8b25-c1b090965e53/disk. size=1073741824 {{(pid=72382) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 15:15:56 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-be32bc62-bc81-44aa-9f55-4b650c885f9a tempest-TestVolumeSwap-583684665 tempest-TestVolumeSwap-583684665-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a82f146-97ce-4319-8b25-c1b090965e53/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:15:56 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: a33515b3-3ef4-4f76-a8d8-e7008b5bbb79] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:15:56 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: a33515b3-3ef4-4f76-a8d8-e7008b5bbb79] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72382) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 15:15:56 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: a33515b3-3ef4-4f76-a8d8-e7008b5bbb79] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 15:15:56 user nova-compute[72382]: INFO nova.compute.manager [None req-b5acb247-093b-4b95-8211-714e6c7f6f60 tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] [instance: a33515b3-3ef4-4f76-a8d8-e7008b5bbb79] Took 11.63 seconds to spawn the instance on the hypervisor.
Aug 09 15:15:56 user nova-compute[72382]: DEBUG nova.compute.manager [None req-b5acb247-093b-4b95-8211-714e6c7f6f60 tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] [instance: a33515b3-3ef4-4f76-a8d8-e7008b5bbb79] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:15:56 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-be32bc62-bc81-44aa-9f55-4b650c885f9a tempest-TestVolumeSwap-583684665 tempest-TestVolumeSwap-583684665-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a82f146-97ce-4319-8b25-c1b090965e53/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:15:56 user nova-compute[72382]: DEBUG nova.virt.disk.api [None req-be32bc62-bc81-44aa-9f55-4b650c885f9a tempest-TestVolumeSwap-583684665 tempest-TestVolumeSwap-583684665-project-member] Cannot resize image /opt/stack/data/nova/instances/9a82f146-97ce-4319-8b25-c1b090965e53/disk to a smaller size. {{(pid=72382) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 15:15:56 user nova-compute[72382]: DEBUG nova.objects.instance [None req-be32bc62-bc81-44aa-9f55-4b650c885f9a tempest-TestVolumeSwap-583684665 tempest-TestVolumeSwap-583684665-project-member] Lazy-loading 'migration_context' on Instance uuid 9a82f146-97ce-4319-8b25-c1b090965e53 {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:15:56 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-be32bc62-bc81-44aa-9f55-4b650c885f9a tempest-TestVolumeSwap-583684665 tempest-TestVolumeSwap-583684665-project-member] [instance: 9a82f146-97ce-4319-8b25-c1b090965e53] Created local disks {{(pid=72382) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 15:15:56 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-be32bc62-bc81-44aa-9f55-4b650c885f9a tempest-TestVolumeSwap-583684665 tempest-TestVolumeSwap-583684665-project-member] [instance: 9a82f146-97ce-4319-8b25-c1b090965e53] Ensure instance console log exists: /opt/stack/data/nova/instances/9a82f146-97ce-4319-8b25-c1b090965e53/console.log {{(pid=72382) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 15:15:56 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-be32bc62-bc81-44aa-9f55-4b650c885f9a tempest-TestVolumeSwap-583684665 tempest-TestVolumeSwap-583684665-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:15:56 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-be32bc62-bc81-44aa-9f55-4b650c885f9a tempest-TestVolumeSwap-583684665 tempest-TestVolumeSwap-583684665-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:15:56 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-be32bc62-bc81-44aa-9f55-4b650c885f9a tempest-TestVolumeSwap-583684665 tempest-TestVolumeSwap-583684665-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:15:56 user nova-compute[72382]: INFO nova.compute.manager [None req-b5acb247-093b-4b95-8211-714e6c7f6f60 tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] [instance: a33515b3-3ef4-4f76-a8d8-e7008b5bbb79] Took 13.56 seconds to build instance.
Aug 09 15:15:56 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-b5acb247-093b-4b95-8211-714e6c7f6f60 tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] Lock "a33515b3-3ef4-4f76-a8d8-e7008b5bbb79" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.853s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:15:56 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:15:56 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:15:56 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:15:57 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:15:57 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:15:57 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:15:57 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:15:57 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:15:57 user nova-compute[72382]: DEBUG nova.compute.manager [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Cleaning up deleted instances {{(pid=72382) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 09 15:15:57 user nova-compute[72382]: DEBUG nova.network.neutron [None req-be32bc62-bc81-44aa-9f55-4b650c885f9a tempest-TestVolumeSwap-583684665 tempest-TestVolumeSwap-583684665-project-member] [instance: 9a82f146-97ce-4319-8b25-c1b090965e53] Successfully created port: 759df480-caa9-4610-893d-3784aaddf4b3 {{(pid=72382) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 15:15:57 user nova-compute[72382]: DEBUG nova.compute.manager [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] There are 0 instances to clean {{(pid=72382) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 09 15:15:57 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:15:57 user nova-compute[72382]: DEBUG nova.compute.manager [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Cleaning up deleted instances with incomplete migration  {{(pid=72382) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 09 15:15:57 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:15:58 user nova-compute[72382]: DEBUG nova.compute.manager [req-19c553dc-b288-404a-9f9c-eab8d9923aa2 req-dbd14f39-4878-4f45-b38b-3120c6c1f296 service nova] [instance: 23f25946-de3a-43fb-97a4-1f9a787e6e51] Received event network-vif-plugged-1c588f02-cc2c-47f1-8918-bf9b1d3ea215 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:15:58 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-19c553dc-b288-404a-9f9c-eab8d9923aa2 req-dbd14f39-4878-4f45-b38b-3120c6c1f296 service nova] Acquiring lock "23f25946-de3a-43fb-97a4-1f9a787e6e51-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:15:58 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-19c553dc-b288-404a-9f9c-eab8d9923aa2 req-dbd14f39-4878-4f45-b38b-3120c6c1f296 service nova] Lock "23f25946-de3a-43fb-97a4-1f9a787e6e51-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:15:58 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-19c553dc-b288-404a-9f9c-eab8d9923aa2 req-dbd14f39-4878-4f45-b38b-3120c6c1f296 service nova] Lock "23f25946-de3a-43fb-97a4-1f9a787e6e51-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:15:58 user nova-compute[72382]: DEBUG nova.compute.manager [req-19c553dc-b288-404a-9f9c-eab8d9923aa2 req-dbd14f39-4878-4f45-b38b-3120c6c1f296 service nova] [instance: 23f25946-de3a-43fb-97a4-1f9a787e6e51] No waiting events found dispatching network-vif-plugged-1c588f02-cc2c-47f1-8918-bf9b1d3ea215 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:15:58 user nova-compute[72382]: WARNING nova.compute.manager [req-19c553dc-b288-404a-9f9c-eab8d9923aa2 req-dbd14f39-4878-4f45-b38b-3120c6c1f296 service nova] [instance: 23f25946-de3a-43fb-97a4-1f9a787e6e51] Received unexpected event network-vif-plugged-1c588f02-cc2c-47f1-8918-bf9b1d3ea215 for instance with vm_state building and task_state spawning.
Aug 09 15:15:58 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:15:58 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:15:59 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:15:59 user nova-compute[72382]: DEBUG nova.virt.driver [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Emitting event <LifecycleEvent: 1691594159.482804, 23f25946-de3a-43fb-97a4-1f9a787e6e51 => Resumed> {{(pid=72382) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 15:15:59 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 23f25946-de3a-43fb-97a4-1f9a787e6e51] VM Resumed (Lifecycle Event)
Aug 09 15:15:59 user nova-compute[72382]: DEBUG nova.compute.manager [None req-dab17cc8-d663-431f-881c-dfe633a6de11 tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] [instance: 23f25946-de3a-43fb-97a4-1f9a787e6e51] Instance event wait completed in 0 seconds for  {{(pid=72382) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 15:15:59 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-dab17cc8-d663-431f-881c-dfe633a6de11 tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] [instance: 23f25946-de3a-43fb-97a4-1f9a787e6e51] Guest created on hypervisor {{(pid=72382) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 15:15:59 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 23f25946-de3a-43fb-97a4-1f9a787e6e51] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:15:59 user nova-compute[72382]: INFO nova.virt.libvirt.driver [-] [instance: 23f25946-de3a-43fb-97a4-1f9a787e6e51] Instance spawned successfully.
Aug 09 15:15:59 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-dab17cc8-d663-431f-881c-dfe633a6de11 tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] [instance: 23f25946-de3a-43fb-97a4-1f9a787e6e51] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 15:15:59 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 23f25946-de3a-43fb-97a4-1f9a787e6e51] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72382) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 15:15:59 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-dab17cc8-d663-431f-881c-dfe633a6de11 tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] [instance: 23f25946-de3a-43fb-97a4-1f9a787e6e51] Found default for hw_cdrom_bus of ide {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:15:59 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-dab17cc8-d663-431f-881c-dfe633a6de11 tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] [instance: 23f25946-de3a-43fb-97a4-1f9a787e6e51] Found default for hw_disk_bus of virtio {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:15:59 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-dab17cc8-d663-431f-881c-dfe633a6de11 tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] [instance: 23f25946-de3a-43fb-97a4-1f9a787e6e51] Found default for hw_input_bus of None {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:15:59 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-dab17cc8-d663-431f-881c-dfe633a6de11 tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] [instance: 23f25946-de3a-43fb-97a4-1f9a787e6e51] Found default for hw_pointer_model of None {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:15:59 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-dab17cc8-d663-431f-881c-dfe633a6de11 tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] [instance: 23f25946-de3a-43fb-97a4-1f9a787e6e51] Found default for hw_video_model of virtio {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:15:59 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-dab17cc8-d663-431f-881c-dfe633a6de11 tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] [instance: 23f25946-de3a-43fb-97a4-1f9a787e6e51] Found default for hw_vif_model of virtio {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:15:59 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 23f25946-de3a-43fb-97a4-1f9a787e6e51] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 15:15:59 user nova-compute[72382]: DEBUG nova.virt.driver [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Emitting event <LifecycleEvent: 1691594159.4850109, 23f25946-de3a-43fb-97a4-1f9a787e6e51 => Started> {{(pid=72382) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 15:15:59 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 23f25946-de3a-43fb-97a4-1f9a787e6e51] VM Started (Lifecycle Event)
Aug 09 15:15:59 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 23f25946-de3a-43fb-97a4-1f9a787e6e51] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:15:59 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 23f25946-de3a-43fb-97a4-1f9a787e6e51] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72382) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 15:15:59 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 23f25946-de3a-43fb-97a4-1f9a787e6e51] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 15:15:59 user nova-compute[72382]: INFO nova.compute.manager [None req-dab17cc8-d663-431f-881c-dfe633a6de11 tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] [instance: 23f25946-de3a-43fb-97a4-1f9a787e6e51] Took 12.05 seconds to spawn the instance on the hypervisor.
Aug 09 15:15:59 user nova-compute[72382]: DEBUG nova.compute.manager [None req-dab17cc8-d663-431f-881c-dfe633a6de11 tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] [instance: 23f25946-de3a-43fb-97a4-1f9a787e6e51] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:15:59 user nova-compute[72382]: INFO nova.compute.manager [None req-dab17cc8-d663-431f-881c-dfe633a6de11 tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] [instance: 23f25946-de3a-43fb-97a4-1f9a787e6e51] Took 13.70 seconds to build instance.
Aug 09 15:15:59 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-dab17cc8-d663-431f-881c-dfe633a6de11 tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] Lock "23f25946-de3a-43fb-97a4-1f9a787e6e51" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.180s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:15:59 user nova-compute[72382]: DEBUG nova.network.neutron [None req-be32bc62-bc81-44aa-9f55-4b650c885f9a tempest-TestVolumeSwap-583684665 tempest-TestVolumeSwap-583684665-project-member] [instance: 9a82f146-97ce-4319-8b25-c1b090965e53] Successfully updated port: 759df480-caa9-4610-893d-3784aaddf4b3 {{(pid=72382) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 15:15:59 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-be32bc62-bc81-44aa-9f55-4b650c885f9a tempest-TestVolumeSwap-583684665 tempest-TestVolumeSwap-583684665-project-member] Acquiring lock "refresh_cache-9a82f146-97ce-4319-8b25-c1b090965e53" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 15:15:59 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-be32bc62-bc81-44aa-9f55-4b650c885f9a tempest-TestVolumeSwap-583684665 tempest-TestVolumeSwap-583684665-project-member] Acquired lock "refresh_cache-9a82f146-97ce-4319-8b25-c1b090965e53" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 15:15:59 user nova-compute[72382]: DEBUG nova.network.neutron [None req-be32bc62-bc81-44aa-9f55-4b650c885f9a tempest-TestVolumeSwap-583684665 tempest-TestVolumeSwap-583684665-project-member] [instance: 9a82f146-97ce-4319-8b25-c1b090965e53] Building network info cache for instance {{(pid=72382) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 15:15:59 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:15:59 user nova-compute[72382]: DEBUG nova.compute.manager [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Starting heal instance info cache {{(pid=72382) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 15:15:59 user nova-compute[72382]: DEBUG nova.compute.manager [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Rebuilding the list of instances to heal {{(pid=72382) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 09 15:15:59 user nova-compute[72382]: DEBUG nova.network.neutron [None req-be32bc62-bc81-44aa-9f55-4b650c885f9a tempest-TestVolumeSwap-583684665 tempest-TestVolumeSwap-583684665-project-member] [instance: 9a82f146-97ce-4319-8b25-c1b090965e53] Instance cache missing network info. {{(pid=72382) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 15:16:00 user nova-compute[72382]: DEBUG nova.compute.manager [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] [instance: 9a82f146-97ce-4319-8b25-c1b090965e53] Skipping network cache update for instance because it is Building. {{(pid=72382) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Aug 09 15:16:00 user nova-compute[72382]: DEBUG nova.compute.manager [req-832f8265-9148-4988-8953-adb8bb824f3d req-697e21d5-b611-4caa-8f5d-c2022d958f91 service nova] [instance: 23f25946-de3a-43fb-97a4-1f9a787e6e51] Received event network-vif-plugged-1c588f02-cc2c-47f1-8918-bf9b1d3ea215 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:16:00 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-832f8265-9148-4988-8953-adb8bb824f3d req-697e21d5-b611-4caa-8f5d-c2022d958f91 service nova] Acquiring lock "23f25946-de3a-43fb-97a4-1f9a787e6e51-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:16:00 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-832f8265-9148-4988-8953-adb8bb824f3d req-697e21d5-b611-4caa-8f5d-c2022d958f91 service nova] Lock "23f25946-de3a-43fb-97a4-1f9a787e6e51-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:16:00 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-832f8265-9148-4988-8953-adb8bb824f3d req-697e21d5-b611-4caa-8f5d-c2022d958f91 service nova] Lock "23f25946-de3a-43fb-97a4-1f9a787e6e51-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:16:00 user nova-compute[72382]: DEBUG nova.compute.manager [req-832f8265-9148-4988-8953-adb8bb824f3d req-697e21d5-b611-4caa-8f5d-c2022d958f91 service nova] [instance: 23f25946-de3a-43fb-97a4-1f9a787e6e51] No waiting events found dispatching network-vif-plugged-1c588f02-cc2c-47f1-8918-bf9b1d3ea215 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:16:00 user nova-compute[72382]: WARNING nova.compute.manager [req-832f8265-9148-4988-8953-adb8bb824f3d req-697e21d5-b611-4caa-8f5d-c2022d958f91 service nova] [instance: 23f25946-de3a-43fb-97a4-1f9a787e6e51] Received unexpected event network-vif-plugged-1c588f02-cc2c-47f1-8918-bf9b1d3ea215 for instance with vm_state active and task_state None.
Aug 09 15:16:00 user nova-compute[72382]: DEBUG nova.compute.manager [req-832f8265-9148-4988-8953-adb8bb824f3d req-697e21d5-b611-4caa-8f5d-c2022d958f91 service nova] [instance: 9a82f146-97ce-4319-8b25-c1b090965e53] Received event network-changed-759df480-caa9-4610-893d-3784aaddf4b3 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:16:00 user nova-compute[72382]: DEBUG nova.compute.manager [req-832f8265-9148-4988-8953-adb8bb824f3d req-697e21d5-b611-4caa-8f5d-c2022d958f91 service nova] [instance: 9a82f146-97ce-4319-8b25-c1b090965e53] Refreshing instance network info cache due to event network-changed-759df480-caa9-4610-893d-3784aaddf4b3. {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 15:16:00 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-832f8265-9148-4988-8953-adb8bb824f3d req-697e21d5-b611-4caa-8f5d-c2022d958f91 service nova] Acquiring lock "refresh_cache-9a82f146-97ce-4319-8b25-c1b090965e53" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 15:16:00 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Acquiring lock "refresh_cache-f780040f-b789-4b72-8986-813c7b9fe4a6" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 15:16:00 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Acquired lock "refresh_cache-f780040f-b789-4b72-8986-813c7b9fe4a6" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 15:16:00 user nova-compute[72382]: DEBUG nova.network.neutron [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] [instance: f780040f-b789-4b72-8986-813c7b9fe4a6] Forcefully refreshing network info cache for instance {{(pid=72382) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 15:16:00 user nova-compute[72382]: DEBUG nova.objects.instance [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lazy-loading 'info_cache' on Instance uuid f780040f-b789-4b72-8986-813c7b9fe4a6 {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:16:01 user nova-compute[72382]: DEBUG nova.network.neutron [None req-be32bc62-bc81-44aa-9f55-4b650c885f9a tempest-TestVolumeSwap-583684665 tempest-TestVolumeSwap-583684665-project-member] [instance: 9a82f146-97ce-4319-8b25-c1b090965e53] Updating instance_info_cache with network_info: [{"id": "759df480-caa9-4610-893d-3784aaddf4b3", "address": "fa:16:3e:71:e7:dc", "network": {"id": "1cf9bb6d-ae38-4dd6-bd50-c20ff14c5ae6", "bridge": "br-int", "label": "tempest-TestVolumeSwap-488911533-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d83791b742c0403ab043a6a41c81042e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap759df480-ca", "ovs_interfaceid": "759df480-caa9-4610-893d-3784aaddf4b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:16:01 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-be32bc62-bc81-44aa-9f55-4b650c885f9a tempest-TestVolumeSwap-583684665 tempest-TestVolumeSwap-583684665-project-member] Releasing lock "refresh_cache-9a82f146-97ce-4319-8b25-c1b090965e53" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 15:16:01 user nova-compute[72382]: DEBUG nova.compute.manager [None req-be32bc62-bc81-44aa-9f55-4b650c885f9a tempest-TestVolumeSwap-583684665 tempest-TestVolumeSwap-583684665-project-member] [instance: 9a82f146-97ce-4319-8b25-c1b090965e53] Instance network_info: |[{"id": "759df480-caa9-4610-893d-3784aaddf4b3", "address": "fa:16:3e:71:e7:dc", "network": {"id": "1cf9bb6d-ae38-4dd6-bd50-c20ff14c5ae6", "bridge": "br-int", "label": "tempest-TestVolumeSwap-488911533-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d83791b742c0403ab043a6a41c81042e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap759df480-ca", "ovs_interfaceid": "759df480-caa9-4610-893d-3784aaddf4b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72382) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 15:16:01 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-832f8265-9148-4988-8953-adb8bb824f3d req-697e21d5-b611-4caa-8f5d-c2022d958f91 service nova] Acquired lock "refresh_cache-9a82f146-97ce-4319-8b25-c1b090965e53" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 15:16:01 user nova-compute[72382]: DEBUG nova.network.neutron [req-832f8265-9148-4988-8953-adb8bb824f3d req-697e21d5-b611-4caa-8f5d-c2022d958f91 service nova] [instance: 9a82f146-97ce-4319-8b25-c1b090965e53] Refreshing network info cache for port 759df480-caa9-4610-893d-3784aaddf4b3 {{(pid=72382) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 15:16:01 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-be32bc62-bc81-44aa-9f55-4b650c885f9a tempest-TestVolumeSwap-583684665 tempest-TestVolumeSwap-583684665-project-member] [instance: 9a82f146-97ce-4319-8b25-c1b090965e53] Start _get_guest_xml network_info=[{"id": "759df480-caa9-4610-893d-3784aaddf4b3", "address": "fa:16:3e:71:e7:dc", "network": {"id": "1cf9bb6d-ae38-4dd6-bd50-c20ff14c5ae6", "bridge": "br-int", "label": "tempest-TestVolumeSwap-488911533-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d83791b742c0403ab043a6a41c81042e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap759df480-ca", "ovs_interfaceid": "759df480-caa9-4610-893d-3784aaddf4b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T15:11:25Z,direct_url=<?>,disk_format='qcow2',id=a79f2cea-eb27-4631-aaf3-05e7d9e411b4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a638990e12cc4d6eabb6d55e13be6bdf',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T15:11:27Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'a79f2cea-eb27-4631-aaf3-05e7d9e411b4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72382) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 15:16:01 user nova-compute[72382]: WARNING nova.virt.libvirt.driver [None req-be32bc62-bc81-44aa-9f55-4b650c885f9a tempest-TestVolumeSwap-583684665 tempest-TestVolumeSwap-583684665-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 15:16:01 user nova-compute[72382]: WARNING nova.virt.libvirt.driver [None req-be32bc62-bc81-44aa-9f55-4b650c885f9a tempest-TestVolumeSwap-583684665 tempest-TestVolumeSwap-583684665-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 15:16:01 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-be32bc62-bc81-44aa-9f55-4b650c885f9a tempest-TestVolumeSwap-583684665 tempest-TestVolumeSwap-583684665-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72382) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 15:16:01 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-be32bc62-bc81-44aa-9f55-4b650c885f9a tempest-TestVolumeSwap-583684665 tempest-TestVolumeSwap-583684665-project-member] CPU controller missing on host. {{(pid=72382) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 15:16:01 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-be32bc62-bc81-44aa-9f55-4b650c885f9a tempest-TestVolumeSwap-583684665 tempest-TestVolumeSwap-583684665-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72382) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 15:16:01 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-be32bc62-bc81-44aa-9f55-4b650c885f9a tempest-TestVolumeSwap-583684665 tempest-TestVolumeSwap-583684665-project-member] CPU controller found on host. {{(pid=72382) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 15:16:01 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-be32bc62-bc81-44aa-9f55-4b650c885f9a tempest-TestVolumeSwap-583684665 tempest-TestVolumeSwap-583684665-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72382) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 15:16:01 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-be32bc62-bc81-44aa-9f55-4b650c885f9a tempest-TestVolumeSwap-583684665 tempest-TestVolumeSwap-583684665-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T15:11:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T15:11:25Z,direct_url=<?>,disk_format='qcow2',id=a79f2cea-eb27-4631-aaf3-05e7d9e411b4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a638990e12cc4d6eabb6d55e13be6bdf',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T15:11:27Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 15:16:01 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-be32bc62-bc81-44aa-9f55-4b650c885f9a tempest-TestVolumeSwap-583684665 tempest-TestVolumeSwap-583684665-project-member] Flavor limits 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 15:16:01 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-be32bc62-bc81-44aa-9f55-4b650c885f9a tempest-TestVolumeSwap-583684665 tempest-TestVolumeSwap-583684665-project-member] Image limits 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 15:16:01 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-be32bc62-bc81-44aa-9f55-4b650c885f9a tempest-TestVolumeSwap-583684665 tempest-TestVolumeSwap-583684665-project-member] Flavor pref 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 15:16:01 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-be32bc62-bc81-44aa-9f55-4b650c885f9a tempest-TestVolumeSwap-583684665 tempest-TestVolumeSwap-583684665-project-member] Image pref 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 15:16:01 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-be32bc62-bc81-44aa-9f55-4b650c885f9a tempest-TestVolumeSwap-583684665 tempest-TestVolumeSwap-583684665-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 15:16:01 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-be32bc62-bc81-44aa-9f55-4b650c885f9a tempest-TestVolumeSwap-583684665 tempest-TestVolumeSwap-583684665-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 15:16:01 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-be32bc62-bc81-44aa-9f55-4b650c885f9a tempest-TestVolumeSwap-583684665 tempest-TestVolumeSwap-583684665-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72382) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 15:16:01 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-be32bc62-bc81-44aa-9f55-4b650c885f9a tempest-TestVolumeSwap-583684665 tempest-TestVolumeSwap-583684665-project-member] Got 1 possible topologies {{(pid=72382) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 15:16:01 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-be32bc62-bc81-44aa-9f55-4b650c885f9a tempest-TestVolumeSwap-583684665 tempest-TestVolumeSwap-583684665-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 15:16:01 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-be32bc62-bc81-44aa-9f55-4b650c885f9a tempest-TestVolumeSwap-583684665 tempest-TestVolumeSwap-583684665-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 15:16:01 user nova-compute[72382]: DEBUG nova.virt.libvirt.vif [None req-be32bc62-bc81-44aa-9f55-4b650c885f9a tempest-TestVolumeSwap-583684665 tempest-TestVolumeSwap-583684665-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T15:15:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-2136349497',display_name='tempest-TestVolumeSwap-server-2136349497',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-2136349497',id=10,image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD4INTzqOUtJmSnJh1Eoc/6VL/ZJB2d4TtStHNFM3qdUiRDBv80UJ34Z9r/gBzURcH3+ZKqKuJ+1FmnlRe71prsqTjLuJRRRfoqNwXqe198BrDYu8rL10eFUe3DXcyiaKg==',key_name='tempest-keypair-1234113342',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d83791b742c0403ab043a6a41c81042e',ramdisk_id='',reservation_id='r-xhefoujb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-583684665',owner_user_name='tempest-TestVolumeSwap-583684665-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T15:15:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='02c5e77225644b918b4c675aad3b946b',uuid=9a82f146-97ce-4319-8b25-c1b090965e53,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "759df480-caa9-4610-893d-3784aaddf4b3", "address": "fa:16:3e:71:e7:dc", "network": {"id": "1cf9bb6d-ae38-4dd6-bd50-c20ff14c5ae6", "bridge": "br-int", "label": "tempest-TestVolumeSwap-488911533-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d83791b742c0403ab043a6a41c81042e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap759df480-ca", "ovs_interfaceid": "759df480-caa9-4610-893d-3784aaddf4b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72382) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 15:16:01 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-be32bc62-bc81-44aa-9f55-4b650c885f9a tempest-TestVolumeSwap-583684665 tempest-TestVolumeSwap-583684665-project-member] Converting VIF {"id": "759df480-caa9-4610-893d-3784aaddf4b3", "address": "fa:16:3e:71:e7:dc", "network": {"id": "1cf9bb6d-ae38-4dd6-bd50-c20ff14c5ae6", "bridge": "br-int", "label": "tempest-TestVolumeSwap-488911533-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d83791b742c0403ab043a6a41c81042e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap759df480-ca", "ovs_interfaceid": "759df480-caa9-4610-893d-3784aaddf4b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 15:16:01 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-be32bc62-bc81-44aa-9f55-4b650c885f9a tempest-TestVolumeSwap-583684665 tempest-TestVolumeSwap-583684665-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:71:e7:dc,bridge_name='br-int',has_traffic_filtering=True,id=759df480-caa9-4610-893d-3784aaddf4b3,network=Network(1cf9bb6d-ae38-4dd6-bd50-c20ff14c5ae6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap759df480-ca') {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 15:16:01 user nova-compute[72382]: DEBUG nova.objects.instance [None req-be32bc62-bc81-44aa-9f55-4b650c885f9a tempest-TestVolumeSwap-583684665 tempest-TestVolumeSwap-583684665-project-member] Lazy-loading 'pci_devices' on Instance uuid 9a82f146-97ce-4319-8b25-c1b090965e53 {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:16:01 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-be32bc62-bc81-44aa-9f55-4b650c885f9a tempest-TestVolumeSwap-583684665 tempest-TestVolumeSwap-583684665-project-member] [instance: 9a82f146-97ce-4319-8b25-c1b090965e53] End _get_guest_xml xml=<domain type="kvm">
Aug 09 15:16:01 user nova-compute[72382]:   <uuid>9a82f146-97ce-4319-8b25-c1b090965e53</uuid>
Aug 09 15:16:01 user nova-compute[72382]:   <name>instance-0000000a</name>
Aug 09 15:16:01 user nova-compute[72382]:   <memory>524288</memory>
Aug 09 15:16:01 user nova-compute[72382]:   <vcpu>1</vcpu>
Aug 09 15:16:01 user nova-compute[72382]:   <metadata>
Aug 09 15:16:01 user nova-compute[72382]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 15:16:01 user nova-compute[72382]:       <nova:package version="0.0.0"/>
Aug 09 15:16:01 user nova-compute[72382]:       <nova:name>tempest-TestVolumeSwap-server-2136349497</nova:name>
Aug 09 15:16:01 user nova-compute[72382]:       <nova:creationTime>2023-08-09 15:16:01</nova:creationTime>
Aug 09 15:16:01 user nova-compute[72382]:       <nova:flavor name="m1.tiny">
Aug 09 15:16:01 user nova-compute[72382]:         <nova:memory>512</nova:memory>
Aug 09 15:16:01 user nova-compute[72382]:         <nova:disk>1</nova:disk>
Aug 09 15:16:01 user nova-compute[72382]:         <nova:swap>0</nova:swap>
Aug 09 15:16:01 user nova-compute[72382]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 15:16:01 user nova-compute[72382]:         <nova:vcpus>1</nova:vcpus>
Aug 09 15:16:01 user nova-compute[72382]:       </nova:flavor>
Aug 09 15:16:01 user nova-compute[72382]:       <nova:owner>
Aug 09 15:16:01 user nova-compute[72382]:         <nova:user uuid="02c5e77225644b918b4c675aad3b946b">tempest-TestVolumeSwap-583684665-project-member</nova:user>
Aug 09 15:16:01 user nova-compute[72382]:         <nova:project uuid="d83791b742c0403ab043a6a41c81042e">tempest-TestVolumeSwap-583684665</nova:project>
Aug 09 15:16:01 user nova-compute[72382]:       </nova:owner>
Aug 09 15:16:01 user nova-compute[72382]:       <nova:root type="image" uuid="a79f2cea-eb27-4631-aaf3-05e7d9e411b4"/>
Aug 09 15:16:01 user nova-compute[72382]:       <nova:ports>
Aug 09 15:16:01 user nova-compute[72382]:         <nova:port uuid="759df480-caa9-4610-893d-3784aaddf4b3">
Aug 09 15:16:01 user nova-compute[72382]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 09 15:16:01 user nova-compute[72382]:         </nova:port>
Aug 09 15:16:01 user nova-compute[72382]:       </nova:ports>
Aug 09 15:16:01 user nova-compute[72382]:     </nova:instance>
Aug 09 15:16:01 user nova-compute[72382]:   </metadata>
Aug 09 15:16:01 user nova-compute[72382]:   <sysinfo type="smbios">
Aug 09 15:16:01 user nova-compute[72382]:     <system>
Aug 09 15:16:01 user nova-compute[72382]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 15:16:01 user nova-compute[72382]:       <entry name="product">OpenStack Nova</entry>
Aug 09 15:16:01 user nova-compute[72382]:       <entry name="version">0.0.0</entry>
Aug 09 15:16:01 user nova-compute[72382]:       <entry name="serial">9a82f146-97ce-4319-8b25-c1b090965e53</entry>
Aug 09 15:16:01 user nova-compute[72382]:       <entry name="uuid">9a82f146-97ce-4319-8b25-c1b090965e53</entry>
Aug 09 15:16:01 user nova-compute[72382]:       <entry name="family">Virtual Machine</entry>
Aug 09 15:16:01 user nova-compute[72382]:     </system>
Aug 09 15:16:01 user nova-compute[72382]:   </sysinfo>
Aug 09 15:16:01 user nova-compute[72382]:   <os>
Aug 09 15:16:01 user nova-compute[72382]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 15:16:01 user nova-compute[72382]:     <boot dev="hd"/>
Aug 09 15:16:01 user nova-compute[72382]:     <smbios mode="sysinfo"/>
Aug 09 15:16:01 user nova-compute[72382]:   </os>
Aug 09 15:16:01 user nova-compute[72382]:   <features>
Aug 09 15:16:01 user nova-compute[72382]:     <acpi/>
Aug 09 15:16:01 user nova-compute[72382]:     <apic/>
Aug 09 15:16:01 user nova-compute[72382]:     <vmcoreinfo/>
Aug 09 15:16:01 user nova-compute[72382]:   </features>
Aug 09 15:16:01 user nova-compute[72382]:   <clock offset="utc">
Aug 09 15:16:01 user nova-compute[72382]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 15:16:01 user nova-compute[72382]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 15:16:01 user nova-compute[72382]:     <timer name="hpet" present="no"/>
Aug 09 15:16:01 user nova-compute[72382]:   </clock>
Aug 09 15:16:01 user nova-compute[72382]:   <cpu mode="custom" match="exact">
Aug 09 15:16:01 user nova-compute[72382]:     <model>Nehalem</model>
Aug 09 15:16:01 user nova-compute[72382]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 15:16:01 user nova-compute[72382]:   </cpu>
Aug 09 15:16:01 user nova-compute[72382]:   <devices>
Aug 09 15:16:01 user nova-compute[72382]:     <disk type="file" device="disk">
Aug 09 15:16:01 user nova-compute[72382]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 15:16:01 user nova-compute[72382]:       <source file="/opt/stack/data/nova/instances/9a82f146-97ce-4319-8b25-c1b090965e53/disk"/>
Aug 09 15:16:01 user nova-compute[72382]:       <target dev="vda" bus="virtio"/>
Aug 09 15:16:01 user nova-compute[72382]:     </disk>
Aug 09 15:16:01 user nova-compute[72382]:     <interface type="ethernet">
Aug 09 15:16:01 user nova-compute[72382]:       <mac address="fa:16:3e:71:e7:dc"/>
Aug 09 15:16:01 user nova-compute[72382]:       <model type="virtio"/>
Aug 09 15:16:01 user nova-compute[72382]:       <mtu size="1442"/>
Aug 09 15:16:01 user nova-compute[72382]:       <target dev="tap759df480-ca"/>
Aug 09 15:16:01 user nova-compute[72382]:     </interface>
Aug 09 15:16:01 user nova-compute[72382]:     <serial type="pty">
Aug 09 15:16:01 user nova-compute[72382]:       <log file="/opt/stack/data/nova/instances/9a82f146-97ce-4319-8b25-c1b090965e53/console.log" append="off"/>
Aug 09 15:16:01 user nova-compute[72382]:     </serial>
Aug 09 15:16:01 user nova-compute[72382]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 15:16:01 user nova-compute[72382]:     <video>
Aug 09 15:16:01 user nova-compute[72382]:       <model type="virtio"/>
Aug 09 15:16:01 user nova-compute[72382]:     </video>
Aug 09 15:16:01 user nova-compute[72382]:     <rng model="virtio">
Aug 09 15:16:01 user nova-compute[72382]:       <backend model="random">/dev/urandom</backend>
Aug 09 15:16:01 user nova-compute[72382]:     </rng>
Aug 09 15:16:01 user nova-compute[72382]:     <controller type="usb" index="0" model="none"/>
Aug 09 15:16:01 user nova-compute[72382]:     <memballoon model="virtio">
Aug 09 15:16:01 user nova-compute[72382]:       <stats period="10"/>
Aug 09 15:16:01 user nova-compute[72382]:     </memballoon>
Aug 09 15:16:01 user nova-compute[72382]:   </devices>
Aug 09 15:16:01 user nova-compute[72382]: </domain>
Aug 09 15:16:01 user nova-compute[72382]:  {{(pid=72382) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 15:16:01 user nova-compute[72382]: DEBUG nova.virt.libvirt.vif [None req-be32bc62-bc81-44aa-9f55-4b650c885f9a tempest-TestVolumeSwap-583684665 tempest-TestVolumeSwap-583684665-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T15:15:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-2136349497',display_name='tempest-TestVolumeSwap-server-2136349497',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-2136349497',id=10,image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD4INTzqOUtJmSnJh1Eoc/6VL/ZJB2d4TtStHNFM3qdUiRDBv80UJ34Z9r/gBzURcH3+ZKqKuJ+1FmnlRe71prsqTjLuJRRRfoqNwXqe198BrDYu8rL10eFUe3DXcyiaKg==',key_name='tempest-keypair-1234113342',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d83791b742c0403ab043a6a41c81042e',ramdisk_id='',reservation_id='r-xhefoujb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-583684665',owner_user_name='tempest-TestVolumeSwap-583684665-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T15:15:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='02c5e77225644b918b4c675aad3b946b',uuid=9a82f146-97ce-4319-8b25-c1b090965e53,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "759df480-caa9-4610-893d-3784aaddf4b3", "address": "fa:16:3e:71:e7:dc", "network": {"id": "1cf9bb6d-ae38-4dd6-bd50-c20ff14c5ae6", "bridge": "br-int", "label": "tempest-TestVolumeSwap-488911533-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d83791b742c0403ab043a6a41c81042e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap759df480-ca", "ovs_interfaceid": "759df480-caa9-4610-893d-3784aaddf4b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 15:16:01 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-be32bc62-bc81-44aa-9f55-4b650c885f9a tempest-TestVolumeSwap-583684665 tempest-TestVolumeSwap-583684665-project-member] Converting VIF {"id": "759df480-caa9-4610-893d-3784aaddf4b3", "address": "fa:16:3e:71:e7:dc", "network": {"id": "1cf9bb6d-ae38-4dd6-bd50-c20ff14c5ae6", "bridge": "br-int", "label": "tempest-TestVolumeSwap-488911533-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d83791b742c0403ab043a6a41c81042e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap759df480-ca", "ovs_interfaceid": "759df480-caa9-4610-893d-3784aaddf4b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 15:16:01 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-be32bc62-bc81-44aa-9f55-4b650c885f9a tempest-TestVolumeSwap-583684665 tempest-TestVolumeSwap-583684665-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:71:e7:dc,bridge_name='br-int',has_traffic_filtering=True,id=759df480-caa9-4610-893d-3784aaddf4b3,network=Network(1cf9bb6d-ae38-4dd6-bd50-c20ff14c5ae6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap759df480-ca') {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 15:16:01 user nova-compute[72382]: DEBUG os_vif [None req-be32bc62-bc81-44aa-9f55-4b650c885f9a tempest-TestVolumeSwap-583684665 tempest-TestVolumeSwap-583684665-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:71:e7:dc,bridge_name='br-int',has_traffic_filtering=True,id=759df480-caa9-4610-893d-3784aaddf4b3,network=Network(1cf9bb6d-ae38-4dd6-bd50-c20ff14c5ae6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap759df480-ca') {{(pid=72382) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 15:16:01 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:16:01 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:16:01 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 15:16:01 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:16:01 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap759df480-ca, may_exist=True, interface_attrs={}) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:16:01 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap759df480-ca, col_values=(('external_ids', {'iface-id': '759df480-caa9-4610-893d-3784aaddf4b3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:71:e7:dc', 'vm-uuid': '9a82f146-97ce-4319-8b25-c1b090965e53'}),), if_exists=True) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:16:01 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:16:01 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:16:01 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:16:01 user nova-compute[72382]: INFO os_vif [None req-be32bc62-bc81-44aa-9f55-4b650c885f9a tempest-TestVolumeSwap-583684665 tempest-TestVolumeSwap-583684665-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:71:e7:dc,bridge_name='br-int',has_traffic_filtering=True,id=759df480-caa9-4610-893d-3784aaddf4b3,network=Network(1cf9bb6d-ae38-4dd6-bd50-c20ff14c5ae6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap759df480-ca')
Aug 09 15:16:01 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-be32bc62-bc81-44aa-9f55-4b650c885f9a tempest-TestVolumeSwap-583684665 tempest-TestVolumeSwap-583684665-project-member] No BDM found with device name vda, not building metadata. {{(pid=72382) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 15:16:01 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-be32bc62-bc81-44aa-9f55-4b650c885f9a tempest-TestVolumeSwap-583684665 tempest-TestVolumeSwap-583684665-project-member] No VIF found with MAC fa:16:3e:71:e7:dc, not building metadata {{(pid=72382) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 15:16:02 user nova-compute[72382]: DEBUG nova.network.neutron [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] [instance: f780040f-b789-4b72-8986-813c7b9fe4a6] Updating instance_info_cache with network_info: [{"id": "3c9b6983-5682-4eaa-866c-1baf9f2ede26", "address": "fa:16:3e:20:d4:ea", "network": {"id": "d47e3749-fdff-4112-bd72-69ca584efe1f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-302967634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "080d1ded4cd94e5083ee0b7e691b7363", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c9b6983-56", "ovs_interfaceid": "3c9b6983-5682-4eaa-866c-1baf9f2ede26", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:16:02 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Releasing lock "refresh_cache-f780040f-b789-4b72-8986-813c7b9fe4a6" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 15:16:02 user nova-compute[72382]: DEBUG nova.compute.manager [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] [instance: f780040f-b789-4b72-8986-813c7b9fe4a6] Updated the network info_cache for instance {{(pid=72382) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 15:16:02 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:16:02 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:16:02 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:16:02 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:16:02 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:16:02 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:16:02 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:16:02 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:16:02 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Auditing locally available compute resources for user (node: user) {{(pid=72382) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 15:16:02 user nova-compute[72382]: DEBUG nova.network.neutron [req-832f8265-9148-4988-8953-adb8bb824f3d req-697e21d5-b611-4caa-8f5d-c2022d958f91 service nova] [instance: 9a82f146-97ce-4319-8b25-c1b090965e53] Updated VIF entry in instance network info cache for port 759df480-caa9-4610-893d-3784aaddf4b3. {{(pid=72382) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 15:16:02 user nova-compute[72382]: DEBUG nova.network.neutron [req-832f8265-9148-4988-8953-adb8bb824f3d req-697e21d5-b611-4caa-8f5d-c2022d958f91 service nova] [instance: 9a82f146-97ce-4319-8b25-c1b090965e53] Updating instance_info_cache with network_info: [{"id": "759df480-caa9-4610-893d-3784aaddf4b3", "address": "fa:16:3e:71:e7:dc", "network": {"id": "1cf9bb6d-ae38-4dd6-bd50-c20ff14c5ae6", "bridge": "br-int", "label": "tempest-TestVolumeSwap-488911533-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d83791b742c0403ab043a6a41c81042e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap759df480-ca", "ovs_interfaceid": "759df480-caa9-4610-893d-3784aaddf4b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:16:02 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-832f8265-9148-4988-8953-adb8bb824f3d req-697e21d5-b611-4caa-8f5d-c2022d958f91 service nova] Releasing lock "refresh_cache-9a82f146-97ce-4319-8b25-c1b090965e53" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 15:16:02 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:16:03 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:16:03 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:16:03 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:16:03 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:16:03 user nova-compute[72382]: DEBUG nova.compute.manager [req-3f4e4441-8610-4638-b252-a7b08034a9b7 req-44e416a1-e9d9-46b5-8f71-7ead9016a0d0 service nova] [instance: 9a82f146-97ce-4319-8b25-c1b090965e53] Received event network-vif-plugged-759df480-caa9-4610-893d-3784aaddf4b3 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:16:03 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-3f4e4441-8610-4638-b252-a7b08034a9b7 req-44e416a1-e9d9-46b5-8f71-7ead9016a0d0 service nova] Acquiring lock "9a82f146-97ce-4319-8b25-c1b090965e53-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:16:03 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-3f4e4441-8610-4638-b252-a7b08034a9b7 req-44e416a1-e9d9-46b5-8f71-7ead9016a0d0 service nova] Lock "9a82f146-97ce-4319-8b25-c1b090965e53-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:16:03 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-3f4e4441-8610-4638-b252-a7b08034a9b7 req-44e416a1-e9d9-46b5-8f71-7ead9016a0d0 service nova] Lock "9a82f146-97ce-4319-8b25-c1b090965e53-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:16:03 user nova-compute[72382]: DEBUG nova.compute.manager [req-3f4e4441-8610-4638-b252-a7b08034a9b7 req-44e416a1-e9d9-46b5-8f71-7ead9016a0d0 service nova] [instance: 9a82f146-97ce-4319-8b25-c1b090965e53] No waiting events found dispatching network-vif-plugged-759df480-caa9-4610-893d-3784aaddf4b3 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:16:03 user nova-compute[72382]: WARNING nova.compute.manager [req-3f4e4441-8610-4638-b252-a7b08034a9b7 req-44e416a1-e9d9-46b5-8f71-7ead9016a0d0 service nova] [instance: 9a82f146-97ce-4319-8b25-c1b090965e53] Received unexpected event network-vif-plugged-759df480-caa9-4610-893d-3784aaddf4b3 for instance with vm_state building and task_state spawning.
Aug 09 15:16:04 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f780040f-b789-4b72-8986-813c7b9fe4a6/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:16:04 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:16:04 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f780040f-b789-4b72-8986-813c7b9fe4a6/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:16:04 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f780040f-b789-4b72-8986-813c7b9fe4a6/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:16:04 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f780040f-b789-4b72-8986-813c7b9fe4a6/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:16:04 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/266be814-4a2b-4f8e-a0f6-e8821fdeb95d/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:16:04 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/266be814-4a2b-4f8e-a0f6-e8821fdeb95d/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:16:04 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/266be814-4a2b-4f8e-a0f6-e8821fdeb95d/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:16:05 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/266be814-4a2b-4f8e-a0f6-e8821fdeb95d/disk --force-share --output=json" returned: 0 in 0.250s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:16:05 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a33515b3-3ef4-4f76-a8d8-e7008b5bbb79/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:16:05 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a33515b3-3ef4-4f76-a8d8-e7008b5bbb79/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:16:05 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a33515b3-3ef4-4f76-a8d8-e7008b5bbb79/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:16:05 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a33515b3-3ef4-4f76-a8d8-e7008b5bbb79/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:16:05 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/777e49ea-b674-4c3f-9cdd-ac2113032632/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:16:05 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/777e49ea-b674-4c3f-9cdd-ac2113032632/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:16:05 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/777e49ea-b674-4c3f-9cdd-ac2113032632/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:16:05 user nova-compute[72382]: DEBUG nova.compute.manager [req-1c09a530-a71e-4216-91aa-8b282516c84f req-6c4ac64c-f80b-46fc-b18d-7e82440597c7 service nova] [instance: 9a82f146-97ce-4319-8b25-c1b090965e53] Received event network-vif-plugged-759df480-caa9-4610-893d-3784aaddf4b3 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:16:05 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-1c09a530-a71e-4216-91aa-8b282516c84f req-6c4ac64c-f80b-46fc-b18d-7e82440597c7 service nova] Acquiring lock "9a82f146-97ce-4319-8b25-c1b090965e53-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:16:05 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-1c09a530-a71e-4216-91aa-8b282516c84f req-6c4ac64c-f80b-46fc-b18d-7e82440597c7 service nova] Lock "9a82f146-97ce-4319-8b25-c1b090965e53-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:16:05 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-1c09a530-a71e-4216-91aa-8b282516c84f req-6c4ac64c-f80b-46fc-b18d-7e82440597c7 service nova] Lock "9a82f146-97ce-4319-8b25-c1b090965e53-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:16:05 user nova-compute[72382]: DEBUG nova.compute.manager [req-1c09a530-a71e-4216-91aa-8b282516c84f req-6c4ac64c-f80b-46fc-b18d-7e82440597c7 service nova] [instance: 9a82f146-97ce-4319-8b25-c1b090965e53] No waiting events found dispatching network-vif-plugged-759df480-caa9-4610-893d-3784aaddf4b3 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:16:05 user nova-compute[72382]: WARNING nova.compute.manager [req-1c09a530-a71e-4216-91aa-8b282516c84f req-6c4ac64c-f80b-46fc-b18d-7e82440597c7 service nova] [instance: 9a82f146-97ce-4319-8b25-c1b090965e53] Received unexpected event network-vif-plugged-759df480-caa9-4610-893d-3784aaddf4b3 for instance with vm_state building and task_state spawning.
Aug 09 15:16:06 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/777e49ea-b674-4c3f-9cdd-ac2113032632/disk --force-share --output=json" returned: 0 in 0.247s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:16:06 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44afd1bf-fa5c-4b3e-8752-b16853fef54e/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:16:06 user nova-compute[72382]: DEBUG nova.virt.driver [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Emitting event <LifecycleEvent: 1691594166.3422678, 9a82f146-97ce-4319-8b25-c1b090965e53 => Resumed> {{(pid=72382) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 15:16:06 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 9a82f146-97ce-4319-8b25-c1b090965e53] VM Resumed (Lifecycle Event)
Aug 09 15:16:06 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:16:06 user nova-compute[72382]: DEBUG nova.compute.manager [None req-be32bc62-bc81-44aa-9f55-4b650c885f9a tempest-TestVolumeSwap-583684665 tempest-TestVolumeSwap-583684665-project-member] [instance: 9a82f146-97ce-4319-8b25-c1b090965e53] Instance event wait completed in 0 seconds for  {{(pid=72382) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 15:16:06 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-be32bc62-bc81-44aa-9f55-4b650c885f9a tempest-TestVolumeSwap-583684665 tempest-TestVolumeSwap-583684665-project-member] [instance: 9a82f146-97ce-4319-8b25-c1b090965e53] Guest created on hypervisor {{(pid=72382) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 15:16:06 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44afd1bf-fa5c-4b3e-8752-b16853fef54e/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:16:06 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44afd1bf-fa5c-4b3e-8752-b16853fef54e/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:16:06 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 9a82f146-97ce-4319-8b25-c1b090965e53] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:16:06 user nova-compute[72382]: INFO nova.virt.libvirt.driver [-] [instance: 9a82f146-97ce-4319-8b25-c1b090965e53] Instance spawned successfully.
Aug 09 15:16:06 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-be32bc62-bc81-44aa-9f55-4b650c885f9a tempest-TestVolumeSwap-583684665 tempest-TestVolumeSwap-583684665-project-member] [instance: 9a82f146-97ce-4319-8b25-c1b090965e53] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 15:16:06 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 9a82f146-97ce-4319-8b25-c1b090965e53] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72382) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 15:16:06 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-be32bc62-bc81-44aa-9f55-4b650c885f9a tempest-TestVolumeSwap-583684665 tempest-TestVolumeSwap-583684665-project-member] [instance: 9a82f146-97ce-4319-8b25-c1b090965e53] Found default for hw_cdrom_bus of ide {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:16:06 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-be32bc62-bc81-44aa-9f55-4b650c885f9a tempest-TestVolumeSwap-583684665 tempest-TestVolumeSwap-583684665-project-member] [instance: 9a82f146-97ce-4319-8b25-c1b090965e53] Found default for hw_disk_bus of virtio {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:16:06 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-be32bc62-bc81-44aa-9f55-4b650c885f9a tempest-TestVolumeSwap-583684665 tempest-TestVolumeSwap-583684665-project-member] [instance: 9a82f146-97ce-4319-8b25-c1b090965e53] Found default for hw_input_bus of None {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:16:06 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-be32bc62-bc81-44aa-9f55-4b650c885f9a tempest-TestVolumeSwap-583684665 tempest-TestVolumeSwap-583684665-project-member] [instance: 9a82f146-97ce-4319-8b25-c1b090965e53] Found default for hw_pointer_model of None {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:16:06 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-be32bc62-bc81-44aa-9f55-4b650c885f9a tempest-TestVolumeSwap-583684665 tempest-TestVolumeSwap-583684665-project-member] [instance: 9a82f146-97ce-4319-8b25-c1b090965e53] Found default for hw_video_model of virtio {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:16:06 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-be32bc62-bc81-44aa-9f55-4b650c885f9a tempest-TestVolumeSwap-583684665 tempest-TestVolumeSwap-583684665-project-member] [instance: 9a82f146-97ce-4319-8b25-c1b090965e53] Found default for hw_vif_model of virtio {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:16:06 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 9a82f146-97ce-4319-8b25-c1b090965e53] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 15:16:06 user nova-compute[72382]: DEBUG nova.virt.driver [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Emitting event <LifecycleEvent: 1691594166.3467455, 9a82f146-97ce-4319-8b25-c1b090965e53 => Started> {{(pid=72382) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 15:16:06 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 9a82f146-97ce-4319-8b25-c1b090965e53] VM Started (Lifecycle Event)
Aug 09 15:16:06 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 9a82f146-97ce-4319-8b25-c1b090965e53] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:16:06 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44afd1bf-fa5c-4b3e-8752-b16853fef54e/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:16:06 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0a7fa25-4520-4f40-9515-b88e3d2fd910/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:16:06 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 9a82f146-97ce-4319-8b25-c1b090965e53] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72382) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 15:16:06 user nova-compute[72382]: INFO nova.compute.manager [None req-be32bc62-bc81-44aa-9f55-4b650c885f9a tempest-TestVolumeSwap-583684665 tempest-TestVolumeSwap-583684665-project-member] [instance: 9a82f146-97ce-4319-8b25-c1b090965e53] Took 11.21 seconds to spawn the instance on the hypervisor.
Aug 09 15:16:06 user nova-compute[72382]: DEBUG nova.compute.manager [None req-be32bc62-bc81-44aa-9f55-4b650c885f9a tempest-TestVolumeSwap-583684665 tempest-TestVolumeSwap-583684665-project-member] [instance: 9a82f146-97ce-4319-8b25-c1b090965e53] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:16:06 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 9a82f146-97ce-4319-8b25-c1b090965e53] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 15:16:06 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0a7fa25-4520-4f40-9515-b88e3d2fd910/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:16:06 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0a7fa25-4520-4f40-9515-b88e3d2fd910/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:16:06 user nova-compute[72382]: INFO nova.compute.manager [None req-be32bc62-bc81-44aa-9f55-4b650c885f9a tempest-TestVolumeSwap-583684665 tempest-TestVolumeSwap-583684665-project-member] [instance: 9a82f146-97ce-4319-8b25-c1b090965e53] Took 12.31 seconds to build instance.
Aug 09 15:16:06 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-be32bc62-bc81-44aa-9f55-4b650c885f9a tempest-TestVolumeSwap-583684665 tempest-TestVolumeSwap-583684665-project-member] Lock "9a82f146-97ce-4319-8b25-c1b090965e53" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.484s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:16:06 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0a7fa25-4520-4f40-9515-b88e3d2fd910/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:16:06 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24b63f7a-be32-424b-b72c-d5bec43c408e/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:16:07 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24b63f7a-be32-424b-b72c-d5bec43c408e/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:16:07 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24b63f7a-be32-424b-b72c-d5bec43c408e/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:16:07 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24b63f7a-be32-424b-b72c-d5bec43c408e/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:16:07 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a82f146-97ce-4319-8b25-c1b090965e53/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:16:07 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a82f146-97ce-4319-8b25-c1b090965e53/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:16:07 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a82f146-97ce-4319-8b25-c1b090965e53/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:16:07 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a82f146-97ce-4319-8b25-c1b090965e53/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:16:07 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9766433-4c5a-40ed-a212-715a24f42b91/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:16:07 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9766433-4c5a-40ed-a212-715a24f42b91/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:16:07 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9766433-4c5a-40ed-a212-715a24f42b91/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:16:08 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9766433-4c5a-40ed-a212-715a24f42b91/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:16:08 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23f25946-de3a-43fb-97a4-1f9a787e6e51/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:16:08 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23f25946-de3a-43fb-97a4-1f9a787e6e51/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:16:08 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23f25946-de3a-43fb-97a4-1f9a787e6e51/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:16:08 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23f25946-de3a-43fb-97a4-1f9a787e6e51/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:16:09 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:16:09 user nova-compute[72382]: WARNING nova.virt.libvirt.driver [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 15:16:09 user nova-compute[72382]: WARNING nova.virt.libvirt.driver [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 15:16:09 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Hypervisor/Node resource view: name=user free_ram=7310MB free_disk=25.904808044433594GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72382) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 15:16:09 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:16:09 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:16:09 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance f780040f-b789-4b72-8986-813c7b9fe4a6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:16:09 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance 777e49ea-b674-4c3f-9cdd-ac2113032632 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:16:09 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance 44afd1bf-fa5c-4b3e-8752-b16853fef54e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:16:09 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance 266be814-4a2b-4f8e-a0f6-e8821fdeb95d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:16:09 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance c9766433-4c5a-40ed-a212-715a24f42b91 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:16:09 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance 24b63f7a-be32-424b-b72c-d5bec43c408e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:16:09 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance f0a7fa25-4520-4f40-9515-b88e3d2fd910 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:16:09 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance a33515b3-3ef4-4f76-a8d8-e7008b5bbb79 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:16:09 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance 23f25946-de3a-43fb-97a4-1f9a787e6e51 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:16:09 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance 9a82f146-97ce-4319-8b25-c1b090965e53 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:16:09 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=72382) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 15:16:09 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=72382) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 15:16:09 user nova-compute[72382]: DEBUG nova.scheduler.client.report [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Refreshing inventories for resource provider 7b15b0e5-df4d-49db-833b-2855d21d10ae {{(pid=72382) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 09 15:16:09 user nova-compute[72382]: DEBUG nova.scheduler.client.report [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Updating ProviderTree inventory for provider 7b15b0e5-df4d-49db-833b-2855d21d10ae from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72382) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 09 15:16:09 user nova-compute[72382]: DEBUG nova.compute.provider_tree [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Updating inventory in ProviderTree for provider 7b15b0e5-df4d-49db-833b-2855d21d10ae with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72382) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 09 15:16:09 user nova-compute[72382]: DEBUG nova.scheduler.client.report [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Refreshing aggregate associations for resource provider 7b15b0e5-df4d-49db-833b-2855d21d10ae, aggregates: None {{(pid=72382) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 09 15:16:10 user nova-compute[72382]: DEBUG nova.scheduler.client.report [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Refreshing trait associations for resource provider 7b15b0e5-df4d-49db-833b-2855d21d10ae, traits: COMPUTE_DEVICE_TAGGING,COMPUTE_NODE,COMPUTE_VOLUME_EXTEND,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE42,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_MMX,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE2 {{(pid=72382) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 09 15:16:10 user nova-compute[72382]: DEBUG nova.compute.provider_tree [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Inventory has not changed in ProviderTree for provider: 7b15b0e5-df4d-49db-833b-2855d21d10ae {{(pid=72382) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 15:16:10 user nova-compute[72382]: DEBUG nova.scheduler.client.report [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Inventory has not changed for provider 7b15b0e5-df4d-49db-833b-2855d21d10ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72382) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 15:16:10 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Compute_service record updated for user:user {{(pid=72382) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 15:16:10 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.242s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:16:11 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:16:11 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:16:11 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:16:11 user nova-compute[72382]: DEBUG nova.compute.manager [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72382) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 15:16:11 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:16:11 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:16:13 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:16:16 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:16:16 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-498a02fa-b7d5-408d-8a46-37de167b0b77 tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] Acquiring lock "b5aa7e23-9c2c-400e-a615-5839858749e1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:16:16 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-498a02fa-b7d5-408d-8a46-37de167b0b77 tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] Lock "b5aa7e23-9c2c-400e-a615-5839858749e1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:16:16 user nova-compute[72382]: DEBUG nova.compute.manager [None req-498a02fa-b7d5-408d-8a46-37de167b0b77 tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] [instance: b5aa7e23-9c2c-400e-a615-5839858749e1] Starting instance... {{(pid=72382) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 15:16:16 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-498a02fa-b7d5-408d-8a46-37de167b0b77 tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:16:16 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-498a02fa-b7d5-408d-8a46-37de167b0b77 tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:16:16 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-498a02fa-b7d5-408d-8a46-37de167b0b77 tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72382) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 15:16:16 user nova-compute[72382]: INFO nova.compute.claims [None req-498a02fa-b7d5-408d-8a46-37de167b0b77 tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] [instance: b5aa7e23-9c2c-400e-a615-5839858749e1] Claim successful on node user
Aug 09 15:16:16 user nova-compute[72382]: DEBUG nova.compute.provider_tree [None req-498a02fa-b7d5-408d-8a46-37de167b0b77 tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] Inventory has not changed in ProviderTree for provider: 7b15b0e5-df4d-49db-833b-2855d21d10ae {{(pid=72382) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 15:16:16 user nova-compute[72382]: DEBUG nova.scheduler.client.report [None req-498a02fa-b7d5-408d-8a46-37de167b0b77 tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] Inventory has not changed for provider 7b15b0e5-df4d-49db-833b-2855d21d10ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72382) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 15:16:16 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-498a02fa-b7d5-408d-8a46-37de167b0b77 tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.431s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:16:16 user nova-compute[72382]: DEBUG nova.compute.manager [None req-498a02fa-b7d5-408d-8a46-37de167b0b77 tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] [instance: b5aa7e23-9c2c-400e-a615-5839858749e1] Start building networks asynchronously for instance. {{(pid=72382) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 15:16:17 user nova-compute[72382]: DEBUG nova.compute.manager [None req-498a02fa-b7d5-408d-8a46-37de167b0b77 tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] [instance: b5aa7e23-9c2c-400e-a615-5839858749e1] Allocating IP information in the background. {{(pid=72382) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 15:16:17 user nova-compute[72382]: DEBUG nova.network.neutron [None req-498a02fa-b7d5-408d-8a46-37de167b0b77 tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] [instance: b5aa7e23-9c2c-400e-a615-5839858749e1] allocate_for_instance() {{(pid=72382) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 15:16:17 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-498a02fa-b7d5-408d-8a46-37de167b0b77 tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] [instance: b5aa7e23-9c2c-400e-a615-5839858749e1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 15:16:17 user nova-compute[72382]: DEBUG nova.compute.manager [None req-498a02fa-b7d5-408d-8a46-37de167b0b77 tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] [instance: b5aa7e23-9c2c-400e-a615-5839858749e1] Start building block device mappings for instance. {{(pid=72382) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 15:16:17 user nova-compute[72382]: DEBUG nova.compute.manager [None req-498a02fa-b7d5-408d-8a46-37de167b0b77 tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] [instance: b5aa7e23-9c2c-400e-a615-5839858749e1] Start spawning the instance on the hypervisor. {{(pid=72382) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 15:16:17 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-498a02fa-b7d5-408d-8a46-37de167b0b77 tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] [instance: b5aa7e23-9c2c-400e-a615-5839858749e1] Creating instance directory {{(pid=72382) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 15:16:17 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-498a02fa-b7d5-408d-8a46-37de167b0b77 tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] [instance: b5aa7e23-9c2c-400e-a615-5839858749e1] Creating image(s)
Aug 09 15:16:17 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-498a02fa-b7d5-408d-8a46-37de167b0b77 tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] Acquiring lock "/opt/stack/data/nova/instances/b5aa7e23-9c2c-400e-a615-5839858749e1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:16:17 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-498a02fa-b7d5-408d-8a46-37de167b0b77 tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] Lock "/opt/stack/data/nova/instances/b5aa7e23-9c2c-400e-a615-5839858749e1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:16:17 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-498a02fa-b7d5-408d-8a46-37de167b0b77 tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] Lock "/opt/stack/data/nova/instances/b5aa7e23-9c2c-400e-a615-5839858749e1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:16:17 user nova-compute[72382]: DEBUG nova.policy [None req-498a02fa-b7d5-408d-8a46-37de167b0b77 tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '47749ad054ff438cb0f79e0aba2514f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d70953bf0414fc8b87d85c5bd77ecaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72382) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 15:16:17 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-498a02fa-b7d5-408d-8a46-37de167b0b77 tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:16:17 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-498a02fa-b7d5-408d-8a46-37de167b0b77 tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b --force-share --output=json" returned: 0 in 0.129s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:16:17 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-498a02fa-b7d5-408d-8a46-37de167b0b77 tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] Acquiring lock "383812ff437283e0191ed5b9ecc04c27f1162b0b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:16:17 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-498a02fa-b7d5-408d-8a46-37de167b0b77 tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] Lock "383812ff437283e0191ed5b9ecc04c27f1162b0b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:16:17 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-498a02fa-b7d5-408d-8a46-37de167b0b77 tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:16:17 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-498a02fa-b7d5-408d-8a46-37de167b0b77 tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b --force-share --output=json" returned: 0 in 0.131s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:16:17 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-498a02fa-b7d5-408d-8a46-37de167b0b77 tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b,backing_fmt=raw /opt/stack/data/nova/instances/b5aa7e23-9c2c-400e-a615-5839858749e1/disk 1073741824 {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:16:17 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-498a02fa-b7d5-408d-8a46-37de167b0b77 tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b,backing_fmt=raw /opt/stack/data/nova/instances/b5aa7e23-9c2c-400e-a615-5839858749e1/disk 1073741824" returned: 0 in 0.047s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:16:17 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-498a02fa-b7d5-408d-8a46-37de167b0b77 tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] Lock "383812ff437283e0191ed5b9ecc04c27f1162b0b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.183s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:16:17 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-498a02fa-b7d5-408d-8a46-37de167b0b77 tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:16:17 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-498a02fa-b7d5-408d-8a46-37de167b0b77 tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b --force-share --output=json" returned: 0 in 0.185s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:16:17 user nova-compute[72382]: DEBUG nova.virt.disk.api [None req-498a02fa-b7d5-408d-8a46-37de167b0b77 tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b5aa7e23-9c2c-400e-a615-5839858749e1/disk. size=1073741824 {{(pid=72382) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 15:16:17 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-498a02fa-b7d5-408d-8a46-37de167b0b77 tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5aa7e23-9c2c-400e-a615-5839858749e1/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:16:17 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-498a02fa-b7d5-408d-8a46-37de167b0b77 tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5aa7e23-9c2c-400e-a615-5839858749e1/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:16:17 user nova-compute[72382]: DEBUG nova.virt.disk.api [None req-498a02fa-b7d5-408d-8a46-37de167b0b77 tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] Cannot resize image /opt/stack/data/nova/instances/b5aa7e23-9c2c-400e-a615-5839858749e1/disk to a smaller size. {{(pid=72382) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 15:16:17 user nova-compute[72382]: DEBUG nova.objects.instance [None req-498a02fa-b7d5-408d-8a46-37de167b0b77 tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] Lazy-loading 'migration_context' on Instance uuid b5aa7e23-9c2c-400e-a615-5839858749e1 {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:16:17 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-498a02fa-b7d5-408d-8a46-37de167b0b77 tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] [instance: b5aa7e23-9c2c-400e-a615-5839858749e1] Created local disks {{(pid=72382) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 15:16:17 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-498a02fa-b7d5-408d-8a46-37de167b0b77 tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] [instance: b5aa7e23-9c2c-400e-a615-5839858749e1] Ensure instance console log exists: /opt/stack/data/nova/instances/b5aa7e23-9c2c-400e-a615-5839858749e1/console.log {{(pid=72382) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 15:16:17 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-498a02fa-b7d5-408d-8a46-37de167b0b77 tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:16:17 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-498a02fa-b7d5-408d-8a46-37de167b0b77 tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:16:17 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-498a02fa-b7d5-408d-8a46-37de167b0b77 tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:16:18 user nova-compute[72382]: DEBUG nova.network.neutron [None req-498a02fa-b7d5-408d-8a46-37de167b0b77 tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] [instance: b5aa7e23-9c2c-400e-a615-5839858749e1] Successfully created port: 0d38f117-6eb0-4627-bc39-8bfd3ed800f6 {{(pid=72382) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 15:16:18 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:16:19 user nova-compute[72382]: DEBUG nova.network.neutron [None req-498a02fa-b7d5-408d-8a46-37de167b0b77 tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] [instance: b5aa7e23-9c2c-400e-a615-5839858749e1] Successfully updated port: 0d38f117-6eb0-4627-bc39-8bfd3ed800f6 {{(pid=72382) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 15:16:19 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-498a02fa-b7d5-408d-8a46-37de167b0b77 tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] Acquiring lock "refresh_cache-b5aa7e23-9c2c-400e-a615-5839858749e1" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 15:16:19 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-498a02fa-b7d5-408d-8a46-37de167b0b77 tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] Acquired lock "refresh_cache-b5aa7e23-9c2c-400e-a615-5839858749e1" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 15:16:19 user nova-compute[72382]: DEBUG nova.network.neutron [None req-498a02fa-b7d5-408d-8a46-37de167b0b77 tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] [instance: b5aa7e23-9c2c-400e-a615-5839858749e1] Building network info cache for instance {{(pid=72382) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 15:16:19 user nova-compute[72382]: DEBUG nova.compute.manager [req-f4d19e81-880b-49bb-bad9-6eb781feff9f req-d7c732bc-5a78-4c18-8588-506bf9432ad3 service nova] [instance: b5aa7e23-9c2c-400e-a615-5839858749e1] Received event network-changed-0d38f117-6eb0-4627-bc39-8bfd3ed800f6 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:16:19 user nova-compute[72382]: DEBUG nova.compute.manager [req-f4d19e81-880b-49bb-bad9-6eb781feff9f req-d7c732bc-5a78-4c18-8588-506bf9432ad3 service nova] [instance: b5aa7e23-9c2c-400e-a615-5839858749e1] Refreshing instance network info cache due to event network-changed-0d38f117-6eb0-4627-bc39-8bfd3ed800f6. {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 15:16:19 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-f4d19e81-880b-49bb-bad9-6eb781feff9f req-d7c732bc-5a78-4c18-8588-506bf9432ad3 service nova] Acquiring lock "refresh_cache-b5aa7e23-9c2c-400e-a615-5839858749e1" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 15:16:19 user nova-compute[72382]: DEBUG nova.network.neutron [None req-498a02fa-b7d5-408d-8a46-37de167b0b77 tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] [instance: b5aa7e23-9c2c-400e-a615-5839858749e1] Instance cache missing network info. {{(pid=72382) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 15:16:19 user nova-compute[72382]: DEBUG nova.network.neutron [None req-498a02fa-b7d5-408d-8a46-37de167b0b77 tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] [instance: b5aa7e23-9c2c-400e-a615-5839858749e1] Updating instance_info_cache with network_info: [{"id": "0d38f117-6eb0-4627-bc39-8bfd3ed800f6", "address": "fa:16:3e:f1:64:50", "network": {"id": "0ea6f64f-105f-42c8-a5ad-56a358383e40", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1157085737-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d70953bf0414fc8b87d85c5bd77ecaa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d38f117-6e", "ovs_interfaceid": "0d38f117-6eb0-4627-bc39-8bfd3ed800f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:16:19 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-498a02fa-b7d5-408d-8a46-37de167b0b77 tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] Releasing lock "refresh_cache-b5aa7e23-9c2c-400e-a615-5839858749e1" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 15:16:19 user nova-compute[72382]: DEBUG nova.compute.manager [None req-498a02fa-b7d5-408d-8a46-37de167b0b77 tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] [instance: b5aa7e23-9c2c-400e-a615-5839858749e1] Instance network_info: |[{"id": "0d38f117-6eb0-4627-bc39-8bfd3ed800f6", "address": "fa:16:3e:f1:64:50", "network": {"id": "0ea6f64f-105f-42c8-a5ad-56a358383e40", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1157085737-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d70953bf0414fc8b87d85c5bd77ecaa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d38f117-6e", "ovs_interfaceid": "0d38f117-6eb0-4627-bc39-8bfd3ed800f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72382) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 15:16:19 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-f4d19e81-880b-49bb-bad9-6eb781feff9f req-d7c732bc-5a78-4c18-8588-506bf9432ad3 service nova] Acquired lock "refresh_cache-b5aa7e23-9c2c-400e-a615-5839858749e1" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 15:16:19 user nova-compute[72382]: DEBUG nova.network.neutron [req-f4d19e81-880b-49bb-bad9-6eb781feff9f req-d7c732bc-5a78-4c18-8588-506bf9432ad3 service nova] [instance: b5aa7e23-9c2c-400e-a615-5839858749e1] Refreshing network info cache for port 0d38f117-6eb0-4627-bc39-8bfd3ed800f6 {{(pid=72382) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 15:16:19 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-498a02fa-b7d5-408d-8a46-37de167b0b77 tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] [instance: b5aa7e23-9c2c-400e-a615-5839858749e1] Start _get_guest_xml network_info=[{"id": "0d38f117-6eb0-4627-bc39-8bfd3ed800f6", "address": "fa:16:3e:f1:64:50", "network": {"id": "0ea6f64f-105f-42c8-a5ad-56a358383e40", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1157085737-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d70953bf0414fc8b87d85c5bd77ecaa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d38f117-6e", "ovs_interfaceid": "0d38f117-6eb0-4627-bc39-8bfd3ed800f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T15:11:25Z,direct_url=<?>,disk_format='qcow2',id=a79f2cea-eb27-4631-aaf3-05e7d9e411b4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a638990e12cc4d6eabb6d55e13be6bdf',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T15:11:27Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'a79f2cea-eb27-4631-aaf3-05e7d9e411b4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72382) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 15:16:19 user nova-compute[72382]: WARNING nova.virt.libvirt.driver [None req-498a02fa-b7d5-408d-8a46-37de167b0b77 tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 15:16:19 user nova-compute[72382]: WARNING nova.virt.libvirt.driver [None req-498a02fa-b7d5-408d-8a46-37de167b0b77 tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 15:16:19 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-498a02fa-b7d5-408d-8a46-37de167b0b77 tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72382) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 15:16:19 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-498a02fa-b7d5-408d-8a46-37de167b0b77 tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] CPU controller missing on host. {{(pid=72382) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 15:16:19 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-498a02fa-b7d5-408d-8a46-37de167b0b77 tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72382) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 15:16:19 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-498a02fa-b7d5-408d-8a46-37de167b0b77 tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] CPU controller found on host. {{(pid=72382) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 15:16:19 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-498a02fa-b7d5-408d-8a46-37de167b0b77 tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72382) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 15:16:19 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-498a02fa-b7d5-408d-8a46-37de167b0b77 tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T15:11:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T15:11:25Z,direct_url=<?>,disk_format='qcow2',id=a79f2cea-eb27-4631-aaf3-05e7d9e411b4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a638990e12cc4d6eabb6d55e13be6bdf',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T15:11:27Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 15:16:19 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-498a02fa-b7d5-408d-8a46-37de167b0b77 tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] Flavor limits 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 15:16:19 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-498a02fa-b7d5-408d-8a46-37de167b0b77 tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] Image limits 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 15:16:19 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-498a02fa-b7d5-408d-8a46-37de167b0b77 tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] Flavor pref 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 15:16:19 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-498a02fa-b7d5-408d-8a46-37de167b0b77 tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] Image pref 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 15:16:19 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-498a02fa-b7d5-408d-8a46-37de167b0b77 tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 15:16:19 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-498a02fa-b7d5-408d-8a46-37de167b0b77 tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 15:16:19 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-498a02fa-b7d5-408d-8a46-37de167b0b77 tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72382) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 15:16:19 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-498a02fa-b7d5-408d-8a46-37de167b0b77 tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] Got 1 possible topologies {{(pid=72382) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 15:16:19 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-498a02fa-b7d5-408d-8a46-37de167b0b77 tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 15:16:19 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-498a02fa-b7d5-408d-8a46-37de167b0b77 tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 15:16:19 user nova-compute[72382]: DEBUG nova.virt.libvirt.vif [None req-498a02fa-b7d5-408d-8a46-37de167b0b77 tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T15:16:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-590083111',display_name='tempest-TestServerVolumeAttachmentScenario-server-590083111',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-590083111',id=11,image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEwtSZCden37QZKDU1Ca41L3AZIFkgcTBEJnqYjicj/EdFplA5cU6qTKVOxrPWHrLxHUSxk/YaAXSMZMn0qvDpx6pefUAYKkJbU0Qr2WgqBuqwI7YaastcprM/E7ETKeiQ==',key_name='tempest-keypair-1369877973',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0d70953bf0414fc8b87d85c5bd77ecaa',ramdisk_id='',reservation_id='r-usvhnkud',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-540197035',owner_user_name='tempest-TestServerVolumeAttachmentScenario-540197035-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T15:16:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='47749ad054ff438cb0f79e0aba2514f1',uuid=b5aa7e23-9c2c-400e-a615-5839858749e1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0d38f117-6eb0-4627-bc39-8bfd3ed800f6", "address": "fa:16:3e:f1:64:50", "network": {"id": "0ea6f64f-105f-42c8-a5ad-56a358383e40", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1157085737-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d70953bf0414fc8b87d85c5bd77ecaa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d38f117-6e", "ovs_interfaceid": "0d38f117-6eb0-4627-bc39-8bfd3ed800f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72382) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 15:16:19 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-498a02fa-b7d5-408d-8a46-37de167b0b77 tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] Converting VIF {"id": "0d38f117-6eb0-4627-bc39-8bfd3ed800f6", "address": "fa:16:3e:f1:64:50", "network": {"id": "0ea6f64f-105f-42c8-a5ad-56a358383e40", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1157085737-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d70953bf0414fc8b87d85c5bd77ecaa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d38f117-6e", "ovs_interfaceid": "0d38f117-6eb0-4627-bc39-8bfd3ed800f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 15:16:19 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-498a02fa-b7d5-408d-8a46-37de167b0b77 tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f1:64:50,bridge_name='br-int',has_traffic_filtering=True,id=0d38f117-6eb0-4627-bc39-8bfd3ed800f6,network=Network(0ea6f64f-105f-42c8-a5ad-56a358383e40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d38f117-6e') {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 15:16:19 user nova-compute[72382]: DEBUG nova.objects.instance [None req-498a02fa-b7d5-408d-8a46-37de167b0b77 tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] Lazy-loading 'pci_devices' on Instance uuid b5aa7e23-9c2c-400e-a615-5839858749e1 {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:16:19 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-498a02fa-b7d5-408d-8a46-37de167b0b77 tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] [instance: b5aa7e23-9c2c-400e-a615-5839858749e1] End _get_guest_xml xml=<domain type="kvm">
Aug 09 15:16:19 user nova-compute[72382]:   <uuid>b5aa7e23-9c2c-400e-a615-5839858749e1</uuid>
Aug 09 15:16:19 user nova-compute[72382]:   <name>instance-0000000b</name>
Aug 09 15:16:19 user nova-compute[72382]:   <memory>524288</memory>
Aug 09 15:16:19 user nova-compute[72382]:   <vcpu>1</vcpu>
Aug 09 15:16:19 user nova-compute[72382]:   <metadata>
Aug 09 15:16:19 user nova-compute[72382]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 15:16:19 user nova-compute[72382]:       <nova:package version="0.0.0"/>
Aug 09 15:16:19 user nova-compute[72382]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-590083111</nova:name>
Aug 09 15:16:19 user nova-compute[72382]:       <nova:creationTime>2023-08-09 15:16:19</nova:creationTime>
Aug 09 15:16:19 user nova-compute[72382]:       <nova:flavor name="m1.tiny">
Aug 09 15:16:19 user nova-compute[72382]:         <nova:memory>512</nova:memory>
Aug 09 15:16:19 user nova-compute[72382]:         <nova:disk>1</nova:disk>
Aug 09 15:16:19 user nova-compute[72382]:         <nova:swap>0</nova:swap>
Aug 09 15:16:19 user nova-compute[72382]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 15:16:19 user nova-compute[72382]:         <nova:vcpus>1</nova:vcpus>
Aug 09 15:16:19 user nova-compute[72382]:       </nova:flavor>
Aug 09 15:16:19 user nova-compute[72382]:       <nova:owner>
Aug 09 15:16:19 user nova-compute[72382]:         <nova:user uuid="47749ad054ff438cb0f79e0aba2514f1">tempest-TestServerVolumeAttachmentScenario-540197035-project-member</nova:user>
Aug 09 15:16:19 user nova-compute[72382]:         <nova:project uuid="0d70953bf0414fc8b87d85c5bd77ecaa">tempest-TestServerVolumeAttachmentScenario-540197035</nova:project>
Aug 09 15:16:19 user nova-compute[72382]:       </nova:owner>
Aug 09 15:16:19 user nova-compute[72382]:       <nova:root type="image" uuid="a79f2cea-eb27-4631-aaf3-05e7d9e411b4"/>
Aug 09 15:16:19 user nova-compute[72382]:       <nova:ports>
Aug 09 15:16:19 user nova-compute[72382]:         <nova:port uuid="0d38f117-6eb0-4627-bc39-8bfd3ed800f6">
Aug 09 15:16:19 user nova-compute[72382]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 09 15:16:19 user nova-compute[72382]:         </nova:port>
Aug 09 15:16:19 user nova-compute[72382]:       </nova:ports>
Aug 09 15:16:19 user nova-compute[72382]:     </nova:instance>
Aug 09 15:16:19 user nova-compute[72382]:   </metadata>
Aug 09 15:16:19 user nova-compute[72382]:   <sysinfo type="smbios">
Aug 09 15:16:19 user nova-compute[72382]:     <system>
Aug 09 15:16:19 user nova-compute[72382]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 15:16:19 user nova-compute[72382]:       <entry name="product">OpenStack Nova</entry>
Aug 09 15:16:19 user nova-compute[72382]:       <entry name="version">0.0.0</entry>
Aug 09 15:16:19 user nova-compute[72382]:       <entry name="serial">b5aa7e23-9c2c-400e-a615-5839858749e1</entry>
Aug 09 15:16:19 user nova-compute[72382]:       <entry name="uuid">b5aa7e23-9c2c-400e-a615-5839858749e1</entry>
Aug 09 15:16:19 user nova-compute[72382]:       <entry name="family">Virtual Machine</entry>
Aug 09 15:16:19 user nova-compute[72382]:     </system>
Aug 09 15:16:19 user nova-compute[72382]:   </sysinfo>
Aug 09 15:16:19 user nova-compute[72382]:   <os>
Aug 09 15:16:19 user nova-compute[72382]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 15:16:19 user nova-compute[72382]:     <boot dev="hd"/>
Aug 09 15:16:19 user nova-compute[72382]:     <smbios mode="sysinfo"/>
Aug 09 15:16:19 user nova-compute[72382]:   </os>
Aug 09 15:16:19 user nova-compute[72382]:   <features>
Aug 09 15:16:19 user nova-compute[72382]:     <acpi/>
Aug 09 15:16:19 user nova-compute[72382]:     <apic/>
Aug 09 15:16:19 user nova-compute[72382]:     <vmcoreinfo/>
Aug 09 15:16:19 user nova-compute[72382]:   </features>
Aug 09 15:16:19 user nova-compute[72382]:   <clock offset="utc">
Aug 09 15:16:19 user nova-compute[72382]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 15:16:19 user nova-compute[72382]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 15:16:19 user nova-compute[72382]:     <timer name="hpet" present="no"/>
Aug 09 15:16:19 user nova-compute[72382]:   </clock>
Aug 09 15:16:19 user nova-compute[72382]:   <cpu mode="custom" match="exact">
Aug 09 15:16:19 user nova-compute[72382]:     <model>Nehalem</model>
Aug 09 15:16:19 user nova-compute[72382]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 15:16:19 user nova-compute[72382]:   </cpu>
Aug 09 15:16:19 user nova-compute[72382]:   <devices>
Aug 09 15:16:19 user nova-compute[72382]:     <disk type="file" device="disk">
Aug 09 15:16:19 user nova-compute[72382]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 15:16:19 user nova-compute[72382]:       <source file="/opt/stack/data/nova/instances/b5aa7e23-9c2c-400e-a615-5839858749e1/disk"/>
Aug 09 15:16:19 user nova-compute[72382]:       <target dev="vda" bus="virtio"/>
Aug 09 15:16:19 user nova-compute[72382]:     </disk>
Aug 09 15:16:19 user nova-compute[72382]:     <interface type="ethernet">
Aug 09 15:16:19 user nova-compute[72382]:       <mac address="fa:16:3e:f1:64:50"/>
Aug 09 15:16:19 user nova-compute[72382]:       <model type="virtio"/>
Aug 09 15:16:19 user nova-compute[72382]:       <mtu size="1442"/>
Aug 09 15:16:19 user nova-compute[72382]:       <target dev="tap0d38f117-6e"/>
Aug 09 15:16:19 user nova-compute[72382]:     </interface>
Aug 09 15:16:19 user nova-compute[72382]:     <serial type="pty">
Aug 09 15:16:19 user nova-compute[72382]:       <log file="/opt/stack/data/nova/instances/b5aa7e23-9c2c-400e-a615-5839858749e1/console.log" append="off"/>
Aug 09 15:16:19 user nova-compute[72382]:     </serial>
Aug 09 15:16:19 user nova-compute[72382]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 15:16:19 user nova-compute[72382]:     <video>
Aug 09 15:16:19 user nova-compute[72382]:       <model type="virtio"/>
Aug 09 15:16:19 user nova-compute[72382]:     </video>
Aug 09 15:16:19 user nova-compute[72382]:     <rng model="virtio">
Aug 09 15:16:19 user nova-compute[72382]:       <backend model="random">/dev/urandom</backend>
Aug 09 15:16:19 user nova-compute[72382]:     </rng>
Aug 09 15:16:19 user nova-compute[72382]:     <controller type="usb" index="0" model="none"/>
Aug 09 15:16:19 user nova-compute[72382]:     <memballoon model="virtio">
Aug 09 15:16:19 user nova-compute[72382]:       <stats period="10"/>
Aug 09 15:16:19 user nova-compute[72382]:     </memballoon>
Aug 09 15:16:19 user nova-compute[72382]:   </devices>
Aug 09 15:16:19 user nova-compute[72382]: </domain>
Aug 09 15:16:19 user nova-compute[72382]:  {{(pid=72382) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 15:16:19 user nova-compute[72382]: DEBUG nova.virt.libvirt.vif [None req-498a02fa-b7d5-408d-8a46-37de167b0b77 tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T15:16:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-590083111',display_name='tempest-TestServerVolumeAttachmentScenario-server-590083111',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-590083111',id=11,image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEwtSZCden37QZKDU1Ca41L3AZIFkgcTBEJnqYjicj/EdFplA5cU6qTKVOxrPWHrLxHUSxk/YaAXSMZMn0qvDpx6pefUAYKkJbU0Qr2WgqBuqwI7YaastcprM/E7ETKeiQ==',key_name='tempest-keypair-1369877973',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0d70953bf0414fc8b87d85c5bd77ecaa',ramdisk_id='',reservation_id='r-usvhnkud',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-540197035',owner_user_name='tempest-TestServerVolumeAttachmentScenario-540197035-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T15:16:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='47749ad054ff438cb0f79e0aba2514f1',uuid=b5aa7e23-9c2c-400e-a615-5839858749e1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0d38f117-6eb0-4627-bc39-8bfd3ed800f6", "address": "fa:16:3e:f1:64:50", "network": {"id": "0ea6f64f-105f-42c8-a5ad-56a358383e40", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1157085737-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d70953bf0414fc8b87d85c5bd77ecaa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d38f117-6e", "ovs_interfaceid": "0d38f117-6eb0-4627-bc39-8bfd3ed800f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 15:16:19 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-498a02fa-b7d5-408d-8a46-37de167b0b77 tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] Converting VIF {"id": "0d38f117-6eb0-4627-bc39-8bfd3ed800f6", "address": "fa:16:3e:f1:64:50", "network": {"id": "0ea6f64f-105f-42c8-a5ad-56a358383e40", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1157085737-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d70953bf0414fc8b87d85c5bd77ecaa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d38f117-6e", "ovs_interfaceid": "0d38f117-6eb0-4627-bc39-8bfd3ed800f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 15:16:19 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-498a02fa-b7d5-408d-8a46-37de167b0b77 tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f1:64:50,bridge_name='br-int',has_traffic_filtering=True,id=0d38f117-6eb0-4627-bc39-8bfd3ed800f6,network=Network(0ea6f64f-105f-42c8-a5ad-56a358383e40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d38f117-6e') {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 15:16:19 user nova-compute[72382]: DEBUG os_vif [None req-498a02fa-b7d5-408d-8a46-37de167b0b77 tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:64:50,bridge_name='br-int',has_traffic_filtering=True,id=0d38f117-6eb0-4627-bc39-8bfd3ed800f6,network=Network(0ea6f64f-105f-42c8-a5ad-56a358383e40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d38f117-6e') {{(pid=72382) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 15:16:19 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:16:19 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:16:19 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 15:16:19 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:16:19 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0d38f117-6e, may_exist=True, interface_attrs={}) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:16:19 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0d38f117-6e, col_values=(('external_ids', {'iface-id': '0d38f117-6eb0-4627-bc39-8bfd3ed800f6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f1:64:50', 'vm-uuid': 'b5aa7e23-9c2c-400e-a615-5839858749e1'}),), if_exists=True) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:16:19 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:16:19 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:16:19 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:16:19 user nova-compute[72382]: INFO os_vif [None req-498a02fa-b7d5-408d-8a46-37de167b0b77 tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:64:50,bridge_name='br-int',has_traffic_filtering=True,id=0d38f117-6eb0-4627-bc39-8bfd3ed800f6,network=Network(0ea6f64f-105f-42c8-a5ad-56a358383e40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d38f117-6e')
Aug 09 15:16:19 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-498a02fa-b7d5-408d-8a46-37de167b0b77 tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] No BDM found with device name vda, not building metadata. {{(pid=72382) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 15:16:19 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-498a02fa-b7d5-408d-8a46-37de167b0b77 tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] No VIF found with MAC fa:16:3e:f1:64:50, not building metadata {{(pid=72382) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 15:16:20 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] Acquiring lock "f1b4f73b-7a9e-4cf1-9d51-f32284f49c53" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:16:20 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] Lock "f1b4f73b-7a9e-4cf1-9d51-f32284f49c53" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:16:20 user nova-compute[72382]: DEBUG nova.compute.manager [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] [instance: f1b4f73b-7a9e-4cf1-9d51-f32284f49c53] Starting instance... {{(pid=72382) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 15:16:20 user nova-compute[72382]: DEBUG nova.network.neutron [req-f4d19e81-880b-49bb-bad9-6eb781feff9f req-d7c732bc-5a78-4c18-8588-506bf9432ad3 service nova] [instance: b5aa7e23-9c2c-400e-a615-5839858749e1] Updated VIF entry in instance network info cache for port 0d38f117-6eb0-4627-bc39-8bfd3ed800f6. {{(pid=72382) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 15:16:20 user nova-compute[72382]: DEBUG nova.network.neutron [req-f4d19e81-880b-49bb-bad9-6eb781feff9f req-d7c732bc-5a78-4c18-8588-506bf9432ad3 service nova] [instance: b5aa7e23-9c2c-400e-a615-5839858749e1] Updating instance_info_cache with network_info: [{"id": "0d38f117-6eb0-4627-bc39-8bfd3ed800f6", "address": "fa:16:3e:f1:64:50", "network": {"id": "0ea6f64f-105f-42c8-a5ad-56a358383e40", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1157085737-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d70953bf0414fc8b87d85c5bd77ecaa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d38f117-6e", "ovs_interfaceid": "0d38f117-6eb0-4627-bc39-8bfd3ed800f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:16:20 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-f4d19e81-880b-49bb-bad9-6eb781feff9f req-d7c732bc-5a78-4c18-8588-506bf9432ad3 service nova] Releasing lock "refresh_cache-b5aa7e23-9c2c-400e-a615-5839858749e1" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 15:16:20 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:16:20 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:16:20 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72382) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 15:16:20 user nova-compute[72382]: INFO nova.compute.claims [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] [instance: f1b4f73b-7a9e-4cf1-9d51-f32284f49c53] Claim successful on node user
Aug 09 15:16:20 user nova-compute[72382]: DEBUG nova.compute.provider_tree [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] Inventory has not changed in ProviderTree for provider: 7b15b0e5-df4d-49db-833b-2855d21d10ae {{(pid=72382) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 15:16:20 user nova-compute[72382]: DEBUG nova.scheduler.client.report [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] Inventory has not changed for provider 7b15b0e5-df4d-49db-833b-2855d21d10ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72382) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 15:16:20 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.527s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:16:20 user nova-compute[72382]: DEBUG nova.compute.manager [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] [instance: f1b4f73b-7a9e-4cf1-9d51-f32284f49c53] Start building networks asynchronously for instance. {{(pid=72382) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 15:16:20 user nova-compute[72382]: DEBUG nova.compute.manager [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] [instance: f1b4f73b-7a9e-4cf1-9d51-f32284f49c53] Allocating IP information in the background. {{(pid=72382) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 15:16:20 user nova-compute[72382]: DEBUG nova.network.neutron [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] [instance: f1b4f73b-7a9e-4cf1-9d51-f32284f49c53] allocate_for_instance() {{(pid=72382) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 15:16:20 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] [instance: f1b4f73b-7a9e-4cf1-9d51-f32284f49c53] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 15:16:21 user nova-compute[72382]: DEBUG nova.compute.manager [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] [instance: f1b4f73b-7a9e-4cf1-9d51-f32284f49c53] Start building block device mappings for instance. {{(pid=72382) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 15:16:21 user nova-compute[72382]: INFO nova.virt.block_device [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] [instance: f1b4f73b-7a9e-4cf1-9d51-f32284f49c53] Booting with volume e2267629-52cf-439c-9083-3e8384c67f08 at /dev/vda
Aug 09 15:16:21 user nova-compute[72382]: DEBUG nova.policy [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4a14592e76e2409aa5baf44221d227a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7345242bf74a4b91a057182d9b5172c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72382) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 15:16:21 user nova-compute[72382]: DEBUG os_brick.utils [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 15:16:21 user nova-compute[72382]: INFO oslo.privsep.daemon [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmpe96sp10m/privsep.sock']
Aug 09 15:16:21 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:16:21 user sudo[83642]:    stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmpe96sp10m/privsep.sock
Aug 09 15:16:21 user sudo[83642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Aug 09 15:16:21 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:16:21 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:16:21 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:16:21 user nova-compute[72382]: DEBUG nova.compute.manager [req-83d82859-c3cd-434d-90d6-4a5abb33aeca req-ecdace60-ee6e-4e6d-934e-6b6064653a84 service nova] [instance: b5aa7e23-9c2c-400e-a615-5839858749e1] Received event network-vif-plugged-0d38f117-6eb0-4627-bc39-8bfd3ed800f6 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:16:21 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-83d82859-c3cd-434d-90d6-4a5abb33aeca req-ecdace60-ee6e-4e6d-934e-6b6064653a84 service nova] Acquiring lock "b5aa7e23-9c2c-400e-a615-5839858749e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:16:21 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-83d82859-c3cd-434d-90d6-4a5abb33aeca req-ecdace60-ee6e-4e6d-934e-6b6064653a84 service nova] Lock "b5aa7e23-9c2c-400e-a615-5839858749e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:16:21 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-83d82859-c3cd-434d-90d6-4a5abb33aeca req-ecdace60-ee6e-4e6d-934e-6b6064653a84 service nova] Lock "b5aa7e23-9c2c-400e-a615-5839858749e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:16:21 user nova-compute[72382]: DEBUG nova.compute.manager [req-83d82859-c3cd-434d-90d6-4a5abb33aeca req-ecdace60-ee6e-4e6d-934e-6b6064653a84 service nova] [instance: b5aa7e23-9c2c-400e-a615-5839858749e1] No waiting events found dispatching network-vif-plugged-0d38f117-6eb0-4627-bc39-8bfd3ed800f6 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:16:21 user nova-compute[72382]: WARNING nova.compute.manager [req-83d82859-c3cd-434d-90d6-4a5abb33aeca req-ecdace60-ee6e-4e6d-934e-6b6064653a84 service nova] [instance: b5aa7e23-9c2c-400e-a615-5839858749e1] Received unexpected event network-vif-plugged-0d38f117-6eb0-4627-bc39-8bfd3ed800f6 for instance with vm_state building and task_state spawning.
Aug 09 15:16:21 user nova-compute[72382]: DEBUG nova.network.neutron [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] [instance: f1b4f73b-7a9e-4cf1-9d51-f32284f49c53] Successfully created port: d031358f-2670-4942-9266-d9db448a078b {{(pid=72382) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 15:16:21 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:16:21 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:16:21 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:16:22 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:16:22 user nova-compute[72382]: DEBUG nova.network.neutron [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] [instance: f1b4f73b-7a9e-4cf1-9d51-f32284f49c53] Successfully created port: d96a280e-5aeb-4a7c-97da-431e5f42c7f6 {{(pid=72382) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 15:16:22 user nova-compute[72382]: DEBUG nova.network.neutron [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] [instance: f1b4f73b-7a9e-4cf1-9d51-f32284f49c53] Successfully created port: 92c19874-960c-4e03-8537-6ae44812a1da {{(pid=72382) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 15:16:23 user sudo[83642]: pam_unix(sudo:session): session closed for user root
Aug 09 15:16:23 user nova-compute[72382]: INFO oslo.privsep.daemon [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] Spawned new privsep daemon via rootwrap
Aug 09 15:16:23 user nova-compute[72382]: INFO oslo.privsep.daemon [-] privsep daemon starting
Aug 09 15:16:23 user nova-compute[72382]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Aug 09 15:16:23 user nova-compute[72382]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Aug 09 15:16:23 user nova-compute[72382]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 83725
Aug 09 15:16:23 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[e445508e-b6cf-43b5-8a2d-566941bbdaf0]: (2,) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:16:23 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:16:23 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:16:23 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[50cb788a-2b5b-443c-8a3c-9ffef4290540]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d2cfa7015fe\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:16:23 user nova-compute[72382]: WARNING os_brick.initiator.connectors.nvmeof [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Aug 09 15:16:23 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:16:23 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.023s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:16:23 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7868f61-eade-467d-aee5-d99184dfea63]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:16:23 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:16:23 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:16:23 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[5333b0c3-337a-41e0-ab99-324fa5f7972b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:16:23 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d2e2134-fcff-4352-bbc2-e416ec6a6747]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:16:23 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] Running cmd (subprocess): nvme version {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:16:23 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] 'nvme version' failed. Not Retrying. {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 15:16:23 user nova-compute[72382]: DEBUG nova.virt.driver [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Emitting event <LifecycleEvent: 1691594183.5163054, b5aa7e23-9c2c-400e-a615-5839858749e1 => Resumed> {{(pid=72382) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 15:16:23 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: b5aa7e23-9c2c-400e-a615-5839858749e1] VM Resumed (Lifecycle Event)
Aug 09 15:16:23 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] nvme not present on system {{(pid=72382) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 15:16:23 user nova-compute[72382]: DEBUG nova.compute.manager [None req-498a02fa-b7d5-408d-8a46-37de167b0b77 tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] [instance: b5aa7e23-9c2c-400e-a615-5839858749e1] Instance event wait completed in 0 seconds for  {{(pid=72382) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 15:16:23 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-498a02fa-b7d5-408d-8a46-37de167b0b77 tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] [instance: b5aa7e23-9c2c-400e-a615-5839858749e1] Guest created on hypervisor {{(pid=72382) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 15:16:23 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:16:23 user nova-compute[72382]: INFO nova.virt.libvirt.driver [-] [instance: b5aa7e23-9c2c-400e-a615-5839858749e1] Instance spawned successfully.
Aug 09 15:16:23 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-498a02fa-b7d5-408d-8a46-37de167b0b77 tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] [instance: b5aa7e23-9c2c-400e-a615-5839858749e1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 15:16:23 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 15:16:23 user nova-compute[72382]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 15:16:23 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6539236-8b53-4e3d-8a62-10f5faa5e3c7]: (4, '') {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:16:23 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.lightos [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72382) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 15:16:23 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.lightos [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72382) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 15:16:23 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.lightos [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] LIGHTOS: no hostnqn found. {{(pid=72382) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 15:16:23 user nova-compute[72382]: DEBUG os_brick.utils [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] <== get_connector_properties: return (2358ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d2cfa7015fe', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 15:16:23 user nova-compute[72382]: DEBUG nova.virt.block_device [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] [instance: f1b4f73b-7a9e-4cf1-9d51-f32284f49c53] Updating existing volume attachment record: fbd6c1ea-232c-4998-94cd-55277e57d786 {{(pid=72382) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 15:16:23 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: b5aa7e23-9c2c-400e-a615-5839858749e1] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:16:23 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: b5aa7e23-9c2c-400e-a615-5839858749e1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72382) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 15:16:23 user nova-compute[72382]: DEBUG nova.compute.manager [req-8a3cfac6-d7a5-4d2f-9053-e4de7f9f6467 req-a9e440d7-856d-4cfd-91ce-43b8e47904dc service nova] [instance: b5aa7e23-9c2c-400e-a615-5839858749e1] Received event network-vif-plugged-0d38f117-6eb0-4627-bc39-8bfd3ed800f6 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:16:23 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-8a3cfac6-d7a5-4d2f-9053-e4de7f9f6467 req-a9e440d7-856d-4cfd-91ce-43b8e47904dc service nova] Acquiring lock "b5aa7e23-9c2c-400e-a615-5839858749e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:16:23 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-8a3cfac6-d7a5-4d2f-9053-e4de7f9f6467 req-a9e440d7-856d-4cfd-91ce-43b8e47904dc service nova] Lock "b5aa7e23-9c2c-400e-a615-5839858749e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:16:23 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-8a3cfac6-d7a5-4d2f-9053-e4de7f9f6467 req-a9e440d7-856d-4cfd-91ce-43b8e47904dc service nova] Lock "b5aa7e23-9c2c-400e-a615-5839858749e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:16:23 user nova-compute[72382]: DEBUG nova.compute.manager [req-8a3cfac6-d7a5-4d2f-9053-e4de7f9f6467 req-a9e440d7-856d-4cfd-91ce-43b8e47904dc service nova] [instance: b5aa7e23-9c2c-400e-a615-5839858749e1] No waiting events found dispatching network-vif-plugged-0d38f117-6eb0-4627-bc39-8bfd3ed800f6 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:16:23 user nova-compute[72382]: WARNING nova.compute.manager [req-8a3cfac6-d7a5-4d2f-9053-e4de7f9f6467 req-a9e440d7-856d-4cfd-91ce-43b8e47904dc service nova] [instance: b5aa7e23-9c2c-400e-a615-5839858749e1] Received unexpected event network-vif-plugged-0d38f117-6eb0-4627-bc39-8bfd3ed800f6 for instance with vm_state building and task_state spawning.
Aug 09 15:16:23 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-498a02fa-b7d5-408d-8a46-37de167b0b77 tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] [instance: b5aa7e23-9c2c-400e-a615-5839858749e1] Found default for hw_cdrom_bus of ide {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:16:23 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-498a02fa-b7d5-408d-8a46-37de167b0b77 tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] [instance: b5aa7e23-9c2c-400e-a615-5839858749e1] Found default for hw_disk_bus of virtio {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:16:23 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-498a02fa-b7d5-408d-8a46-37de167b0b77 tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] [instance: b5aa7e23-9c2c-400e-a615-5839858749e1] Found default for hw_input_bus of None {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:16:23 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-498a02fa-b7d5-408d-8a46-37de167b0b77 tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] [instance: b5aa7e23-9c2c-400e-a615-5839858749e1] Found default for hw_pointer_model of None {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:16:23 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-498a02fa-b7d5-408d-8a46-37de167b0b77 tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] [instance: b5aa7e23-9c2c-400e-a615-5839858749e1] Found default for hw_video_model of virtio {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:16:23 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-498a02fa-b7d5-408d-8a46-37de167b0b77 tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] [instance: b5aa7e23-9c2c-400e-a615-5839858749e1] Found default for hw_vif_model of virtio {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:16:23 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: b5aa7e23-9c2c-400e-a615-5839858749e1] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 15:16:23 user nova-compute[72382]: DEBUG nova.virt.driver [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Emitting event <LifecycleEvent: 1691594183.5176148, b5aa7e23-9c2c-400e-a615-5839858749e1 => Started> {{(pid=72382) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 15:16:23 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: b5aa7e23-9c2c-400e-a615-5839858749e1] VM Started (Lifecycle Event)
Aug 09 15:16:23 user nova-compute[72382]: DEBUG nova.network.neutron [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] [instance: f1b4f73b-7a9e-4cf1-9d51-f32284f49c53] Successfully created port: 6830a784-9d5e-4efe-8b35-9d1713e0c8ce {{(pid=72382) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 15:16:23 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: b5aa7e23-9c2c-400e-a615-5839858749e1] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:16:23 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: b5aa7e23-9c2c-400e-a615-5839858749e1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72382) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 15:16:23 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: b5aa7e23-9c2c-400e-a615-5839858749e1] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 15:16:23 user nova-compute[72382]: INFO nova.compute.manager [None req-498a02fa-b7d5-408d-8a46-37de167b0b77 tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] [instance: b5aa7e23-9c2c-400e-a615-5839858749e1] Took 6.54 seconds to spawn the instance on the hypervisor.
Aug 09 15:16:23 user nova-compute[72382]: DEBUG nova.compute.manager [None req-498a02fa-b7d5-408d-8a46-37de167b0b77 tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] [instance: b5aa7e23-9c2c-400e-a615-5839858749e1] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:16:23 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:16:23 user nova-compute[72382]: INFO nova.compute.manager [None req-498a02fa-b7d5-408d-8a46-37de167b0b77 tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] [instance: b5aa7e23-9c2c-400e-a615-5839858749e1] Took 7.31 seconds to build instance.
Aug 09 15:16:23 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-498a02fa-b7d5-408d-8a46-37de167b0b77 tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] Lock "b5aa7e23-9c2c-400e-a615-5839858749e1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.420s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:16:24 user nova-compute[72382]: DEBUG nova.network.neutron [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] [instance: f1b4f73b-7a9e-4cf1-9d51-f32284f49c53] Successfully created port: 650ae32c-3dec-4bad-8ff0-6ad423e1cb21 {{(pid=72382) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 15:16:24 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:16:24 user nova-compute[72382]: DEBUG nova.network.neutron [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] [instance: f1b4f73b-7a9e-4cf1-9d51-f32284f49c53] Successfully updated port: d031358f-2670-4942-9266-d9db448a078b {{(pid=72382) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 15:16:24 user nova-compute[72382]: DEBUG nova.compute.manager [req-d812fd0c-3e31-456c-b462-f87b8d35d934 req-438c7659-67ee-4871-9fb4-66bf22eec4a5 service nova] [instance: f1b4f73b-7a9e-4cf1-9d51-f32284f49c53] Received event network-changed-d031358f-2670-4942-9266-d9db448a078b {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:16:24 user nova-compute[72382]: DEBUG nova.compute.manager [req-d812fd0c-3e31-456c-b462-f87b8d35d934 req-438c7659-67ee-4871-9fb4-66bf22eec4a5 service nova] [instance: f1b4f73b-7a9e-4cf1-9d51-f32284f49c53] Refreshing instance network info cache due to event network-changed-d031358f-2670-4942-9266-d9db448a078b. {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 15:16:24 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-d812fd0c-3e31-456c-b462-f87b8d35d934 req-438c7659-67ee-4871-9fb4-66bf22eec4a5 service nova] Acquiring lock "refresh_cache-f1b4f73b-7a9e-4cf1-9d51-f32284f49c53" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 15:16:24 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-d812fd0c-3e31-456c-b462-f87b8d35d934 req-438c7659-67ee-4871-9fb4-66bf22eec4a5 service nova] Acquired lock "refresh_cache-f1b4f73b-7a9e-4cf1-9d51-f32284f49c53" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 15:16:24 user nova-compute[72382]: DEBUG nova.network.neutron [req-d812fd0c-3e31-456c-b462-f87b8d35d934 req-438c7659-67ee-4871-9fb4-66bf22eec4a5 service nova] [instance: f1b4f73b-7a9e-4cf1-9d51-f32284f49c53] Refreshing network info cache for port d031358f-2670-4942-9266-d9db448a078b {{(pid=72382) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 15:16:25 user nova-compute[72382]: DEBUG nova.network.neutron [req-d812fd0c-3e31-456c-b462-f87b8d35d934 req-438c7659-67ee-4871-9fb4-66bf22eec4a5 service nova] [instance: f1b4f73b-7a9e-4cf1-9d51-f32284f49c53] Instance cache missing network info. {{(pid=72382) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 15:16:25 user nova-compute[72382]: DEBUG nova.network.neutron [req-d812fd0c-3e31-456c-b462-f87b8d35d934 req-438c7659-67ee-4871-9fb4-66bf22eec4a5 service nova] [instance: f1b4f73b-7a9e-4cf1-9d51-f32284f49c53] Updating instance_info_cache with network_info: [] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:16:25 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-d812fd0c-3e31-456c-b462-f87b8d35d934 req-438c7659-67ee-4871-9fb4-66bf22eec4a5 service nova] Releasing lock "refresh_cache-f1b4f73b-7a9e-4cf1-9d51-f32284f49c53" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 15:16:26 user nova-compute[72382]: DEBUG nova.network.neutron [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] [instance: f1b4f73b-7a9e-4cf1-9d51-f32284f49c53] Successfully updated port: 3cea2e31-e2a9-4b8a-976b-ce818aaca460 {{(pid=72382) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 15:16:26 user nova-compute[72382]: DEBUG nova.network.neutron [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] [instance: f1b4f73b-7a9e-4cf1-9d51-f32284f49c53] Successfully updated port: fcd90f6b-ef1b-4f9d-9ced-b98f7be4bc55 {{(pid=72382) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 15:16:27 user nova-compute[72382]: DEBUG nova.compute.manager [req-7603f248-c3d1-47ca-a90d-2a754ff38f32 req-adea46ab-2fcd-49c6-8d68-a3fc8f5b892c service nova] [instance: f1b4f73b-7a9e-4cf1-9d51-f32284f49c53] Received event network-changed-3cea2e31-e2a9-4b8a-976b-ce818aaca460 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:16:27 user nova-compute[72382]: DEBUG nova.compute.manager [req-7603f248-c3d1-47ca-a90d-2a754ff38f32 req-adea46ab-2fcd-49c6-8d68-a3fc8f5b892c service nova] [instance: f1b4f73b-7a9e-4cf1-9d51-f32284f49c53] Refreshing instance network info cache due to event network-changed-3cea2e31-e2a9-4b8a-976b-ce818aaca460. {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 15:16:27 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-7603f248-c3d1-47ca-a90d-2a754ff38f32 req-adea46ab-2fcd-49c6-8d68-a3fc8f5b892c service nova] Acquiring lock "refresh_cache-f1b4f73b-7a9e-4cf1-9d51-f32284f49c53" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 15:16:27 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-7603f248-c3d1-47ca-a90d-2a754ff38f32 req-adea46ab-2fcd-49c6-8d68-a3fc8f5b892c service nova] Acquired lock "refresh_cache-f1b4f73b-7a9e-4cf1-9d51-f32284f49c53" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 15:16:27 user nova-compute[72382]: DEBUG nova.network.neutron [req-7603f248-c3d1-47ca-a90d-2a754ff38f32 req-adea46ab-2fcd-49c6-8d68-a3fc8f5b892c service nova] [instance: f1b4f73b-7a9e-4cf1-9d51-f32284f49c53] Refreshing network info cache for port 3cea2e31-e2a9-4b8a-976b-ce818aaca460 {{(pid=72382) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 15:16:27 user nova-compute[72382]: DEBUG nova.network.neutron [req-7603f248-c3d1-47ca-a90d-2a754ff38f32 req-adea46ab-2fcd-49c6-8d68-a3fc8f5b892c service nova] [instance: f1b4f73b-7a9e-4cf1-9d51-f32284f49c53] Instance cache missing network info. {{(pid=72382) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 15:16:27 user nova-compute[72382]: DEBUG nova.network.neutron [req-7603f248-c3d1-47ca-a90d-2a754ff38f32 req-adea46ab-2fcd-49c6-8d68-a3fc8f5b892c service nova] [instance: f1b4f73b-7a9e-4cf1-9d51-f32284f49c53] Updating instance_info_cache with network_info: [] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:16:27 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-7603f248-c3d1-47ca-a90d-2a754ff38f32 req-adea46ab-2fcd-49c6-8d68-a3fc8f5b892c service nova] Releasing lock "refresh_cache-f1b4f73b-7a9e-4cf1-9d51-f32284f49c53" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 15:16:27 user nova-compute[72382]: DEBUG nova.compute.manager [req-7603f248-c3d1-47ca-a90d-2a754ff38f32 req-adea46ab-2fcd-49c6-8d68-a3fc8f5b892c service nova] [instance: f1b4f73b-7a9e-4cf1-9d51-f32284f49c53] Received event network-changed-fcd90f6b-ef1b-4f9d-9ced-b98f7be4bc55 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:16:27 user nova-compute[72382]: DEBUG nova.compute.manager [req-7603f248-c3d1-47ca-a90d-2a754ff38f32 req-adea46ab-2fcd-49c6-8d68-a3fc8f5b892c service nova] [instance: f1b4f73b-7a9e-4cf1-9d51-f32284f49c53] Refreshing instance network info cache due to event network-changed-fcd90f6b-ef1b-4f9d-9ced-b98f7be4bc55. {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 15:16:27 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-7603f248-c3d1-47ca-a90d-2a754ff38f32 req-adea46ab-2fcd-49c6-8d68-a3fc8f5b892c service nova] Acquiring lock "refresh_cache-f1b4f73b-7a9e-4cf1-9d51-f32284f49c53" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 15:16:27 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-7603f248-c3d1-47ca-a90d-2a754ff38f32 req-adea46ab-2fcd-49c6-8d68-a3fc8f5b892c service nova] Acquired lock "refresh_cache-f1b4f73b-7a9e-4cf1-9d51-f32284f49c53" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 15:16:27 user nova-compute[72382]: DEBUG nova.network.neutron [req-7603f248-c3d1-47ca-a90d-2a754ff38f32 req-adea46ab-2fcd-49c6-8d68-a3fc8f5b892c service nova] [instance: f1b4f73b-7a9e-4cf1-9d51-f32284f49c53] Refreshing network info cache for port fcd90f6b-ef1b-4f9d-9ced-b98f7be4bc55 {{(pid=72382) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 15:16:27 user nova-compute[72382]: DEBUG nova.network.neutron [req-7603f248-c3d1-47ca-a90d-2a754ff38f32 req-adea46ab-2fcd-49c6-8d68-a3fc8f5b892c service nova] [instance: f1b4f73b-7a9e-4cf1-9d51-f32284f49c53] Instance cache missing network info. {{(pid=72382) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 15:16:27 user nova-compute[72382]: DEBUG nova.network.neutron [req-7603f248-c3d1-47ca-a90d-2a754ff38f32 req-adea46ab-2fcd-49c6-8d68-a3fc8f5b892c service nova] [instance: f1b4f73b-7a9e-4cf1-9d51-f32284f49c53] Updating instance_info_cache with network_info: [] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:16:27 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-7603f248-c3d1-47ca-a90d-2a754ff38f32 req-adea46ab-2fcd-49c6-8d68-a3fc8f5b892c service nova] Releasing lock "refresh_cache-f1b4f73b-7a9e-4cf1-9d51-f32284f49c53" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 15:16:28 user nova-compute[72382]: DEBUG nova.network.neutron [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] [instance: f1b4f73b-7a9e-4cf1-9d51-f32284f49c53] Successfully updated port: d96a280e-5aeb-4a7c-97da-431e5f42c7f6 {{(pid=72382) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 15:16:28 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:16:29 user nova-compute[72382]: DEBUG nova.compute.manager [req-edfb2c75-8b43-480d-8a6a-d19879115e38 req-d2d3c717-fdb6-4ccf-98f5-c3d7dd28bf7a service nova] [instance: f1b4f73b-7a9e-4cf1-9d51-f32284f49c53] Received event network-changed-d96a280e-5aeb-4a7c-97da-431e5f42c7f6 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:16:29 user nova-compute[72382]: DEBUG nova.compute.manager [req-edfb2c75-8b43-480d-8a6a-d19879115e38 req-d2d3c717-fdb6-4ccf-98f5-c3d7dd28bf7a service nova] [instance: f1b4f73b-7a9e-4cf1-9d51-f32284f49c53] Refreshing instance network info cache due to event network-changed-d96a280e-5aeb-4a7c-97da-431e5f42c7f6. {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 15:16:29 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-edfb2c75-8b43-480d-8a6a-d19879115e38 req-d2d3c717-fdb6-4ccf-98f5-c3d7dd28bf7a service nova] Acquiring lock "refresh_cache-f1b4f73b-7a9e-4cf1-9d51-f32284f49c53" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 15:16:29 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-edfb2c75-8b43-480d-8a6a-d19879115e38 req-d2d3c717-fdb6-4ccf-98f5-c3d7dd28bf7a service nova] Acquired lock "refresh_cache-f1b4f73b-7a9e-4cf1-9d51-f32284f49c53" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 15:16:29 user nova-compute[72382]: DEBUG nova.network.neutron [req-edfb2c75-8b43-480d-8a6a-d19879115e38 req-d2d3c717-fdb6-4ccf-98f5-c3d7dd28bf7a service nova] [instance: f1b4f73b-7a9e-4cf1-9d51-f32284f49c53] Refreshing network info cache for port d96a280e-5aeb-4a7c-97da-431e5f42c7f6 {{(pid=72382) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 15:16:29 user nova-compute[72382]: DEBUG nova.network.neutron [req-edfb2c75-8b43-480d-8a6a-d19879115e38 req-d2d3c717-fdb6-4ccf-98f5-c3d7dd28bf7a service nova] [instance: f1b4f73b-7a9e-4cf1-9d51-f32284f49c53] Instance cache missing network info. {{(pid=72382) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 15:16:29 user nova-compute[72382]: DEBUG nova.network.neutron [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] [instance: f1b4f73b-7a9e-4cf1-9d51-f32284f49c53] Successfully updated port: 92c19874-960c-4e03-8537-6ae44812a1da {{(pid=72382) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 15:16:29 user nova-compute[72382]: DEBUG nova.network.neutron [req-edfb2c75-8b43-480d-8a6a-d19879115e38 req-d2d3c717-fdb6-4ccf-98f5-c3d7dd28bf7a service nova] [instance: f1b4f73b-7a9e-4cf1-9d51-f32284f49c53] Updating instance_info_cache with network_info: [] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:16:29 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-edfb2c75-8b43-480d-8a6a-d19879115e38 req-d2d3c717-fdb6-4ccf-98f5-c3d7dd28bf7a service nova] Releasing lock "refresh_cache-f1b4f73b-7a9e-4cf1-9d51-f32284f49c53" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 15:16:29 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:16:30 user nova-compute[72382]: DEBUG nova.network.neutron [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] [instance: f1b4f73b-7a9e-4cf1-9d51-f32284f49c53] Successfully updated port: 6830a784-9d5e-4efe-8b35-9d1713e0c8ce {{(pid=72382) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 15:16:31 user nova-compute[72382]: DEBUG nova.compute.manager [req-b479e168-0965-406c-914e-f147c51b321f req-dcf07f22-9e1e-46c7-a990-26e67f959fe0 service nova] [instance: f1b4f73b-7a9e-4cf1-9d51-f32284f49c53] Received event network-changed-92c19874-960c-4e03-8537-6ae44812a1da {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:16:31 user nova-compute[72382]: DEBUG nova.compute.manager [req-b479e168-0965-406c-914e-f147c51b321f req-dcf07f22-9e1e-46c7-a990-26e67f959fe0 service nova] [instance: f1b4f73b-7a9e-4cf1-9d51-f32284f49c53] Refreshing instance network info cache due to event network-changed-92c19874-960c-4e03-8537-6ae44812a1da. {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 15:16:31 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-b479e168-0965-406c-914e-f147c51b321f req-dcf07f22-9e1e-46c7-a990-26e67f959fe0 service nova] Acquiring lock "refresh_cache-f1b4f73b-7a9e-4cf1-9d51-f32284f49c53" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 15:16:31 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-b479e168-0965-406c-914e-f147c51b321f req-dcf07f22-9e1e-46c7-a990-26e67f959fe0 service nova] Acquired lock "refresh_cache-f1b4f73b-7a9e-4cf1-9d51-f32284f49c53" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 15:16:31 user nova-compute[72382]: DEBUG nova.network.neutron [req-b479e168-0965-406c-914e-f147c51b321f req-dcf07f22-9e1e-46c7-a990-26e67f959fe0 service nova] [instance: f1b4f73b-7a9e-4cf1-9d51-f32284f49c53] Refreshing network info cache for port 92c19874-960c-4e03-8537-6ae44812a1da {{(pid=72382) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 15:16:31 user nova-compute[72382]: DEBUG nova.network.neutron [req-b479e168-0965-406c-914e-f147c51b321f req-dcf07f22-9e1e-46c7-a990-26e67f959fe0 service nova] [instance: f1b4f73b-7a9e-4cf1-9d51-f32284f49c53] Instance cache missing network info. {{(pid=72382) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 15:16:31 user nova-compute[72382]: DEBUG nova.network.neutron [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] [instance: f1b4f73b-7a9e-4cf1-9d51-f32284f49c53] Successfully updated port: 650ae32c-3dec-4bad-8ff0-6ad423e1cb21 {{(pid=72382) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 15:16:31 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] Acquiring lock "refresh_cache-f1b4f73b-7a9e-4cf1-9d51-f32284f49c53" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 15:16:31 user nova-compute[72382]: DEBUG nova.network.neutron [req-b479e168-0965-406c-914e-f147c51b321f req-dcf07f22-9e1e-46c7-a990-26e67f959fe0 service nova] [instance: f1b4f73b-7a9e-4cf1-9d51-f32284f49c53] Updating instance_info_cache with network_info: [] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:16:31 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-b479e168-0965-406c-914e-f147c51b321f req-dcf07f22-9e1e-46c7-a990-26e67f959fe0 service nova] Releasing lock "refresh_cache-f1b4f73b-7a9e-4cf1-9d51-f32284f49c53" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 15:16:31 user nova-compute[72382]: DEBUG nova.compute.manager [req-b479e168-0965-406c-914e-f147c51b321f req-dcf07f22-9e1e-46c7-a990-26e67f959fe0 service nova] [instance: f1b4f73b-7a9e-4cf1-9d51-f32284f49c53] Received event network-changed-6830a784-9d5e-4efe-8b35-9d1713e0c8ce {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:16:31 user nova-compute[72382]: DEBUG nova.compute.manager [req-b479e168-0965-406c-914e-f147c51b321f req-dcf07f22-9e1e-46c7-a990-26e67f959fe0 service nova] [instance: f1b4f73b-7a9e-4cf1-9d51-f32284f49c53] Refreshing instance network info cache due to event network-changed-6830a784-9d5e-4efe-8b35-9d1713e0c8ce. {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 15:16:31 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-b479e168-0965-406c-914e-f147c51b321f req-dcf07f22-9e1e-46c7-a990-26e67f959fe0 service nova] Acquiring lock "refresh_cache-f1b4f73b-7a9e-4cf1-9d51-f32284f49c53" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 15:16:31 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-b479e168-0965-406c-914e-f147c51b321f req-dcf07f22-9e1e-46c7-a990-26e67f959fe0 service nova] Acquired lock "refresh_cache-f1b4f73b-7a9e-4cf1-9d51-f32284f49c53" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 15:16:31 user nova-compute[72382]: DEBUG nova.network.neutron [req-b479e168-0965-406c-914e-f147c51b321f req-dcf07f22-9e1e-46c7-a990-26e67f959fe0 service nova] [instance: f1b4f73b-7a9e-4cf1-9d51-f32284f49c53] Refreshing network info cache for port 6830a784-9d5e-4efe-8b35-9d1713e0c8ce {{(pid=72382) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 15:16:31 user nova-compute[72382]: DEBUG nova.network.neutron [req-b479e168-0965-406c-914e-f147c51b321f req-dcf07f22-9e1e-46c7-a990-26e67f959fe0 service nova] [instance: f1b4f73b-7a9e-4cf1-9d51-f32284f49c53] Instance cache missing network info. {{(pid=72382) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 15:16:31 user nova-compute[72382]: DEBUG nova.network.neutron [req-b479e168-0965-406c-914e-f147c51b321f req-dcf07f22-9e1e-46c7-a990-26e67f959fe0 service nova] [instance: f1b4f73b-7a9e-4cf1-9d51-f32284f49c53] Updating instance_info_cache with network_info: [] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:16:31 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-b479e168-0965-406c-914e-f147c51b321f req-dcf07f22-9e1e-46c7-a990-26e67f959fe0 service nova] Releasing lock "refresh_cache-f1b4f73b-7a9e-4cf1-9d51-f32284f49c53" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 15:16:31 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] Acquired lock "refresh_cache-f1b4f73b-7a9e-4cf1-9d51-f32284f49c53" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 15:16:31 user nova-compute[72382]: DEBUG nova.network.neutron [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] [instance: f1b4f73b-7a9e-4cf1-9d51-f32284f49c53] Building network info cache for instance {{(pid=72382) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 15:16:31 user nova-compute[72382]: DEBUG nova.network.neutron [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] [instance: f1b4f73b-7a9e-4cf1-9d51-f32284f49c53] Instance cache missing network info. {{(pid=72382) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 15:16:32 user nova-compute[72382]: INFO nova.virt.block_device [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] [instance: f1b4f73b-7a9e-4cf1-9d51-f32284f49c53] Booting with volume 5a13916f-1416-4b94-9e10-96f9e6415753 at /dev/vdb
Aug 09 15:16:32 user nova-compute[72382]: DEBUG os_brick.utils [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 15:16:32 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:16:32 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:16:32 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[8efc794b-6446-4789-90b6-e04d241ff774]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d2cfa7015fe\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:16:32 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:16:32 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:16:32 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[10fb7927-b485-4b21-b65a-adc3820b2e81]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:16:32 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:16:32 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:16:32 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[519ce375-a274-441d-8196-1fe02b019495]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:16:32 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6971c62-7979-4c03-b8c3-d7f5a525c216]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:16:32 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] Running cmd (subprocess): nvme version {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:16:32 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] 'nvme version' failed. Not Retrying. {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 15:16:32 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] nvme not present on system {{(pid=72382) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 15:16:32 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:16:32 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 15:16:32 user nova-compute[72382]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 15:16:32 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[07d9bf28-10cf-4424-bbd0-f86c73b84080]: (4, '') {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:16:32 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.lightos [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72382) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 15:16:32 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.lightos [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72382) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 15:16:32 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.lightos [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] LIGHTOS: no hostnqn found. {{(pid=72382) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 15:16:32 user nova-compute[72382]: DEBUG os_brick.utils [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d2cfa7015fe', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 15:16:32 user nova-compute[72382]: DEBUG nova.virt.block_device [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] [instance: f1b4f73b-7a9e-4cf1-9d51-f32284f49c53] Updating existing volume attachment record: 180dba90-ccdd-4b30-a888-58841d4d7ea3 {{(pid=72382) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 15:16:33 user nova-compute[72382]: DEBUG nova.compute.manager [req-c8f0ddfb-cc50-4e5f-9f52-2ce6330c636a req-c2897119-ee66-4429-9701-3032b9d13ce1 service nova] [instance: f1b4f73b-7a9e-4cf1-9d51-f32284f49c53] Received event network-changed-650ae32c-3dec-4bad-8ff0-6ad423e1cb21 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:16:33 user nova-compute[72382]: DEBUG nova.compute.manager [req-c8f0ddfb-cc50-4e5f-9f52-2ce6330c636a req-c2897119-ee66-4429-9701-3032b9d13ce1 service nova] [instance: f1b4f73b-7a9e-4cf1-9d51-f32284f49c53] Refreshing instance network info cache due to event network-changed-650ae32c-3dec-4bad-8ff0-6ad423e1cb21. {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 15:16:33 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-c8f0ddfb-cc50-4e5f-9f52-2ce6330c636a req-c2897119-ee66-4429-9701-3032b9d13ce1 service nova] Acquiring lock "refresh_cache-f1b4f73b-7a9e-4cf1-9d51-f32284f49c53" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 15:16:33 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:16:34 user nova-compute[72382]: DEBUG nova.network.neutron [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] [instance: f1b4f73b-7a9e-4cf1-9d51-f32284f49c53] Updating instance_info_cache with network_info: [{"id": "d031358f-2670-4942-9266-d9db448a078b", "address": "fa:16:3e:4d:2e:d1", "network": {"id": "6c42873e-d293-4fe2-8d72-d048d58d0141", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1386426199-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7345242bf74a4b91a057182d9b5172c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd031358f-26", "ovs_interfaceid": "d031358f-2670-4942-9266-d9db448a078b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3cea2e31-e2a9-4b8a-976b-ce818aaca460", "address": "fa:16:3e:ef:80:eb", "network": {"id": "b16bed11-36bd-4428-a500-f0ad85bfaf2d", "bridge": "br-int", "label": "tempest-device-tagging-net1-483768340", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.27", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7345242bf74a4b91a057182d9b5172c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3cea2e31-e2", "ovs_interfaceid": "3cea2e31-e2a9-4b8a-976b-ce818aaca460", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fcd90f6b-ef1b-4f9d-9ced-b98f7be4bc55", "address": "fa:16:3e:90:b6:32", "network": {"id": "b16bed11-36bd-4428-a500-f0ad85bfaf2d", "bridge": "br-int", "label": "tempest-device-tagging-net1-483768340", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.115", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7345242bf74a4b91a057182d9b5172c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcd90f6b-ef", "ovs_interfaceid": "fcd90f6b-ef1b-4f9d-9ced-b98f7be4bc55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d96a280e-5aeb-4a7c-97da-431e5f42c7f6", "address": "fa:16:3e:90:60:1f", "network": {"id": "b16bed11-36bd-4428-a500-f0ad85bfaf2d", "bridge": "br-int", "label": "tempest-device-tagging-net1-483768340", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.234", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7345242bf74a4b91a057182d9b5172c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd96a280e-5a", "ovs_interfaceid": "d96a280e-5aeb-4a7c-97da-431e5f42c7f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "92c19874-960c-4e03-8537-6ae44812a1da", "address": "fa:16:3e:a2:61:33", "network": {"id": "b16bed11-36bd-4428-a500-f0ad85bfaf2d", "bridge": "br-int", "label": "tempest-device-tagging-net1-483768340", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.114", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7345242bf74a4b91a057182d9b5172c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92c19874-96", "ovs_interfaceid": "92c19874-960c-4e03-8537-6ae44812a1da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6830a784-9d5e-4efe-8b35-9d1713e0c8ce", "address": "fa:16:3e:99:2e:fe", "network": {"id": "5bf13de0-38d0-4177-9863-980a7c39151c", "bridge": "br-int", "label": "tempest-device-tagging-net2-427749890", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7345242bf74a4b91a057182d9b5172c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6830a784-9d", "ovs_interfaceid": "6830a784-9d5e-4efe-8b35-9d1713e0c8ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "650ae32c-3dec-4bad-8ff0-6ad423e1cb21", "address": "fa:16:3e:c9:be:0b", "network": {"id": "5bf13de0-38d0-4177-9863-980a7c39151c", "bridge": "br-int", "label": "tempest-device-tagging-net2-427749890", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7345242bf74a4b91a057182d9b5172c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap650ae32c-3d", "ovs_interfaceid": "650ae32c-3dec-4bad-8ff0-6ad423e1cb21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:16:34 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] Releasing lock "refresh_cache-f1b4f73b-7a9e-4cf1-9d51-f32284f49c53" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 15:16:34 user nova-compute[72382]: DEBUG nova.compute.manager [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] [instance: f1b4f73b-7a9e-4cf1-9d51-f32284f49c53] Instance network_info: |[{"id": "d031358f-2670-4942-9266-d9db448a078b", "address": "fa:16:3e:4d:2e:d1", "network": {"id": "6c42873e-d293-4fe2-8d72-d048d58d0141", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1386426199-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7345242bf74a4b91a057182d9b5172c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd031358f-26", "ovs_interfaceid": "d031358f-2670-4942-9266-d9db448a078b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3cea2e31-e2a9-4b8a-976b-ce818aaca460", "address": "fa:16:3e:ef:80:eb", "network": {"id": "b16bed11-36bd-4428-a500-f0ad85bfaf2d", "bridge": "br-int", "label": "tempest-device-tagging-net1-483768340", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.27", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7345242bf74a4b91a057182d9b5172c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3cea2e31-e2", "ovs_interfaceid": "3cea2e31-e2a9-4b8a-976b-ce818aaca460", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fcd90f6b-ef1b-4f9d-9ced-b98f7be4bc55", "address": "fa:16:3e:90:b6:32", "network": {"id": "b16bed11-36bd-4428-a500-f0ad85bfaf2d", "bridge": "br-int", "label": "tempest-device-tagging-net1-483768340", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.115", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7345242bf74a4b91a057182d9b5172c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcd90f6b-ef", "ovs_interfaceid": "fcd90f6b-ef1b-4f9d-9ced-b98f7be4bc55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d96a280e-5aeb-4a7c-97da-431e5f42c7f6", "address": "fa:16:3e:90:60:1f", "network": {"id": "b16bed11-36bd-4428-a500-f0ad85bfaf2d", "bridge": "br-int", "label": "tempest-device-tagging-net1-483768340", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.234", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7345242bf74a4b91a057182d9b5172c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd96a280e-5a", "ovs_interfaceid": "d96a280e-5aeb-4a7c-97da-431e5f42c7f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "92c19874-960c-4e03-8537-6ae44812a1da", "address": "fa:16:3e:a2:61:33", "network": {"id": "b16bed11-36bd-4428-a500-f0ad85bfaf2d", "bridge": "br-int", "label": "tempest-device-tagging-net1-483768340", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.114", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7345242bf74a4b91a057182d9b5172c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92c19874-96", "ovs_interfaceid": "92c19874-960c-4e03-8537-6ae44812a1da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6830a784-9d5e-4efe-8b35-9d1713e0c8ce", "address": "fa:16:3e:99:2e:fe", "network": {"id": "5bf13de0-38d0-4177-9863-980a7c39151c", "bridge": "br-int", "label": "tempest-device-tagging-net2-427749890", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7345242bf74a4b91a057182d9b5172c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6830a784-9d", "ovs_interfaceid": "6830a784-9d5e-4efe-8b35-9d1713e0c8ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "650ae32c-3dec-4bad-8ff0-6ad423e1cb21", "address": "fa:16:3e:c9:be:0b", "network": {"id": "5bf13de0-38d0-4177-9863-980a7c39151c", "bridge": "br-int", "label": "tempest-device-tagging-net2-427749890", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7345242bf74a4b91a057182d9b5172c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap650ae32c-3d", "ovs_interfaceid": "650ae32c-3dec-4bad-8ff0-6ad423e1cb21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72382) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 15:16:34 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-c8f0ddfb-cc50-4e5f-9f52-2ce6330c636a req-c2897119-ee66-4429-9701-3032b9d13ce1 service nova] Acquired lock "refresh_cache-f1b4f73b-7a9e-4cf1-9d51-f32284f49c53" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 15:16:34 user nova-compute[72382]: DEBUG nova.network.neutron [req-c8f0ddfb-cc50-4e5f-9f52-2ce6330c636a req-c2897119-ee66-4429-9701-3032b9d13ce1 service nova] [instance: f1b4f73b-7a9e-4cf1-9d51-f32284f49c53] Refreshing network info cache for port 650ae32c-3dec-4bad-8ff0-6ad423e1cb21 {{(pid=72382) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 15:16:34 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:16:34 user nova-compute[72382]: DEBUG nova.network.neutron [req-c8f0ddfb-cc50-4e5f-9f52-2ce6330c636a req-c2897119-ee66-4429-9701-3032b9d13ce1 service nova] [instance: f1b4f73b-7a9e-4cf1-9d51-f32284f49c53] Updated VIF entry in instance network info cache for port 650ae32c-3dec-4bad-8ff0-6ad423e1cb21. {{(pid=72382) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 15:16:34 user nova-compute[72382]: DEBUG nova.network.neutron [req-c8f0ddfb-cc50-4e5f-9f52-2ce6330c636a req-c2897119-ee66-4429-9701-3032b9d13ce1 service nova] [instance: f1b4f73b-7a9e-4cf1-9d51-f32284f49c53] Updating instance_info_cache with network_info: [{"id": "d031358f-2670-4942-9266-d9db448a078b", "address": "fa:16:3e:4d:2e:d1", "network": {"id": "6c42873e-d293-4fe2-8d72-d048d58d0141", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1386426199-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7345242bf74a4b91a057182d9b5172c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd031358f-26", "ovs_interfaceid": "d031358f-2670-4942-9266-d9db448a078b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3cea2e31-e2a9-4b8a-976b-ce818aaca460", "address": "fa:16:3e:ef:80:eb", "network": {"id": "b16bed11-36bd-4428-a500-f0ad85bfaf2d", "bridge": "br-int", "label": "tempest-device-tagging-net1-483768340", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.27", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7345242bf74a4b91a057182d9b5172c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3cea2e31-e2", "ovs_interfaceid": "3cea2e31-e2a9-4b8a-976b-ce818aaca460", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fcd90f6b-ef1b-4f9d-9ced-b98f7be4bc55", "address": "fa:16:3e:90:b6:32", "network": {"id": "b16bed11-36bd-4428-a500-f0ad85bfaf2d", "bridge": "br-int", "label": "tempest-device-tagging-net1-483768340", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.115", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7345242bf74a4b91a057182d9b5172c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcd90f6b-ef", "ovs_interfaceid": "fcd90f6b-ef1b-4f9d-9ced-b98f7be4bc55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d96a280e-5aeb-4a7c-97da-431e5f42c7f6", "address": "fa:16:3e:90:60:1f", "network": {"id": "b16bed11-36bd-4428-a500-f0ad85bfaf2d", "bridge": "br-int", "label": "tempest-device-tagging-net1-483768340", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.234", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7345242bf74a4b91a057182d9b5172c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd96a280e-5a", "ovs_interfaceid": "d96a280e-5aeb-4a7c-97da-431e5f42c7f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "92c19874-960c-4e03-8537-6ae44812a1da", "address": "fa:16:3e:a2:61:33", "network": {"id": "b16bed11-36bd-4428-a500-f0ad85bfaf2d", "bridge": "br-int", "label": "tempest-device-tagging-net1-483768340", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.114", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7345242bf74a4b91a057182d9b5172c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92c19874-96", "ovs_interfaceid": "92c19874-960c-4e03-8537-6ae44812a1da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6830a784-9d5e-4efe-8b35-9d1713e0c8ce", "address": "fa:16:3e:99:2e:fe", "network": {"id": "5bf13de0-38d0-4177-9863-980a7c39151c", "bridge": "br-int", "label": "tempest-device-tagging-net2-427749890", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7345242bf74a4b91a057182d9b5172c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6830a784-9d", "ovs_interfaceid": "6830a784-9d5e-4efe-8b35-9d1713e0c8ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "650ae32c-3dec-4bad-8ff0-6ad423e1cb21", "address": "fa:16:3e:c9:be:0b", "network": {"id": "5bf13de0-38d0-4177-9863-980a7c39151c", "bridge": "br-int", "label": "tempest-device-tagging-net2-427749890", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7345242bf74a4b91a057182d9b5172c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap650ae32c-3d", "ovs_interfaceid": "650ae32c-3dec-4bad-8ff0-6ad423e1cb21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:16:34 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-c8f0ddfb-cc50-4e5f-9f52-2ce6330c636a req-c2897119-ee66-4429-9701-3032b9d13ce1 service nova] Releasing lock "refresh_cache-f1b4f73b-7a9e-4cf1-9d51-f32284f49c53" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 15:16:38 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:16:39 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:16:41 user nova-compute[72382]: INFO nova.virt.block_device [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] [instance: f1b4f73b-7a9e-4cf1-9d51-f32284f49c53] Booting with volume 16ef1023-88b6-4e22-9b4b-45515b25ca9b at /dev/vdc
Aug 09 15:16:41 user nova-compute[72382]: DEBUG os_brick.utils [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 15:16:41 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:16:41 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:16:41 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[6860d67f-68dc-4bc6-9b22-97021961f2a8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d2cfa7015fe\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:16:41 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:16:41 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:16:41 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[f637dc74-cb52-4e3e-867d-5421881c7ec2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:16:41 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:16:41 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:16:41 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[93db7980-9319-491f-888d-7237a061a4bf]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:16:41 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5d82ca5-6783-4a3a-8c2f-d2a9c2d9d122]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:16:41 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] Running cmd (subprocess): nvme version {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:16:41 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] 'nvme version' failed. Not Retrying. {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 15:16:41 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] nvme not present on system {{(pid=72382) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 15:16:41 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:16:41 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 15:16:41 user nova-compute[72382]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 15:16:41 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfc0e7b5-8db9-400e-b2ac-bfb378aea656]: (4, '') {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:16:41 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.lightos [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72382) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 15:16:41 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.lightos [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72382) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 15:16:41 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.lightos [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] LIGHTOS: no hostnqn found. {{(pid=72382) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 15:16:41 user nova-compute[72382]: DEBUG os_brick.utils [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] <== get_connector_properties: return (111ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d2cfa7015fe', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 15:16:41 user nova-compute[72382]: DEBUG nova.virt.block_device [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] [instance: f1b4f73b-7a9e-4cf1-9d51-f32284f49c53] Updating existing volume attachment record: 262a00ac-789b-4824-b5ff-1be264800a11 {{(pid=72382) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 15:16:43 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:16:44 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:16:48 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:16:49 user nova-compute[72382]: DEBUG nova.compute.manager [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] [instance: f1b4f73b-7a9e-4cf1-9d51-f32284f49c53] Start spawning the instance on the hypervisor. {{(pid=72382) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 15:16:49 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] [instance: f1b4f73b-7a9e-4cf1-9d51-f32284f49c53] Creating instance directory {{(pid=72382) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 15:16:49 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] [instance: f1b4f73b-7a9e-4cf1-9d51-f32284f49c53] Creating image(s)
Aug 09 15:16:49 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] [instance: f1b4f73b-7a9e-4cf1-9d51-f32284f49c53] Did not create local disks {{(pid=72382) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 09 15:16:49 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] [instance: f1b4f73b-7a9e-4cf1-9d51-f32284f49c53] Ensure instance console log exists: /opt/stack/data/nova/instances/f1b4f73b-7a9e-4cf1-9d51-f32284f49c53/console.log {{(pid=72382) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 15:16:49 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:16:49 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:16:49 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:16:49 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] [instance: f1b4f73b-7a9e-4cf1-9d51-f32284f49c53] Start _get_guest_xml network_info=[{"id": "d031358f-2670-4942-9266-d9db448a078b", "address": "fa:16:3e:4d:2e:d1", "network": {"id": "6c42873e-d293-4fe2-8d72-d048d58d0141", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1386426199-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7345242bf74a4b91a057182d9b5172c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd031358f-26", "ovs_interfaceid": "d031358f-2670-4942-9266-d9db448a078b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3cea2e31-e2a9-4b8a-976b-ce818aaca460", "address": "fa:16:3e:ef:80:eb", "network": {"id": "b16bed11-36bd-4428-a500-f0ad85bfaf2d", "bridge": "br-int", "label": "tempest-device-tagging-net1-483768340", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.27", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7345242bf74a4b91a057182d9b5172c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3cea2e31-e2", "ovs_interfaceid": "3cea2e31-e2a9-4b8a-976b-ce818aaca460", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fcd90f6b-ef1b-4f9d-9ced-b98f7be4bc55", "address": "fa:16:3e:90:b6:32", "network": {"id": "b16bed11-36bd-4428-a500-f0ad85bfaf2d", "bridge": "br-int", "label": "tempest-device-tagging-net1-483768340", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.115", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7345242bf74a4b91a057182d9b5172c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcd90f6b-ef", "ovs_interfaceid": "fcd90f6b-ef1b-4f9d-9ced-b98f7be4bc55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d96a280e-5aeb-4a7c-97da-431e5f42c7f6", "address": "fa:16:3e:90:60:1f", "network": {"id": "b16bed11-36bd-4428-a500-f0ad85bfaf2d", "bridge": "br-int", "label": "tempest-device-tagging-net1-483768340", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.234", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7345242bf74a4b91a057182d9b5172c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd96a280e-5a", "ovs_interfaceid": "d96a280e-5aeb-4a7c-97da-431e5f42c7f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "92c19874-960c-4e03-8537-6ae44812a1da", "address": "fa:16:3e:a2:61:33", "network": {"id": "b16bed11-36bd-4428-a500-f0ad85bfaf2d", "bridge": "br-int", "label": "tempest-device-tagging-net1-483768340", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.114", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7345242bf74a4b91a057182d9b5172c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92c19874-96", "ovs_interfaceid": "92c19874-960c-4e03-8537-6ae44812a1da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6830a784-9d5e-4efe-8b35-9d1713e0c8ce", "address": "fa:16:3e:99:2e:fe", "network": {"id": "5bf13de0-38d0-4177-9863-980a7c39151c", "bridge": "br-int", "label": "tempest-device-tagging-net2-427749890", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7345242bf74a4b91a057182d9b5172c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6830a784-9d", "ovs_interfaceid": "6830a784-9d5e-4efe-8b35-9d1713e0c8ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "650ae32c-3dec-4bad-8ff0-6ad423e1cb21", "address": "fa:16:3e:c9:be:0b", "network": {"id": "5bf13de0-38d0-4177-9863-980a7c39151c", "bridge": "br-int", "label": "tempest-device-tagging-net2-427749890", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7345242bf74a4b91a057182d9b5172c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap650ae32c-3d", "ovs_interfaceid": "650ae32c-3dec-4bad-8ff0-6ad423e1cb21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T15:11:25Z,direct_url=<?>,disk_format='qcow2',id=a79f2cea-eb27-4631-aaf3-05e7d9e411b4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a638990e12cc4d6eabb6d55e13be6bdf',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T15:11:27Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:e2267629-52cf-439c-9083-3e8384c67f08'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rDYvqdHM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'f1b4f73b-7a9e-4cf1-9d51-f32284f49c53', 'attached_at': '', 'detached_at': '', 'volume_id': 'e2267629-52cf-439c-9083-3e8384c67f08', 'serial': 'e2267629-52cf-439c-9083-3e8384c67f08'}, 'disk_bus': 'virtio', 'attachment_id': 'fbd6c1ea-232c-4998-94cd-55277e57d786', 'delete_on_termination': False, 'volume_type': None}, {'guest_format': None, 'device_type': 'disk', 'boot_index': 1, 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:5a13916f-1416-4b94-9e10-96f9e6415753'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FDiNaqEe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'f1b4f73b-7a9e-4cf1-9d51-f32284f49c53', 'attached_at': '', 'detached_at': '', 'volume_id': '5a13916f-1416-4b94-9e10-96f9e6415753', 'serial': '5a13916f-1416-4b94-9e10-96f9e6415753'}, 'disk_bus': 'virtio', 'attachment_id': '180dba90-ccdd-4b30-a888-58841d4d7ea3', 'delete_on_termination': False, 'volume_type': None}, {'guest_format': None, 'device_type': 'disk', 'boot_index': 2, 'mount_device': '/dev/vdc', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:16ef1023-88b6-4e22-9b4b-45515b25ca9b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lseWJYAz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'f1b4f73b-7a9e-4cf1-9d51-f32284f49c53', 'attached_at': '', 'detached_at': '', 'volume_id': '16ef1023-88b6-4e22-9b4b-45515b25ca9b', 'serial': '16ef1023-88b6-4e22-9b4b-45515b25ca9b'}, 'disk_bus': 'virtio', 'attachment_id': '262a00ac-789b-4824-b5ff-1be264800a11', 'delete_on_termination': False, 'volume_type': None} {{(pid=72382) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 15:16:49 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:16:49 user nova-compute[72382]: WARNING nova.virt.libvirt.driver [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 15:16:49 user nova-compute[72382]: WARNING nova.virt.libvirt.driver [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 15:16:49 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72382) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 15:16:49 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] CPU controller missing on host. {{(pid=72382) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 15:16:49 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72382) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 15:16:49 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] CPU controller found on host. {{(pid=72382) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 15:16:49 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72382) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 15:16:49 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T15:11:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T15:11:25Z,direct_url=<?>,disk_format='qcow2',id=a79f2cea-eb27-4631-aaf3-05e7d9e411b4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a638990e12cc4d6eabb6d55e13be6bdf',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T15:11:27Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 15:16:49 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] Flavor limits 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 15:16:49 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] Image limits 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 15:16:49 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] Flavor pref 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 15:16:49 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] Image pref 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 15:16:49 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 15:16:49 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 15:16:49 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72382) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 15:16:49 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] Got 1 possible topologies {{(pid=72382) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 15:16:49 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 15:16:49 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 15:16:49 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:16:49 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:16:49 user nova-compute[72382]: DEBUG os_brick.initiator.connector [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] Factory for ISCSI on None {{(pid=72382) factory /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connector.py:281}}
Aug 09 15:16:49 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.005s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:16:49 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] [instance: f1b4f73b-7a9e-4cf1-9d51-f32284f49c53] Calling os-brick to attach iSCSI Volume {{(pid=72382) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 15:16:49 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2a0c768340>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:e2267629-52cf-439c-9083-3e8384c67f08'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rDYvqdHM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 15:16:49 user nova-compute[72382]: WARNING os_brick.initiator.connectors.base [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 15:16:49 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 15:16:49 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 15:16:49 user nova-compute[72382]: WARNING os_brick.initiator.connectors.base [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 15:16:49 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e2267629-52cf-439c-9083-3e8384c67f08" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 15:16:49 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e2267629-52cf-439c-9083-3e8384c67f08" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 15:16:49 user nova-compute[72382]: INFO os_brick.initiator.connectors.iscsi [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 15:16:49 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2267629-52cf-439c-9083-3e8384c67f08 -p 172.16.0.220:3260 {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:16:49 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2267629-52cf-439c-9083-3e8384c67f08 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:16:49 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf5a0b21-8f7b-42f5-bdf8-009c0255cc7c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:16:49 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 15:16:49 user nova-compute[72382]:  {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:16:49 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2267629-52cf-439c-9083-3e8384c67f08 -p 172.16.0.220:3260 --interface default --op new {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:16:49 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2267629-52cf-439c-9083-3e8384c67f08 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:16:49 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[61e87e1c-aa54-4313-8bd6-c10fb6d70442]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e2267629-52cf-439c-9083-3e8384c67f08] added\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:16:49 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e2267629-52cf-439c-9083-3e8384c67f08] added
Aug 09 15:16:49 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:16:49 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2267629-52cf-439c-9083-3e8384c67f08 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:16:49 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2267629-52cf-439c-9083-3e8384c67f08 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:16:49 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d03c528-c17e-4e27-83c2-9d91d1304b56]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:16:49 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:16:49 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2267629-52cf-439c-9083-3e8384c67f08 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:16:49 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2267629-52cf-439c-9083-3e8384c67f08 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.033s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:16:49 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f36944f-7a51-4a75-a938-d278c7fb9c4f]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:16:49 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:16:49 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2267629-52cf-439c-9083-3e8384c67f08 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rDYvqdHM {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:16:49 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2267629-52cf-439c-9083-3e8384c67f08 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rDYvqdHM" returned: 0 in 0.016s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:16:49 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[84bbfab1-bc4b-47ed-ba86-fd6fe1606ce7]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:16:49 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rDYvqdHM'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:16:49 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2267629-52cf-439c-9083-3e8384c67f08 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:16:49 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2267629-52cf-439c-9083-3e8384c67f08 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:16:49 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[788ce2e2-62a7-4f43-9765-bc67cb76c5f8]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:16:49 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:16:49 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:16:49 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:16:49 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[34f99caa-ac7e-41f3-b427-d88ad0e58bae]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:16:49 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 09 15:16:49 user nova-compute[72382]:  {{(pid=72382) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 15:16:49 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 09 15:16:49 user nova-compute[72382]:  {{(pid=72382) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 15:16:49 user nova-compute[72382]: WARNING os_brick.initiator.connectors.iscsi [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 09 15:16:49 user nova-compute[72382]: 
Aug 09 15:16:49 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2267629-52cf-439c-9083-3e8384c67f08 -p 172.16.0.220:3260 --login {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:16:50 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2267629-52cf-439c-9083-3e8384c67f08 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:16:50 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a3d6be0-aadc-4d94-b77d-abe268228332]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e2267629-52cf-439c-9083-3e8384c67f08, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e2267629-52cf-439c-9083-3e8384c67f08, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:16:50 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e2267629-52cf-439c-9083-3e8384c67f08, portal: 172.16.0.220,3260]
Aug 09 15:16:50 user nova-compute[72382]: Login to [iface: default, target: iqn.2010-10.org.openstack:e2267629-52cf-439c-9083-3e8384c67f08, portal: 172.16.0.220,3260] successful.
Aug 09 15:16:50 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:16:50 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2267629-52cf-439c-9083-3e8384c67f08 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:16:50 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2267629-52cf-439c-9083-3e8384c67f08 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:16:50 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[20e5fb75-e0a3-4bae-8032-dd45886b5c4a]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:16:50 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:16:50 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:16:50 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:16:50 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaec0c5e-11bd-4429-88e2-61b13aab7df5]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2267629-52cf-439c-9083-3e8384c67f08 (non-flash)\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:16:50 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2267629-52cf-439c-9083-3e8384c67f08 (non-flash)
Aug 09 15:16:50 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 15:16:50 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2267629-52cf-439c-9083-3e8384c67f08 (non-flash)
Aug 09 15:16:50 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 15:16:50 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e2267629-52cf-439c-9083-3e8384c67f08" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.271s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 15:16:50 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] Connected to 172.16.0.220:3260 {{(pid=72382) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 15:16:50 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=72382) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 15:16:50 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72382) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 15:16:50 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:16:50 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:16:50 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f3120d0-72bf-4581-b9ac-a783d529b2cb]: (4, ('- - 0', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:16:50 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72382) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 15:16:50 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rDYvqdHM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72382) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 15:16:51 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.299s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 15:16:51 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] <== connect_volume: return (1300ms) {'type': 'block', 'scsi_wwn': '26466656464623962', 'path': '/dev/sdb'} {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 15:16:51 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] [instance: f1b4f73b-7a9e-4cf1-9d51-f32284f49c53] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26466656464623962', 'path': '/dev/sdb'} {{(pid=72382) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 15:16:51 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] [instance: f1b4f73b-7a9e-4cf1-9d51-f32284f49c53] Calling os-brick to attach iSCSI Volume {{(pid=72382) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 15:16:51 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2a0c768340>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:5a13916f-1416-4b94-9e10-96f9e6415753'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FDiNaqEe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 15:16:51 user nova-compute[72382]: WARNING os_brick.initiator.connectors.base [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 15:16:51 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 15:16:51 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 15:16:51 user nova-compute[72382]: WARNING os_brick.initiator.connectors.base [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 15:16:51 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5a13916f-1416-4b94-9e10-96f9e6415753" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 15:16:51 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5a13916f-1416-4b94-9e10-96f9e6415753" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 15:16:51 user nova-compute[72382]: INFO os_brick.initiator.connectors.iscsi [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 15:16:51 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a13916f-1416-4b94-9e10-96f9e6415753 -p 172.16.0.220:3260 {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:16:51 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a13916f-1416-4b94-9e10-96f9e6415753 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:16:51 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[fafa1ff6-fc0f-4d2b-8681-cbba255cbd44]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:16:51 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 15:16:51 user nova-compute[72382]:  {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:16:51 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a13916f-1416-4b94-9e10-96f9e6415753 -p 172.16.0.220:3260 --interface default --op new {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:16:51 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a13916f-1416-4b94-9e10-96f9e6415753 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:16:51 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[c26b6f6d-7c06-475b-b1ff-762b6e5ba167]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5a13916f-1416-4b94-9e10-96f9e6415753] added\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:16:51 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5a13916f-1416-4b94-9e10-96f9e6415753] added
Aug 09 15:16:51 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:16:51 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a13916f-1416-4b94-9e10-96f9e6415753 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:16:51 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a13916f-1416-4b94-9e10-96f9e6415753 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.016s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:16:51 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[11265592-7646-46e6-a4f7-ce6c7c93a292]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:16:51 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:16:51 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a13916f-1416-4b94-9e10-96f9e6415753 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:16:51 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a13916f-1416-4b94-9e10-96f9e6415753 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:16:51 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee8a1b3e-a56d-40a6-92f5-edf77187479b]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:16:51 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:16:51 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a13916f-1416-4b94-9e10-96f9e6415753 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FDiNaqEe {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:16:51 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a13916f-1416-4b94-9e10-96f9e6415753 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FDiNaqEe" returned: 0 in 0.017s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:16:51 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d39474d-cdad-4d63-b155-417798bc98ab]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:16:51 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FDiNaqEe'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:16:51 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a13916f-1416-4b94-9e10-96f9e6415753 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:16:51 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a13916f-1416-4b94-9e10-96f9e6415753 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:16:51 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[880bea2c-8a87-43db-9b32-3f6ac4f37b95]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:16:51 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:16:51 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:16:51 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:16:51 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6b4b9e1-06f5-44ac-b909-173acb91f915]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2267629-52cf-439c-9083-3e8384c67f08 (non-flash)\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:16:51 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2267629-52cf-439c-9083-3e8384c67f08 (non-flash)
Aug 09 15:16:51 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 15:16:51 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2267629-52cf-439c-9083-3e8384c67f08 (non-flash)
Aug 09 15:16:51 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 15:16:51 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a13916f-1416-4b94-9e10-96f9e6415753 -p 172.16.0.220:3260 --login {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:16:51 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a13916f-1416-4b94-9e10-96f9e6415753 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:16:51 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5456389-f443-4732-9f48-32a79189334f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5a13916f-1416-4b94-9e10-96f9e6415753, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5a13916f-1416-4b94-9e10-96f9e6415753, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:16:51 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5a13916f-1416-4b94-9e10-96f9e6415753, portal: 172.16.0.220,3260]
Aug 09 15:16:51 user nova-compute[72382]: Login to [iface: default, target: iqn.2010-10.org.openstack:5a13916f-1416-4b94-9e10-96f9e6415753, portal: 172.16.0.220,3260] successful.
Aug 09 15:16:51 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:16:51 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a13916f-1416-4b94-9e10-96f9e6415753 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:16:51 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a13916f-1416-4b94-9e10-96f9e6415753 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:16:51 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[74dc3a55-e976-415e-a352-63064f60e33d]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:16:51 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:16:51 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:16:51 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:16:51 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cae39c8-6beb-4647-89b1-fd58e486ceaa]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2267629-52cf-439c-9083-3e8384c67f08 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a13916f-1416-4b94-9e10-96f9e6415753 (non-flash)\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:16:51 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2267629-52cf-439c-9083-3e8384c67f08 (non-flash)
Aug 09 15:16:51 user nova-compute[72382]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a13916f-1416-4b94-9e10-96f9e6415753 (non-flash)
Aug 09 15:16:51 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 15:16:51 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2267629-52cf-439c-9083-3e8384c67f08 (non-flash)
Aug 09 15:16:51 user nova-compute[72382]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a13916f-1416-4b94-9e10-96f9e6415753 (non-flash)
Aug 09 15:16:51 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 15:16:51 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5a13916f-1416-4b94-9e10-96f9e6415753" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.254s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 15:16:51 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] Connected to 172.16.0.220:3260 {{(pid=72382) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 15:16:51 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=72382) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 15:16:51 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72382) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 15:16:51 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:16:51 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:16:51 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab23c210-b078-46c9-bb9a-949835712716]: (4, ('- - 0', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:16:51 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: None {{(pid=72382) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 15:16:52 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72382) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 15:16:52 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FDiNaqEe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72382) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 15:16:52 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.281s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 15:16:52 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] <== connect_volume: return (1282ms) {'type': 'block', 'scsi_wwn': '23839616231333661', 'path': '/dev/sdc'} {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 15:16:52 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] [instance: f1b4f73b-7a9e-4cf1-9d51-f32284f49c53] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23839616231333661', 'path': '/dev/sdc'} {{(pid=72382) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 15:16:52 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] [instance: f1b4f73b-7a9e-4cf1-9d51-f32284f49c53] Calling os-brick to attach iSCSI Volume {{(pid=72382) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 15:16:52 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2a0c768340>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:16ef1023-88b6-4e22-9b4b-45515b25ca9b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lseWJYAz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 15:16:52 user nova-compute[72382]: WARNING os_brick.initiator.connectors.base [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 15:16:52 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 15:16:52 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 15:16:52 user nova-compute[72382]: WARNING os_brick.initiator.connectors.base [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 15:16:52 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:16ef1023-88b6-4e22-9b4b-45515b25ca9b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 15:16:52 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:16ef1023-88b6-4e22-9b4b-45515b25ca9b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 15:16:52 user nova-compute[72382]: INFO os_brick.initiator.connectors.iscsi [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 15:16:52 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16ef1023-88b6-4e22-9b4b-45515b25ca9b -p 172.16.0.220:3260 {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:16:52 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16ef1023-88b6-4e22-9b4b-45515b25ca9b -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:16:52 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccbdc0f1-044a-46a8-a504-cf6fd73e4866]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:16:52 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 15:16:52 user nova-compute[72382]:  {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:16:52 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16ef1023-88b6-4e22-9b4b-45515b25ca9b -p 172.16.0.220:3260 --interface default --op new {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:16:52 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16ef1023-88b6-4e22-9b4b-45515b25ca9b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:16:52 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cc11f28-b158-48fc-99dc-fb8d3e7f9ec6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:16ef1023-88b6-4e22-9b4b-45515b25ca9b] added\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:16:52 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:16ef1023-88b6-4e22-9b4b-45515b25ca9b] added
Aug 09 15:16:52 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:16:52 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16ef1023-88b6-4e22-9b4b-45515b25ca9b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:16:52 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16ef1023-88b6-4e22-9b4b-45515b25ca9b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:16:52 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9f2579c-1c31-4a8c-983c-8ab248537dc2]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:16:52 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:16:52 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16ef1023-88b6-4e22-9b4b-45515b25ca9b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:16:52 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16ef1023-88b6-4e22-9b4b-45515b25ca9b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:16:52 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[24197c71-726e-4ce9-8e53-1250f4d1f5bf]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:16:52 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:16:52 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16ef1023-88b6-4e22-9b4b-45515b25ca9b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lseWJYAz {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:16:52 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16ef1023-88b6-4e22-9b4b-45515b25ca9b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lseWJYAz" returned: 0 in 0.018s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:16:52 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[8606a45b-8deb-4b02-80d8-79a2fe2e0bbe]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:16:52 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lseWJYAz'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:16:52 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16ef1023-88b6-4e22-9b4b-45515b25ca9b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:16:52 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16ef1023-88b6-4e22-9b4b-45515b25ca9b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:16:52 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbe39162-dcbd-4942-923b-aa989ec2e495]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:16:52 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:16:52 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:16:52 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:16:52 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[9389c0fb-c54c-4e78-a1ff-b56bbb94d0d7]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2267629-52cf-439c-9083-3e8384c67f08 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a13916f-1416-4b94-9e10-96f9e6415753 (non-flash)\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:16:52 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2267629-52cf-439c-9083-3e8384c67f08 (non-flash)
Aug 09 15:16:52 user nova-compute[72382]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a13916f-1416-4b94-9e10-96f9e6415753 (non-flash)
Aug 09 15:16:52 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 15:16:52 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2267629-52cf-439c-9083-3e8384c67f08 (non-flash)
Aug 09 15:16:52 user nova-compute[72382]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a13916f-1416-4b94-9e10-96f9e6415753 (non-flash)
Aug 09 15:16:52 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 15:16:52 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16ef1023-88b6-4e22-9b4b-45515b25ca9b -p 172.16.0.220:3260 --login {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:16:52 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16ef1023-88b6-4e22-9b4b-45515b25ca9b -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:16:52 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[b31d3ddc-48c5-4716-9c1d-d6fa74ba4fd0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:16ef1023-88b6-4e22-9b4b-45515b25ca9b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:16ef1023-88b6-4e22-9b4b-45515b25ca9b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:16:52 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:16ef1023-88b6-4e22-9b4b-45515b25ca9b, portal: 172.16.0.220,3260]
Aug 09 15:16:52 user nova-compute[72382]: Login to [iface: default, target: iqn.2010-10.org.openstack:16ef1023-88b6-4e22-9b4b-45515b25ca9b, portal: 172.16.0.220,3260] successful.
Aug 09 15:16:52 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:16:52 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16ef1023-88b6-4e22-9b4b-45515b25ca9b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:16:52 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16ef1023-88b6-4e22-9b4b-45515b25ca9b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:16:52 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[1643906a-089f-4061-818b-4312dc2e7ae4]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:16:52 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:16:52 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:16:52 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:16:52 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[248d632d-31b5-44d9-9f6c-c06b9f09d6b9]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2267629-52cf-439c-9083-3e8384c67f08 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a13916f-1416-4b94-9e10-96f9e6415753 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16ef1023-88b6-4e22-9b4b-45515b25ca9b (non-flash)\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:16:52 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2267629-52cf-439c-9083-3e8384c67f08 (non-flash)
Aug 09 15:16:52 user nova-compute[72382]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a13916f-1416-4b94-9e10-96f9e6415753 (non-flash)
Aug 09 15:16:52 user nova-compute[72382]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16ef1023-88b6-4e22-9b4b-45515b25ca9b (non-flash)
Aug 09 15:16:52 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 15:16:52 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2267629-52cf-439c-9083-3e8384c67f08 (non-flash)
Aug 09 15:16:52 user nova-compute[72382]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a13916f-1416-4b94-9e10-96f9e6415753 (non-flash)
Aug 09 15:16:52 user nova-compute[72382]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16ef1023-88b6-4e22-9b4b-45515b25ca9b (non-flash)
Aug 09 15:16:52 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 15:16:52 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:16ef1023-88b6-4e22-9b4b-45515b25ca9b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.269s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 15:16:52 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] Connected to 172.16.0.220:3260 {{(pid=72382) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 15:16:52 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] HCTL ('35', '-', '-', 0) found on session 4 with lun 0 {{(pid=72382) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 15:16:52 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72382) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 15:16:52 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:16:52 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:16:52 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[37e7bcbe-970e-40ed-a733-f86a227effa5]: (4, ('- - 0', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:16:52 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72382) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 15:16:52 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lseWJYAz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72382) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 15:16:53 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.299s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 15:16:53 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] <== connect_volume: return (1300ms) {'type': 'block', 'scsi_wwn': '26539366366663334', 'path': '/dev/sdd'} {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 15:16:53 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] [instance: f1b4f73b-7a9e-4cf1-9d51-f32284f49c53] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26539366366663334', 'path': '/dev/sdd'} {{(pid=72382) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 15:16:53 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:16:53 user nova-compute[72382]: DEBUG nova.virt.libvirt.vif [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T15:16:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-572693492',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-572693492',id=12,image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMb7zhMvTYtSMjdbttccgrhGtZnLO3To5atuqn2KzXxPdjBeWNkfUC7xHzQcOqU2f9y/wGWlWICsIErR+5PTjvgcRPYq/Fn5iownuIQu/C79E2xKR9om6708gJPHzSBRPQ==',key_name='tempest-keypair-767486892',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7345242bf74a4b91a057182d9b5172c4',ramdisk_id='',reservation_id='r-oprrtn26',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1008702709',owner_user_name='tempest-TaggedBootDevicesTest-1008702709-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T15:16:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4a14592e76e2409aa5baf44221d227a4',uuid=f1b4f73b-7a9e-4cf1-9d51-f32284f49c53,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d031358f-2670-4942-9266-d9db448a078b", "address": "fa:16:3e:4d:2e:d1", "network": {"id": "6c42873e-d293-4fe2-8d72-d048d58d0141", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1386426199-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7345242bf74a4b91a057182d9b5172c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd031358f-26", "ovs_interfaceid": "d031358f-2670-4942-9266-d9db448a078b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72382) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 15:16:53 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] Converting VIF {"id": "d031358f-2670-4942-9266-d9db448a078b", "address": "fa:16:3e:4d:2e:d1", "network": {"id": "6c42873e-d293-4fe2-8d72-d048d58d0141", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1386426199-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7345242bf74a4b91a057182d9b5172c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd031358f-26", "ovs_interfaceid": "d031358f-2670-4942-9266-d9db448a078b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 15:16:53 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4d:2e:d1,bridge_name='br-int',has_traffic_filtering=True,id=d031358f-2670-4942-9266-d9db448a078b,network=Network(6c42873e-d293-4fe2-8d72-d048d58d0141),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd031358f-26') {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 15:16:53 user nova-compute[72382]: DEBUG nova.virt.libvirt.vif [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T15:16:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-572693492',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-572693492',id=12,image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMb7zhMvTYtSMjdbttccgrhGtZnLO3To5atuqn2KzXxPdjBeWNkfUC7xHzQcOqU2f9y/wGWlWICsIErR+5PTjvgcRPYq/Fn5iownuIQu/C79E2xKR9om6708gJPHzSBRPQ==',key_name='tempest-keypair-767486892',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7345242bf74a4b91a057182d9b5172c4',ramdisk_id='',reservation_id='r-oprrtn26',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1008702709',owner_user_name='tempest-TaggedBootDevicesTest-1008702709-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T15:16:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4a14592e76e2409aa5baf44221d227a4',uuid=f1b4f73b-7a9e-4cf1-9d51-f32284f49c53,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3cea2e31-e2a9-4b8a-976b-ce818aaca460", "address": "fa:16:3e:ef:80:eb", "network": {"id": "b16bed11-36bd-4428-a500-f0ad85bfaf2d", "bridge": "br-int", "label": "tempest-device-tagging-net1-483768340", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.27", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7345242bf74a4b91a057182d9b5172c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3cea2e31-e2", "ovs_interfaceid": "3cea2e31-e2a9-4b8a-976b-ce818aaca460", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72382) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 15:16:53 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] Converting VIF {"id": "3cea2e31-e2a9-4b8a-976b-ce818aaca460", "address": "fa:16:3e:ef:80:eb", "network": {"id": "b16bed11-36bd-4428-a500-f0ad85bfaf2d", "bridge": "br-int", "label": "tempest-device-tagging-net1-483768340", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.27", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7345242bf74a4b91a057182d9b5172c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3cea2e31-e2", "ovs_interfaceid": "3cea2e31-e2a9-4b8a-976b-ce818aaca460", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 15:16:53 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ef:80:eb,bridge_name='br-int',has_traffic_filtering=True,id=3cea2e31-e2a9-4b8a-976b-ce818aaca460,network=Network(b16bed11-36bd-4428-a500-f0ad85bfaf2d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3cea2e31-e2') {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 15:16:53 user nova-compute[72382]: DEBUG nova.virt.libvirt.vif [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T15:16:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-572693492',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-572693492',id=12,image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMb7zhMvTYtSMjdbttccgrhGtZnLO3To5atuqn2KzXxPdjBeWNkfUC7xHzQcOqU2f9y/wGWlWICsIErR+5PTjvgcRPYq/Fn5iownuIQu/C79E2xKR9om6708gJPHzSBRPQ==',key_name='tempest-keypair-767486892',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7345242bf74a4b91a057182d9b5172c4',ramdisk_id='',reservation_id='r-oprrtn26',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1008702709',owner_user_name='tempest-TaggedBootDevicesTest-1008702709-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T15:16:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4a14592e76e2409aa5baf44221d227a4',uuid=f1b4f73b-7a9e-4cf1-9d51-f32284f49c53,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fcd90f6b-ef1b-4f9d-9ced-b98f7be4bc55", "address": "fa:16:3e:90:b6:32", "network": {"id": "b16bed11-36bd-4428-a500-f0ad85bfaf2d", "bridge": "br-int", "label": "tempest-device-tagging-net1-483768340", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.115", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7345242bf74a4b91a057182d9b5172c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcd90f6b-ef", "ovs_interfaceid": "fcd90f6b-ef1b-4f9d-9ced-b98f7be4bc55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72382) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 15:16:53 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] Converting VIF {"id": "fcd90f6b-ef1b-4f9d-9ced-b98f7be4bc55", "address": "fa:16:3e:90:b6:32", "network": {"id": "b16bed11-36bd-4428-a500-f0ad85bfaf2d", "bridge": "br-int", "label": "tempest-device-tagging-net1-483768340", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.115", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7345242bf74a4b91a057182d9b5172c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcd90f6b-ef", "ovs_interfaceid": "fcd90f6b-ef1b-4f9d-9ced-b98f7be4bc55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 15:16:53 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:90:b6:32,bridge_name='br-int',has_traffic_filtering=True,id=fcd90f6b-ef1b-4f9d-9ced-b98f7be4bc55,network=Network(b16bed11-36bd-4428-a500-f0ad85bfaf2d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapfcd90f6b-ef') {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 15:16:53 user nova-compute[72382]: DEBUG nova.virt.libvirt.vif [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T15:16:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-572693492',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-572693492',id=12,image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMb7zhMvTYtSMjdbttccgrhGtZnLO3To5atuqn2KzXxPdjBeWNkfUC7xHzQcOqU2f9y/wGWlWICsIErR+5PTjvgcRPYq/Fn5iownuIQu/C79E2xKR9om6708gJPHzSBRPQ==',key_name='tempest-keypair-767486892',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7345242bf74a4b91a057182d9b5172c4',ramdisk_id='',reservation_id='r-oprrtn26',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1008702709',owner_user_name='tempest-TaggedBootDevicesTest-1008702709-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T15:16:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4a14592e76e2409aa5baf44221d227a4',uuid=f1b4f73b-7a9e-4cf1-9d51-f32284f49c53,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d96a280e-5aeb-4a7c-97da-431e5f42c7f6", "address": "fa:16:3e:90:60:1f", "network": {"id": "b16bed11-36bd-4428-a500-f0ad85bfaf2d", "bridge": "br-int", "label": "tempest-device-tagging-net1-483768340", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.234", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7345242bf74a4b91a057182d9b5172c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd96a280e-5a", "ovs_interfaceid": "d96a280e-5aeb-4a7c-97da-431e5f42c7f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72382) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 15:16:53 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] Converting VIF {"id": "d96a280e-5aeb-4a7c-97da-431e5f42c7f6", "address": "fa:16:3e:90:60:1f", "network": {"id": "b16bed11-36bd-4428-a500-f0ad85bfaf2d", "bridge": "br-int", "label": "tempest-device-tagging-net1-483768340", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.234", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7345242bf74a4b91a057182d9b5172c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd96a280e-5a", "ovs_interfaceid": "d96a280e-5aeb-4a7c-97da-431e5f42c7f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 15:16:53 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:90:60:1f,bridge_name='br-int',has_traffic_filtering=True,id=d96a280e-5aeb-4a7c-97da-431e5f42c7f6,network=Network(b16bed11-36bd-4428-a500-f0ad85bfaf2d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd96a280e-5a') {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 15:16:53 user nova-compute[72382]: DEBUG nova.virt.libvirt.vif [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T15:16:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-572693492',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-572693492',id=12,image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMb7zhMvTYtSMjdbttccgrhGtZnLO3To5atuqn2KzXxPdjBeWNkfUC7xHzQcOqU2f9y/wGWlWICsIErR+5PTjvgcRPYq/Fn5iownuIQu/C79E2xKR9om6708gJPHzSBRPQ==',key_name='tempest-keypair-767486892',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7345242bf74a4b91a057182d9b5172c4',ramdisk_id='',reservation_id='r-oprrtn26',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1008702709',owner_user_name='tempest-TaggedBootDevicesTest-1008702709-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T15:16:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4a14592e76e2409aa5baf44221d227a4',uuid=f1b4f73b-7a9e-4cf1-9d51-f32284f49c53,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "92c19874-960c-4e03-8537-6ae44812a1da", "address": "fa:16:3e:a2:61:33", "network": {"id": "b16bed11-36bd-4428-a500-f0ad85bfaf2d", "bridge": "br-int", "label": "tempest-device-tagging-net1-483768340", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.114", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7345242bf74a4b91a057182d9b5172c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92c19874-96", "ovs_interfaceid": "92c19874-960c-4e03-8537-6ae44812a1da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72382) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 15:16:53 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] Converting VIF {"id": "92c19874-960c-4e03-8537-6ae44812a1da", "address": "fa:16:3e:a2:61:33", "network": {"id": "b16bed11-36bd-4428-a500-f0ad85bfaf2d", "bridge": "br-int", "label": "tempest-device-tagging-net1-483768340", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.114", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7345242bf74a4b91a057182d9b5172c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92c19874-96", "ovs_interfaceid": "92c19874-960c-4e03-8537-6ae44812a1da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 15:16:53 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a2:61:33,bridge_name='br-int',has_traffic_filtering=True,id=92c19874-960c-4e03-8537-6ae44812a1da,network=Network(b16bed11-36bd-4428-a500-f0ad85bfaf2d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92c19874-96') {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 15:16:53 user nova-compute[72382]: DEBUG nova.virt.libvirt.vif [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T15:16:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-572693492',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-572693492',id=12,image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMb7zhMvTYtSMjdbttccgrhGtZnLO3To5atuqn2KzXxPdjBeWNkfUC7xHzQcOqU2f9y/wGWlWICsIErR+5PTjvgcRPYq/Fn5iownuIQu/C79E2xKR9om6708gJPHzSBRPQ==',key_name='tempest-keypair-767486892',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7345242bf74a4b91a057182d9b5172c4',ramdisk_id='',reservation_id='r-oprrtn26',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1008702709',owner_user_name='tempest-TaggedBootDevicesTest-1008702709-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T15:16:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4a14592e76e2409aa5baf44221d227a4',uuid=f1b4f73b-7a9e-4cf1-9d51-f32284f49c53,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6830a784-9d5e-4efe-8b35-9d1713e0c8ce", "address": "fa:16:3e:99:2e:fe", "network": {"id": "5bf13de0-38d0-4177-9863-980a7c39151c", "bridge": "br-int", "label": "tempest-device-tagging-net2-427749890", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7345242bf74a4b91a057182d9b5172c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6830a784-9d", "ovs_interfaceid": "6830a784-9d5e-4efe-8b35-9d1713e0c8ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72382) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 15:16:53 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] Converting VIF {"id": "6830a784-9d5e-4efe-8b35-9d1713e0c8ce", "address": "fa:16:3e:99:2e:fe", "network": {"id": "5bf13de0-38d0-4177-9863-980a7c39151c", "bridge": "br-int", "label": "tempest-device-tagging-net2-427749890", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7345242bf74a4b91a057182d9b5172c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6830a784-9d", "ovs_interfaceid": "6830a784-9d5e-4efe-8b35-9d1713e0c8ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 15:16:53 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:99:2e:fe,bridge_name='br-int',has_traffic_filtering=True,id=6830a784-9d5e-4efe-8b35-9d1713e0c8ce,network=Network(5bf13de0-38d0-4177-9863-980a7c39151c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6830a784-9d') {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 15:16:53 user nova-compute[72382]: DEBUG nova.virt.libvirt.vif [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T15:16:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-572693492',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-572693492',id=12,image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMb7zhMvTYtSMjdbttccgrhGtZnLO3To5atuqn2KzXxPdjBeWNkfUC7xHzQcOqU2f9y/wGWlWICsIErR+5PTjvgcRPYq/Fn5iownuIQu/C79E2xKR9om6708gJPHzSBRPQ==',key_name='tempest-keypair-767486892',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7345242bf74a4b91a057182d9b5172c4',ramdisk_id='',reservation_id='r-oprrtn26',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1008702709',owner_user_name='tempest-TaggedBootDevicesTest-1008702709-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T15:16:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4a14592e76e2409aa5baf44221d227a4',uuid=f1b4f73b-7a9e-4cf1-9d51-f32284f49c53,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "650ae32c-3dec-4bad-8ff0-6ad423e1cb21", "address": "fa:16:3e:c9:be:0b", "network": {"id": "5bf13de0-38d0-4177-9863-980a7c39151c", "bridge": "br-int", "label": "tempest-device-tagging-net2-427749890", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7345242bf74a4b91a057182d9b5172c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap650ae32c-3d", "ovs_interfaceid": "650ae32c-3dec-4bad-8ff0-6ad423e1cb21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72382) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 15:16:53 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] Converting VIF {"id": "650ae32c-3dec-4bad-8ff0-6ad423e1cb21", "address": "fa:16:3e:c9:be:0b", "network": {"id": "5bf13de0-38d0-4177-9863-980a7c39151c", "bridge": "br-int", "label": "tempest-device-tagging-net2-427749890", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7345242bf74a4b91a057182d9b5172c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap650ae32c-3d", "ovs_interfaceid": "650ae32c-3dec-4bad-8ff0-6ad423e1cb21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 15:16:53 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c9:be:0b,bridge_name='br-int',has_traffic_filtering=True,id=650ae32c-3dec-4bad-8ff0-6ad423e1cb21,network=Network(5bf13de0-38d0-4177-9863-980a7c39151c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap650ae32c-3d') {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 15:16:53 user nova-compute[72382]: DEBUG nova.objects.instance [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] Lazy-loading 'pci_devices' on Instance uuid f1b4f73b-7a9e-4cf1-9d51-f32284f49c53 {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:16:53 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] [instance: f1b4f73b-7a9e-4cf1-9d51-f32284f49c53] End _get_guest_xml xml=<domain type="kvm">
Aug 09 15:16:53 user nova-compute[72382]:   <uuid>f1b4f73b-7a9e-4cf1-9d51-f32284f49c53</uuid>
Aug 09 15:16:53 user nova-compute[72382]:   <name>instance-0000000c</name>
Aug 09 15:16:53 user nova-compute[72382]:   <memory>524288</memory>
Aug 09 15:16:53 user nova-compute[72382]:   <vcpu>1</vcpu>
Aug 09 15:16:53 user nova-compute[72382]:   <metadata>
Aug 09 15:16:53 user nova-compute[72382]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 15:16:53 user nova-compute[72382]:       <nova:package version="0.0.0"/>
Aug 09 15:16:53 user nova-compute[72382]:       <nova:name>tempest-device-tagging-server-572693492</nova:name>
Aug 09 15:16:53 user nova-compute[72382]:       <nova:creationTime>2023-08-09 15:16:49</nova:creationTime>
Aug 09 15:16:53 user nova-compute[72382]:       <nova:flavor name="m1.tiny">
Aug 09 15:16:53 user nova-compute[72382]:         <nova:memory>512</nova:memory>
Aug 09 15:16:53 user nova-compute[72382]:         <nova:disk>1</nova:disk>
Aug 09 15:16:53 user nova-compute[72382]:         <nova:swap>0</nova:swap>
Aug 09 15:16:53 user nova-compute[72382]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 15:16:53 user nova-compute[72382]:         <nova:vcpus>1</nova:vcpus>
Aug 09 15:16:53 user nova-compute[72382]:       </nova:flavor>
Aug 09 15:16:53 user nova-compute[72382]:       <nova:owner>
Aug 09 15:16:53 user nova-compute[72382]:         <nova:user uuid="4a14592e76e2409aa5baf44221d227a4">tempest-TaggedBootDevicesTest-1008702709-project-member</nova:user>
Aug 09 15:16:53 user nova-compute[72382]:         <nova:project uuid="7345242bf74a4b91a057182d9b5172c4">tempest-TaggedBootDevicesTest-1008702709</nova:project>
Aug 09 15:16:53 user nova-compute[72382]:       </nova:owner>
Aug 09 15:16:53 user nova-compute[72382]:       <nova:root type="image" uuid="a79f2cea-eb27-4631-aaf3-05e7d9e411b4"/>
Aug 09 15:16:53 user nova-compute[72382]:       <nova:ports>
Aug 09 15:16:53 user nova-compute[72382]:         <nova:port uuid="d031358f-2670-4942-9266-d9db448a078b">
Aug 09 15:16:53 user nova-compute[72382]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 09 15:16:53 user nova-compute[72382]:         </nova:port>
Aug 09 15:16:53 user nova-compute[72382]:         <nova:port uuid="3cea2e31-e2a9-4b8a-976b-ce818aaca460">
Aug 09 15:16:53 user nova-compute[72382]:           <nova:ip type="fixed" address="10.1.1.27" ipVersion="4"/>
Aug 09 15:16:53 user nova-compute[72382]:         </nova:port>
Aug 09 15:16:53 user nova-compute[72382]:         <nova:port uuid="fcd90f6b-ef1b-4f9d-9ced-b98f7be4bc55">
Aug 09 15:16:53 user nova-compute[72382]:           <nova:ip type="fixed" address="10.1.1.115" ipVersion="4"/>
Aug 09 15:16:53 user nova-compute[72382]:         </nova:port>
Aug 09 15:16:53 user nova-compute[72382]:         <nova:port uuid="d96a280e-5aeb-4a7c-97da-431e5f42c7f6">
Aug 09 15:16:53 user nova-compute[72382]:           <nova:ip type="fixed" address="10.1.1.234" ipVersion="4"/>
Aug 09 15:16:53 user nova-compute[72382]:         </nova:port>
Aug 09 15:16:53 user nova-compute[72382]:         <nova:port uuid="92c19874-960c-4e03-8537-6ae44812a1da">
Aug 09 15:16:53 user nova-compute[72382]:           <nova:ip type="fixed" address="10.1.1.114" ipVersion="4"/>
Aug 09 15:16:53 user nova-compute[72382]:         </nova:port>
Aug 09 15:16:53 user nova-compute[72382]:         <nova:port uuid="6830a784-9d5e-4efe-8b35-9d1713e0c8ce">
Aug 09 15:16:53 user nova-compute[72382]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Aug 09 15:16:53 user nova-compute[72382]:         </nova:port>
Aug 09 15:16:53 user nova-compute[72382]:         <nova:port uuid="650ae32c-3dec-4bad-8ff0-6ad423e1cb21">
Aug 09 15:16:53 user nova-compute[72382]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Aug 09 15:16:53 user nova-compute[72382]:         </nova:port>
Aug 09 15:16:53 user nova-compute[72382]:       </nova:ports>
Aug 09 15:16:53 user nova-compute[72382]:     </nova:instance>
Aug 09 15:16:53 user nova-compute[72382]:   </metadata>
Aug 09 15:16:53 user nova-compute[72382]:   <sysinfo type="smbios">
Aug 09 15:16:53 user nova-compute[72382]:     <system>
Aug 09 15:16:53 user nova-compute[72382]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 15:16:53 user nova-compute[72382]:       <entry name="product">OpenStack Nova</entry>
Aug 09 15:16:53 user nova-compute[72382]:       <entry name="version">0.0.0</entry>
Aug 09 15:16:53 user nova-compute[72382]:       <entry name="serial">f1b4f73b-7a9e-4cf1-9d51-f32284f49c53</entry>
Aug 09 15:16:53 user nova-compute[72382]:       <entry name="uuid">f1b4f73b-7a9e-4cf1-9d51-f32284f49c53</entry>
Aug 09 15:16:53 user nova-compute[72382]:       <entry name="family">Virtual Machine</entry>
Aug 09 15:16:53 user nova-compute[72382]:     </system>
Aug 09 15:16:53 user nova-compute[72382]:   </sysinfo>
Aug 09 15:16:53 user nova-compute[72382]:   <os>
Aug 09 15:16:53 user nova-compute[72382]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 15:16:53 user nova-compute[72382]:     <boot dev="hd"/>
Aug 09 15:16:53 user nova-compute[72382]:     <smbios mode="sysinfo"/>
Aug 09 15:16:53 user nova-compute[72382]:   </os>
Aug 09 15:16:53 user nova-compute[72382]:   <features>
Aug 09 15:16:53 user nova-compute[72382]:     <acpi/>
Aug 09 15:16:53 user nova-compute[72382]:     <apic/>
Aug 09 15:16:53 user nova-compute[72382]:     <vmcoreinfo/>
Aug 09 15:16:53 user nova-compute[72382]:   </features>
Aug 09 15:16:53 user nova-compute[72382]:   <clock offset="utc">
Aug 09 15:16:53 user nova-compute[72382]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 15:16:53 user nova-compute[72382]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 15:16:53 user nova-compute[72382]:     <timer name="hpet" present="no"/>
Aug 09 15:16:53 user nova-compute[72382]:   </clock>
Aug 09 15:16:53 user nova-compute[72382]:   <cpu mode="custom" match="exact">
Aug 09 15:16:53 user nova-compute[72382]:     <model>Nehalem</model>
Aug 09 15:16:53 user nova-compute[72382]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 15:16:53 user nova-compute[72382]:   </cpu>
Aug 09 15:16:53 user nova-compute[72382]:   <devices>
Aug 09 15:16:53 user nova-compute[72382]:     <disk type="file" device="cdrom">
Aug 09 15:16:53 user nova-compute[72382]:       <driver name="qemu" type="raw" cache="none"/>
Aug 09 15:16:53 user nova-compute[72382]:       <source file="/opt/stack/data/nova/instances/f1b4f73b-7a9e-4cf1-9d51-f32284f49c53/disk.config"/>
Aug 09 15:16:53 user nova-compute[72382]:       <target dev="hda" bus="ide"/>
Aug 09 15:16:53 user nova-compute[72382]:     </disk>
Aug 09 15:16:53 user nova-compute[72382]:     <disk type="block" device="disk">
Aug 09 15:16:53 user nova-compute[72382]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 15:16:53 user nova-compute[72382]:       <source dev="/dev/sdb"/>
Aug 09 15:16:53 user nova-compute[72382]:       <target dev="vda" bus="virtio"/>
Aug 09 15:16:53 user nova-compute[72382]:       <serial>e2267629-52cf-439c-9083-3e8384c67f08</serial>
Aug 09 15:16:53 user nova-compute[72382]:     </disk>
Aug 09 15:16:53 user nova-compute[72382]:     <disk type="block" device="disk">
Aug 09 15:16:53 user nova-compute[72382]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 15:16:53 user nova-compute[72382]:       <source dev="/dev/sdc"/>
Aug 09 15:16:53 user nova-compute[72382]:       <target dev="vdb" bus="virtio"/>
Aug 09 15:16:53 user nova-compute[72382]:       <serial>5a13916f-1416-4b94-9e10-96f9e6415753</serial>
Aug 09 15:16:53 user nova-compute[72382]:     </disk>
Aug 09 15:16:53 user nova-compute[72382]:     <disk type="block" device="disk">
Aug 09 15:16:53 user nova-compute[72382]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 15:16:53 user nova-compute[72382]:       <source dev="/dev/sdd"/>
Aug 09 15:16:53 user nova-compute[72382]:       <target dev="vdc" bus="virtio"/>
Aug 09 15:16:53 user nova-compute[72382]:       <serial>16ef1023-88b6-4e22-9b4b-45515b25ca9b</serial>
Aug 09 15:16:53 user nova-compute[72382]:     </disk>
Aug 09 15:16:53 user nova-compute[72382]:     <interface type="ethernet">
Aug 09 15:16:53 user nova-compute[72382]:       <mac address="fa:16:3e:4d:2e:d1"/>
Aug 09 15:16:53 user nova-compute[72382]:       <model type="virtio"/>
Aug 09 15:16:53 user nova-compute[72382]:       <mtu size="1442"/>
Aug 09 15:16:53 user nova-compute[72382]:       <target dev="tapd031358f-26"/>
Aug 09 15:16:53 user nova-compute[72382]:     </interface>
Aug 09 15:16:53 user nova-compute[72382]:     <interface type="ethernet">
Aug 09 15:16:53 user nova-compute[72382]:       <mac address="fa:16:3e:ef:80:eb"/>
Aug 09 15:16:53 user nova-compute[72382]:       <model type="virtio"/>
Aug 09 15:16:53 user nova-compute[72382]:       <mtu size="1442"/>
Aug 09 15:16:53 user nova-compute[72382]:       <target dev="tap3cea2e31-e2"/>
Aug 09 15:16:53 user nova-compute[72382]:     </interface>
Aug 09 15:16:53 user nova-compute[72382]:     <interface type="ethernet">
Aug 09 15:16:53 user nova-compute[72382]:       <mac address="fa:16:3e:90:b6:32"/>
Aug 09 15:16:53 user nova-compute[72382]:       <model type="virtio"/>
Aug 09 15:16:53 user nova-compute[72382]:       <mtu size="1442"/>
Aug 09 15:16:53 user nova-compute[72382]:       <target dev="tapfcd90f6b-ef"/>
Aug 09 15:16:53 user nova-compute[72382]:     </interface>
Aug 09 15:16:53 user nova-compute[72382]:     <interface type="ethernet">
Aug 09 15:16:53 user nova-compute[72382]:       <mac address="fa:16:3e:90:60:1f"/>
Aug 09 15:16:53 user nova-compute[72382]:       <model type="virtio"/>
Aug 09 15:16:53 user nova-compute[72382]:       <mtu size="1442"/>
Aug 09 15:16:53 user nova-compute[72382]:       <target dev="tapd96a280e-5a"/>
Aug 09 15:16:53 user nova-compute[72382]:     </interface>
Aug 09 15:16:53 user nova-compute[72382]:     <interface type="ethernet">
Aug 09 15:16:53 user nova-compute[72382]:       <mac address="fa:16:3e:a2:61:33"/>
Aug 09 15:16:53 user nova-compute[72382]:       <model type="virtio"/>
Aug 09 15:16:53 user nova-compute[72382]:       <mtu size="1442"/>
Aug 09 15:16:53 user nova-compute[72382]:       <target dev="tap92c19874-96"/>
Aug 09 15:16:53 user nova-compute[72382]:     </interface>
Aug 09 15:16:53 user nova-compute[72382]:     <interface type="ethernet">
Aug 09 15:16:53 user nova-compute[72382]:       <mac address="fa:16:3e:99:2e:fe"/>
Aug 09 15:16:53 user nova-compute[72382]:       <model type="virtio"/>
Aug 09 15:16:53 user nova-compute[72382]:       <mtu size="1442"/>
Aug 09 15:16:53 user nova-compute[72382]:       <target dev="tap6830a784-9d"/>
Aug 09 15:16:53 user nova-compute[72382]:     </interface>
Aug 09 15:16:53 user nova-compute[72382]:     <interface type="ethernet">
Aug 09 15:16:53 user nova-compute[72382]:       <mac address="fa:16:3e:c9:be:0b"/>
Aug 09 15:16:53 user nova-compute[72382]:       <model type="virtio"/>
Aug 09 15:16:53 user nova-compute[72382]:       <mtu size="1442"/>
Aug 09 15:16:53 user nova-compute[72382]:       <target dev="tap650ae32c-3d"/>
Aug 09 15:16:53 user nova-compute[72382]:     </interface>
Aug 09 15:16:53 user nova-compute[72382]:     <serial type="pty">
Aug 09 15:16:53 user nova-compute[72382]:       <log file="/opt/stack/data/nova/instances/f1b4f73b-7a9e-4cf1-9d51-f32284f49c53/console.log" append="off"/>
Aug 09 15:16:53 user nova-compute[72382]:     </serial>
Aug 09 15:16:53 user nova-compute[72382]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 15:16:53 user nova-compute[72382]:     <video>
Aug 09 15:16:53 user nova-compute[72382]:       <model type="virtio"/>
Aug 09 15:16:53 user nova-compute[72382]:     </video>
Aug 09 15:16:53 user nova-compute[72382]:     <rng model="virtio">
Aug 09 15:16:53 user nova-compute[72382]:       <backend model="random">/dev/urandom</backend>
Aug 09 15:16:53 user nova-compute[72382]:     </rng>
Aug 09 15:16:53 user nova-compute[72382]:     <controller type="usb" index="0" model="none"/>
Aug 09 15:16:53 user nova-compute[72382]:     <memballoon model="virtio">
Aug 09 15:16:53 user nova-compute[72382]:       <stats period="10"/>
Aug 09 15:16:53 user nova-compute[72382]:     </memballoon>
Aug 09 15:16:53 user nova-compute[72382]:   </devices>
Aug 09 15:16:53 user nova-compute[72382]: </domain>
Aug 09 15:16:53 user nova-compute[72382]:  {{(pid=72382) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 15:16:53 user nova-compute[72382]: DEBUG nova.virt.libvirt.vif [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T15:16:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-572693492',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-572693492',id=12,image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMb7zhMvTYtSMjdbttccgrhGtZnLO3To5atuqn2KzXxPdjBeWNkfUC7xHzQcOqU2f9y/wGWlWICsIErR+5PTjvgcRPYq/Fn5iownuIQu/C79E2xKR9om6708gJPHzSBRPQ==',key_name='tempest-keypair-767486892',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7345242bf74a4b91a057182d9b5172c4',ramdisk_id='',reservation_id='r-oprrtn26',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1008702709',owner_user_name='tempest-TaggedBootDevicesTest-1008702709-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T15:16:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4a14592e76e2409aa5baf44221d227a4',uuid=f1b4f73b-7a9e-4cf1-9d51-f32284f49c53,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d031358f-2670-4942-9266-d9db448a078b", "address": "fa:16:3e:4d:2e:d1", "network": {"id": "6c42873e-d293-4fe2-8d72-d048d58d0141", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1386426199-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7345242bf74a4b91a057182d9b5172c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd031358f-26", "ovs_interfaceid": "d031358f-2670-4942-9266-d9db448a078b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 15:16:53 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] Converting VIF {"id": "d031358f-2670-4942-9266-d9db448a078b", "address": "fa:16:3e:4d:2e:d1", "network": {"id": "6c42873e-d293-4fe2-8d72-d048d58d0141", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1386426199-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7345242bf74a4b91a057182d9b5172c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd031358f-26", "ovs_interfaceid": "d031358f-2670-4942-9266-d9db448a078b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 15:16:53 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4d:2e:d1,bridge_name='br-int',has_traffic_filtering=True,id=d031358f-2670-4942-9266-d9db448a078b,network=Network(6c42873e-d293-4fe2-8d72-d048d58d0141),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd031358f-26') {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 15:16:53 user nova-compute[72382]: DEBUG os_vif [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4d:2e:d1,bridge_name='br-int',has_traffic_filtering=True,id=d031358f-2670-4942-9266-d9db448a078b,network=Network(6c42873e-d293-4fe2-8d72-d048d58d0141),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd031358f-26') {{(pid=72382) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 15:16:53 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:16:53 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:16:53 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 15:16:53 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:16:53 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd031358f-26, may_exist=True, interface_attrs={}) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:16:53 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd031358f-26, col_values=(('external_ids', {'iface-id': 'd031358f-2670-4942-9266-d9db448a078b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4d:2e:d1', 'vm-uuid': 'f1b4f73b-7a9e-4cf1-9d51-f32284f49c53'}),), if_exists=True) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:16:53 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:16:53 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:16:53 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:16:53 user nova-compute[72382]: INFO os_vif [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4d:2e:d1,bridge_name='br-int',has_traffic_filtering=True,id=d031358f-2670-4942-9266-d9db448a078b,network=Network(6c42873e-d293-4fe2-8d72-d048d58d0141),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd031358f-26')
Aug 09 15:16:53 user nova-compute[72382]: DEBUG nova.virt.libvirt.vif [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T15:16:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-572693492',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-572693492',id=12,image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMb7zhMvTYtSMjdbttccgrhGtZnLO3To5atuqn2KzXxPdjBeWNkfUC7xHzQcOqU2f9y/wGWlWICsIErR+5PTjvgcRPYq/Fn5iownuIQu/C79E2xKR9om6708gJPHzSBRPQ==',key_name='tempest-keypair-767486892',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7345242bf74a4b91a057182d9b5172c4',ramdisk_id='',reservation_id='r-oprrtn26',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1008702709',owner_user_name='tempest-TaggedBootDevicesTest-1008702709-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T15:16:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4a14592e76e2409aa5baf44221d227a4',uuid=f1b4f73b-7a9e-4cf1-9d51-f32284f49c53,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3cea2e31-e2a9-4b8a-976b-ce818aaca460", "address": "fa:16:3e:ef:80:eb", "network": {"id": "b16bed11-36bd-4428-a500-f0ad85bfaf2d", "bridge": "br-int", "label": "tempest-device-tagging-net1-483768340", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.27", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7345242bf74a4b91a057182d9b5172c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3cea2e31-e2", "ovs_interfaceid": "3cea2e31-e2a9-4b8a-976b-ce818aaca460", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72382) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 15:16:53 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] Converting VIF {"id": "3cea2e31-e2a9-4b8a-976b-ce818aaca460", "address": "fa:16:3e:ef:80:eb", "network": {"id": "b16bed11-36bd-4428-a500-f0ad85bfaf2d", "bridge": "br-int", "label": "tempest-device-tagging-net1-483768340", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.27", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7345242bf74a4b91a057182d9b5172c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3cea2e31-e2", "ovs_interfaceid": "3cea2e31-e2a9-4b8a-976b-ce818aaca460", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 15:16:53 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ef:80:eb,bridge_name='br-int',has_traffic_filtering=True,id=3cea2e31-e2a9-4b8a-976b-ce818aaca460,network=Network(b16bed11-36bd-4428-a500-f0ad85bfaf2d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3cea2e31-e2') {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 15:16:53 user nova-compute[72382]: DEBUG os_vif [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ef:80:eb,bridge_name='br-int',has_traffic_filtering=True,id=3cea2e31-e2a9-4b8a-976b-ce818aaca460,network=Network(b16bed11-36bd-4428-a500-f0ad85bfaf2d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3cea2e31-e2') {{(pid=72382) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 15:16:53 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:16:53 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:16:53 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 15:16:53 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:16:53 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3cea2e31-e2, may_exist=True, interface_attrs={}) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:16:53 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3cea2e31-e2, col_values=(('external_ids', {'iface-id': '3cea2e31-e2a9-4b8a-976b-ce818aaca460', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ef:80:eb', 'vm-uuid': 'f1b4f73b-7a9e-4cf1-9d51-f32284f49c53'}),), if_exists=True) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:16:53 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:16:53 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:16:53 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:16:53 user nova-compute[72382]: INFO os_vif [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ef:80:eb,bridge_name='br-int',has_traffic_filtering=True,id=3cea2e31-e2a9-4b8a-976b-ce818aaca460,network=Network(b16bed11-36bd-4428-a500-f0ad85bfaf2d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3cea2e31-e2')
Aug 09 15:16:53 user nova-compute[72382]: DEBUG nova.virt.libvirt.vif [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T15:16:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-572693492',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-572693492',id=12,image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMb7zhMvTYtSMjdbttccgrhGtZnLO3To5atuqn2KzXxPdjBeWNkfUC7xHzQcOqU2f9y/wGWlWICsIErR+5PTjvgcRPYq/Fn5iownuIQu/C79E2xKR9om6708gJPHzSBRPQ==',key_name='tempest-keypair-767486892',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7345242bf74a4b91a057182d9b5172c4',ramdisk_id='',reservation_id='r-oprrtn26',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1008702709',owner_user_name='tempest-TaggedBootDevicesTest-1008702709-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T15:16:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4a14592e76e2409aa5baf44221d227a4',uuid=f1b4f73b-7a9e-4cf1-9d51-f32284f49c53,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fcd90f6b-ef1b-4f9d-9ced-b98f7be4bc55", "address": "fa:16:3e:90:b6:32", "network": {"id": "b16bed11-36bd-4428-a500-f0ad85bfaf2d", "bridge": "br-int", "label": "tempest-device-tagging-net1-483768340", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.115", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7345242bf74a4b91a057182d9b5172c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcd90f6b-ef", "ovs_interfaceid": "fcd90f6b-ef1b-4f9d-9ced-b98f7be4bc55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72382) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 15:16:53 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] Converting VIF {"id": "fcd90f6b-ef1b-4f9d-9ced-b98f7be4bc55", "address": "fa:16:3e:90:b6:32", "network": {"id": "b16bed11-36bd-4428-a500-f0ad85bfaf2d", "bridge": "br-int", "label": "tempest-device-tagging-net1-483768340", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.115", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7345242bf74a4b91a057182d9b5172c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcd90f6b-ef", "ovs_interfaceid": "fcd90f6b-ef1b-4f9d-9ced-b98f7be4bc55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 15:16:53 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:90:b6:32,bridge_name='br-int',has_traffic_filtering=True,id=fcd90f6b-ef1b-4f9d-9ced-b98f7be4bc55,network=Network(b16bed11-36bd-4428-a500-f0ad85bfaf2d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapfcd90f6b-ef') {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 15:16:53 user nova-compute[72382]: DEBUG os_vif [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:90:b6:32,bridge_name='br-int',has_traffic_filtering=True,id=fcd90f6b-ef1b-4f9d-9ced-b98f7be4bc55,network=Network(b16bed11-36bd-4428-a500-f0ad85bfaf2d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapfcd90f6b-ef') {{(pid=72382) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 15:16:53 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:16:53 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:16:53 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 15:16:53 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:16:53 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfcd90f6b-ef, may_exist=True, interface_attrs={}) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:16:53 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapfcd90f6b-ef, col_values=(('external_ids', {'iface-id': 'fcd90f6b-ef1b-4f9d-9ced-b98f7be4bc55', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:90:b6:32', 'vm-uuid': 'f1b4f73b-7a9e-4cf1-9d51-f32284f49c53'}),), if_exists=True) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:16:53 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:16:53 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:16:53 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:16:53 user nova-compute[72382]: INFO os_vif [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:90:b6:32,bridge_name='br-int',has_traffic_filtering=True,id=fcd90f6b-ef1b-4f9d-9ced-b98f7be4bc55,network=Network(b16bed11-36bd-4428-a500-f0ad85bfaf2d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapfcd90f6b-ef')
Aug 09 15:16:53 user nova-compute[72382]: DEBUG nova.virt.libvirt.vif [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T15:16:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-572693492',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-572693492',id=12,image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMb7zhMvTYtSMjdbttccgrhGtZnLO3To5atuqn2KzXxPdjBeWNkfUC7xHzQcOqU2f9y/wGWlWICsIErR+5PTjvgcRPYq/Fn5iownuIQu/C79E2xKR9om6708gJPHzSBRPQ==',key_name='tempest-keypair-767486892',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7345242bf74a4b91a057182d9b5172c4',ramdisk_id='',reservation_id='r-oprrtn26',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1008702709',owner_user_name='tempest-TaggedBootDevicesTest-1008702709-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T15:16:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4a14592e76e2409aa5baf44221d227a4',uuid=f1b4f73b-7a9e-4cf1-9d51-f32284f49c53,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d96a280e-5aeb-4a7c-97da-431e5f42c7f6", "address": "fa:16:3e:90:60:1f", "network": {"id": "b16bed11-36bd-4428-a500-f0ad85bfaf2d", "bridge": "br-int", "label": "tempest-device-tagging-net1-483768340", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.234", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7345242bf74a4b91a057182d9b5172c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd96a280e-5a", "ovs_interfaceid": "d96a280e-5aeb-4a7c-97da-431e5f42c7f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 15:16:53 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] Converting VIF {"id": "d96a280e-5aeb-4a7c-97da-431e5f42c7f6", "address": "fa:16:3e:90:60:1f", "network": {"id": "b16bed11-36bd-4428-a500-f0ad85bfaf2d", "bridge": "br-int", "label": "tempest-device-tagging-net1-483768340", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.234", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7345242bf74a4b91a057182d9b5172c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd96a280e-5a", "ovs_interfaceid": "d96a280e-5aeb-4a7c-97da-431e5f42c7f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 15:16:53 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:90:60:1f,bridge_name='br-int',has_traffic_filtering=True,id=d96a280e-5aeb-4a7c-97da-431e5f42c7f6,network=Network(b16bed11-36bd-4428-a500-f0ad85bfaf2d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd96a280e-5a') {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 15:16:53 user nova-compute[72382]: DEBUG os_vif [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:90:60:1f,bridge_name='br-int',has_traffic_filtering=True,id=d96a280e-5aeb-4a7c-97da-431e5f42c7f6,network=Network(b16bed11-36bd-4428-a500-f0ad85bfaf2d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd96a280e-5a') {{(pid=72382) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 15:16:53 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:16:53 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:16:53 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 15:16:53 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:16:53 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd96a280e-5a, may_exist=True, interface_attrs={}) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:16:53 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd96a280e-5a, col_values=(('external_ids', {'iface-id': 'd96a280e-5aeb-4a7c-97da-431e5f42c7f6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:90:60:1f', 'vm-uuid': 'f1b4f73b-7a9e-4cf1-9d51-f32284f49c53'}),), if_exists=True) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:16:53 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:16:53 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:16:53 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:16:53 user nova-compute[72382]: INFO os_vif [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:90:60:1f,bridge_name='br-int',has_traffic_filtering=True,id=d96a280e-5aeb-4a7c-97da-431e5f42c7f6,network=Network(b16bed11-36bd-4428-a500-f0ad85bfaf2d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd96a280e-5a')
Aug 09 15:16:53 user nova-compute[72382]: DEBUG nova.virt.libvirt.vif [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T15:16:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-572693492',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-572693492',id=12,image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMb7zhMvTYtSMjdbttccgrhGtZnLO3To5atuqn2KzXxPdjBeWNkfUC7xHzQcOqU2f9y/wGWlWICsIErR+5PTjvgcRPYq/Fn5iownuIQu/C79E2xKR9om6708gJPHzSBRPQ==',key_name='tempest-keypair-767486892',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7345242bf74a4b91a057182d9b5172c4',ramdisk_id='',reservation_id='r-oprrtn26',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1008702709',owner_user_name='tempest-TaggedBootDevicesTest-1008702709-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T15:16:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4a14592e76e2409aa5baf44221d227a4',uuid=f1b4f73b-7a9e-4cf1-9d51-f32284f49c53,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "92c19874-960c-4e03-8537-6ae44812a1da", "address": "fa:16:3e:a2:61:33", "network": {"id": "b16bed11-36bd-4428-a500-f0ad85bfaf2d", "bridge": "br-int", "label": "tempest-device-tagging-net1-483768340", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.114", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7345242bf74a4b91a057182d9b5172c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92c19874-96", "ovs_interfaceid": "92c19874-960c-4e03-8537-6ae44812a1da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 15:16:53 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] Converting VIF {"id": "92c19874-960c-4e03-8537-6ae44812a1da", "address": "fa:16:3e:a2:61:33", "network": {"id": "b16bed11-36bd-4428-a500-f0ad85bfaf2d", "bridge": "br-int", "label": "tempest-device-tagging-net1-483768340", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.114", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7345242bf74a4b91a057182d9b5172c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92c19874-96", "ovs_interfaceid": "92c19874-960c-4e03-8537-6ae44812a1da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 15:16:53 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a2:61:33,bridge_name='br-int',has_traffic_filtering=True,id=92c19874-960c-4e03-8537-6ae44812a1da,network=Network(b16bed11-36bd-4428-a500-f0ad85bfaf2d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92c19874-96') {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 15:16:53 user nova-compute[72382]: DEBUG os_vif [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:61:33,bridge_name='br-int',has_traffic_filtering=True,id=92c19874-960c-4e03-8537-6ae44812a1da,network=Network(b16bed11-36bd-4428-a500-f0ad85bfaf2d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92c19874-96') {{(pid=72382) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 15:16:53 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:16:53 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:16:53 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 15:16:53 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:16:53 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap92c19874-96, may_exist=True, interface_attrs={}) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:16:53 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap92c19874-96, col_values=(('external_ids', {'iface-id': '92c19874-960c-4e03-8537-6ae44812a1da', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a2:61:33', 'vm-uuid': 'f1b4f73b-7a9e-4cf1-9d51-f32284f49c53'}),), if_exists=True) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:16:53 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:16:53 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:16:54 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:16:54 user nova-compute[72382]: INFO os_vif [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:61:33,bridge_name='br-int',has_traffic_filtering=True,id=92c19874-960c-4e03-8537-6ae44812a1da,network=Network(b16bed11-36bd-4428-a500-f0ad85bfaf2d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92c19874-96')
Aug 09 15:16:54 user nova-compute[72382]: DEBUG nova.virt.libvirt.vif [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T15:16:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-572693492',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-572693492',id=12,image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMb7zhMvTYtSMjdbttccgrhGtZnLO3To5atuqn2KzXxPdjBeWNkfUC7xHzQcOqU2f9y/wGWlWICsIErR+5PTjvgcRPYq/Fn5iownuIQu/C79E2xKR9om6708gJPHzSBRPQ==',key_name='tempest-keypair-767486892',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7345242bf74a4b91a057182d9b5172c4',ramdisk_id='',reservation_id='r-oprrtn26',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1008702709',owner_user_name='tempest-TaggedBootDevicesTest-1008702709-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T15:16:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4a14592e76e2409aa5baf44221d227a4',uuid=f1b4f73b-7a9e-4cf1-9d51-f32284f49c53,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6830a784-9d5e-4efe-8b35-9d1713e0c8ce", "address": "fa:16:3e:99:2e:fe", "network": {"id": "5bf13de0-38d0-4177-9863-980a7c39151c", "bridge": "br-int", "label": "tempest-device-tagging-net2-427749890", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7345242bf74a4b91a057182d9b5172c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6830a784-9d", "ovs_interfaceid": "6830a784-9d5e-4efe-8b35-9d1713e0c8ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 15:16:54 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] Converting VIF {"id": "6830a784-9d5e-4efe-8b35-9d1713e0c8ce", "address": "fa:16:3e:99:2e:fe", "network": {"id": "5bf13de0-38d0-4177-9863-980a7c39151c", "bridge": "br-int", "label": "tempest-device-tagging-net2-427749890", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7345242bf74a4b91a057182d9b5172c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6830a784-9d", "ovs_interfaceid": "6830a784-9d5e-4efe-8b35-9d1713e0c8ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 15:16:54 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:99:2e:fe,bridge_name='br-int',has_traffic_filtering=True,id=6830a784-9d5e-4efe-8b35-9d1713e0c8ce,network=Network(5bf13de0-38d0-4177-9863-980a7c39151c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6830a784-9d') {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 15:16:54 user nova-compute[72382]: DEBUG os_vif [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:99:2e:fe,bridge_name='br-int',has_traffic_filtering=True,id=6830a784-9d5e-4efe-8b35-9d1713e0c8ce,network=Network(5bf13de0-38d0-4177-9863-980a7c39151c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6830a784-9d') {{(pid=72382) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 15:16:54 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:16:54 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:16:54 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 15:16:54 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:16:54 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6830a784-9d, may_exist=True, interface_attrs={}) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:16:54 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6830a784-9d, col_values=(('external_ids', {'iface-id': '6830a784-9d5e-4efe-8b35-9d1713e0c8ce', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:99:2e:fe', 'vm-uuid': 'f1b4f73b-7a9e-4cf1-9d51-f32284f49c53'}),), if_exists=True) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:16:54 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:16:54 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:16:54 user nova-compute[72382]: INFO os_vif [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:99:2e:fe,bridge_name='br-int',has_traffic_filtering=True,id=6830a784-9d5e-4efe-8b35-9d1713e0c8ce,network=Network(5bf13de0-38d0-4177-9863-980a7c39151c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6830a784-9d')
Aug 09 15:16:54 user nova-compute[72382]: DEBUG nova.virt.libvirt.vif [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T15:16:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-572693492',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-572693492',id=12,image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMb7zhMvTYtSMjdbttccgrhGtZnLO3To5atuqn2KzXxPdjBeWNkfUC7xHzQcOqU2f9y/wGWlWICsIErR+5PTjvgcRPYq/Fn5iownuIQu/C79E2xKR9om6708gJPHzSBRPQ==',key_name='tempest-keypair-767486892',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7345242bf74a4b91a057182d9b5172c4',ramdisk_id='',reservation_id='r-oprrtn26',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1008702709',owner_user_name='tempest-TaggedBootDevicesTest-1008702709-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T15:16:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4a14592e76e2409aa5baf44221d227a4',uuid=f1b4f73b-7a9e-4cf1-9d51-f32284f49c53,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "650ae32c-3dec-4bad-8ff0-6ad423e1cb21", "address": "fa:16:3e:c9:be:0b", "network": {"id": "5bf13de0-38d0-4177-9863-980a7c39151c", "bridge": "br-int", "label": "tempest-device-tagging-net2-427749890", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7345242bf74a4b91a057182d9b5172c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap650ae32c-3d", "ovs_interfaceid": "650ae32c-3dec-4bad-8ff0-6ad423e1cb21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 15:16:54 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] Converting VIF {"id": "650ae32c-3dec-4bad-8ff0-6ad423e1cb21", "address": "fa:16:3e:c9:be:0b", "network": {"id": "5bf13de0-38d0-4177-9863-980a7c39151c", "bridge": "br-int", "label": "tempest-device-tagging-net2-427749890", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7345242bf74a4b91a057182d9b5172c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap650ae32c-3d", "ovs_interfaceid": "650ae32c-3dec-4bad-8ff0-6ad423e1cb21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 15:16:54 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c9:be:0b,bridge_name='br-int',has_traffic_filtering=True,id=650ae32c-3dec-4bad-8ff0-6ad423e1cb21,network=Network(5bf13de0-38d0-4177-9863-980a7c39151c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap650ae32c-3d') {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 15:16:54 user nova-compute[72382]: DEBUG os_vif [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:be:0b,bridge_name='br-int',has_traffic_filtering=True,id=650ae32c-3dec-4bad-8ff0-6ad423e1cb21,network=Network(5bf13de0-38d0-4177-9863-980a7c39151c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap650ae32c-3d') {{(pid=72382) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 15:16:54 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:16:54 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:16:54 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 15:16:54 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:16:54 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap650ae32c-3d, may_exist=True, interface_attrs={}) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:16:54 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap650ae32c-3d, col_values=(('external_ids', {'iface-id': '650ae32c-3dec-4bad-8ff0-6ad423e1cb21', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c9:be:0b', 'vm-uuid': 'f1b4f73b-7a9e-4cf1-9d51-f32284f49c53'}),), if_exists=True) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:16:54 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:16:54 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:16:54 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:16:54 user nova-compute[72382]: INFO os_vif [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:be:0b,bridge_name='br-int',has_traffic_filtering=True,id=650ae32c-3dec-4bad-8ff0-6ad423e1cb21,network=Network(5bf13de0-38d0-4177-9863-980a7c39151c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap650ae32c-3d')
Aug 09 15:16:54 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] No BDM found with device name hda, not building metadata. {{(pid=72382) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 15:16:54 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72382) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 15:16:54 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] No VIF found with MAC fa:16:3e:4d:2e:d1, not building metadata {{(pid=72382) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 15:16:54 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] No VIF found with MAC fa:16:3e:a2:61:33, not building metadata {{(pid=72382) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 15:16:54 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] [instance: f1b4f73b-7a9e-4cf1-9d51-f32284f49c53] Using config drive
Aug 09 15:16:54 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] [instance: f1b4f73b-7a9e-4cf1-9d51-f32284f49c53] Creating config drive at /opt/stack/data/nova/instances/f1b4f73b-7a9e-4cf1-9d51-f32284f49c53/disk.config
Aug 09 15:16:54 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/f1b4f73b-7a9e-4cf1-9d51-f32284f49c53/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp9d5yt9v2 {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:16:54 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/f1b4f73b-7a9e-4cf1-9d51-f32284f49c53/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp9d5yt9v2" returned: 0 in 0.053s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:16:55 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:16:55 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:16:55 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:16:55 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:16:56 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:16:56 user nova-compute[72382]: DEBUG nova.compute.manager [req-a2826527-2a28-4160-8af1-7db27e30ec45 req-f4716e69-ac55-4266-92cd-0ce1d139182c service nova] [instance: f1b4f73b-7a9e-4cf1-9d51-f32284f49c53] Received event network-vif-plugged-d031358f-2670-4942-9266-d9db448a078b {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:16:56 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-a2826527-2a28-4160-8af1-7db27e30ec45 req-f4716e69-ac55-4266-92cd-0ce1d139182c service nova] Acquiring lock "f1b4f73b-7a9e-4cf1-9d51-f32284f49c53-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:16:56 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-a2826527-2a28-4160-8af1-7db27e30ec45 req-f4716e69-ac55-4266-92cd-0ce1d139182c service nova] Lock "f1b4f73b-7a9e-4cf1-9d51-f32284f49c53-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:16:56 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-a2826527-2a28-4160-8af1-7db27e30ec45 req-f4716e69-ac55-4266-92cd-0ce1d139182c service nova] Lock "f1b4f73b-7a9e-4cf1-9d51-f32284f49c53-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:16:56 user nova-compute[72382]: DEBUG nova.compute.manager [req-a2826527-2a28-4160-8af1-7db27e30ec45 req-f4716e69-ac55-4266-92cd-0ce1d139182c service nova] [instance: f1b4f73b-7a9e-4cf1-9d51-f32284f49c53] No waiting events found dispatching network-vif-plugged-d031358f-2670-4942-9266-d9db448a078b {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:16:56 user nova-compute[72382]: WARNING nova.compute.manager [req-a2826527-2a28-4160-8af1-7db27e30ec45 req-f4716e69-ac55-4266-92cd-0ce1d139182c service nova] [instance: f1b4f73b-7a9e-4cf1-9d51-f32284f49c53] Received unexpected event network-vif-plugged-d031358f-2670-4942-9266-d9db448a078b for instance with vm_state building and task_state spawning.
Aug 09 15:16:56 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:16:56 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:16:56 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:16:56 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:16:56 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:16:56 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:16:56 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:16:56 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:16:56 user nova-compute[72382]: DEBUG nova.compute.manager [req-27614dbf-9026-4f5a-b780-057e972012b9 req-07e00b11-3af7-4fca-9477-76493647c802 service nova] [instance: f1b4f73b-7a9e-4cf1-9d51-f32284f49c53] Received event network-vif-plugged-fcd90f6b-ef1b-4f9d-9ced-b98f7be4bc55 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:16:56 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-27614dbf-9026-4f5a-b780-057e972012b9 req-07e00b11-3af7-4fca-9477-76493647c802 service nova] Acquiring lock "f1b4f73b-7a9e-4cf1-9d51-f32284f49c53-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:16:56 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-27614dbf-9026-4f5a-b780-057e972012b9 req-07e00b11-3af7-4fca-9477-76493647c802 service nova] Lock "f1b4f73b-7a9e-4cf1-9d51-f32284f49c53-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:16:56 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-27614dbf-9026-4f5a-b780-057e972012b9 req-07e00b11-3af7-4fca-9477-76493647c802 service nova] Lock "f1b4f73b-7a9e-4cf1-9d51-f32284f49c53-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:16:56 user nova-compute[72382]: DEBUG nova.compute.manager [req-27614dbf-9026-4f5a-b780-057e972012b9 req-07e00b11-3af7-4fca-9477-76493647c802 service nova] [instance: f1b4f73b-7a9e-4cf1-9d51-f32284f49c53] No waiting events found dispatching network-vif-plugged-fcd90f6b-ef1b-4f9d-9ced-b98f7be4bc55 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:16:56 user nova-compute[72382]: WARNING nova.compute.manager [req-27614dbf-9026-4f5a-b780-057e972012b9 req-07e00b11-3af7-4fca-9477-76493647c802 service nova] [instance: f1b4f73b-7a9e-4cf1-9d51-f32284f49c53] Received unexpected event network-vif-plugged-fcd90f6b-ef1b-4f9d-9ced-b98f7be4bc55 for instance with vm_state building and task_state spawning.
Aug 09 15:16:56 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:16:56 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:16:56 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:16:56 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:16:57 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:16:57 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:16:57 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:16:57 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:16:57 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:16:57 user nova-compute[72382]: DEBUG nova.compute.manager [req-80e609ca-a4e5-40cc-b6d1-3be0a835d38a req-48f2296b-0e0d-4094-a9b7-3cda84077f18 service nova] [instance: f1b4f73b-7a9e-4cf1-9d51-f32284f49c53] Received event network-vif-plugged-d96a280e-5aeb-4a7c-97da-431e5f42c7f6 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:16:57 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-80e609ca-a4e5-40cc-b6d1-3be0a835d38a req-48f2296b-0e0d-4094-a9b7-3cda84077f18 service nova] Acquiring lock "f1b4f73b-7a9e-4cf1-9d51-f32284f49c53-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:16:57 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-80e609ca-a4e5-40cc-b6d1-3be0a835d38a req-48f2296b-0e0d-4094-a9b7-3cda84077f18 service nova] Lock "f1b4f73b-7a9e-4cf1-9d51-f32284f49c53-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:16:57 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-80e609ca-a4e5-40cc-b6d1-3be0a835d38a req-48f2296b-0e0d-4094-a9b7-3cda84077f18 service nova] Lock "f1b4f73b-7a9e-4cf1-9d51-f32284f49c53-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:16:57 user nova-compute[72382]: DEBUG nova.compute.manager [req-80e609ca-a4e5-40cc-b6d1-3be0a835d38a req-48f2296b-0e0d-4094-a9b7-3cda84077f18 service nova] [instance: f1b4f73b-7a9e-4cf1-9d51-f32284f49c53] No waiting events found dispatching network-vif-plugged-d96a280e-5aeb-4a7c-97da-431e5f42c7f6 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:16:57 user nova-compute[72382]: WARNING nova.compute.manager [req-80e609ca-a4e5-40cc-b6d1-3be0a835d38a req-48f2296b-0e0d-4094-a9b7-3cda84077f18 service nova] [instance: f1b4f73b-7a9e-4cf1-9d51-f32284f49c53] Received unexpected event network-vif-plugged-d96a280e-5aeb-4a7c-97da-431e5f42c7f6 for instance with vm_state building and task_state spawning.
Aug 09 15:16:57 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:16:57 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:16:57 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:16:57 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:16:57 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:16:57 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:16:57 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:16:57 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:16:57 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:16:57 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:16:58 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:16:58 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:16:58 user nova-compute[72382]: DEBUG nova.compute.manager [req-098d045c-67cf-49c6-884a-b0eb4116676d req-788a0c61-95b9-424e-ab52-336aa199a130 service nova] [instance: f1b4f73b-7a9e-4cf1-9d51-f32284f49c53] Received event network-vif-plugged-d031358f-2670-4942-9266-d9db448a078b {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:16:58 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-098d045c-67cf-49c6-884a-b0eb4116676d req-788a0c61-95b9-424e-ab52-336aa199a130 service nova] Acquiring lock "f1b4f73b-7a9e-4cf1-9d51-f32284f49c53-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:16:58 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-098d045c-67cf-49c6-884a-b0eb4116676d req-788a0c61-95b9-424e-ab52-336aa199a130 service nova] Lock "f1b4f73b-7a9e-4cf1-9d51-f32284f49c53-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:16:58 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-098d045c-67cf-49c6-884a-b0eb4116676d req-788a0c61-95b9-424e-ab52-336aa199a130 service nova] Lock "f1b4f73b-7a9e-4cf1-9d51-f32284f49c53-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:16:58 user nova-compute[72382]: DEBUG nova.compute.manager [req-098d045c-67cf-49c6-884a-b0eb4116676d req-788a0c61-95b9-424e-ab52-336aa199a130 service nova] [instance: f1b4f73b-7a9e-4cf1-9d51-f32284f49c53] No waiting events found dispatching network-vif-plugged-d031358f-2670-4942-9266-d9db448a078b {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:16:58 user nova-compute[72382]: WARNING nova.compute.manager [req-098d045c-67cf-49c6-884a-b0eb4116676d req-788a0c61-95b9-424e-ab52-336aa199a130 service nova] [instance: f1b4f73b-7a9e-4cf1-9d51-f32284f49c53] Received unexpected event network-vif-plugged-d031358f-2670-4942-9266-d9db448a078b for instance with vm_state building and task_state spawning.
Aug 09 15:16:58 user nova-compute[72382]: DEBUG nova.compute.manager [req-098d045c-67cf-49c6-884a-b0eb4116676d req-788a0c61-95b9-424e-ab52-336aa199a130 service nova] [instance: f1b4f73b-7a9e-4cf1-9d51-f32284f49c53] Received event network-vif-plugged-3cea2e31-e2a9-4b8a-976b-ce818aaca460 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:16:58 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-098d045c-67cf-49c6-884a-b0eb4116676d req-788a0c61-95b9-424e-ab52-336aa199a130 service nova] Acquiring lock "f1b4f73b-7a9e-4cf1-9d51-f32284f49c53-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:16:58 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-098d045c-67cf-49c6-884a-b0eb4116676d req-788a0c61-95b9-424e-ab52-336aa199a130 service nova] Lock "f1b4f73b-7a9e-4cf1-9d51-f32284f49c53-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:16:58 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-098d045c-67cf-49c6-884a-b0eb4116676d req-788a0c61-95b9-424e-ab52-336aa199a130 service nova] Lock "f1b4f73b-7a9e-4cf1-9d51-f32284f49c53-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:16:58 user nova-compute[72382]: DEBUG nova.compute.manager [req-098d045c-67cf-49c6-884a-b0eb4116676d req-788a0c61-95b9-424e-ab52-336aa199a130 service nova] [instance: f1b4f73b-7a9e-4cf1-9d51-f32284f49c53] No waiting events found dispatching network-vif-plugged-3cea2e31-e2a9-4b8a-976b-ce818aaca460 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:16:58 user nova-compute[72382]: WARNING nova.compute.manager [req-098d045c-67cf-49c6-884a-b0eb4116676d req-788a0c61-95b9-424e-ab52-336aa199a130 service nova] [instance: f1b4f73b-7a9e-4cf1-9d51-f32284f49c53] Received unexpected event network-vif-plugged-3cea2e31-e2a9-4b8a-976b-ce818aaca460 for instance with vm_state building and task_state spawning.
Aug 09 15:16:58 user nova-compute[72382]: DEBUG nova.compute.manager [req-098d045c-67cf-49c6-884a-b0eb4116676d req-788a0c61-95b9-424e-ab52-336aa199a130 service nova] [instance: f1b4f73b-7a9e-4cf1-9d51-f32284f49c53] Received event network-vif-plugged-3cea2e31-e2a9-4b8a-976b-ce818aaca460 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:16:58 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-098d045c-67cf-49c6-884a-b0eb4116676d req-788a0c61-95b9-424e-ab52-336aa199a130 service nova] Acquiring lock "f1b4f73b-7a9e-4cf1-9d51-f32284f49c53-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:16:58 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-098d045c-67cf-49c6-884a-b0eb4116676d req-788a0c61-95b9-424e-ab52-336aa199a130 service nova] Lock "f1b4f73b-7a9e-4cf1-9d51-f32284f49c53-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:16:58 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-098d045c-67cf-49c6-884a-b0eb4116676d req-788a0c61-95b9-424e-ab52-336aa199a130 service nova] Lock "f1b4f73b-7a9e-4cf1-9d51-f32284f49c53-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:16:58 user nova-compute[72382]: DEBUG nova.compute.manager [req-098d045c-67cf-49c6-884a-b0eb4116676d req-788a0c61-95b9-424e-ab52-336aa199a130 service nova] [instance: f1b4f73b-7a9e-4cf1-9d51-f32284f49c53] No waiting events found dispatching network-vif-plugged-3cea2e31-e2a9-4b8a-976b-ce818aaca460 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:16:58 user nova-compute[72382]: WARNING nova.compute.manager [req-098d045c-67cf-49c6-884a-b0eb4116676d req-788a0c61-95b9-424e-ab52-336aa199a130 service nova] [instance: f1b4f73b-7a9e-4cf1-9d51-f32284f49c53] Received unexpected event network-vif-plugged-3cea2e31-e2a9-4b8a-976b-ce818aaca460 for instance with vm_state building and task_state spawning.
Aug 09 15:16:58 user nova-compute[72382]: DEBUG nova.compute.manager [req-098d045c-67cf-49c6-884a-b0eb4116676d req-788a0c61-95b9-424e-ab52-336aa199a130 service nova] [instance: f1b4f73b-7a9e-4cf1-9d51-f32284f49c53] Received event network-vif-plugged-6830a784-9d5e-4efe-8b35-9d1713e0c8ce {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:16:58 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-098d045c-67cf-49c6-884a-b0eb4116676d req-788a0c61-95b9-424e-ab52-336aa199a130 service nova] Acquiring lock "f1b4f73b-7a9e-4cf1-9d51-f32284f49c53-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:16:58 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-098d045c-67cf-49c6-884a-b0eb4116676d req-788a0c61-95b9-424e-ab52-336aa199a130 service nova] Lock "f1b4f73b-7a9e-4cf1-9d51-f32284f49c53-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:16:58 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-098d045c-67cf-49c6-884a-b0eb4116676d req-788a0c61-95b9-424e-ab52-336aa199a130 service nova] Lock "f1b4f73b-7a9e-4cf1-9d51-f32284f49c53-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:16:58 user nova-compute[72382]: DEBUG nova.compute.manager [req-098d045c-67cf-49c6-884a-b0eb4116676d req-788a0c61-95b9-424e-ab52-336aa199a130 service nova] [instance: f1b4f73b-7a9e-4cf1-9d51-f32284f49c53] No waiting events found dispatching network-vif-plugged-6830a784-9d5e-4efe-8b35-9d1713e0c8ce {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:16:58 user nova-compute[72382]: WARNING nova.compute.manager [req-098d045c-67cf-49c6-884a-b0eb4116676d req-788a0c61-95b9-424e-ab52-336aa199a130 service nova] [instance: f1b4f73b-7a9e-4cf1-9d51-f32284f49c53] Received unexpected event network-vif-plugged-6830a784-9d5e-4efe-8b35-9d1713e0c8ce for instance with vm_state building and task_state spawning.
Aug 09 15:16:58 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:16:58 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:16:58 user nova-compute[72382]: DEBUG nova.compute.manager [req-5b6ea0df-85e1-4fa1-b458-2b78c5761d80 req-e42077d8-8f81-4a05-85d2-b346c91aa1f4 service nova] [instance: f1b4f73b-7a9e-4cf1-9d51-f32284f49c53] Received event network-vif-plugged-fcd90f6b-ef1b-4f9d-9ced-b98f7be4bc55 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:16:58 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-5b6ea0df-85e1-4fa1-b458-2b78c5761d80 req-e42077d8-8f81-4a05-85d2-b346c91aa1f4 service nova] Acquiring lock "f1b4f73b-7a9e-4cf1-9d51-f32284f49c53-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:16:58 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-5b6ea0df-85e1-4fa1-b458-2b78c5761d80 req-e42077d8-8f81-4a05-85d2-b346c91aa1f4 service nova] Lock "f1b4f73b-7a9e-4cf1-9d51-f32284f49c53-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:16:58 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-5b6ea0df-85e1-4fa1-b458-2b78c5761d80 req-e42077d8-8f81-4a05-85d2-b346c91aa1f4 service nova] Lock "f1b4f73b-7a9e-4cf1-9d51-f32284f49c53-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:16:58 user nova-compute[72382]: DEBUG nova.compute.manager [req-5b6ea0df-85e1-4fa1-b458-2b78c5761d80 req-e42077d8-8f81-4a05-85d2-b346c91aa1f4 service nova] [instance: f1b4f73b-7a9e-4cf1-9d51-f32284f49c53] No waiting events found dispatching network-vif-plugged-fcd90f6b-ef1b-4f9d-9ced-b98f7be4bc55 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:16:58 user nova-compute[72382]: WARNING nova.compute.manager [req-5b6ea0df-85e1-4fa1-b458-2b78c5761d80 req-e42077d8-8f81-4a05-85d2-b346c91aa1f4 service nova] [instance: f1b4f73b-7a9e-4cf1-9d51-f32284f49c53] Received unexpected event network-vif-plugged-fcd90f6b-ef1b-4f9d-9ced-b98f7be4bc55 for instance with vm_state building and task_state spawning.
Aug 09 15:16:58 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:16:59 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:16:59 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:16:59 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:16:59 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:16:59 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:16:59 user nova-compute[72382]: DEBUG nova.compute.manager [req-c76fac98-ad96-4043-8cb6-a9f3d4f26507 req-ed5407a7-b194-46f9-a6fb-804902fa049e service nova] [instance: f1b4f73b-7a9e-4cf1-9d51-f32284f49c53] Received event network-vif-plugged-d96a280e-5aeb-4a7c-97da-431e5f42c7f6 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:16:59 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-c76fac98-ad96-4043-8cb6-a9f3d4f26507 req-ed5407a7-b194-46f9-a6fb-804902fa049e service nova] Acquiring lock "f1b4f73b-7a9e-4cf1-9d51-f32284f49c53-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:16:59 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-c76fac98-ad96-4043-8cb6-a9f3d4f26507 req-ed5407a7-b194-46f9-a6fb-804902fa049e service nova] Lock "f1b4f73b-7a9e-4cf1-9d51-f32284f49c53-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:16:59 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-c76fac98-ad96-4043-8cb6-a9f3d4f26507 req-ed5407a7-b194-46f9-a6fb-804902fa049e service nova] Lock "f1b4f73b-7a9e-4cf1-9d51-f32284f49c53-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:16:59 user nova-compute[72382]: DEBUG nova.compute.manager [req-c76fac98-ad96-4043-8cb6-a9f3d4f26507 req-ed5407a7-b194-46f9-a6fb-804902fa049e service nova] [instance: f1b4f73b-7a9e-4cf1-9d51-f32284f49c53] No waiting events found dispatching network-vif-plugged-d96a280e-5aeb-4a7c-97da-431e5f42c7f6 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:16:59 user nova-compute[72382]: WARNING nova.compute.manager [req-c76fac98-ad96-4043-8cb6-a9f3d4f26507 req-ed5407a7-b194-46f9-a6fb-804902fa049e service nova] [instance: f1b4f73b-7a9e-4cf1-9d51-f32284f49c53] Received unexpected event network-vif-plugged-d96a280e-5aeb-4a7c-97da-431e5f42c7f6 for instance with vm_state building and task_state spawning.
Aug 09 15:16:59 user nova-compute[72382]: DEBUG nova.compute.manager [req-c76fac98-ad96-4043-8cb6-a9f3d4f26507 req-ed5407a7-b194-46f9-a6fb-804902fa049e service nova] [instance: f1b4f73b-7a9e-4cf1-9d51-f32284f49c53] Received event network-vif-plugged-92c19874-960c-4e03-8537-6ae44812a1da {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:16:59 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-c76fac98-ad96-4043-8cb6-a9f3d4f26507 req-ed5407a7-b194-46f9-a6fb-804902fa049e service nova] Acquiring lock "f1b4f73b-7a9e-4cf1-9d51-f32284f49c53-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:16:59 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-c76fac98-ad96-4043-8cb6-a9f3d4f26507 req-ed5407a7-b194-46f9-a6fb-804902fa049e service nova] Lock "f1b4f73b-7a9e-4cf1-9d51-f32284f49c53-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:16:59 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-c76fac98-ad96-4043-8cb6-a9f3d4f26507 req-ed5407a7-b194-46f9-a6fb-804902fa049e service nova] Lock "f1b4f73b-7a9e-4cf1-9d51-f32284f49c53-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:16:59 user nova-compute[72382]: DEBUG nova.compute.manager [req-c76fac98-ad96-4043-8cb6-a9f3d4f26507 req-ed5407a7-b194-46f9-a6fb-804902fa049e service nova] [instance: f1b4f73b-7a9e-4cf1-9d51-f32284f49c53] No waiting events found dispatching network-vif-plugged-92c19874-960c-4e03-8537-6ae44812a1da {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:16:59 user nova-compute[72382]: WARNING nova.compute.manager [req-c76fac98-ad96-4043-8cb6-a9f3d4f26507 req-ed5407a7-b194-46f9-a6fb-804902fa049e service nova] [instance: f1b4f73b-7a9e-4cf1-9d51-f32284f49c53] Received unexpected event network-vif-plugged-92c19874-960c-4e03-8537-6ae44812a1da for instance with vm_state building and task_state spawning.
Aug 09 15:16:59 user nova-compute[72382]: DEBUG nova.compute.manager [req-c76fac98-ad96-4043-8cb6-a9f3d4f26507 req-ed5407a7-b194-46f9-a6fb-804902fa049e service nova] [instance: f1b4f73b-7a9e-4cf1-9d51-f32284f49c53] Received event network-vif-plugged-92c19874-960c-4e03-8537-6ae44812a1da {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:16:59 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-c76fac98-ad96-4043-8cb6-a9f3d4f26507 req-ed5407a7-b194-46f9-a6fb-804902fa049e service nova] Acquiring lock "f1b4f73b-7a9e-4cf1-9d51-f32284f49c53-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:16:59 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-c76fac98-ad96-4043-8cb6-a9f3d4f26507 req-ed5407a7-b194-46f9-a6fb-804902fa049e service nova] Lock "f1b4f73b-7a9e-4cf1-9d51-f32284f49c53-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:16:59 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-c76fac98-ad96-4043-8cb6-a9f3d4f26507 req-ed5407a7-b194-46f9-a6fb-804902fa049e service nova] Lock "f1b4f73b-7a9e-4cf1-9d51-f32284f49c53-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:16:59 user nova-compute[72382]: DEBUG nova.compute.manager [req-c76fac98-ad96-4043-8cb6-a9f3d4f26507 req-ed5407a7-b194-46f9-a6fb-804902fa049e service nova] [instance: f1b4f73b-7a9e-4cf1-9d51-f32284f49c53] No waiting events found dispatching network-vif-plugged-92c19874-960c-4e03-8537-6ae44812a1da {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:16:59 user nova-compute[72382]: WARNING nova.compute.manager [req-c76fac98-ad96-4043-8cb6-a9f3d4f26507 req-ed5407a7-b194-46f9-a6fb-804902fa049e service nova] [instance: f1b4f73b-7a9e-4cf1-9d51-f32284f49c53] Received unexpected event network-vif-plugged-92c19874-960c-4e03-8537-6ae44812a1da for instance with vm_state building and task_state spawning.
Aug 09 15:16:59 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:16:59 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:16:59 user nova-compute[72382]: DEBUG nova.compute.manager [None req-b98e5003-2b92-46e7-883e-1cad3418b5f4 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] [instance: f780040f-b789-4b72-8986-813c7b9fe4a6] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:16:59 user nova-compute[72382]: INFO nova.compute.manager [None req-b98e5003-2b92-46e7-883e-1cad3418b5f4 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] [instance: f780040f-b789-4b72-8986-813c7b9fe4a6] instance snapshotting
Aug 09 15:17:00 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-b98e5003-2b92-46e7-883e-1cad3418b5f4 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] [instance: f780040f-b789-4b72-8986-813c7b9fe4a6] Beginning live snapshot process
Aug 09 15:17:00 user nova-compute[72382]: DEBUG nova.virt.driver [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Emitting event <LifecycleEvent: 1691594220.164783, f1b4f73b-7a9e-4cf1-9d51-f32284f49c53 => Resumed> {{(pid=72382) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 15:17:00 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: f1b4f73b-7a9e-4cf1-9d51-f32284f49c53] VM Resumed (Lifecycle Event)
Aug 09 15:17:00 user nova-compute[72382]: DEBUG nova.compute.manager [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] [instance: f1b4f73b-7a9e-4cf1-9d51-f32284f49c53] Instance event wait completed in 0 seconds for  {{(pid=72382) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 15:17:00 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] [instance: f1b4f73b-7a9e-4cf1-9d51-f32284f49c53] Guest created on hypervisor {{(pid=72382) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 15:17:00 user nova-compute[72382]: INFO nova.virt.libvirt.driver [-] [instance: f1b4f73b-7a9e-4cf1-9d51-f32284f49c53] Instance spawned successfully.
Aug 09 15:17:00 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] [instance: f1b4f73b-7a9e-4cf1-9d51-f32284f49c53] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 15:17:00 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: f1b4f73b-7a9e-4cf1-9d51-f32284f49c53] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:17:00 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: f1b4f73b-7a9e-4cf1-9d51-f32284f49c53] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72382) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 15:17:00 user nova-compute[72382]: DEBUG nova.compute.manager [req-2e530819-6517-4b63-99aa-9fbcdd722f06 req-4fa4ba25-d775-4358-a459-fc6bfb2cb8b5 service nova] [instance: f1b4f73b-7a9e-4cf1-9d51-f32284f49c53] Received event network-vif-plugged-6830a784-9d5e-4efe-8b35-9d1713e0c8ce {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:17:00 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-2e530819-6517-4b63-99aa-9fbcdd722f06 req-4fa4ba25-d775-4358-a459-fc6bfb2cb8b5 service nova] Acquiring lock "f1b4f73b-7a9e-4cf1-9d51-f32284f49c53-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:17:00 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-2e530819-6517-4b63-99aa-9fbcdd722f06 req-4fa4ba25-d775-4358-a459-fc6bfb2cb8b5 service nova] Lock "f1b4f73b-7a9e-4cf1-9d51-f32284f49c53-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:17:00 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-2e530819-6517-4b63-99aa-9fbcdd722f06 req-4fa4ba25-d775-4358-a459-fc6bfb2cb8b5 service nova] Lock "f1b4f73b-7a9e-4cf1-9d51-f32284f49c53-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:17:00 user nova-compute[72382]: DEBUG nova.compute.manager [req-2e530819-6517-4b63-99aa-9fbcdd722f06 req-4fa4ba25-d775-4358-a459-fc6bfb2cb8b5 service nova] [instance: f1b4f73b-7a9e-4cf1-9d51-f32284f49c53] No waiting events found dispatching network-vif-plugged-6830a784-9d5e-4efe-8b35-9d1713e0c8ce {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:17:00 user nova-compute[72382]: WARNING nova.compute.manager [req-2e530819-6517-4b63-99aa-9fbcdd722f06 req-4fa4ba25-d775-4358-a459-fc6bfb2cb8b5 service nova] [instance: f1b4f73b-7a9e-4cf1-9d51-f32284f49c53] Received unexpected event network-vif-plugged-6830a784-9d5e-4efe-8b35-9d1713e0c8ce for instance with vm_state building and task_state spawning.
Aug 09 15:17:00 user nova-compute[72382]: DEBUG nova.compute.manager [req-2e530819-6517-4b63-99aa-9fbcdd722f06 req-4fa4ba25-d775-4358-a459-fc6bfb2cb8b5 service nova] [instance: f1b4f73b-7a9e-4cf1-9d51-f32284f49c53] Received event network-vif-plugged-650ae32c-3dec-4bad-8ff0-6ad423e1cb21 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:17:00 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-2e530819-6517-4b63-99aa-9fbcdd722f06 req-4fa4ba25-d775-4358-a459-fc6bfb2cb8b5 service nova] Acquiring lock "f1b4f73b-7a9e-4cf1-9d51-f32284f49c53-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:17:00 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-2e530819-6517-4b63-99aa-9fbcdd722f06 req-4fa4ba25-d775-4358-a459-fc6bfb2cb8b5 service nova] Lock "f1b4f73b-7a9e-4cf1-9d51-f32284f49c53-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:17:00 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-2e530819-6517-4b63-99aa-9fbcdd722f06 req-4fa4ba25-d775-4358-a459-fc6bfb2cb8b5 service nova] Lock "f1b4f73b-7a9e-4cf1-9d51-f32284f49c53-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:17:00 user nova-compute[72382]: DEBUG nova.compute.manager [req-2e530819-6517-4b63-99aa-9fbcdd722f06 req-4fa4ba25-d775-4358-a459-fc6bfb2cb8b5 service nova] [instance: f1b4f73b-7a9e-4cf1-9d51-f32284f49c53] No waiting events found dispatching network-vif-plugged-650ae32c-3dec-4bad-8ff0-6ad423e1cb21 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:17:00 user nova-compute[72382]: WARNING nova.compute.manager [req-2e530819-6517-4b63-99aa-9fbcdd722f06 req-4fa4ba25-d775-4358-a459-fc6bfb2cb8b5 service nova] [instance: f1b4f73b-7a9e-4cf1-9d51-f32284f49c53] Received unexpected event network-vif-plugged-650ae32c-3dec-4bad-8ff0-6ad423e1cb21 for instance with vm_state building and task_state spawning.
Aug 09 15:17:00 user nova-compute[72382]: DEBUG nova.compute.manager [req-2e530819-6517-4b63-99aa-9fbcdd722f06 req-4fa4ba25-d775-4358-a459-fc6bfb2cb8b5 service nova] [instance: f1b4f73b-7a9e-4cf1-9d51-f32284f49c53] Received event network-vif-plugged-650ae32c-3dec-4bad-8ff0-6ad423e1cb21 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:17:00 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-2e530819-6517-4b63-99aa-9fbcdd722f06 req-4fa4ba25-d775-4358-a459-fc6bfb2cb8b5 service nova] Acquiring lock "f1b4f73b-7a9e-4cf1-9d51-f32284f49c53-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:17:00 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-2e530819-6517-4b63-99aa-9fbcdd722f06 req-4fa4ba25-d775-4358-a459-fc6bfb2cb8b5 service nova] Lock "f1b4f73b-7a9e-4cf1-9d51-f32284f49c53-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:17:00 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-2e530819-6517-4b63-99aa-9fbcdd722f06 req-4fa4ba25-d775-4358-a459-fc6bfb2cb8b5 service nova] Lock "f1b4f73b-7a9e-4cf1-9d51-f32284f49c53-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:17:00 user nova-compute[72382]: DEBUG nova.compute.manager [req-2e530819-6517-4b63-99aa-9fbcdd722f06 req-4fa4ba25-d775-4358-a459-fc6bfb2cb8b5 service nova] [instance: f1b4f73b-7a9e-4cf1-9d51-f32284f49c53] No waiting events found dispatching network-vif-plugged-650ae32c-3dec-4bad-8ff0-6ad423e1cb21 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:17:00 user nova-compute[72382]: WARNING nova.compute.manager [req-2e530819-6517-4b63-99aa-9fbcdd722f06 req-4fa4ba25-d775-4358-a459-fc6bfb2cb8b5 service nova] [instance: f1b4f73b-7a9e-4cf1-9d51-f32284f49c53] Received unexpected event network-vif-plugged-650ae32c-3dec-4bad-8ff0-6ad423e1cb21 for instance with vm_state building and task_state spawning.
Aug 09 15:17:00 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: f1b4f73b-7a9e-4cf1-9d51-f32284f49c53] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 15:17:00 user nova-compute[72382]: DEBUG nova.virt.driver [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Emitting event <LifecycleEvent: 1691594220.1668437, f1b4f73b-7a9e-4cf1-9d51-f32284f49c53 => Started> {{(pid=72382) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 15:17:00 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: f1b4f73b-7a9e-4cf1-9d51-f32284f49c53] VM Started (Lifecycle Event)
Aug 09 15:17:00 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] [instance: f1b4f73b-7a9e-4cf1-9d51-f32284f49c53] Found default for hw_cdrom_bus of ide {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:17:00 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] [instance: f1b4f73b-7a9e-4cf1-9d51-f32284f49c53] Found default for hw_disk_bus of virtio {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:17:00 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] [instance: f1b4f73b-7a9e-4cf1-9d51-f32284f49c53] Found default for hw_input_bus of None {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:17:00 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] [instance: f1b4f73b-7a9e-4cf1-9d51-f32284f49c53] Found default for hw_pointer_model of None {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:17:00 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] [instance: f1b4f73b-7a9e-4cf1-9d51-f32284f49c53] Found default for hw_video_model of virtio {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:17:00 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] [instance: f1b4f73b-7a9e-4cf1-9d51-f32284f49c53] Found default for hw_vif_model of virtio {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:17:00 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-b98e5003-2b92-46e7-883e-1cad3418b5f4 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f780040f-b789-4b72-8986-813c7b9fe4a6/disk --force-share --output=json -f qcow2 {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:17:00 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: f1b4f73b-7a9e-4cf1-9d51-f32284f49c53] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:17:00 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: f1b4f73b-7a9e-4cf1-9d51-f32284f49c53] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72382) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 15:17:00 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: f1b4f73b-7a9e-4cf1-9d51-f32284f49c53] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 15:17:00 user nova-compute[72382]: INFO nova.compute.manager [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] [instance: f1b4f73b-7a9e-4cf1-9d51-f32284f49c53] Took 10.64 seconds to spawn the instance on the hypervisor.
Aug 09 15:17:00 user nova-compute[72382]: DEBUG nova.compute.manager [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] [instance: f1b4f73b-7a9e-4cf1-9d51-f32284f49c53] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:17:00 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-b98e5003-2b92-46e7-883e-1cad3418b5f4 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f780040f-b789-4b72-8986-813c7b9fe4a6/disk --force-share --output=json -f qcow2" returned: 0 in 0.141s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:17:00 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-b98e5003-2b92-46e7-883e-1cad3418b5f4 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f780040f-b789-4b72-8986-813c7b9fe4a6/disk --force-share --output=json -f qcow2 {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:17:00 user nova-compute[72382]: INFO nova.compute.manager [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] [instance: f1b4f73b-7a9e-4cf1-9d51-f32284f49c53] Took 40.12 seconds to build instance.
Aug 09 15:17:00 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-7bbde5d7-9095-4bec-8423-fcefd21ab4c3 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] Lock "f1b4f73b-7a9e-4cf1-9d51-f32284f49c53" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 40.239s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:17:00 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-b98e5003-2b92-46e7-883e-1cad3418b5f4 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f780040f-b789-4b72-8986-813c7b9fe4a6/disk --force-share --output=json -f qcow2" returned: 0 in 0.134s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:17:00 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-b98e5003-2b92-46e7-883e-1cad3418b5f4 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:17:00 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-b98e5003-2b92-46e7-883e-1cad3418b5f4 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b --force-share --output=json" returned: 0 in 0.130s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:17:00 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-b98e5003-2b92-46e7-883e-1cad3418b5f4 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp223ru8io/6f824c17f92540c884a0ad7206e1e703.delta 1073741824 {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:17:00 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-b98e5003-2b92-46e7-883e-1cad3418b5f4 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp223ru8io/6f824c17f92540c884a0ad7206e1e703.delta 1073741824" returned: 0 in 0.052s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:17:00 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-b98e5003-2b92-46e7-883e-1cad3418b5f4 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] [instance: f780040f-b789-4b72-8986-813c7b9fe4a6] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 09 15:17:00 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-b98e5003-2b92-46e7-883e-1cad3418b5f4 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Checking UEFI support for host arch (x86_64) {{(pid=72382) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1751}}
Aug 09 15:17:00 user nova-compute[72382]: INFO nova.virt.libvirt.host [None req-b98e5003-2b92-46e7-883e-1cad3418b5f4 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] UEFI support detected
Aug 09 15:17:01 user nova-compute[72382]: DEBUG nova.virt.libvirt.guest [None req-b98e5003-2b92-46e7-883e-1cad3418b5f4 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=72382) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 09 15:17:01 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:17:01 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:17:01 user nova-compute[72382]: DEBUG nova.compute.manager [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Starting heal instance info cache {{(pid=72382) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 15:17:01 user nova-compute[72382]: DEBUG nova.virt.libvirt.guest [None req-b98e5003-2b92-46e7-883e-1cad3418b5f4 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=72382) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 09 15:17:01 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-b98e5003-2b92-46e7-883e-1cad3418b5f4 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] [instance: f780040f-b789-4b72-8986-813c7b9fe4a6] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 09 15:17:02 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Acquiring lock "refresh_cache-777e49ea-b674-4c3f-9cdd-ac2113032632" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 15:17:02 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Acquired lock "refresh_cache-777e49ea-b674-4c3f-9cdd-ac2113032632" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 15:17:02 user nova-compute[72382]: DEBUG nova.network.neutron [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] [instance: 777e49ea-b674-4c3f-9cdd-ac2113032632] Forcefully refreshing network info cache for instance {{(pid=72382) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 15:17:02 user nova-compute[72382]: DEBUG nova.privsep.utils [None req-b98e5003-2b92-46e7-883e-1cad3418b5f4 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72382) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 09 15:17:02 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-b98e5003-2b92-46e7-883e-1cad3418b5f4 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp223ru8io/6f824c17f92540c884a0ad7206e1e703.delta /opt/stack/data/nova/instances/snapshots/tmp223ru8io/6f824c17f92540c884a0ad7206e1e703 {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:17:02 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-b98e5003-2b92-46e7-883e-1cad3418b5f4 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp223ru8io/6f824c17f92540c884a0ad7206e1e703.delta /opt/stack/data/nova/instances/snapshots/tmp223ru8io/6f824c17f92540c884a0ad7206e1e703" returned: 0 in 0.266s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:17:02 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-b98e5003-2b92-46e7-883e-1cad3418b5f4 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] [instance: f780040f-b789-4b72-8986-813c7b9fe4a6] Snapshot extracted, beginning image upload
Aug 09 15:17:02 user nova-compute[72382]: DEBUG nova.network.neutron [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] [instance: 777e49ea-b674-4c3f-9cdd-ac2113032632] Updating instance_info_cache with network_info: [{"id": "80b78279-76f9-46c8-a54d-413116bc37c6", "address": "fa:16:3e:37:26:34", "network": {"id": "32d8bb03-1dc6-499b-8b79-48938664dd3b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1565950502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8995b21c93c24ab19fcfad5c4939509f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80b78279-76", "ovs_interfaceid": "80b78279-76f9-46c8-a54d-413116bc37c6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:17:02 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Releasing lock "refresh_cache-777e49ea-b674-4c3f-9cdd-ac2113032632" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 15:17:02 user nova-compute[72382]: DEBUG nova.compute.manager [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] [instance: 777e49ea-b674-4c3f-9cdd-ac2113032632] Updated the network info_cache for instance {{(pid=72382) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 15:17:02 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:17:02 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:17:02 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:17:02 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:17:02 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:17:02 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:17:02 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:17:02 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Auditing locally available compute resources for user (node: user) {{(pid=72382) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 15:17:03 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72382) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 15:17:03 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72382) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 15:17:03 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=72382) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 15:17:03 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f780040f-b789-4b72-8986-813c7b9fe4a6/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:17:03 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f780040f-b789-4b72-8986-813c7b9fe4a6/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:17:03 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f780040f-b789-4b72-8986-813c7b9fe4a6/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:17:03 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f780040f-b789-4b72-8986-813c7b9fe4a6/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:17:03 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/266be814-4a2b-4f8e-a0f6-e8821fdeb95d/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:17:03 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-6c134a39-1f5d-4c33-8bab-18f3d95b1803 tempest-ServersNegativeTestJSON-1671359082 tempest-ServersNegativeTestJSON-1671359082-project-member] Acquiring lock "8b4be6ea-c8f6-420b-9453-c0558b6c4b9f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:17:03 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-6c134a39-1f5d-4c33-8bab-18f3d95b1803 tempest-ServersNegativeTestJSON-1671359082 tempest-ServersNegativeTestJSON-1671359082-project-member] Lock "8b4be6ea-c8f6-420b-9453-c0558b6c4b9f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:17:03 user nova-compute[72382]: DEBUG nova.compute.manager [None req-6c134a39-1f5d-4c33-8bab-18f3d95b1803 tempest-ServersNegativeTestJSON-1671359082 tempest-ServersNegativeTestJSON-1671359082-project-member] [instance: 8b4be6ea-c8f6-420b-9453-c0558b6c4b9f] Starting instance... {{(pid=72382) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 15:17:03 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/266be814-4a2b-4f8e-a0f6-e8821fdeb95d/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:17:03 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/266be814-4a2b-4f8e-a0f6-e8821fdeb95d/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:17:03 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-6c134a39-1f5d-4c33-8bab-18f3d95b1803 tempest-ServersNegativeTestJSON-1671359082 tempest-ServersNegativeTestJSON-1671359082-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:17:03 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-6c134a39-1f5d-4c33-8bab-18f3d95b1803 tempest-ServersNegativeTestJSON-1671359082 tempest-ServersNegativeTestJSON-1671359082-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:17:03 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-6c134a39-1f5d-4c33-8bab-18f3d95b1803 tempest-ServersNegativeTestJSON-1671359082 tempest-ServersNegativeTestJSON-1671359082-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72382) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 15:17:03 user nova-compute[72382]: INFO nova.compute.claims [None req-6c134a39-1f5d-4c33-8bab-18f3d95b1803 tempest-ServersNegativeTestJSON-1671359082 tempest-ServersNegativeTestJSON-1671359082-project-member] [instance: 8b4be6ea-c8f6-420b-9453-c0558b6c4b9f] Claim successful on node user
Aug 09 15:17:03 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/266be814-4a2b-4f8e-a0f6-e8821fdeb95d/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:17:03 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a33515b3-3ef4-4f76-a8d8-e7008b5bbb79/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:17:03 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:17:03 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a33515b3-3ef4-4f76-a8d8-e7008b5bbb79/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:17:03 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a33515b3-3ef4-4f76-a8d8-e7008b5bbb79/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:17:04 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a33515b3-3ef4-4f76-a8d8-e7008b5bbb79/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:17:04 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/777e49ea-b674-4c3f-9cdd-ac2113032632/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:17:04 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:17:04 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/777e49ea-b674-4c3f-9cdd-ac2113032632/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:17:04 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/777e49ea-b674-4c3f-9cdd-ac2113032632/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:17:04 user nova-compute[72382]: DEBUG nova.compute.provider_tree [None req-6c134a39-1f5d-4c33-8bab-18f3d95b1803 tempest-ServersNegativeTestJSON-1671359082 tempest-ServersNegativeTestJSON-1671359082-project-member] Inventory has not changed in ProviderTree for provider: 7b15b0e5-df4d-49db-833b-2855d21d10ae {{(pid=72382) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 15:17:04 user nova-compute[72382]: DEBUG nova.scheduler.client.report [None req-6c134a39-1f5d-4c33-8bab-18f3d95b1803 tempest-ServersNegativeTestJSON-1671359082 tempest-ServersNegativeTestJSON-1671359082-project-member] Inventory has not changed for provider 7b15b0e5-df4d-49db-833b-2855d21d10ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72382) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 15:17:04 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-6c134a39-1f5d-4c33-8bab-18f3d95b1803 tempest-ServersNegativeTestJSON-1671359082 tempest-ServersNegativeTestJSON-1671359082-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.695s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:17:04 user nova-compute[72382]: DEBUG nova.compute.manager [None req-6c134a39-1f5d-4c33-8bab-18f3d95b1803 tempest-ServersNegativeTestJSON-1671359082 tempest-ServersNegativeTestJSON-1671359082-project-member] [instance: 8b4be6ea-c8f6-420b-9453-c0558b6c4b9f] Start building networks asynchronously for instance. {{(pid=72382) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 15:17:04 user nova-compute[72382]: DEBUG nova.compute.manager [None req-6c134a39-1f5d-4c33-8bab-18f3d95b1803 tempest-ServersNegativeTestJSON-1671359082 tempest-ServersNegativeTestJSON-1671359082-project-member] [instance: 8b4be6ea-c8f6-420b-9453-c0558b6c4b9f] Allocating IP information in the background. {{(pid=72382) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 15:17:04 user nova-compute[72382]: DEBUG nova.network.neutron [None req-6c134a39-1f5d-4c33-8bab-18f3d95b1803 tempest-ServersNegativeTestJSON-1671359082 tempest-ServersNegativeTestJSON-1671359082-project-member] [instance: 8b4be6ea-c8f6-420b-9453-c0558b6c4b9f] allocate_for_instance() {{(pid=72382) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 15:17:04 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/777e49ea-b674-4c3f-9cdd-ac2113032632/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:17:04 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44afd1bf-fa5c-4b3e-8752-b16853fef54e/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:17:04 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-6c134a39-1f5d-4c33-8bab-18f3d95b1803 tempest-ServersNegativeTestJSON-1671359082 tempest-ServersNegativeTestJSON-1671359082-project-member] [instance: 8b4be6ea-c8f6-420b-9453-c0558b6c4b9f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 15:17:04 user nova-compute[72382]: DEBUG nova.compute.manager [None req-6c134a39-1f5d-4c33-8bab-18f3d95b1803 tempest-ServersNegativeTestJSON-1671359082 tempest-ServersNegativeTestJSON-1671359082-project-member] [instance: 8b4be6ea-c8f6-420b-9453-c0558b6c4b9f] Start building block device mappings for instance. {{(pid=72382) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 15:17:04 user nova-compute[72382]: DEBUG nova.policy [None req-6c134a39-1f5d-4c33-8bab-18f3d95b1803 tempest-ServersNegativeTestJSON-1671359082 tempest-ServersNegativeTestJSON-1671359082-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5e4b3ed6be8f4c99ba979398388bf12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8995b21c93c24ab19fcfad5c4939509f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72382) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 15:17:04 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44afd1bf-fa5c-4b3e-8752-b16853fef54e/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:17:04 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44afd1bf-fa5c-4b3e-8752-b16853fef54e/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:17:04 user nova-compute[72382]: DEBUG nova.compute.manager [None req-6c134a39-1f5d-4c33-8bab-18f3d95b1803 tempest-ServersNegativeTestJSON-1671359082 tempest-ServersNegativeTestJSON-1671359082-project-member] [instance: 8b4be6ea-c8f6-420b-9453-c0558b6c4b9f] Start spawning the instance on the hypervisor. {{(pid=72382) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 15:17:04 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-6c134a39-1f5d-4c33-8bab-18f3d95b1803 tempest-ServersNegativeTestJSON-1671359082 tempest-ServersNegativeTestJSON-1671359082-project-member] [instance: 8b4be6ea-c8f6-420b-9453-c0558b6c4b9f] Creating instance directory {{(pid=72382) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 15:17:04 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-6c134a39-1f5d-4c33-8bab-18f3d95b1803 tempest-ServersNegativeTestJSON-1671359082 tempest-ServersNegativeTestJSON-1671359082-project-member] [instance: 8b4be6ea-c8f6-420b-9453-c0558b6c4b9f] Creating image(s)
Aug 09 15:17:04 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-6c134a39-1f5d-4c33-8bab-18f3d95b1803 tempest-ServersNegativeTestJSON-1671359082 tempest-ServersNegativeTestJSON-1671359082-project-member] Acquiring lock "/opt/stack/data/nova/instances/8b4be6ea-c8f6-420b-9453-c0558b6c4b9f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:17:04 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-6c134a39-1f5d-4c33-8bab-18f3d95b1803 tempest-ServersNegativeTestJSON-1671359082 tempest-ServersNegativeTestJSON-1671359082-project-member] Lock "/opt/stack/data/nova/instances/8b4be6ea-c8f6-420b-9453-c0558b6c4b9f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:17:04 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-6c134a39-1f5d-4c33-8bab-18f3d95b1803 tempest-ServersNegativeTestJSON-1671359082 tempest-ServersNegativeTestJSON-1671359082-project-member] Lock "/opt/stack/data/nova/instances/8b4be6ea-c8f6-420b-9453-c0558b6c4b9f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:17:04 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-6c134a39-1f5d-4c33-8bab-18f3d95b1803 tempest-ServersNegativeTestJSON-1671359082 tempest-ServersNegativeTestJSON-1671359082-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:17:04 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44afd1bf-fa5c-4b3e-8752-b16853fef54e/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:17:04 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0a7fa25-4520-4f40-9515-b88e3d2fd910/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:17:04 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-6c134a39-1f5d-4c33-8bab-18f3d95b1803 tempest-ServersNegativeTestJSON-1671359082 tempest-ServersNegativeTestJSON-1671359082-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b --force-share --output=json" returned: 0 in 0.143s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:17:04 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-6c134a39-1f5d-4c33-8bab-18f3d95b1803 tempest-ServersNegativeTestJSON-1671359082 tempest-ServersNegativeTestJSON-1671359082-project-member] Acquiring lock "383812ff437283e0191ed5b9ecc04c27f1162b0b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:17:04 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-6c134a39-1f5d-4c33-8bab-18f3d95b1803 tempest-ServersNegativeTestJSON-1671359082 tempest-ServersNegativeTestJSON-1671359082-project-member] Lock "383812ff437283e0191ed5b9ecc04c27f1162b0b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:17:04 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-6c134a39-1f5d-4c33-8bab-18f3d95b1803 tempest-ServersNegativeTestJSON-1671359082 tempest-ServersNegativeTestJSON-1671359082-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:17:04 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0a7fa25-4520-4f40-9515-b88e3d2fd910/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:17:04 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0a7fa25-4520-4f40-9515-b88e3d2fd910/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:17:04 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-6c134a39-1f5d-4c33-8bab-18f3d95b1803 tempest-ServersNegativeTestJSON-1671359082 tempest-ServersNegativeTestJSON-1671359082-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b --force-share --output=json" returned: 0 in 0.166s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:17:04 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-6c134a39-1f5d-4c33-8bab-18f3d95b1803 tempest-ServersNegativeTestJSON-1671359082 tempest-ServersNegativeTestJSON-1671359082-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b,backing_fmt=raw /opt/stack/data/nova/instances/8b4be6ea-c8f6-420b-9453-c0558b6c4b9f/disk 1073741824 {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:17:05 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-6c134a39-1f5d-4c33-8bab-18f3d95b1803 tempest-ServersNegativeTestJSON-1671359082 tempest-ServersNegativeTestJSON-1671359082-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b,backing_fmt=raw /opt/stack/data/nova/instances/8b4be6ea-c8f6-420b-9453-c0558b6c4b9f/disk 1073741824" returned: 0 in 0.051s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:17:05 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-6c134a39-1f5d-4c33-8bab-18f3d95b1803 tempest-ServersNegativeTestJSON-1671359082 tempest-ServersNegativeTestJSON-1671359082-project-member] Lock "383812ff437283e0191ed5b9ecc04c27f1162b0b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.223s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:17:05 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-6c134a39-1f5d-4c33-8bab-18f3d95b1803 tempest-ServersNegativeTestJSON-1671359082 tempest-ServersNegativeTestJSON-1671359082-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:17:05 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0a7fa25-4520-4f40-9515-b88e3d2fd910/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:17:05 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-b98e5003-2b92-46e7-883e-1cad3418b5f4 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] [instance: f780040f-b789-4b72-8986-813c7b9fe4a6] Snapshot image upload complete
Aug 09 15:17:05 user nova-compute[72382]: INFO nova.compute.manager [None req-b98e5003-2b92-46e7-883e-1cad3418b5f4 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] [instance: f780040f-b789-4b72-8986-813c7b9fe4a6] Took 5.14 seconds to snapshot the instance on the hypervisor.
Aug 09 15:17:05 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24b63f7a-be32-424b-b72c-d5bec43c408e/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:17:05 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-6c134a39-1f5d-4c33-8bab-18f3d95b1803 tempest-ServersNegativeTestJSON-1671359082 tempest-ServersNegativeTestJSON-1671359082-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b --force-share --output=json" returned: 0 in 0.158s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:17:05 user nova-compute[72382]: DEBUG nova.virt.disk.api [None req-6c134a39-1f5d-4c33-8bab-18f3d95b1803 tempest-ServersNegativeTestJSON-1671359082 tempest-ServersNegativeTestJSON-1671359082-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8b4be6ea-c8f6-420b-9453-c0558b6c4b9f/disk. size=1073741824 {{(pid=72382) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 15:17:05 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-6c134a39-1f5d-4c33-8bab-18f3d95b1803 tempest-ServersNegativeTestJSON-1671359082 tempest-ServersNegativeTestJSON-1671359082-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b4be6ea-c8f6-420b-9453-c0558b6c4b9f/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:17:05 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24b63f7a-be32-424b-b72c-d5bec43c408e/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:17:05 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24b63f7a-be32-424b-b72c-d5bec43c408e/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:17:05 user nova-compute[72382]: DEBUG nova.network.neutron [None req-6c134a39-1f5d-4c33-8bab-18f3d95b1803 tempest-ServersNegativeTestJSON-1671359082 tempest-ServersNegativeTestJSON-1671359082-project-member] [instance: 8b4be6ea-c8f6-420b-9453-c0558b6c4b9f] Successfully created port: 69b23d47-a252-4a81-8119-00c851da530d {{(pid=72382) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 15:17:05 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-6c134a39-1f5d-4c33-8bab-18f3d95b1803 tempest-ServersNegativeTestJSON-1671359082 tempest-ServersNegativeTestJSON-1671359082-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b4be6ea-c8f6-420b-9453-c0558b6c4b9f/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:17:05 user nova-compute[72382]: DEBUG nova.virt.disk.api [None req-6c134a39-1f5d-4c33-8bab-18f3d95b1803 tempest-ServersNegativeTestJSON-1671359082 tempest-ServersNegativeTestJSON-1671359082-project-member] Cannot resize image /opt/stack/data/nova/instances/8b4be6ea-c8f6-420b-9453-c0558b6c4b9f/disk to a smaller size. {{(pid=72382) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 15:17:05 user nova-compute[72382]: DEBUG nova.objects.instance [None req-6c134a39-1f5d-4c33-8bab-18f3d95b1803 tempest-ServersNegativeTestJSON-1671359082 tempest-ServersNegativeTestJSON-1671359082-project-member] Lazy-loading 'migration_context' on Instance uuid 8b4be6ea-c8f6-420b-9453-c0558b6c4b9f {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:17:05 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-6c134a39-1f5d-4c33-8bab-18f3d95b1803 tempest-ServersNegativeTestJSON-1671359082 tempest-ServersNegativeTestJSON-1671359082-project-member] [instance: 8b4be6ea-c8f6-420b-9453-c0558b6c4b9f] Created local disks {{(pid=72382) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 15:17:05 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-6c134a39-1f5d-4c33-8bab-18f3d95b1803 tempest-ServersNegativeTestJSON-1671359082 tempest-ServersNegativeTestJSON-1671359082-project-member] [instance: 8b4be6ea-c8f6-420b-9453-c0558b6c4b9f] Ensure instance console log exists: /opt/stack/data/nova/instances/8b4be6ea-c8f6-420b-9453-c0558b6c4b9f/console.log {{(pid=72382) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 15:17:05 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-6c134a39-1f5d-4c33-8bab-18f3d95b1803 tempest-ServersNegativeTestJSON-1671359082 tempest-ServersNegativeTestJSON-1671359082-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:17:05 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-6c134a39-1f5d-4c33-8bab-18f3d95b1803 tempest-ServersNegativeTestJSON-1671359082 tempest-ServersNegativeTestJSON-1671359082-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:17:05 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-6c134a39-1f5d-4c33-8bab-18f3d95b1803 tempest-ServersNegativeTestJSON-1671359082 tempest-ServersNegativeTestJSON-1671359082-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:17:05 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24b63f7a-be32-424b-b72c-d5bec43c408e/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:17:05 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a82f146-97ce-4319-8b25-c1b090965e53/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:17:05 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a82f146-97ce-4319-8b25-c1b090965e53/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:17:05 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a82f146-97ce-4319-8b25-c1b090965e53/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:17:05 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a82f146-97ce-4319-8b25-c1b090965e53/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:17:05 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9766433-4c5a-40ed-a212-715a24f42b91/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:17:05 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9766433-4c5a-40ed-a212-715a24f42b91/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:17:05 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9766433-4c5a-40ed-a212-715a24f42b91/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:17:06 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9766433-4c5a-40ed-a212-715a24f42b91/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:17:06 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23f25946-de3a-43fb-97a4-1f9a787e6e51/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:17:06 user nova-compute[72382]: DEBUG nova.network.neutron [None req-6c134a39-1f5d-4c33-8bab-18f3d95b1803 tempest-ServersNegativeTestJSON-1671359082 tempest-ServersNegativeTestJSON-1671359082-project-member] [instance: 8b4be6ea-c8f6-420b-9453-c0558b6c4b9f] Successfully updated port: 69b23d47-a252-4a81-8119-00c851da530d {{(pid=72382) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 15:17:06 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-6c134a39-1f5d-4c33-8bab-18f3d95b1803 tempest-ServersNegativeTestJSON-1671359082 tempest-ServersNegativeTestJSON-1671359082-project-member] Acquiring lock "refresh_cache-8b4be6ea-c8f6-420b-9453-c0558b6c4b9f" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 15:17:06 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-6c134a39-1f5d-4c33-8bab-18f3d95b1803 tempest-ServersNegativeTestJSON-1671359082 tempest-ServersNegativeTestJSON-1671359082-project-member] Acquired lock "refresh_cache-8b4be6ea-c8f6-420b-9453-c0558b6c4b9f" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 15:17:06 user nova-compute[72382]: DEBUG nova.network.neutron [None req-6c134a39-1f5d-4c33-8bab-18f3d95b1803 tempest-ServersNegativeTestJSON-1671359082 tempest-ServersNegativeTestJSON-1671359082-project-member] [instance: 8b4be6ea-c8f6-420b-9453-c0558b6c4b9f] Building network info cache for instance {{(pid=72382) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 15:17:06 user nova-compute[72382]: DEBUG nova.compute.manager [req-516da1f4-3d51-477d-af4b-4618aba54cd9 req-cb8466e9-ff21-42fb-bb55-ea2d0730d6bc service nova] [instance: 8b4be6ea-c8f6-420b-9453-c0558b6c4b9f] Received event network-changed-69b23d47-a252-4a81-8119-00c851da530d {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:17:06 user nova-compute[72382]: DEBUG nova.compute.manager [req-516da1f4-3d51-477d-af4b-4618aba54cd9 req-cb8466e9-ff21-42fb-bb55-ea2d0730d6bc service nova] [instance: 8b4be6ea-c8f6-420b-9453-c0558b6c4b9f] Refreshing instance network info cache due to event network-changed-69b23d47-a252-4a81-8119-00c851da530d. {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 15:17:06 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-516da1f4-3d51-477d-af4b-4618aba54cd9 req-cb8466e9-ff21-42fb-bb55-ea2d0730d6bc service nova] Acquiring lock "refresh_cache-8b4be6ea-c8f6-420b-9453-c0558b6c4b9f" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 15:17:06 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23f25946-de3a-43fb-97a4-1f9a787e6e51/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:17:06 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23f25946-de3a-43fb-97a4-1f9a787e6e51/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:17:06 user nova-compute[72382]: DEBUG nova.network.neutron [None req-6c134a39-1f5d-4c33-8bab-18f3d95b1803 tempest-ServersNegativeTestJSON-1671359082 tempest-ServersNegativeTestJSON-1671359082-project-member] [instance: 8b4be6ea-c8f6-420b-9453-c0558b6c4b9f] Instance cache missing network info. {{(pid=72382) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 15:17:06 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23f25946-de3a-43fb-97a4-1f9a787e6e51/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:17:06 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5aa7e23-9c2c-400e-a615-5839858749e1/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:17:06 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5aa7e23-9c2c-400e-a615-5839858749e1/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:17:06 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5aa7e23-9c2c-400e-a615-5839858749e1/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:17:06 user nova-compute[72382]: INFO nova.compute.manager [None req-fac10749-478d-4c59-8039-477634657846 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] [instance: 266be814-4a2b-4f8e-a0f6-e8821fdeb95d] Rescuing
Aug 09 15:17:06 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-fac10749-478d-4c59-8039-477634657846 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Acquiring lock "refresh_cache-266be814-4a2b-4f8e-a0f6-e8821fdeb95d" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 15:17:06 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-fac10749-478d-4c59-8039-477634657846 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Acquired lock "refresh_cache-266be814-4a2b-4f8e-a0f6-e8821fdeb95d" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 15:17:06 user nova-compute[72382]: DEBUG nova.network.neutron [None req-fac10749-478d-4c59-8039-477634657846 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] [instance: 266be814-4a2b-4f8e-a0f6-e8821fdeb95d] Building network info cache for instance {{(pid=72382) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 15:17:06 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5aa7e23-9c2c-400e-a615-5839858749e1/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:17:07 user nova-compute[72382]: WARNING nova.virt.libvirt.driver [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 15:17:07 user nova-compute[72382]: WARNING nova.virt.libvirt.driver [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 15:17:07 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Hypervisor/Node resource view: name=user free_ram=6624MB free_disk=25.677207946777344GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72382) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 15:17:07 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:17:07 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:17:07 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance f780040f-b789-4b72-8986-813c7b9fe4a6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:17:07 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance 777e49ea-b674-4c3f-9cdd-ac2113032632 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:17:07 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance 44afd1bf-fa5c-4b3e-8752-b16853fef54e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:17:07 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance 266be814-4a2b-4f8e-a0f6-e8821fdeb95d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:17:07 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance c9766433-4c5a-40ed-a212-715a24f42b91 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:17:07 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance 24b63f7a-be32-424b-b72c-d5bec43c408e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:17:07 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance f0a7fa25-4520-4f40-9515-b88e3d2fd910 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:17:07 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance a33515b3-3ef4-4f76-a8d8-e7008b5bbb79 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:17:07 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance 23f25946-de3a-43fb-97a4-1f9a787e6e51 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:17:07 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance 9a82f146-97ce-4319-8b25-c1b090965e53 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:17:07 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance b5aa7e23-9c2c-400e-a615-5839858749e1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:17:07 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance f1b4f73b-7a9e-4cf1-9d51-f32284f49c53 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:17:07 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance 8b4be6ea-c8f6-420b-9453-c0558b6c4b9f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:17:07 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=72382) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 15:17:07 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=12GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=72382) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 15:17:07 user nova-compute[72382]: DEBUG nova.network.neutron [None req-6c134a39-1f5d-4c33-8bab-18f3d95b1803 tempest-ServersNegativeTestJSON-1671359082 tempest-ServersNegativeTestJSON-1671359082-project-member] [instance: 8b4be6ea-c8f6-420b-9453-c0558b6c4b9f] Updating instance_info_cache with network_info: [{"id": "69b23d47-a252-4a81-8119-00c851da530d", "address": "fa:16:3e:15:5d:a8", "network": {"id": "32d8bb03-1dc6-499b-8b79-48938664dd3b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1565950502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8995b21c93c24ab19fcfad5c4939509f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69b23d47-a2", "ovs_interfaceid": "69b23d47-a252-4a81-8119-00c851da530d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:17:07 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-6c134a39-1f5d-4c33-8bab-18f3d95b1803 tempest-ServersNegativeTestJSON-1671359082 tempest-ServersNegativeTestJSON-1671359082-project-member] Releasing lock "refresh_cache-8b4be6ea-c8f6-420b-9453-c0558b6c4b9f" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 15:17:07 user nova-compute[72382]: DEBUG nova.compute.manager [None req-6c134a39-1f5d-4c33-8bab-18f3d95b1803 tempest-ServersNegativeTestJSON-1671359082 tempest-ServersNegativeTestJSON-1671359082-project-member] [instance: 8b4be6ea-c8f6-420b-9453-c0558b6c4b9f] Instance network_info: |[{"id": "69b23d47-a252-4a81-8119-00c851da530d", "address": "fa:16:3e:15:5d:a8", "network": {"id": "32d8bb03-1dc6-499b-8b79-48938664dd3b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1565950502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8995b21c93c24ab19fcfad5c4939509f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69b23d47-a2", "ovs_interfaceid": "69b23d47-a252-4a81-8119-00c851da530d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72382) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 15:17:07 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-516da1f4-3d51-477d-af4b-4618aba54cd9 req-cb8466e9-ff21-42fb-bb55-ea2d0730d6bc service nova] Acquired lock "refresh_cache-8b4be6ea-c8f6-420b-9453-c0558b6c4b9f" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 15:17:07 user nova-compute[72382]: DEBUG nova.network.neutron [req-516da1f4-3d51-477d-af4b-4618aba54cd9 req-cb8466e9-ff21-42fb-bb55-ea2d0730d6bc service nova] [instance: 8b4be6ea-c8f6-420b-9453-c0558b6c4b9f] Refreshing network info cache for port 69b23d47-a252-4a81-8119-00c851da530d {{(pid=72382) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 15:17:07 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-6c134a39-1f5d-4c33-8bab-18f3d95b1803 tempest-ServersNegativeTestJSON-1671359082 tempest-ServersNegativeTestJSON-1671359082-project-member] [instance: 8b4be6ea-c8f6-420b-9453-c0558b6c4b9f] Start _get_guest_xml network_info=[{"id": "69b23d47-a252-4a81-8119-00c851da530d", "address": "fa:16:3e:15:5d:a8", "network": {"id": "32d8bb03-1dc6-499b-8b79-48938664dd3b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1565950502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8995b21c93c24ab19fcfad5c4939509f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69b23d47-a2", "ovs_interfaceid": "69b23d47-a252-4a81-8119-00c851da530d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T15:11:25Z,direct_url=<?>,disk_format='qcow2',id=a79f2cea-eb27-4631-aaf3-05e7d9e411b4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a638990e12cc4d6eabb6d55e13be6bdf',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T15:11:27Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'a79f2cea-eb27-4631-aaf3-05e7d9e411b4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72382) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 15:17:07 user nova-compute[72382]: WARNING nova.virt.libvirt.driver [None req-6c134a39-1f5d-4c33-8bab-18f3d95b1803 tempest-ServersNegativeTestJSON-1671359082 tempest-ServersNegativeTestJSON-1671359082-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 15:17:07 user nova-compute[72382]: WARNING nova.virt.libvirt.driver [None req-6c134a39-1f5d-4c33-8bab-18f3d95b1803 tempest-ServersNegativeTestJSON-1671359082 tempest-ServersNegativeTestJSON-1671359082-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 15:17:07 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-6c134a39-1f5d-4c33-8bab-18f3d95b1803 tempest-ServersNegativeTestJSON-1671359082 tempest-ServersNegativeTestJSON-1671359082-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72382) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 15:17:07 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-6c134a39-1f5d-4c33-8bab-18f3d95b1803 tempest-ServersNegativeTestJSON-1671359082 tempest-ServersNegativeTestJSON-1671359082-project-member] CPU controller missing on host. {{(pid=72382) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 15:17:07 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-6c134a39-1f5d-4c33-8bab-18f3d95b1803 tempest-ServersNegativeTestJSON-1671359082 tempest-ServersNegativeTestJSON-1671359082-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72382) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 15:17:07 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-6c134a39-1f5d-4c33-8bab-18f3d95b1803 tempest-ServersNegativeTestJSON-1671359082 tempest-ServersNegativeTestJSON-1671359082-project-member] CPU controller found on host. {{(pid=72382) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 15:17:07 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-6c134a39-1f5d-4c33-8bab-18f3d95b1803 tempest-ServersNegativeTestJSON-1671359082 tempest-ServersNegativeTestJSON-1671359082-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72382) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 15:17:07 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-6c134a39-1f5d-4c33-8bab-18f3d95b1803 tempest-ServersNegativeTestJSON-1671359082 tempest-ServersNegativeTestJSON-1671359082-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T15:11:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T15:11:25Z,direct_url=<?>,disk_format='qcow2',id=a79f2cea-eb27-4631-aaf3-05e7d9e411b4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a638990e12cc4d6eabb6d55e13be6bdf',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T15:11:27Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 15:17:07 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-6c134a39-1f5d-4c33-8bab-18f3d95b1803 tempest-ServersNegativeTestJSON-1671359082 tempest-ServersNegativeTestJSON-1671359082-project-member] Flavor limits 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 15:17:07 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-6c134a39-1f5d-4c33-8bab-18f3d95b1803 tempest-ServersNegativeTestJSON-1671359082 tempest-ServersNegativeTestJSON-1671359082-project-member] Image limits 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 15:17:07 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-6c134a39-1f5d-4c33-8bab-18f3d95b1803 tempest-ServersNegativeTestJSON-1671359082 tempest-ServersNegativeTestJSON-1671359082-project-member] Flavor pref 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 15:17:07 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-6c134a39-1f5d-4c33-8bab-18f3d95b1803 tempest-ServersNegativeTestJSON-1671359082 tempest-ServersNegativeTestJSON-1671359082-project-member] Image pref 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 15:17:07 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-6c134a39-1f5d-4c33-8bab-18f3d95b1803 tempest-ServersNegativeTestJSON-1671359082 tempest-ServersNegativeTestJSON-1671359082-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 15:17:07 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-6c134a39-1f5d-4c33-8bab-18f3d95b1803 tempest-ServersNegativeTestJSON-1671359082 tempest-ServersNegativeTestJSON-1671359082-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 15:17:07 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-6c134a39-1f5d-4c33-8bab-18f3d95b1803 tempest-ServersNegativeTestJSON-1671359082 tempest-ServersNegativeTestJSON-1671359082-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72382) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 15:17:07 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-6c134a39-1f5d-4c33-8bab-18f3d95b1803 tempest-ServersNegativeTestJSON-1671359082 tempest-ServersNegativeTestJSON-1671359082-project-member] Got 1 possible topologies {{(pid=72382) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 15:17:07 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-6c134a39-1f5d-4c33-8bab-18f3d95b1803 tempest-ServersNegativeTestJSON-1671359082 tempest-ServersNegativeTestJSON-1671359082-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 15:17:07 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-6c134a39-1f5d-4c33-8bab-18f3d95b1803 tempest-ServersNegativeTestJSON-1671359082 tempest-ServersNegativeTestJSON-1671359082-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 15:17:07 user nova-compute[72382]: DEBUG nova.virt.libvirt.vif [None req-6c134a39-1f5d-4c33-8bab-18f3d95b1803 tempest-ServersNegativeTestJSON-1671359082 tempest-ServersNegativeTestJSON-1671359082-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T15:17:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1006877955',display_name='tempest-ServersNegativeTestJSON-server-1006877955',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1006877955',id=13,image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8995b21c93c24ab19fcfad5c4939509f',ramdisk_id='',reservation_id='r-t415205w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1671359082',owner_user_name='tempest-ServersNegativeTestJSON-1671359082-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T15:17:05Z,user_data=None,user_id='5e4b3ed6be8f4c99ba979398388bf12d',uuid=8b4be6ea-c8f6-420b-9453-c0558b6c4b9f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "69b23d47-a252-4a81-8119-00c851da530d", "address": "fa:16:3e:15:5d:a8", "network": {"id": "32d8bb03-1dc6-499b-8b79-48938664dd3b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1565950502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8995b21c93c24ab19fcfad5c4939509f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69b23d47-a2", "ovs_interfaceid": "69b23d47-a252-4a81-8119-00c851da530d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72382) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 15:17:07 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-6c134a39-1f5d-4c33-8bab-18f3d95b1803 tempest-ServersNegativeTestJSON-1671359082 tempest-ServersNegativeTestJSON-1671359082-project-member] Converting VIF {"id": "69b23d47-a252-4a81-8119-00c851da530d", "address": "fa:16:3e:15:5d:a8", "network": {"id": "32d8bb03-1dc6-499b-8b79-48938664dd3b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1565950502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8995b21c93c24ab19fcfad5c4939509f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69b23d47-a2", "ovs_interfaceid": "69b23d47-a252-4a81-8119-00c851da530d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 15:17:07 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-6c134a39-1f5d-4c33-8bab-18f3d95b1803 tempest-ServersNegativeTestJSON-1671359082 tempest-ServersNegativeTestJSON-1671359082-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:15:5d:a8,bridge_name='br-int',has_traffic_filtering=True,id=69b23d47-a252-4a81-8119-00c851da530d,network=Network(32d8bb03-1dc6-499b-8b79-48938664dd3b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69b23d47-a2') {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 15:17:07 user nova-compute[72382]: DEBUG nova.objects.instance [None req-6c134a39-1f5d-4c33-8bab-18f3d95b1803 tempest-ServersNegativeTestJSON-1671359082 tempest-ServersNegativeTestJSON-1671359082-project-member] Lazy-loading 'pci_devices' on Instance uuid 8b4be6ea-c8f6-420b-9453-c0558b6c4b9f {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:17:07 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-6c134a39-1f5d-4c33-8bab-18f3d95b1803 tempest-ServersNegativeTestJSON-1671359082 tempest-ServersNegativeTestJSON-1671359082-project-member] [instance: 8b4be6ea-c8f6-420b-9453-c0558b6c4b9f] End _get_guest_xml xml=<domain type="kvm">
Aug 09 15:17:07 user nova-compute[72382]:   <uuid>8b4be6ea-c8f6-420b-9453-c0558b6c4b9f</uuid>
Aug 09 15:17:07 user nova-compute[72382]:   <name>instance-0000000d</name>
Aug 09 15:17:07 user nova-compute[72382]:   <memory>524288</memory>
Aug 09 15:17:07 user nova-compute[72382]:   <vcpu>1</vcpu>
Aug 09 15:17:07 user nova-compute[72382]:   <metadata>
Aug 09 15:17:07 user nova-compute[72382]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 15:17:07 user nova-compute[72382]:       <nova:package version="0.0.0"/>
Aug 09 15:17:07 user nova-compute[72382]:       <nova:name>tempest-ServersNegativeTestJSON-server-1006877955</nova:name>
Aug 09 15:17:07 user nova-compute[72382]:       <nova:creationTime>2023-08-09 15:17:07</nova:creationTime>
Aug 09 15:17:07 user nova-compute[72382]:       <nova:flavor name="m1.tiny">
Aug 09 15:17:07 user nova-compute[72382]:         <nova:memory>512</nova:memory>
Aug 09 15:17:07 user nova-compute[72382]:         <nova:disk>1</nova:disk>
Aug 09 15:17:07 user nova-compute[72382]:         <nova:swap>0</nova:swap>
Aug 09 15:17:07 user nova-compute[72382]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 15:17:07 user nova-compute[72382]:         <nova:vcpus>1</nova:vcpus>
Aug 09 15:17:07 user nova-compute[72382]:       </nova:flavor>
Aug 09 15:17:07 user nova-compute[72382]:       <nova:owner>
Aug 09 15:17:07 user nova-compute[72382]:         <nova:user uuid="5e4b3ed6be8f4c99ba979398388bf12d">tempest-ServersNegativeTestJSON-1671359082-project-member</nova:user>
Aug 09 15:17:07 user nova-compute[72382]:         <nova:project uuid="8995b21c93c24ab19fcfad5c4939509f">tempest-ServersNegativeTestJSON-1671359082</nova:project>
Aug 09 15:17:07 user nova-compute[72382]:       </nova:owner>
Aug 09 15:17:07 user nova-compute[72382]:       <nova:root type="image" uuid="a79f2cea-eb27-4631-aaf3-05e7d9e411b4"/>
Aug 09 15:17:07 user nova-compute[72382]:       <nova:ports>
Aug 09 15:17:07 user nova-compute[72382]:         <nova:port uuid="69b23d47-a252-4a81-8119-00c851da530d">
Aug 09 15:17:07 user nova-compute[72382]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 09 15:17:07 user nova-compute[72382]:         </nova:port>
Aug 09 15:17:07 user nova-compute[72382]:       </nova:ports>
Aug 09 15:17:07 user nova-compute[72382]:     </nova:instance>
Aug 09 15:17:07 user nova-compute[72382]:   </metadata>
Aug 09 15:17:07 user nova-compute[72382]:   <sysinfo type="smbios">
Aug 09 15:17:07 user nova-compute[72382]:     <system>
Aug 09 15:17:07 user nova-compute[72382]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 15:17:07 user nova-compute[72382]:       <entry name="product">OpenStack Nova</entry>
Aug 09 15:17:07 user nova-compute[72382]:       <entry name="version">0.0.0</entry>
Aug 09 15:17:07 user nova-compute[72382]:       <entry name="serial">8b4be6ea-c8f6-420b-9453-c0558b6c4b9f</entry>
Aug 09 15:17:07 user nova-compute[72382]:       <entry name="uuid">8b4be6ea-c8f6-420b-9453-c0558b6c4b9f</entry>
Aug 09 15:17:07 user nova-compute[72382]:       <entry name="family">Virtual Machine</entry>
Aug 09 15:17:07 user nova-compute[72382]:     </system>
Aug 09 15:17:07 user nova-compute[72382]:   </sysinfo>
Aug 09 15:17:07 user nova-compute[72382]:   <os>
Aug 09 15:17:07 user nova-compute[72382]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 15:17:07 user nova-compute[72382]:     <boot dev="hd"/>
Aug 09 15:17:07 user nova-compute[72382]:     <smbios mode="sysinfo"/>
Aug 09 15:17:07 user nova-compute[72382]:   </os>
Aug 09 15:17:07 user nova-compute[72382]:   <features>
Aug 09 15:17:07 user nova-compute[72382]:     <acpi/>
Aug 09 15:17:07 user nova-compute[72382]:     <apic/>
Aug 09 15:17:07 user nova-compute[72382]:     <vmcoreinfo/>
Aug 09 15:17:07 user nova-compute[72382]:   </features>
Aug 09 15:17:07 user nova-compute[72382]:   <clock offset="utc">
Aug 09 15:17:07 user nova-compute[72382]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 15:17:07 user nova-compute[72382]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 15:17:07 user nova-compute[72382]:     <timer name="hpet" present="no"/>
Aug 09 15:17:07 user nova-compute[72382]:   </clock>
Aug 09 15:17:07 user nova-compute[72382]:   <cpu mode="custom" match="exact">
Aug 09 15:17:07 user nova-compute[72382]:     <model>Nehalem</model>
Aug 09 15:17:07 user nova-compute[72382]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 15:17:07 user nova-compute[72382]:   </cpu>
Aug 09 15:17:07 user nova-compute[72382]:   <devices>
Aug 09 15:17:07 user nova-compute[72382]:     <disk type="file" device="disk">
Aug 09 15:17:07 user nova-compute[72382]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 15:17:07 user nova-compute[72382]:       <source file="/opt/stack/data/nova/instances/8b4be6ea-c8f6-420b-9453-c0558b6c4b9f/disk"/>
Aug 09 15:17:07 user nova-compute[72382]:       <target dev="vda" bus="virtio"/>
Aug 09 15:17:07 user nova-compute[72382]:     </disk>
Aug 09 15:17:07 user nova-compute[72382]:     <interface type="ethernet">
Aug 09 15:17:07 user nova-compute[72382]:       <mac address="fa:16:3e:15:5d:a8"/>
Aug 09 15:17:07 user nova-compute[72382]:       <model type="virtio"/>
Aug 09 15:17:07 user nova-compute[72382]:       <mtu size="1442"/>
Aug 09 15:17:07 user nova-compute[72382]:       <target dev="tap69b23d47-a2"/>
Aug 09 15:17:07 user nova-compute[72382]:     </interface>
Aug 09 15:17:07 user nova-compute[72382]:     <serial type="pty">
Aug 09 15:17:07 user nova-compute[72382]:       <log file="/opt/stack/data/nova/instances/8b4be6ea-c8f6-420b-9453-c0558b6c4b9f/console.log" append="off"/>
Aug 09 15:17:07 user nova-compute[72382]:     </serial>
Aug 09 15:17:07 user nova-compute[72382]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 15:17:07 user nova-compute[72382]:     <video>
Aug 09 15:17:07 user nova-compute[72382]:       <model type="virtio"/>
Aug 09 15:17:07 user nova-compute[72382]:     </video>
Aug 09 15:17:07 user nova-compute[72382]:     <rng model="virtio">
Aug 09 15:17:07 user nova-compute[72382]:       <backend model="random">/dev/urandom</backend>
Aug 09 15:17:07 user nova-compute[72382]:     </rng>
Aug 09 15:17:07 user nova-compute[72382]:     <controller type="usb" index="0" model="none"/>
Aug 09 15:17:07 user nova-compute[72382]:     <memballoon model="virtio">
Aug 09 15:17:07 user nova-compute[72382]:       <stats period="10"/>
Aug 09 15:17:07 user nova-compute[72382]:     </memballoon>
Aug 09 15:17:07 user nova-compute[72382]:   </devices>
Aug 09 15:17:07 user nova-compute[72382]: </domain>
Aug 09 15:17:07 user nova-compute[72382]:  {{(pid=72382) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 15:17:07 user nova-compute[72382]: DEBUG nova.virt.libvirt.vif [None req-6c134a39-1f5d-4c33-8bab-18f3d95b1803 tempest-ServersNegativeTestJSON-1671359082 tempest-ServersNegativeTestJSON-1671359082-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T15:17:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1006877955',display_name='tempest-ServersNegativeTestJSON-server-1006877955',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1006877955',id=13,image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8995b21c93c24ab19fcfad5c4939509f',ramdisk_id='',reservation_id='r-t415205w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1671359082',owner_user_name='tempest-ServersNegativeTestJSON-1671359082-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T15:17:05Z,user_data=None,user_id='5e4b3ed6be8f4c99ba979398388bf12d',uuid=8b4be6ea-c8f6-420b-9453-c0558b6c4b9f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "69b23d47-a252-4a81-8119-00c851da530d", "address": "fa:16:3e:15:5d:a8", "network": {"id": "32d8bb03-1dc6-499b-8b79-48938664dd3b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1565950502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8995b21c93c24ab19fcfad5c4939509f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69b23d47-a2", "ovs_interfaceid": "69b23d47-a252-4a81-8119-00c851da530d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 15:17:07 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-6c134a39-1f5d-4c33-8bab-18f3d95b1803 tempest-ServersNegativeTestJSON-1671359082 tempest-ServersNegativeTestJSON-1671359082-project-member] Converting VIF {"id": "69b23d47-a252-4a81-8119-00c851da530d", "address": "fa:16:3e:15:5d:a8", "network": {"id": "32d8bb03-1dc6-499b-8b79-48938664dd3b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1565950502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8995b21c93c24ab19fcfad5c4939509f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69b23d47-a2", "ovs_interfaceid": "69b23d47-a252-4a81-8119-00c851da530d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 15:17:07 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-6c134a39-1f5d-4c33-8bab-18f3d95b1803 tempest-ServersNegativeTestJSON-1671359082 tempest-ServersNegativeTestJSON-1671359082-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:15:5d:a8,bridge_name='br-int',has_traffic_filtering=True,id=69b23d47-a252-4a81-8119-00c851da530d,network=Network(32d8bb03-1dc6-499b-8b79-48938664dd3b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69b23d47-a2') {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 15:17:07 user nova-compute[72382]: DEBUG os_vif [None req-6c134a39-1f5d-4c33-8bab-18f3d95b1803 tempest-ServersNegativeTestJSON-1671359082 tempest-ServersNegativeTestJSON-1671359082-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:5d:a8,bridge_name='br-int',has_traffic_filtering=True,id=69b23d47-a252-4a81-8119-00c851da530d,network=Network(32d8bb03-1dc6-499b-8b79-48938664dd3b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69b23d47-a2') {{(pid=72382) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 15:17:07 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:17:07 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:17:07 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 15:17:07 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:17:07 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap69b23d47-a2, may_exist=True, interface_attrs={}) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:17:07 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap69b23d47-a2, col_values=(('external_ids', {'iface-id': '69b23d47-a252-4a81-8119-00c851da530d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:15:5d:a8', 'vm-uuid': '8b4be6ea-c8f6-420b-9453-c0558b6c4b9f'}),), if_exists=True) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:17:07 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:17:07 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:17:07 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:17:07 user nova-compute[72382]: INFO os_vif [None req-6c134a39-1f5d-4c33-8bab-18f3d95b1803 tempest-ServersNegativeTestJSON-1671359082 tempest-ServersNegativeTestJSON-1671359082-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:5d:a8,bridge_name='br-int',has_traffic_filtering=True,id=69b23d47-a252-4a81-8119-00c851da530d,network=Network(32d8bb03-1dc6-499b-8b79-48938664dd3b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69b23d47-a2')
Aug 09 15:17:07 user nova-compute[72382]: DEBUG nova.compute.provider_tree [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Inventory has not changed in ProviderTree for provider: 7b15b0e5-df4d-49db-833b-2855d21d10ae {{(pid=72382) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 15:17:07 user nova-compute[72382]: DEBUG nova.scheduler.client.report [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Inventory has not changed for provider 7b15b0e5-df4d-49db-833b-2855d21d10ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72382) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 15:17:07 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Compute_service record updated for user:user {{(pid=72382) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 15:17:07 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.570s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:17:07 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-6c134a39-1f5d-4c33-8bab-18f3d95b1803 tempest-ServersNegativeTestJSON-1671359082 tempest-ServersNegativeTestJSON-1671359082-project-member] No BDM found with device name vda, not building metadata. {{(pid=72382) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 15:17:07 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-6c134a39-1f5d-4c33-8bab-18f3d95b1803 tempest-ServersNegativeTestJSON-1671359082 tempest-ServersNegativeTestJSON-1671359082-project-member] No VIF found with MAC fa:16:3e:15:5d:a8, not building metadata {{(pid=72382) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 15:17:08 user nova-compute[72382]: DEBUG nova.network.neutron [None req-fac10749-478d-4c59-8039-477634657846 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] [instance: 266be814-4a2b-4f8e-a0f6-e8821fdeb95d] Updating instance_info_cache with network_info: [{"id": "48650c01-c5a9-44f2-a481-5120c429a5a5", "address": "fa:16:3e:25:0d:d4", "network": {"id": "46ef00c7-17ee-4e45-ba1d-dcc0a417ea85", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1360012261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "990ba791030940d38360af5879c853c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48650c01-c5", "ovs_interfaceid": "48650c01-c5a9-44f2-a481-5120c429a5a5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:17:08 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-fac10749-478d-4c59-8039-477634657846 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Releasing lock "refresh_cache-266be814-4a2b-4f8e-a0f6-e8821fdeb95d" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 15:17:08 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:17:08 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:17:08 user nova-compute[72382]: DEBUG nova.network.neutron [req-516da1f4-3d51-477d-af4b-4618aba54cd9 req-cb8466e9-ff21-42fb-bb55-ea2d0730d6bc service nova] [instance: 8b4be6ea-c8f6-420b-9453-c0558b6c4b9f] Updated VIF entry in instance network info cache for port 69b23d47-a252-4a81-8119-00c851da530d. {{(pid=72382) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 15:17:08 user nova-compute[72382]: DEBUG nova.network.neutron [req-516da1f4-3d51-477d-af4b-4618aba54cd9 req-cb8466e9-ff21-42fb-bb55-ea2d0730d6bc service nova] [instance: 8b4be6ea-c8f6-420b-9453-c0558b6c4b9f] Updating instance_info_cache with network_info: [{"id": "69b23d47-a252-4a81-8119-00c851da530d", "address": "fa:16:3e:15:5d:a8", "network": {"id": "32d8bb03-1dc6-499b-8b79-48938664dd3b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1565950502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8995b21c93c24ab19fcfad5c4939509f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69b23d47-a2", "ovs_interfaceid": "69b23d47-a252-4a81-8119-00c851da530d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:17:08 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-516da1f4-3d51-477d-af4b-4618aba54cd9 req-cb8466e9-ff21-42fb-bb55-ea2d0730d6bc service nova] Releasing lock "refresh_cache-8b4be6ea-c8f6-420b-9453-c0558b6c4b9f" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 15:17:08 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:17:08 user nova-compute[72382]: DEBUG nova.compute.manager [req-40c1d227-d4d3-447c-b510-b182b8e3d3fd req-212aa4a9-6cfb-4943-ab81-4029784039e1 service nova] [instance: 266be814-4a2b-4f8e-a0f6-e8821fdeb95d] Received event network-vif-unplugged-48650c01-c5a9-44f2-a481-5120c429a5a5 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:17:08 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-40c1d227-d4d3-447c-b510-b182b8e3d3fd req-212aa4a9-6cfb-4943-ab81-4029784039e1 service nova] Acquiring lock "266be814-4a2b-4f8e-a0f6-e8821fdeb95d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:17:08 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-40c1d227-d4d3-447c-b510-b182b8e3d3fd req-212aa4a9-6cfb-4943-ab81-4029784039e1 service nova] Lock "266be814-4a2b-4f8e-a0f6-e8821fdeb95d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:17:08 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-40c1d227-d4d3-447c-b510-b182b8e3d3fd req-212aa4a9-6cfb-4943-ab81-4029784039e1 service nova] Lock "266be814-4a2b-4f8e-a0f6-e8821fdeb95d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:17:08 user nova-compute[72382]: DEBUG nova.compute.manager [req-40c1d227-d4d3-447c-b510-b182b8e3d3fd req-212aa4a9-6cfb-4943-ab81-4029784039e1 service nova] [instance: 266be814-4a2b-4f8e-a0f6-e8821fdeb95d] No waiting events found dispatching network-vif-unplugged-48650c01-c5a9-44f2-a481-5120c429a5a5 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:17:08 user nova-compute[72382]: WARNING nova.compute.manager [req-40c1d227-d4d3-447c-b510-b182b8e3d3fd req-212aa4a9-6cfb-4943-ab81-4029784039e1 service nova] [instance: 266be814-4a2b-4f8e-a0f6-e8821fdeb95d] Received unexpected event network-vif-unplugged-48650c01-c5a9-44f2-a481-5120c429a5a5 for instance with vm_state active and task_state rescuing.
Aug 09 15:17:08 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:17:08 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:17:08 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:17:08 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:17:08 user nova-compute[72382]: DEBUG nova.compute.manager [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72382) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 15:17:09 user nova-compute[72382]: INFO nova.virt.libvirt.driver [-] [instance: 266be814-4a2b-4f8e-a0f6-e8821fdeb95d] Instance destroyed successfully.
Aug 09 15:17:09 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-fac10749-478d-4c59-8039-477634657846 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] [instance: 266be814-4a2b-4f8e-a0f6-e8821fdeb95d] Attempting rescue
Aug 09 15:17:09 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-fac10749-478d-4c59-8039-477634657846 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=72382) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 09 15:17:09 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-fac10749-478d-4c59-8039-477634657846 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] [instance: 266be814-4a2b-4f8e-a0f6-e8821fdeb95d] Instance directory exists: not creating {{(pid=72382) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 09 15:17:09 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-fac10749-478d-4c59-8039-477634657846 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] [instance: 266be814-4a2b-4f8e-a0f6-e8821fdeb95d] Creating image(s)
Aug 09 15:17:09 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-fac10749-478d-4c59-8039-477634657846 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Acquiring lock "/opt/stack/data/nova/instances/266be814-4a2b-4f8e-a0f6-e8821fdeb95d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:17:09 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-fac10749-478d-4c59-8039-477634657846 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Lock "/opt/stack/data/nova/instances/266be814-4a2b-4f8e-a0f6-e8821fdeb95d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:17:09 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-fac10749-478d-4c59-8039-477634657846 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Lock "/opt/stack/data/nova/instances/266be814-4a2b-4f8e-a0f6-e8821fdeb95d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:17:09 user nova-compute[72382]: DEBUG nova.objects.instance [None req-fac10749-478d-4c59-8039-477634657846 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Lazy-loading 'trusted_certs' on Instance uuid 266be814-4a2b-4f8e-a0f6-e8821fdeb95d {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:17:09 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:17:09 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-fac10749-478d-4c59-8039-477634657846 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Acquiring lock "383812ff437283e0191ed5b9ecc04c27f1162b0b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:17:09 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-fac10749-478d-4c59-8039-477634657846 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Lock "383812ff437283e0191ed5b9ecc04c27f1162b0b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:17:09 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-fac10749-478d-4c59-8039-477634657846 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:17:09 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:17:09 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:17:09 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-fac10749-478d-4c59-8039-477634657846 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b --force-share --output=json" returned: 0 in 0.155s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:17:09 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-fac10749-478d-4c59-8039-477634657846 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b,backing_fmt=raw /opt/stack/data/nova/instances/266be814-4a2b-4f8e-a0f6-e8821fdeb95d/disk.rescue {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:17:09 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-fac10749-478d-4c59-8039-477634657846 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b,backing_fmt=raw /opt/stack/data/nova/instances/266be814-4a2b-4f8e-a0f6-e8821fdeb95d/disk.rescue" returned: 0 in 0.065s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:17:09 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-fac10749-478d-4c59-8039-477634657846 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Lock "383812ff437283e0191ed5b9ecc04c27f1162b0b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.226s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:17:09 user nova-compute[72382]: DEBUG nova.objects.instance [None req-fac10749-478d-4c59-8039-477634657846 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Lazy-loading 'migration_context' on Instance uuid 266be814-4a2b-4f8e-a0f6-e8821fdeb95d {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:17:09 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-fac10749-478d-4c59-8039-477634657846 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] [instance: 266be814-4a2b-4f8e-a0f6-e8821fdeb95d] Created local disks {{(pid=72382) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 15:17:09 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-fac10749-478d-4c59-8039-477634657846 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] [instance: 266be814-4a2b-4f8e-a0f6-e8821fdeb95d] Start _get_guest_xml network_info=[{"id": "48650c01-c5a9-44f2-a481-5120c429a5a5", "address": "fa:16:3e:25:0d:d4", "network": {"id": "46ef00c7-17ee-4e45-ba1d-dcc0a417ea85", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1360012261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1360012261-network", "vif_mac": "fa:16:3e:25:0d:d4"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "990ba791030940d38360af5879c853c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48650c01-c5", "ovs_interfaceid": "48650c01-c5a9-44f2-a481-5120c429a5a5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T15:11:25Z,direct_url=<?>,disk_format='qcow2',id=a79f2cea-eb27-4631-aaf3-05e7d9e411b4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a638990e12cc4d6eabb6d55e13be6bdf',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T15:11:27Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'a79f2cea-eb27-4631-aaf3-05e7d9e411b4', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=72382) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 15:17:09 user nova-compute[72382]: DEBUG nova.objects.instance [None req-fac10749-478d-4c59-8039-477634657846 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Lazy-loading 'resources' on Instance uuid 266be814-4a2b-4f8e-a0f6-e8821fdeb95d {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:17:09 user nova-compute[72382]: DEBUG nova.objects.instance [None req-fac10749-478d-4c59-8039-477634657846 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Lazy-loading 'numa_topology' on Instance uuid 266be814-4a2b-4f8e-a0f6-e8821fdeb95d {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:17:09 user nova-compute[72382]: WARNING nova.virt.libvirt.driver [None req-fac10749-478d-4c59-8039-477634657846 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 15:17:09 user nova-compute[72382]: WARNING nova.virt.libvirt.driver [None req-fac10749-478d-4c59-8039-477634657846 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 15:17:09 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-fac10749-478d-4c59-8039-477634657846 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72382) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 15:17:09 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-fac10749-478d-4c59-8039-477634657846 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] CPU controller missing on host. {{(pid=72382) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 15:17:09 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-fac10749-478d-4c59-8039-477634657846 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72382) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 15:17:09 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-fac10749-478d-4c59-8039-477634657846 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] CPU controller found on host. {{(pid=72382) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 15:17:09 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-fac10749-478d-4c59-8039-477634657846 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72382) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 15:17:09 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-fac10749-478d-4c59-8039-477634657846 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T15:11:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T15:11:25Z,direct_url=<?>,disk_format='qcow2',id=a79f2cea-eb27-4631-aaf3-05e7d9e411b4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a638990e12cc4d6eabb6d55e13be6bdf',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T15:11:27Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 15:17:09 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-fac10749-478d-4c59-8039-477634657846 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Flavor limits 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 15:17:09 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-fac10749-478d-4c59-8039-477634657846 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Image limits 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 15:17:09 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-fac10749-478d-4c59-8039-477634657846 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Flavor pref 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 15:17:09 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-fac10749-478d-4c59-8039-477634657846 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Image pref 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 15:17:09 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-fac10749-478d-4c59-8039-477634657846 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 15:17:09 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-fac10749-478d-4c59-8039-477634657846 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 15:17:09 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-fac10749-478d-4c59-8039-477634657846 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72382) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 15:17:09 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-fac10749-478d-4c59-8039-477634657846 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Got 1 possible topologies {{(pid=72382) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 15:17:09 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-fac10749-478d-4c59-8039-477634657846 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 15:17:09 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-fac10749-478d-4c59-8039-477634657846 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 15:17:09 user nova-compute[72382]: DEBUG nova.objects.instance [None req-fac10749-478d-4c59-8039-477634657846 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Lazy-loading 'vcpu_model' on Instance uuid 266be814-4a2b-4f8e-a0f6-e8821fdeb95d {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:17:09 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:17:09 user nova-compute[72382]: DEBUG nova.virt.libvirt.vif [None req-fac10749-478d-4c59-8039-477634657846 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T15:15:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1904336264',display_name='tempest-ServerRescueNegativeTestJSON-server-1904336264',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1904336264',id=4,image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-09T15:15:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='990ba791030940d38360af5879c853c5',ramdisk_id='',reservation_id='r-odim6gvi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-867522113',owner_user_name='tempest-ServerRescueNegativeTestJSON-867522113-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T15:15:36Z,user_data=None,user_id='f94ca386a2be42cfbc2407bb7520cd25',uuid=266be814-4a2b-4f8e-a0f6-e8821fdeb95d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "48650c01-c5a9-44f2-a481-5120c429a5a5", "address": "fa:16:3e:25:0d:d4", "network": {"id": "46ef00c7-17ee-4e45-ba1d-dcc0a417ea85", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1360012261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1360012261-network", "vif_mac": "fa:16:3e:25:0d:d4"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "990ba791030940d38360af5879c853c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48650c01-c5", "ovs_interfaceid": "48650c01-c5a9-44f2-a481-5120c429a5a5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72382) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 15:17:09 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-fac10749-478d-4c59-8039-477634657846 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Converting VIF {"id": "48650c01-c5a9-44f2-a481-5120c429a5a5", "address": "fa:16:3e:25:0d:d4", "network": {"id": "46ef00c7-17ee-4e45-ba1d-dcc0a417ea85", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1360012261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1360012261-network", "vif_mac": "fa:16:3e:25:0d:d4"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "990ba791030940d38360af5879c853c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48650c01-c5", "ovs_interfaceid": "48650c01-c5a9-44f2-a481-5120c429a5a5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 15:17:09 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-fac10749-478d-4c59-8039-477634657846 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:25:0d:d4,bridge_name='br-int',has_traffic_filtering=True,id=48650c01-c5a9-44f2-a481-5120c429a5a5,network=Network(46ef00c7-17ee-4e45-ba1d-dcc0a417ea85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48650c01-c5') {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 15:17:09 user nova-compute[72382]: DEBUG nova.objects.instance [None req-fac10749-478d-4c59-8039-477634657846 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Lazy-loading 'pci_devices' on Instance uuid 266be814-4a2b-4f8e-a0f6-e8821fdeb95d {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:17:09 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:17:09 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-fac10749-478d-4c59-8039-477634657846 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] [instance: 266be814-4a2b-4f8e-a0f6-e8821fdeb95d] End _get_guest_xml xml=<domain type="kvm">
Aug 09 15:17:09 user nova-compute[72382]:   <uuid>266be814-4a2b-4f8e-a0f6-e8821fdeb95d</uuid>
Aug 09 15:17:09 user nova-compute[72382]:   <name>instance-00000004</name>
Aug 09 15:17:09 user nova-compute[72382]:   <memory>524288</memory>
Aug 09 15:17:09 user nova-compute[72382]:   <vcpu>1</vcpu>
Aug 09 15:17:09 user nova-compute[72382]:   <metadata>
Aug 09 15:17:09 user nova-compute[72382]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 15:17:09 user nova-compute[72382]:       <nova:package version="0.0.0"/>
Aug 09 15:17:09 user nova-compute[72382]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1904336264</nova:name>
Aug 09 15:17:09 user nova-compute[72382]:       <nova:creationTime>2023-08-09 15:17:09</nova:creationTime>
Aug 09 15:17:09 user nova-compute[72382]:       <nova:flavor name="m1.tiny">
Aug 09 15:17:09 user nova-compute[72382]:         <nova:memory>512</nova:memory>
Aug 09 15:17:09 user nova-compute[72382]:         <nova:disk>1</nova:disk>
Aug 09 15:17:09 user nova-compute[72382]:         <nova:swap>0</nova:swap>
Aug 09 15:17:09 user nova-compute[72382]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 15:17:09 user nova-compute[72382]:         <nova:vcpus>1</nova:vcpus>
Aug 09 15:17:09 user nova-compute[72382]:       </nova:flavor>
Aug 09 15:17:09 user nova-compute[72382]:       <nova:owner>
Aug 09 15:17:09 user nova-compute[72382]:         <nova:user uuid="f94ca386a2be42cfbc2407bb7520cd25">tempest-ServerRescueNegativeTestJSON-867522113-project-member</nova:user>
Aug 09 15:17:09 user nova-compute[72382]:         <nova:project uuid="990ba791030940d38360af5879c853c5">tempest-ServerRescueNegativeTestJSON-867522113</nova:project>
Aug 09 15:17:09 user nova-compute[72382]:       </nova:owner>
Aug 09 15:17:09 user nova-compute[72382]:       <nova:root type="image" uuid="a79f2cea-eb27-4631-aaf3-05e7d9e411b4"/>
Aug 09 15:17:09 user nova-compute[72382]:       <nova:ports>
Aug 09 15:17:09 user nova-compute[72382]:         <nova:port uuid="48650c01-c5a9-44f2-a481-5120c429a5a5">
Aug 09 15:17:09 user nova-compute[72382]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 09 15:17:09 user nova-compute[72382]:         </nova:port>
Aug 09 15:17:09 user nova-compute[72382]:       </nova:ports>
Aug 09 15:17:09 user nova-compute[72382]:     </nova:instance>
Aug 09 15:17:09 user nova-compute[72382]:   </metadata>
Aug 09 15:17:09 user nova-compute[72382]:   <sysinfo type="smbios">
Aug 09 15:17:09 user nova-compute[72382]:     <system>
Aug 09 15:17:09 user nova-compute[72382]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 15:17:09 user nova-compute[72382]:       <entry name="product">OpenStack Nova</entry>
Aug 09 15:17:09 user nova-compute[72382]:       <entry name="version">0.0.0</entry>
Aug 09 15:17:09 user nova-compute[72382]:       <entry name="serial">266be814-4a2b-4f8e-a0f6-e8821fdeb95d</entry>
Aug 09 15:17:09 user nova-compute[72382]:       <entry name="uuid">266be814-4a2b-4f8e-a0f6-e8821fdeb95d</entry>
Aug 09 15:17:09 user nova-compute[72382]:       <entry name="family">Virtual Machine</entry>
Aug 09 15:17:09 user nova-compute[72382]:     </system>
Aug 09 15:17:09 user nova-compute[72382]:   </sysinfo>
Aug 09 15:17:09 user nova-compute[72382]:   <os>
Aug 09 15:17:09 user nova-compute[72382]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 15:17:09 user nova-compute[72382]:     <smbios mode="sysinfo"/>
Aug 09 15:17:09 user nova-compute[72382]:   </os>
Aug 09 15:17:09 user nova-compute[72382]:   <features>
Aug 09 15:17:09 user nova-compute[72382]:     <acpi/>
Aug 09 15:17:09 user nova-compute[72382]:     <apic/>
Aug 09 15:17:09 user nova-compute[72382]:     <vmcoreinfo/>
Aug 09 15:17:09 user nova-compute[72382]:   </features>
Aug 09 15:17:09 user nova-compute[72382]:   <clock offset="utc">
Aug 09 15:17:09 user nova-compute[72382]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 15:17:09 user nova-compute[72382]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 15:17:09 user nova-compute[72382]:     <timer name="hpet" present="no"/>
Aug 09 15:17:09 user nova-compute[72382]:   </clock>
Aug 09 15:17:09 user nova-compute[72382]:   <cpu mode="custom" match="exact">
Aug 09 15:17:09 user nova-compute[72382]:     <model>Nehalem</model>
Aug 09 15:17:09 user nova-compute[72382]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 15:17:09 user nova-compute[72382]:   </cpu>
Aug 09 15:17:09 user nova-compute[72382]:   <devices>
Aug 09 15:17:09 user nova-compute[72382]:     <disk type="file" device="disk">
Aug 09 15:17:09 user nova-compute[72382]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 15:17:09 user nova-compute[72382]:       <source file="/opt/stack/data/nova/instances/266be814-4a2b-4f8e-a0f6-e8821fdeb95d/disk.rescue"/>
Aug 09 15:17:09 user nova-compute[72382]:       <target dev="vda" bus="virtio"/>
Aug 09 15:17:09 user nova-compute[72382]:     </disk>
Aug 09 15:17:09 user nova-compute[72382]:     <disk type="file" device="disk">
Aug 09 15:17:09 user nova-compute[72382]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 15:17:09 user nova-compute[72382]:       <source file="/opt/stack/data/nova/instances/266be814-4a2b-4f8e-a0f6-e8821fdeb95d/disk"/>
Aug 09 15:17:09 user nova-compute[72382]:       <target dev="vdb" bus="virtio"/>
Aug 09 15:17:09 user nova-compute[72382]:     </disk>
Aug 09 15:17:09 user nova-compute[72382]:     <interface type="ethernet">
Aug 09 15:17:09 user nova-compute[72382]:       <mac address="fa:16:3e:25:0d:d4"/>
Aug 09 15:17:09 user nova-compute[72382]:       <model type="virtio"/>
Aug 09 15:17:09 user nova-compute[72382]:       <mtu size="1442"/>
Aug 09 15:17:09 user nova-compute[72382]:       <target dev="tap48650c01-c5"/>
Aug 09 15:17:09 user nova-compute[72382]:     </interface>
Aug 09 15:17:09 user nova-compute[72382]:     <serial type="pty">
Aug 09 15:17:09 user nova-compute[72382]:       <log file="/opt/stack/data/nova/instances/266be814-4a2b-4f8e-a0f6-e8821fdeb95d/console.log" append="off"/>
Aug 09 15:17:09 user nova-compute[72382]:     </serial>
Aug 09 15:17:09 user nova-compute[72382]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 15:17:09 user nova-compute[72382]:     <video>
Aug 09 15:17:09 user nova-compute[72382]:       <model type="virtio"/>
Aug 09 15:17:09 user nova-compute[72382]:     </video>
Aug 09 15:17:09 user nova-compute[72382]:     <rng model="virtio">
Aug 09 15:17:09 user nova-compute[72382]:       <backend model="random">/dev/urandom</backend>
Aug 09 15:17:09 user nova-compute[72382]:     </rng>
Aug 09 15:17:09 user nova-compute[72382]:     <controller type="usb" index="0" model="none"/>
Aug 09 15:17:09 user nova-compute[72382]:     <memballoon model="virtio">
Aug 09 15:17:09 user nova-compute[72382]:       <stats period="10"/>
Aug 09 15:17:09 user nova-compute[72382]:     </memballoon>
Aug 09 15:17:09 user nova-compute[72382]:   </devices>
Aug 09 15:17:09 user nova-compute[72382]: </domain>
Aug 09 15:17:09 user nova-compute[72382]:  {{(pid=72382) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 15:17:09 user nova-compute[72382]: INFO nova.virt.libvirt.driver [-] [instance: 266be814-4a2b-4f8e-a0f6-e8821fdeb95d] Instance destroyed successfully.
Aug 09 15:17:10 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-fac10749-478d-4c59-8039-477634657846 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] No BDM found with device name vda, not building metadata. {{(pid=72382) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 15:17:10 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-fac10749-478d-4c59-8039-477634657846 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72382) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 15:17:10 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-fac10749-478d-4c59-8039-477634657846 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] No VIF found with MAC fa:16:3e:25:0d:d4, not building metadata {{(pid=72382) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 15:17:10 user nova-compute[72382]: DEBUG nova.compute.manager [req-e966947a-04b5-4920-af34-75620f7d4332 req-f796d1ee-ac8b-4ebe-a099-a9f93dd8f4d1 service nova] [instance: 266be814-4a2b-4f8e-a0f6-e8821fdeb95d] Received event network-vif-plugged-48650c01-c5a9-44f2-a481-5120c429a5a5 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:17:10 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-e966947a-04b5-4920-af34-75620f7d4332 req-f796d1ee-ac8b-4ebe-a099-a9f93dd8f4d1 service nova] Acquiring lock "266be814-4a2b-4f8e-a0f6-e8821fdeb95d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:17:10 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-e966947a-04b5-4920-af34-75620f7d4332 req-f796d1ee-ac8b-4ebe-a099-a9f93dd8f4d1 service nova] Lock "266be814-4a2b-4f8e-a0f6-e8821fdeb95d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:17:10 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-e966947a-04b5-4920-af34-75620f7d4332 req-f796d1ee-ac8b-4ebe-a099-a9f93dd8f4d1 service nova] Lock "266be814-4a2b-4f8e-a0f6-e8821fdeb95d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:17:10 user nova-compute[72382]: DEBUG nova.compute.manager [req-e966947a-04b5-4920-af34-75620f7d4332 req-f796d1ee-ac8b-4ebe-a099-a9f93dd8f4d1 service nova] [instance: 266be814-4a2b-4f8e-a0f6-e8821fdeb95d] No waiting events found dispatching network-vif-plugged-48650c01-c5a9-44f2-a481-5120c429a5a5 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:17:10 user nova-compute[72382]: WARNING nova.compute.manager [req-e966947a-04b5-4920-af34-75620f7d4332 req-f796d1ee-ac8b-4ebe-a099-a9f93dd8f4d1 service nova] [instance: 266be814-4a2b-4f8e-a0f6-e8821fdeb95d] Received unexpected event network-vif-plugged-48650c01-c5a9-44f2-a481-5120c429a5a5 for instance with vm_state active and task_state rescuing.
Aug 09 15:17:10 user nova-compute[72382]: DEBUG nova.compute.manager [req-e966947a-04b5-4920-af34-75620f7d4332 req-f796d1ee-ac8b-4ebe-a099-a9f93dd8f4d1 service nova] [instance: 8b4be6ea-c8f6-420b-9453-c0558b6c4b9f] Received event network-vif-plugged-69b23d47-a252-4a81-8119-00c851da530d {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:17:10 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-e966947a-04b5-4920-af34-75620f7d4332 req-f796d1ee-ac8b-4ebe-a099-a9f93dd8f4d1 service nova] Acquiring lock "8b4be6ea-c8f6-420b-9453-c0558b6c4b9f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:17:10 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-e966947a-04b5-4920-af34-75620f7d4332 req-f796d1ee-ac8b-4ebe-a099-a9f93dd8f4d1 service nova] Lock "8b4be6ea-c8f6-420b-9453-c0558b6c4b9f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:17:10 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-e966947a-04b5-4920-af34-75620f7d4332 req-f796d1ee-ac8b-4ebe-a099-a9f93dd8f4d1 service nova] Lock "8b4be6ea-c8f6-420b-9453-c0558b6c4b9f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:17:10 user nova-compute[72382]: DEBUG nova.compute.manager [req-e966947a-04b5-4920-af34-75620f7d4332 req-f796d1ee-ac8b-4ebe-a099-a9f93dd8f4d1 service nova] [instance: 8b4be6ea-c8f6-420b-9453-c0558b6c4b9f] No waiting events found dispatching network-vif-plugged-69b23d47-a252-4a81-8119-00c851da530d {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:17:10 user nova-compute[72382]: WARNING nova.compute.manager [req-e966947a-04b5-4920-af34-75620f7d4332 req-f796d1ee-ac8b-4ebe-a099-a9f93dd8f4d1 service nova] [instance: 8b4be6ea-c8f6-420b-9453-c0558b6c4b9f] Received unexpected event network-vif-plugged-69b23d47-a252-4a81-8119-00c851da530d for instance with vm_state building and task_state spawning.
Aug 09 15:17:10 user nova-compute[72382]: DEBUG nova.compute.manager [req-e966947a-04b5-4920-af34-75620f7d4332 req-f796d1ee-ac8b-4ebe-a099-a9f93dd8f4d1 service nova] [instance: 8b4be6ea-c8f6-420b-9453-c0558b6c4b9f] Received event network-vif-plugged-69b23d47-a252-4a81-8119-00c851da530d {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:17:10 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-e966947a-04b5-4920-af34-75620f7d4332 req-f796d1ee-ac8b-4ebe-a099-a9f93dd8f4d1 service nova] Acquiring lock "8b4be6ea-c8f6-420b-9453-c0558b6c4b9f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:17:10 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-e966947a-04b5-4920-af34-75620f7d4332 req-f796d1ee-ac8b-4ebe-a099-a9f93dd8f4d1 service nova] Lock "8b4be6ea-c8f6-420b-9453-c0558b6c4b9f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:17:10 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-e966947a-04b5-4920-af34-75620f7d4332 req-f796d1ee-ac8b-4ebe-a099-a9f93dd8f4d1 service nova] Lock "8b4be6ea-c8f6-420b-9453-c0558b6c4b9f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:17:10 user nova-compute[72382]: DEBUG nova.compute.manager [req-e966947a-04b5-4920-af34-75620f7d4332 req-f796d1ee-ac8b-4ebe-a099-a9f93dd8f4d1 service nova] [instance: 8b4be6ea-c8f6-420b-9453-c0558b6c4b9f] No waiting events found dispatching network-vif-plugged-69b23d47-a252-4a81-8119-00c851da530d {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:17:10 user nova-compute[72382]: WARNING nova.compute.manager [req-e966947a-04b5-4920-af34-75620f7d4332 req-f796d1ee-ac8b-4ebe-a099-a9f93dd8f4d1 service nova] [instance: 8b4be6ea-c8f6-420b-9453-c0558b6c4b9f] Received unexpected event network-vif-plugged-69b23d47-a252-4a81-8119-00c851da530d for instance with vm_state building and task_state spawning.
Aug 09 15:17:10 user nova-compute[72382]: DEBUG nova.compute.manager [req-a8775110-ccb4-46f0-a3bd-909744b7e18b req-b069186b-8073-4247-ba89-f1d2b8282356 service nova] [instance: c9766433-4c5a-40ed-a212-715a24f42b91] Received event network-changed-599dae3b-13bb-47af-b889-0037e03d5e31 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:17:10 user nova-compute[72382]: DEBUG nova.compute.manager [req-a8775110-ccb4-46f0-a3bd-909744b7e18b req-b069186b-8073-4247-ba89-f1d2b8282356 service nova] [instance: c9766433-4c5a-40ed-a212-715a24f42b91] Refreshing instance network info cache due to event network-changed-599dae3b-13bb-47af-b889-0037e03d5e31. {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 15:17:10 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-a8775110-ccb4-46f0-a3bd-909744b7e18b req-b069186b-8073-4247-ba89-f1d2b8282356 service nova] Acquiring lock "refresh_cache-c9766433-4c5a-40ed-a212-715a24f42b91" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 15:17:10 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-a8775110-ccb4-46f0-a3bd-909744b7e18b req-b069186b-8073-4247-ba89-f1d2b8282356 service nova] Acquired lock "refresh_cache-c9766433-4c5a-40ed-a212-715a24f42b91" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 15:17:10 user nova-compute[72382]: DEBUG nova.network.neutron [req-a8775110-ccb4-46f0-a3bd-909744b7e18b req-b069186b-8073-4247-ba89-f1d2b8282356 service nova] [instance: c9766433-4c5a-40ed-a212-715a24f42b91] Refreshing network info cache for port 599dae3b-13bb-47af-b889-0037e03d5e31 {{(pid=72382) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 15:17:11 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:17:11 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:17:11 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:17:11 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:17:11 user nova-compute[72382]: DEBUG nova.network.neutron [req-a8775110-ccb4-46f0-a3bd-909744b7e18b req-b069186b-8073-4247-ba89-f1d2b8282356 service nova] [instance: c9766433-4c5a-40ed-a212-715a24f42b91] Updated VIF entry in instance network info cache for port 599dae3b-13bb-47af-b889-0037e03d5e31. {{(pid=72382) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 15:17:11 user nova-compute[72382]: DEBUG nova.network.neutron [req-a8775110-ccb4-46f0-a3bd-909744b7e18b req-b069186b-8073-4247-ba89-f1d2b8282356 service nova] [instance: c9766433-4c5a-40ed-a212-715a24f42b91] Updating instance_info_cache with network_info: [{"id": "599dae3b-13bb-47af-b889-0037e03d5e31", "address": "fa:16:3e:66:9f:0b", "network": {"id": "63303ac8-d370-4386-a6bc-576677b64740", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1379220233-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f45d010dd474c92a6b24bf977564ad1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap599dae3b-13", "ovs_interfaceid": "599dae3b-13bb-47af-b889-0037e03d5e31", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:17:11 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-a8775110-ccb4-46f0-a3bd-909744b7e18b req-b069186b-8073-4247-ba89-f1d2b8282356 service nova] Releasing lock "refresh_cache-c9766433-4c5a-40ed-a212-715a24f42b91" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 15:17:11 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:17:11 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:17:11 user nova-compute[72382]: DEBUG nova.virt.driver [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Emitting event <LifecycleEvent: 1691594231.9579396, 8b4be6ea-c8f6-420b-9453-c0558b6c4b9f => Resumed> {{(pid=72382) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 15:17:11 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 8b4be6ea-c8f6-420b-9453-c0558b6c4b9f] VM Resumed (Lifecycle Event)
Aug 09 15:17:11 user nova-compute[72382]: DEBUG nova.compute.manager [None req-6c134a39-1f5d-4c33-8bab-18f3d95b1803 tempest-ServersNegativeTestJSON-1671359082 tempest-ServersNegativeTestJSON-1671359082-project-member] [instance: 8b4be6ea-c8f6-420b-9453-c0558b6c4b9f] Instance event wait completed in 0 seconds for  {{(pid=72382) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 15:17:11 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-6c134a39-1f5d-4c33-8bab-18f3d95b1803 tempest-ServersNegativeTestJSON-1671359082 tempest-ServersNegativeTestJSON-1671359082-project-member] [instance: 8b4be6ea-c8f6-420b-9453-c0558b6c4b9f] Guest created on hypervisor {{(pid=72382) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 15:17:11 user nova-compute[72382]: INFO nova.virt.libvirt.driver [-] [instance: 8b4be6ea-c8f6-420b-9453-c0558b6c4b9f] Instance spawned successfully.
Aug 09 15:17:11 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-6c134a39-1f5d-4c33-8bab-18f3d95b1803 tempest-ServersNegativeTestJSON-1671359082 tempest-ServersNegativeTestJSON-1671359082-project-member] [instance: 8b4be6ea-c8f6-420b-9453-c0558b6c4b9f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 15:17:11 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 8b4be6ea-c8f6-420b-9453-c0558b6c4b9f] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:17:11 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 8b4be6ea-c8f6-420b-9453-c0558b6c4b9f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72382) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 15:17:12 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-6c134a39-1f5d-4c33-8bab-18f3d95b1803 tempest-ServersNegativeTestJSON-1671359082 tempest-ServersNegativeTestJSON-1671359082-project-member] [instance: 8b4be6ea-c8f6-420b-9453-c0558b6c4b9f] Found default for hw_cdrom_bus of ide {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:17:12 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-6c134a39-1f5d-4c33-8bab-18f3d95b1803 tempest-ServersNegativeTestJSON-1671359082 tempest-ServersNegativeTestJSON-1671359082-project-member] [instance: 8b4be6ea-c8f6-420b-9453-c0558b6c4b9f] Found default for hw_disk_bus of virtio {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:17:12 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-6c134a39-1f5d-4c33-8bab-18f3d95b1803 tempest-ServersNegativeTestJSON-1671359082 tempest-ServersNegativeTestJSON-1671359082-project-member] [instance: 8b4be6ea-c8f6-420b-9453-c0558b6c4b9f] Found default for hw_input_bus of None {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:17:12 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-6c134a39-1f5d-4c33-8bab-18f3d95b1803 tempest-ServersNegativeTestJSON-1671359082 tempest-ServersNegativeTestJSON-1671359082-project-member] [instance: 8b4be6ea-c8f6-420b-9453-c0558b6c4b9f] Found default for hw_pointer_model of None {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:17:12 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-6c134a39-1f5d-4c33-8bab-18f3d95b1803 tempest-ServersNegativeTestJSON-1671359082 tempest-ServersNegativeTestJSON-1671359082-project-member] [instance: 8b4be6ea-c8f6-420b-9453-c0558b6c4b9f] Found default for hw_video_model of virtio {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:17:12 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-6c134a39-1f5d-4c33-8bab-18f3d95b1803 tempest-ServersNegativeTestJSON-1671359082 tempest-ServersNegativeTestJSON-1671359082-project-member] [instance: 8b4be6ea-c8f6-420b-9453-c0558b6c4b9f] Found default for hw_vif_model of virtio {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:17:12 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 8b4be6ea-c8f6-420b-9453-c0558b6c4b9f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 15:17:12 user nova-compute[72382]: DEBUG nova.virt.driver [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Emitting event <LifecycleEvent: 1691594231.9614315, 8b4be6ea-c8f6-420b-9453-c0558b6c4b9f => Started> {{(pid=72382) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 15:17:12 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 8b4be6ea-c8f6-420b-9453-c0558b6c4b9f] VM Started (Lifecycle Event)
Aug 09 15:17:12 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 8b4be6ea-c8f6-420b-9453-c0558b6c4b9f] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:17:12 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 8b4be6ea-c8f6-420b-9453-c0558b6c4b9f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72382) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 15:17:12 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 8b4be6ea-c8f6-420b-9453-c0558b6c4b9f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 15:17:12 user nova-compute[72382]: INFO nova.compute.manager [None req-6c134a39-1f5d-4c33-8bab-18f3d95b1803 tempest-ServersNegativeTestJSON-1671359082 tempest-ServersNegativeTestJSON-1671359082-project-member] [instance: 8b4be6ea-c8f6-420b-9453-c0558b6c4b9f] Took 7.50 seconds to spawn the instance on the hypervisor.
Aug 09 15:17:12 user nova-compute[72382]: DEBUG nova.compute.manager [None req-6c134a39-1f5d-4c33-8bab-18f3d95b1803 tempest-ServersNegativeTestJSON-1671359082 tempest-ServersNegativeTestJSON-1671359082-project-member] [instance: 8b4be6ea-c8f6-420b-9453-c0558b6c4b9f] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:17:12 user nova-compute[72382]: INFO nova.compute.manager [None req-6c134a39-1f5d-4c33-8bab-18f3d95b1803 tempest-ServersNegativeTestJSON-1671359082 tempest-ServersNegativeTestJSON-1671359082-project-member] [instance: 8b4be6ea-c8f6-420b-9453-c0558b6c4b9f] Took 8.66 seconds to build instance.
Aug 09 15:17:12 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-6c134a39-1f5d-4c33-8bab-18f3d95b1803 tempest-ServersNegativeTestJSON-1671359082 tempest-ServersNegativeTestJSON-1671359082-project-member] Lock "8b4be6ea-c8f6-420b-9453-c0558b6c4b9f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.764s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:17:12 user nova-compute[72382]: DEBUG nova.compute.manager [req-89d4b80d-2f4b-4542-a5af-89fbff87d7bc req-9996c652-818e-4bc7-a4da-1469c19d1289 service nova] [instance: 266be814-4a2b-4f8e-a0f6-e8821fdeb95d] Received event network-vif-plugged-48650c01-c5a9-44f2-a481-5120c429a5a5 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:17:12 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-89d4b80d-2f4b-4542-a5af-89fbff87d7bc req-9996c652-818e-4bc7-a4da-1469c19d1289 service nova] Acquiring lock "266be814-4a2b-4f8e-a0f6-e8821fdeb95d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:17:12 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-89d4b80d-2f4b-4542-a5af-89fbff87d7bc req-9996c652-818e-4bc7-a4da-1469c19d1289 service nova] Lock "266be814-4a2b-4f8e-a0f6-e8821fdeb95d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:17:12 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-89d4b80d-2f4b-4542-a5af-89fbff87d7bc req-9996c652-818e-4bc7-a4da-1469c19d1289 service nova] Lock "266be814-4a2b-4f8e-a0f6-e8821fdeb95d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:17:12 user nova-compute[72382]: DEBUG nova.compute.manager [req-89d4b80d-2f4b-4542-a5af-89fbff87d7bc req-9996c652-818e-4bc7-a4da-1469c19d1289 service nova] [instance: 266be814-4a2b-4f8e-a0f6-e8821fdeb95d] No waiting events found dispatching network-vif-plugged-48650c01-c5a9-44f2-a481-5120c429a5a5 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:17:12 user nova-compute[72382]: WARNING nova.compute.manager [req-89d4b80d-2f4b-4542-a5af-89fbff87d7bc req-9996c652-818e-4bc7-a4da-1469c19d1289 service nova] [instance: 266be814-4a2b-4f8e-a0f6-e8821fdeb95d] Received unexpected event network-vif-plugged-48650c01-c5a9-44f2-a481-5120c429a5a5 for instance with vm_state active and task_state rescuing.
Aug 09 15:17:12 user nova-compute[72382]: DEBUG nova.compute.manager [req-89d4b80d-2f4b-4542-a5af-89fbff87d7bc req-9996c652-818e-4bc7-a4da-1469c19d1289 service nova] [instance: 266be814-4a2b-4f8e-a0f6-e8821fdeb95d] Received event network-vif-plugged-48650c01-c5a9-44f2-a481-5120c429a5a5 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:17:12 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-89d4b80d-2f4b-4542-a5af-89fbff87d7bc req-9996c652-818e-4bc7-a4da-1469c19d1289 service nova] Acquiring lock "266be814-4a2b-4f8e-a0f6-e8821fdeb95d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:17:12 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-89d4b80d-2f4b-4542-a5af-89fbff87d7bc req-9996c652-818e-4bc7-a4da-1469c19d1289 service nova] Lock "266be814-4a2b-4f8e-a0f6-e8821fdeb95d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:17:12 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-89d4b80d-2f4b-4542-a5af-89fbff87d7bc req-9996c652-818e-4bc7-a4da-1469c19d1289 service nova] Lock "266be814-4a2b-4f8e-a0f6-e8821fdeb95d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:17:12 user nova-compute[72382]: DEBUG nova.compute.manager [req-89d4b80d-2f4b-4542-a5af-89fbff87d7bc req-9996c652-818e-4bc7-a4da-1469c19d1289 service nova] [instance: 266be814-4a2b-4f8e-a0f6-e8821fdeb95d] No waiting events found dispatching network-vif-plugged-48650c01-c5a9-44f2-a481-5120c429a5a5 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:17:12 user nova-compute[72382]: WARNING nova.compute.manager [req-89d4b80d-2f4b-4542-a5af-89fbff87d7bc req-9996c652-818e-4bc7-a4da-1469c19d1289 service nova] [instance: 266be814-4a2b-4f8e-a0f6-e8821fdeb95d] Received unexpected event network-vif-plugged-48650c01-c5a9-44f2-a481-5120c429a5a5 for instance with vm_state active and task_state rescuing.
Aug 09 15:17:12 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:17:13 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Removed pending event for 266be814-4a2b-4f8e-a0f6-e8821fdeb95d due to event {{(pid=72382) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 09 15:17:13 user nova-compute[72382]: DEBUG nova.virt.driver [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Emitting event <LifecycleEvent: 1691594233.6985934, 266be814-4a2b-4f8e-a0f6-e8821fdeb95d => Resumed> {{(pid=72382) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 15:17:13 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 266be814-4a2b-4f8e-a0f6-e8821fdeb95d] VM Resumed (Lifecycle Event)
Aug 09 15:17:13 user nova-compute[72382]: DEBUG nova.compute.manager [None req-fac10749-478d-4c59-8039-477634657846 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] [instance: 266be814-4a2b-4f8e-a0f6-e8821fdeb95d] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:17:13 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 266be814-4a2b-4f8e-a0f6-e8821fdeb95d] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:17:13 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 266be814-4a2b-4f8e-a0f6-e8821fdeb95d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72382) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 15:17:13 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 266be814-4a2b-4f8e-a0f6-e8821fdeb95d] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 09 15:17:13 user nova-compute[72382]: DEBUG nova.virt.driver [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Emitting event <LifecycleEvent: 1691594233.7011929, 266be814-4a2b-4f8e-a0f6-e8821fdeb95d => Started> {{(pid=72382) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 15:17:13 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 266be814-4a2b-4f8e-a0f6-e8821fdeb95d] VM Started (Lifecycle Event)
Aug 09 15:17:13 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:17:13 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 266be814-4a2b-4f8e-a0f6-e8821fdeb95d] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:17:13 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 266be814-4a2b-4f8e-a0f6-e8821fdeb95d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72382) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 15:17:17 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:17:18 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:17:22 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:17:23 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:17:24 user nova-compute[72382]: DEBUG nova.compute.manager [req-4fa4827e-3f57-4817-aab9-a1f97ce228b5 req-6bd35ad9-04a0-4439-8aa4-8c866cc38db8 service nova] [instance: 24b63f7a-be32-424b-b72c-d5bec43c408e] Received event network-changed-f21a4544-6f79-47c6-8577-f5e8d2b440bd {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:17:24 user nova-compute[72382]: DEBUG nova.compute.manager [req-4fa4827e-3f57-4817-aab9-a1f97ce228b5 req-6bd35ad9-04a0-4439-8aa4-8c866cc38db8 service nova] [instance: 24b63f7a-be32-424b-b72c-d5bec43c408e] Refreshing instance network info cache due to event network-changed-f21a4544-6f79-47c6-8577-f5e8d2b440bd. {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 15:17:24 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-4fa4827e-3f57-4817-aab9-a1f97ce228b5 req-6bd35ad9-04a0-4439-8aa4-8c866cc38db8 service nova] Acquiring lock "refresh_cache-24b63f7a-be32-424b-b72c-d5bec43c408e" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 15:17:24 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-4fa4827e-3f57-4817-aab9-a1f97ce228b5 req-6bd35ad9-04a0-4439-8aa4-8c866cc38db8 service nova] Acquired lock "refresh_cache-24b63f7a-be32-424b-b72c-d5bec43c408e" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 15:17:24 user nova-compute[72382]: DEBUG nova.network.neutron [req-4fa4827e-3f57-4817-aab9-a1f97ce228b5 req-6bd35ad9-04a0-4439-8aa4-8c866cc38db8 service nova] [instance: 24b63f7a-be32-424b-b72c-d5bec43c408e] Refreshing network info cache for port f21a4544-6f79-47c6-8577-f5e8d2b440bd {{(pid=72382) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 15:17:25 user nova-compute[72382]: DEBUG nova.network.neutron [req-4fa4827e-3f57-4817-aab9-a1f97ce228b5 req-6bd35ad9-04a0-4439-8aa4-8c866cc38db8 service nova] [instance: 24b63f7a-be32-424b-b72c-d5bec43c408e] Updated VIF entry in instance network info cache for port f21a4544-6f79-47c6-8577-f5e8d2b440bd. {{(pid=72382) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 15:17:25 user nova-compute[72382]: DEBUG nova.network.neutron [req-4fa4827e-3f57-4817-aab9-a1f97ce228b5 req-6bd35ad9-04a0-4439-8aa4-8c866cc38db8 service nova] [instance: 24b63f7a-be32-424b-b72c-d5bec43c408e] Updating instance_info_cache with network_info: [{"id": "f21a4544-6f79-47c6-8577-f5e8d2b440bd", "address": "fa:16:3e:58:ca:e4", "network": {"id": "a87fbfc3-5f2b-427c-9337-e00cf40d8896", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1094857259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f33e667025294028aa560b26d80d81a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf21a4544-6f", "ovs_interfaceid": "f21a4544-6f79-47c6-8577-f5e8d2b440bd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:17:25 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-4fa4827e-3f57-4817-aab9-a1f97ce228b5 req-6bd35ad9-04a0-4439-8aa4-8c866cc38db8 service nova] Releasing lock "refresh_cache-24b63f7a-be32-424b-b72c-d5bec43c408e" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 15:17:27 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:17:28 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-305253a7-f1cb-4fef-bf50-7f19b7f1e750 tempest-AttachSCSIVolumeTestJSON-1083630769 tempest-AttachSCSIVolumeTestJSON-1083630769-project-member] Acquiring lock "24b63f7a-be32-424b-b72c-d5bec43c408e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:17:28 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-305253a7-f1cb-4fef-bf50-7f19b7f1e750 tempest-AttachSCSIVolumeTestJSON-1083630769 tempest-AttachSCSIVolumeTestJSON-1083630769-project-member] Lock "24b63f7a-be32-424b-b72c-d5bec43c408e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:17:28 user nova-compute[72382]: DEBUG nova.objects.instance [None req-305253a7-f1cb-4fef-bf50-7f19b7f1e750 tempest-AttachSCSIVolumeTestJSON-1083630769 tempest-AttachSCSIVolumeTestJSON-1083630769-project-member] Lazy-loading 'flavor' on Instance uuid 24b63f7a-be32-424b-b72c-d5bec43c408e {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:17:28 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:17:28 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-305253a7-f1cb-4fef-bf50-7f19b7f1e750 tempest-AttachSCSIVolumeTestJSON-1083630769 tempest-AttachSCSIVolumeTestJSON-1083630769-project-member] Lock "24b63f7a-be32-424b-b72c-d5bec43c408e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.088s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:17:28 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-305253a7-f1cb-4fef-bf50-7f19b7f1e750 tempest-AttachSCSIVolumeTestJSON-1083630769 tempest-AttachSCSIVolumeTestJSON-1083630769-project-member] Acquiring lock "24b63f7a-be32-424b-b72c-d5bec43c408e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:17:28 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-305253a7-f1cb-4fef-bf50-7f19b7f1e750 tempest-AttachSCSIVolumeTestJSON-1083630769 tempest-AttachSCSIVolumeTestJSON-1083630769-project-member] Lock "24b63f7a-be32-424b-b72c-d5bec43c408e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:17:28 user nova-compute[72382]: INFO nova.compute.manager [None req-305253a7-f1cb-4fef-bf50-7f19b7f1e750 tempest-AttachSCSIVolumeTestJSON-1083630769 tempest-AttachSCSIVolumeTestJSON-1083630769-project-member] [instance: 24b63f7a-be32-424b-b72c-d5bec43c408e] Attaching volume a907afa8-0d60-4c8f-8bb8-711114487377 to /dev/sdc
Aug 09 15:17:29 user nova-compute[72382]: DEBUG os_brick.utils [None req-305253a7-f1cb-4fef-bf50-7f19b7f1e750 tempest-AttachSCSIVolumeTestJSON-1083630769 tempest-AttachSCSIVolumeTestJSON-1083630769-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 15:17:29 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:17:29 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:17:29 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[0023ac1f-a46d-44af-8b3b-d62ca322be3b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d2cfa7015fe\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:17:29 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:17:29 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:17:29 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa583ece-f9f6-43b0-8434-a00bdd2ea842]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:17:29 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:17:29 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:17:29 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bd55544-a88e-43b8-80b0-8e13300f60d2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:17:29 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[9286e25b-e823-4da2-bf8f-dd4ee258c40a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:17:29 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-305253a7-f1cb-4fef-bf50-7f19b7f1e750 tempest-AttachSCSIVolumeTestJSON-1083630769 tempest-AttachSCSIVolumeTestJSON-1083630769-project-member] Running cmd (subprocess): nvme version {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:17:29 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-305253a7-f1cb-4fef-bf50-7f19b7f1e750 tempest-AttachSCSIVolumeTestJSON-1083630769 tempest-AttachSCSIVolumeTestJSON-1083630769-project-member] 'nvme version' failed. Not Retrying. {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 15:17:29 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.nvmeof [None req-305253a7-f1cb-4fef-bf50-7f19b7f1e750 tempest-AttachSCSIVolumeTestJSON-1083630769 tempest-AttachSCSIVolumeTestJSON-1083630769-project-member] nvme not present on system {{(pid=72382) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 15:17:29 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:17:29 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 15:17:29 user nova-compute[72382]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 15:17:29 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8df44e7-cf5c-4bdc-9457-1a896d425c5e]: (4, '') {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:17:29 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.lightos [None req-305253a7-f1cb-4fef-bf50-7f19b7f1e750 tempest-AttachSCSIVolumeTestJSON-1083630769 tempest-AttachSCSIVolumeTestJSON-1083630769-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72382) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 15:17:29 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.lightos [None req-305253a7-f1cb-4fef-bf50-7f19b7f1e750 tempest-AttachSCSIVolumeTestJSON-1083630769 tempest-AttachSCSIVolumeTestJSON-1083630769-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72382) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 15:17:29 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.lightos [None req-305253a7-f1cb-4fef-bf50-7f19b7f1e750 tempest-AttachSCSIVolumeTestJSON-1083630769 tempest-AttachSCSIVolumeTestJSON-1083630769-project-member] LIGHTOS: no hostnqn found. {{(pid=72382) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 15:17:29 user nova-compute[72382]: DEBUG os_brick.utils [None req-305253a7-f1cb-4fef-bf50-7f19b7f1e750 tempest-AttachSCSIVolumeTestJSON-1083630769 tempest-AttachSCSIVolumeTestJSON-1083630769-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d2cfa7015fe', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 15:17:29 user nova-compute[72382]: DEBUG nova.virt.block_device [None req-305253a7-f1cb-4fef-bf50-7f19b7f1e750 tempest-AttachSCSIVolumeTestJSON-1083630769 tempest-AttachSCSIVolumeTestJSON-1083630769-project-member] [instance: 24b63f7a-be32-424b-b72c-d5bec43c408e] Updating existing volume attachment record: cee0c059-bfd0-4fe1-bcd2-4cae39358744 {{(pid=72382) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 15:17:31 user nova-compute[72382]: DEBUG nova.compute.manager [req-8d62c4e1-95a6-4f69-b426-18b3066ade12 req-8a276890-eee0-460c-a3ef-eaa9318032de service nova] [instance: f0a7fa25-4520-4f40-9515-b88e3d2fd910] Received event network-changed-5b8a4395-5fb8-4ae6-a987-127e82862327 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:17:31 user nova-compute[72382]: DEBUG nova.compute.manager [req-8d62c4e1-95a6-4f69-b426-18b3066ade12 req-8a276890-eee0-460c-a3ef-eaa9318032de service nova] [instance: f0a7fa25-4520-4f40-9515-b88e3d2fd910] Refreshing instance network info cache due to event network-changed-5b8a4395-5fb8-4ae6-a987-127e82862327. {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 15:17:31 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-8d62c4e1-95a6-4f69-b426-18b3066ade12 req-8a276890-eee0-460c-a3ef-eaa9318032de service nova] Acquiring lock "refresh_cache-f0a7fa25-4520-4f40-9515-b88e3d2fd910" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 15:17:31 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-8d62c4e1-95a6-4f69-b426-18b3066ade12 req-8a276890-eee0-460c-a3ef-eaa9318032de service nova] Acquired lock "refresh_cache-f0a7fa25-4520-4f40-9515-b88e3d2fd910" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 15:17:31 user nova-compute[72382]: DEBUG nova.network.neutron [req-8d62c4e1-95a6-4f69-b426-18b3066ade12 req-8a276890-eee0-460c-a3ef-eaa9318032de service nova] [instance: f0a7fa25-4520-4f40-9515-b88e3d2fd910] Refreshing network info cache for port 5b8a4395-5fb8-4ae6-a987-127e82862327 {{(pid=72382) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 15:17:31 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-c0f6a347-ede6-413a-b46f-3c5d09a71d16 tempest-VolumesAssistedSnapshotsTest-1118703382 tempest-VolumesAssistedSnapshotsTest-1118703382-project-admin] Acquiring lock "f0a7fa25-4520-4f40-9515-b88e3d2fd910" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:17:31 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-c0f6a347-ede6-413a-b46f-3c5d09a71d16 tempest-VolumesAssistedSnapshotsTest-1118703382 tempest-VolumesAssistedSnapshotsTest-1118703382-project-admin] Lock "f0a7fa25-4520-4f40-9515-b88e3d2fd910" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:17:31 user nova-compute[72382]: DEBUG nova.objects.instance [None req-c0f6a347-ede6-413a-b46f-3c5d09a71d16 tempest-VolumesAssistedSnapshotsTest-1118703382 tempest-VolumesAssistedSnapshotsTest-1118703382-project-admin] Lazy-loading 'flavor' on Instance uuid f0a7fa25-4520-4f40-9515-b88e3d2fd910 {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:17:31 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-c0f6a347-ede6-413a-b46f-3c5d09a71d16 tempest-VolumesAssistedSnapshotsTest-1118703382 tempest-VolumesAssistedSnapshotsTest-1118703382-project-admin] Lock "f0a7fa25-4520-4f40-9515-b88e3d2fd910" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.079s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:17:31 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-c0f6a347-ede6-413a-b46f-3c5d09a71d16 tempest-VolumesAssistedSnapshotsTest-1118703382 tempest-VolumesAssistedSnapshotsTest-1118703382-project-admin] Acquiring lock "f0a7fa25-4520-4f40-9515-b88e3d2fd910" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:17:31 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-c0f6a347-ede6-413a-b46f-3c5d09a71d16 tempest-VolumesAssistedSnapshotsTest-1118703382 tempest-VolumesAssistedSnapshotsTest-1118703382-project-admin] Lock "f0a7fa25-4520-4f40-9515-b88e3d2fd910" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:17:31 user nova-compute[72382]: INFO nova.compute.manager [None req-c0f6a347-ede6-413a-b46f-3c5d09a71d16 tempest-VolumesAssistedSnapshotsTest-1118703382 tempest-VolumesAssistedSnapshotsTest-1118703382-project-admin] [instance: f0a7fa25-4520-4f40-9515-b88e3d2fd910] Attaching volume eb2b70eb-a2ee-434f-86e2-badfd14fa295 to /dev/vdb
Aug 09 15:17:32 user nova-compute[72382]: DEBUG nova.network.neutron [req-8d62c4e1-95a6-4f69-b426-18b3066ade12 req-8a276890-eee0-460c-a3ef-eaa9318032de service nova] [instance: f0a7fa25-4520-4f40-9515-b88e3d2fd910] Updated VIF entry in instance network info cache for port 5b8a4395-5fb8-4ae6-a987-127e82862327. {{(pid=72382) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 15:17:32 user nova-compute[72382]: DEBUG nova.network.neutron [req-8d62c4e1-95a6-4f69-b426-18b3066ade12 req-8a276890-eee0-460c-a3ef-eaa9318032de service nova] [instance: f0a7fa25-4520-4f40-9515-b88e3d2fd910] Updating instance_info_cache with network_info: [{"id": "5b8a4395-5fb8-4ae6-a987-127e82862327", "address": "fa:16:3e:55:d7:da", "network": {"id": "cdb7cc30-fb6f-4cb2-8162-a15463a93a4a", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1417098143-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.27", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dcde0eaf3243471280e72b35b04a1022", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b8a4395-5f", "ovs_interfaceid": "5b8a4395-5fb8-4ae6-a987-127e82862327", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:17:32 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-8d62c4e1-95a6-4f69-b426-18b3066ade12 req-8a276890-eee0-460c-a3ef-eaa9318032de service nova] Releasing lock "refresh_cache-f0a7fa25-4520-4f40-9515-b88e3d2fd910" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 15:17:32 user nova-compute[72382]: DEBUG os_brick.utils [None req-c0f6a347-ede6-413a-b46f-3c5d09a71d16 tempest-VolumesAssistedSnapshotsTest-1118703382 tempest-VolumesAssistedSnapshotsTest-1118703382-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 15:17:32 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:17:32 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:17:32 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffda3646-be93-4a5a-999d-bbad5c04fc64]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d2cfa7015fe\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:17:32 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:17:32 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:17:32 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[4991a7ce-a47c-4c53-bd58-687510b4e361]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:17:32 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:17:32 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:17:32 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[04a4467b-7c25-4eeb-82bb-94bf37191892]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:17:32 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3e0757f-daa2-4c0a-9306-842283af60e1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:17:32 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-c0f6a347-ede6-413a-b46f-3c5d09a71d16 tempest-VolumesAssistedSnapshotsTest-1118703382 tempest-VolumesAssistedSnapshotsTest-1118703382-project-admin] Running cmd (subprocess): nvme version {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:17:32 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-c0f6a347-ede6-413a-b46f-3c5d09a71d16 tempest-VolumesAssistedSnapshotsTest-1118703382 tempest-VolumesAssistedSnapshotsTest-1118703382-project-admin] 'nvme version' failed. Not Retrying. {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 15:17:32 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c0f6a347-ede6-413a-b46f-3c5d09a71d16 tempest-VolumesAssistedSnapshotsTest-1118703382 tempest-VolumesAssistedSnapshotsTest-1118703382-project-admin] nvme not present on system {{(pid=72382) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 15:17:32 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:17:32 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 15:17:32 user nova-compute[72382]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 15:17:32 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[f78b906a-8c47-41cc-a5d2-e89cca87ca41]: (4, '') {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:17:32 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.lightos [None req-c0f6a347-ede6-413a-b46f-3c5d09a71d16 tempest-VolumesAssistedSnapshotsTest-1118703382 tempest-VolumesAssistedSnapshotsTest-1118703382-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72382) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 15:17:32 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.lightos [None req-c0f6a347-ede6-413a-b46f-3c5d09a71d16 tempest-VolumesAssistedSnapshotsTest-1118703382 tempest-VolumesAssistedSnapshotsTest-1118703382-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72382) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 15:17:32 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.lightos [None req-c0f6a347-ede6-413a-b46f-3c5d09a71d16 tempest-VolumesAssistedSnapshotsTest-1118703382 tempest-VolumesAssistedSnapshotsTest-1118703382-project-admin] LIGHTOS: no hostnqn found. {{(pid=72382) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 15:17:32 user nova-compute[72382]: DEBUG os_brick.utils [None req-c0f6a347-ede6-413a-b46f-3c5d09a71d16 tempest-VolumesAssistedSnapshotsTest-1118703382 tempest-VolumesAssistedSnapshotsTest-1118703382-project-admin] <== get_connector_properties: return (106ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d2cfa7015fe', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 15:17:32 user nova-compute[72382]: DEBUG nova.virt.block_device [None req-c0f6a347-ede6-413a-b46f-3c5d09a71d16 tempest-VolumesAssistedSnapshotsTest-1118703382 tempest-VolumesAssistedSnapshotsTest-1118703382-project-admin] [instance: f0a7fa25-4520-4f40-9515-b88e3d2fd910] Updating existing volume attachment record: a4268d2b-102d-419f-a692-217b1e9d3adb {{(pid=72382) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 15:17:32 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:17:33 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:17:34 user nova-compute[72382]: DEBUG nova.compute.manager [req-00c65f44-45b2-46c3-a726-cb7c8327956e req-de59c2e7-a9e4-44be-80fa-93a8de2f34bb service nova] [instance: a33515b3-3ef4-4f76-a8d8-e7008b5bbb79] Received event network-changed-32c23c7b-6885-4276-bca1-7d8a8cb924c1 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:17:34 user nova-compute[72382]: DEBUG nova.compute.manager [req-00c65f44-45b2-46c3-a726-cb7c8327956e req-de59c2e7-a9e4-44be-80fa-93a8de2f34bb service nova] [instance: a33515b3-3ef4-4f76-a8d8-e7008b5bbb79] Refreshing instance network info cache due to event network-changed-32c23c7b-6885-4276-bca1-7d8a8cb924c1. {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 15:17:34 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-00c65f44-45b2-46c3-a726-cb7c8327956e req-de59c2e7-a9e4-44be-80fa-93a8de2f34bb service nova] Acquiring lock "refresh_cache-a33515b3-3ef4-4f76-a8d8-e7008b5bbb79" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 15:17:34 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-00c65f44-45b2-46c3-a726-cb7c8327956e req-de59c2e7-a9e4-44be-80fa-93a8de2f34bb service nova] Acquired lock "refresh_cache-a33515b3-3ef4-4f76-a8d8-e7008b5bbb79" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 15:17:34 user nova-compute[72382]: DEBUG nova.network.neutron [req-00c65f44-45b2-46c3-a726-cb7c8327956e req-de59c2e7-a9e4-44be-80fa-93a8de2f34bb service nova] [instance: a33515b3-3ef4-4f76-a8d8-e7008b5bbb79] Refreshing network info cache for port 32c23c7b-6885-4276-bca1-7d8a8cb924c1 {{(pid=72382) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 15:17:34 user nova-compute[72382]: DEBUG nova.network.neutron [req-00c65f44-45b2-46c3-a726-cb7c8327956e req-de59c2e7-a9e4-44be-80fa-93a8de2f34bb service nova] [instance: a33515b3-3ef4-4f76-a8d8-e7008b5bbb79] Updated VIF entry in instance network info cache for port 32c23c7b-6885-4276-bca1-7d8a8cb924c1. {{(pid=72382) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 15:17:34 user nova-compute[72382]: DEBUG nova.network.neutron [req-00c65f44-45b2-46c3-a726-cb7c8327956e req-de59c2e7-a9e4-44be-80fa-93a8de2f34bb service nova] [instance: a33515b3-3ef4-4f76-a8d8-e7008b5bbb79] Updating instance_info_cache with network_info: [{"id": "32c23c7b-6885-4276-bca1-7d8a8cb924c1", "address": "fa:16:3e:e9:da:b6", "network": {"id": "1a0f18df-96f2-4c90-8e53-fcbfc8f17bc4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1771770150-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b98e20f61c34fd6aa28cef7ceadf0d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32c23c7b-68", "ovs_interfaceid": "32c23c7b-6885-4276-bca1-7d8a8cb924c1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:17:34 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-00c65f44-45b2-46c3-a726-cb7c8327956e req-de59c2e7-a9e4-44be-80fa-93a8de2f34bb service nova] Releasing lock "refresh_cache-a33515b3-3ef4-4f76-a8d8-e7008b5bbb79" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 15:17:37 user nova-compute[72382]: DEBUG nova.compute.manager [req-3f61cd28-e949-4b04-8652-e4ff85cd50ca req-1d3d13b8-6ffb-4728-8172-63a789bbeef7 service nova] [instance: 23f25946-de3a-43fb-97a4-1f9a787e6e51] Received event network-changed-1c588f02-cc2c-47f1-8918-bf9b1d3ea215 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:17:37 user nova-compute[72382]: DEBUG nova.compute.manager [req-3f61cd28-e949-4b04-8652-e4ff85cd50ca req-1d3d13b8-6ffb-4728-8172-63a789bbeef7 service nova] [instance: 23f25946-de3a-43fb-97a4-1f9a787e6e51] Refreshing instance network info cache due to event network-changed-1c588f02-cc2c-47f1-8918-bf9b1d3ea215. {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 15:17:37 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-3f61cd28-e949-4b04-8652-e4ff85cd50ca req-1d3d13b8-6ffb-4728-8172-63a789bbeef7 service nova] Acquiring lock "refresh_cache-23f25946-de3a-43fb-97a4-1f9a787e6e51" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 15:17:37 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-3f61cd28-e949-4b04-8652-e4ff85cd50ca req-1d3d13b8-6ffb-4728-8172-63a789bbeef7 service nova] Acquired lock "refresh_cache-23f25946-de3a-43fb-97a4-1f9a787e6e51" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 15:17:37 user nova-compute[72382]: DEBUG nova.network.neutron [req-3f61cd28-e949-4b04-8652-e4ff85cd50ca req-1d3d13b8-6ffb-4728-8172-63a789bbeef7 service nova] [instance: 23f25946-de3a-43fb-97a4-1f9a787e6e51] Refreshing network info cache for port 1c588f02-cc2c-47f1-8918-bf9b1d3ea215 {{(pid=72382) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 15:17:37 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:17:37 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-4d5794d4-655b-42a7-b0cc-3f10f4c5400f tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] Acquiring lock "a33515b3-3ef4-4f76-a8d8-e7008b5bbb79" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:17:37 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-4d5794d4-655b-42a7-b0cc-3f10f4c5400f tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] Lock "a33515b3-3ef4-4f76-a8d8-e7008b5bbb79" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:17:37 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-bef6582c-e737-47d6-a352-abd45034229b tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] Acquiring lock "interface-23f25946-de3a-43fb-97a4-1f9a787e6e51-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:17:37 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-bef6582c-e737-47d6-a352-abd45034229b tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] Lock "interface-23f25946-de3a-43fb-97a4-1f9a787e6e51-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:17:37 user nova-compute[72382]: DEBUG nova.objects.instance [None req-bef6582c-e737-47d6-a352-abd45034229b tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] Lazy-loading 'flavor' on Instance uuid 23f25946-de3a-43fb-97a4-1f9a787e6e51 {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:17:37 user nova-compute[72382]: DEBUG nova.objects.instance [None req-4d5794d4-655b-42a7-b0cc-3f10f4c5400f tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] Lazy-loading 'flavor' on Instance uuid a33515b3-3ef4-4f76-a8d8-e7008b5bbb79 {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:17:38 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-4d5794d4-655b-42a7-b0cc-3f10f4c5400f tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] Lock "a33515b3-3ef4-4f76-a8d8-e7008b5bbb79" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:17:38 user nova-compute[72382]: DEBUG nova.network.neutron [req-3f61cd28-e949-4b04-8652-e4ff85cd50ca req-1d3d13b8-6ffb-4728-8172-63a789bbeef7 service nova] [instance: 23f25946-de3a-43fb-97a4-1f9a787e6e51] Updated VIF entry in instance network info cache for port 1c588f02-cc2c-47f1-8918-bf9b1d3ea215. {{(pid=72382) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 15:17:38 user nova-compute[72382]: DEBUG nova.network.neutron [req-3f61cd28-e949-4b04-8652-e4ff85cd50ca req-1d3d13b8-6ffb-4728-8172-63a789bbeef7 service nova] [instance: 23f25946-de3a-43fb-97a4-1f9a787e6e51] Updating instance_info_cache with network_info: [{"id": "1c588f02-cc2c-47f1-8918-bf9b1d3ea215", "address": "fa:16:3e:b1:4d:7d", "network": {"id": "e5132afa-231c-471e-b11a-a6e972603b0c", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2085484007-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b84d09ad643146859e76996c09ba02c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c588f02-cc", "ovs_interfaceid": "1c588f02-cc2c-47f1-8918-bf9b1d3ea215", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:17:38 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-3f61cd28-e949-4b04-8652-e4ff85cd50ca req-1d3d13b8-6ffb-4728-8172-63a789bbeef7 service nova] Releasing lock "refresh_cache-23f25946-de3a-43fb-97a4-1f9a787e6e51" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 15:17:38 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-4d5794d4-655b-42a7-b0cc-3f10f4c5400f tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] Acquiring lock "a33515b3-3ef4-4f76-a8d8-e7008b5bbb79" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:17:38 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-4d5794d4-655b-42a7-b0cc-3f10f4c5400f tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] Lock "a33515b3-3ef4-4f76-a8d8-e7008b5bbb79" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:17:38 user nova-compute[72382]: INFO nova.compute.manager [None req-4d5794d4-655b-42a7-b0cc-3f10f4c5400f tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] [instance: a33515b3-3ef4-4f76-a8d8-e7008b5bbb79] Attaching volume 21e1540c-408d-44a5-893c-892d0e91eb01 to /dev/vdb
Aug 09 15:17:38 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-305253a7-f1cb-4fef-bf50-7f19b7f1e750 tempest-AttachSCSIVolumeTestJSON-1083630769 tempest-AttachSCSIVolumeTestJSON-1083630769-project-member] [instance: 24b63f7a-be32-424b-b72c-d5bec43c408e] Calling os-brick to attach iSCSI Volume {{(pid=72382) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 15:17:38 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-305253a7-f1cb-4fef-bf50-7f19b7f1e750 tempest-AttachSCSIVolumeTestJSON-1083630769 tempest-AttachSCSIVolumeTestJSON-1083630769-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2a0c768340>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:a907afa8-0d60-4c8f-8bb8-711114487377'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bxyWoAvT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 15:17:38 user nova-compute[72382]: WARNING os_brick.initiator.connectors.base [None req-305253a7-f1cb-4fef-bf50-7f19b7f1e750 tempest-AttachSCSIVolumeTestJSON-1083630769 tempest-AttachSCSIVolumeTestJSON-1083630769-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 15:17:38 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-305253a7-f1cb-4fef-bf50-7f19b7f1e750 tempest-AttachSCSIVolumeTestJSON-1083630769 tempest-AttachSCSIVolumeTestJSON-1083630769-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 15:17:38 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-305253a7-f1cb-4fef-bf50-7f19b7f1e750 tempest-AttachSCSIVolumeTestJSON-1083630769 tempest-AttachSCSIVolumeTestJSON-1083630769-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 15:17:38 user nova-compute[72382]: WARNING os_brick.initiator.connectors.base [None req-305253a7-f1cb-4fef-bf50-7f19b7f1e750 tempest-AttachSCSIVolumeTestJSON-1083630769 tempest-AttachSCSIVolumeTestJSON-1083630769-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 15:17:38 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-305253a7-f1cb-4fef-bf50-7f19b7f1e750 tempest-AttachSCSIVolumeTestJSON-1083630769 tempest-AttachSCSIVolumeTestJSON-1083630769-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a907afa8-0d60-4c8f-8bb8-711114487377" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 15:17:38 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-305253a7-f1cb-4fef-bf50-7f19b7f1e750 tempest-AttachSCSIVolumeTestJSON-1083630769 tempest-AttachSCSIVolumeTestJSON-1083630769-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a907afa8-0d60-4c8f-8bb8-711114487377" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 15:17:38 user nova-compute[72382]: INFO os_brick.initiator.connectors.iscsi [None req-305253a7-f1cb-4fef-bf50-7f19b7f1e750 tempest-AttachSCSIVolumeTestJSON-1083630769 tempest-AttachSCSIVolumeTestJSON-1083630769-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 15:17:38 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a907afa8-0d60-4c8f-8bb8-711114487377 -p 172.16.0.220:3260 {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:17:38 user nova-compute[72382]: DEBUG nova.objects.instance [None req-bef6582c-e737-47d6-a352-abd45034229b tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] Lazy-loading 'pci_requests' on Instance uuid 23f25946-de3a-43fb-97a4-1f9a787e6e51 {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:17:38 user nova-compute[72382]: DEBUG nova.network.neutron [None req-bef6582c-e737-47d6-a352-abd45034229b tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] [instance: 23f25946-de3a-43fb-97a4-1f9a787e6e51] allocate_for_instance() {{(pid=72382) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 15:17:38 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a907afa8-0d60-4c8f-8bb8-711114487377 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:17:38 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[151aeeb1-c470-42b4-a7c8-0a91f45ad16b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:17:38 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-305253a7-f1cb-4fef-bf50-7f19b7f1e750 tempest-AttachSCSIVolumeTestJSON-1083630769 tempest-AttachSCSIVolumeTestJSON-1083630769-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 15:17:38 user nova-compute[72382]:  {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:17:38 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a907afa8-0d60-4c8f-8bb8-711114487377 -p 172.16.0.220:3260 --interface default --op new {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:17:38 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a907afa8-0d60-4c8f-8bb8-711114487377 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:17:38 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[36918ba2-8e1b-41cd-81e6-0d0b41dece91]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a907afa8-0d60-4c8f-8bb8-711114487377] added\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:17:38 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-305253a7-f1cb-4fef-bf50-7f19b7f1e750 tempest-AttachSCSIVolumeTestJSON-1083630769 tempest-AttachSCSIVolumeTestJSON-1083630769-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a907afa8-0d60-4c8f-8bb8-711114487377] added
Aug 09 15:17:38 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:17:38 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a907afa8-0d60-4c8f-8bb8-711114487377 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:17:38 user nova-compute[72382]: DEBUG os_brick.utils [None req-4d5794d4-655b-42a7-b0cc-3f10f4c5400f tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 15:17:38 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:17:38 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a907afa8-0d60-4c8f-8bb8-711114487377 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:17:38 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[4447581c-3cfe-482a-aa6a-c61630c468bd]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:17:38 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-305253a7-f1cb-4fef-bf50-7f19b7f1e750 tempest-AttachSCSIVolumeTestJSON-1083630769 tempest-AttachSCSIVolumeTestJSON-1083630769-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:17:38 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a907afa8-0d60-4c8f-8bb8-711114487377 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:17:38 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:17:38 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[c37377de-bb37-4257-adc0-d337873c470b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d2cfa7015fe\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:17:38 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:17:38 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a907afa8-0d60-4c8f-8bb8-711114487377 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:17:38 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[6544ab74-9cd7-4bd1-b66f-302a5e40fee4]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:17:38 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-305253a7-f1cb-4fef-bf50-7f19b7f1e750 tempest-AttachSCSIVolumeTestJSON-1083630769 tempest-AttachSCSIVolumeTestJSON-1083630769-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:17:38 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a907afa8-0d60-4c8f-8bb8-711114487377 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bxyWoAvT {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:17:38 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.023s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:17:38 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[867d4e44-ae98-4e31-996a-f6f1ff5c82b5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:17:38 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:17:38 user nova-compute[72382]: DEBUG nova.policy [None req-bef6582c-e737-47d6-a352-abd45034229b tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '97fa102d2fed4045a326b0f5efbd1b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84d09ad643146859e76996c09ba02c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72382) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 15:17:38 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a907afa8-0d60-4c8f-8bb8-711114487377 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bxyWoAvT" returned: 0 in 0.019s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:17:38 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[27d2ca2e-3e3c-4b33-8ee4-39120797dac2]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:17:38 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:17:38 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[012a643c-e2f2-45db-b715-99148dacf5cd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:17:38 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-305253a7-f1cb-4fef-bf50-7f19b7f1e750 tempest-AttachSCSIVolumeTestJSON-1083630769 tempest-AttachSCSIVolumeTestJSON-1083630769-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bxyWoAvT'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:17:38 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a907afa8-0d60-4c8f-8bb8-711114487377 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:17:38 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[1928d8b5-cb34-4ebe-9750-d0186c18ad8e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:17:38 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-4d5794d4-655b-42a7-b0cc-3f10f4c5400f tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] Running cmd (subprocess): nvme version {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:17:38 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-4d5794d4-655b-42a7-b0cc-3f10f4c5400f tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] 'nvme version' failed. Not Retrying. {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 15:17:38 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a907afa8-0d60-4c8f-8bb8-711114487377 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:17:38 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d5fc368-eaa1-45f1-8709-4143ec3c10f2]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:17:38 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4d5794d4-655b-42a7-b0cc-3f10f4c5400f tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] nvme not present on system {{(pid=72382) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 15:17:38 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-305253a7-f1cb-4fef-bf50-7f19b7f1e750 tempest-AttachSCSIVolumeTestJSON-1083630769 tempest-AttachSCSIVolumeTestJSON-1083630769-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:17:38 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:17:38 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:17:38 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 15:17:38 user nova-compute[72382]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 15:17:38 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ce22023-374d-49b9-900b-069863dd5c3c]: (4, '') {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:17:38 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.lightos [None req-4d5794d4-655b-42a7-b0cc-3f10f4c5400f tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72382) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 15:17:38 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.lightos [None req-4d5794d4-655b-42a7-b0cc-3f10f4c5400f tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72382) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 15:17:38 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.lightos [None req-4d5794d4-655b-42a7-b0cc-3f10f4c5400f tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] LIGHTOS: no hostnqn found. {{(pid=72382) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 15:17:38 user nova-compute[72382]: DEBUG os_brick.utils [None req-4d5794d4-655b-42a7-b0cc-3f10f4c5400f tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] <== get_connector_properties: return (147ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d2cfa7015fe', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 15:17:38 user nova-compute[72382]: DEBUG nova.virt.block_device [None req-4d5794d4-655b-42a7-b0cc-3f10f4c5400f tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] [instance: a33515b3-3ef4-4f76-a8d8-e7008b5bbb79] Updating existing volume attachment record: ab163b01-df02-48b7-8288-d5eed1f783a2 {{(pid=72382) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 15:17:38 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:17:38 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[d40251cd-bcbb-4c8b-b704-03e9cc40db5b]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2267629-52cf-439c-9083-3e8384c67f08 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a13916f-1416-4b94-9e10-96f9e6415753 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16ef1023-88b6-4e22-9b4b-45515b25ca9b (non-flash)\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:17:38 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-305253a7-f1cb-4fef-bf50-7f19b7f1e750 tempest-AttachSCSIVolumeTestJSON-1083630769 tempest-AttachSCSIVolumeTestJSON-1083630769-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2267629-52cf-439c-9083-3e8384c67f08 (non-flash)
Aug 09 15:17:38 user nova-compute[72382]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a13916f-1416-4b94-9e10-96f9e6415753 (non-flash)
Aug 09 15:17:38 user nova-compute[72382]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16ef1023-88b6-4e22-9b4b-45515b25ca9b (non-flash)
Aug 09 15:17:38 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 15:17:38 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-305253a7-f1cb-4fef-bf50-7f19b7f1e750 tempest-AttachSCSIVolumeTestJSON-1083630769 tempest-AttachSCSIVolumeTestJSON-1083630769-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2267629-52cf-439c-9083-3e8384c67f08 (non-flash)
Aug 09 15:17:38 user nova-compute[72382]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a13916f-1416-4b94-9e10-96f9e6415753 (non-flash)
Aug 09 15:17:38 user nova-compute[72382]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16ef1023-88b6-4e22-9b4b-45515b25ca9b (non-flash)
Aug 09 15:17:38 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 15:17:38 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a907afa8-0d60-4c8f-8bb8-711114487377 -p 172.16.0.220:3260 --login {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:17:38 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a907afa8-0d60-4c8f-8bb8-711114487377 -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:17:38 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a522781-6333-4254-92e6-de7d31a2d58e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a907afa8-0d60-4c8f-8bb8-711114487377, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a907afa8-0d60-4c8f-8bb8-711114487377, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:17:38 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-305253a7-f1cb-4fef-bf50-7f19b7f1e750 tempest-AttachSCSIVolumeTestJSON-1083630769 tempest-AttachSCSIVolumeTestJSON-1083630769-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a907afa8-0d60-4c8f-8bb8-711114487377, portal: 172.16.0.220,3260]
Aug 09 15:17:38 user nova-compute[72382]: Login to [iface: default, target: iqn.2010-10.org.openstack:a907afa8-0d60-4c8f-8bb8-711114487377, portal: 172.16.0.220,3260] successful.
Aug 09 15:17:38 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:17:38 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a907afa8-0d60-4c8f-8bb8-711114487377 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:17:38 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a907afa8-0d60-4c8f-8bb8-711114487377 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:17:38 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[77801a73-b23b-435a-851d-6be626cf1103]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:17:38 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-305253a7-f1cb-4fef-bf50-7f19b7f1e750 tempest-AttachSCSIVolumeTestJSON-1083630769 tempest-AttachSCSIVolumeTestJSON-1083630769-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:17:38 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:17:38 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:17:38 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab274072-ec0d-44fe-9a7d-1b0b05b1c2bb]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2267629-52cf-439c-9083-3e8384c67f08 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a13916f-1416-4b94-9e10-96f9e6415753 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16ef1023-88b6-4e22-9b4b-45515b25ca9b (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a907afa8-0d60-4c8f-8bb8-711114487377 (non-flash)\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:17:38 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-305253a7-f1cb-4fef-bf50-7f19b7f1e750 tempest-AttachSCSIVolumeTestJSON-1083630769 tempest-AttachSCSIVolumeTestJSON-1083630769-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2267629-52cf-439c-9083-3e8384c67f08 (non-flash)
Aug 09 15:17:38 user nova-compute[72382]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a13916f-1416-4b94-9e10-96f9e6415753 (non-flash)
Aug 09 15:17:38 user nova-compute[72382]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16ef1023-88b6-4e22-9b4b-45515b25ca9b (non-flash)
Aug 09 15:17:38 user nova-compute[72382]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a907afa8-0d60-4c8f-8bb8-711114487377 (non-flash)
Aug 09 15:17:38 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 15:17:38 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-305253a7-f1cb-4fef-bf50-7f19b7f1e750 tempest-AttachSCSIVolumeTestJSON-1083630769 tempest-AttachSCSIVolumeTestJSON-1083630769-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2267629-52cf-439c-9083-3e8384c67f08 (non-flash)
Aug 09 15:17:38 user nova-compute[72382]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a13916f-1416-4b94-9e10-96f9e6415753 (non-flash)
Aug 09 15:17:38 user nova-compute[72382]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16ef1023-88b6-4e22-9b4b-45515b25ca9b (non-flash)
Aug 09 15:17:38 user nova-compute[72382]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a907afa8-0d60-4c8f-8bb8-711114487377 (non-flash)
Aug 09 15:17:38 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 15:17:38 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-305253a7-f1cb-4fef-bf50-7f19b7f1e750 tempest-AttachSCSIVolumeTestJSON-1083630769 tempest-AttachSCSIVolumeTestJSON-1083630769-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a907afa8-0d60-4c8f-8bb8-711114487377" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.353s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 15:17:38 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-305253a7-f1cb-4fef-bf50-7f19b7f1e750 tempest-AttachSCSIVolumeTestJSON-1083630769 tempest-AttachSCSIVolumeTestJSON-1083630769-project-member] Connected to 172.16.0.220:3260 {{(pid=72382) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 15:17:38 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-305253a7-f1cb-4fef-bf50-7f19b7f1e750 tempest-AttachSCSIVolumeTestJSON-1083630769 tempest-AttachSCSIVolumeTestJSON-1083630769-project-member] HCTL ('36', '-', '-', 0) found on session 5 with lun 0 {{(pid=72382) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 15:17:38 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-305253a7-f1cb-4fef-bf50-7f19b7f1e750 tempest-AttachSCSIVolumeTestJSON-1083630769 tempest-AttachSCSIVolumeTestJSON-1083630769-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72382) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 15:17:38 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:17:38 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.024s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:17:38 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca714225-9e54-4b3a-a389-5288c5972e2c]: (4, ('- - 0', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:17:38 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-305253a7-f1cb-4fef-bf50-7f19b7f1e750 tempest-AttachSCSIVolumeTestJSON-1083630769 tempest-AttachSCSIVolumeTestJSON-1083630769-project-member] Searching for a device in session 5 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72382) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 15:17:38 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-305253a7-f1cb-4fef-bf50-7f19b7f1e750 tempest-AttachSCSIVolumeTestJSON-1083630769 tempest-AttachSCSIVolumeTestJSON-1083630769-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bxyWoAvT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72382) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 15:17:38 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:17:39 user nova-compute[72382]: DEBUG nova.network.neutron [None req-bef6582c-e737-47d6-a352-abd45034229b tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] [instance: 23f25946-de3a-43fb-97a4-1f9a787e6e51] Successfully created port: a67bcfee-0085-436e-8b18-1014b9b40f81 {{(pid=72382) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 15:17:39 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-305253a7-f1cb-4fef-bf50-7f19b7f1e750 tempest-AttachSCSIVolumeTestJSON-1083630769 tempest-AttachSCSIVolumeTestJSON-1083630769-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.395s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 15:17:39 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-305253a7-f1cb-4fef-bf50-7f19b7f1e750 tempest-AttachSCSIVolumeTestJSON-1083630769 tempest-AttachSCSIVolumeTestJSON-1083630769-project-member] <== connect_volume: return (1397ms) {'type': 'block', 'scsi_wwn': '23734663836353438', 'path': '/dev/sde'} {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 15:17:39 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-305253a7-f1cb-4fef-bf50-7f19b7f1e750 tempest-AttachSCSIVolumeTestJSON-1083630769 tempest-AttachSCSIVolumeTestJSON-1083630769-project-member] [instance: 24b63f7a-be32-424b-b72c-d5bec43c408e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23734663836353438', 'path': '/dev/sde'} {{(pid=72382) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 15:17:39 user nova-compute[72382]: DEBUG nova.objects.instance [None req-305253a7-f1cb-4fef-bf50-7f19b7f1e750 tempest-AttachSCSIVolumeTestJSON-1083630769 tempest-AttachSCSIVolumeTestJSON-1083630769-project-member] Lazy-loading 'flavor' on Instance uuid 24b63f7a-be32-424b-b72c-d5bec43c408e {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:17:39 user nova-compute[72382]: DEBUG nova.virt.libvirt.guest [None req-305253a7-f1cb-4fef-bf50-7f19b7f1e750 tempest-AttachSCSIVolumeTestJSON-1083630769 tempest-AttachSCSIVolumeTestJSON-1083630769-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 15:17:39 user nova-compute[72382]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 15:17:39 user nova-compute[72382]:   <source dev="/dev/sde"/>
Aug 09 15:17:39 user nova-compute[72382]:   <target dev="sdc" bus="scsi"/>
Aug 09 15:17:39 user nova-compute[72382]:   <serial>a907afa8-0d60-4c8f-8bb8-711114487377</serial>
Aug 09 15:17:39 user nova-compute[72382]:   <address type="drive" controller="0" unit="2"/>
Aug 09 15:17:39 user nova-compute[72382]: </disk>
Aug 09 15:17:39 user nova-compute[72382]:  {{(pid=72382) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 15:17:40 user nova-compute[72382]: DEBUG nova.network.neutron [None req-bef6582c-e737-47d6-a352-abd45034229b tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] [instance: 23f25946-de3a-43fb-97a4-1f9a787e6e51] Successfully updated port: a67bcfee-0085-436e-8b18-1014b9b40f81 {{(pid=72382) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 15:17:40 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-bef6582c-e737-47d6-a352-abd45034229b tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] Acquiring lock "refresh_cache-23f25946-de3a-43fb-97a4-1f9a787e6e51" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 15:17:40 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-bef6582c-e737-47d6-a352-abd45034229b tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] Acquired lock "refresh_cache-23f25946-de3a-43fb-97a4-1f9a787e6e51" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 15:17:40 user nova-compute[72382]: DEBUG nova.network.neutron [None req-bef6582c-e737-47d6-a352-abd45034229b tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] [instance: 23f25946-de3a-43fb-97a4-1f9a787e6e51] Building network info cache for instance {{(pid=72382) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 15:17:40 user nova-compute[72382]: DEBUG nova.compute.manager [req-52c8caa7-6f27-47e2-8157-a602b3dad958 req-4359e4ae-bccd-4de7-bfe7-e9ed418797cd service nova] [instance: 23f25946-de3a-43fb-97a4-1f9a787e6e51] Received event network-changed-a67bcfee-0085-436e-8b18-1014b9b40f81 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:17:40 user nova-compute[72382]: DEBUG nova.compute.manager [req-52c8caa7-6f27-47e2-8157-a602b3dad958 req-4359e4ae-bccd-4de7-bfe7-e9ed418797cd service nova] [instance: 23f25946-de3a-43fb-97a4-1f9a787e6e51] Refreshing instance network info cache due to event network-changed-a67bcfee-0085-436e-8b18-1014b9b40f81. {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 15:17:40 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-52c8caa7-6f27-47e2-8157-a602b3dad958 req-4359e4ae-bccd-4de7-bfe7-e9ed418797cd service nova] Acquiring lock "refresh_cache-23f25946-de3a-43fb-97a4-1f9a787e6e51" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 15:17:40 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-305253a7-f1cb-4fef-bf50-7f19b7f1e750 tempest-AttachSCSIVolumeTestJSON-1083630769 tempest-AttachSCSIVolumeTestJSON-1083630769-project-member] No BDM found with device name sda, not building metadata. {{(pid=72382) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 15:17:40 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-305253a7-f1cb-4fef-bf50-7f19b7f1e750 tempest-AttachSCSIVolumeTestJSON-1083630769 tempest-AttachSCSIVolumeTestJSON-1083630769-project-member] No BDM found with device name sdb, not building metadata. {{(pid=72382) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 15:17:40 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-305253a7-f1cb-4fef-bf50-7f19b7f1e750 tempest-AttachSCSIVolumeTestJSON-1083630769 tempest-AttachSCSIVolumeTestJSON-1083630769-project-member] No BDM found with device name sdc, not building metadata. {{(pid=72382) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 15:17:40 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-305253a7-f1cb-4fef-bf50-7f19b7f1e750 tempest-AttachSCSIVolumeTestJSON-1083630769 tempest-AttachSCSIVolumeTestJSON-1083630769-project-member] No VIF found with MAC fa:16:3e:58:ca:e4, not building metadata {{(pid=72382) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 15:17:40 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-305253a7-f1cb-4fef-bf50-7f19b7f1e750 tempest-AttachSCSIVolumeTestJSON-1083630769 tempest-AttachSCSIVolumeTestJSON-1083630769-project-member] Lock "24b63f7a-be32-424b-b72c-d5bec43c408e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.634s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:17:41 user nova-compute[72382]: DEBUG nova.network.neutron [None req-bef6582c-e737-47d6-a352-abd45034229b tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] [instance: 23f25946-de3a-43fb-97a4-1f9a787e6e51] Updating instance_info_cache with network_info: [{"id": "1c588f02-cc2c-47f1-8918-bf9b1d3ea215", "address": "fa:16:3e:b1:4d:7d", "network": {"id": "e5132afa-231c-471e-b11a-a6e972603b0c", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2085484007-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b84d09ad643146859e76996c09ba02c7", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c588f02-cc", "ovs_interfaceid": "1c588f02-cc2c-47f1-8918-bf9b1d3ea215", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a67bcfee-0085-436e-8b18-1014b9b40f81", "address": "fa:16:3e:5c:2f:23", "network": {"id": "224c3e1d-3948-43d1-bb02-76a05add8f1e", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-126262034", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.156", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "b84d09ad643146859e76996c09ba02c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa67bcfee-00", "ovs_interfaceid": "a67bcfee-0085-436e-8b18-1014b9b40f81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:17:41 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-bef6582c-e737-47d6-a352-abd45034229b tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] Releasing lock "refresh_cache-23f25946-de3a-43fb-97a4-1f9a787e6e51" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 15:17:41 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-52c8caa7-6f27-47e2-8157-a602b3dad958 req-4359e4ae-bccd-4de7-bfe7-e9ed418797cd service nova] Acquired lock "refresh_cache-23f25946-de3a-43fb-97a4-1f9a787e6e51" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 15:17:41 user nova-compute[72382]: DEBUG nova.network.neutron [req-52c8caa7-6f27-47e2-8157-a602b3dad958 req-4359e4ae-bccd-4de7-bfe7-e9ed418797cd service nova] [instance: 23f25946-de3a-43fb-97a4-1f9a787e6e51] Refreshing network info cache for port a67bcfee-0085-436e-8b18-1014b9b40f81 {{(pid=72382) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 15:17:41 user nova-compute[72382]: DEBUG nova.virt.libvirt.vif [None req-bef6582c-e737-47d6-a352-abd45034229b tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T15:15:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-176087286',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-176087286',id=9,image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF4pKUdXj5zZfLZFWCxFHz8jMa5yp/7/IPCXi1mkSKd0mYycvxd7H8zaZJVqn1Nt7uBCqZDaWzic3f3975RUjfs8oAsAozBRZ/XXtDelWRnO6lHLhAgDLjQA+jzema7e1g==',key_name='tempest-keypair-1955626579',keypairs=<?>,launch_index=0,launched_at=2023-08-09T15:15:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='b84d09ad643146859e76996c09ba02c7',ramdisk_id='',reservation_id='r-sy0nsoiy',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-605331854',owner_user_name='tempest-TaggedAttachmentsTest-605331854-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T15:16:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='97fa102d2fed4045a326b0f5efbd1b1c',uuid=23f25946-de3a-43fb-97a4-1f9a787e6e51,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a67bcfee-0085-436e-8b18-1014b9b40f81", "address": "fa:16:3e:5c:2f:23", "network": {"id": "224c3e1d-3948-43d1-bb02-76a05add8f1e", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-126262034", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.156", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "b84d09ad643146859e76996c09ba02c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa67bcfee-00", "ovs_interfaceid": "a67bcfee-0085-436e-8b18-1014b9b40f81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 15:17:41 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-bef6582c-e737-47d6-a352-abd45034229b tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] Converting VIF {"id": "a67bcfee-0085-436e-8b18-1014b9b40f81", "address": "fa:16:3e:5c:2f:23", "network": {"id": "224c3e1d-3948-43d1-bb02-76a05add8f1e", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-126262034", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.156", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "b84d09ad643146859e76996c09ba02c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa67bcfee-00", "ovs_interfaceid": "a67bcfee-0085-436e-8b18-1014b9b40f81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 15:17:41 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-bef6582c-e737-47d6-a352-abd45034229b tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5c:2f:23,bridge_name='br-int',has_traffic_filtering=True,id=a67bcfee-0085-436e-8b18-1014b9b40f81,network=Network(224c3e1d-3948-43d1-bb02-76a05add8f1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa67bcfee-00') {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 15:17:41 user nova-compute[72382]: DEBUG os_vif [None req-bef6582c-e737-47d6-a352-abd45034229b tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:2f:23,bridge_name='br-int',has_traffic_filtering=True,id=a67bcfee-0085-436e-8b18-1014b9b40f81,network=Network(224c3e1d-3948-43d1-bb02-76a05add8f1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa67bcfee-00') {{(pid=72382) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 15:17:41 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:17:41 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:17:41 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 15:17:41 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:17:41 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa67bcfee-00, may_exist=True, interface_attrs={}) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:17:41 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa67bcfee-00, col_values=(('external_ids', {'iface-id': 'a67bcfee-0085-436e-8b18-1014b9b40f81', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5c:2f:23', 'vm-uuid': '23f25946-de3a-43fb-97a4-1f9a787e6e51'}),), if_exists=True) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:17:41 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:17:41 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:17:41 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:17:41 user nova-compute[72382]: INFO os_vif [None req-bef6582c-e737-47d6-a352-abd45034229b tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:2f:23,bridge_name='br-int',has_traffic_filtering=True,id=a67bcfee-0085-436e-8b18-1014b9b40f81,network=Network(224c3e1d-3948-43d1-bb02-76a05add8f1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa67bcfee-00')
Aug 09 15:17:41 user nova-compute[72382]: DEBUG nova.virt.libvirt.vif [None req-bef6582c-e737-47d6-a352-abd45034229b tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T15:15:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-176087286',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-176087286',id=9,image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF4pKUdXj5zZfLZFWCxFHz8jMa5yp/7/IPCXi1mkSKd0mYycvxd7H8zaZJVqn1Nt7uBCqZDaWzic3f3975RUjfs8oAsAozBRZ/XXtDelWRnO6lHLhAgDLjQA+jzema7e1g==',key_name='tempest-keypair-1955626579',keypairs=<?>,launch_index=0,launched_at=2023-08-09T15:15:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='b84d09ad643146859e76996c09ba02c7',ramdisk_id='',reservation_id='r-sy0nsoiy',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-605331854',owner_user_name='tempest-TaggedAttachmentsTest-605331854-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T15:16:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='97fa102d2fed4045a326b0f5efbd1b1c',uuid=23f25946-de3a-43fb-97a4-1f9a787e6e51,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a67bcfee-0085-436e-8b18-1014b9b40f81", "address": "fa:16:3e:5c:2f:23", "network": {"id": "224c3e1d-3948-43d1-bb02-76a05add8f1e", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-126262034", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.156", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "b84d09ad643146859e76996c09ba02c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa67bcfee-00", "ovs_interfaceid": "a67bcfee-0085-436e-8b18-1014b9b40f81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72382) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 15:17:41 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-bef6582c-e737-47d6-a352-abd45034229b tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] Converting VIF {"id": "a67bcfee-0085-436e-8b18-1014b9b40f81", "address": "fa:16:3e:5c:2f:23", "network": {"id": "224c3e1d-3948-43d1-bb02-76a05add8f1e", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-126262034", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.156", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "b84d09ad643146859e76996c09ba02c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa67bcfee-00", "ovs_interfaceid": "a67bcfee-0085-436e-8b18-1014b9b40f81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 15:17:41 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-bef6582c-e737-47d6-a352-abd45034229b tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5c:2f:23,bridge_name='br-int',has_traffic_filtering=True,id=a67bcfee-0085-436e-8b18-1014b9b40f81,network=Network(224c3e1d-3948-43d1-bb02-76a05add8f1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa67bcfee-00') {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 15:17:41 user nova-compute[72382]: DEBUG nova.virt.libvirt.guest [None req-bef6582c-e737-47d6-a352-abd45034229b tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] attach device xml: <interface type="ethernet">
Aug 09 15:17:41 user nova-compute[72382]:   <mac address="fa:16:3e:5c:2f:23"/>
Aug 09 15:17:41 user nova-compute[72382]:   <model type="virtio"/>
Aug 09 15:17:41 user nova-compute[72382]:   <mtu size="1442"/>
Aug 09 15:17:41 user nova-compute[72382]:   <target dev="tapa67bcfee-00"/>
Aug 09 15:17:41 user nova-compute[72382]: </interface>
Aug 09 15:17:41 user nova-compute[72382]:  {{(pid=72382) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 15:17:41 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:17:41 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:17:41 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:17:41 user nova-compute[72382]: DEBUG nova.compute.manager [req-a726f8ce-90ef-479d-88e3-a1d10966ca08 req-76fbca9c-a4c0-4b91-8039-fd6838c9e4b2 service nova] [instance: 23f25946-de3a-43fb-97a4-1f9a787e6e51] Received event network-vif-plugged-a67bcfee-0085-436e-8b18-1014b9b40f81 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:17:41 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-a726f8ce-90ef-479d-88e3-a1d10966ca08 req-76fbca9c-a4c0-4b91-8039-fd6838c9e4b2 service nova] Acquiring lock "23f25946-de3a-43fb-97a4-1f9a787e6e51-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:17:41 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-a726f8ce-90ef-479d-88e3-a1d10966ca08 req-76fbca9c-a4c0-4b91-8039-fd6838c9e4b2 service nova] Lock "23f25946-de3a-43fb-97a4-1f9a787e6e51-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:17:41 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-a726f8ce-90ef-479d-88e3-a1d10966ca08 req-76fbca9c-a4c0-4b91-8039-fd6838c9e4b2 service nova] Lock "23f25946-de3a-43fb-97a4-1f9a787e6e51-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:17:41 user nova-compute[72382]: DEBUG nova.compute.manager [req-a726f8ce-90ef-479d-88e3-a1d10966ca08 req-76fbca9c-a4c0-4b91-8039-fd6838c9e4b2 service nova] [instance: 23f25946-de3a-43fb-97a4-1f9a787e6e51] No waiting events found dispatching network-vif-plugged-a67bcfee-0085-436e-8b18-1014b9b40f81 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:17:41 user nova-compute[72382]: WARNING nova.compute.manager [req-a726f8ce-90ef-479d-88e3-a1d10966ca08 req-76fbca9c-a4c0-4b91-8039-fd6838c9e4b2 service nova] [instance: 23f25946-de3a-43fb-97a4-1f9a787e6e51] Received unexpected event network-vif-plugged-a67bcfee-0085-436e-8b18-1014b9b40f81 for instance with vm_state active and task_state None.
Aug 09 15:17:41 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-08f3a80a-9765-4f12-993a-eb156d401961 tempest-AttachSCSIVolumeTestJSON-1083630769 tempest-AttachSCSIVolumeTestJSON-1083630769-project-member] Acquiring lock "24b63f7a-be32-424b-b72c-d5bec43c408e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:17:41 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-08f3a80a-9765-4f12-993a-eb156d401961 tempest-AttachSCSIVolumeTestJSON-1083630769 tempest-AttachSCSIVolumeTestJSON-1083630769-project-member] Lock "24b63f7a-be32-424b-b72c-d5bec43c408e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:17:41 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-bef6582c-e737-47d6-a352-abd45034229b tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] No BDM found with device name vda, not building metadata. {{(pid=72382) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 15:17:41 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-bef6582c-e737-47d6-a352-abd45034229b tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] No BDM found with device name hda, not building metadata. {{(pid=72382) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 15:17:41 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-bef6582c-e737-47d6-a352-abd45034229b tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] No VIF found with MAC fa:16:3e:b1:4d:7d, not building metadata {{(pid=72382) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 15:17:41 user nova-compute[72382]: INFO nova.compute.manager [None req-08f3a80a-9765-4f12-993a-eb156d401961 tempest-AttachSCSIVolumeTestJSON-1083630769 tempest-AttachSCSIVolumeTestJSON-1083630769-project-member] [instance: 24b63f7a-be32-424b-b72c-d5bec43c408e] Detaching volume a907afa8-0d60-4c8f-8bb8-711114487377
Aug 09 15:17:41 user nova-compute[72382]: DEBUG nova.virt.libvirt.guest [None req-bef6582c-e737-47d6-a352-abd45034229b tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 15:17:41 user nova-compute[72382]:   <nova:package version="0.0.0"/>
Aug 09 15:17:41 user nova-compute[72382]:   <nova:name>tempest-device-tagging-server-176087286</nova:name>
Aug 09 15:17:41 user nova-compute[72382]:   <nova:creationTime>2023-08-09 15:17:41</nova:creationTime>
Aug 09 15:17:41 user nova-compute[72382]:   <nova:flavor name="m1.tiny">
Aug 09 15:17:41 user nova-compute[72382]:     <nova:memory>512</nova:memory>
Aug 09 15:17:41 user nova-compute[72382]:     <nova:disk>1</nova:disk>
Aug 09 15:17:41 user nova-compute[72382]:     <nova:swap>0</nova:swap>
Aug 09 15:17:41 user nova-compute[72382]:     <nova:ephemeral>0</nova:ephemeral>
Aug 09 15:17:41 user nova-compute[72382]:     <nova:vcpus>1</nova:vcpus>
Aug 09 15:17:41 user nova-compute[72382]:   </nova:flavor>
Aug 09 15:17:41 user nova-compute[72382]:   <nova:owner>
Aug 09 15:17:41 user nova-compute[72382]:     <nova:user uuid="97fa102d2fed4045a326b0f5efbd1b1c">tempest-TaggedAttachmentsTest-605331854-project-member</nova:user>
Aug 09 15:17:41 user nova-compute[72382]:     <nova:project uuid="b84d09ad643146859e76996c09ba02c7">tempest-TaggedAttachmentsTest-605331854</nova:project>
Aug 09 15:17:41 user nova-compute[72382]:   </nova:owner>
Aug 09 15:17:41 user nova-compute[72382]:   <nova:root type="image" uuid="a79f2cea-eb27-4631-aaf3-05e7d9e411b4"/>
Aug 09 15:17:41 user nova-compute[72382]:   <nova:ports>
Aug 09 15:17:41 user nova-compute[72382]:     <nova:port uuid="1c588f02-cc2c-47f1-8918-bf9b1d3ea215">
Aug 09 15:17:41 user nova-compute[72382]:       <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 09 15:17:41 user nova-compute[72382]:     </nova:port>
Aug 09 15:17:41 user nova-compute[72382]:     <nova:port uuid="a67bcfee-0085-436e-8b18-1014b9b40f81">
Aug 09 15:17:41 user nova-compute[72382]:       <nova:ip type="fixed" address="10.10.10.156" ipVersion="4"/>
Aug 09 15:17:41 user nova-compute[72382]:     </nova:port>
Aug 09 15:17:41 user nova-compute[72382]:   </nova:ports>
Aug 09 15:17:41 user nova-compute[72382]: </nova:instance>
Aug 09 15:17:41 user nova-compute[72382]:  {{(pid=72382) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Aug 09 15:17:41 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-bef6582c-e737-47d6-a352-abd45034229b tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] Lock "interface-23f25946-de3a-43fb-97a4-1f9a787e6e51-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 3.884s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:17:41 user nova-compute[72382]: DEBUG nova.network.neutron [req-52c8caa7-6f27-47e2-8157-a602b3dad958 req-4359e4ae-bccd-4de7-bfe7-e9ed418797cd service nova] [instance: 23f25946-de3a-43fb-97a4-1f9a787e6e51] Updated VIF entry in instance network info cache for port a67bcfee-0085-436e-8b18-1014b9b40f81. {{(pid=72382) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 15:17:41 user nova-compute[72382]: DEBUG nova.network.neutron [req-52c8caa7-6f27-47e2-8157-a602b3dad958 req-4359e4ae-bccd-4de7-bfe7-e9ed418797cd service nova] [instance: 23f25946-de3a-43fb-97a4-1f9a787e6e51] Updating instance_info_cache with network_info: [{"id": "1c588f02-cc2c-47f1-8918-bf9b1d3ea215", "address": "fa:16:3e:b1:4d:7d", "network": {"id": "e5132afa-231c-471e-b11a-a6e972603b0c", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2085484007-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b84d09ad643146859e76996c09ba02c7", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c588f02-cc", "ovs_interfaceid": "1c588f02-cc2c-47f1-8918-bf9b1d3ea215", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a67bcfee-0085-436e-8b18-1014b9b40f81", "address": "fa:16:3e:5c:2f:23", "network": {"id": "224c3e1d-3948-43d1-bb02-76a05add8f1e", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-126262034", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.156", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "b84d09ad643146859e76996c09ba02c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa67bcfee-00", "ovs_interfaceid": "a67bcfee-0085-436e-8b18-1014b9b40f81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:17:41 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-52c8caa7-6f27-47e2-8157-a602b3dad958 req-4359e4ae-bccd-4de7-bfe7-e9ed418797cd service nova] Releasing lock "refresh_cache-23f25946-de3a-43fb-97a4-1f9a787e6e51" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 15:17:41 user nova-compute[72382]: INFO nova.virt.block_device [None req-08f3a80a-9765-4f12-993a-eb156d401961 tempest-AttachSCSIVolumeTestJSON-1083630769 tempest-AttachSCSIVolumeTestJSON-1083630769-project-member] [instance: 24b63f7a-be32-424b-b72c-d5bec43c408e] Attempting to driver detach volume a907afa8-0d60-4c8f-8bb8-711114487377 from mountpoint /dev/sdc
Aug 09 15:17:41 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-08f3a80a-9765-4f12-993a-eb156d401961 tempest-AttachSCSIVolumeTestJSON-1083630769 tempest-AttachSCSIVolumeTestJSON-1083630769-project-member] Attempting to detach device sdc from instance 24b63f7a-be32-424b-b72c-d5bec43c408e from the persistent domain config. {{(pid=72382) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 15:17:41 user nova-compute[72382]: DEBUG nova.virt.libvirt.guest [None req-08f3a80a-9765-4f12-993a-eb156d401961 tempest-AttachSCSIVolumeTestJSON-1083630769 tempest-AttachSCSIVolumeTestJSON-1083630769-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 15:17:41 user nova-compute[72382]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 15:17:41 user nova-compute[72382]:   <source dev="/dev/sde"/>
Aug 09 15:17:41 user nova-compute[72382]:   <target dev="sdc" bus="scsi"/>
Aug 09 15:17:41 user nova-compute[72382]:   <serial>a907afa8-0d60-4c8f-8bb8-711114487377</serial>
Aug 09 15:17:41 user nova-compute[72382]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Aug 09 15:17:41 user nova-compute[72382]: </disk>
Aug 09 15:17:41 user nova-compute[72382]:  {{(pid=72382) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 15:17:41 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-08f3a80a-9765-4f12-993a-eb156d401961 tempest-AttachSCSIVolumeTestJSON-1083630769 tempest-AttachSCSIVolumeTestJSON-1083630769-project-member] Successfully detached device sdc from instance 24b63f7a-be32-424b-b72c-d5bec43c408e from the persistent domain config.
Aug 09 15:17:41 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-08f3a80a-9765-4f12-993a-eb156d401961 tempest-AttachSCSIVolumeTestJSON-1083630769 tempest-AttachSCSIVolumeTestJSON-1083630769-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance 24b63f7a-be32-424b-b72c-d5bec43c408e from the live domain config. {{(pid=72382) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 15:17:41 user nova-compute[72382]: DEBUG nova.virt.libvirt.guest [None req-08f3a80a-9765-4f12-993a-eb156d401961 tempest-AttachSCSIVolumeTestJSON-1083630769 tempest-AttachSCSIVolumeTestJSON-1083630769-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 15:17:41 user nova-compute[72382]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 15:17:41 user nova-compute[72382]:   <source dev="/dev/sde"/>
Aug 09 15:17:41 user nova-compute[72382]:   <target dev="sdc" bus="scsi"/>
Aug 09 15:17:41 user nova-compute[72382]:   <serial>a907afa8-0d60-4c8f-8bb8-711114487377</serial>
Aug 09 15:17:41 user nova-compute[72382]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Aug 09 15:17:41 user nova-compute[72382]: </disk>
Aug 09 15:17:41 user nova-compute[72382]:  {{(pid=72382) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 15:17:42 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:17:42 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:17:42 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:17:42 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c0f6a347-ede6-413a-b46f-3c5d09a71d16 tempest-VolumesAssistedSnapshotsTest-1118703382 tempest-VolumesAssistedSnapshotsTest-1118703382-project-admin] [instance: f0a7fa25-4520-4f40-9515-b88e3d2fd910] Calling os-brick to attach iSCSI Volume {{(pid=72382) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 15:17:42 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0f6a347-ede6-413a-b46f-3c5d09a71d16 tempest-VolumesAssistedSnapshotsTest-1118703382 tempest-VolumesAssistedSnapshotsTest-1118703382-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2a0c768340>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:eb2b70eb-a2ee-434f-86e2-badfd14fa295'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'URQtoeuF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 15:17:42 user nova-compute[72382]: WARNING os_brick.initiator.connectors.base [None req-c0f6a347-ede6-413a-b46f-3c5d09a71d16 tempest-VolumesAssistedSnapshotsTest-1118703382 tempest-VolumesAssistedSnapshotsTest-1118703382-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 15:17:42 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-c0f6a347-ede6-413a-b46f-3c5d09a71d16 tempest-VolumesAssistedSnapshotsTest-1118703382 tempest-VolumesAssistedSnapshotsTest-1118703382-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 15:17:42 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-c0f6a347-ede6-413a-b46f-3c5d09a71d16 tempest-VolumesAssistedSnapshotsTest-1118703382 tempest-VolumesAssistedSnapshotsTest-1118703382-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 15:17:42 user nova-compute[72382]: WARNING os_brick.initiator.connectors.base [None req-c0f6a347-ede6-413a-b46f-3c5d09a71d16 tempest-VolumesAssistedSnapshotsTest-1118703382 tempest-VolumesAssistedSnapshotsTest-1118703382-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 15:17:42 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-c0f6a347-ede6-413a-b46f-3c5d09a71d16 tempest-VolumesAssistedSnapshotsTest-1118703382 tempest-VolumesAssistedSnapshotsTest-1118703382-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eb2b70eb-a2ee-434f-86e2-badfd14fa295" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 15:17:42 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-c0f6a347-ede6-413a-b46f-3c5d09a71d16 tempest-VolumesAssistedSnapshotsTest-1118703382 tempest-VolumesAssistedSnapshotsTest-1118703382-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eb2b70eb-a2ee-434f-86e2-badfd14fa295" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 15:17:42 user nova-compute[72382]: INFO os_brick.initiator.connectors.iscsi [None req-c0f6a347-ede6-413a-b46f-3c5d09a71d16 tempest-VolumesAssistedSnapshotsTest-1118703382 tempest-VolumesAssistedSnapshotsTest-1118703382-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 15:17:42 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb2b70eb-a2ee-434f-86e2-badfd14fa295 -p 172.16.0.220:3260 {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:17:42 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb2b70eb-a2ee-434f-86e2-badfd14fa295 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:17:42 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[151975af-b74a-4b49-89e7-7df8b8f7f87f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:17:42 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0f6a347-ede6-413a-b46f-3c5d09a71d16 tempest-VolumesAssistedSnapshotsTest-1118703382 tempest-VolumesAssistedSnapshotsTest-1118703382-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 15:17:42 user nova-compute[72382]:  {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:17:42 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb2b70eb-a2ee-434f-86e2-badfd14fa295 -p 172.16.0.220:3260 --interface default --op new {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:17:42 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb2b70eb-a2ee-434f-86e2-badfd14fa295 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:17:42 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dcc741f-35b3-42c7-8ba0-6f6f310b9df8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:eb2b70eb-a2ee-434f-86e2-badfd14fa295] added\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:17:42 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0f6a347-ede6-413a-b46f-3c5d09a71d16 tempest-VolumesAssistedSnapshotsTest-1118703382 tempest-VolumesAssistedSnapshotsTest-1118703382-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:eb2b70eb-a2ee-434f-86e2-badfd14fa295] added
Aug 09 15:17:42 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:17:42 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb2b70eb-a2ee-434f-86e2-badfd14fa295 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:17:42 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb2b70eb-a2ee-434f-86e2-badfd14fa295 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:17:42 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e26b20f-08dc-418f-b5dd-773e52403879]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:17:42 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0f6a347-ede6-413a-b46f-3c5d09a71d16 tempest-VolumesAssistedSnapshotsTest-1118703382 tempest-VolumesAssistedSnapshotsTest-1118703382-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:17:42 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb2b70eb-a2ee-434f-86e2-badfd14fa295 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:17:42 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb2b70eb-a2ee-434f-86e2-badfd14fa295 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:17:42 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[5572cbb0-6ad7-4c5a-b2ba-41c897a55678]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:17:42 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0f6a347-ede6-413a-b46f-3c5d09a71d16 tempest-VolumesAssistedSnapshotsTest-1118703382 tempest-VolumesAssistedSnapshotsTest-1118703382-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:17:42 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb2b70eb-a2ee-434f-86e2-badfd14fa295 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v URQtoeuF {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:17:42 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb2b70eb-a2ee-434f-86e2-badfd14fa295 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v URQtoeuF" returned: 0 in 0.019s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:17:42 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[37924d64-0e3f-4212-b9b9-fbb71755da61]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:17:42 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0f6a347-ede6-413a-b46f-3c5d09a71d16 tempest-VolumesAssistedSnapshotsTest-1118703382 tempest-VolumesAssistedSnapshotsTest-1118703382-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'URQtoeuF'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:17:42 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb2b70eb-a2ee-434f-86e2-badfd14fa295 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:17:42 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb2b70eb-a2ee-434f-86e2-badfd14fa295 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:17:42 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cceafa0-ae92-40bc-a3c8-302e5771addb]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:17:42 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0f6a347-ede6-413a-b46f-3c5d09a71d16 tempest-VolumesAssistedSnapshotsTest-1118703382 tempest-VolumesAssistedSnapshotsTest-1118703382-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:17:42 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:17:42 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-13577d43-df39-42bb-8f2e-da94464f07aa tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] Acquiring lock "23f25946-de3a-43fb-97a4-1f9a787e6e51" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:17:42 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-13577d43-df39-42bb-8f2e-da94464f07aa tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] Lock "23f25946-de3a-43fb-97a4-1f9a787e6e51" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:17:42 user nova-compute[72382]: DEBUG nova.objects.instance [None req-13577d43-df39-42bb-8f2e-da94464f07aa tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] Lazy-loading 'flavor' on Instance uuid 23f25946-de3a-43fb-97a4-1f9a787e6e51 {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:17:42 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:17:42 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[102a88fa-efec-4d4f-9b2d-94dd6a550ece]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2267629-52cf-439c-9083-3e8384c67f08 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a13916f-1416-4b94-9e10-96f9e6415753 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16ef1023-88b6-4e22-9b4b-45515b25ca9b (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a907afa8-0d60-4c8f-8bb8-711114487377 (non-flash)\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:17:42 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0f6a347-ede6-413a-b46f-3c5d09a71d16 tempest-VolumesAssistedSnapshotsTest-1118703382 tempest-VolumesAssistedSnapshotsTest-1118703382-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2267629-52cf-439c-9083-3e8384c67f08 (non-flash)
Aug 09 15:17:42 user nova-compute[72382]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a13916f-1416-4b94-9e10-96f9e6415753 (non-flash)
Aug 09 15:17:42 user nova-compute[72382]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16ef1023-88b6-4e22-9b4b-45515b25ca9b (non-flash)
Aug 09 15:17:42 user nova-compute[72382]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a907afa8-0d60-4c8f-8bb8-711114487377 (non-flash)
Aug 09 15:17:42 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 15:17:42 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0f6a347-ede6-413a-b46f-3c5d09a71d16 tempest-VolumesAssistedSnapshotsTest-1118703382 tempest-VolumesAssistedSnapshotsTest-1118703382-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2267629-52cf-439c-9083-3e8384c67f08 (non-flash)
Aug 09 15:17:42 user nova-compute[72382]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a13916f-1416-4b94-9e10-96f9e6415753 (non-flash)
Aug 09 15:17:42 user nova-compute[72382]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16ef1023-88b6-4e22-9b4b-45515b25ca9b (non-flash)
Aug 09 15:17:42 user nova-compute[72382]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a907afa8-0d60-4c8f-8bb8-711114487377 (non-flash)
Aug 09 15:17:42 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 15:17:42 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb2b70eb-a2ee-434f-86e2-badfd14fa295 -p 172.16.0.220:3260 --login {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:17:42 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-13577d43-df39-42bb-8f2e-da94464f07aa tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] Lock "23f25946-de3a-43fb-97a4-1f9a787e6e51" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.105s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:17:42 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb2b70eb-a2ee-434f-86e2-badfd14fa295 -p 172.16.0.220:3260 --login" returned: 0 in 0.082s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:17:42 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[21bd62a7-62d9-47e9-a443-b6518abdcc16]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:eb2b70eb-a2ee-434f-86e2-badfd14fa295, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:eb2b70eb-a2ee-434f-86e2-badfd14fa295, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:17:42 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0f6a347-ede6-413a-b46f-3c5d09a71d16 tempest-VolumesAssistedSnapshotsTest-1118703382 tempest-VolumesAssistedSnapshotsTest-1118703382-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:eb2b70eb-a2ee-434f-86e2-badfd14fa295, portal: 172.16.0.220,3260]
Aug 09 15:17:42 user nova-compute[72382]: Login to [iface: default, target: iqn.2010-10.org.openstack:eb2b70eb-a2ee-434f-86e2-badfd14fa295, portal: 172.16.0.220,3260] successful.
Aug 09 15:17:42 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:17:42 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb2b70eb-a2ee-434f-86e2-badfd14fa295 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:17:42 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb2b70eb-a2ee-434f-86e2-badfd14fa295 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.029s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:17:42 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[31a15223-2ec8-4b9e-881a-2e38ed8dafb6]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:17:42 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0f6a347-ede6-413a-b46f-3c5d09a71d16 tempest-VolumesAssistedSnapshotsTest-1118703382 tempest-VolumesAssistedSnapshotsTest-1118703382-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:17:42 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:17:42 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:17:42 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[08ad637e-2f6c-4851-805a-585f52ba3fbe]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2267629-52cf-439c-9083-3e8384c67f08 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a13916f-1416-4b94-9e10-96f9e6415753 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16ef1023-88b6-4e22-9b4b-45515b25ca9b (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a907afa8-0d60-4c8f-8bb8-711114487377 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb2b70eb-a2ee-434f-86e2-badfd14fa295 (non-flash)\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:17:42 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0f6a347-ede6-413a-b46f-3c5d09a71d16 tempest-VolumesAssistedSnapshotsTest-1118703382 tempest-VolumesAssistedSnapshotsTest-1118703382-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2267629-52cf-439c-9083-3e8384c67f08 (non-flash)
Aug 09 15:17:42 user nova-compute[72382]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a13916f-1416-4b94-9e10-96f9e6415753 (non-flash)
Aug 09 15:17:42 user nova-compute[72382]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16ef1023-88b6-4e22-9b4b-45515b25ca9b (non-flash)
Aug 09 15:17:42 user nova-compute[72382]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a907afa8-0d60-4c8f-8bb8-711114487377 (non-flash)
Aug 09 15:17:42 user nova-compute[72382]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb2b70eb-a2ee-434f-86e2-badfd14fa295 (non-flash)
Aug 09 15:17:42 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 15:17:42 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0f6a347-ede6-413a-b46f-3c5d09a71d16 tempest-VolumesAssistedSnapshotsTest-1118703382 tempest-VolumesAssistedSnapshotsTest-1118703382-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2267629-52cf-439c-9083-3e8384c67f08 (non-flash)
Aug 09 15:17:42 user nova-compute[72382]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a13916f-1416-4b94-9e10-96f9e6415753 (non-flash)
Aug 09 15:17:42 user nova-compute[72382]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16ef1023-88b6-4e22-9b4b-45515b25ca9b (non-flash)
Aug 09 15:17:42 user nova-compute[72382]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a907afa8-0d60-4c8f-8bb8-711114487377 (non-flash)
Aug 09 15:17:42 user nova-compute[72382]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb2b70eb-a2ee-434f-86e2-badfd14fa295 (non-flash)
Aug 09 15:17:42 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 15:17:42 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-c0f6a347-ede6-413a-b46f-3c5d09a71d16 tempest-VolumesAssistedSnapshotsTest-1118703382 tempest-VolumesAssistedSnapshotsTest-1118703382-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eb2b70eb-a2ee-434f-86e2-badfd14fa295" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.319s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 15:17:42 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0f6a347-ede6-413a-b46f-3c5d09a71d16 tempest-VolumesAssistedSnapshotsTest-1118703382 tempest-VolumesAssistedSnapshotsTest-1118703382-project-admin] Connected to 172.16.0.220:3260 {{(pid=72382) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 15:17:42 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-c0f6a347-ede6-413a-b46f-3c5d09a71d16 tempest-VolumesAssistedSnapshotsTest-1118703382 tempest-VolumesAssistedSnapshotsTest-1118703382-project-admin] HCTL ('37', '-', '-', 0) found on session 6 with lun 0 {{(pid=72382) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 15:17:42 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-c0f6a347-ede6-413a-b46f-3c5d09a71d16 tempest-VolumesAssistedSnapshotsTest-1118703382 tempest-VolumesAssistedSnapshotsTest-1118703382-project-admin] Scanning host 37 c: -, t: -, l: 0) {{(pid=72382) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 15:17:42 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:17:42 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Received event <DeviceRemovedEvent: 1691594262.4714472, 24b63f7a-be32-424b-b72c-d5bec43c408e => scsi0-0-0-2> from libvirt while the driver is waiting for it; dispatched. {{(pid=72382) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 15:17:42 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.019s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:17:42 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e21ef0d-83d5-485d-afd3-309e6be8b5b7]: (4, ('- - 0', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:17:42 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-c0f6a347-ede6-413a-b46f-3c5d09a71d16 tempest-VolumesAssistedSnapshotsTest-1118703382 tempest-VolumesAssistedSnapshotsTest-1118703382-project-admin] Searching for a device in session 6 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=72382) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 15:17:42 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0f6a347-ede6-413a-b46f-3c5d09a71d16 tempest-VolumesAssistedSnapshotsTest-1118703382 tempest-VolumesAssistedSnapshotsTest-1118703382-project-admin] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'URQtoeuF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72382) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 15:17:42 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-08f3a80a-9765-4f12-993a-eb156d401961 tempest-AttachSCSIVolumeTestJSON-1083630769 tempest-AttachSCSIVolumeTestJSON-1083630769-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance 24b63f7a-be32-424b-b72c-d5bec43c408e {{(pid=72382) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 15:17:42 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-08f3a80a-9765-4f12-993a-eb156d401961 tempest-AttachSCSIVolumeTestJSON-1083630769 tempest-AttachSCSIVolumeTestJSON-1083630769-project-member] Successfully detached device sdc from instance 24b63f7a-be32-424b-b72c-d5bec43c408e from the live domain config.
Aug 09 15:17:42 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-08f3a80a-9765-4f12-993a-eb156d401961 tempest-AttachSCSIVolumeTestJSON-1083630769 tempest-AttachSCSIVolumeTestJSON-1083630769-project-member] [instance: 24b63f7a-be32-424b-b72c-d5bec43c408e] calling os-brick to detach iSCSI Volume {{(pid=72382) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 15:17:42 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-08f3a80a-9765-4f12-993a-eb156d401961 tempest-AttachSCSIVolumeTestJSON-1083630769 tempest-AttachSCSIVolumeTestJSON-1083630769-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2a0c768340>, {'target_iqns': ['iqn.2010-10.org.openstack:a907afa8-0d60-4c8f-8bb8-711114487377'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bxyWoAvT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 15:17:42 user nova-compute[72382]: WARNING os_brick.initiator.connectors.base [None req-08f3a80a-9765-4f12-993a-eb156d401961 tempest-AttachSCSIVolumeTestJSON-1083630769 tempest-AttachSCSIVolumeTestJSON-1083630769-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 15:17:42 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-08f3a80a-9765-4f12-993a-eb156d401961 tempest-AttachSCSIVolumeTestJSON-1083630769 tempest-AttachSCSIVolumeTestJSON-1083630769-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 15:17:42 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-13577d43-df39-42bb-8f2e-da94464f07aa tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] Acquiring lock "23f25946-de3a-43fb-97a4-1f9a787e6e51" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:17:42 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-13577d43-df39-42bb-8f2e-da94464f07aa tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] Lock "23f25946-de3a-43fb-97a4-1f9a787e6e51" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:17:42 user nova-compute[72382]: INFO nova.compute.manager [None req-13577d43-df39-42bb-8f2e-da94464f07aa tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] [instance: 23f25946-de3a-43fb-97a4-1f9a787e6e51] Attaching volume 9489f8bc-3805-45bd-adfa-7d42f629184a to /dev/vdb
Aug 09 15:17:42 user nova-compute[72382]: DEBUG os_brick.utils [None req-13577d43-df39-42bb-8f2e-da94464f07aa tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 15:17:42 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:17:42 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:17:42 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[82525c4c-e6be-4db7-8af5-2da5137f1549]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d2cfa7015fe\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:17:42 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:17:42 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.032s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:17:42 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[d671f230-313c-4059-ade7-af394766dc1e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:17:42 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:17:42 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:17:42 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8e05db9-7709-4a3f-8c50-83ff5d9b6556]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:17:42 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[0db0d82e-1dfd-4de1-ae8a-edcaced183ab]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:17:42 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-13577d43-df39-42bb-8f2e-da94464f07aa tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] Running cmd (subprocess): nvme version {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:17:42 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-13577d43-df39-42bb-8f2e-da94464f07aa tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] 'nvme version' failed. Not Retrying. {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 15:17:42 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.nvmeof [None req-13577d43-df39-42bb-8f2e-da94464f07aa tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] nvme not present on system {{(pid=72382) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 15:17:42 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:17:42 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 15:17:42 user nova-compute[72382]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 15:17:42 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[12e38452-918f-4d97-ad77-76b7017ce55e]: (4, '') {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:17:42 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.lightos [None req-13577d43-df39-42bb-8f2e-da94464f07aa tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72382) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 15:17:42 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.lightos [None req-13577d43-df39-42bb-8f2e-da94464f07aa tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72382) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 15:17:42 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.lightos [None req-13577d43-df39-42bb-8f2e-da94464f07aa tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] LIGHTOS: no hostnqn found. {{(pid=72382) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 15:17:42 user nova-compute[72382]: DEBUG os_brick.utils [None req-13577d43-df39-42bb-8f2e-da94464f07aa tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d2cfa7015fe', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 15:17:42 user nova-compute[72382]: DEBUG nova.virt.block_device [None req-13577d43-df39-42bb-8f2e-da94464f07aa tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] [instance: 23f25946-de3a-43fb-97a4-1f9a787e6e51] Updating existing volume attachment record: 392a4fb0-3c9f-42d4-b00e-4419755f1277 {{(pid=72382) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 15:17:43 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-c0f6a347-ede6-413a-b46f-3c5d09a71d16 tempest-VolumesAssistedSnapshotsTest-1118703382 tempest-VolumesAssistedSnapshotsTest-1118703382-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.358s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 15:17:43 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0f6a347-ede6-413a-b46f-3c5d09a71d16 tempest-VolumesAssistedSnapshotsTest-1118703382 tempest-VolumesAssistedSnapshotsTest-1118703382-project-admin] <== connect_volume: return (1361ms) {'type': 'block', 'scsi_wwn': '23736616365643138', 'path': '/dev/sdf'} {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 15:17:43 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c0f6a347-ede6-413a-b46f-3c5d09a71d16 tempest-VolumesAssistedSnapshotsTest-1118703382 tempest-VolumesAssistedSnapshotsTest-1118703382-project-admin] [instance: f0a7fa25-4520-4f40-9515-b88e3d2fd910] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23736616365643138', 'path': '/dev/sdf'} {{(pid=72382) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 15:17:43 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-08f3a80a-9765-4f12-993a-eb156d401961 tempest-AttachSCSIVolumeTestJSON-1083630769 tempest-AttachSCSIVolumeTestJSON-1083630769-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.999s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 15:17:43 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-08f3a80a-9765-4f12-993a-eb156d401961 tempest-AttachSCSIVolumeTestJSON-1083630769 tempest-AttachSCSIVolumeTestJSON-1083630769-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a907afa8-0d60-4c8f-8bb8-711114487377', 0)] {{(pid=72382) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 15:17:43 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:17:43 user nova-compute[72382]: DEBUG nova.objects.instance [None req-c0f6a347-ede6-413a-b46f-3c5d09a71d16 tempest-VolumesAssistedSnapshotsTest-1118703382 tempest-VolumesAssistedSnapshotsTest-1118703382-project-admin] Lazy-loading 'flavor' on Instance uuid f0a7fa25-4520-4f40-9515-b88e3d2fd910 {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:17:43 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:17:43 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8c93ff9-c9ea-4698-be56-b5d274faa5d8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:16ef1023-88b6-4e22-9b4b-45515b25ca9b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5a13916f-1416-4b94-9e10-96f9e6415753\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a907afa8-0d60-4c8f-8bb8-711114487377\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e2267629-52cf-439c-9083-3e8384c67f08\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eb2b70eb-a2ee-434f-86e2-badfd14fa295\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:17:43 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:17:43 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:17:43 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[be9b3d66-1002-497a-b4db-96ad8df67444]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2267629-52cf-439c-9083-3e8384c67f08 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a13916f-1416-4b94-9e10-96f9e6415753 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16ef1023-88b6-4e22-9b4b-45515b25ca9b (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a907afa8-0d60-4c8f-8bb8-711114487377 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb2b70eb-a2ee-434f-86e2-badfd14fa295 (non-flash)\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:17:43 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-08f3a80a-9765-4f12-993a-eb156d401961 tempest-AttachSCSIVolumeTestJSON-1083630769 tempest-AttachSCSIVolumeTestJSON-1083630769-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2267629-52cf-439c-9083-3e8384c67f08 (non-flash)
Aug 09 15:17:43 user nova-compute[72382]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a13916f-1416-4b94-9e10-96f9e6415753 (non-flash)
Aug 09 15:17:43 user nova-compute[72382]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16ef1023-88b6-4e22-9b4b-45515b25ca9b (non-flash)
Aug 09 15:17:43 user nova-compute[72382]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a907afa8-0d60-4c8f-8bb8-711114487377 (non-flash)
Aug 09 15:17:43 user nova-compute[72382]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb2b70eb-a2ee-434f-86e2-badfd14fa295 (non-flash)
Aug 09 15:17:43 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 15:17:43 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-08f3a80a-9765-4f12-993a-eb156d401961 tempest-AttachSCSIVolumeTestJSON-1083630769 tempest-AttachSCSIVolumeTestJSON-1083630769-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2267629-52cf-439c-9083-3e8384c67f08 (non-flash)
Aug 09 15:17:43 user nova-compute[72382]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a13916f-1416-4b94-9e10-96f9e6415753 (non-flash)
Aug 09 15:17:43 user nova-compute[72382]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16ef1023-88b6-4e22-9b4b-45515b25ca9b (non-flash)
Aug 09 15:17:43 user nova-compute[72382]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a907afa8-0d60-4c8f-8bb8-711114487377 (non-flash)
Aug 09 15:17:43 user nova-compute[72382]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb2b70eb-a2ee-434f-86e2-badfd14fa295 (non-flash)
Aug 09 15:17:43 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 15:17:43 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-08f3a80a-9765-4f12-993a-eb156d401961 tempest-AttachSCSIVolumeTestJSON-1083630769 tempest-AttachSCSIVolumeTestJSON-1083630769-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2a2432acb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a907afa8-0d60-4c8f-8bb8-711114487377'): ({'sde'}, set())}) {{(pid=72382) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 15:17:43 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-08f3a80a-9765-4f12-993a-eb156d401961 tempest-AttachSCSIVolumeTestJSON-1083630769 tempest-AttachSCSIVolumeTestJSON-1083630769-project-member] Removing single pathed devices sde {{(pid=72382) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 15:17:43 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:17:43 user nova-compute[72382]: DEBUG nova.virt.libvirt.guest [None req-c0f6a347-ede6-413a-b46f-3c5d09a71d16 tempest-VolumesAssistedSnapshotsTest-1118703382 tempest-VolumesAssistedSnapshotsTest-1118703382-project-admin] attach device xml: <disk type="block" device="disk">
Aug 09 15:17:43 user nova-compute[72382]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 15:17:43 user nova-compute[72382]:   <source dev="/dev/sdf"/>
Aug 09 15:17:43 user nova-compute[72382]:   <target dev="vdb" bus="virtio"/>
Aug 09 15:17:43 user nova-compute[72382]:   <serial>eb2b70eb-a2ee-434f-86e2-badfd14fa295</serial>
Aug 09 15:17:43 user nova-compute[72382]: </disk>
Aug 09 15:17:43 user nova-compute[72382]:  {{(pid=72382) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 15:17:43 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:17:43 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cadf6f0-1cec-4999-ba5e-59b8543869e1]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:17:43 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:17:43 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.075s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:17:43 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[13007c44-ef63-4ecc-9fa2-620a93cc41bf]: (4, ('ok\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:17:43 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-08f3a80a-9765-4f12-993a-eb156d401961 tempest-AttachSCSIVolumeTestJSON-1083630769 tempest-AttachSCSIVolumeTestJSON-1083630769-project-member] Flushing IO for device /dev/sde {{(pid=72382) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 15:17:43 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:17:43 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.017s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:17:43 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f240093-8686-4ed8-a460-6a53c9518e9a]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:17:43 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-08f3a80a-9765-4f12-993a-eb156d401961 tempest-AttachSCSIVolumeTestJSON-1083630769 tempest-AttachSCSIVolumeTestJSON-1083630769-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72382) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 15:17:43 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:17:43 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.034s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:17:43 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[40ab8605-d8b4-4141-a48b-b8f0300e3c0b]: (4, ('1', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:17:43 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-08f3a80a-9765-4f12-993a-eb156d401961 tempest-AttachSCSIVolumeTestJSON-1083630769 tempest-AttachSCSIVolumeTestJSON-1083630769-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72382) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 15:17:43 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-08f3a80a-9765-4f12-993a-eb156d401961 tempest-AttachSCSIVolumeTestJSON-1083630769 tempest-AttachSCSIVolumeTestJSON-1083630769-project-member] SCSI volumes sde have been removed. {{(pid=72382) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 15:17:43 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-08f3a80a-9765-4f12-993a-eb156d401961 tempest-AttachSCSIVolumeTestJSON-1083630769 tempest-AttachSCSIVolumeTestJSON-1083630769-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a907afa8-0d60-4c8f-8bb8-711114487377')] {{(pid=72382) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 15:17:43 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a907afa8-0d60-4c8f-8bb8-711114487377 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:17:43 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a907afa8-0d60-4c8f-8bb8-711114487377 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:17:43 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eeaa814-a379-41fc-aad8-4a6c1af202d1]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:17:43 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-08f3a80a-9765-4f12-993a-eb156d401961 tempest-AttachSCSIVolumeTestJSON-1083630769 tempest-AttachSCSIVolumeTestJSON-1083630769-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:17:43 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a907afa8-0d60-4c8f-8bb8-711114487377 -p 172.16.0.220:3260 --logout {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:17:43 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:17:43 user nova-compute[72382]: DEBUG nova.compute.manager [req-53dbf880-b8dd-4eb2-baae-f634ab191889 req-8790c89b-48f5-42a8-8478-6ed1e10f5856 service nova] [instance: 23f25946-de3a-43fb-97a4-1f9a787e6e51] Received event network-vif-plugged-a67bcfee-0085-436e-8b18-1014b9b40f81 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:17:43 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-53dbf880-b8dd-4eb2-baae-f634ab191889 req-8790c89b-48f5-42a8-8478-6ed1e10f5856 service nova] Acquiring lock "23f25946-de3a-43fb-97a4-1f9a787e6e51-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:17:43 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-53dbf880-b8dd-4eb2-baae-f634ab191889 req-8790c89b-48f5-42a8-8478-6ed1e10f5856 service nova] Lock "23f25946-de3a-43fb-97a4-1f9a787e6e51-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:17:43 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-53dbf880-b8dd-4eb2-baae-f634ab191889 req-8790c89b-48f5-42a8-8478-6ed1e10f5856 service nova] Lock "23f25946-de3a-43fb-97a4-1f9a787e6e51-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:17:43 user nova-compute[72382]: DEBUG nova.compute.manager [req-53dbf880-b8dd-4eb2-baae-f634ab191889 req-8790c89b-48f5-42a8-8478-6ed1e10f5856 service nova] [instance: 23f25946-de3a-43fb-97a4-1f9a787e6e51] No waiting events found dispatching network-vif-plugged-a67bcfee-0085-436e-8b18-1014b9b40f81 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:17:43 user nova-compute[72382]: WARNING nova.compute.manager [req-53dbf880-b8dd-4eb2-baae-f634ab191889 req-8790c89b-48f5-42a8-8478-6ed1e10f5856 service nova] [instance: 23f25946-de3a-43fb-97a4-1f9a787e6e51] Received unexpected event network-vif-plugged-a67bcfee-0085-436e-8b18-1014b9b40f81 for instance with vm_state active and task_state None.
Aug 09 15:17:43 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a907afa8-0d60-4c8f-8bb8-711114487377 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:17:43 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[b70c1ce1-d912-4e34-b38d-94b068c1e4bf]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:a907afa8-0d60-4c8f-8bb8-711114487377, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:a907afa8-0d60-4c8f-8bb8-711114487377, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:17:43 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-08f3a80a-9765-4f12-993a-eb156d401961 tempest-AttachSCSIVolumeTestJSON-1083630769 tempest-AttachSCSIVolumeTestJSON-1083630769-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:a907afa8-0d60-4c8f-8bb8-711114487377, portal: 172.16.0.220,3260]
Aug 09 15:17:43 user nova-compute[72382]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:a907afa8-0d60-4c8f-8bb8-711114487377, portal: 172.16.0.220,3260] successful.
Aug 09 15:17:43 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:17:43 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a907afa8-0d60-4c8f-8bb8-711114487377 -p 172.16.0.220:3260 --op delete {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:17:43 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a907afa8-0d60-4c8f-8bb8-711114487377 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:17:43 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca1fe61a-877b-4ba7-a50d-a60743b7fda8]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:17:43 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-08f3a80a-9765-4f12-993a-eb156d401961 tempest-AttachSCSIVolumeTestJSON-1083630769 tempest-AttachSCSIVolumeTestJSON-1083630769-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:17:43 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-08f3a80a-9765-4f12-993a-eb156d401961 tempest-AttachSCSIVolumeTestJSON-1083630769 tempest-AttachSCSIVolumeTestJSON-1083630769-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.359s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 15:17:43 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-08f3a80a-9765-4f12-993a-eb156d401961 tempest-AttachSCSIVolumeTestJSON-1083630769 tempest-AttachSCSIVolumeTestJSON-1083630769-project-member] <== disconnect_volume: return (1358ms) None {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 15:17:43 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-08f3a80a-9765-4f12-993a-eb156d401961 tempest-AttachSCSIVolumeTestJSON-1083630769 tempest-AttachSCSIVolumeTestJSON-1083630769-project-member] [instance: 24b63f7a-be32-424b-b72c-d5bec43c408e] Disconnected iSCSI Volume {{(pid=72382) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 15:17:44 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-c0f6a347-ede6-413a-b46f-3c5d09a71d16 tempest-VolumesAssistedSnapshotsTest-1118703382 tempest-VolumesAssistedSnapshotsTest-1118703382-project-admin] No BDM found with device name vda, not building metadata. {{(pid=72382) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 15:17:44 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-c0f6a347-ede6-413a-b46f-3c5d09a71d16 tempest-VolumesAssistedSnapshotsTest-1118703382 tempest-VolumesAssistedSnapshotsTest-1118703382-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=72382) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 15:17:44 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-c0f6a347-ede6-413a-b46f-3c5d09a71d16 tempest-VolumesAssistedSnapshotsTest-1118703382 tempest-VolumesAssistedSnapshotsTest-1118703382-project-admin] No VIF found with MAC fa:16:3e:55:d7:da, not building metadata {{(pid=72382) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 15:17:44 user nova-compute[72382]: DEBUG nova.objects.instance [None req-08f3a80a-9765-4f12-993a-eb156d401961 tempest-AttachSCSIVolumeTestJSON-1083630769 tempest-AttachSCSIVolumeTestJSON-1083630769-project-member] Lazy-loading 'flavor' on Instance uuid 24b63f7a-be32-424b-b72c-d5bec43c408e {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:17:44 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-08f3a80a-9765-4f12-993a-eb156d401961 tempest-AttachSCSIVolumeTestJSON-1083630769 tempest-AttachSCSIVolumeTestJSON-1083630769-project-member] Lock "24b63f7a-be32-424b-b72c-d5bec43c408e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.936s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:17:44 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-c0f6a347-ede6-413a-b46f-3c5d09a71d16 tempest-VolumesAssistedSnapshotsTest-1118703382 tempest-VolumesAssistedSnapshotsTest-1118703382-project-admin] Lock "f0a7fa25-4520-4f40-9515-b88e3d2fd910" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.887s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:17:45 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e4f561ea-44ab-42ab-bc56-7238c1e648b4 tempest-AttachSCSIVolumeTestJSON-1083630769 tempest-AttachSCSIVolumeTestJSON-1083630769-project-member] Acquiring lock "24b63f7a-be32-424b-b72c-d5bec43c408e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:17:45 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e4f561ea-44ab-42ab-bc56-7238c1e648b4 tempest-AttachSCSIVolumeTestJSON-1083630769 tempest-AttachSCSIVolumeTestJSON-1083630769-project-member] Lock "24b63f7a-be32-424b-b72c-d5bec43c408e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:17:45 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e4f561ea-44ab-42ab-bc56-7238c1e648b4 tempest-AttachSCSIVolumeTestJSON-1083630769 tempest-AttachSCSIVolumeTestJSON-1083630769-project-member] Acquiring lock "24b63f7a-be32-424b-b72c-d5bec43c408e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:17:45 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e4f561ea-44ab-42ab-bc56-7238c1e648b4 tempest-AttachSCSIVolumeTestJSON-1083630769 tempest-AttachSCSIVolumeTestJSON-1083630769-project-member] Lock "24b63f7a-be32-424b-b72c-d5bec43c408e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:17:45 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e4f561ea-44ab-42ab-bc56-7238c1e648b4 tempest-AttachSCSIVolumeTestJSON-1083630769 tempest-AttachSCSIVolumeTestJSON-1083630769-project-member] Lock "24b63f7a-be32-424b-b72c-d5bec43c408e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:17:45 user nova-compute[72382]: INFO nova.compute.manager [None req-e4f561ea-44ab-42ab-bc56-7238c1e648b4 tempest-AttachSCSIVolumeTestJSON-1083630769 tempest-AttachSCSIVolumeTestJSON-1083630769-project-member] [instance: 24b63f7a-be32-424b-b72c-d5bec43c408e] Terminating instance
Aug 09 15:17:45 user nova-compute[72382]: DEBUG nova.compute.manager [None req-e4f561ea-44ab-42ab-bc56-7238c1e648b4 tempest-AttachSCSIVolumeTestJSON-1083630769 tempest-AttachSCSIVolumeTestJSON-1083630769-project-member] [instance: 24b63f7a-be32-424b-b72c-d5bec43c408e] Start destroying the instance on the hypervisor. {{(pid=72382) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 15:17:45 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:17:45 user nova-compute[72382]: DEBUG nova.compute.manager [req-4059cbef-8a68-4dbb-aaf9-ac90f78a5379 req-20b70aac-2828-4a1d-a720-bb2000a31d70 service nova] [instance: 9a82f146-97ce-4319-8b25-c1b090965e53] Received event network-changed-759df480-caa9-4610-893d-3784aaddf4b3 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:17:45 user nova-compute[72382]: DEBUG nova.compute.manager [req-4059cbef-8a68-4dbb-aaf9-ac90f78a5379 req-20b70aac-2828-4a1d-a720-bb2000a31d70 service nova] [instance: 9a82f146-97ce-4319-8b25-c1b090965e53] Refreshing instance network info cache due to event network-changed-759df480-caa9-4610-893d-3784aaddf4b3. {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 15:17:45 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-4059cbef-8a68-4dbb-aaf9-ac90f78a5379 req-20b70aac-2828-4a1d-a720-bb2000a31d70 service nova] Acquiring lock "refresh_cache-9a82f146-97ce-4319-8b25-c1b090965e53" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 15:17:45 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-4059cbef-8a68-4dbb-aaf9-ac90f78a5379 req-20b70aac-2828-4a1d-a720-bb2000a31d70 service nova] Acquired lock "refresh_cache-9a82f146-97ce-4319-8b25-c1b090965e53" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 15:17:45 user nova-compute[72382]: DEBUG nova.network.neutron [req-4059cbef-8a68-4dbb-aaf9-ac90f78a5379 req-20b70aac-2828-4a1d-a720-bb2000a31d70 service nova] [instance: 9a82f146-97ce-4319-8b25-c1b090965e53] Refreshing network info cache for port 759df480-caa9-4610-893d-3784aaddf4b3 {{(pid=72382) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 15:17:45 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:17:45 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:17:45 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:17:45 user nova-compute[72382]: DEBUG nova.compute.manager [req-b9dbb249-1036-4ad0-b56b-c286d84748e8 req-f3733dc4-aa0d-4bf7-8930-93f78dedbd21 service nova] [instance: 24b63f7a-be32-424b-b72c-d5bec43c408e] Received event network-vif-unplugged-f21a4544-6f79-47c6-8577-f5e8d2b440bd {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:17:45 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-b9dbb249-1036-4ad0-b56b-c286d84748e8 req-f3733dc4-aa0d-4bf7-8930-93f78dedbd21 service nova] Acquiring lock "24b63f7a-be32-424b-b72c-d5bec43c408e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:17:45 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-b9dbb249-1036-4ad0-b56b-c286d84748e8 req-f3733dc4-aa0d-4bf7-8930-93f78dedbd21 service nova] Lock "24b63f7a-be32-424b-b72c-d5bec43c408e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:17:45 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-b9dbb249-1036-4ad0-b56b-c286d84748e8 req-f3733dc4-aa0d-4bf7-8930-93f78dedbd21 service nova] Lock "24b63f7a-be32-424b-b72c-d5bec43c408e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:17:45 user nova-compute[72382]: DEBUG nova.compute.manager [req-b9dbb249-1036-4ad0-b56b-c286d84748e8 req-f3733dc4-aa0d-4bf7-8930-93f78dedbd21 service nova] [instance: 24b63f7a-be32-424b-b72c-d5bec43c408e] No waiting events found dispatching network-vif-unplugged-f21a4544-6f79-47c6-8577-f5e8d2b440bd {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:17:45 user nova-compute[72382]: DEBUG nova.compute.manager [req-b9dbb249-1036-4ad0-b56b-c286d84748e8 req-f3733dc4-aa0d-4bf7-8930-93f78dedbd21 service nova] [instance: 24b63f7a-be32-424b-b72c-d5bec43c408e] Received event network-vif-unplugged-f21a4544-6f79-47c6-8577-f5e8d2b440bd for instance with task_state deleting. {{(pid=72382) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 15:17:45 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-78ad1354-f860-42dc-b50c-5aacb0bf64b4 tempest-TestVolumeSwap-583684665 tempest-TestVolumeSwap-583684665-project-member] Acquiring lock "9a82f146-97ce-4319-8b25-c1b090965e53" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:17:45 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-78ad1354-f860-42dc-b50c-5aacb0bf64b4 tempest-TestVolumeSwap-583684665 tempest-TestVolumeSwap-583684665-project-member] Lock "9a82f146-97ce-4319-8b25-c1b090965e53" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:17:45 user nova-compute[72382]: DEBUG nova.objects.instance [None req-78ad1354-f860-42dc-b50c-5aacb0bf64b4 tempest-TestVolumeSwap-583684665 tempest-TestVolumeSwap-583684665-project-member] Lazy-loading 'flavor' on Instance uuid 9a82f146-97ce-4319-8b25-c1b090965e53 {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:17:45 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-78ad1354-f860-42dc-b50c-5aacb0bf64b4 tempest-TestVolumeSwap-583684665 tempest-TestVolumeSwap-583684665-project-member] Lock "9a82f146-97ce-4319-8b25-c1b090965e53" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.072s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:17:45 user nova-compute[72382]: DEBUG nova.network.neutron [req-4059cbef-8a68-4dbb-aaf9-ac90f78a5379 req-20b70aac-2828-4a1d-a720-bb2000a31d70 service nova] [instance: 9a82f146-97ce-4319-8b25-c1b090965e53] Updated VIF entry in instance network info cache for port 759df480-caa9-4610-893d-3784aaddf4b3. {{(pid=72382) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 15:17:45 user nova-compute[72382]: DEBUG nova.network.neutron [req-4059cbef-8a68-4dbb-aaf9-ac90f78a5379 req-20b70aac-2828-4a1d-a720-bb2000a31d70 service nova] [instance: 9a82f146-97ce-4319-8b25-c1b090965e53] Updating instance_info_cache with network_info: [{"id": "759df480-caa9-4610-893d-3784aaddf4b3", "address": "fa:16:3e:71:e7:dc", "network": {"id": "1cf9bb6d-ae38-4dd6-bd50-c20ff14c5ae6", "bridge": "br-int", "label": "tempest-TestVolumeSwap-488911533-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d83791b742c0403ab043a6a41c81042e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap759df480-ca", "ovs_interfaceid": "759df480-caa9-4610-893d-3784aaddf4b3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:17:45 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-4059cbef-8a68-4dbb-aaf9-ac90f78a5379 req-20b70aac-2828-4a1d-a720-bb2000a31d70 service nova] Releasing lock "refresh_cache-9a82f146-97ce-4319-8b25-c1b090965e53" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 15:17:45 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-8f26f168-7966-4ac7-8e65-ff208428730a tempest-VolumesAssistedSnapshotsTest-1118703382 tempest-VolumesAssistedSnapshotsTest-1118703382-project-admin] [instance: f0a7fa25-4520-4f40-9515-b88e3d2fd910] volume_snapshot_create: create_info: {'snapshot_id': 'a653723d-5b02-4070-853e-b15ee674e616', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=72382) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3566}}
Aug 09 15:17:46 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-78ad1354-f860-42dc-b50c-5aacb0bf64b4 tempest-TestVolumeSwap-583684665 tempest-TestVolumeSwap-583684665-project-member] Acquiring lock "9a82f146-97ce-4319-8b25-c1b090965e53" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:17:46 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-78ad1354-f860-42dc-b50c-5aacb0bf64b4 tempest-TestVolumeSwap-583684665 tempest-TestVolumeSwap-583684665-project-member] Lock "9a82f146-97ce-4319-8b25-c1b090965e53" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:17:46 user nova-compute[72382]: INFO nova.compute.manager [None req-78ad1354-f860-42dc-b50c-5aacb0bf64b4 tempest-TestVolumeSwap-583684665 tempest-TestVolumeSwap-583684665-project-member] [instance: 9a82f146-97ce-4319-8b25-c1b090965e53] Attaching volume ad1e2adc-5d1a-4718-8971-7d362e291602 to /dev/vdb
Aug 09 15:17:46 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-8f26f168-7966-4ac7-8e65-ff208428730a tempest-VolumesAssistedSnapshotsTest-1118703382 tempest-VolumesAssistedSnapshotsTest-1118703382-project-admin] [instance: f0a7fa25-4520-4f40-9515-b88e3d2fd910] snap xml: <domainsnapshot>
Aug 09 15:17:46 user nova-compute[72382]:   <disks>
Aug 09 15:17:46 user nova-compute[72382]:     <disk name="/dev/sdf" snapshot="external" type="file">
Aug 09 15:17:46 user nova-compute[72382]:       <source file="/dev/new_file"/>
Aug 09 15:17:46 user nova-compute[72382]:     </disk>
Aug 09 15:17:46 user nova-compute[72382]:     <disk name="vda" snapshot="no"/>
Aug 09 15:17:46 user nova-compute[72382]:   </disks>
Aug 09 15:17:46 user nova-compute[72382]: </domainsnapshot>
Aug 09 15:17:46 user nova-compute[72382]:  {{(pid=72382) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3507}}
Aug 09 15:17:46 user nova-compute[72382]: DEBUG nova.objects.instance [None req-8f26f168-7966-4ac7-8e65-ff208428730a tempest-VolumesAssistedSnapshotsTest-1118703382 tempest-VolumesAssistedSnapshotsTest-1118703382-project-admin] Lazy-loading 'system_metadata' on Instance uuid f0a7fa25-4520-4f40-9515-b88e3d2fd910 {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:17:46 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-8f26f168-7966-4ac7-8e65-ff208428730a tempest-VolumesAssistedSnapshotsTest-1118703382 tempest-VolumesAssistedSnapshotsTest-1118703382-project-admin] [instance: f0a7fa25-4520-4f40-9515-b88e3d2fd910] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 09 15:17:46 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:17:46 user nova-compute[72382]: ERROR nova.virt.libvirt.driver [None req-8f26f168-7966-4ac7-8e65-ff208428730a tempest-VolumesAssistedSnapshotsTest-1118703382 tempest-VolumesAssistedSnapshotsTest-1118703382-project-admin] [instance: f0a7fa25-4520-4f40-9515-b88e3d2fd910] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 09 15:17:46 user nova-compute[72382]: ERROR nova.virt.libvirt.driver [instance: f0a7fa25-4520-4f40-9515-b88e3d2fd910] Traceback (most recent call last):
Aug 09 15:17:46 user nova-compute[72382]: ERROR nova.virt.libvirt.driver [instance: f0a7fa25-4520-4f40-9515-b88e3d2fd910]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 09 15:17:46 user nova-compute[72382]: ERROR nova.virt.libvirt.driver [instance: f0a7fa25-4520-4f40-9515-b88e3d2fd910]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 09 15:17:46 user nova-compute[72382]: ERROR nova.virt.libvirt.driver [instance: f0a7fa25-4520-4f40-9515-b88e3d2fd910]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 09 15:17:46 user nova-compute[72382]: ERROR nova.virt.libvirt.driver [instance: f0a7fa25-4520-4f40-9515-b88e3d2fd910]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 09 15:17:46 user nova-compute[72382]: ERROR nova.virt.libvirt.driver [instance: f0a7fa25-4520-4f40-9515-b88e3d2fd910]   File "/usr/local/lib/python3.10/dist-packages/eventlet/tpool.py", line 193, in doit
Aug 09 15:17:46 user nova-compute[72382]: ERROR nova.virt.libvirt.driver [instance: f0a7fa25-4520-4f40-9515-b88e3d2fd910]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 09 15:17:46 user nova-compute[72382]: ERROR nova.virt.libvirt.driver [instance: f0a7fa25-4520-4f40-9515-b88e3d2fd910]   File "/usr/local/lib/python3.10/dist-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 09 15:17:46 user nova-compute[72382]: ERROR nova.virt.libvirt.driver [instance: f0a7fa25-4520-4f40-9515-b88e3d2fd910]     rv = execute(f, *args, **kwargs)
Aug 09 15:17:46 user nova-compute[72382]: ERROR nova.virt.libvirt.driver [instance: f0a7fa25-4520-4f40-9515-b88e3d2fd910]   File "/usr/local/lib/python3.10/dist-packages/eventlet/tpool.py", line 132, in execute
Aug 09 15:17:46 user nova-compute[72382]: ERROR nova.virt.libvirt.driver [instance: f0a7fa25-4520-4f40-9515-b88e3d2fd910]     six.reraise(c, e, tb)
Aug 09 15:17:46 user nova-compute[72382]: ERROR nova.virt.libvirt.driver [instance: f0a7fa25-4520-4f40-9515-b88e3d2fd910]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 09 15:17:46 user nova-compute[72382]: ERROR nova.virt.libvirt.driver [instance: f0a7fa25-4520-4f40-9515-b88e3d2fd910]     raise value
Aug 09 15:17:46 user nova-compute[72382]: ERROR nova.virt.libvirt.driver [instance: f0a7fa25-4520-4f40-9515-b88e3d2fd910]   File "/usr/local/lib/python3.10/dist-packages/eventlet/tpool.py", line 86, in tworker
Aug 09 15:17:46 user nova-compute[72382]: ERROR nova.virt.libvirt.driver [instance: f0a7fa25-4520-4f40-9515-b88e3d2fd910]     rv = meth(*args, **kwargs)
Aug 09 15:17:46 user nova-compute[72382]: ERROR nova.virt.libvirt.driver [instance: f0a7fa25-4520-4f40-9515-b88e3d2fd910]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 09 15:17:46 user nova-compute[72382]: ERROR nova.virt.libvirt.driver [instance: f0a7fa25-4520-4f40-9515-b88e3d2fd910]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 09 15:17:46 user nova-compute[72382]: ERROR nova.virt.libvirt.driver [instance: f0a7fa25-4520-4f40-9515-b88e3d2fd910] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 09 15:17:46 user nova-compute[72382]: ERROR nova.virt.libvirt.driver [instance: f0a7fa25-4520-4f40-9515-b88e3d2fd910] 
Aug 09 15:17:46 user nova-compute[72382]: ERROR nova.virt.libvirt.driver [None req-8f26f168-7966-4ac7-8e65-ff208428730a tempest-VolumesAssistedSnapshotsTest-1118703382 tempest-VolumesAssistedSnapshotsTest-1118703382-project-admin] [instance: f0a7fa25-4520-4f40-9515-b88e3d2fd910] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 09 15:17:46 user nova-compute[72382]: ERROR nova.virt.libvirt.driver [instance: f0a7fa25-4520-4f40-9515-b88e3d2fd910] Traceback (most recent call last):
Aug 09 15:17:46 user nova-compute[72382]: ERROR nova.virt.libvirt.driver [instance: f0a7fa25-4520-4f40-9515-b88e3d2fd910]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3584, in volume_snapshot_create
Aug 09 15:17:46 user nova-compute[72382]: ERROR nova.virt.libvirt.driver [instance: f0a7fa25-4520-4f40-9515-b88e3d2fd910]     self._volume_snapshot_create(context, instance, guest,
Aug 09 15:17:46 user nova-compute[72382]: ERROR nova.virt.libvirt.driver [instance: f0a7fa25-4520-4f40-9515-b88e3d2fd910]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 09 15:17:46 user nova-compute[72382]: ERROR nova.virt.libvirt.driver [instance: f0a7fa25-4520-4f40-9515-b88e3d2fd910]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 09 15:17:46 user nova-compute[72382]: ERROR nova.virt.libvirt.driver [instance: f0a7fa25-4520-4f40-9515-b88e3d2fd910]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 09 15:17:46 user nova-compute[72382]: ERROR nova.virt.libvirt.driver [instance: f0a7fa25-4520-4f40-9515-b88e3d2fd910]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 09 15:17:46 user nova-compute[72382]: ERROR nova.virt.libvirt.driver [instance: f0a7fa25-4520-4f40-9515-b88e3d2fd910]   File "/usr/local/lib/python3.10/dist-packages/eventlet/tpool.py", line 193, in doit
Aug 09 15:17:46 user nova-compute[72382]: ERROR nova.virt.libvirt.driver [instance: f0a7fa25-4520-4f40-9515-b88e3d2fd910]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 09 15:17:46 user nova-compute[72382]: ERROR nova.virt.libvirt.driver [instance: f0a7fa25-4520-4f40-9515-b88e3d2fd910]   File "/usr/local/lib/python3.10/dist-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 09 15:17:46 user nova-compute[72382]: ERROR nova.virt.libvirt.driver [instance: f0a7fa25-4520-4f40-9515-b88e3d2fd910]     rv = execute(f, *args, **kwargs)
Aug 09 15:17:46 user nova-compute[72382]: ERROR nova.virt.libvirt.driver [instance: f0a7fa25-4520-4f40-9515-b88e3d2fd910]   File "/usr/local/lib/python3.10/dist-packages/eventlet/tpool.py", line 132, in execute
Aug 09 15:17:46 user nova-compute[72382]: ERROR nova.virt.libvirt.driver [instance: f0a7fa25-4520-4f40-9515-b88e3d2fd910]     six.reraise(c, e, tb)
Aug 09 15:17:46 user nova-compute[72382]: ERROR nova.virt.libvirt.driver [instance: f0a7fa25-4520-4f40-9515-b88e3d2fd910]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 09 15:17:46 user nova-compute[72382]: ERROR nova.virt.libvirt.driver [instance: f0a7fa25-4520-4f40-9515-b88e3d2fd910]     raise value
Aug 09 15:17:46 user nova-compute[72382]: ERROR nova.virt.libvirt.driver [instance: f0a7fa25-4520-4f40-9515-b88e3d2fd910]   File "/usr/local/lib/python3.10/dist-packages/eventlet/tpool.py", line 86, in tworker
Aug 09 15:17:46 user nova-compute[72382]: ERROR nova.virt.libvirt.driver [instance: f0a7fa25-4520-4f40-9515-b88e3d2fd910]     rv = meth(*args, **kwargs)
Aug 09 15:17:46 user nova-compute[72382]: ERROR nova.virt.libvirt.driver [instance: f0a7fa25-4520-4f40-9515-b88e3d2fd910]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 09 15:17:46 user nova-compute[72382]: ERROR nova.virt.libvirt.driver [instance: f0a7fa25-4520-4f40-9515-b88e3d2fd910]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 09 15:17:46 user nova-compute[72382]: ERROR nova.virt.libvirt.driver [instance: f0a7fa25-4520-4f40-9515-b88e3d2fd910] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 09 15:17:46 user nova-compute[72382]: ERROR nova.virt.libvirt.driver [instance: f0a7fa25-4520-4f40-9515-b88e3d2fd910] 
Aug 09 15:17:46 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-8c3b138a-5514-4597-bb94-9c7d12834f22 tempest-VolumesAssistedSnapshotsTest-1118703382 tempest-VolumesAssistedSnapshotsTest-1118703382-project-admin] [instance: f0a7fa25-4520-4f40-9515-b88e3d2fd910] volume_snapshot_delete: delete_info: {'volume_id': 'eb2b70eb-a2ee-434f-86e2-badfd14fa295'} {{(pid=72382) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3667}}
Aug 09 15:17:46 user nova-compute[72382]: ERROR nova.virt.libvirt.driver [None req-8c3b138a-5514-4597-bb94-9c7d12834f22 tempest-VolumesAssistedSnapshotsTest-1118703382 tempest-VolumesAssistedSnapshotsTest-1118703382-project-admin] [instance: f0a7fa25-4520-4f40-9515-b88e3d2fd910] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type'
Aug 09 15:17:46 user nova-compute[72382]: ERROR nova.virt.libvirt.driver [instance: f0a7fa25-4520-4f40-9515-b88e3d2fd910] Traceback (most recent call last):
Aug 09 15:17:46 user nova-compute[72382]: ERROR nova.virt.libvirt.driver [instance: f0a7fa25-4520-4f40-9515-b88e3d2fd910]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3840, in volume_snapshot_delete
Aug 09 15:17:46 user nova-compute[72382]: ERROR nova.virt.libvirt.driver [instance: f0a7fa25-4520-4f40-9515-b88e3d2fd910]     self._volume_snapshot_delete(context, instance, volume_id,
Aug 09 15:17:46 user nova-compute[72382]: ERROR nova.virt.libvirt.driver [instance: f0a7fa25-4520-4f40-9515-b88e3d2fd910]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3670, in _volume_snapshot_delete
Aug 09 15:17:46 user nova-compute[72382]: ERROR nova.virt.libvirt.driver [instance: f0a7fa25-4520-4f40-9515-b88e3d2fd910]     if delete_info['type'] != 'qcow2':
Aug 09 15:17:46 user nova-compute[72382]: ERROR nova.virt.libvirt.driver [instance: f0a7fa25-4520-4f40-9515-b88e3d2fd910] KeyError: 'type'
Aug 09 15:17:46 user nova-compute[72382]: ERROR nova.virt.libvirt.driver [instance: f0a7fa25-4520-4f40-9515-b88e3d2fd910] 
Aug 09 15:17:46 user nova-compute[72382]: INFO nova.virt.libvirt.driver [-] [instance: 24b63f7a-be32-424b-b72c-d5bec43c408e] Instance destroyed successfully.
Aug 09 15:17:46 user nova-compute[72382]: DEBUG nova.objects.instance [None req-e4f561ea-44ab-42ab-bc56-7238c1e648b4 tempest-AttachSCSIVolumeTestJSON-1083630769 tempest-AttachSCSIVolumeTestJSON-1083630769-project-member] Lazy-loading 'resources' on Instance uuid 24b63f7a-be32-424b-b72c-d5bec43c408e {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:17:46 user nova-compute[72382]: DEBUG nova.virt.libvirt.vif [None req-e4f561ea-44ab-42ab-bc56-7238c1e648b4 tempest-AttachSCSIVolumeTestJSON-1083630769 tempest-AttachSCSIVolumeTestJSON-1083630769-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T15:15:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1271599526',display_name='tempest-AttachSCSIVolumeTestJSON-server-1271599526',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1271599526',id=6,image_ref='b177d706-cfc5-43a0-af20-d585b803cf65',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK/qkZ8Ev63QMbaDRtKoVhIB/B4zKrrzbWwNqmRbQUpWKNgI+nx/zypByKPNdhfyzldpCqOzD6zbm38ZLHrvJNQONRhwoe/rbduu7DVaeWIUknSst2+q72d49Ao0tjpaEg==',key_name='tempest-keypair-766974151',keypairs=<?>,launch_index=0,launched_at=2023-08-09T15:15:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f33e667025294028aa560b26d80d81a5',ramdisk_id='',reservation_id='r-qvtivipu',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b177d706-cfc5-43a0-af20-d585b803cf65',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1083630769',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1083630769-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T15:15:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='100263f546ec45938377bcbdfcf6ea0f',uuid=24b63f7a-be32-424b-b72c-d5bec43c408e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f21a4544-6f79-47c6-8577-f5e8d2b440bd", "address": "fa:16:3e:58:ca:e4", "network": {"id": "a87fbfc3-5f2b-427c-9337-e00cf40d8896", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1094857259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f33e667025294028aa560b26d80d81a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf21a4544-6f", "ovs_interfaceid": "f21a4544-6f79-47c6-8577-f5e8d2b440bd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 15:17:46 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-e4f561ea-44ab-42ab-bc56-7238c1e648b4 tempest-AttachSCSIVolumeTestJSON-1083630769 tempest-AttachSCSIVolumeTestJSON-1083630769-project-member] Converting VIF {"id": "f21a4544-6f79-47c6-8577-f5e8d2b440bd", "address": "fa:16:3e:58:ca:e4", "network": {"id": "a87fbfc3-5f2b-427c-9337-e00cf40d8896", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1094857259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f33e667025294028aa560b26d80d81a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf21a4544-6f", "ovs_interfaceid": "f21a4544-6f79-47c6-8577-f5e8d2b440bd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 15:17:46 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-e4f561ea-44ab-42ab-bc56-7238c1e648b4 tempest-AttachSCSIVolumeTestJSON-1083630769 tempest-AttachSCSIVolumeTestJSON-1083630769-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:58:ca:e4,bridge_name='br-int',has_traffic_filtering=True,id=f21a4544-6f79-47c6-8577-f5e8d2b440bd,network=Network(a87fbfc3-5f2b-427c-9337-e00cf40d8896),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf21a4544-6f') {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 15:17:46 user nova-compute[72382]: DEBUG os_vif [None req-e4f561ea-44ab-42ab-bc56-7238c1e648b4 tempest-AttachSCSIVolumeTestJSON-1083630769 tempest-AttachSCSIVolumeTestJSON-1083630769-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:58:ca:e4,bridge_name='br-int',has_traffic_filtering=True,id=f21a4544-6f79-47c6-8577-f5e8d2b440bd,network=Network(a87fbfc3-5f2b-427c-9337-e00cf40d8896),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf21a4544-6f') {{(pid=72382) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 15:17:46 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:17:46 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf21a4544-6f, bridge=br-int, if_exists=True) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:17:46 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:17:46 user nova-compute[72382]: DEBUG os_brick.utils [None req-78ad1354-f860-42dc-b50c-5aacb0bf64b4 tempest-TestVolumeSwap-583684665 tempest-TestVolumeSwap-583684665-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 15:17:46 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:17:46 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:17:46 user nova-compute[72382]: INFO os_vif [None req-e4f561ea-44ab-42ab-bc56-7238c1e648b4 tempest-AttachSCSIVolumeTestJSON-1083630769 tempest-AttachSCSIVolumeTestJSON-1083630769-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:58:ca:e4,bridge_name='br-int',has_traffic_filtering=True,id=f21a4544-6f79-47c6-8577-f5e8d2b440bd,network=Network(a87fbfc3-5f2b-427c-9337-e00cf40d8896),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf21a4544-6f')
Aug 09 15:17:46 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-e4f561ea-44ab-42ab-bc56-7238c1e648b4 tempest-AttachSCSIVolumeTestJSON-1083630769 tempest-AttachSCSIVolumeTestJSON-1083630769-project-member] [instance: 24b63f7a-be32-424b-b72c-d5bec43c408e] Deleting instance files /opt/stack/data/nova/instances/24b63f7a-be32-424b-b72c-d5bec43c408e_del
Aug 09 15:17:46 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-e4f561ea-44ab-42ab-bc56-7238c1e648b4 tempest-AttachSCSIVolumeTestJSON-1083630769 tempest-AttachSCSIVolumeTestJSON-1083630769-project-member] [instance: 24b63f7a-be32-424b-b72c-d5bec43c408e] Deletion of /opt/stack/data/nova/instances/24b63f7a-be32-424b-b72c-d5bec43c408e_del complete
Aug 09 15:17:46 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:17:46 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c778a98-ae76-4d00-a27b-66a1027a0f1c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d2cfa7015fe\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:17:46 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:17:46 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:17:46 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8bce5d1-269a-4df6-84d9-358a5e36f805]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:17:46 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:17:46 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:17:46 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[38210023-6bfe-4d3c-90c0-4fdd539c2553]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:17:46 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[09bcf327-af10-429c-9a25-9775905cf9db]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:17:46 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-78ad1354-f860-42dc-b50c-5aacb0bf64b4 tempest-TestVolumeSwap-583684665 tempest-TestVolumeSwap-583684665-project-member] Running cmd (subprocess): nvme version {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:17:46 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-78ad1354-f860-42dc-b50c-5aacb0bf64b4 tempest-TestVolumeSwap-583684665 tempest-TestVolumeSwap-583684665-project-member] 'nvme version' failed. Not Retrying. {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 15:17:46 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.nvmeof [None req-78ad1354-f860-42dc-b50c-5aacb0bf64b4 tempest-TestVolumeSwap-583684665 tempest-TestVolumeSwap-583684665-project-member] nvme not present on system {{(pid=72382) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 15:17:46 user nova-compute[72382]: ERROR nova.virt.libvirt.driver [None req-8f26f168-7966-4ac7-8e65-ff208428730a tempest-VolumesAssistedSnapshotsTest-1118703382 tempest-VolumesAssistedSnapshotsTest-1118703382-project-admin] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot a653723d-5b02-4070-853e-b15ee674e616 could not be found.
Aug 09 15:17:46 user nova-compute[72382]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 09 15:17:46 user nova-compute[72382]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3584, in volume_snapshot_create
Aug 09 15:17:46 user nova-compute[72382]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_create(context, instance, guest,
Aug 09 15:17:46 user nova-compute[72382]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 09 15:17:46 user nova-compute[72382]: ERROR nova.virt.libvirt.driver     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 09 15:17:46 user nova-compute[72382]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 09 15:17:46 user nova-compute[72382]: ERROR nova.virt.libvirt.driver     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 09 15:17:46 user nova-compute[72382]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/eventlet/tpool.py", line 193, in doit
Aug 09 15:17:46 user nova-compute[72382]: ERROR nova.virt.libvirt.driver     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 09 15:17:46 user nova-compute[72382]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 09 15:17:46 user nova-compute[72382]: ERROR nova.virt.libvirt.driver     rv = execute(f, *args, **kwargs)
Aug 09 15:17:46 user nova-compute[72382]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/eventlet/tpool.py", line 132, in execute
Aug 09 15:17:46 user nova-compute[72382]: ERROR nova.virt.libvirt.driver     six.reraise(c, e, tb)
Aug 09 15:17:46 user nova-compute[72382]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 09 15:17:46 user nova-compute[72382]: ERROR nova.virt.libvirt.driver     raise value
Aug 09 15:17:46 user nova-compute[72382]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/eventlet/tpool.py", line 86, in tworker
Aug 09 15:17:46 user nova-compute[72382]: ERROR nova.virt.libvirt.driver     rv = meth(*args, **kwargs)
Aug 09 15:17:46 user nova-compute[72382]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 09 15:17:46 user nova-compute[72382]: ERROR nova.virt.libvirt.driver     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 09 15:17:46 user nova-compute[72382]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 09 15:17:46 user nova-compute[72382]: ERROR nova.virt.libvirt.driver 
Aug 09 15:17:46 user nova-compute[72382]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 09 15:17:46 user nova-compute[72382]: ERROR nova.virt.libvirt.driver 
Aug 09 15:17:46 user nova-compute[72382]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 09 15:17:46 user nova-compute[72382]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 09 15:17:46 user nova-compute[72382]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 09 15:17:46 user nova-compute[72382]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 09 15:17:46 user nova-compute[72382]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 09 15:17:46 user nova-compute[72382]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 09 15:17:46 user nova-compute[72382]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 09 15:17:46 user nova-compute[72382]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 09 15:17:46 user nova-compute[72382]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 09 15:17:46 user nova-compute[72382]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 223, in post
Aug 09 15:17:46 user nova-compute[72382]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 09 15:17:46 user nova-compute[72382]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request
Aug 09 15:17:46 user nova-compute[72382]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 09 15:17:46 user nova-compute[72382]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request
Aug 09 15:17:46 user nova-compute[72382]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 09 15:17:46 user nova-compute[72382]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot a653723d-5b02-4070-853e-b15ee674e616 could not be found. (HTTP 404) (Request-ID: req-a354a44e-97ff-4f70-bd84-3845fb5973c8)
Aug 09 15:17:46 user nova-compute[72382]: ERROR nova.virt.libvirt.driver 
Aug 09 15:17:46 user nova-compute[72382]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 09 15:17:46 user nova-compute[72382]: ERROR nova.virt.libvirt.driver 
Aug 09 15:17:46 user nova-compute[72382]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 09 15:17:46 user nova-compute[72382]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3406, in _volume_snapshot_update_status
Aug 09 15:17:46 user nova-compute[72382]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Aug 09 15:17:46 user nova-compute[72382]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Aug 09 15:17:46 user nova-compute[72382]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Aug 09 15:17:46 user nova-compute[72382]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Aug 09 15:17:46 user nova-compute[72382]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Aug 09 15:17:46 user nova-compute[72382]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Aug 09 15:17:46 user nova-compute[72382]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Aug 09 15:17:46 user nova-compute[72382]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 09 15:17:46 user nova-compute[72382]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 09 15:17:46 user nova-compute[72382]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 09 15:17:46 user nova-compute[72382]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 09 15:17:46 user nova-compute[72382]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 09 15:17:46 user nova-compute[72382]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 09 15:17:46 user nova-compute[72382]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 09 15:17:46 user nova-compute[72382]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 09 15:17:46 user nova-compute[72382]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 223, in post
Aug 09 15:17:46 user nova-compute[72382]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 09 15:17:46 user nova-compute[72382]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request
Aug 09 15:17:46 user nova-compute[72382]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 09 15:17:46 user nova-compute[72382]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request
Aug 09 15:17:46 user nova-compute[72382]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 09 15:17:46 user nova-compute[72382]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot a653723d-5b02-4070-853e-b15ee674e616 could not be found.
Aug 09 15:17:46 user nova-compute[72382]: ERROR nova.virt.libvirt.driver 
Aug 09 15:17:46 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:17:46 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 15:17:46 user nova-compute[72382]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 15:17:46 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[72e9a0e2-48bc-4626-9917-35bc71167736]: (4, '') {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:17:46 user nova-compute[72382]: ERROR nova.virt.libvirt.driver [None req-8c3b138a-5514-4597-bb94-9c7d12834f22 tempest-VolumesAssistedSnapshotsTest-1118703382 tempest-VolumesAssistedSnapshotsTest-1118703382-project-admin] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found.
Aug 09 15:17:46 user nova-compute[72382]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 09 15:17:46 user nova-compute[72382]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3840, in volume_snapshot_delete
Aug 09 15:17:46 user nova-compute[72382]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_delete(context, instance, volume_id,
Aug 09 15:17:46 user nova-compute[72382]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3670, in _volume_snapshot_delete
Aug 09 15:17:46 user nova-compute[72382]: ERROR nova.virt.libvirt.driver     if delete_info['type'] != 'qcow2':
Aug 09 15:17:46 user nova-compute[72382]: ERROR nova.virt.libvirt.driver KeyError: 'type'
Aug 09 15:17:46 user nova-compute[72382]: ERROR nova.virt.libvirt.driver 
Aug 09 15:17:46 user nova-compute[72382]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 09 15:17:46 user nova-compute[72382]: ERROR nova.virt.libvirt.driver 
Aug 09 15:17:46 user nova-compute[72382]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 09 15:17:46 user nova-compute[72382]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 09 15:17:46 user nova-compute[72382]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 09 15:17:46 user nova-compute[72382]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 09 15:17:46 user nova-compute[72382]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 09 15:17:46 user nova-compute[72382]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 09 15:17:46 user nova-compute[72382]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 09 15:17:46 user nova-compute[72382]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 09 15:17:46 user nova-compute[72382]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 09 15:17:46 user nova-compute[72382]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 223, in post
Aug 09 15:17:46 user nova-compute[72382]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 09 15:17:46 user nova-compute[72382]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request
Aug 09 15:17:46 user nova-compute[72382]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 09 15:17:46 user nova-compute[72382]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request
Aug 09 15:17:46 user nova-compute[72382]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 09 15:17:46 user nova-compute[72382]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-d6205c83-cf69-434b-a25f-13e659485355)
Aug 09 15:17:46 user nova-compute[72382]: ERROR nova.virt.libvirt.driver 
Aug 09 15:17:46 user nova-compute[72382]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 09 15:17:46 user nova-compute[72382]: ERROR nova.virt.libvirt.driver 
Aug 09 15:17:46 user nova-compute[72382]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 09 15:17:46 user nova-compute[72382]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3406, in _volume_snapshot_update_status
Aug 09 15:17:46 user nova-compute[72382]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Aug 09 15:17:46 user nova-compute[72382]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Aug 09 15:17:46 user nova-compute[72382]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Aug 09 15:17:46 user nova-compute[72382]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Aug 09 15:17:46 user nova-compute[72382]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Aug 09 15:17:46 user nova-compute[72382]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Aug 09 15:17:46 user nova-compute[72382]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Aug 09 15:17:46 user nova-compute[72382]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 09 15:17:46 user nova-compute[72382]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 09 15:17:46 user nova-compute[72382]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 09 15:17:46 user nova-compute[72382]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 09 15:17:46 user nova-compute[72382]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 09 15:17:46 user nova-compute[72382]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 09 15:17:46 user nova-compute[72382]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 09 15:17:46 user nova-compute[72382]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 09 15:17:46 user nova-compute[72382]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 223, in post
Aug 09 15:17:46 user nova-compute[72382]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 09 15:17:46 user nova-compute[72382]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request
Aug 09 15:17:46 user nova-compute[72382]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 09 15:17:46 user nova-compute[72382]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request
Aug 09 15:17:46 user nova-compute[72382]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 09 15:17:46 user nova-compute[72382]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found.
Aug 09 15:17:46 user nova-compute[72382]: ERROR nova.virt.libvirt.driver 
Aug 09 15:17:46 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.lightos [None req-78ad1354-f860-42dc-b50c-5aacb0bf64b4 tempest-TestVolumeSwap-583684665 tempest-TestVolumeSwap-583684665-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72382) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 15:17:46 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.lightos [None req-78ad1354-f860-42dc-b50c-5aacb0bf64b4 tempest-TestVolumeSwap-583684665 tempest-TestVolumeSwap-583684665-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72382) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 15:17:46 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.lightos [None req-78ad1354-f860-42dc-b50c-5aacb0bf64b4 tempest-TestVolumeSwap-583684665 tempest-TestVolumeSwap-583684665-project-member] LIGHTOS: no hostnqn found. {{(pid=72382) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 15:17:46 user nova-compute[72382]: DEBUG os_brick.utils [None req-78ad1354-f860-42dc-b50c-5aacb0bf64b4 tempest-TestVolumeSwap-583684665 tempest-TestVolumeSwap-583684665-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d2cfa7015fe', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 15:17:46 user nova-compute[72382]: DEBUG nova.virt.block_device [None req-78ad1354-f860-42dc-b50c-5aacb0bf64b4 tempest-TestVolumeSwap-583684665 tempest-TestVolumeSwap-583684665-project-member] [instance: 9a82f146-97ce-4319-8b25-c1b090965e53] Updating existing volume attachment record: 31d7842e-2379-4f02-b311-0e7e52705e4c {{(pid=72382) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 15:17:46 user nova-compute[72382]: INFO nova.compute.manager [None req-e4f561ea-44ab-42ab-bc56-7238c1e648b4 tempest-AttachSCSIVolumeTestJSON-1083630769 tempest-AttachSCSIVolumeTestJSON-1083630769-project-member] [instance: 24b63f7a-be32-424b-b72c-d5bec43c408e] Took 1.03 seconds to destroy the instance on the hypervisor.
Aug 09 15:17:46 user nova-compute[72382]: DEBUG oslo.service.loopingcall [None req-e4f561ea-44ab-42ab-bc56-7238c1e648b4 tempest-AttachSCSIVolumeTestJSON-1083630769 tempest-AttachSCSIVolumeTestJSON-1083630769-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72382) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 15:17:46 user nova-compute[72382]: ERROR oslo_messaging.rpc.server [None req-8f26f168-7966-4ac7-8e65-ff208428730a tempest-VolumesAssistedSnapshotsTest-1118703382 tempest-VolumesAssistedSnapshotsTest-1118703382-project-admin] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 09 15:17:46 user nova-compute[72382]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Aug 09 15:17:46 user nova-compute[72382]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Aug 09 15:17:46 user nova-compute[72382]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Aug 09 15:17:46 user nova-compute[72382]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Aug 09 15:17:46 user nova-compute[72382]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Aug 09 15:17:46 user nova-compute[72382]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Aug 09 15:17:46 user nova-compute[72382]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Aug 09 15:17:46 user nova-compute[72382]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 244, in inner
Aug 09 15:17:46 user nova-compute[72382]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Aug 09 15:17:46 user nova-compute[72382]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Aug 09 15:17:46 user nova-compute[72382]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 09 15:17:46 user nova-compute[72382]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 09 15:17:46 user nova-compute[72382]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 09 15:17:46 user nova-compute[72382]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 09 15:17:46 user nova-compute[72382]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 09 15:17:46 user nova-compute[72382]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Aug 09 15:17:46 user nova-compute[72382]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Aug 09 15:17:46 user nova-compute[72382]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4425, in volume_snapshot_create
Aug 09 15:17:46 user nova-compute[72382]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_create(context, instance, volume_id,
Aug 09 15:17:46 user nova-compute[72382]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3587, in volume_snapshot_create
Aug 09 15:17:46 user nova-compute[72382]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 09 15:17:46 user nova-compute[72382]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 09 15:17:46 user nova-compute[72382]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 09 15:17:46 user nova-compute[72382]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 09 15:17:46 user nova-compute[72382]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 09 15:17:46 user nova-compute[72382]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3584, in volume_snapshot_create
Aug 09 15:17:46 user nova-compute[72382]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_create(context, instance, guest,
Aug 09 15:17:46 user nova-compute[72382]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 09 15:17:46 user nova-compute[72382]: ERROR oslo_messaging.rpc.server     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 09 15:17:46 user nova-compute[72382]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 09 15:17:46 user nova-compute[72382]: ERROR oslo_messaging.rpc.server     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 09 15:17:46 user nova-compute[72382]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/eventlet/tpool.py", line 193, in doit
Aug 09 15:17:46 user nova-compute[72382]: ERROR oslo_messaging.rpc.server     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 09 15:17:46 user nova-compute[72382]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 09 15:17:46 user nova-compute[72382]: ERROR oslo_messaging.rpc.server     rv = execute(f, *args, **kwargs)
Aug 09 15:17:46 user nova-compute[72382]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/eventlet/tpool.py", line 132, in execute
Aug 09 15:17:46 user nova-compute[72382]: ERROR oslo_messaging.rpc.server     six.reraise(c, e, tb)
Aug 09 15:17:46 user nova-compute[72382]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 09 15:17:46 user nova-compute[72382]: ERROR oslo_messaging.rpc.server     raise value
Aug 09 15:17:46 user nova-compute[72382]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/eventlet/tpool.py", line 86, in tworker
Aug 09 15:17:46 user nova-compute[72382]: ERROR oslo_messaging.rpc.server     rv = meth(*args, **kwargs)
Aug 09 15:17:46 user nova-compute[72382]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 09 15:17:46 user nova-compute[72382]: ERROR oslo_messaging.rpc.server     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 09 15:17:46 user nova-compute[72382]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 09 15:17:46 user nova-compute[72382]: ERROR oslo_messaging.rpc.server 
Aug 09 15:17:46 user nova-compute[72382]: DEBUG nova.compute.manager [-] [instance: 24b63f7a-be32-424b-b72c-d5bec43c408e] Deallocating network for instance {{(pid=72382) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 15:17:46 user nova-compute[72382]: DEBUG nova.network.neutron [-] [instance: 24b63f7a-be32-424b-b72c-d5bec43c408e] deallocate_for_instance() {{(pid=72382) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 15:17:46 user nova-compute[72382]: ERROR oslo_messaging.rpc.server [None req-8c3b138a-5514-4597-bb94-9c7d12834f22 tempest-VolumesAssistedSnapshotsTest-1118703382 tempest-VolumesAssistedSnapshotsTest-1118703382-project-admin] Exception during message handling: KeyError: 'type'
Aug 09 15:17:46 user nova-compute[72382]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Aug 09 15:17:46 user nova-compute[72382]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Aug 09 15:17:46 user nova-compute[72382]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Aug 09 15:17:46 user nova-compute[72382]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Aug 09 15:17:46 user nova-compute[72382]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Aug 09 15:17:46 user nova-compute[72382]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Aug 09 15:17:46 user nova-compute[72382]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Aug 09 15:17:46 user nova-compute[72382]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 244, in inner
Aug 09 15:17:46 user nova-compute[72382]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Aug 09 15:17:46 user nova-compute[72382]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Aug 09 15:17:46 user nova-compute[72382]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 09 15:17:46 user nova-compute[72382]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 09 15:17:46 user nova-compute[72382]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 09 15:17:46 user nova-compute[72382]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 09 15:17:46 user nova-compute[72382]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 09 15:17:46 user nova-compute[72382]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Aug 09 15:17:46 user nova-compute[72382]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Aug 09 15:17:46 user nova-compute[72382]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4437, in volume_snapshot_delete
Aug 09 15:17:46 user nova-compute[72382]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_delete(context, instance, volume_id,
Aug 09 15:17:46 user nova-compute[72382]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3843, in volume_snapshot_delete
Aug 09 15:17:46 user nova-compute[72382]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 09 15:17:46 user nova-compute[72382]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 09 15:17:46 user nova-compute[72382]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 09 15:17:46 user nova-compute[72382]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 09 15:17:46 user nova-compute[72382]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 09 15:17:46 user nova-compute[72382]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3840, in volume_snapshot_delete
Aug 09 15:17:46 user nova-compute[72382]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_delete(context, instance, volume_id,
Aug 09 15:17:46 user nova-compute[72382]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3670, in _volume_snapshot_delete
Aug 09 15:17:46 user nova-compute[72382]: ERROR oslo_messaging.rpc.server     if delete_info['type'] != 'qcow2':
Aug 09 15:17:46 user nova-compute[72382]: ERROR oslo_messaging.rpc.server KeyError: 'type'
Aug 09 15:17:46 user nova-compute[72382]: ERROR oslo_messaging.rpc.server 
Aug 09 15:17:47 user nova-compute[72382]: DEBUG nova.compute.manager [req-5a5925d0-81f9-4ac4-ae56-18b1c3f10877 req-fe1c10b0-19ee-4f15-bd46-f3de8123c956 service nova] [instance: 24b63f7a-be32-424b-b72c-d5bec43c408e] Received event network-vif-plugged-f21a4544-6f79-47c6-8577-f5e8d2b440bd {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:17:47 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-5a5925d0-81f9-4ac4-ae56-18b1c3f10877 req-fe1c10b0-19ee-4f15-bd46-f3de8123c956 service nova] Acquiring lock "24b63f7a-be32-424b-b72c-d5bec43c408e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:17:47 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-5a5925d0-81f9-4ac4-ae56-18b1c3f10877 req-fe1c10b0-19ee-4f15-bd46-f3de8123c956 service nova] Lock "24b63f7a-be32-424b-b72c-d5bec43c408e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:17:47 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-5a5925d0-81f9-4ac4-ae56-18b1c3f10877 req-fe1c10b0-19ee-4f15-bd46-f3de8123c956 service nova] Lock "24b63f7a-be32-424b-b72c-d5bec43c408e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:17:47 user nova-compute[72382]: DEBUG nova.compute.manager [req-5a5925d0-81f9-4ac4-ae56-18b1c3f10877 req-fe1c10b0-19ee-4f15-bd46-f3de8123c956 service nova] [instance: 24b63f7a-be32-424b-b72c-d5bec43c408e] No waiting events found dispatching network-vif-plugged-f21a4544-6f79-47c6-8577-f5e8d2b440bd {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:17:47 user nova-compute[72382]: WARNING nova.compute.manager [req-5a5925d0-81f9-4ac4-ae56-18b1c3f10877 req-fe1c10b0-19ee-4f15-bd46-f3de8123c956 service nova] [instance: 24b63f7a-be32-424b-b72c-d5bec43c408e] Received unexpected event network-vif-plugged-f21a4544-6f79-47c6-8577-f5e8d2b440bd for instance with vm_state active and task_state deleting.
Aug 09 15:17:47 user nova-compute[72382]: DEBUG nova.network.neutron [-] [instance: 24b63f7a-be32-424b-b72c-d5bec43c408e] Updating instance_info_cache with network_info: [] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:17:47 user nova-compute[72382]: INFO nova.compute.manager [-] [instance: 24b63f7a-be32-424b-b72c-d5bec43c408e] Took 1.50 seconds to deallocate network for instance.
Aug 09 15:17:47 user nova-compute[72382]: DEBUG nova.compute.manager [req-5b39e59d-c3a9-41e2-bea2-89fbb7120a8e req-46184fc4-2854-48f0-ba66-990c2facdce6 service nova] [instance: 24b63f7a-be32-424b-b72c-d5bec43c408e] Received event network-vif-deleted-f21a4544-6f79-47c6-8577-f5e8d2b440bd {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:17:47 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e4f561ea-44ab-42ab-bc56-7238c1e648b4 tempest-AttachSCSIVolumeTestJSON-1083630769 tempest-AttachSCSIVolumeTestJSON-1083630769-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:17:47 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e4f561ea-44ab-42ab-bc56-7238c1e648b4 tempest-AttachSCSIVolumeTestJSON-1083630769 tempest-AttachSCSIVolumeTestJSON-1083630769-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:17:48 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4d5794d4-655b-42a7-b0cc-3f10f4c5400f tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] [instance: a33515b3-3ef4-4f76-a8d8-e7008b5bbb79] Calling os-brick to attach iSCSI Volume {{(pid=72382) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 15:17:48 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d5794d4-655b-42a7-b0cc-3f10f4c5400f tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2a0c768340>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:21e1540c-408d-44a5-893c-892d0e91eb01'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pLtOTdXi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 15:17:48 user nova-compute[72382]: WARNING os_brick.initiator.connectors.base [None req-4d5794d4-655b-42a7-b0cc-3f10f4c5400f tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 15:17:48 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-4d5794d4-655b-42a7-b0cc-3f10f4c5400f tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 15:17:48 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-4d5794d4-655b-42a7-b0cc-3f10f4c5400f tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 15:17:48 user nova-compute[72382]: WARNING os_brick.initiator.connectors.base [None req-4d5794d4-655b-42a7-b0cc-3f10f4c5400f tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 15:17:48 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-4d5794d4-655b-42a7-b0cc-3f10f4c5400f tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:21e1540c-408d-44a5-893c-892d0e91eb01" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 15:17:48 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-4d5794d4-655b-42a7-b0cc-3f10f4c5400f tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:21e1540c-408d-44a5-893c-892d0e91eb01" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 15:17:48 user nova-compute[72382]: INFO os_brick.initiator.connectors.iscsi [None req-4d5794d4-655b-42a7-b0cc-3f10f4c5400f tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 15:17:48 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21e1540c-408d-44a5-893c-892d0e91eb01 -p 172.16.0.220:3260 {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:17:48 user nova-compute[72382]: DEBUG nova.compute.provider_tree [None req-e4f561ea-44ab-42ab-bc56-7238c1e648b4 tempest-AttachSCSIVolumeTestJSON-1083630769 tempest-AttachSCSIVolumeTestJSON-1083630769-project-member] Inventory has not changed in ProviderTree for provider: 7b15b0e5-df4d-49db-833b-2855d21d10ae {{(pid=72382) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 15:17:48 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21e1540c-408d-44a5-893c-892d0e91eb01 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:17:48 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f7d3035-ce9f-463e-aebc-f070f6959421]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:17:48 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d5794d4-655b-42a7-b0cc-3f10f4c5400f tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 15:17:48 user nova-compute[72382]:  {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:17:48 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21e1540c-408d-44a5-893c-892d0e91eb01 -p 172.16.0.220:3260 --interface default --op new {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:17:48 user nova-compute[72382]: DEBUG nova.scheduler.client.report [None req-e4f561ea-44ab-42ab-bc56-7238c1e648b4 tempest-AttachSCSIVolumeTestJSON-1083630769 tempest-AttachSCSIVolumeTestJSON-1083630769-project-member] Inventory has not changed for provider 7b15b0e5-df4d-49db-833b-2855d21d10ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72382) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 15:17:48 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21e1540c-408d-44a5-893c-892d0e91eb01 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:17:48 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[95acc705-0625-4ac5-a213-e683125dd588]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:21e1540c-408d-44a5-893c-892d0e91eb01] added\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:17:48 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d5794d4-655b-42a7-b0cc-3f10f4c5400f tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:21e1540c-408d-44a5-893c-892d0e91eb01] added
Aug 09 15:17:48 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:17:48 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21e1540c-408d-44a5-893c-892d0e91eb01 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:17:48 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e4f561ea-44ab-42ab-bc56-7238c1e648b4 tempest-AttachSCSIVolumeTestJSON-1083630769 tempest-AttachSCSIVolumeTestJSON-1083630769-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.448s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:17:48 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21e1540c-408d-44a5-893c-892d0e91eb01 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:17:48 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2e10dc2-bf4f-41e2-9e55-5438b7142624]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:17:48 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-7d9ad3be-4a3a-4194-baae-3de669f166c4 tempest-VolumesAssistedSnapshotsTest-1118703382 tempest-VolumesAssistedSnapshotsTest-1118703382-project-admin] Acquiring lock "f0a7fa25-4520-4f40-9515-b88e3d2fd910" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:17:48 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-7d9ad3be-4a3a-4194-baae-3de669f166c4 tempest-VolumesAssistedSnapshotsTest-1118703382 tempest-VolumesAssistedSnapshotsTest-1118703382-project-admin] Lock "f0a7fa25-4520-4f40-9515-b88e3d2fd910" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:17:48 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d5794d4-655b-42a7-b0cc-3f10f4c5400f tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:17:48 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21e1540c-408d-44a5-893c-892d0e91eb01 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:17:48 user nova-compute[72382]: INFO nova.compute.manager [None req-7d9ad3be-4a3a-4194-baae-3de669f166c4 tempest-VolumesAssistedSnapshotsTest-1118703382 tempest-VolumesAssistedSnapshotsTest-1118703382-project-admin] [instance: f0a7fa25-4520-4f40-9515-b88e3d2fd910] Detaching volume eb2b70eb-a2ee-434f-86e2-badfd14fa295
Aug 09 15:17:48 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21e1540c-408d-44a5-893c-892d0e91eb01 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:17:48 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb3fd9df-8e9e-488b-97e0-45b7d171c36c]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:17:48 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d5794d4-655b-42a7-b0cc-3f10f4c5400f tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:17:48 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21e1540c-408d-44a5-893c-892d0e91eb01 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pLtOTdXi {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:17:48 user nova-compute[72382]: INFO nova.scheduler.client.report [None req-e4f561ea-44ab-42ab-bc56-7238c1e648b4 tempest-AttachSCSIVolumeTestJSON-1083630769 tempest-AttachSCSIVolumeTestJSON-1083630769-project-member] Deleted allocations for instance 24b63f7a-be32-424b-b72c-d5bec43c408e
Aug 09 15:17:48 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21e1540c-408d-44a5-893c-892d0e91eb01 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pLtOTdXi" returned: 0 in 0.022s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:17:48 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[15460c2c-a6b8-4a5a-abe0-21a61d8e72f6]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:17:48 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d5794d4-655b-42a7-b0cc-3f10f4c5400f tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pLtOTdXi'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:17:48 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21e1540c-408d-44a5-893c-892d0e91eb01 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:17:48 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21e1540c-408d-44a5-893c-892d0e91eb01 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:17:48 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0970bfa-14bc-48a6-8e27-78e9d4b3d33e]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:17:48 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d5794d4-655b-42a7-b0cc-3f10f4c5400f tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:17:48 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:17:48 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:17:48 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[682e825d-0a1a-466f-8ed2-81d098941a9d]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2267629-52cf-439c-9083-3e8384c67f08 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a13916f-1416-4b94-9e10-96f9e6415753 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16ef1023-88b6-4e22-9b4b-45515b25ca9b (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb2b70eb-a2ee-434f-86e2-badfd14fa295 (non-flash)\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:17:48 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d5794d4-655b-42a7-b0cc-3f10f4c5400f tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2267629-52cf-439c-9083-3e8384c67f08 (non-flash)
Aug 09 15:17:48 user nova-compute[72382]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a13916f-1416-4b94-9e10-96f9e6415753 (non-flash)
Aug 09 15:17:48 user nova-compute[72382]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16ef1023-88b6-4e22-9b4b-45515b25ca9b (non-flash)
Aug 09 15:17:48 user nova-compute[72382]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb2b70eb-a2ee-434f-86e2-badfd14fa295 (non-flash)
Aug 09 15:17:48 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 15:17:48 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d5794d4-655b-42a7-b0cc-3f10f4c5400f tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2267629-52cf-439c-9083-3e8384c67f08 (non-flash)
Aug 09 15:17:48 user nova-compute[72382]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a13916f-1416-4b94-9e10-96f9e6415753 (non-flash)
Aug 09 15:17:48 user nova-compute[72382]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16ef1023-88b6-4e22-9b4b-45515b25ca9b (non-flash)
Aug 09 15:17:48 user nova-compute[72382]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb2b70eb-a2ee-434f-86e2-badfd14fa295 (non-flash)
Aug 09 15:17:48 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 15:17:48 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21e1540c-408d-44a5-893c-892d0e91eb01 -p 172.16.0.220:3260 --login {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:17:48 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e4f561ea-44ab-42ab-bc56-7238c1e648b4 tempest-AttachSCSIVolumeTestJSON-1083630769 tempest-AttachSCSIVolumeTestJSON-1083630769-project-member] Lock "24b63f7a-be32-424b-b72c-d5bec43c408e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.229s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:17:48 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21e1540c-408d-44a5-893c-892d0e91eb01 -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:17:48 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[91a3c3b5-a226-4e70-a6d8-6aeabd0fb16f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:21e1540c-408d-44a5-893c-892d0e91eb01, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:21e1540c-408d-44a5-893c-892d0e91eb01, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:17:48 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d5794d4-655b-42a7-b0cc-3f10f4c5400f tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:21e1540c-408d-44a5-893c-892d0e91eb01, portal: 172.16.0.220,3260]
Aug 09 15:17:48 user nova-compute[72382]: Login to [iface: default, target: iqn.2010-10.org.openstack:21e1540c-408d-44a5-893c-892d0e91eb01, portal: 172.16.0.220,3260] successful.
Aug 09 15:17:48 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:17:48 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21e1540c-408d-44a5-893c-892d0e91eb01 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:17:48 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21e1540c-408d-44a5-893c-892d0e91eb01 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:17:48 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[facfb2b4-2fe8-4d43-9b86-5db54e857b89]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:17:48 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d5794d4-655b-42a7-b0cc-3f10f4c5400f tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:17:48 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:17:48 user nova-compute[72382]: INFO nova.virt.block_device [None req-7d9ad3be-4a3a-4194-baae-3de669f166c4 tempest-VolumesAssistedSnapshotsTest-1118703382 tempest-VolumesAssistedSnapshotsTest-1118703382-project-admin] [instance: f0a7fa25-4520-4f40-9515-b88e3d2fd910] Attempting to driver detach volume eb2b70eb-a2ee-434f-86e2-badfd14fa295 from mountpoint /dev/vdb
Aug 09 15:17:48 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:17:48 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[7501cdcb-e7e3-4ecf-9f04-58314bb6430e]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2267629-52cf-439c-9083-3e8384c67f08 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a13916f-1416-4b94-9e10-96f9e6415753 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16ef1023-88b6-4e22-9b4b-45515b25ca9b (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb2b70eb-a2ee-434f-86e2-badfd14fa295 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21e1540c-408d-44a5-893c-892d0e91eb01 (non-flash)\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:17:48 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d5794d4-655b-42a7-b0cc-3f10f4c5400f tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2267629-52cf-439c-9083-3e8384c67f08 (non-flash)
Aug 09 15:17:48 user nova-compute[72382]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a13916f-1416-4b94-9e10-96f9e6415753 (non-flash)
Aug 09 15:17:48 user nova-compute[72382]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16ef1023-88b6-4e22-9b4b-45515b25ca9b (non-flash)
Aug 09 15:17:48 user nova-compute[72382]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb2b70eb-a2ee-434f-86e2-badfd14fa295 (non-flash)
Aug 09 15:17:48 user nova-compute[72382]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21e1540c-408d-44a5-893c-892d0e91eb01 (non-flash)
Aug 09 15:17:48 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 15:17:48 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d5794d4-655b-42a7-b0cc-3f10f4c5400f tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2267629-52cf-439c-9083-3e8384c67f08 (non-flash)
Aug 09 15:17:48 user nova-compute[72382]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a13916f-1416-4b94-9e10-96f9e6415753 (non-flash)
Aug 09 15:17:48 user nova-compute[72382]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16ef1023-88b6-4e22-9b4b-45515b25ca9b (non-flash)
Aug 09 15:17:48 user nova-compute[72382]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb2b70eb-a2ee-434f-86e2-badfd14fa295 (non-flash)
Aug 09 15:17:48 user nova-compute[72382]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21e1540c-408d-44a5-893c-892d0e91eb01 (non-flash)
Aug 09 15:17:48 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 15:17:48 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-4d5794d4-655b-42a7-b0cc-3f10f4c5400f tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:21e1540c-408d-44a5-893c-892d0e91eb01" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.317s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 15:17:48 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d5794d4-655b-42a7-b0cc-3f10f4c5400f tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] Connected to 172.16.0.220:3260 {{(pid=72382) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 15:17:48 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-4d5794d4-655b-42a7-b0cc-3f10f4c5400f tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] HCTL ('36', '-', '-', 0) found on session 7 with lun 0 {{(pid=72382) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 15:17:48 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-4d5794d4-655b-42a7-b0cc-3f10f4c5400f tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72382) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 15:17:48 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:17:48 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-7d9ad3be-4a3a-4194-baae-3de669f166c4 tempest-VolumesAssistedSnapshotsTest-1118703382 tempest-VolumesAssistedSnapshotsTest-1118703382-project-admin] Attempting to detach device vdb from instance f0a7fa25-4520-4f40-9515-b88e3d2fd910 from the persistent domain config. {{(pid=72382) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 15:17:48 user nova-compute[72382]: DEBUG nova.virt.libvirt.guest [None req-7d9ad3be-4a3a-4194-baae-3de669f166c4 tempest-VolumesAssistedSnapshotsTest-1118703382 tempest-VolumesAssistedSnapshotsTest-1118703382-project-admin] detach device xml: <disk type="block" device="disk">
Aug 09 15:17:48 user nova-compute[72382]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 15:17:48 user nova-compute[72382]:   <source dev="/dev/sdf"/>
Aug 09 15:17:48 user nova-compute[72382]:   <target dev="vdb" bus="virtio"/>
Aug 09 15:17:48 user nova-compute[72382]:   <serial>eb2b70eb-a2ee-434f-86e2-badfd14fa295</serial>
Aug 09 15:17:48 user nova-compute[72382]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 15:17:48 user nova-compute[72382]: </disk>
Aug 09 15:17:48 user nova-compute[72382]:  {{(pid=72382) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 15:17:48 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-7d9ad3be-4a3a-4194-baae-3de669f166c4 tempest-VolumesAssistedSnapshotsTest-1118703382 tempest-VolumesAssistedSnapshotsTest-1118703382-project-admin] Successfully detached device vdb from instance f0a7fa25-4520-4f40-9515-b88e3d2fd910 from the persistent domain config.
Aug 09 15:17:48 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-7d9ad3be-4a3a-4194-baae-3de669f166c4 tempest-VolumesAssistedSnapshotsTest-1118703382 tempest-VolumesAssistedSnapshotsTest-1118703382-project-admin] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f0a7fa25-4520-4f40-9515-b88e3d2fd910 from the live domain config. {{(pid=72382) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 15:17:48 user nova-compute[72382]: DEBUG nova.virt.libvirt.guest [None req-7d9ad3be-4a3a-4194-baae-3de669f166c4 tempest-VolumesAssistedSnapshotsTest-1118703382 tempest-VolumesAssistedSnapshotsTest-1118703382-project-admin] detach device xml: <disk type="block" device="disk">
Aug 09 15:17:48 user nova-compute[72382]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 15:17:48 user nova-compute[72382]:   <source dev="/dev/sdf"/>
Aug 09 15:17:48 user nova-compute[72382]:   <target dev="vdb" bus="virtio"/>
Aug 09 15:17:48 user nova-compute[72382]:   <serial>eb2b70eb-a2ee-434f-86e2-badfd14fa295</serial>
Aug 09 15:17:48 user nova-compute[72382]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 15:17:48 user nova-compute[72382]: </disk>
Aug 09 15:17:48 user nova-compute[72382]:  {{(pid=72382) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 15:17:48 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:17:48 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f54a991-93a9-4f1b-ac7e-bf3f9a69581c]: (4, ('- - 0', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:17:48 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-4d5794d4-655b-42a7-b0cc-3f10f4c5400f tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] Searching for a device in session 7 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72382) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 15:17:48 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d5794d4-655b-42a7-b0cc-3f10f4c5400f tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pLtOTdXi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72382) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 15:17:48 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:17:49 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Received event <DeviceRemovedEvent: 1691594269.105073, f0a7fa25-4520-4f40-9515-b88e3d2fd910 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72382) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 15:17:49 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-7d9ad3be-4a3a-4194-baae-3de669f166c4 tempest-VolumesAssistedSnapshotsTest-1118703382 tempest-VolumesAssistedSnapshotsTest-1118703382-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f0a7fa25-4520-4f40-9515-b88e3d2fd910 {{(pid=72382) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 15:17:49 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-7d9ad3be-4a3a-4194-baae-3de669f166c4 tempest-VolumesAssistedSnapshotsTest-1118703382 tempest-VolumesAssistedSnapshotsTest-1118703382-project-admin] Successfully detached device vdb from instance f0a7fa25-4520-4f40-9515-b88e3d2fd910 from the live domain config.
Aug 09 15:17:49 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7d9ad3be-4a3a-4194-baae-3de669f166c4 tempest-VolumesAssistedSnapshotsTest-1118703382 tempest-VolumesAssistedSnapshotsTest-1118703382-project-admin] [instance: f0a7fa25-4520-4f40-9515-b88e3d2fd910] calling os-brick to detach iSCSI Volume {{(pid=72382) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 15:17:49 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d9ad3be-4a3a-4194-baae-3de669f166c4 tempest-VolumesAssistedSnapshotsTest-1118703382 tempest-VolumesAssistedSnapshotsTest-1118703382-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2a0c768340>, {'target_iqns': ['iqn.2010-10.org.openstack:eb2b70eb-a2ee-434f-86e2-badfd14fa295'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'URQtoeuF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 15:17:49 user nova-compute[72382]: WARNING os_brick.initiator.connectors.base [None req-7d9ad3be-4a3a-4194-baae-3de669f166c4 tempest-VolumesAssistedSnapshotsTest-1118703382 tempest-VolumesAssistedSnapshotsTest-1118703382-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 15:17:49 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-7d9ad3be-4a3a-4194-baae-3de669f166c4 tempest-VolumesAssistedSnapshotsTest-1118703382 tempest-VolumesAssistedSnapshotsTest-1118703382-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 15:17:49 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-4d5794d4-655b-42a7-b0cc-3f10f4c5400f tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.352s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 15:17:49 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d5794d4-655b-42a7-b0cc-3f10f4c5400f tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] <== connect_volume: return (1353ms) {'type': 'block', 'scsi_wwn': '23233613861616333', 'path': '/dev/sde'} {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 15:17:49 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4d5794d4-655b-42a7-b0cc-3f10f4c5400f tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] [instance: a33515b3-3ef4-4f76-a8d8-e7008b5bbb79] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23233613861616333', 'path': '/dev/sde'} {{(pid=72382) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 15:17:49 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-7d9ad3be-4a3a-4194-baae-3de669f166c4 tempest-VolumesAssistedSnapshotsTest-1118703382 tempest-VolumesAssistedSnapshotsTest-1118703382-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.525s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 15:17:49 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d9ad3be-4a3a-4194-baae-3de669f166c4 tempest-VolumesAssistedSnapshotsTest-1118703382 tempest-VolumesAssistedSnapshotsTest-1118703382-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eb2b70eb-a2ee-434f-86e2-badfd14fa295', 0)] {{(pid=72382) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 15:17:49 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:17:49 user nova-compute[72382]: DEBUG nova.objects.instance [None req-4d5794d4-655b-42a7-b0cc-3f10f4c5400f tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] Lazy-loading 'flavor' on Instance uuid a33515b3-3ef4-4f76-a8d8-e7008b5bbb79 {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:17:49 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:17:49 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[50ce1f4e-c2da-40d0-87d7-1656330508e0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:16ef1023-88b6-4e22-9b4b-45515b25ca9b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:21e1540c-408d-44a5-893c-892d0e91eb01\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5a13916f-1416-4b94-9e10-96f9e6415753\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e2267629-52cf-439c-9083-3e8384c67f08\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eb2b70eb-a2ee-434f-86e2-badfd14fa295\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:17:49 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:17:49 user nova-compute[72382]: DEBUG nova.virt.libvirt.guest [None req-4d5794d4-655b-42a7-b0cc-3f10f4c5400f tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 15:17:49 user nova-compute[72382]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 15:17:49 user nova-compute[72382]:   <source dev="/dev/sde"/>
Aug 09 15:17:49 user nova-compute[72382]:   <target dev="vdb" bus="virtio"/>
Aug 09 15:17:49 user nova-compute[72382]:   <serial>21e1540c-408d-44a5-893c-892d0e91eb01</serial>
Aug 09 15:17:49 user nova-compute[72382]: </disk>
Aug 09 15:17:49 user nova-compute[72382]:  {{(pid=72382) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 15:17:49 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:17:49 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[057c825b-12e8-4200-998e-ee430a382cde]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2267629-52cf-439c-9083-3e8384c67f08 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a13916f-1416-4b94-9e10-96f9e6415753 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16ef1023-88b6-4e22-9b4b-45515b25ca9b (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb2b70eb-a2ee-434f-86e2-badfd14fa295 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21e1540c-408d-44a5-893c-892d0e91eb01 (non-flash)\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:17:49 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d9ad3be-4a3a-4194-baae-3de669f166c4 tempest-VolumesAssistedSnapshotsTest-1118703382 tempest-VolumesAssistedSnapshotsTest-1118703382-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2267629-52cf-439c-9083-3e8384c67f08 (non-flash)
Aug 09 15:17:49 user nova-compute[72382]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a13916f-1416-4b94-9e10-96f9e6415753 (non-flash)
Aug 09 15:17:49 user nova-compute[72382]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16ef1023-88b6-4e22-9b4b-45515b25ca9b (non-flash)
Aug 09 15:17:49 user nova-compute[72382]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb2b70eb-a2ee-434f-86e2-badfd14fa295 (non-flash)
Aug 09 15:17:49 user nova-compute[72382]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21e1540c-408d-44a5-893c-892d0e91eb01 (non-flash)
Aug 09 15:17:49 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 15:17:49 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d9ad3be-4a3a-4194-baae-3de669f166c4 tempest-VolumesAssistedSnapshotsTest-1118703382 tempest-VolumesAssistedSnapshotsTest-1118703382-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2267629-52cf-439c-9083-3e8384c67f08 (non-flash)
Aug 09 15:17:49 user nova-compute[72382]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a13916f-1416-4b94-9e10-96f9e6415753 (non-flash)
Aug 09 15:17:49 user nova-compute[72382]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16ef1023-88b6-4e22-9b4b-45515b25ca9b (non-flash)
Aug 09 15:17:49 user nova-compute[72382]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb2b70eb-a2ee-434f-86e2-badfd14fa295 (non-flash)
Aug 09 15:17:49 user nova-compute[72382]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21e1540c-408d-44a5-893c-892d0e91eb01 (non-flash)
Aug 09 15:17:49 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 15:17:49 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d9ad3be-4a3a-4194-baae-3de669f166c4 tempest-VolumesAssistedSnapshotsTest-1118703382 tempest-VolumesAssistedSnapshotsTest-1118703382-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2a0c31fc70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eb2b70eb-a2ee-434f-86e2-badfd14fa295'): ({'sdf'}, set())}) {{(pid=72382) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 15:17:49 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-7d9ad3be-4a3a-4194-baae-3de669f166c4 tempest-VolumesAssistedSnapshotsTest-1118703382 tempest-VolumesAssistedSnapshotsTest-1118703382-project-admin] Removing single pathed devices sdf {{(pid=72382) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 15:17:49 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:17:49 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:17:49 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6cd0c1f-62bc-40e2-acae-22388afeb48d]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:17:49 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:17:49 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:17:49 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[6df6ae19-a622-4df2-984e-295d6a48d9f3]: (4, ('ok\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:17:49 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-7d9ad3be-4a3a-4194-baae-3de669f166c4 tempest-VolumesAssistedSnapshotsTest-1118703382 tempest-VolumesAssistedSnapshotsTest-1118703382-project-admin] Flushing IO for device /dev/sdf {{(pid=72382) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 15:17:49 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:17:49 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:17:49 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[10fbf124-6949-485c-a6e0-3bd606dbe8b4]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:17:49 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-7d9ad3be-4a3a-4194-baae-3de669f166c4 tempest-VolumesAssistedSnapshotsTest-1118703382 tempest-VolumesAssistedSnapshotsTest-1118703382-project-admin] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=72382) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 15:17:49 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:17:49 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.039s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:17:49 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[f886a51e-268c-4754-9607-3942ad6a6ad0]: (4, ('1', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:17:49 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-7d9ad3be-4a3a-4194-baae-3de669f166c4 tempest-VolumesAssistedSnapshotsTest-1118703382 tempest-VolumesAssistedSnapshotsTest-1118703382-project-admin] Checking to see if SCSI volumes sdf have been removed. {{(pid=72382) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 15:17:49 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-7d9ad3be-4a3a-4194-baae-3de669f166c4 tempest-VolumesAssistedSnapshotsTest-1118703382 tempest-VolumesAssistedSnapshotsTest-1118703382-project-admin] SCSI volumes sdf have been removed. {{(pid=72382) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 15:17:49 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d9ad3be-4a3a-4194-baae-3de669f166c4 tempest-VolumesAssistedSnapshotsTest-1118703382 tempest-VolumesAssistedSnapshotsTest-1118703382-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eb2b70eb-a2ee-434f-86e2-badfd14fa295')] {{(pid=72382) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 15:17:49 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb2b70eb-a2ee-434f-86e2-badfd14fa295 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:17:49 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb2b70eb-a2ee-434f-86e2-badfd14fa295 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:17:49 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[a050bbf8-97a0-473f-bd7a-78f947a05009]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:17:49 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d9ad3be-4a3a-4194-baae-3de669f166c4 tempest-VolumesAssistedSnapshotsTest-1118703382 tempest-VolumesAssistedSnapshotsTest-1118703382-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:17:49 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb2b70eb-a2ee-434f-86e2-badfd14fa295 -p 172.16.0.220:3260 --logout {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:17:49 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb2b70eb-a2ee-434f-86e2-badfd14fa295 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:17:49 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdfaa718-2066-4f37-994b-bce6232cd765]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:eb2b70eb-a2ee-434f-86e2-badfd14fa295, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:eb2b70eb-a2ee-434f-86e2-badfd14fa295, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:17:49 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d9ad3be-4a3a-4194-baae-3de669f166c4 tempest-VolumesAssistedSnapshotsTest-1118703382 tempest-VolumesAssistedSnapshotsTest-1118703382-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:eb2b70eb-a2ee-434f-86e2-badfd14fa295, portal: 172.16.0.220,3260]
Aug 09 15:17:49 user nova-compute[72382]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:eb2b70eb-a2ee-434f-86e2-badfd14fa295, portal: 172.16.0.220,3260] successful.
Aug 09 15:17:49 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:17:49 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb2b70eb-a2ee-434f-86e2-badfd14fa295 -p 172.16.0.220:3260 --op delete {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:17:49 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb2b70eb-a2ee-434f-86e2-badfd14fa295 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:17:49 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[63a5e7fe-e2f2-46db-958a-367959e27981]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:17:49 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d9ad3be-4a3a-4194-baae-3de669f166c4 tempest-VolumesAssistedSnapshotsTest-1118703382 tempest-VolumesAssistedSnapshotsTest-1118703382-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:17:49 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-7d9ad3be-4a3a-4194-baae-3de669f166c4 tempest-VolumesAssistedSnapshotsTest-1118703382 tempest-VolumesAssistedSnapshotsTest-1118703382-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.284s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 15:17:49 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d9ad3be-4a3a-4194-baae-3de669f166c4 tempest-VolumesAssistedSnapshotsTest-1118703382 tempest-VolumesAssistedSnapshotsTest-1118703382-project-admin] <== disconnect_volume: return (809ms) None {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 15:17:49 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7d9ad3be-4a3a-4194-baae-3de669f166c4 tempest-VolumesAssistedSnapshotsTest-1118703382 tempest-VolumesAssistedSnapshotsTest-1118703382-project-admin] [instance: f0a7fa25-4520-4f40-9515-b88e3d2fd910] Disconnected iSCSI Volume {{(pid=72382) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 15:17:50 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-4d5794d4-655b-42a7-b0cc-3f10f4c5400f tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] No BDM found with device name vda, not building metadata. {{(pid=72382) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 15:17:50 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-4d5794d4-655b-42a7-b0cc-3f10f4c5400f tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72382) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 15:17:50 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-4d5794d4-655b-42a7-b0cc-3f10f4c5400f tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] No VIF found with MAC fa:16:3e:e9:da:b6, not building metadata {{(pid=72382) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 15:17:50 user nova-compute[72382]: DEBUG nova.objects.instance [None req-7d9ad3be-4a3a-4194-baae-3de669f166c4 tempest-VolumesAssistedSnapshotsTest-1118703382 tempest-VolumesAssistedSnapshotsTest-1118703382-project-admin] Lazy-loading 'flavor' on Instance uuid f0a7fa25-4520-4f40-9515-b88e3d2fd910 {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:17:50 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-7d9ad3be-4a3a-4194-baae-3de669f166c4 tempest-VolumesAssistedSnapshotsTest-1118703382 tempest-VolumesAssistedSnapshotsTest-1118703382-project-admin] Lock "f0a7fa25-4520-4f40-9515-b88e3d2fd910" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.494s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:17:50 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-4d5794d4-655b-42a7-b0cc-3f10f4c5400f tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] Lock "a33515b3-3ef4-4f76-a8d8-e7008b5bbb79" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.602s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:17:51 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:17:51 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-d2bf6bc0-c9cb-4e7f-b391-3a0ea28a550d tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] Acquiring lock "a33515b3-3ef4-4f76-a8d8-e7008b5bbb79" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:17:51 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-d2bf6bc0-c9cb-4e7f-b391-3a0ea28a550d tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] Lock "a33515b3-3ef4-4f76-a8d8-e7008b5bbb79" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:17:51 user nova-compute[72382]: INFO nova.compute.manager [None req-d2bf6bc0-c9cb-4e7f-b391-3a0ea28a550d tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] [instance: a33515b3-3ef4-4f76-a8d8-e7008b5bbb79] Detaching volume 21e1540c-408d-44a5-893c-892d0e91eb01
Aug 09 15:17:51 user nova-compute[72382]: INFO nova.virt.block_device [None req-d2bf6bc0-c9cb-4e7f-b391-3a0ea28a550d tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] [instance: a33515b3-3ef4-4f76-a8d8-e7008b5bbb79] Attempting to driver detach volume 21e1540c-408d-44a5-893c-892d0e91eb01 from mountpoint /dev/vdb
Aug 09 15:17:51 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-d2bf6bc0-c9cb-4e7f-b391-3a0ea28a550d tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] Attempting to detach device vdb from instance a33515b3-3ef4-4f76-a8d8-e7008b5bbb79 from the persistent domain config. {{(pid=72382) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 15:17:51 user nova-compute[72382]: DEBUG nova.virt.libvirt.guest [None req-d2bf6bc0-c9cb-4e7f-b391-3a0ea28a550d tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 15:17:51 user nova-compute[72382]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 15:17:51 user nova-compute[72382]:   <source dev="/dev/sde"/>
Aug 09 15:17:51 user nova-compute[72382]:   <target dev="vdb" bus="virtio"/>
Aug 09 15:17:51 user nova-compute[72382]:   <serial>21e1540c-408d-44a5-893c-892d0e91eb01</serial>
Aug 09 15:17:51 user nova-compute[72382]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 15:17:51 user nova-compute[72382]: </disk>
Aug 09 15:17:51 user nova-compute[72382]:  {{(pid=72382) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 15:17:51 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-d2bf6bc0-c9cb-4e7f-b391-3a0ea28a550d tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] Successfully detached device vdb from instance a33515b3-3ef4-4f76-a8d8-e7008b5bbb79 from the persistent domain config.
Aug 09 15:17:51 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-d2bf6bc0-c9cb-4e7f-b391-3a0ea28a550d tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a33515b3-3ef4-4f76-a8d8-e7008b5bbb79 from the live domain config. {{(pid=72382) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 15:17:51 user nova-compute[72382]: DEBUG nova.virt.libvirt.guest [None req-d2bf6bc0-c9cb-4e7f-b391-3a0ea28a550d tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 15:17:51 user nova-compute[72382]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 15:17:51 user nova-compute[72382]:   <source dev="/dev/sde"/>
Aug 09 15:17:51 user nova-compute[72382]:   <target dev="vdb" bus="virtio"/>
Aug 09 15:17:51 user nova-compute[72382]:   <serial>21e1540c-408d-44a5-893c-892d0e91eb01</serial>
Aug 09 15:17:51 user nova-compute[72382]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 15:17:51 user nova-compute[72382]: </disk>
Aug 09 15:17:51 user nova-compute[72382]:  {{(pid=72382) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 15:17:52 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-13577d43-df39-42bb-8f2e-da94464f07aa tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] [instance: 23f25946-de3a-43fb-97a4-1f9a787e6e51] Calling os-brick to attach iSCSI Volume {{(pid=72382) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 15:17:52 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-13577d43-df39-42bb-8f2e-da94464f07aa tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2a0c768340>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:9489f8bc-3805-45bd-adfa-7d42f629184a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zjftpNbH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 15:17:52 user nova-compute[72382]: WARNING os_brick.initiator.connectors.base [None req-13577d43-df39-42bb-8f2e-da94464f07aa tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 15:17:52 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-13577d43-df39-42bb-8f2e-da94464f07aa tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 15:17:52 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-13577d43-df39-42bb-8f2e-da94464f07aa tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 15:17:52 user nova-compute[72382]: WARNING os_brick.initiator.connectors.base [None req-13577d43-df39-42bb-8f2e-da94464f07aa tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 15:17:52 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-13577d43-df39-42bb-8f2e-da94464f07aa tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9489f8bc-3805-45bd-adfa-7d42f629184a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 15:17:52 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-13577d43-df39-42bb-8f2e-da94464f07aa tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9489f8bc-3805-45bd-adfa-7d42f629184a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 15:17:52 user nova-compute[72382]: INFO os_brick.initiator.connectors.iscsi [None req-13577d43-df39-42bb-8f2e-da94464f07aa tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 15:17:52 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9489f8bc-3805-45bd-adfa-7d42f629184a -p 172.16.0.220:3260 {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:17:52 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9489f8bc-3805-45bd-adfa-7d42f629184a -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:17:52 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[a93013a1-8f94-4dcf-923f-11601dd91c7a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:17:52 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-13577d43-df39-42bb-8f2e-da94464f07aa tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 15:17:52 user nova-compute[72382]:  {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:17:52 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9489f8bc-3805-45bd-adfa-7d42f629184a -p 172.16.0.220:3260 --interface default --op new {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:17:52 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9489f8bc-3805-45bd-adfa-7d42f629184a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:17:52 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[53a27f0b-c416-42c9-98ab-9547bb8da485]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9489f8bc-3805-45bd-adfa-7d42f629184a] added\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:17:52 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-13577d43-df39-42bb-8f2e-da94464f07aa tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9489f8bc-3805-45bd-adfa-7d42f629184a] added
Aug 09 15:17:52 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:17:52 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9489f8bc-3805-45bd-adfa-7d42f629184a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:17:52 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9489f8bc-3805-45bd-adfa-7d42f629184a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:17:52 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a13849f-aa3a-4b34-936e-b9639fc24831]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:17:52 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-13577d43-df39-42bb-8f2e-da94464f07aa tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:17:52 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9489f8bc-3805-45bd-adfa-7d42f629184a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:17:52 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9489f8bc-3805-45bd-adfa-7d42f629184a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:17:52 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[046b207d-0324-481e-bd18-d82b64aac135]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:17:52 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-13577d43-df39-42bb-8f2e-da94464f07aa tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:17:52 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9489f8bc-3805-45bd-adfa-7d42f629184a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zjftpNbH {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:17:52 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9489f8bc-3805-45bd-adfa-7d42f629184a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zjftpNbH" returned: 0 in 0.018s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:17:52 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[35277eab-8d56-4c4b-925d-095504dc36da]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:17:52 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-13577d43-df39-42bb-8f2e-da94464f07aa tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zjftpNbH'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:17:52 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9489f8bc-3805-45bd-adfa-7d42f629184a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:17:52 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9489f8bc-3805-45bd-adfa-7d42f629184a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:17:52 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[bece6e75-54d4-4a27-a751-1cedc3a085bb]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:17:52 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-13577d43-df39-42bb-8f2e-da94464f07aa tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:17:52 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:17:52 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:17:52 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0e7a220-9b50-4ccb-98be-473d912b1fba]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2267629-52cf-439c-9083-3e8384c67f08 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a13916f-1416-4b94-9e10-96f9e6415753 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16ef1023-88b6-4e22-9b4b-45515b25ca9b (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21e1540c-408d-44a5-893c-892d0e91eb01 (non-flash)\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:17:52 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-13577d43-df39-42bb-8f2e-da94464f07aa tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2267629-52cf-439c-9083-3e8384c67f08 (non-flash)
Aug 09 15:17:52 user nova-compute[72382]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a13916f-1416-4b94-9e10-96f9e6415753 (non-flash)
Aug 09 15:17:52 user nova-compute[72382]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16ef1023-88b6-4e22-9b4b-45515b25ca9b (non-flash)
Aug 09 15:17:52 user nova-compute[72382]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21e1540c-408d-44a5-893c-892d0e91eb01 (non-flash)
Aug 09 15:17:52 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 15:17:52 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-13577d43-df39-42bb-8f2e-da94464f07aa tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2267629-52cf-439c-9083-3e8384c67f08 (non-flash)
Aug 09 15:17:52 user nova-compute[72382]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a13916f-1416-4b94-9e10-96f9e6415753 (non-flash)
Aug 09 15:17:52 user nova-compute[72382]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16ef1023-88b6-4e22-9b4b-45515b25ca9b (non-flash)
Aug 09 15:17:52 user nova-compute[72382]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21e1540c-408d-44a5-893c-892d0e91eb01 (non-flash)
Aug 09 15:17:52 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 15:17:52 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9489f8bc-3805-45bd-adfa-7d42f629184a -p 172.16.0.220:3260 --login {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:17:52 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Received event <DeviceRemovedEvent: 1691594272.3709028, a33515b3-3ef4-4f76-a8d8-e7008b5bbb79 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72382) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 15:17:52 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-d2bf6bc0-c9cb-4e7f-b391-3a0ea28a550d tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a33515b3-3ef4-4f76-a8d8-e7008b5bbb79 {{(pid=72382) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 15:17:52 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-d2bf6bc0-c9cb-4e7f-b391-3a0ea28a550d tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] Successfully detached device vdb from instance a33515b3-3ef4-4f76-a8d8-e7008b5bbb79 from the live domain config.
Aug 09 15:17:52 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d2bf6bc0-c9cb-4e7f-b391-3a0ea28a550d tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] [instance: a33515b3-3ef4-4f76-a8d8-e7008b5bbb79] calling os-brick to detach iSCSI Volume {{(pid=72382) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 15:17:52 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2bf6bc0-c9cb-4e7f-b391-3a0ea28a550d tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2a0c768340>, {'target_iqns': ['iqn.2010-10.org.openstack:21e1540c-408d-44a5-893c-892d0e91eb01'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pLtOTdXi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 15:17:52 user nova-compute[72382]: WARNING os_brick.initiator.connectors.base [None req-d2bf6bc0-c9cb-4e7f-b391-3a0ea28a550d tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 15:17:52 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-d2bf6bc0-c9cb-4e7f-b391-3a0ea28a550d tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 15:17:52 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9489f8bc-3805-45bd-adfa-7d42f629184a -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:17:52 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[24ba793e-713b-4fd8-a662-c4f8627cd0e7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9489f8bc-3805-45bd-adfa-7d42f629184a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9489f8bc-3805-45bd-adfa-7d42f629184a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:17:52 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-13577d43-df39-42bb-8f2e-da94464f07aa tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9489f8bc-3805-45bd-adfa-7d42f629184a, portal: 172.16.0.220,3260]
Aug 09 15:17:52 user nova-compute[72382]: Login to [iface: default, target: iqn.2010-10.org.openstack:9489f8bc-3805-45bd-adfa-7d42f629184a, portal: 172.16.0.220,3260] successful.
Aug 09 15:17:52 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:17:52 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9489f8bc-3805-45bd-adfa-7d42f629184a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:17:52 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9489f8bc-3805-45bd-adfa-7d42f629184a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:17:52 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[240c2f4c-c2e0-46f3-ada0-878f9b88000f]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:17:52 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-13577d43-df39-42bb-8f2e-da94464f07aa tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:17:52 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:17:52 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:17:52 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[6164c379-8c7b-490c-9beb-b98e366ce64b]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2267629-52cf-439c-9083-3e8384c67f08 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a13916f-1416-4b94-9e10-96f9e6415753 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16ef1023-88b6-4e22-9b4b-45515b25ca9b (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21e1540c-408d-44a5-893c-892d0e91eb01 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9489f8bc-3805-45bd-adfa-7d42f629184a (non-flash)\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:17:52 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-13577d43-df39-42bb-8f2e-da94464f07aa tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2267629-52cf-439c-9083-3e8384c67f08 (non-flash)
Aug 09 15:17:52 user nova-compute[72382]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a13916f-1416-4b94-9e10-96f9e6415753 (non-flash)
Aug 09 15:17:52 user nova-compute[72382]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16ef1023-88b6-4e22-9b4b-45515b25ca9b (non-flash)
Aug 09 15:17:52 user nova-compute[72382]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21e1540c-408d-44a5-893c-892d0e91eb01 (non-flash)
Aug 09 15:17:52 user nova-compute[72382]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9489f8bc-3805-45bd-adfa-7d42f629184a (non-flash)
Aug 09 15:17:52 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 15:17:52 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-13577d43-df39-42bb-8f2e-da94464f07aa tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2267629-52cf-439c-9083-3e8384c67f08 (non-flash)
Aug 09 15:17:52 user nova-compute[72382]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a13916f-1416-4b94-9e10-96f9e6415753 (non-flash)
Aug 09 15:17:52 user nova-compute[72382]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16ef1023-88b6-4e22-9b4b-45515b25ca9b (non-flash)
Aug 09 15:17:52 user nova-compute[72382]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21e1540c-408d-44a5-893c-892d0e91eb01 (non-flash)
Aug 09 15:17:52 user nova-compute[72382]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9489f8bc-3805-45bd-adfa-7d42f629184a (non-flash)
Aug 09 15:17:52 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 15:17:52 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-13577d43-df39-42bb-8f2e-da94464f07aa tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9489f8bc-3805-45bd-adfa-7d42f629184a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.288s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 15:17:52 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-13577d43-df39-42bb-8f2e-da94464f07aa tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] Connected to 172.16.0.220:3260 {{(pid=72382) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 15:17:52 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-13577d43-df39-42bb-8f2e-da94464f07aa tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] HCTL ('37', '-', '-', 0) found on session 8 with lun 0 {{(pid=72382) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 15:17:52 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-13577d43-df39-42bb-8f2e-da94464f07aa tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=72382) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 15:17:52 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:17:52 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.016s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:17:52 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[7282bc14-fc10-4fc7-9446-029543c40982]: (4, ('- - 0', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:17:52 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-13577d43-df39-42bb-8f2e-da94464f07aa tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] Searching for a device in session 8 and hctl ['37', '*', '*', 0] yield: None {{(pid=72382) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 15:17:53 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-13577d43-df39-42bb-8f2e-da94464f07aa tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] Searching for a device in session 8 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=72382) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 15:17:53 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-13577d43-df39-42bb-8f2e-da94464f07aa tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zjftpNbH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72382) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 15:17:53 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-13577d43-df39-42bb-8f2e-da94464f07aa tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.319s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 15:17:53 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-13577d43-df39-42bb-8f2e-da94464f07aa tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] <== connect_volume: return (1321ms) {'type': 'block', 'scsi_wwn': '23263613361323164', 'path': '/dev/sdf'} {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 15:17:53 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-13577d43-df39-42bb-8f2e-da94464f07aa tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] [instance: 23f25946-de3a-43fb-97a4-1f9a787e6e51] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23263613361323164', 'path': '/dev/sdf'} {{(pid=72382) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 15:17:53 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-d2bf6bc0-c9cb-4e7f-b391-3a0ea28a550d tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.135s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 15:17:53 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2bf6bc0-c9cb-4e7f-b391-3a0ea28a550d tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:21e1540c-408d-44a5-893c-892d0e91eb01', 0)] {{(pid=72382) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 15:17:53 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:17:53 user nova-compute[72382]: DEBUG nova.objects.instance [None req-13577d43-df39-42bb-8f2e-da94464f07aa tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] Lazy-loading 'flavor' on Instance uuid 23f25946-de3a-43fb-97a4-1f9a787e6e51 {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:17:53 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:17:53 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a094639-c1a5-4821-a4a2-263d4ab3366e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:16ef1023-88b6-4e22-9b4b-45515b25ca9b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:21e1540c-408d-44a5-893c-892d0e91eb01\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5a13916f-1416-4b94-9e10-96f9e6415753\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9489f8bc-3805-45bd-adfa-7d42f629184a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e2267629-52cf-439c-9083-3e8384c67f08\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:17:53 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:17:53 user nova-compute[72382]: DEBUG nova.virt.libvirt.guest [None req-13577d43-df39-42bb-8f2e-da94464f07aa tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 15:17:53 user nova-compute[72382]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 15:17:53 user nova-compute[72382]:   <source dev="/dev/sdf"/>
Aug 09 15:17:53 user nova-compute[72382]:   <target dev="vdb" bus="virtio"/>
Aug 09 15:17:53 user nova-compute[72382]:   <serial>9489f8bc-3805-45bd-adfa-7d42f629184a</serial>
Aug 09 15:17:53 user nova-compute[72382]: </disk>
Aug 09 15:17:53 user nova-compute[72382]:  {{(pid=72382) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 15:17:53 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:17:53 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[509911ab-370d-43c0-bd04-942a93087001]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2267629-52cf-439c-9083-3e8384c67f08 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a13916f-1416-4b94-9e10-96f9e6415753 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16ef1023-88b6-4e22-9b4b-45515b25ca9b (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21e1540c-408d-44a5-893c-892d0e91eb01 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9489f8bc-3805-45bd-adfa-7d42f629184a (non-flash)\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:17:53 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2bf6bc0-c9cb-4e7f-b391-3a0ea28a550d tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2267629-52cf-439c-9083-3e8384c67f08 (non-flash)
Aug 09 15:17:53 user nova-compute[72382]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a13916f-1416-4b94-9e10-96f9e6415753 (non-flash)
Aug 09 15:17:53 user nova-compute[72382]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16ef1023-88b6-4e22-9b4b-45515b25ca9b (non-flash)
Aug 09 15:17:53 user nova-compute[72382]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21e1540c-408d-44a5-893c-892d0e91eb01 (non-flash)
Aug 09 15:17:53 user nova-compute[72382]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9489f8bc-3805-45bd-adfa-7d42f629184a (non-flash)
Aug 09 15:17:53 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 15:17:53 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2bf6bc0-c9cb-4e7f-b391-3a0ea28a550d tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2267629-52cf-439c-9083-3e8384c67f08 (non-flash)
Aug 09 15:17:53 user nova-compute[72382]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a13916f-1416-4b94-9e10-96f9e6415753 (non-flash)
Aug 09 15:17:53 user nova-compute[72382]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16ef1023-88b6-4e22-9b4b-45515b25ca9b (non-flash)
Aug 09 15:17:53 user nova-compute[72382]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21e1540c-408d-44a5-893c-892d0e91eb01 (non-flash)
Aug 09 15:17:53 user nova-compute[72382]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9489f8bc-3805-45bd-adfa-7d42f629184a (non-flash)
Aug 09 15:17:53 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 15:17:53 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2bf6bc0-c9cb-4e7f-b391-3a0ea28a550d tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2a0c33d2d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:21e1540c-408d-44a5-893c-892d0e91eb01'): ({'sde'}, set())}) {{(pid=72382) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 15:17:53 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-d2bf6bc0-c9cb-4e7f-b391-3a0ea28a550d tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] Removing single pathed devices sde {{(pid=72382) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 15:17:53 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:17:53 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:17:53 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ef95bdf-7775-46a9-8f40-a0240240c9e0]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:17:53 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:17:53 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:17:53 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f9a2f1a-496d-4c0e-bb26-9662afb723cc]: (4, ('ok\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:17:53 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-d2bf6bc0-c9cb-4e7f-b391-3a0ea28a550d tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] Flushing IO for device /dev/sde {{(pid=72382) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 15:17:53 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:17:53 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.018s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:17:53 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[209d1042-6e0d-4eef-abbe-cafd0f17857a]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:17:53 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-d2bf6bc0-c9cb-4e7f-b391-3a0ea28a550d tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72382) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 15:17:53 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:17:53 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.043s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:17:53 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[c78d71d9-0423-4983-b32e-1ee5a4c8133c]: (4, ('1', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:17:53 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-d2bf6bc0-c9cb-4e7f-b391-3a0ea28a550d tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72382) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 15:17:53 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-d2bf6bc0-c9cb-4e7f-b391-3a0ea28a550d tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] SCSI volumes sde have been removed. {{(pid=72382) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 15:17:53 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2bf6bc0-c9cb-4e7f-b391-3a0ea28a550d tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:21e1540c-408d-44a5-893c-892d0e91eb01')] {{(pid=72382) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 15:17:53 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21e1540c-408d-44a5-893c-892d0e91eb01 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:17:53 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21e1540c-408d-44a5-893c-892d0e91eb01 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:17:53 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[b68fae04-8350-422a-aead-1af20d59d875]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:17:53 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2bf6bc0-c9cb-4e7f-b391-3a0ea28a550d tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:17:53 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21e1540c-408d-44a5-893c-892d0e91eb01 -p 172.16.0.220:3260 --logout {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:17:53 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21e1540c-408d-44a5-893c-892d0e91eb01 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:17:53 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[96a489b4-f374-46ef-a2b1-ef7a96ff7cbe]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:21e1540c-408d-44a5-893c-892d0e91eb01, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:21e1540c-408d-44a5-893c-892d0e91eb01, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:17:53 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2bf6bc0-c9cb-4e7f-b391-3a0ea28a550d tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:21e1540c-408d-44a5-893c-892d0e91eb01, portal: 172.16.0.220,3260]
Aug 09 15:17:53 user nova-compute[72382]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:21e1540c-408d-44a5-893c-892d0e91eb01, portal: 172.16.0.220,3260] successful.
Aug 09 15:17:53 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:17:53 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21e1540c-408d-44a5-893c-892d0e91eb01 -p 172.16.0.220:3260 --op delete {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:17:53 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:17:53 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21e1540c-408d-44a5-893c-892d0e91eb01 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:17:53 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ac36e75-3a96-4262-a230-e6b27dc7993f]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:17:53 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2bf6bc0-c9cb-4e7f-b391-3a0ea28a550d tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:17:53 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-d2bf6bc0-c9cb-4e7f-b391-3a0ea28a550d tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.282s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 15:17:53 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2bf6bc0-c9cb-4e7f-b391-3a0ea28a550d tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] <== disconnect_volume: return (1416ms) None {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 15:17:53 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d2bf6bc0-c9cb-4e7f-b391-3a0ea28a550d tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] [instance: a33515b3-3ef4-4f76-a8d8-e7008b5bbb79] Disconnected iSCSI Volume {{(pid=72382) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 15:17:53 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-13577d43-df39-42bb-8f2e-da94464f07aa tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] No BDM found with device name vda, not building metadata. {{(pid=72382) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 15:17:53 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-13577d43-df39-42bb-8f2e-da94464f07aa tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] No BDM found with device name hda, not building metadata. {{(pid=72382) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 15:17:53 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-13577d43-df39-42bb-8f2e-da94464f07aa tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] No VIF found with MAC fa:16:3e:b1:4d:7d, not building metadata {{(pid=72382) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 15:17:54 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-13577d43-df39-42bb-8f2e-da94464f07aa tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] Lock "23f25946-de3a-43fb-97a4-1f9a787e6e51" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.561s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:17:54 user nova-compute[72382]: DEBUG nova.objects.instance [None req-d2bf6bc0-c9cb-4e7f-b391-3a0ea28a550d tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] Lazy-loading 'flavor' on Instance uuid a33515b3-3ef4-4f76-a8d8-e7008b5bbb79 {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:17:54 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-d2bf6bc0-c9cb-4e7f-b391-3a0ea28a550d tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] Lock "a33515b3-3ef4-4f76-a8d8-e7008b5bbb79" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.872s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:17:55 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-78ad1354-f860-42dc-b50c-5aacb0bf64b4 tempest-TestVolumeSwap-583684665 tempest-TestVolumeSwap-583684665-project-member] [instance: 9a82f146-97ce-4319-8b25-c1b090965e53] Calling os-brick to attach iSCSI Volume {{(pid=72382) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 15:17:55 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-78ad1354-f860-42dc-b50c-5aacb0bf64b4 tempest-TestVolumeSwap-583684665 tempest-TestVolumeSwap-583684665-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2a0c768340>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:ad1e2adc-5d1a-4718-8971-7d362e291602'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'avodyQXL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 15:17:55 user nova-compute[72382]: WARNING os_brick.initiator.connectors.base [None req-78ad1354-f860-42dc-b50c-5aacb0bf64b4 tempest-TestVolumeSwap-583684665 tempest-TestVolumeSwap-583684665-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 15:17:55 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-78ad1354-f860-42dc-b50c-5aacb0bf64b4 tempest-TestVolumeSwap-583684665 tempest-TestVolumeSwap-583684665-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 15:17:55 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-78ad1354-f860-42dc-b50c-5aacb0bf64b4 tempest-TestVolumeSwap-583684665 tempest-TestVolumeSwap-583684665-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 15:17:55 user nova-compute[72382]: WARNING os_brick.initiator.connectors.base [None req-78ad1354-f860-42dc-b50c-5aacb0bf64b4 tempest-TestVolumeSwap-583684665 tempest-TestVolumeSwap-583684665-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 15:17:55 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-78ad1354-f860-42dc-b50c-5aacb0bf64b4 tempest-TestVolumeSwap-583684665 tempest-TestVolumeSwap-583684665-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ad1e2adc-5d1a-4718-8971-7d362e291602" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 15:17:55 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-78ad1354-f860-42dc-b50c-5aacb0bf64b4 tempest-TestVolumeSwap-583684665 tempest-TestVolumeSwap-583684665-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ad1e2adc-5d1a-4718-8971-7d362e291602" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 15:17:55 user nova-compute[72382]: INFO os_brick.initiator.connectors.iscsi [None req-78ad1354-f860-42dc-b50c-5aacb0bf64b4 tempest-TestVolumeSwap-583684665 tempest-TestVolumeSwap-583684665-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 15:17:55 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad1e2adc-5d1a-4718-8971-7d362e291602 -p 172.16.0.220:3260 {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:17:55 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad1e2adc-5d1a-4718-8971-7d362e291602 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:17:55 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f3d8bf6-86eb-4d83-a501-1fae90a277e4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:17:55 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-78ad1354-f860-42dc-b50c-5aacb0bf64b4 tempest-TestVolumeSwap-583684665 tempest-TestVolumeSwap-583684665-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 15:17:55 user nova-compute[72382]:  {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:17:55 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad1e2adc-5d1a-4718-8971-7d362e291602 -p 172.16.0.220:3260 --interface default --op new {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:17:55 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad1e2adc-5d1a-4718-8971-7d362e291602 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:17:55 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7a3d5ef-8770-44f8-b11c-31a031ea97bb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ad1e2adc-5d1a-4718-8971-7d362e291602] added\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:17:55 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-78ad1354-f860-42dc-b50c-5aacb0bf64b4 tempest-TestVolumeSwap-583684665 tempest-TestVolumeSwap-583684665-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ad1e2adc-5d1a-4718-8971-7d362e291602] added
Aug 09 15:17:55 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:17:55 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad1e2adc-5d1a-4718-8971-7d362e291602 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:17:55 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad1e2adc-5d1a-4718-8971-7d362e291602 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:17:55 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef989f6c-af0e-4c87-901f-dfbd5a201d26]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:17:55 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-78ad1354-f860-42dc-b50c-5aacb0bf64b4 tempest-TestVolumeSwap-583684665 tempest-TestVolumeSwap-583684665-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:17:55 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad1e2adc-5d1a-4718-8971-7d362e291602 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:17:55 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad1e2adc-5d1a-4718-8971-7d362e291602 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:17:55 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1f09438-f957-4c99-9bfe-3d2701ed0c0d]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:17:55 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-78ad1354-f860-42dc-b50c-5aacb0bf64b4 tempest-TestVolumeSwap-583684665 tempest-TestVolumeSwap-583684665-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:17:55 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad1e2adc-5d1a-4718-8971-7d362e291602 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v avodyQXL {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:17:55 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad1e2adc-5d1a-4718-8971-7d362e291602 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v avodyQXL" returned: 0 in 0.019s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:17:55 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[57cb8820-1ffb-48d0-a3c9-c818edf31ca7]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:17:55 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-78ad1354-f860-42dc-b50c-5aacb0bf64b4 tempest-TestVolumeSwap-583684665 tempest-TestVolumeSwap-583684665-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'avodyQXL'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:17:55 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad1e2adc-5d1a-4718-8971-7d362e291602 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:17:55 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad1e2adc-5d1a-4718-8971-7d362e291602 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:17:55 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dc2630e-c7fd-4825-b29f-882953a2043b]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:17:55 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-78ad1354-f860-42dc-b50c-5aacb0bf64b4 tempest-TestVolumeSwap-583684665 tempest-TestVolumeSwap-583684665-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:17:55 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:17:55 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:17:55 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ab34110-6fd9-4e5c-ad30-a9b51b294ccb]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2267629-52cf-439c-9083-3e8384c67f08 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a13916f-1416-4b94-9e10-96f9e6415753 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16ef1023-88b6-4e22-9b4b-45515b25ca9b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9489f8bc-3805-45bd-adfa-7d42f629184a (non-flash)\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:17:55 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-78ad1354-f860-42dc-b50c-5aacb0bf64b4 tempest-TestVolumeSwap-583684665 tempest-TestVolumeSwap-583684665-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2267629-52cf-439c-9083-3e8384c67f08 (non-flash)
Aug 09 15:17:55 user nova-compute[72382]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a13916f-1416-4b94-9e10-96f9e6415753 (non-flash)
Aug 09 15:17:55 user nova-compute[72382]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16ef1023-88b6-4e22-9b4b-45515b25ca9b (non-flash)
Aug 09 15:17:55 user nova-compute[72382]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9489f8bc-3805-45bd-adfa-7d42f629184a (non-flash)
Aug 09 15:17:55 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 15:17:55 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-78ad1354-f860-42dc-b50c-5aacb0bf64b4 tempest-TestVolumeSwap-583684665 tempest-TestVolumeSwap-583684665-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2267629-52cf-439c-9083-3e8384c67f08 (non-flash)
Aug 09 15:17:55 user nova-compute[72382]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a13916f-1416-4b94-9e10-96f9e6415753 (non-flash)
Aug 09 15:17:55 user nova-compute[72382]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16ef1023-88b6-4e22-9b4b-45515b25ca9b (non-flash)
Aug 09 15:17:55 user nova-compute[72382]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9489f8bc-3805-45bd-adfa-7d42f629184a (non-flash)
Aug 09 15:17:55 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 15:17:55 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad1e2adc-5d1a-4718-8971-7d362e291602 -p 172.16.0.220:3260 --login {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:17:55 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad1e2adc-5d1a-4718-8971-7d362e291602 -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:17:55 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[aba8212d-93df-4a47-8e74-78b1b1cdc2b4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ad1e2adc-5d1a-4718-8971-7d362e291602, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ad1e2adc-5d1a-4718-8971-7d362e291602, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:17:55 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-78ad1354-f860-42dc-b50c-5aacb0bf64b4 tempest-TestVolumeSwap-583684665 tempest-TestVolumeSwap-583684665-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ad1e2adc-5d1a-4718-8971-7d362e291602, portal: 172.16.0.220,3260]
Aug 09 15:17:55 user nova-compute[72382]: Login to [iface: default, target: iqn.2010-10.org.openstack:ad1e2adc-5d1a-4718-8971-7d362e291602, portal: 172.16.0.220,3260] successful.
Aug 09 15:17:55 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:17:55 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad1e2adc-5d1a-4718-8971-7d362e291602 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:17:55 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad1e2adc-5d1a-4718-8971-7d362e291602 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:17:55 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c7ff13a-466f-493f-8d8d-88c8bf4e0f0c]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:17:55 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-78ad1354-f860-42dc-b50c-5aacb0bf64b4 tempest-TestVolumeSwap-583684665 tempest-TestVolumeSwap-583684665-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:17:55 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:17:55 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:17:55 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[157b5b79-bed4-4ae3-aba0-f341e87c3db7]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2267629-52cf-439c-9083-3e8384c67f08 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a13916f-1416-4b94-9e10-96f9e6415753 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16ef1023-88b6-4e22-9b4b-45515b25ca9b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9489f8bc-3805-45bd-adfa-7d42f629184a (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad1e2adc-5d1a-4718-8971-7d362e291602 (non-flash)\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:17:55 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-78ad1354-f860-42dc-b50c-5aacb0bf64b4 tempest-TestVolumeSwap-583684665 tempest-TestVolumeSwap-583684665-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2267629-52cf-439c-9083-3e8384c67f08 (non-flash)
Aug 09 15:17:55 user nova-compute[72382]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a13916f-1416-4b94-9e10-96f9e6415753 (non-flash)
Aug 09 15:17:55 user nova-compute[72382]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16ef1023-88b6-4e22-9b4b-45515b25ca9b (non-flash)
Aug 09 15:17:55 user nova-compute[72382]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9489f8bc-3805-45bd-adfa-7d42f629184a (non-flash)
Aug 09 15:17:55 user nova-compute[72382]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad1e2adc-5d1a-4718-8971-7d362e291602 (non-flash)
Aug 09 15:17:55 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 15:17:55 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-78ad1354-f860-42dc-b50c-5aacb0bf64b4 tempest-TestVolumeSwap-583684665 tempest-TestVolumeSwap-583684665-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2267629-52cf-439c-9083-3e8384c67f08 (non-flash)
Aug 09 15:17:55 user nova-compute[72382]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a13916f-1416-4b94-9e10-96f9e6415753 (non-flash)
Aug 09 15:17:55 user nova-compute[72382]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16ef1023-88b6-4e22-9b4b-45515b25ca9b (non-flash)
Aug 09 15:17:55 user nova-compute[72382]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9489f8bc-3805-45bd-adfa-7d42f629184a (non-flash)
Aug 09 15:17:55 user nova-compute[72382]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad1e2adc-5d1a-4718-8971-7d362e291602 (non-flash)
Aug 09 15:17:55 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 15:17:55 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-78ad1354-f860-42dc-b50c-5aacb0bf64b4 tempest-TestVolumeSwap-583684665 tempest-TestVolumeSwap-583684665-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ad1e2adc-5d1a-4718-8971-7d362e291602" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.313s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 15:17:55 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-78ad1354-f860-42dc-b50c-5aacb0bf64b4 tempest-TestVolumeSwap-583684665 tempest-TestVolumeSwap-583684665-project-member] Connected to 172.16.0.220:3260 {{(pid=72382) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 15:17:55 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-78ad1354-f860-42dc-b50c-5aacb0bf64b4 tempest-TestVolumeSwap-583684665 tempest-TestVolumeSwap-583684665-project-member] HCTL ('36', '-', '-', 0) found on session 9 with lun 0 {{(pid=72382) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 15:17:55 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-78ad1354-f860-42dc-b50c-5aacb0bf64b4 tempest-TestVolumeSwap-583684665 tempest-TestVolumeSwap-583684665-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72382) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 15:17:55 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:17:55 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:17:55 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd15f020-2a2d-48bd-9bd7-7e0cdba11351]: (4, ('- - 0', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:17:55 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-78ad1354-f860-42dc-b50c-5aacb0bf64b4 tempest-TestVolumeSwap-583684665 tempest-TestVolumeSwap-583684665-project-member] Searching for a device in session 9 and hctl ['36', '*', '*', 0] yield: None {{(pid=72382) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 15:17:55 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-bdba4866-7775-499b-944c-57b7eef4a5d1 tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] Acquiring lock "23f25946-de3a-43fb-97a4-1f9a787e6e51" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:17:55 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-bdba4866-7775-499b-944c-57b7eef4a5d1 tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] Lock "23f25946-de3a-43fb-97a4-1f9a787e6e51" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:17:55 user nova-compute[72382]: INFO nova.compute.manager [None req-bdba4866-7775-499b-944c-57b7eef4a5d1 tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] [instance: 23f25946-de3a-43fb-97a4-1f9a787e6e51] Detaching volume 9489f8bc-3805-45bd-adfa-7d42f629184a
Aug 09 15:17:56 user nova-compute[72382]: INFO nova.virt.block_device [None req-bdba4866-7775-499b-944c-57b7eef4a5d1 tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] [instance: 23f25946-de3a-43fb-97a4-1f9a787e6e51] Attempting to driver detach volume 9489f8bc-3805-45bd-adfa-7d42f629184a from mountpoint /dev/vdb
Aug 09 15:17:56 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-bdba4866-7775-499b-944c-57b7eef4a5d1 tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] Attempting to detach device vdb from instance 23f25946-de3a-43fb-97a4-1f9a787e6e51 from the persistent domain config. {{(pid=72382) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 15:17:56 user nova-compute[72382]: DEBUG nova.virt.libvirt.guest [None req-bdba4866-7775-499b-944c-57b7eef4a5d1 tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 15:17:56 user nova-compute[72382]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 15:17:56 user nova-compute[72382]:   <source dev="/dev/sdf"/>
Aug 09 15:17:56 user nova-compute[72382]:   <target dev="vdb" bus="virtio"/>
Aug 09 15:17:56 user nova-compute[72382]:   <serial>9489f8bc-3805-45bd-adfa-7d42f629184a</serial>
Aug 09 15:17:56 user nova-compute[72382]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 09 15:17:56 user nova-compute[72382]: </disk>
Aug 09 15:17:56 user nova-compute[72382]:  {{(pid=72382) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 15:17:56 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-bdba4866-7775-499b-944c-57b7eef4a5d1 tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] Successfully detached device vdb from instance 23f25946-de3a-43fb-97a4-1f9a787e6e51 from the persistent domain config.
Aug 09 15:17:56 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-bdba4866-7775-499b-944c-57b7eef4a5d1 tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 23f25946-de3a-43fb-97a4-1f9a787e6e51 from the live domain config. {{(pid=72382) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 15:17:56 user nova-compute[72382]: DEBUG nova.virt.libvirt.guest [None req-bdba4866-7775-499b-944c-57b7eef4a5d1 tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 15:17:56 user nova-compute[72382]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 15:17:56 user nova-compute[72382]:   <source dev="/dev/sdf"/>
Aug 09 15:17:56 user nova-compute[72382]:   <target dev="vdb" bus="virtio"/>
Aug 09 15:17:56 user nova-compute[72382]:   <serial>9489f8bc-3805-45bd-adfa-7d42f629184a</serial>
Aug 09 15:17:56 user nova-compute[72382]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 09 15:17:56 user nova-compute[72382]: </disk>
Aug 09 15:17:56 user nova-compute[72382]:  {{(pid=72382) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 15:17:56 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:17:56 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Received event <DeviceRemovedEvent: 1691594276.5246716, 23f25946-de3a-43fb-97a4-1f9a787e6e51 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72382) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 15:17:56 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-bdba4866-7775-499b-944c-57b7eef4a5d1 tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 23f25946-de3a-43fb-97a4-1f9a787e6e51 {{(pid=72382) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 15:17:56 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-bdba4866-7775-499b-944c-57b7eef4a5d1 tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] Successfully detached device vdb from instance 23f25946-de3a-43fb-97a4-1f9a787e6e51 from the live domain config.
Aug 09 15:17:56 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bdba4866-7775-499b-944c-57b7eef4a5d1 tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] [instance: 23f25946-de3a-43fb-97a4-1f9a787e6e51] calling os-brick to detach iSCSI Volume {{(pid=72382) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 15:17:56 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdba4866-7775-499b-944c-57b7eef4a5d1 tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2a0c768340>, {'target_iqns': ['iqn.2010-10.org.openstack:9489f8bc-3805-45bd-adfa-7d42f629184a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zjftpNbH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 15:17:56 user nova-compute[72382]: WARNING os_brick.initiator.connectors.base [None req-bdba4866-7775-499b-944c-57b7eef4a5d1 tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 15:17:56 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-bdba4866-7775-499b-944c-57b7eef4a5d1 tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 15:17:56 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-78ad1354-f860-42dc-b50c-5aacb0bf64b4 tempest-TestVolumeSwap-583684665 tempest-TestVolumeSwap-583684665-project-member] Searching for a device in session 9 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72382) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 15:17:56 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-78ad1354-f860-42dc-b50c-5aacb0bf64b4 tempest-TestVolumeSwap-583684665 tempest-TestVolumeSwap-583684665-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'avodyQXL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72382) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 15:17:56 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-78ad1354-f860-42dc-b50c-5aacb0bf64b4 tempest-TestVolumeSwap-583684665 tempest-TestVolumeSwap-583684665-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.345s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 15:17:56 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-78ad1354-f860-42dc-b50c-5aacb0bf64b4 tempest-TestVolumeSwap-583684665 tempest-TestVolumeSwap-583684665-project-member] <== connect_volume: return (1347ms) {'type': 'block', 'scsi_wwn': '23234323435383435', 'path': '/dev/sde'} {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 15:17:56 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-78ad1354-f860-42dc-b50c-5aacb0bf64b4 tempest-TestVolumeSwap-583684665 tempest-TestVolumeSwap-583684665-project-member] [instance: 9a82f146-97ce-4319-8b25-c1b090965e53] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23234323435383435', 'path': '/dev/sde'} {{(pid=72382) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 15:17:56 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-bdba4866-7775-499b-944c-57b7eef4a5d1 tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.151s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 15:17:56 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdba4866-7775-499b-944c-57b7eef4a5d1 tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9489f8bc-3805-45bd-adfa-7d42f629184a', 0)] {{(pid=72382) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 15:17:56 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:17:56 user nova-compute[72382]: DEBUG nova.objects.instance [None req-78ad1354-f860-42dc-b50c-5aacb0bf64b4 tempest-TestVolumeSwap-583684665 tempest-TestVolumeSwap-583684665-project-member] Lazy-loading 'flavor' on Instance uuid 9a82f146-97ce-4319-8b25-c1b090965e53 {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:17:56 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:17:56 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[99f3fa6d-613b-4a7b-85b8-811dda883b04]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:16ef1023-88b6-4e22-9b4b-45515b25ca9b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5a13916f-1416-4b94-9e10-96f9e6415753\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9489f8bc-3805-45bd-adfa-7d42f629184a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ad1e2adc-5d1a-4718-8971-7d362e291602\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e2267629-52cf-439c-9083-3e8384c67f08\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:17:56 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:17:56 user nova-compute[72382]: DEBUG nova.virt.libvirt.guest [None req-78ad1354-f860-42dc-b50c-5aacb0bf64b4 tempest-TestVolumeSwap-583684665 tempest-TestVolumeSwap-583684665-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 15:17:56 user nova-compute[72382]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 15:17:56 user nova-compute[72382]:   <source dev="/dev/sde"/>
Aug 09 15:17:56 user nova-compute[72382]:   <target dev="vdb" bus="virtio"/>
Aug 09 15:17:56 user nova-compute[72382]:   <serial>ad1e2adc-5d1a-4718-8971-7d362e291602</serial>
Aug 09 15:17:56 user nova-compute[72382]: </disk>
Aug 09 15:17:56 user nova-compute[72382]:  {{(pid=72382) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 15:17:56 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:17:56 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[1eca2f08-9fdb-4eae-adcb-294bb3244b95]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2267629-52cf-439c-9083-3e8384c67f08 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a13916f-1416-4b94-9e10-96f9e6415753 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16ef1023-88b6-4e22-9b4b-45515b25ca9b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9489f8bc-3805-45bd-adfa-7d42f629184a (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad1e2adc-5d1a-4718-8971-7d362e291602 (non-flash)\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:17:56 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdba4866-7775-499b-944c-57b7eef4a5d1 tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2267629-52cf-439c-9083-3e8384c67f08 (non-flash)
Aug 09 15:17:56 user nova-compute[72382]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a13916f-1416-4b94-9e10-96f9e6415753 (non-flash)
Aug 09 15:17:56 user nova-compute[72382]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16ef1023-88b6-4e22-9b4b-45515b25ca9b (non-flash)
Aug 09 15:17:56 user nova-compute[72382]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9489f8bc-3805-45bd-adfa-7d42f629184a (non-flash)
Aug 09 15:17:56 user nova-compute[72382]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad1e2adc-5d1a-4718-8971-7d362e291602 (non-flash)
Aug 09 15:17:56 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 15:17:56 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdba4866-7775-499b-944c-57b7eef4a5d1 tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2267629-52cf-439c-9083-3e8384c67f08 (non-flash)
Aug 09 15:17:56 user nova-compute[72382]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a13916f-1416-4b94-9e10-96f9e6415753 (non-flash)
Aug 09 15:17:56 user nova-compute[72382]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16ef1023-88b6-4e22-9b4b-45515b25ca9b (non-flash)
Aug 09 15:17:56 user nova-compute[72382]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9489f8bc-3805-45bd-adfa-7d42f629184a (non-flash)
Aug 09 15:17:56 user nova-compute[72382]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad1e2adc-5d1a-4718-8971-7d362e291602 (non-flash)
Aug 09 15:17:56 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 15:17:56 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdba4866-7775-499b-944c-57b7eef4a5d1 tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2a0c735090>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9489f8bc-3805-45bd-adfa-7d42f629184a'): ({'sdf'}, set())}) {{(pid=72382) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 15:17:56 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-bdba4866-7775-499b-944c-57b7eef4a5d1 tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] Removing single pathed devices sdf {{(pid=72382) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 15:17:56 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:17:56 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:17:56 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b707d8e-98a1-4e74-a720-1a46472681ee]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:17:56 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:17:56 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.023s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:17:56 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bb783ec-325d-4d99-bacf-12fb2cbc5cd0]: (4, ('ok\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:17:56 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-bdba4866-7775-499b-944c-57b7eef4a5d1 tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] Flushing IO for device /dev/sdf {{(pid=72382) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 15:17:56 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:17:56 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:17:56 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[e31fefbb-aabd-48a3-bc99-3d2bb9d8c30f]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:17:56 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-bdba4866-7775-499b-944c-57b7eef4a5d1 tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=72382) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 15:17:56 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:17:56 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.041s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:17:56 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f43a4e6-5340-488b-a460-b05c10fb70d3]: (4, ('1', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:17:56 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-bdba4866-7775-499b-944c-57b7eef4a5d1 tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=72382) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 15:17:56 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-bdba4866-7775-499b-944c-57b7eef4a5d1 tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] SCSI volumes sdf have been removed. {{(pid=72382) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 15:17:56 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdba4866-7775-499b-944c-57b7eef4a5d1 tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9489f8bc-3805-45bd-adfa-7d42f629184a')] {{(pid=72382) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 15:17:56 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9489f8bc-3805-45bd-adfa-7d42f629184a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:17:56 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9489f8bc-3805-45bd-adfa-7d42f629184a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:17:56 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[a80fdd54-448a-45fe-896b-74480724ce1b]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:17:56 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdba4866-7775-499b-944c-57b7eef4a5d1 tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:17:56 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9489f8bc-3805-45bd-adfa-7d42f629184a -p 172.16.0.220:3260 --logout {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:17:56 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9489f8bc-3805-45bd-adfa-7d42f629184a -p 172.16.0.220:3260 --logout" returned: 0 in 0.105s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:17:56 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[45d94282-f14e-4150-9e1d-0b9981e5fbd3]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:9489f8bc-3805-45bd-adfa-7d42f629184a, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:9489f8bc-3805-45bd-adfa-7d42f629184a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:17:56 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdba4866-7775-499b-944c-57b7eef4a5d1 tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:9489f8bc-3805-45bd-adfa-7d42f629184a, portal: 172.16.0.220,3260]
Aug 09 15:17:56 user nova-compute[72382]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:9489f8bc-3805-45bd-adfa-7d42f629184a, portal: 172.16.0.220,3260] successful.
Aug 09 15:17:56 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:17:56 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9489f8bc-3805-45bd-adfa-7d42f629184a -p 172.16.0.220:3260 --op delete {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:17:57 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9489f8bc-3805-45bd-adfa-7d42f629184a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:17:57 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecd91482-24e4-40e3-9595-576c4258b120]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:17:57 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdba4866-7775-499b-944c-57b7eef4a5d1 tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:17:57 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-bdba4866-7775-499b-944c-57b7eef4a5d1 tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.339s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 15:17:57 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdba4866-7775-499b-944c-57b7eef4a5d1 tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] <== disconnect_volume: return (491ms) None {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 15:17:57 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bdba4866-7775-499b-944c-57b7eef4a5d1 tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] [instance: 23f25946-de3a-43fb-97a4-1f9a787e6e51] Disconnected iSCSI Volume {{(pid=72382) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 15:17:57 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-78ad1354-f860-42dc-b50c-5aacb0bf64b4 tempest-TestVolumeSwap-583684665 tempest-TestVolumeSwap-583684665-project-member] No BDM found with device name vda, not building metadata. {{(pid=72382) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 15:17:57 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-78ad1354-f860-42dc-b50c-5aacb0bf64b4 tempest-TestVolumeSwap-583684665 tempest-TestVolumeSwap-583684665-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72382) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 15:17:57 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-78ad1354-f860-42dc-b50c-5aacb0bf64b4 tempest-TestVolumeSwap-583684665 tempest-TestVolumeSwap-583684665-project-member] No VIF found with MAC fa:16:3e:71:e7:dc, not building metadata {{(pid=72382) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 15:17:57 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-78ad1354-f860-42dc-b50c-5aacb0bf64b4 tempest-TestVolumeSwap-583684665 tempest-TestVolumeSwap-583684665-project-member] Lock "9a82f146-97ce-4319-8b25-c1b090965e53" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.294s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:17:58 user nova-compute[72382]: DEBUG nova.objects.instance [None req-bdba4866-7775-499b-944c-57b7eef4a5d1 tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] Lazy-loading 'flavor' on Instance uuid 23f25946-de3a-43fb-97a4-1f9a787e6e51 {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:17:58 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-cc59ad8f-6273-4c23-8869-cc1a783ecb14 tempest-TestVolumeSwap-1225930191 tempest-TestVolumeSwap-1225930191-project-admin] Acquiring lock "9a82f146-97ce-4319-8b25-c1b090965e53" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:17:58 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-cc59ad8f-6273-4c23-8869-cc1a783ecb14 tempest-TestVolumeSwap-1225930191 tempest-TestVolumeSwap-1225930191-project-admin] Lock "9a82f146-97ce-4319-8b25-c1b090965e53" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:17:58 user nova-compute[72382]: DEBUG os_brick.utils [None req-cc59ad8f-6273-4c23-8869-cc1a783ecb14 tempest-TestVolumeSwap-1225930191 tempest-TestVolumeSwap-1225930191-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 15:17:58 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:17:58 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:17:58 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[5011fffb-4450-40fc-a632-9d164097232b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d2cfa7015fe\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:17:58 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:17:58 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-bdba4866-7775-499b-944c-57b7eef4a5d1 tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] Lock "23f25946-de3a-43fb-97a4-1f9a787e6e51" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.184s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:17:58 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:17:58 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e1c3799-1949-41d2-ae6c-398349a32811]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:17:58 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:17:58 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:17:58 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f61d836-827a-4a1f-b75f-f53d79318c6b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:17:58 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[8717d505-c95f-42fa-b7e8-973295d64593]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:17:58 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-cc59ad8f-6273-4c23-8869-cc1a783ecb14 tempest-TestVolumeSwap-1225930191 tempest-TestVolumeSwap-1225930191-project-admin] Running cmd (subprocess): nvme version {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:17:58 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-cc59ad8f-6273-4c23-8869-cc1a783ecb14 tempest-TestVolumeSwap-1225930191 tempest-TestVolumeSwap-1225930191-project-admin] 'nvme version' failed. Not Retrying. {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 15:17:58 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cc59ad8f-6273-4c23-8869-cc1a783ecb14 tempest-TestVolumeSwap-1225930191 tempest-TestVolumeSwap-1225930191-project-admin] nvme not present on system {{(pid=72382) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 15:17:58 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:17:58 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 15:17:58 user nova-compute[72382]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 15:17:58 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[e671b0a4-5419-40d2-ba95-0d61dfc45e7d]: (4, '') {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:17:58 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.lightos [None req-cc59ad8f-6273-4c23-8869-cc1a783ecb14 tempest-TestVolumeSwap-1225930191 tempest-TestVolumeSwap-1225930191-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72382) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 15:17:58 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.lightos [None req-cc59ad8f-6273-4c23-8869-cc1a783ecb14 tempest-TestVolumeSwap-1225930191 tempest-TestVolumeSwap-1225930191-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72382) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 15:17:58 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.lightos [None req-cc59ad8f-6273-4c23-8869-cc1a783ecb14 tempest-TestVolumeSwap-1225930191 tempest-TestVolumeSwap-1225930191-project-admin] LIGHTOS: no hostnqn found. {{(pid=72382) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 15:17:58 user nova-compute[72382]: DEBUG os_brick.utils [None req-cc59ad8f-6273-4c23-8869-cc1a783ecb14 tempest-TestVolumeSwap-1225930191 tempest-TestVolumeSwap-1225930191-project-admin] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d2cfa7015fe', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 15:17:58 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-b5b5ac91-bf83-486d-9ee8-2971aefb1473 tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] Acquiring lock "interface-23f25946-de3a-43fb-97a4-1f9a787e6e51-a67bcfee-0085-436e-8b18-1014b9b40f81" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:17:58 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-b5b5ac91-bf83-486d-9ee8-2971aefb1473 tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] Lock "interface-23f25946-de3a-43fb-97a4-1f9a787e6e51-a67bcfee-0085-436e-8b18-1014b9b40f81" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:17:58 user nova-compute[72382]: DEBUG nova.objects.instance [None req-b5b5ac91-bf83-486d-9ee8-2971aefb1473 tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] Lazy-loading 'flavor' on Instance uuid 23f25946-de3a-43fb-97a4-1f9a787e6e51 {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:17:58 user nova-compute[72382]: DEBUG nova.virt.libvirt.vif [None req-b5b5ac91-bf83-486d-9ee8-2971aefb1473 tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T15:15:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-176087286',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-176087286',id=9,image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF4pKUdXj5zZfLZFWCxFHz8jMa5yp/7/IPCXi1mkSKd0mYycvxd7H8zaZJVqn1Nt7uBCqZDaWzic3f3975RUjfs8oAsAozBRZ/XXtDelWRnO6lHLhAgDLjQA+jzema7e1g==',key_name='tempest-keypair-1955626579',keypairs=<?>,launch_index=0,launched_at=2023-08-09T15:15:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b84d09ad643146859e76996c09ba02c7',ramdisk_id='',reservation_id='r-sy0nsoiy',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-605331854',owner_user_name='tempest-TaggedAttachmentsTest-605331854-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T15:16:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='97fa102d2fed4045a326b0f5efbd1b1c',uuid=23f25946-de3a-43fb-97a4-1f9a787e6e51,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a67bcfee-0085-436e-8b18-1014b9b40f81", "address": "fa:16:3e:5c:2f:23", "network": {"id": "224c3e1d-3948-43d1-bb02-76a05add8f1e", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-126262034", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.156", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "b84d09ad643146859e76996c09ba02c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa67bcfee-00", "ovs_interfaceid": "a67bcfee-0085-436e-8b18-1014b9b40f81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72382) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 15:17:58 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-b5b5ac91-bf83-486d-9ee8-2971aefb1473 tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] Converting VIF {"id": "a67bcfee-0085-436e-8b18-1014b9b40f81", "address": "fa:16:3e:5c:2f:23", "network": {"id": "224c3e1d-3948-43d1-bb02-76a05add8f1e", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-126262034", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.156", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "b84d09ad643146859e76996c09ba02c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa67bcfee-00", "ovs_interfaceid": "a67bcfee-0085-436e-8b18-1014b9b40f81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 15:17:58 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-b5b5ac91-bf83-486d-9ee8-2971aefb1473 tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5c:2f:23,bridge_name='br-int',has_traffic_filtering=True,id=a67bcfee-0085-436e-8b18-1014b9b40f81,network=Network(224c3e1d-3948-43d1-bb02-76a05add8f1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa67bcfee-00') {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 15:17:58 user nova-compute[72382]: DEBUG nova.virt.libvirt.guest [None req-b5b5ac91-bf83-486d-9ee8-2971aefb1473 tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:5c:2f:23"/><model type="virtio"/><mtu size="1442"/><target dev="tapa67bcfee-00"/></interface> {{(pid=72382) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 09 15:17:58 user nova-compute[72382]: DEBUG nova.virt.libvirt.guest [None req-b5b5ac91-bf83-486d-9ee8-2971aefb1473 tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:5c:2f:23"/><model type="virtio"/><mtu size="1442"/><target dev="tapa67bcfee-00"/></interface> {{(pid=72382) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 09 15:17:58 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-b5b5ac91-bf83-486d-9ee8-2971aefb1473 tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] Attempting to detach device tapa67bcfee-00 from instance 23f25946-de3a-43fb-97a4-1f9a787e6e51 from the persistent domain config. {{(pid=72382) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 15:17:58 user nova-compute[72382]: DEBUG nova.virt.libvirt.guest [None req-b5b5ac91-bf83-486d-9ee8-2971aefb1473 tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] detach device xml: <interface type="ethernet">
Aug 09 15:17:58 user nova-compute[72382]:   <mac address="fa:16:3e:5c:2f:23"/>
Aug 09 15:17:58 user nova-compute[72382]:   <model type="virtio"/>
Aug 09 15:17:58 user nova-compute[72382]:   <mtu size="1442"/>
Aug 09 15:17:58 user nova-compute[72382]:   <target dev="tapa67bcfee-00"/>
Aug 09 15:17:58 user nova-compute[72382]: </interface>
Aug 09 15:17:58 user nova-compute[72382]:  {{(pid=72382) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 15:17:58 user nova-compute[72382]: DEBUG nova.virt.libvirt.guest [None req-b5b5ac91-bf83-486d-9ee8-2971aefb1473 tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:5c:2f:23"/><model type="virtio"/><mtu size="1442"/><target dev="tapa67bcfee-00"/></interface> {{(pid=72382) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 09 15:17:58 user nova-compute[72382]: DEBUG nova.virt.libvirt.guest [None req-b5b5ac91-bf83-486d-9ee8-2971aefb1473 tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:5c:2f:23"/><model type="virtio"/><mtu size="1442"/><target dev="tapa67bcfee-00"/></interface>not found in domain: <domain type='kvm' id='9'>
Aug 09 15:17:58 user nova-compute[72382]:   <name>instance-00000009</name>
Aug 09 15:17:58 user nova-compute[72382]:   <uuid>23f25946-de3a-43fb-97a4-1f9a787e6e51</uuid>
Aug 09 15:17:58 user nova-compute[72382]:   <metadata>
Aug 09 15:17:58 user nova-compute[72382]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 15:17:58 user nova-compute[72382]:   <nova:package version="0.0.0"/>
Aug 09 15:17:58 user nova-compute[72382]:   <nova:name>tempest-device-tagging-server-176087286</nova:name>
Aug 09 15:17:58 user nova-compute[72382]:   <nova:creationTime>2023-08-09 15:17:41</nova:creationTime>
Aug 09 15:17:58 user nova-compute[72382]:   <nova:flavor name="m1.tiny">
Aug 09 15:17:58 user nova-compute[72382]:     <nova:memory>512</nova:memory>
Aug 09 15:17:58 user nova-compute[72382]:     <nova:disk>1</nova:disk>
Aug 09 15:17:58 user nova-compute[72382]:     <nova:swap>0</nova:swap>
Aug 09 15:17:58 user nova-compute[72382]:     <nova:ephemeral>0</nova:ephemeral>
Aug 09 15:17:58 user nova-compute[72382]:     <nova:vcpus>1</nova:vcpus>
Aug 09 15:17:58 user nova-compute[72382]:   </nova:flavor>
Aug 09 15:17:58 user nova-compute[72382]:   <nova:owner>
Aug 09 15:17:58 user nova-compute[72382]:     <nova:user uuid="97fa102d2fed4045a326b0f5efbd1b1c">tempest-TaggedAttachmentsTest-605331854-project-member</nova:user>
Aug 09 15:17:58 user nova-compute[72382]:     <nova:project uuid="b84d09ad643146859e76996c09ba02c7">tempest-TaggedAttachmentsTest-605331854</nova:project>
Aug 09 15:17:58 user nova-compute[72382]:   </nova:owner>
Aug 09 15:17:58 user nova-compute[72382]:   <nova:root type="image" uuid="a79f2cea-eb27-4631-aaf3-05e7d9e411b4"/>
Aug 09 15:17:58 user nova-compute[72382]:   <nova:ports>
Aug 09 15:17:58 user nova-compute[72382]:     <nova:port uuid="1c588f02-cc2c-47f1-8918-bf9b1d3ea215">
Aug 09 15:17:58 user nova-compute[72382]:       <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 09 15:17:58 user nova-compute[72382]:     </nova:port>
Aug 09 15:17:58 user nova-compute[72382]:     <nova:port uuid="a67bcfee-0085-436e-8b18-1014b9b40f81">
Aug 09 15:17:58 user nova-compute[72382]:       <nova:ip type="fixed" address="10.10.10.156" ipVersion="4"/>
Aug 09 15:17:58 user nova-compute[72382]:     </nova:port>
Aug 09 15:17:58 user nova-compute[72382]:   </nova:ports>
Aug 09 15:17:58 user nova-compute[72382]: </nova:instance>
Aug 09 15:17:58 user nova-compute[72382]:   </metadata>
Aug 09 15:17:58 user nova-compute[72382]:   <memory unit='KiB'>524288</memory>
Aug 09 15:17:58 user nova-compute[72382]:   <currentMemory unit='KiB'>524288</currentMemory>
Aug 09 15:17:58 user nova-compute[72382]:   <vcpu placement='static'>1</vcpu>
Aug 09 15:17:58 user nova-compute[72382]:   <resource>
Aug 09 15:17:58 user nova-compute[72382]:     <partition>/machine</partition>
Aug 09 15:17:58 user nova-compute[72382]:   </resource>
Aug 09 15:17:58 user nova-compute[72382]:   <sysinfo type='smbios'>
Aug 09 15:17:58 user nova-compute[72382]:     <system>
Aug 09 15:17:58 user nova-compute[72382]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Aug 09 15:17:58 user nova-compute[72382]:       <entry name='product'>OpenStack Nova</entry>
Aug 09 15:17:58 user nova-compute[72382]:       <entry name='version'>0.0.0</entry>
Aug 09 15:17:58 user nova-compute[72382]:       <entry name='serial'>23f25946-de3a-43fb-97a4-1f9a787e6e51</entry>
Aug 09 15:17:58 user nova-compute[72382]:       <entry name='uuid'>23f25946-de3a-43fb-97a4-1f9a787e6e51</entry>
Aug 09 15:17:58 user nova-compute[72382]:       <entry name='family'>Virtual Machine</entry>
Aug 09 15:17:58 user nova-compute[72382]:     </system>
Aug 09 15:17:58 user nova-compute[72382]:   </sysinfo>
Aug 09 15:17:58 user nova-compute[72382]:   <os>
Aug 09 15:17:58 user nova-compute[72382]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Aug 09 15:17:58 user nova-compute[72382]:     <boot dev='hd'/>
Aug 09 15:17:58 user nova-compute[72382]:     <smbios mode='sysinfo'/>
Aug 09 15:17:58 user nova-compute[72382]:   </os>
Aug 09 15:17:58 user nova-compute[72382]:   <features>
Aug 09 15:17:58 user nova-compute[72382]:     <acpi/>
Aug 09 15:17:58 user nova-compute[72382]:     <apic/>
Aug 09 15:17:58 user nova-compute[72382]:     <vmcoreinfo state='on'/>
Aug 09 15:17:58 user nova-compute[72382]:   </features>
Aug 09 15:17:58 user nova-compute[72382]:   <cpu mode='custom' match='exact' check='full'>
Aug 09 15:17:58 user nova-compute[72382]:     <model fallback='forbid'>Nehalem</model>
Aug 09 15:17:58 user nova-compute[72382]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Aug 09 15:17:58 user nova-compute[72382]:     <feature policy='require' name='vme'/>
Aug 09 15:17:58 user nova-compute[72382]:     <feature policy='require' name='x2apic'/>
Aug 09 15:17:58 user nova-compute[72382]:     <feature policy='require' name='hypervisor'/>
Aug 09 15:17:58 user nova-compute[72382]:   </cpu>
Aug 09 15:17:58 user nova-compute[72382]:   <clock offset='utc'>
Aug 09 15:17:58 user nova-compute[72382]:     <timer name='pit' tickpolicy='delay'/>
Aug 09 15:17:58 user nova-compute[72382]:     <timer name='rtc' tickpolicy='catchup'/>
Aug 09 15:17:58 user nova-compute[72382]:     <timer name='hpet' present='no'/>
Aug 09 15:17:58 user nova-compute[72382]:   </clock>
Aug 09 15:17:58 user nova-compute[72382]:   <on_poweroff>destroy</on_poweroff>
Aug 09 15:17:58 user nova-compute[72382]:   <on_reboot>restart</on_reboot>
Aug 09 15:17:58 user nova-compute[72382]:   <on_crash>destroy</on_crash>
Aug 09 15:17:58 user nova-compute[72382]:   <devices>
Aug 09 15:17:58 user nova-compute[72382]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 09 15:17:58 user nova-compute[72382]:     <disk type='file' device='disk'>
Aug 09 15:17:58 user nova-compute[72382]:       <driver name='qemu' type='qcow2' cache='none'/>
Aug 09 15:17:58 user nova-compute[72382]:       <source file='/opt/stack/data/nova/instances/23f25946-de3a-43fb-97a4-1f9a787e6e51/disk' index='2'/>
Aug 09 15:17:58 user nova-compute[72382]:       <backingStore type='file' index='3'>
Aug 09 15:17:58 user nova-compute[72382]:         <format type='raw'/>
Aug 09 15:17:58 user nova-compute[72382]:         <source file='/opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b'/>
Aug 09 15:17:58 user nova-compute[72382]:         <backingStore/>
Aug 09 15:17:58 user nova-compute[72382]:       </backingStore>
Aug 09 15:17:58 user nova-compute[72382]:       <target dev='vda' bus='virtio'/>
Aug 09 15:17:58 user nova-compute[72382]:       <alias name='virtio-disk0'/>
Aug 09 15:17:58 user nova-compute[72382]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Aug 09 15:17:58 user nova-compute[72382]:     </disk>
Aug 09 15:17:58 user nova-compute[72382]:     <disk type='file' device='cdrom'>
Aug 09 15:17:58 user nova-compute[72382]:       <driver name='qemu' type='raw' cache='none'/>
Aug 09 15:17:58 user nova-compute[72382]:       <source file='/opt/stack/data/nova/instances/23f25946-de3a-43fb-97a4-1f9a787e6e51/disk.config' index='1'/>
Aug 09 15:17:58 user nova-compute[72382]:       <backingStore/>
Aug 09 15:17:58 user nova-compute[72382]:       <target dev='hda' bus='ide'/>
Aug 09 15:17:58 user nova-compute[72382]:       <readonly/>
Aug 09 15:17:58 user nova-compute[72382]:       <alias name='ide0-0-0'/>
Aug 09 15:17:58 user nova-compute[72382]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Aug 09 15:17:58 user nova-compute[72382]:     </disk>
Aug 09 15:17:58 user nova-compute[72382]:     <controller type='usb' index='0' model='none'>
Aug 09 15:17:58 user nova-compute[72382]:       <alias name='usb'/>
Aug 09 15:17:58 user nova-compute[72382]:     </controller>
Aug 09 15:17:58 user nova-compute[72382]:     <controller type='pci' index='0' model='pci-root'>
Aug 09 15:17:58 user nova-compute[72382]:       <alias name='pci.0'/>
Aug 09 15:17:58 user nova-compute[72382]:     </controller>
Aug 09 15:17:58 user nova-compute[72382]:     <controller type='ide' index='0'>
Aug 09 15:17:58 user nova-compute[72382]:       <alias name='ide'/>
Aug 09 15:17:58 user nova-compute[72382]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Aug 09 15:17:58 user nova-compute[72382]:     </controller>
Aug 09 15:17:58 user nova-compute[72382]:     <interface type='ethernet'>
Aug 09 15:17:58 user nova-compute[72382]:       <mac address='fa:16:3e:b1:4d:7d'/>
Aug 09 15:17:58 user nova-compute[72382]:       <target dev='tap1c588f02-cc'/>
Aug 09 15:17:58 user nova-compute[72382]:       <model type='virtio'/>
Aug 09 15:17:58 user nova-compute[72382]:       <mtu size='1442'/>
Aug 09 15:17:58 user nova-compute[72382]:       <alias name='net0'/>
Aug 09 15:17:58 user nova-compute[72382]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Aug 09 15:17:58 user nova-compute[72382]:     </interface>
Aug 09 15:17:58 user nova-compute[72382]:     <interface type='ethernet'>
Aug 09 15:17:58 user nova-compute[72382]:       <mac address='fa:16:3e:5c:2f:23'/>
Aug 09 15:17:58 user nova-compute[72382]:       <target dev='tapa67bcfee-00'/>
Aug 09 15:17:58 user nova-compute[72382]:       <model type='virtio'/>
Aug 09 15:17:58 user nova-compute[72382]:       <mtu size='1442'/>
Aug 09 15:17:58 user nova-compute[72382]:       <alias name='net1'/>
Aug 09 15:17:58 user nova-compute[72382]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Aug 09 15:17:58 user nova-compute[72382]:     </interface>
Aug 09 15:17:58 user nova-compute[72382]:     <serial type='pty'>
Aug 09 15:17:58 user nova-compute[72382]:       <source path='/dev/pts/8'/>
Aug 09 15:17:58 user nova-compute[72382]:       <log file='/opt/stack/data/nova/instances/23f25946-de3a-43fb-97a4-1f9a787e6e51/console.log' append='off'/>
Aug 09 15:17:58 user nova-compute[72382]:       <target type='isa-serial' port='0'>
Aug 09 15:17:58 user nova-compute[72382]:         <model name='isa-serial'/>
Aug 09 15:17:58 user nova-compute[72382]:       </target>
Aug 09 15:17:58 user nova-compute[72382]:       <alias name='serial0'/>
Aug 09 15:17:58 user nova-compute[72382]:     </serial>
Aug 09 15:17:58 user nova-compute[72382]:     <console type='pty' tty='/dev/pts/8'>
Aug 09 15:17:58 user nova-compute[72382]:       <source path='/dev/pts/8'/>
Aug 09 15:17:58 user nova-compute[72382]:       <log file='/opt/stack/data/nova/instances/23f25946-de3a-43fb-97a4-1f9a787e6e51/console.log' append='off'/>
Aug 09 15:17:58 user nova-compute[72382]:       <target type='serial' port='0'/>
Aug 09 15:17:58 user nova-compute[72382]:       <alias name='serial0'/>
Aug 09 15:17:58 user nova-compute[72382]:     </console>
Aug 09 15:17:58 user nova-compute[72382]:     <input type='mouse' bus='ps2'>
Aug 09 15:17:58 user nova-compute[72382]:       <alias name='input0'/>
Aug 09 15:17:58 user nova-compute[72382]:     </input>
Aug 09 15:17:58 user nova-compute[72382]:     <input type='keyboard' bus='ps2'>
Aug 09 15:17:58 user nova-compute[72382]:       <alias name='input1'/>
Aug 09 15:17:58 user nova-compute[72382]:     </input>
Aug 09 15:17:58 user nova-compute[72382]:     <graphics type='vnc' port='5908' autoport='yes' listen='0.0.0.0'>
Aug 09 15:17:58 user nova-compute[72382]:       <listen type='address' address='0.0.0.0'/>
Aug 09 15:17:58 user nova-compute[72382]:     </graphics>
Aug 09 15:17:58 user nova-compute[72382]:     <audio id='1' type='none'/>
Aug 09 15:17:58 user nova-compute[72382]:     <video>
Aug 09 15:17:58 user nova-compute[72382]:       <model type='virtio' heads='1' primary='yes'/>
Aug 09 15:17:58 user nova-compute[72382]:       <alias name='video0'/>
Aug 09 15:17:58 user nova-compute[72382]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Aug 09 15:17:58 user nova-compute[72382]:     </video>
Aug 09 15:17:58 user nova-compute[72382]:     <memballoon model='virtio'>
Aug 09 15:17:58 user nova-compute[72382]:       <stats period='10'/>
Aug 09 15:17:58 user nova-compute[72382]:       <alias name='balloon0'/>
Aug 09 15:17:58 user nova-compute[72382]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Aug 09 15:17:58 user nova-compute[72382]:     </memballoon>
Aug 09 15:17:58 user nova-compute[72382]:     <rng model='virtio'>
Aug 09 15:17:58 user nova-compute[72382]:       <backend model='random'>/dev/urandom</backend>
Aug 09 15:17:58 user nova-compute[72382]:       <alias name='rng0'/>
Aug 09 15:17:58 user nova-compute[72382]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Aug 09 15:17:58 user nova-compute[72382]:     </rng>
Aug 09 15:17:58 user nova-compute[72382]:   </devices>
Aug 09 15:17:58 user nova-compute[72382]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Aug 09 15:17:58 user nova-compute[72382]:     <label>libvirt-23f25946-de3a-43fb-97a4-1f9a787e6e51</label>
Aug 09 15:17:58 user nova-compute[72382]:     <imagelabel>libvirt-23f25946-de3a-43fb-97a4-1f9a787e6e51</imagelabel>
Aug 09 15:17:58 user nova-compute[72382]:   </seclabel>
Aug 09 15:17:58 user nova-compute[72382]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Aug 09 15:17:58 user nova-compute[72382]:     <label>+64055:+108</label>
Aug 09 15:17:58 user nova-compute[72382]:     <imagelabel>+64055:+108</imagelabel>
Aug 09 15:17:58 user nova-compute[72382]:   </seclabel>
Aug 09 15:17:58 user nova-compute[72382]: </domain>
Aug 09 15:17:58 user nova-compute[72382]:  {{(pid=72382) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Aug 09 15:17:58 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-b5b5ac91-bf83-486d-9ee8-2971aefb1473 tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] Successfully detached device tapa67bcfee-00 from instance 23f25946-de3a-43fb-97a4-1f9a787e6e51 from the persistent domain config.
Aug 09 15:17:58 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-b5b5ac91-bf83-486d-9ee8-2971aefb1473 tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] (1/8): Attempting to detach device tapa67bcfee-00 with device alias net1 from instance 23f25946-de3a-43fb-97a4-1f9a787e6e51 from the live domain config. {{(pid=72382) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 15:17:58 user nova-compute[72382]: DEBUG nova.virt.libvirt.guest [None req-b5b5ac91-bf83-486d-9ee8-2971aefb1473 tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] detach device xml: <interface type="ethernet">
Aug 09 15:17:58 user nova-compute[72382]:   <mac address="fa:16:3e:5c:2f:23"/>
Aug 09 15:17:58 user nova-compute[72382]:   <model type="virtio"/>
Aug 09 15:17:58 user nova-compute[72382]:   <mtu size="1442"/>
Aug 09 15:17:58 user nova-compute[72382]:   <target dev="tapa67bcfee-00"/>
Aug 09 15:17:58 user nova-compute[72382]: </interface>
Aug 09 15:17:58 user nova-compute[72382]:  {{(pid=72382) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 15:17:58 user nova-compute[72382]: INFO nova.compute.manager [None req-cc59ad8f-6273-4c23-8869-cc1a783ecb14 tempest-TestVolumeSwap-1225930191 tempest-TestVolumeSwap-1225930191-project-admin] [instance: 9a82f146-97ce-4319-8b25-c1b090965e53] Swapping volume ad1e2adc-5d1a-4718-8971-7d362e291602 for 344efe6d-5a52-4d0d-a34e-da8627a1e09f
Aug 09 15:17:58 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:17:58 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Received event <DeviceRemovedEvent: 1691594278.60595, 23f25946-de3a-43fb-97a4-1f9a787e6e51 => net1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72382) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 15:17:58 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-b5b5ac91-bf83-486d-9ee8-2971aefb1473 tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] Start waiting for the detach event from libvirt for device tapa67bcfee-00 with device alias net1 for instance 23f25946-de3a-43fb-97a4-1f9a787e6e51 {{(pid=72382) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 15:17:58 user nova-compute[72382]: DEBUG nova.virt.libvirt.guest [None req-b5b5ac91-bf83-486d-9ee8-2971aefb1473 tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:5c:2f:23"/><model type="virtio"/><mtu size="1442"/><target dev="tapa67bcfee-00"/></interface> {{(pid=72382) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 09 15:17:58 user nova-compute[72382]: DEBUG nova.virt.libvirt.guest [None req-b5b5ac91-bf83-486d-9ee8-2971aefb1473 tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:5c:2f:23"/><model type="virtio"/><mtu size="1442"/><target dev="tapa67bcfee-00"/></interface>not found in domain: <domain type='kvm' id='9'>
Aug 09 15:17:58 user nova-compute[72382]:   <name>instance-00000009</name>
Aug 09 15:17:58 user nova-compute[72382]:   <uuid>23f25946-de3a-43fb-97a4-1f9a787e6e51</uuid>
Aug 09 15:17:58 user nova-compute[72382]:   <metadata>
Aug 09 15:17:58 user nova-compute[72382]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 15:17:58 user nova-compute[72382]:   <nova:package version="0.0.0"/>
Aug 09 15:17:58 user nova-compute[72382]:   <nova:name>tempest-device-tagging-server-176087286</nova:name>
Aug 09 15:17:58 user nova-compute[72382]:   <nova:creationTime>2023-08-09 15:17:41</nova:creationTime>
Aug 09 15:17:58 user nova-compute[72382]:   <nova:flavor name="m1.tiny">
Aug 09 15:17:58 user nova-compute[72382]:     <nova:memory>512</nova:memory>
Aug 09 15:17:58 user nova-compute[72382]:     <nova:disk>1</nova:disk>
Aug 09 15:17:58 user nova-compute[72382]:     <nova:swap>0</nova:swap>
Aug 09 15:17:58 user nova-compute[72382]:     <nova:ephemeral>0</nova:ephemeral>
Aug 09 15:17:58 user nova-compute[72382]:     <nova:vcpus>1</nova:vcpus>
Aug 09 15:17:58 user nova-compute[72382]:   </nova:flavor>
Aug 09 15:17:58 user nova-compute[72382]:   <nova:owner>
Aug 09 15:17:58 user nova-compute[72382]:     <nova:user uuid="97fa102d2fed4045a326b0f5efbd1b1c">tempest-TaggedAttachmentsTest-605331854-project-member</nova:user>
Aug 09 15:17:58 user nova-compute[72382]:     <nova:project uuid="b84d09ad643146859e76996c09ba02c7">tempest-TaggedAttachmentsTest-605331854</nova:project>
Aug 09 15:17:58 user nova-compute[72382]:   </nova:owner>
Aug 09 15:17:58 user nova-compute[72382]:   <nova:root type="image" uuid="a79f2cea-eb27-4631-aaf3-05e7d9e411b4"/>
Aug 09 15:17:58 user nova-compute[72382]:   <nova:ports>
Aug 09 15:17:58 user nova-compute[72382]:     <nova:port uuid="1c588f02-cc2c-47f1-8918-bf9b1d3ea215">
Aug 09 15:17:58 user nova-compute[72382]:       <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 09 15:17:58 user nova-compute[72382]:     </nova:port>
Aug 09 15:17:58 user nova-compute[72382]:     <nova:port uuid="a67bcfee-0085-436e-8b18-1014b9b40f81">
Aug 09 15:17:58 user nova-compute[72382]:       <nova:ip type="fixed" address="10.10.10.156" ipVersion="4"/>
Aug 09 15:17:58 user nova-compute[72382]:     </nova:port>
Aug 09 15:17:58 user nova-compute[72382]:   </nova:ports>
Aug 09 15:17:58 user nova-compute[72382]: </nova:instance>
Aug 09 15:17:58 user nova-compute[72382]:   </metadata>
Aug 09 15:17:58 user nova-compute[72382]:   <memory unit='KiB'>524288</memory>
Aug 09 15:17:58 user nova-compute[72382]:   <currentMemory unit='KiB'>524288</currentMemory>
Aug 09 15:17:58 user nova-compute[72382]:   <vcpu placement='static'>1</vcpu>
Aug 09 15:17:58 user nova-compute[72382]:   <resource>
Aug 09 15:17:58 user nova-compute[72382]:     <partition>/machine</partition>
Aug 09 15:17:58 user nova-compute[72382]:   </resource>
Aug 09 15:17:58 user nova-compute[72382]:   <sysinfo type='smbios'>
Aug 09 15:17:58 user nova-compute[72382]:     <system>
Aug 09 15:17:58 user nova-compute[72382]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Aug 09 15:17:58 user nova-compute[72382]:       <entry name='product'>OpenStack Nova</entry>
Aug 09 15:17:58 user nova-compute[72382]:       <entry name='version'>0.0.0</entry>
Aug 09 15:17:58 user nova-compute[72382]:       <entry name='serial'>23f25946-de3a-43fb-97a4-1f9a787e6e51</entry>
Aug 09 15:17:58 user nova-compute[72382]:       <entry name='uuid'>23f25946-de3a-43fb-97a4-1f9a787e6e51</entry>
Aug 09 15:17:58 user nova-compute[72382]:       <entry name='family'>Virtual Machine</entry>
Aug 09 15:17:58 user nova-compute[72382]:     </system>
Aug 09 15:17:58 user nova-compute[72382]:   </sysinfo>
Aug 09 15:17:58 user nova-compute[72382]:   <os>
Aug 09 15:17:58 user nova-compute[72382]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Aug 09 15:17:58 user nova-compute[72382]:     <boot dev='hd'/>
Aug 09 15:17:58 user nova-compute[72382]:     <smbios mode='sysinfo'/>
Aug 09 15:17:58 user nova-compute[72382]:   </os>
Aug 09 15:17:58 user nova-compute[72382]:   <features>
Aug 09 15:17:58 user nova-compute[72382]:     <acpi/>
Aug 09 15:17:58 user nova-compute[72382]:     <apic/>
Aug 09 15:17:58 user nova-compute[72382]:     <vmcoreinfo state='on'/>
Aug 09 15:17:58 user nova-compute[72382]:   </features>
Aug 09 15:17:58 user nova-compute[72382]:   <cpu mode='custom' match='exact' check='full'>
Aug 09 15:17:58 user nova-compute[72382]:     <model fallback='forbid'>Nehalem</model>
Aug 09 15:17:58 user nova-compute[72382]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Aug 09 15:17:58 user nova-compute[72382]:     <feature policy='require' name='vme'/>
Aug 09 15:17:58 user nova-compute[72382]:     <feature policy='require' name='x2apic'/>
Aug 09 15:17:58 user nova-compute[72382]:     <feature policy='require' name='hypervisor'/>
Aug 09 15:17:58 user nova-compute[72382]:   </cpu>
Aug 09 15:17:58 user nova-compute[72382]:   <clock offset='utc'>
Aug 09 15:17:58 user nova-compute[72382]:     <timer name='pit' tickpolicy='delay'/>
Aug 09 15:17:58 user nova-compute[72382]:     <timer name='rtc' tickpolicy='catchup'/>
Aug 09 15:17:58 user nova-compute[72382]:     <timer name='hpet' present='no'/>
Aug 09 15:17:58 user nova-compute[72382]:   </clock>
Aug 09 15:17:58 user nova-compute[72382]:   <on_poweroff>destroy</on_poweroff>
Aug 09 15:17:58 user nova-compute[72382]:   <on_reboot>restart</on_reboot>
Aug 09 15:17:58 user nova-compute[72382]:   <on_crash>destroy</on_crash>
Aug 09 15:17:58 user nova-compute[72382]:   <devices>
Aug 09 15:17:58 user nova-compute[72382]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 09 15:17:58 user nova-compute[72382]:     <disk type='file' device='disk'>
Aug 09 15:17:58 user nova-compute[72382]:       <driver name='qemu' type='qcow2' cache='none'/>
Aug 09 15:17:58 user nova-compute[72382]:       <source file='/opt/stack/data/nova/instances/23f25946-de3a-43fb-97a4-1f9a787e6e51/disk' index='2'/>
Aug 09 15:17:58 user nova-compute[72382]:       <backingStore type='file' index='3'>
Aug 09 15:17:58 user nova-compute[72382]:         <format type='raw'/>
Aug 09 15:17:58 user nova-compute[72382]:         <source file='/opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b'/>
Aug 09 15:17:58 user nova-compute[72382]:         <backingStore/>
Aug 09 15:17:58 user nova-compute[72382]:       </backingStore>
Aug 09 15:17:58 user nova-compute[72382]:       <target dev='vda' bus='virtio'/>
Aug 09 15:17:58 user nova-compute[72382]:       <alias name='virtio-disk0'/>
Aug 09 15:17:58 user nova-compute[72382]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Aug 09 15:17:58 user nova-compute[72382]:     </disk>
Aug 09 15:17:58 user nova-compute[72382]:     <disk type='file' device='cdrom'>
Aug 09 15:17:58 user nova-compute[72382]:       <driver name='qemu' type='raw' cache='none'/>
Aug 09 15:17:58 user nova-compute[72382]:       <source file='/opt/stack/data/nova/instances/23f25946-de3a-43fb-97a4-1f9a787e6e51/disk.config' index='1'/>
Aug 09 15:17:58 user nova-compute[72382]:       <backingStore/>
Aug 09 15:17:58 user nova-compute[72382]:       <target dev='hda' bus='ide'/>
Aug 09 15:17:58 user nova-compute[72382]:       <readonly/>
Aug 09 15:17:58 user nova-compute[72382]:       <alias name='ide0-0-0'/>
Aug 09 15:17:58 user nova-compute[72382]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Aug 09 15:17:58 user nova-compute[72382]:     </disk>
Aug 09 15:17:58 user nova-compute[72382]:     <controller type='usb' index='0' model='none'>
Aug 09 15:17:58 user nova-compute[72382]:       <alias name='usb'/>
Aug 09 15:17:58 user nova-compute[72382]:     </controller>
Aug 09 15:17:58 user nova-compute[72382]:     <controller type='pci' index='0' model='pci-root'>
Aug 09 15:17:58 user nova-compute[72382]:       <alias name='pci.0'/>
Aug 09 15:17:58 user nova-compute[72382]:     </controller>
Aug 09 15:17:58 user nova-compute[72382]:     <controller type='ide' index='0'>
Aug 09 15:17:58 user nova-compute[72382]:       <alias name='ide'/>
Aug 09 15:17:58 user nova-compute[72382]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Aug 09 15:17:58 user nova-compute[72382]:     </controller>
Aug 09 15:17:58 user nova-compute[72382]:     <interface type='ethernet'>
Aug 09 15:17:58 user nova-compute[72382]:       <mac address='fa:16:3e:b1:4d:7d'/>
Aug 09 15:17:58 user nova-compute[72382]:       <target dev='tap1c588f02-cc'/>
Aug 09 15:17:58 user nova-compute[72382]:       <model type='virtio'/>
Aug 09 15:17:58 user nova-compute[72382]:       <mtu size='1442'/>
Aug 09 15:17:58 user nova-compute[72382]:       <alias name='net0'/>
Aug 09 15:17:58 user nova-compute[72382]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Aug 09 15:17:58 user nova-compute[72382]:     </interface>
Aug 09 15:17:58 user nova-compute[72382]:     <serial type='pty'>
Aug 09 15:17:58 user nova-compute[72382]:       <source path='/dev/pts/8'/>
Aug 09 15:17:58 user nova-compute[72382]:       <log file='/opt/stack/data/nova/instances/23f25946-de3a-43fb-97a4-1f9a787e6e51/console.log' append='off'/>
Aug 09 15:17:58 user nova-compute[72382]:       <target type='isa-serial' port='0'>
Aug 09 15:17:58 user nova-compute[72382]:         <model name='isa-serial'/>
Aug 09 15:17:58 user nova-compute[72382]:       </target>
Aug 09 15:17:58 user nova-compute[72382]:       <alias name='serial0'/>
Aug 09 15:17:58 user nova-compute[72382]:     </serial>
Aug 09 15:17:58 user nova-compute[72382]:     <console type='pty' tty='/dev/pts/8'>
Aug 09 15:17:58 user nova-compute[72382]:       <source path='/dev/pts/8'/>
Aug 09 15:17:58 user nova-compute[72382]:       <log file='/opt/stack/data/nova/instances/23f25946-de3a-43fb-97a4-1f9a787e6e51/console.log' append='off'/>
Aug 09 15:17:58 user nova-compute[72382]:       <target type='serial' port='0'/>
Aug 09 15:17:58 user nova-compute[72382]:       <alias name='serial0'/>
Aug 09 15:17:58 user nova-compute[72382]:     </console>
Aug 09 15:17:58 user nova-compute[72382]:     <input type='mouse' bus='ps2'>
Aug 09 15:17:58 user nova-compute[72382]:       <alias name='input0'/>
Aug 09 15:17:58 user nova-compute[72382]:     </input>
Aug 09 15:17:58 user nova-compute[72382]:     <input type='keyboard' bus='ps2'>
Aug 09 15:17:58 user nova-compute[72382]:       <alias name='input1'/>
Aug 09 15:17:58 user nova-compute[72382]:     </input>
Aug 09 15:17:58 user nova-compute[72382]:     <graphics type='vnc' port='5908' autoport='yes' listen='0.0.0.0'>
Aug 09 15:17:58 user nova-compute[72382]:       <listen type='address' address='0.0.0.0'/>
Aug 09 15:17:58 user nova-compute[72382]:     </graphics>
Aug 09 15:17:58 user nova-compute[72382]:     <audio id='1' type='none'/>
Aug 09 15:17:58 user nova-compute[72382]:     <video>
Aug 09 15:17:58 user nova-compute[72382]:       <model type='virtio' heads='1' primary='yes'/>
Aug 09 15:17:58 user nova-compute[72382]:       <alias name='video0'/>
Aug 09 15:17:58 user nova-compute[72382]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Aug 09 15:17:58 user nova-compute[72382]:     </video>
Aug 09 15:17:58 user nova-compute[72382]:     <memballoon model='virtio'>
Aug 09 15:17:58 user nova-compute[72382]:       <stats period='10'/>
Aug 09 15:17:58 user nova-compute[72382]:       <alias name='balloon0'/>
Aug 09 15:17:58 user nova-compute[72382]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Aug 09 15:17:58 user nova-compute[72382]:     </memballoon>
Aug 09 15:17:58 user nova-compute[72382]:     <rng model='virtio'>
Aug 09 15:17:58 user nova-compute[72382]:       <backend model='random'>/dev/urandom</backend>
Aug 09 15:17:58 user nova-compute[72382]:       <alias name='rng0'/>
Aug 09 15:17:58 user nova-compute[72382]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Aug 09 15:17:58 user nova-compute[72382]:     </rng>
Aug 09 15:17:58 user nova-compute[72382]:   </devices>
Aug 09 15:17:58 user nova-compute[72382]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Aug 09 15:17:58 user nova-compute[72382]:     <label>libvirt-23f25946-de3a-43fb-97a4-1f9a787e6e51</label>
Aug 09 15:17:58 user nova-compute[72382]:     <imagelabel>libvirt-23f25946-de3a-43fb-97a4-1f9a787e6e51</imagelabel>
Aug 09 15:17:58 user nova-compute[72382]:   </seclabel>
Aug 09 15:17:58 user nova-compute[72382]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Aug 09 15:17:58 user nova-compute[72382]:     <label>+64055:+108</label>
Aug 09 15:17:58 user nova-compute[72382]:     <imagelabel>+64055:+108</imagelabel>
Aug 09 15:17:58 user nova-compute[72382]:   </seclabel>
Aug 09 15:17:58 user nova-compute[72382]: </domain>
Aug 09 15:17:58 user nova-compute[72382]:  {{(pid=72382) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Aug 09 15:17:58 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-b5b5ac91-bf83-486d-9ee8-2971aefb1473 tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] Successfully detached device tapa67bcfee-00 from instance 23f25946-de3a-43fb-97a4-1f9a787e6e51 from the live domain config.
Aug 09 15:17:58 user nova-compute[72382]: DEBUG nova.virt.libvirt.vif [None req-b5b5ac91-bf83-486d-9ee8-2971aefb1473 tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T15:15:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-176087286',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-176087286',id=9,image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF4pKUdXj5zZfLZFWCxFHz8jMa5yp/7/IPCXi1mkSKd0mYycvxd7H8zaZJVqn1Nt7uBCqZDaWzic3f3975RUjfs8oAsAozBRZ/XXtDelWRnO6lHLhAgDLjQA+jzema7e1g==',key_name='tempest-keypair-1955626579',keypairs=<?>,launch_index=0,launched_at=2023-08-09T15:15:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b84d09ad643146859e76996c09ba02c7',ramdisk_id='',reservation_id='r-sy0nsoiy',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-605331854',owner_user_name='tempest-TaggedAttachmentsTest-605331854-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T15:16:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='97fa102d2fed4045a326b0f5efbd1b1c',uuid=23f25946-de3a-43fb-97a4-1f9a787e6e51,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a67bcfee-0085-436e-8b18-1014b9b40f81", "address": "fa:16:3e:5c:2f:23", "network": {"id": "224c3e1d-3948-43d1-bb02-76a05add8f1e", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-126262034", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.156", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "b84d09ad643146859e76996c09ba02c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa67bcfee-00", "ovs_interfaceid": "a67bcfee-0085-436e-8b18-1014b9b40f81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 15:17:58 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-b5b5ac91-bf83-486d-9ee8-2971aefb1473 tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] Converting VIF {"id": "a67bcfee-0085-436e-8b18-1014b9b40f81", "address": "fa:16:3e:5c:2f:23", "network": {"id": "224c3e1d-3948-43d1-bb02-76a05add8f1e", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-126262034", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.156", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "b84d09ad643146859e76996c09ba02c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa67bcfee-00", "ovs_interfaceid": "a67bcfee-0085-436e-8b18-1014b9b40f81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 15:17:58 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-b5b5ac91-bf83-486d-9ee8-2971aefb1473 tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5c:2f:23,bridge_name='br-int',has_traffic_filtering=True,id=a67bcfee-0085-436e-8b18-1014b9b40f81,network=Network(224c3e1d-3948-43d1-bb02-76a05add8f1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa67bcfee-00') {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 15:17:58 user nova-compute[72382]: DEBUG os_vif [None req-b5b5ac91-bf83-486d-9ee8-2971aefb1473 tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:2f:23,bridge_name='br-int',has_traffic_filtering=True,id=a67bcfee-0085-436e-8b18-1014b9b40f81,network=Network(224c3e1d-3948-43d1-bb02-76a05add8f1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa67bcfee-00') {{(pid=72382) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 15:17:58 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:17:58 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa67bcfee-00, bridge=br-int, if_exists=True) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:17:58 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:17:58 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:17:58 user nova-compute[72382]: INFO os_vif [None req-b5b5ac91-bf83-486d-9ee8-2971aefb1473 tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:2f:23,bridge_name='br-int',has_traffic_filtering=True,id=a67bcfee-0085-436e-8b18-1014b9b40f81,network=Network(224c3e1d-3948-43d1-bb02-76a05add8f1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa67bcfee-00')
Aug 09 15:17:58 user nova-compute[72382]: DEBUG nova.virt.libvirt.guest [None req-b5b5ac91-bf83-486d-9ee8-2971aefb1473 tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 15:17:58 user nova-compute[72382]:   <nova:package version="0.0.0"/>
Aug 09 15:17:58 user nova-compute[72382]:   <nova:name>tempest-device-tagging-server-176087286</nova:name>
Aug 09 15:17:58 user nova-compute[72382]:   <nova:creationTime>2023-08-09 15:17:58</nova:creationTime>
Aug 09 15:17:58 user nova-compute[72382]:   <nova:flavor name="m1.tiny">
Aug 09 15:17:58 user nova-compute[72382]:     <nova:memory>512</nova:memory>
Aug 09 15:17:58 user nova-compute[72382]:     <nova:disk>1</nova:disk>
Aug 09 15:17:58 user nova-compute[72382]:     <nova:swap>0</nova:swap>
Aug 09 15:17:58 user nova-compute[72382]:     <nova:ephemeral>0</nova:ephemeral>
Aug 09 15:17:58 user nova-compute[72382]:     <nova:vcpus>1</nova:vcpus>
Aug 09 15:17:58 user nova-compute[72382]:   </nova:flavor>
Aug 09 15:17:58 user nova-compute[72382]:   <nova:owner>
Aug 09 15:17:58 user nova-compute[72382]:     <nova:user uuid="97fa102d2fed4045a326b0f5efbd1b1c">tempest-TaggedAttachmentsTest-605331854-project-member</nova:user>
Aug 09 15:17:58 user nova-compute[72382]:     <nova:project uuid="b84d09ad643146859e76996c09ba02c7">tempest-TaggedAttachmentsTest-605331854</nova:project>
Aug 09 15:17:58 user nova-compute[72382]:   </nova:owner>
Aug 09 15:17:58 user nova-compute[72382]:   <nova:root type="image" uuid="a79f2cea-eb27-4631-aaf3-05e7d9e411b4"/>
Aug 09 15:17:58 user nova-compute[72382]:   <nova:ports>
Aug 09 15:17:58 user nova-compute[72382]:     <nova:port uuid="1c588f02-cc2c-47f1-8918-bf9b1d3ea215">
Aug 09 15:17:58 user nova-compute[72382]:       <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 09 15:17:58 user nova-compute[72382]:     </nova:port>
Aug 09 15:17:58 user nova-compute[72382]:   </nova:ports>
Aug 09 15:17:58 user nova-compute[72382]: </nova:instance>
Aug 09 15:17:58 user nova-compute[72382]:  {{(pid=72382) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Aug 09 15:17:58 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:17:58 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:17:58 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:17:58 user nova-compute[72382]: DEBUG nova.compute.manager [req-3c680cfa-8d34-43d7-a641-baf27b52af58 req-13623403-690d-4715-90c7-e26aff66c41f service nova] [instance: 23f25946-de3a-43fb-97a4-1f9a787e6e51] Received event network-vif-unplugged-a67bcfee-0085-436e-8b18-1014b9b40f81 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:17:58 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-3c680cfa-8d34-43d7-a641-baf27b52af58 req-13623403-690d-4715-90c7-e26aff66c41f service nova] Acquiring lock "23f25946-de3a-43fb-97a4-1f9a787e6e51-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:17:58 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-3c680cfa-8d34-43d7-a641-baf27b52af58 req-13623403-690d-4715-90c7-e26aff66c41f service nova] Lock "23f25946-de3a-43fb-97a4-1f9a787e6e51-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:17:58 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-3c680cfa-8d34-43d7-a641-baf27b52af58 req-13623403-690d-4715-90c7-e26aff66c41f service nova] Lock "23f25946-de3a-43fb-97a4-1f9a787e6e51-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:17:58 user nova-compute[72382]: DEBUG nova.compute.manager [req-3c680cfa-8d34-43d7-a641-baf27b52af58 req-13623403-690d-4715-90c7-e26aff66c41f service nova] [instance: 23f25946-de3a-43fb-97a4-1f9a787e6e51] No waiting events found dispatching network-vif-unplugged-a67bcfee-0085-436e-8b18-1014b9b40f81 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:17:58 user nova-compute[72382]: WARNING nova.compute.manager [req-3c680cfa-8d34-43d7-a641-baf27b52af58 req-13623403-690d-4715-90c7-e26aff66c41f service nova] [instance: 23f25946-de3a-43fb-97a4-1f9a787e6e51] Received unexpected event network-vif-unplugged-a67bcfee-0085-436e-8b18-1014b9b40f81 for instance with vm_state active and task_state None.
Aug 09 15:17:59 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:17:59 user nova-compute[72382]: DEBUG nova.compute.manager [req-b8fdd5cc-efb9-45a3-87d8-c21340620f48 req-dc4ba890-b2cf-4bb9-9546-2d59062f4951 service nova] [instance: 23f25946-de3a-43fb-97a4-1f9a787e6e51] Received event network-vif-deleted-a67bcfee-0085-436e-8b18-1014b9b40f81 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:17:59 user nova-compute[72382]: INFO nova.compute.manager [req-b8fdd5cc-efb9-45a3-87d8-c21340620f48 req-dc4ba890-b2cf-4bb9-9546-2d59062f4951 service nova] [instance: 23f25946-de3a-43fb-97a4-1f9a787e6e51] Neutron deleted interface a67bcfee-0085-436e-8b18-1014b9b40f81; detaching it from the instance and deleting it from the info cache
Aug 09 15:17:59 user nova-compute[72382]: DEBUG nova.network.neutron [req-b8fdd5cc-efb9-45a3-87d8-c21340620f48 req-dc4ba890-b2cf-4bb9-9546-2d59062f4951 service nova] [instance: 23f25946-de3a-43fb-97a4-1f9a787e6e51] Updating instance_info_cache with network_info: [{"id": "1c588f02-cc2c-47f1-8918-bf9b1d3ea215", "address": "fa:16:3e:b1:4d:7d", "network": {"id": "e5132afa-231c-471e-b11a-a6e972603b0c", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2085484007-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b84d09ad643146859e76996c09ba02c7", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c588f02-cc", "ovs_interfaceid": "1c588f02-cc2c-47f1-8918-bf9b1d3ea215", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:17:59 user nova-compute[72382]: DEBUG nova.objects.instance [req-b8fdd5cc-efb9-45a3-87d8-c21340620f48 req-dc4ba890-b2cf-4bb9-9546-2d59062f4951 service nova] Lazy-loading 'system_metadata' on Instance uuid 23f25946-de3a-43fb-97a4-1f9a787e6e51 {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:17:59 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-b5b5ac91-bf83-486d-9ee8-2971aefb1473 tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] Acquiring lock "refresh_cache-23f25946-de3a-43fb-97a4-1f9a787e6e51" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 15:17:59 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-b5b5ac91-bf83-486d-9ee8-2971aefb1473 tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] Acquired lock "refresh_cache-23f25946-de3a-43fb-97a4-1f9a787e6e51" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 15:17:59 user nova-compute[72382]: DEBUG nova.network.neutron [None req-b5b5ac91-bf83-486d-9ee8-2971aefb1473 tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] [instance: 23f25946-de3a-43fb-97a4-1f9a787e6e51] Building network info cache for instance {{(pid=72382) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 15:17:59 user nova-compute[72382]: DEBUG nova.objects.instance [req-b8fdd5cc-efb9-45a3-87d8-c21340620f48 req-dc4ba890-b2cf-4bb9-9546-2d59062f4951 service nova] Lazy-loading 'flavor' on Instance uuid 23f25946-de3a-43fb-97a4-1f9a787e6e51 {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:17:59 user nova-compute[72382]: DEBUG nova.virt.libvirt.vif [req-b8fdd5cc-efb9-45a3-87d8-c21340620f48 req-dc4ba890-b2cf-4bb9-9546-2d59062f4951 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T15:15:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-176087286',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-176087286',id=9,image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF4pKUdXj5zZfLZFWCxFHz8jMa5yp/7/IPCXi1mkSKd0mYycvxd7H8zaZJVqn1Nt7uBCqZDaWzic3f3975RUjfs8oAsAozBRZ/XXtDelWRnO6lHLhAgDLjQA+jzema7e1g==',key_name='tempest-keypair-1955626579',keypairs=<?>,launch_index=0,launched_at=2023-08-09T15:15:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b84d09ad643146859e76996c09ba02c7',ramdisk_id='',reservation_id='r-sy0nsoiy',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-605331854',owner_user_name='tempest-TaggedAttachmentsTest-605331854-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T15:16:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='97fa102d2fed4045a326b0f5efbd1b1c',uuid=23f25946-de3a-43fb-97a4-1f9a787e6e51,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a67bcfee-0085-436e-8b18-1014b9b40f81", "address": "fa:16:3e:5c:2f:23", "network": {"id": "224c3e1d-3948-43d1-bb02-76a05add8f1e", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-126262034", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.156", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "b84d09ad643146859e76996c09ba02c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa67bcfee-00", "ovs_interfaceid": "a67bcfee-0085-436e-8b18-1014b9b40f81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72382) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 15:17:59 user nova-compute[72382]: DEBUG nova.network.os_vif_util [req-b8fdd5cc-efb9-45a3-87d8-c21340620f48 req-dc4ba890-b2cf-4bb9-9546-2d59062f4951 service nova] Converting VIF {"id": "a67bcfee-0085-436e-8b18-1014b9b40f81", "address": "fa:16:3e:5c:2f:23", "network": {"id": "224c3e1d-3948-43d1-bb02-76a05add8f1e", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-126262034", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.156", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "b84d09ad643146859e76996c09ba02c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa67bcfee-00", "ovs_interfaceid": "a67bcfee-0085-436e-8b18-1014b9b40f81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 15:17:59 user nova-compute[72382]: DEBUG nova.network.os_vif_util [req-b8fdd5cc-efb9-45a3-87d8-c21340620f48 req-dc4ba890-b2cf-4bb9-9546-2d59062f4951 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5c:2f:23,bridge_name='br-int',has_traffic_filtering=True,id=a67bcfee-0085-436e-8b18-1014b9b40f81,network=Network(224c3e1d-3948-43d1-bb02-76a05add8f1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa67bcfee-00') {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 15:17:59 user nova-compute[72382]: DEBUG nova.virt.libvirt.guest [req-b8fdd5cc-efb9-45a3-87d8-c21340620f48 req-dc4ba890-b2cf-4bb9-9546-2d59062f4951 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:5c:2f:23"/><model type="virtio"/><mtu size="1442"/><target dev="tapa67bcfee-00"/></interface> {{(pid=72382) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 09 15:17:59 user nova-compute[72382]: DEBUG nova.virt.libvirt.guest [req-b8fdd5cc-efb9-45a3-87d8-c21340620f48 req-dc4ba890-b2cf-4bb9-9546-2d59062f4951 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:5c:2f:23"/><model type="virtio"/><mtu size="1442"/><target dev="tapa67bcfee-00"/></interface>not found in domain: <domain type='kvm' id='9'>
Aug 09 15:17:59 user nova-compute[72382]:   <name>instance-00000009</name>
Aug 09 15:17:59 user nova-compute[72382]:   <uuid>23f25946-de3a-43fb-97a4-1f9a787e6e51</uuid>
Aug 09 15:17:59 user nova-compute[72382]:   <metadata>
Aug 09 15:17:59 user nova-compute[72382]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 15:17:59 user nova-compute[72382]:   <nova:package version="0.0.0"/>
Aug 09 15:17:59 user nova-compute[72382]:   <nova:name>tempest-device-tagging-server-176087286</nova:name>
Aug 09 15:17:59 user nova-compute[72382]:   <nova:creationTime>2023-08-09 15:17:58</nova:creationTime>
Aug 09 15:17:59 user nova-compute[72382]:   <nova:flavor name="m1.tiny">
Aug 09 15:17:59 user nova-compute[72382]:     <nova:memory>512</nova:memory>
Aug 09 15:17:59 user nova-compute[72382]:     <nova:disk>1</nova:disk>
Aug 09 15:17:59 user nova-compute[72382]:     <nova:swap>0</nova:swap>
Aug 09 15:17:59 user nova-compute[72382]:     <nova:ephemeral>0</nova:ephemeral>
Aug 09 15:17:59 user nova-compute[72382]:     <nova:vcpus>1</nova:vcpus>
Aug 09 15:17:59 user nova-compute[72382]:   </nova:flavor>
Aug 09 15:17:59 user nova-compute[72382]:   <nova:owner>
Aug 09 15:17:59 user nova-compute[72382]:     <nova:user uuid="97fa102d2fed4045a326b0f5efbd1b1c">tempest-TaggedAttachmentsTest-605331854-project-member</nova:user>
Aug 09 15:17:59 user nova-compute[72382]:     <nova:project uuid="b84d09ad643146859e76996c09ba02c7">tempest-TaggedAttachmentsTest-605331854</nova:project>
Aug 09 15:17:59 user nova-compute[72382]:   </nova:owner>
Aug 09 15:17:59 user nova-compute[72382]:   <nova:root type="image" uuid="a79f2cea-eb27-4631-aaf3-05e7d9e411b4"/>
Aug 09 15:17:59 user nova-compute[72382]:   <nova:ports>
Aug 09 15:17:59 user nova-compute[72382]:     <nova:port uuid="1c588f02-cc2c-47f1-8918-bf9b1d3ea215">
Aug 09 15:17:59 user nova-compute[72382]:       <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 09 15:17:59 user nova-compute[72382]:     </nova:port>
Aug 09 15:17:59 user nova-compute[72382]:   </nova:ports>
Aug 09 15:17:59 user nova-compute[72382]: </nova:instance>
Aug 09 15:17:59 user nova-compute[72382]:   </metadata>
Aug 09 15:17:59 user nova-compute[72382]:   <memory unit='KiB'>524288</memory>
Aug 09 15:17:59 user nova-compute[72382]:   <currentMemory unit='KiB'>524288</currentMemory>
Aug 09 15:17:59 user nova-compute[72382]:   <vcpu placement='static'>1</vcpu>
Aug 09 15:17:59 user nova-compute[72382]:   <resource>
Aug 09 15:17:59 user nova-compute[72382]:     <partition>/machine</partition>
Aug 09 15:17:59 user nova-compute[72382]:   </resource>
Aug 09 15:17:59 user nova-compute[72382]:   <sysinfo type='smbios'>
Aug 09 15:17:59 user nova-compute[72382]:     <system>
Aug 09 15:17:59 user nova-compute[72382]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Aug 09 15:17:59 user nova-compute[72382]:       <entry name='product'>OpenStack Nova</entry>
Aug 09 15:17:59 user nova-compute[72382]:       <entry name='version'>0.0.0</entry>
Aug 09 15:17:59 user nova-compute[72382]:       <entry name='serial'>23f25946-de3a-43fb-97a4-1f9a787e6e51</entry>
Aug 09 15:17:59 user nova-compute[72382]:       <entry name='uuid'>23f25946-de3a-43fb-97a4-1f9a787e6e51</entry>
Aug 09 15:17:59 user nova-compute[72382]:       <entry name='family'>Virtual Machine</entry>
Aug 09 15:17:59 user nova-compute[72382]:     </system>
Aug 09 15:17:59 user nova-compute[72382]:   </sysinfo>
Aug 09 15:17:59 user nova-compute[72382]:   <os>
Aug 09 15:17:59 user nova-compute[72382]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Aug 09 15:17:59 user nova-compute[72382]:     <boot dev='hd'/>
Aug 09 15:17:59 user nova-compute[72382]:     <smbios mode='sysinfo'/>
Aug 09 15:17:59 user nova-compute[72382]:   </os>
Aug 09 15:17:59 user nova-compute[72382]:   <features>
Aug 09 15:17:59 user nova-compute[72382]:     <acpi/>
Aug 09 15:17:59 user nova-compute[72382]:     <apic/>
Aug 09 15:17:59 user nova-compute[72382]:     <vmcoreinfo state='on'/>
Aug 09 15:17:59 user nova-compute[72382]:   </features>
Aug 09 15:17:59 user nova-compute[72382]:   <cpu mode='custom' match='exact' check='full'>
Aug 09 15:17:59 user nova-compute[72382]:     <model fallback='forbid'>Nehalem</model>
Aug 09 15:17:59 user nova-compute[72382]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Aug 09 15:17:59 user nova-compute[72382]:     <feature policy='require' name='vme'/>
Aug 09 15:17:59 user nova-compute[72382]:     <feature policy='require' name='x2apic'/>
Aug 09 15:17:59 user nova-compute[72382]:     <feature policy='require' name='hypervisor'/>
Aug 09 15:17:59 user nova-compute[72382]:   </cpu>
Aug 09 15:17:59 user nova-compute[72382]:   <clock offset='utc'>
Aug 09 15:17:59 user nova-compute[72382]:     <timer name='pit' tickpolicy='delay'/>
Aug 09 15:17:59 user nova-compute[72382]:     <timer name='rtc' tickpolicy='catchup'/>
Aug 09 15:17:59 user nova-compute[72382]:     <timer name='hpet' present='no'/>
Aug 09 15:17:59 user nova-compute[72382]:   </clock>
Aug 09 15:17:59 user nova-compute[72382]:   <on_poweroff>destroy</on_poweroff>
Aug 09 15:17:59 user nova-compute[72382]:   <on_reboot>restart</on_reboot>
Aug 09 15:17:59 user nova-compute[72382]:   <on_crash>destroy</on_crash>
Aug 09 15:17:59 user nova-compute[72382]:   <devices>
Aug 09 15:17:59 user nova-compute[72382]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 09 15:17:59 user nova-compute[72382]:     <disk type='file' device='disk'>
Aug 09 15:17:59 user nova-compute[72382]:       <driver name='qemu' type='qcow2' cache='none'/>
Aug 09 15:17:59 user nova-compute[72382]:       <source file='/opt/stack/data/nova/instances/23f25946-de3a-43fb-97a4-1f9a787e6e51/disk' index='2'/>
Aug 09 15:17:59 user nova-compute[72382]:       <backingStore type='file' index='3'>
Aug 09 15:17:59 user nova-compute[72382]:         <format type='raw'/>
Aug 09 15:17:59 user nova-compute[72382]:         <source file='/opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b'/>
Aug 09 15:17:59 user nova-compute[72382]:         <backingStore/>
Aug 09 15:17:59 user nova-compute[72382]:       </backingStore>
Aug 09 15:17:59 user nova-compute[72382]:       <target dev='vda' bus='virtio'/>
Aug 09 15:17:59 user nova-compute[72382]:       <alias name='virtio-disk0'/>
Aug 09 15:17:59 user nova-compute[72382]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Aug 09 15:17:59 user nova-compute[72382]:     </disk>
Aug 09 15:17:59 user nova-compute[72382]:     <disk type='file' device='cdrom'>
Aug 09 15:17:59 user nova-compute[72382]:       <driver name='qemu' type='raw' cache='none'/>
Aug 09 15:17:59 user nova-compute[72382]:       <source file='/opt/stack/data/nova/instances/23f25946-de3a-43fb-97a4-1f9a787e6e51/disk.config' index='1'/>
Aug 09 15:17:59 user nova-compute[72382]:       <backingStore/>
Aug 09 15:17:59 user nova-compute[72382]:       <target dev='hda' bus='ide'/>
Aug 09 15:17:59 user nova-compute[72382]:       <readonly/>
Aug 09 15:17:59 user nova-compute[72382]:       <alias name='ide0-0-0'/>
Aug 09 15:17:59 user nova-compute[72382]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Aug 09 15:17:59 user nova-compute[72382]:     </disk>
Aug 09 15:17:59 user nova-compute[72382]:     <controller type='usb' index='0' model='none'>
Aug 09 15:17:59 user nova-compute[72382]:       <alias name='usb'/>
Aug 09 15:17:59 user nova-compute[72382]:     </controller>
Aug 09 15:17:59 user nova-compute[72382]:     <controller type='pci' index='0' model='pci-root'>
Aug 09 15:17:59 user nova-compute[72382]:       <alias name='pci.0'/>
Aug 09 15:17:59 user nova-compute[72382]:     </controller>
Aug 09 15:17:59 user nova-compute[72382]:     <controller type='ide' index='0'>
Aug 09 15:17:59 user nova-compute[72382]:       <alias name='ide'/>
Aug 09 15:17:59 user nova-compute[72382]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Aug 09 15:17:59 user nova-compute[72382]:     </controller>
Aug 09 15:17:59 user nova-compute[72382]:     <interface type='ethernet'>
Aug 09 15:17:59 user nova-compute[72382]:       <mac address='fa:16:3e:b1:4d:7d'/>
Aug 09 15:17:59 user nova-compute[72382]:       <target dev='tap1c588f02-cc'/>
Aug 09 15:17:59 user nova-compute[72382]:       <model type='virtio'/>
Aug 09 15:17:59 user nova-compute[72382]:       <mtu size='1442'/>
Aug 09 15:17:59 user nova-compute[72382]:       <alias name='net0'/>
Aug 09 15:17:59 user nova-compute[72382]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Aug 09 15:17:59 user nova-compute[72382]:     </interface>
Aug 09 15:17:59 user nova-compute[72382]:     <serial type='pty'>
Aug 09 15:17:59 user nova-compute[72382]:       <source path='/dev/pts/8'/>
Aug 09 15:17:59 user nova-compute[72382]:       <log file='/opt/stack/data/nova/instances/23f25946-de3a-43fb-97a4-1f9a787e6e51/console.log' append='off'/>
Aug 09 15:17:59 user nova-compute[72382]:       <target type='isa-serial' port='0'>
Aug 09 15:17:59 user nova-compute[72382]:         <model name='isa-serial'/>
Aug 09 15:17:59 user nova-compute[72382]:       </target>
Aug 09 15:17:59 user nova-compute[72382]:       <alias name='serial0'/>
Aug 09 15:17:59 user nova-compute[72382]:     </serial>
Aug 09 15:17:59 user nova-compute[72382]:     <console type='pty' tty='/dev/pts/8'>
Aug 09 15:17:59 user nova-compute[72382]:       <source path='/dev/pts/8'/>
Aug 09 15:17:59 user nova-compute[72382]:       <log file='/opt/stack/data/nova/instances/23f25946-de3a-43fb-97a4-1f9a787e6e51/console.log' append='off'/>
Aug 09 15:17:59 user nova-compute[72382]:       <target type='serial' port='0'/>
Aug 09 15:17:59 user nova-compute[72382]:       <alias name='serial0'/>
Aug 09 15:17:59 user nova-compute[72382]:     </console>
Aug 09 15:17:59 user nova-compute[72382]:     <input type='mouse' bus='ps2'>
Aug 09 15:17:59 user nova-compute[72382]:       <alias name='input0'/>
Aug 09 15:17:59 user nova-compute[72382]:     </input>
Aug 09 15:17:59 user nova-compute[72382]:     <input type='keyboard' bus='ps2'>
Aug 09 15:17:59 user nova-compute[72382]:       <alias name='input1'/>
Aug 09 15:17:59 user nova-compute[72382]:     </input>
Aug 09 15:17:59 user nova-compute[72382]:     <graphics type='vnc' port='5908' autoport='yes' listen='0.0.0.0'>
Aug 09 15:17:59 user nova-compute[72382]:       <listen type='address' address='0.0.0.0'/>
Aug 09 15:17:59 user nova-compute[72382]:     </graphics>
Aug 09 15:17:59 user nova-compute[72382]:     <audio id='1' type='none'/>
Aug 09 15:17:59 user nova-compute[72382]:     <video>
Aug 09 15:17:59 user nova-compute[72382]:       <model type='virtio' heads='1' primary='yes'/>
Aug 09 15:17:59 user nova-compute[72382]:       <alias name='video0'/>
Aug 09 15:17:59 user nova-compute[72382]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Aug 09 15:17:59 user nova-compute[72382]:     </video>
Aug 09 15:17:59 user nova-compute[72382]:     <memballoon model='virtio'>
Aug 09 15:17:59 user nova-compute[72382]:       <stats period='10'/>
Aug 09 15:17:59 user nova-compute[72382]:       <alias name='balloon0'/>
Aug 09 15:17:59 user nova-compute[72382]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Aug 09 15:17:59 user nova-compute[72382]:     </memballoon>
Aug 09 15:17:59 user nova-compute[72382]:     <rng model='virtio'>
Aug 09 15:17:59 user nova-compute[72382]:       <backend model='random'>/dev/urandom</backend>
Aug 09 15:17:59 user nova-compute[72382]:       <alias name='rng0'/>
Aug 09 15:17:59 user nova-compute[72382]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Aug 09 15:17:59 user nova-compute[72382]:     </rng>
Aug 09 15:17:59 user nova-compute[72382]:   </devices>
Aug 09 15:17:59 user nova-compute[72382]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Aug 09 15:17:59 user nova-compute[72382]:     <label>libvirt-23f25946-de3a-43fb-97a4-1f9a787e6e51</label>
Aug 09 15:17:59 user nova-compute[72382]:     <imagelabel>libvirt-23f25946-de3a-43fb-97a4-1f9a787e6e51</imagelabel>
Aug 09 15:17:59 user nova-compute[72382]:   </seclabel>
Aug 09 15:17:59 user nova-compute[72382]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Aug 09 15:17:59 user nova-compute[72382]:     <label>+64055:+108</label>
Aug 09 15:17:59 user nova-compute[72382]:     <imagelabel>+64055:+108</imagelabel>
Aug 09 15:17:59 user nova-compute[72382]:   </seclabel>
Aug 09 15:17:59 user nova-compute[72382]: </domain>
Aug 09 15:17:59 user nova-compute[72382]:  {{(pid=72382) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Aug 09 15:17:59 user nova-compute[72382]: DEBUG nova.virt.libvirt.guest [req-b8fdd5cc-efb9-45a3-87d8-c21340620f48 req-dc4ba890-b2cf-4bb9-9546-2d59062f4951 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:5c:2f:23"/><model type="virtio"/><mtu size="1442"/><target dev="tapa67bcfee-00"/></interface> {{(pid=72382) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 09 15:17:59 user nova-compute[72382]: DEBUG nova.virt.libvirt.guest [req-b8fdd5cc-efb9-45a3-87d8-c21340620f48 req-dc4ba890-b2cf-4bb9-9546-2d59062f4951 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:5c:2f:23"/><model type="virtio"/><mtu size="1442"/><target dev="tapa67bcfee-00"/></interface>not found in domain: <domain type='kvm' id='9'>
Aug 09 15:17:59 user nova-compute[72382]:   <name>instance-00000009</name>
Aug 09 15:17:59 user nova-compute[72382]:   <uuid>23f25946-de3a-43fb-97a4-1f9a787e6e51</uuid>
Aug 09 15:17:59 user nova-compute[72382]:   <metadata>
Aug 09 15:17:59 user nova-compute[72382]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 15:17:59 user nova-compute[72382]:   <nova:package version="0.0.0"/>
Aug 09 15:17:59 user nova-compute[72382]:   <nova:name>tempest-device-tagging-server-176087286</nova:name>
Aug 09 15:17:59 user nova-compute[72382]:   <nova:creationTime>2023-08-09 15:17:58</nova:creationTime>
Aug 09 15:17:59 user nova-compute[72382]:   <nova:flavor name="m1.tiny">
Aug 09 15:17:59 user nova-compute[72382]:     <nova:memory>512</nova:memory>
Aug 09 15:17:59 user nova-compute[72382]:     <nova:disk>1</nova:disk>
Aug 09 15:17:59 user nova-compute[72382]:     <nova:swap>0</nova:swap>
Aug 09 15:17:59 user nova-compute[72382]:     <nova:ephemeral>0</nova:ephemeral>
Aug 09 15:17:59 user nova-compute[72382]:     <nova:vcpus>1</nova:vcpus>
Aug 09 15:17:59 user nova-compute[72382]:   </nova:flavor>
Aug 09 15:17:59 user nova-compute[72382]:   <nova:owner>
Aug 09 15:17:59 user nova-compute[72382]:     <nova:user uuid="97fa102d2fed4045a326b0f5efbd1b1c">tempest-TaggedAttachmentsTest-605331854-project-member</nova:user>
Aug 09 15:17:59 user nova-compute[72382]:     <nova:project uuid="b84d09ad643146859e76996c09ba02c7">tempest-TaggedAttachmentsTest-605331854</nova:project>
Aug 09 15:17:59 user nova-compute[72382]:   </nova:owner>
Aug 09 15:17:59 user nova-compute[72382]:   <nova:root type="image" uuid="a79f2cea-eb27-4631-aaf3-05e7d9e411b4"/>
Aug 09 15:17:59 user nova-compute[72382]:   <nova:ports>
Aug 09 15:17:59 user nova-compute[72382]:     <nova:port uuid="1c588f02-cc2c-47f1-8918-bf9b1d3ea215">
Aug 09 15:17:59 user nova-compute[72382]:       <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 09 15:17:59 user nova-compute[72382]:     </nova:port>
Aug 09 15:17:59 user nova-compute[72382]:   </nova:ports>
Aug 09 15:17:59 user nova-compute[72382]: </nova:instance>
Aug 09 15:17:59 user nova-compute[72382]:   </metadata>
Aug 09 15:17:59 user nova-compute[72382]:   <memory unit='KiB'>524288</memory>
Aug 09 15:17:59 user nova-compute[72382]:   <currentMemory unit='KiB'>524288</currentMemory>
Aug 09 15:17:59 user nova-compute[72382]:   <vcpu placement='static'>1</vcpu>
Aug 09 15:17:59 user nova-compute[72382]:   <resource>
Aug 09 15:17:59 user nova-compute[72382]:     <partition>/machine</partition>
Aug 09 15:17:59 user nova-compute[72382]:   </resource>
Aug 09 15:17:59 user nova-compute[72382]:   <sysinfo type='smbios'>
Aug 09 15:17:59 user nova-compute[72382]:     <system>
Aug 09 15:17:59 user nova-compute[72382]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Aug 09 15:17:59 user nova-compute[72382]:       <entry name='product'>OpenStack Nova</entry>
Aug 09 15:17:59 user nova-compute[72382]:       <entry name='version'>0.0.0</entry>
Aug 09 15:17:59 user nova-compute[72382]:       <entry name='serial'>23f25946-de3a-43fb-97a4-1f9a787e6e51</entry>
Aug 09 15:17:59 user nova-compute[72382]:       <entry name='uuid'>23f25946-de3a-43fb-97a4-1f9a787e6e51</entry>
Aug 09 15:17:59 user nova-compute[72382]:       <entry name='family'>Virtual Machine</entry>
Aug 09 15:17:59 user nova-compute[72382]:     </system>
Aug 09 15:17:59 user nova-compute[72382]:   </sysinfo>
Aug 09 15:17:59 user nova-compute[72382]:   <os>
Aug 09 15:17:59 user nova-compute[72382]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Aug 09 15:17:59 user nova-compute[72382]:     <boot dev='hd'/>
Aug 09 15:17:59 user nova-compute[72382]:     <smbios mode='sysinfo'/>
Aug 09 15:17:59 user nova-compute[72382]:   </os>
Aug 09 15:17:59 user nova-compute[72382]:   <features>
Aug 09 15:17:59 user nova-compute[72382]:     <acpi/>
Aug 09 15:17:59 user nova-compute[72382]:     <apic/>
Aug 09 15:17:59 user nova-compute[72382]:     <vmcoreinfo state='on'/>
Aug 09 15:17:59 user nova-compute[72382]:   </features>
Aug 09 15:17:59 user nova-compute[72382]:   <cpu mode='custom' match='exact' check='full'>
Aug 09 15:17:59 user nova-compute[72382]:     <model fallback='forbid'>Nehalem</model>
Aug 09 15:17:59 user nova-compute[72382]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Aug 09 15:17:59 user nova-compute[72382]:     <feature policy='require' name='vme'/>
Aug 09 15:17:59 user nova-compute[72382]:     <feature policy='require' name='x2apic'/>
Aug 09 15:17:59 user nova-compute[72382]:     <feature policy='require' name='hypervisor'/>
Aug 09 15:17:59 user nova-compute[72382]:   </cpu>
Aug 09 15:17:59 user nova-compute[72382]:   <clock offset='utc'>
Aug 09 15:17:59 user nova-compute[72382]:     <timer name='pit' tickpolicy='delay'/>
Aug 09 15:17:59 user nova-compute[72382]:     <timer name='rtc' tickpolicy='catchup'/>
Aug 09 15:17:59 user nova-compute[72382]:     <timer name='hpet' present='no'/>
Aug 09 15:17:59 user nova-compute[72382]:   </clock>
Aug 09 15:17:59 user nova-compute[72382]:   <on_poweroff>destroy</on_poweroff>
Aug 09 15:17:59 user nova-compute[72382]:   <on_reboot>restart</on_reboot>
Aug 09 15:17:59 user nova-compute[72382]:   <on_crash>destroy</on_crash>
Aug 09 15:17:59 user nova-compute[72382]:   <devices>
Aug 09 15:17:59 user nova-compute[72382]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 09 15:17:59 user nova-compute[72382]:     <disk type='file' device='disk'>
Aug 09 15:17:59 user nova-compute[72382]:       <driver name='qemu' type='qcow2' cache='none'/>
Aug 09 15:17:59 user nova-compute[72382]:       <source file='/opt/stack/data/nova/instances/23f25946-de3a-43fb-97a4-1f9a787e6e51/disk' index='2'/>
Aug 09 15:17:59 user nova-compute[72382]:       <backingStore type='file' index='3'>
Aug 09 15:17:59 user nova-compute[72382]:         <format type='raw'/>
Aug 09 15:17:59 user nova-compute[72382]:         <source file='/opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b'/>
Aug 09 15:17:59 user nova-compute[72382]:         <backingStore/>
Aug 09 15:17:59 user nova-compute[72382]:       </backingStore>
Aug 09 15:17:59 user nova-compute[72382]:       <target dev='vda' bus='virtio'/>
Aug 09 15:17:59 user nova-compute[72382]:       <alias name='virtio-disk0'/>
Aug 09 15:17:59 user nova-compute[72382]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Aug 09 15:17:59 user nova-compute[72382]:     </disk>
Aug 09 15:17:59 user nova-compute[72382]:     <disk type='file' device='cdrom'>
Aug 09 15:17:59 user nova-compute[72382]:       <driver name='qemu' type='raw' cache='none'/>
Aug 09 15:17:59 user nova-compute[72382]:       <source file='/opt/stack/data/nova/instances/23f25946-de3a-43fb-97a4-1f9a787e6e51/disk.config' index='1'/>
Aug 09 15:17:59 user nova-compute[72382]:       <backingStore/>
Aug 09 15:17:59 user nova-compute[72382]:       <target dev='hda' bus='ide'/>
Aug 09 15:17:59 user nova-compute[72382]:       <readonly/>
Aug 09 15:17:59 user nova-compute[72382]:       <alias name='ide0-0-0'/>
Aug 09 15:17:59 user nova-compute[72382]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Aug 09 15:17:59 user nova-compute[72382]:     </disk>
Aug 09 15:17:59 user nova-compute[72382]:     <controller type='usb' index='0' model='none'>
Aug 09 15:17:59 user nova-compute[72382]:       <alias name='usb'/>
Aug 09 15:17:59 user nova-compute[72382]:     </controller>
Aug 09 15:17:59 user nova-compute[72382]:     <controller type='pci' index='0' model='pci-root'>
Aug 09 15:17:59 user nova-compute[72382]:       <alias name='pci.0'/>
Aug 09 15:17:59 user nova-compute[72382]:     </controller>
Aug 09 15:17:59 user nova-compute[72382]:     <controller type='ide' index='0'>
Aug 09 15:17:59 user nova-compute[72382]:       <alias name='ide'/>
Aug 09 15:17:59 user nova-compute[72382]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Aug 09 15:17:59 user nova-compute[72382]:     </controller>
Aug 09 15:17:59 user nova-compute[72382]:     <interface type='ethernet'>
Aug 09 15:17:59 user nova-compute[72382]:       <mac address='fa:16:3e:b1:4d:7d'/>
Aug 09 15:17:59 user nova-compute[72382]:       <target dev='tap1c588f02-cc'/>
Aug 09 15:17:59 user nova-compute[72382]:       <model type='virtio'/>
Aug 09 15:17:59 user nova-compute[72382]:       <mtu size='1442'/>
Aug 09 15:17:59 user nova-compute[72382]:       <alias name='net0'/>
Aug 09 15:17:59 user nova-compute[72382]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Aug 09 15:17:59 user nova-compute[72382]:     </interface>
Aug 09 15:17:59 user nova-compute[72382]:     <serial type='pty'>
Aug 09 15:17:59 user nova-compute[72382]:       <source path='/dev/pts/8'/>
Aug 09 15:17:59 user nova-compute[72382]:       <log file='/opt/stack/data/nova/instances/23f25946-de3a-43fb-97a4-1f9a787e6e51/console.log' append='off'/>
Aug 09 15:17:59 user nova-compute[72382]:       <target type='isa-serial' port='0'>
Aug 09 15:17:59 user nova-compute[72382]:         <model name='isa-serial'/>
Aug 09 15:17:59 user nova-compute[72382]:       </target>
Aug 09 15:17:59 user nova-compute[72382]:       <alias name='serial0'/>
Aug 09 15:17:59 user nova-compute[72382]:     </serial>
Aug 09 15:17:59 user nova-compute[72382]:     <console type='pty' tty='/dev/pts/8'>
Aug 09 15:17:59 user nova-compute[72382]:       <source path='/dev/pts/8'/>
Aug 09 15:17:59 user nova-compute[72382]:       <log file='/opt/stack/data/nova/instances/23f25946-de3a-43fb-97a4-1f9a787e6e51/console.log' append='off'/>
Aug 09 15:17:59 user nova-compute[72382]:       <target type='serial' port='0'/>
Aug 09 15:17:59 user nova-compute[72382]:       <alias name='serial0'/>
Aug 09 15:17:59 user nova-compute[72382]:     </console>
Aug 09 15:17:59 user nova-compute[72382]:     <input type='mouse' bus='ps2'>
Aug 09 15:17:59 user nova-compute[72382]:       <alias name='input0'/>
Aug 09 15:17:59 user nova-compute[72382]:     </input>
Aug 09 15:17:59 user nova-compute[72382]:     <input type='keyboard' bus='ps2'>
Aug 09 15:17:59 user nova-compute[72382]:       <alias name='input1'/>
Aug 09 15:17:59 user nova-compute[72382]:     </input>
Aug 09 15:17:59 user nova-compute[72382]:     <graphics type='vnc' port='5908' autoport='yes' listen='0.0.0.0'>
Aug 09 15:17:59 user nova-compute[72382]:       <listen type='address' address='0.0.0.0'/>
Aug 09 15:17:59 user nova-compute[72382]:     </graphics>
Aug 09 15:17:59 user nova-compute[72382]:     <audio id='1' type='none'/>
Aug 09 15:17:59 user nova-compute[72382]:     <video>
Aug 09 15:17:59 user nova-compute[72382]:       <model type='virtio' heads='1' primary='yes'/>
Aug 09 15:17:59 user nova-compute[72382]:       <alias name='video0'/>
Aug 09 15:17:59 user nova-compute[72382]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Aug 09 15:17:59 user nova-compute[72382]:     </video>
Aug 09 15:17:59 user nova-compute[72382]:     <memballoon model='virtio'>
Aug 09 15:17:59 user nova-compute[72382]:       <stats period='10'/>
Aug 09 15:17:59 user nova-compute[72382]:       <alias name='balloon0'/>
Aug 09 15:17:59 user nova-compute[72382]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Aug 09 15:17:59 user nova-compute[72382]:     </memballoon>
Aug 09 15:17:59 user nova-compute[72382]:     <rng model='virtio'>
Aug 09 15:17:59 user nova-compute[72382]:       <backend model='random'>/dev/urandom</backend>
Aug 09 15:17:59 user nova-compute[72382]:       <alias name='rng0'/>
Aug 09 15:17:59 user nova-compute[72382]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Aug 09 15:17:59 user nova-compute[72382]:     </rng>
Aug 09 15:17:59 user nova-compute[72382]:   </devices>
Aug 09 15:17:59 user nova-compute[72382]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Aug 09 15:17:59 user nova-compute[72382]:     <label>libvirt-23f25946-de3a-43fb-97a4-1f9a787e6e51</label>
Aug 09 15:17:59 user nova-compute[72382]:     <imagelabel>libvirt-23f25946-de3a-43fb-97a4-1f9a787e6e51</imagelabel>
Aug 09 15:17:59 user nova-compute[72382]:   </seclabel>
Aug 09 15:17:59 user nova-compute[72382]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Aug 09 15:17:59 user nova-compute[72382]:     <label>+64055:+108</label>
Aug 09 15:17:59 user nova-compute[72382]:     <imagelabel>+64055:+108</imagelabel>
Aug 09 15:17:59 user nova-compute[72382]:   </seclabel>
Aug 09 15:17:59 user nova-compute[72382]: </domain>
Aug 09 15:17:59 user nova-compute[72382]:  {{(pid=72382) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Aug 09 15:17:59 user nova-compute[72382]: WARNING nova.virt.libvirt.driver [req-b8fdd5cc-efb9-45a3-87d8-c21340620f48 req-dc4ba890-b2cf-4bb9-9546-2d59062f4951 service nova] [instance: 23f25946-de3a-43fb-97a4-1f9a787e6e51] Detaching interface fa:16:3e:5c:2f:23 failed because the device is no longer found on the guest.: nova.exception.DeviceNotFound: Device 'tapa67bcfee-00' not found.
Aug 09 15:17:59 user nova-compute[72382]: DEBUG nova.virt.libvirt.vif [req-b8fdd5cc-efb9-45a3-87d8-c21340620f48 req-dc4ba890-b2cf-4bb9-9546-2d59062f4951 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T15:15:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-176087286',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-176087286',id=9,image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF4pKUdXj5zZfLZFWCxFHz8jMa5yp/7/IPCXi1mkSKd0mYycvxd7H8zaZJVqn1Nt7uBCqZDaWzic3f3975RUjfs8oAsAozBRZ/XXtDelWRnO6lHLhAgDLjQA+jzema7e1g==',key_name='tempest-keypair-1955626579',keypairs=<?>,launch_index=0,launched_at=2023-08-09T15:15:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b84d09ad643146859e76996c09ba02c7',ramdisk_id='',reservation_id='r-sy0nsoiy',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-605331854',owner_user_name='tempest-TaggedAttachmentsTest-605331854-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T15:16:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='97fa102d2fed4045a326b0f5efbd1b1c',uuid=23f25946-de3a-43fb-97a4-1f9a787e6e51,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a67bcfee-0085-436e-8b18-1014b9b40f81", "address": "fa:16:3e:5c:2f:23", "network": {"id": "224c3e1d-3948-43d1-bb02-76a05add8f1e", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-126262034", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.156", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "b84d09ad643146859e76996c09ba02c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa67bcfee-00", "ovs_interfaceid": "a67bcfee-0085-436e-8b18-1014b9b40f81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 15:17:59 user nova-compute[72382]: DEBUG nova.network.os_vif_util [req-b8fdd5cc-efb9-45a3-87d8-c21340620f48 req-dc4ba890-b2cf-4bb9-9546-2d59062f4951 service nova] Converting VIF {"id": "a67bcfee-0085-436e-8b18-1014b9b40f81", "address": "fa:16:3e:5c:2f:23", "network": {"id": "224c3e1d-3948-43d1-bb02-76a05add8f1e", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-126262034", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.156", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "b84d09ad643146859e76996c09ba02c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa67bcfee-00", "ovs_interfaceid": "a67bcfee-0085-436e-8b18-1014b9b40f81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 15:17:59 user nova-compute[72382]: DEBUG nova.network.os_vif_util [req-b8fdd5cc-efb9-45a3-87d8-c21340620f48 req-dc4ba890-b2cf-4bb9-9546-2d59062f4951 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5c:2f:23,bridge_name='br-int',has_traffic_filtering=True,id=a67bcfee-0085-436e-8b18-1014b9b40f81,network=Network(224c3e1d-3948-43d1-bb02-76a05add8f1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa67bcfee-00') {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 15:17:59 user nova-compute[72382]: DEBUG os_vif [req-b8fdd5cc-efb9-45a3-87d8-c21340620f48 req-dc4ba890-b2cf-4bb9-9546-2d59062f4951 service nova] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:2f:23,bridge_name='br-int',has_traffic_filtering=True,id=a67bcfee-0085-436e-8b18-1014b9b40f81,network=Network(224c3e1d-3948-43d1-bb02-76a05add8f1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa67bcfee-00') {{(pid=72382) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 15:17:59 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:17:59 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa67bcfee-00, bridge=br-int, if_exists=True) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:17:59 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 15:17:59 user nova-compute[72382]: INFO os_vif [req-b8fdd5cc-efb9-45a3-87d8-c21340620f48 req-dc4ba890-b2cf-4bb9-9546-2d59062f4951 service nova] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:2f:23,bridge_name='br-int',has_traffic_filtering=True,id=a67bcfee-0085-436e-8b18-1014b9b40f81,network=Network(224c3e1d-3948-43d1-bb02-76a05add8f1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa67bcfee-00')
Aug 09 15:17:59 user nova-compute[72382]: DEBUG nova.virt.libvirt.guest [req-b8fdd5cc-efb9-45a3-87d8-c21340620f48 req-dc4ba890-b2cf-4bb9-9546-2d59062f4951 service nova] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 15:17:59 user nova-compute[72382]:   <nova:package version="0.0.0"/>
Aug 09 15:17:59 user nova-compute[72382]:   <nova:name>tempest-device-tagging-server-176087286</nova:name>
Aug 09 15:17:59 user nova-compute[72382]:   <nova:creationTime>2023-08-09 15:17:59</nova:creationTime>
Aug 09 15:17:59 user nova-compute[72382]:   <nova:flavor name="m1.tiny">
Aug 09 15:17:59 user nova-compute[72382]:     <nova:memory>512</nova:memory>
Aug 09 15:17:59 user nova-compute[72382]:     <nova:disk>1</nova:disk>
Aug 09 15:17:59 user nova-compute[72382]:     <nova:swap>0</nova:swap>
Aug 09 15:17:59 user nova-compute[72382]:     <nova:ephemeral>0</nova:ephemeral>
Aug 09 15:17:59 user nova-compute[72382]:     <nova:vcpus>1</nova:vcpus>
Aug 09 15:17:59 user nova-compute[72382]:   </nova:flavor>
Aug 09 15:17:59 user nova-compute[72382]:   <nova:owner>
Aug 09 15:17:59 user nova-compute[72382]:     <nova:user uuid="97fa102d2fed4045a326b0f5efbd1b1c">tempest-TaggedAttachmentsTest-605331854-project-member</nova:user>
Aug 09 15:17:59 user nova-compute[72382]:     <nova:project uuid="b84d09ad643146859e76996c09ba02c7">tempest-TaggedAttachmentsTest-605331854</nova:project>
Aug 09 15:17:59 user nova-compute[72382]:   </nova:owner>
Aug 09 15:17:59 user nova-compute[72382]:   <nova:root type="image" uuid="a79f2cea-eb27-4631-aaf3-05e7d9e411b4"/>
Aug 09 15:17:59 user nova-compute[72382]:   <nova:ports>
Aug 09 15:17:59 user nova-compute[72382]:     <nova:port uuid="1c588f02-cc2c-47f1-8918-bf9b1d3ea215">
Aug 09 15:17:59 user nova-compute[72382]:       <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 09 15:17:59 user nova-compute[72382]:     </nova:port>
Aug 09 15:17:59 user nova-compute[72382]:   </nova:ports>
Aug 09 15:17:59 user nova-compute[72382]: </nova:instance>
Aug 09 15:17:59 user nova-compute[72382]:  {{(pid=72382) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Aug 09 15:17:59 user nova-compute[72382]: DEBUG nova.network.neutron [None req-b5b5ac91-bf83-486d-9ee8-2971aefb1473 tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] [instance: 23f25946-de3a-43fb-97a4-1f9a787e6e51] Updating instance_info_cache with network_info: [{"id": "1c588f02-cc2c-47f1-8918-bf9b1d3ea215", "address": "fa:16:3e:b1:4d:7d", "network": {"id": "e5132afa-231c-471e-b11a-a6e972603b0c", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2085484007-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b84d09ad643146859e76996c09ba02c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c588f02-cc", "ovs_interfaceid": "1c588f02-cc2c-47f1-8918-bf9b1d3ea215", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:17:59 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-b5b5ac91-bf83-486d-9ee8-2971aefb1473 tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] Releasing lock "refresh_cache-23f25946-de3a-43fb-97a4-1f9a787e6e51" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 15:17:59 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-b5b5ac91-bf83-486d-9ee8-2971aefb1473 tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] Lock "interface-23f25946-de3a-43fb-97a4-1f9a787e6e51-a67bcfee-0085-436e-8b18-1014b9b40f81" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 1.527s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:18:00 user nova-compute[72382]: DEBUG nova.compute.manager [req-336b1873-4841-43be-b343-99f7cf917596 req-fc214342-4044-4dd3-8b83-f5894cd9ad45 service nova] [instance: 23f25946-de3a-43fb-97a4-1f9a787e6e51] Received event network-vif-plugged-a67bcfee-0085-436e-8b18-1014b9b40f81 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:18:00 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-336b1873-4841-43be-b343-99f7cf917596 req-fc214342-4044-4dd3-8b83-f5894cd9ad45 service nova] Acquiring lock "23f25946-de3a-43fb-97a4-1f9a787e6e51-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:18:00 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-336b1873-4841-43be-b343-99f7cf917596 req-fc214342-4044-4dd3-8b83-f5894cd9ad45 service nova] Lock "23f25946-de3a-43fb-97a4-1f9a787e6e51-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:18:00 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-336b1873-4841-43be-b343-99f7cf917596 req-fc214342-4044-4dd3-8b83-f5894cd9ad45 service nova] Lock "23f25946-de3a-43fb-97a4-1f9a787e6e51-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:18:00 user nova-compute[72382]: DEBUG nova.compute.manager [req-336b1873-4841-43be-b343-99f7cf917596 req-fc214342-4044-4dd3-8b83-f5894cd9ad45 service nova] [instance: 23f25946-de3a-43fb-97a4-1f9a787e6e51] No waiting events found dispatching network-vif-plugged-a67bcfee-0085-436e-8b18-1014b9b40f81 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:18:00 user nova-compute[72382]: WARNING nova.compute.manager [req-336b1873-4841-43be-b343-99f7cf917596 req-fc214342-4044-4dd3-8b83-f5894cd9ad45 service nova] [instance: 23f25946-de3a-43fb-97a4-1f9a787e6e51] Received unexpected event network-vif-plugged-a67bcfee-0085-436e-8b18-1014b9b40f81 for instance with vm_state active and task_state None.
Aug 09 15:18:01 user nova-compute[72382]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691594266.1064208, 24b63f7a-be32-424b-b72c-d5bec43c408e => Stopped> {{(pid=72382) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 15:18:01 user nova-compute[72382]: INFO nova.compute.manager [-] [instance: 24b63f7a-be32-424b-b72c-d5bec43c408e] VM Stopped (Lifecycle Event)
Aug 09 15:18:01 user nova-compute[72382]: DEBUG nova.compute.manager [None req-3473f21c-af78-438e-ad24-4ef2dd8f755f None None] [instance: 24b63f7a-be32-424b-b72c-d5bec43c408e] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:18:01 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:18:02 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:18:02 user nova-compute[72382]: DEBUG nova.compute.manager [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Starting heal instance info cache {{(pid=72382) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 15:18:02 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Acquiring lock "refresh_cache-44afd1bf-fa5c-4b3e-8752-b16853fef54e" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 15:18:02 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Acquired lock "refresh_cache-44afd1bf-fa5c-4b3e-8752-b16853fef54e" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 15:18:02 user nova-compute[72382]: DEBUG nova.network.neutron [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] [instance: 44afd1bf-fa5c-4b3e-8752-b16853fef54e] Forcefully refreshing network info cache for instance {{(pid=72382) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 15:18:03 user nova-compute[72382]: DEBUG nova.network.neutron [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] [instance: 44afd1bf-fa5c-4b3e-8752-b16853fef54e] Updating instance_info_cache with network_info: [{"id": "2a1d4c60-bc2a-4530-b3bd-2a12ae2d2098", "address": "fa:16:3e:6c:50:29", "network": {"id": "46ef00c7-17ee-4e45-ba1d-dcc0a417ea85", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1360012261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "990ba791030940d38360af5879c853c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a1d4c60-bc", "ovs_interfaceid": "2a1d4c60-bc2a-4530-b3bd-2a12ae2d2098", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:18:03 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:18:03 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Releasing lock "refresh_cache-44afd1bf-fa5c-4b3e-8752-b16853fef54e" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 15:18:03 user nova-compute[72382]: DEBUG nova.compute.manager [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] [instance: 44afd1bf-fa5c-4b3e-8752-b16853fef54e] Updated the network info_cache for instance {{(pid=72382) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 15:18:03 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:18:03 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:18:03 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:18:03 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:18:03 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:18:03 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Auditing locally available compute resources for user (node: user) {{(pid=72382) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 15:18:03 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:18:03 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72382) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 15:18:03 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72382) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 15:18:03 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=72382) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 15:18:03 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f780040f-b789-4b72-8986-813c7b9fe4a6/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:18:04 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f780040f-b789-4b72-8986-813c7b9fe4a6/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:18:04 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f780040f-b789-4b72-8986-813c7b9fe4a6/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:18:04 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f780040f-b789-4b72-8986-813c7b9fe4a6/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:18:04 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/266be814-4a2b-4f8e-a0f6-e8821fdeb95d/disk.rescue --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:18:04 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/266be814-4a2b-4f8e-a0f6-e8821fdeb95d/disk.rescue --force-share --output=json" returned: 0 in 0.131s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:18:04 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/266be814-4a2b-4f8e-a0f6-e8821fdeb95d/disk.rescue --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:18:04 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/266be814-4a2b-4f8e-a0f6-e8821fdeb95d/disk.rescue --force-share --output=json" returned: 0 in 0.140s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:18:04 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/266be814-4a2b-4f8e-a0f6-e8821fdeb95d/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:18:04 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/266be814-4a2b-4f8e-a0f6-e8821fdeb95d/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:18:04 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/266be814-4a2b-4f8e-a0f6-e8821fdeb95d/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:18:04 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/266be814-4a2b-4f8e-a0f6-e8821fdeb95d/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:18:04 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a33515b3-3ef4-4f76-a8d8-e7008b5bbb79/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:18:04 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a33515b3-3ef4-4f76-a8d8-e7008b5bbb79/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:18:04 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a33515b3-3ef4-4f76-a8d8-e7008b5bbb79/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:18:05 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a33515b3-3ef4-4f76-a8d8-e7008b5bbb79/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:18:05 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b4be6ea-c8f6-420b-9453-c0558b6c4b9f/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:18:05 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b4be6ea-c8f6-420b-9453-c0558b6c4b9f/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:18:05 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b4be6ea-c8f6-420b-9453-c0558b6c4b9f/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:18:05 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b4be6ea-c8f6-420b-9453-c0558b6c4b9f/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:18:05 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/777e49ea-b674-4c3f-9cdd-ac2113032632/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:18:05 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/777e49ea-b674-4c3f-9cdd-ac2113032632/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:18:05 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/777e49ea-b674-4c3f-9cdd-ac2113032632/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:18:05 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/777e49ea-b674-4c3f-9cdd-ac2113032632/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:18:05 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44afd1bf-fa5c-4b3e-8752-b16853fef54e/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:18:05 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44afd1bf-fa5c-4b3e-8752-b16853fef54e/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:18:05 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44afd1bf-fa5c-4b3e-8752-b16853fef54e/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:18:05 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44afd1bf-fa5c-4b3e-8752-b16853fef54e/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:18:05 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0a7fa25-4520-4f40-9515-b88e3d2fd910/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:18:06 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0a7fa25-4520-4f40-9515-b88e3d2fd910/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:18:06 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0a7fa25-4520-4f40-9515-b88e3d2fd910/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:18:06 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0a7fa25-4520-4f40-9515-b88e3d2fd910/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:18:06 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a82f146-97ce-4319-8b25-c1b090965e53/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:18:06 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a82f146-97ce-4319-8b25-c1b090965e53/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:18:06 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a82f146-97ce-4319-8b25-c1b090965e53/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:18:06 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a82f146-97ce-4319-8b25-c1b090965e53/disk --force-share --output=json" returned: 0 in 0.127s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:18:06 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=72382) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 15:18:06 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9766433-4c5a-40ed-a212-715a24f42b91/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:18:06 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9766433-4c5a-40ed-a212-715a24f42b91/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:18:06 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9766433-4c5a-40ed-a212-715a24f42b91/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:18:06 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9766433-4c5a-40ed-a212-715a24f42b91/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:18:06 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23f25946-de3a-43fb-97a4-1f9a787e6e51/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:18:07 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23f25946-de3a-43fb-97a4-1f9a787e6e51/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:18:07 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23f25946-de3a-43fb-97a4-1f9a787e6e51/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:18:07 user nova-compute[72382]: DEBUG nova.compute.manager [None req-cc59ad8f-6273-4c23-8869-cc1a783ecb14 tempest-TestVolumeSwap-1225930191 tempest-TestVolumeSwap-1225930191-project-admin] [instance: 9a82f146-97ce-4319-8b25-c1b090965e53] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:344efe6d-5a52-4d0d-a34e-da8627a1e09f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qiuZemSC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '9a82f146-97ce-4319-8b25-c1b090965e53', 'attached_at': '', 'detached_at': '', 'volume_id': '344efe6d-5a52-4d0d-a34e-da8627a1e09f', 'serial': '344efe6d-5a52-4d0d-a34e-da8627a1e09f'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:ad1e2adc-5d1a-4718-8971-7d362e291602'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'avodyQXL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': '9a82f146-97ce-4319-8b25-c1b090965e53', 'attached_at': '', 'detached_at': '', 'volume_id': 'ad1e2adc-5d1a-4718-8971-7d362e291602', 'serial'} {{(pid=72382) _swap_volume /opt/stack/nova/nova/compute/manager.py:7702}}
Aug 09 15:18:07 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cc59ad8f-6273-4c23-8869-cc1a783ecb14 tempest-TestVolumeSwap-1225930191 tempest-TestVolumeSwap-1225930191-project-admin] [instance: 9a82f146-97ce-4319-8b25-c1b090965e53] Calling os-brick to attach iSCSI Volume {{(pid=72382) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 15:18:07 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc59ad8f-6273-4c23-8869-cc1a783ecb14 tempest-TestVolumeSwap-1225930191 tempest-TestVolumeSwap-1225930191-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2a0c768340>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:344efe6d-5a52-4d0d-a34e-da8627a1e09f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qiuZemSC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 15:18:07 user nova-compute[72382]: WARNING os_brick.initiator.connectors.base [None req-cc59ad8f-6273-4c23-8869-cc1a783ecb14 tempest-TestVolumeSwap-1225930191 tempest-TestVolumeSwap-1225930191-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 15:18:07 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-cc59ad8f-6273-4c23-8869-cc1a783ecb14 tempest-TestVolumeSwap-1225930191 tempest-TestVolumeSwap-1225930191-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 15:18:07 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-cc59ad8f-6273-4c23-8869-cc1a783ecb14 tempest-TestVolumeSwap-1225930191 tempest-TestVolumeSwap-1225930191-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 15:18:07 user nova-compute[72382]: WARNING os_brick.initiator.connectors.base [None req-cc59ad8f-6273-4c23-8869-cc1a783ecb14 tempest-TestVolumeSwap-1225930191 tempest-TestVolumeSwap-1225930191-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 15:18:07 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-cc59ad8f-6273-4c23-8869-cc1a783ecb14 tempest-TestVolumeSwap-1225930191 tempest-TestVolumeSwap-1225930191-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:344efe6d-5a52-4d0d-a34e-da8627a1e09f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 15:18:07 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-cc59ad8f-6273-4c23-8869-cc1a783ecb14 tempest-TestVolumeSwap-1225930191 tempest-TestVolumeSwap-1225930191-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:344efe6d-5a52-4d0d-a34e-da8627a1e09f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 15:18:07 user nova-compute[72382]: INFO os_brick.initiator.connectors.iscsi [None req-cc59ad8f-6273-4c23-8869-cc1a783ecb14 tempest-TestVolumeSwap-1225930191 tempest-TestVolumeSwap-1225930191-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 15:18:07 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:344efe6d-5a52-4d0d-a34e-da8627a1e09f -p 172.16.0.220:3260 {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:18:07 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:344efe6d-5a52-4d0d-a34e-da8627a1e09f -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:18:07 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[706b2114-e43c-4782-afd2-348b59040896]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:18:07 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc59ad8f-6273-4c23-8869-cc1a783ecb14 tempest-TestVolumeSwap-1225930191 tempest-TestVolumeSwap-1225930191-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 15:18:07 user nova-compute[72382]:  {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:18:07 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:344efe6d-5a52-4d0d-a34e-da8627a1e09f -p 172.16.0.220:3260 --interface default --op new {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:18:07 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:344efe6d-5a52-4d0d-a34e-da8627a1e09f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:18:07 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23f25946-de3a-43fb-97a4-1f9a787e6e51/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:18:07 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[84942cf7-7c9b-419a-88ce-34698f6bf5d0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:344efe6d-5a52-4d0d-a34e-da8627a1e09f] added\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:18:07 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc59ad8f-6273-4c23-8869-cc1a783ecb14 tempest-TestVolumeSwap-1225930191 tempest-TestVolumeSwap-1225930191-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:344efe6d-5a52-4d0d-a34e-da8627a1e09f] added
Aug 09 15:18:07 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:18:07 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:344efe6d-5a52-4d0d-a34e-da8627a1e09f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:18:07 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5aa7e23-9c2c-400e-a615-5839858749e1/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:18:07 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:344efe6d-5a52-4d0d-a34e-da8627a1e09f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:18:07 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[c433dd72-c49a-43ee-84e1-62b716ef85e3]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:18:07 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc59ad8f-6273-4c23-8869-cc1a783ecb14 tempest-TestVolumeSwap-1225930191 tempest-TestVolumeSwap-1225930191-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:18:07 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:344efe6d-5a52-4d0d-a34e-da8627a1e09f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:18:07 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:344efe6d-5a52-4d0d-a34e-da8627a1e09f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:18:07 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[0588d541-fcc6-4a9a-b728-68a944f160a5]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:18:07 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc59ad8f-6273-4c23-8869-cc1a783ecb14 tempest-TestVolumeSwap-1225930191 tempest-TestVolumeSwap-1225930191-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:18:07 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:344efe6d-5a52-4d0d-a34e-da8627a1e09f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qiuZemSC {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:18:07 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:344efe6d-5a52-4d0d-a34e-da8627a1e09f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qiuZemSC" returned: 0 in 0.018s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:18:07 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[b79644b4-f3ca-4efd-bfad-7104a5daafce]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:18:07 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc59ad8f-6273-4c23-8869-cc1a783ecb14 tempest-TestVolumeSwap-1225930191 tempest-TestVolumeSwap-1225930191-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qiuZemSC'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:18:07 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:344efe6d-5a52-4d0d-a34e-da8627a1e09f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:18:07 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:344efe6d-5a52-4d0d-a34e-da8627a1e09f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:18:07 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[54e61ffe-a7e7-408a-9e6f-10ae3daea324]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:18:07 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc59ad8f-6273-4c23-8869-cc1a783ecb14 tempest-TestVolumeSwap-1225930191 tempest-TestVolumeSwap-1225930191-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:18:07 user nova-compute[72382]: DEBUG nova.compute.manager [req-972b5c5c-fa1d-4d66-8eff-bc613ef0af21 req-1c5193a7-209e-4bb3-8bfc-956aedeb5c13 service nova] [instance: b5aa7e23-9c2c-400e-a615-5839858749e1] Received event network-changed-0d38f117-6eb0-4627-bc39-8bfd3ed800f6 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:18:07 user nova-compute[72382]: DEBUG nova.compute.manager [req-972b5c5c-fa1d-4d66-8eff-bc613ef0af21 req-1c5193a7-209e-4bb3-8bfc-956aedeb5c13 service nova] [instance: b5aa7e23-9c2c-400e-a615-5839858749e1] Refreshing instance network info cache due to event network-changed-0d38f117-6eb0-4627-bc39-8bfd3ed800f6. {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 15:18:07 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-972b5c5c-fa1d-4d66-8eff-bc613ef0af21 req-1c5193a7-209e-4bb3-8bfc-956aedeb5c13 service nova] Acquiring lock "refresh_cache-b5aa7e23-9c2c-400e-a615-5839858749e1" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 15:18:07 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-972b5c5c-fa1d-4d66-8eff-bc613ef0af21 req-1c5193a7-209e-4bb3-8bfc-956aedeb5c13 service nova] Acquired lock "refresh_cache-b5aa7e23-9c2c-400e-a615-5839858749e1" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 15:18:07 user nova-compute[72382]: DEBUG nova.network.neutron [req-972b5c5c-fa1d-4d66-8eff-bc613ef0af21 req-1c5193a7-209e-4bb3-8bfc-956aedeb5c13 service nova] [instance: b5aa7e23-9c2c-400e-a615-5839858749e1] Refreshing network info cache for port 0d38f117-6eb0-4627-bc39-8bfd3ed800f6 {{(pid=72382) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 15:18:07 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:18:07 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5aa7e23-9c2c-400e-a615-5839858749e1/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:18:07 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5aa7e23-9c2c-400e-a615-5839858749e1/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:18:07 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:18:07 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dc5e0da-0d13-4561-bcc3-8eb9e2642098]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2267629-52cf-439c-9083-3e8384c67f08 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a13916f-1416-4b94-9e10-96f9e6415753 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16ef1023-88b6-4e22-9b4b-45515b25ca9b (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad1e2adc-5d1a-4718-8971-7d362e291602 (non-flash)\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:18:07 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc59ad8f-6273-4c23-8869-cc1a783ecb14 tempest-TestVolumeSwap-1225930191 tempest-TestVolumeSwap-1225930191-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2267629-52cf-439c-9083-3e8384c67f08 (non-flash)
Aug 09 15:18:07 user nova-compute[72382]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a13916f-1416-4b94-9e10-96f9e6415753 (non-flash)
Aug 09 15:18:07 user nova-compute[72382]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16ef1023-88b6-4e22-9b4b-45515b25ca9b (non-flash)
Aug 09 15:18:07 user nova-compute[72382]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad1e2adc-5d1a-4718-8971-7d362e291602 (non-flash)
Aug 09 15:18:07 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 15:18:07 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc59ad8f-6273-4c23-8869-cc1a783ecb14 tempest-TestVolumeSwap-1225930191 tempest-TestVolumeSwap-1225930191-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2267629-52cf-439c-9083-3e8384c67f08 (non-flash)
Aug 09 15:18:07 user nova-compute[72382]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a13916f-1416-4b94-9e10-96f9e6415753 (non-flash)
Aug 09 15:18:07 user nova-compute[72382]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16ef1023-88b6-4e22-9b4b-45515b25ca9b (non-flash)
Aug 09 15:18:07 user nova-compute[72382]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad1e2adc-5d1a-4718-8971-7d362e291602 (non-flash)
Aug 09 15:18:07 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 15:18:07 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:344efe6d-5a52-4d0d-a34e-da8627a1e09f -p 172.16.0.220:3260 --login {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:18:07 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:344efe6d-5a52-4d0d-a34e-da8627a1e09f -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:18:07 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[109748ed-962a-4f87-9568-626b0e5676ec]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:344efe6d-5a52-4d0d-a34e-da8627a1e09f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:344efe6d-5a52-4d0d-a34e-da8627a1e09f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:18:07 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc59ad8f-6273-4c23-8869-cc1a783ecb14 tempest-TestVolumeSwap-1225930191 tempest-TestVolumeSwap-1225930191-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:344efe6d-5a52-4d0d-a34e-da8627a1e09f, portal: 172.16.0.220,3260]
Aug 09 15:18:07 user nova-compute[72382]: Login to [iface: default, target: iqn.2010-10.org.openstack:344efe6d-5a52-4d0d-a34e-da8627a1e09f, portal: 172.16.0.220,3260] successful.
Aug 09 15:18:07 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:18:07 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:344efe6d-5a52-4d0d-a34e-da8627a1e09f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:18:07 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5aa7e23-9c2c-400e-a615-5839858749e1/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:18:07 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:344efe6d-5a52-4d0d-a34e-da8627a1e09f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:18:07 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f7e70bd-bf5c-42b7-bc66-427bdd1a9533]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:18:07 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc59ad8f-6273-4c23-8869-cc1a783ecb14 tempest-TestVolumeSwap-1225930191 tempest-TestVolumeSwap-1225930191-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:18:07 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:18:07 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:18:07 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b8e30dc-dc19-41f1-af1b-5d4d7357865d]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:344efe6d-5a52-4d0d-a34e-da8627a1e09f (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2267629-52cf-439c-9083-3e8384c67f08 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a13916f-1416-4b94-9e10-96f9e6415753 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16ef1023-88b6-4e22-9b4b-45515b25ca9b (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad1e2adc-5d1a-4718-8971-7d362e291602 (non-flash)\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:18:07 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc59ad8f-6273-4c23-8869-cc1a783ecb14 tempest-TestVolumeSwap-1225930191 tempest-TestVolumeSwap-1225930191-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:344efe6d-5a52-4d0d-a34e-da8627a1e09f (non-flash)
Aug 09 15:18:07 user nova-compute[72382]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2267629-52cf-439c-9083-3e8384c67f08 (non-flash)
Aug 09 15:18:07 user nova-compute[72382]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a13916f-1416-4b94-9e10-96f9e6415753 (non-flash)
Aug 09 15:18:07 user nova-compute[72382]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16ef1023-88b6-4e22-9b4b-45515b25ca9b (non-flash)
Aug 09 15:18:07 user nova-compute[72382]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad1e2adc-5d1a-4718-8971-7d362e291602 (non-flash)
Aug 09 15:18:07 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 15:18:07 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc59ad8f-6273-4c23-8869-cc1a783ecb14 tempest-TestVolumeSwap-1225930191 tempest-TestVolumeSwap-1225930191-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:344efe6d-5a52-4d0d-a34e-da8627a1e09f (non-flash)
Aug 09 15:18:07 user nova-compute[72382]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2267629-52cf-439c-9083-3e8384c67f08 (non-flash)
Aug 09 15:18:07 user nova-compute[72382]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a13916f-1416-4b94-9e10-96f9e6415753 (non-flash)
Aug 09 15:18:07 user nova-compute[72382]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16ef1023-88b6-4e22-9b4b-45515b25ca9b (non-flash)
Aug 09 15:18:07 user nova-compute[72382]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad1e2adc-5d1a-4718-8971-7d362e291602 (non-flash)
Aug 09 15:18:07 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 15:18:07 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-cc59ad8f-6273-4c23-8869-cc1a783ecb14 tempest-TestVolumeSwap-1225930191 tempest-TestVolumeSwap-1225930191-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:344efe6d-5a52-4d0d-a34e-da8627a1e09f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.388s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 15:18:07 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc59ad8f-6273-4c23-8869-cc1a783ecb14 tempest-TestVolumeSwap-1225930191 tempest-TestVolumeSwap-1225930191-project-admin] Connected to 172.16.0.220:3260 {{(pid=72382) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 15:18:07 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-cc59ad8f-6273-4c23-8869-cc1a783ecb14 tempest-TestVolumeSwap-1225930191 tempest-TestVolumeSwap-1225930191-project-admin] HCTL ('37', '-', '-', 0) found on session 10 with lun 0 {{(pid=72382) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 15:18:07 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-cc59ad8f-6273-4c23-8869-cc1a783ecb14 tempest-TestVolumeSwap-1225930191 tempest-TestVolumeSwap-1225930191-project-admin] Scanning host 37 c: -, t: -, l: 0) {{(pid=72382) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 15:18:08 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:18:08 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.017s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:18:08 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe0bb1df-1340-4b5a-a9a1-fbcb6cb62562]: (4, ('- - 0', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:18:08 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-cc59ad8f-6273-4c23-8869-cc1a783ecb14 tempest-TestVolumeSwap-1225930191 tempest-TestVolumeSwap-1225930191-project-admin] Searching for a device in session 10 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=72382) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 15:18:08 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc59ad8f-6273-4c23-8869-cc1a783ecb14 tempest-TestVolumeSwap-1225930191 tempest-TestVolumeSwap-1225930191-project-admin] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qiuZemSC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72382) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 15:18:08 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-cc59ad8f-6273-4c23-8869-cc1a783ecb14 tempest-TestVolumeSwap-1225930191 tempest-TestVolumeSwap-1225930191-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.023s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 15:18:08 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc59ad8f-6273-4c23-8869-cc1a783ecb14 tempest-TestVolumeSwap-1225930191 tempest-TestVolumeSwap-1225930191-project-admin] <== connect_volume: return (1026ms) {'type': 'block', 'scsi_wwn': '23061343837316638', 'path': '/dev/sdf'} {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 15:18:08 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cc59ad8f-6273-4c23-8869-cc1a783ecb14 tempest-TestVolumeSwap-1225930191 tempest-TestVolumeSwap-1225930191-project-admin] [instance: 9a82f146-97ce-4319-8b25-c1b090965e53] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23061343837316638', 'path': '/dev/sdf'} {{(pid=72382) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 15:18:08 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-ac22a112-e9ca-445c-a23d-a39f8d7239ad tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] Acquiring lock "b5aa7e23-9c2c-400e-a615-5839858749e1" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:18:08 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-ac22a112-e9ca-445c-a23d-a39f8d7239ad tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] Lock "b5aa7e23-9c2c-400e-a615-5839858749e1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:18:08 user nova-compute[72382]: WARNING nova.virt.libvirt.driver [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 15:18:08 user nova-compute[72382]: WARNING nova.virt.libvirt.driver [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 15:18:08 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Hypervisor/Node resource view: name=user free_ram=6676MB free_disk=25.646923065185547GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72382) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 15:18:08 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:18:08 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:18:08 user nova-compute[72382]: DEBUG nova.objects.instance [None req-ac22a112-e9ca-445c-a23d-a39f8d7239ad tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] Lazy-loading 'flavor' on Instance uuid b5aa7e23-9c2c-400e-a615-5839858749e1 {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:18:08 user nova-compute[72382]: DEBUG nova.objects.instance [None req-cc59ad8f-6273-4c23-8869-cc1a783ecb14 tempest-TestVolumeSwap-1225930191 tempest-TestVolumeSwap-1225930191-project-admin] Lazy-loading 'flavor' on Instance uuid 9a82f146-97ce-4319-8b25-c1b090965e53 {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:18:08 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-ac22a112-e9ca-445c-a23d-a39f8d7239ad tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] Lock "b5aa7e23-9c2c-400e-a615-5839858749e1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.069s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:18:08 user nova-compute[72382]: INFO nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance 0f510d75-5d1e-4a5c-b38f-731c299f0f5a has allocations against this compute host but is not found in the database.
Aug 09 15:18:08 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance f780040f-b789-4b72-8986-813c7b9fe4a6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:18:08 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance b5aa7e23-9c2c-400e-a615-5839858749e1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:18:08 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance a33515b3-3ef4-4f76-a8d8-e7008b5bbb79 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:18:08 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance f1b4f73b-7a9e-4cf1-9d51-f32284f49c53 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:18:08 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance 777e49ea-b674-4c3f-9cdd-ac2113032632 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:18:08 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance 8b4be6ea-c8f6-420b-9453-c0558b6c4b9f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:18:08 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance 266be814-4a2b-4f8e-a0f6-e8821fdeb95d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:18:08 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance 44afd1bf-fa5c-4b3e-8752-b16853fef54e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:18:08 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance c9766433-4c5a-40ed-a212-715a24f42b91 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:18:08 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance 23f25946-de3a-43fb-97a4-1f9a787e6e51 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:18:08 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance 9a82f146-97ce-4319-8b25-c1b090965e53 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:18:08 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance f0a7fa25-4520-4f40-9515-b88e3d2fd910 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:18:08 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=72382) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 15:18:08 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=72382) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 15:18:08 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-ac22a112-e9ca-445c-a23d-a39f8d7239ad tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] Acquiring lock "b5aa7e23-9c2c-400e-a615-5839858749e1" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:18:08 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-ac22a112-e9ca-445c-a23d-a39f8d7239ad tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] Lock "b5aa7e23-9c2c-400e-a615-5839858749e1" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:18:08 user nova-compute[72382]: INFO nova.compute.manager [None req-ac22a112-e9ca-445c-a23d-a39f8d7239ad tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] [instance: b5aa7e23-9c2c-400e-a615-5839858749e1] Attaching volume 9c2a0938-fb5c-434c-91ba-15e8823c1348 to /dev/vdb
Aug 09 15:18:08 user nova-compute[72382]: DEBUG os_brick.utils [None req-ac22a112-e9ca-445c-a23d-a39f8d7239ad tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 15:18:08 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:18:08 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:18:08 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[6050802e-b4a9-4e97-b455-7a45ed5ea693]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d2cfa7015fe\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:18:08 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:18:08 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-8627fbb2-f07f-4595-a72c-5724ed106893 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Acquiring lock "0f510d75-5d1e-4a5c-b38f-731c299f0f5a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:18:08 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-8627fbb2-f07f-4595-a72c-5724ed106893 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Lock "0f510d75-5d1e-4a5c-b38f-731c299f0f5a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:18:08 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:18:08 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d21f95e-0e02-4041-8f04-6e966876b72d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:18:08 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:18:08 user nova-compute[72382]: DEBUG nova.network.neutron [req-972b5c5c-fa1d-4d66-8eff-bc613ef0af21 req-1c5193a7-209e-4bb3-8bfc-956aedeb5c13 service nova] [instance: b5aa7e23-9c2c-400e-a615-5839858749e1] Updated VIF entry in instance network info cache for port 0d38f117-6eb0-4627-bc39-8bfd3ed800f6. {{(pid=72382) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 15:18:08 user nova-compute[72382]: DEBUG nova.network.neutron [req-972b5c5c-fa1d-4d66-8eff-bc613ef0af21 req-1c5193a7-209e-4bb3-8bfc-956aedeb5c13 service nova] [instance: b5aa7e23-9c2c-400e-a615-5839858749e1] Updating instance_info_cache with network_info: [{"id": "0d38f117-6eb0-4627-bc39-8bfd3ed800f6", "address": "fa:16:3e:f1:64:50", "network": {"id": "0ea6f64f-105f-42c8-a5ad-56a358383e40", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1157085737-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.41", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d70953bf0414fc8b87d85c5bd77ecaa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d38f117-6e", "ovs_interfaceid": "0d38f117-6eb0-4627-bc39-8bfd3ed800f6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:18:08 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8627fbb2-f07f-4595-a72c-5724ed106893 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] [instance: 0f510d75-5d1e-4a5c-b38f-731c299f0f5a] Starting instance... {{(pid=72382) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 15:18:08 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:18:08 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c2f1a10-f51d-4df5-b1af-c03a63d603fe]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:18:08 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b090f3a-6108-475f-b9ef-75a17fe5ce1d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:18:08 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-ac22a112-e9ca-445c-a23d-a39f8d7239ad tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] Running cmd (subprocess): nvme version {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:18:08 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-972b5c5c-fa1d-4d66-8eff-bc613ef0af21 req-1c5193a7-209e-4bb3-8bfc-956aedeb5c13 service nova] Releasing lock "refresh_cache-b5aa7e23-9c2c-400e-a615-5839858749e1" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 15:18:08 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-ac22a112-e9ca-445c-a23d-a39f8d7239ad tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] 'nvme version' failed. Not Retrying. {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 15:18:08 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ac22a112-e9ca-445c-a23d-a39f8d7239ad tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] nvme not present on system {{(pid=72382) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 15:18:08 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:18:08 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 15:18:08 user nova-compute[72382]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 15:18:08 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[70eabace-169c-458b-a458-1c2555bd4fe1]: (4, '') {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:18:08 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:18:08 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.lightos [None req-ac22a112-e9ca-445c-a23d-a39f8d7239ad tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72382) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 15:18:08 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.lightos [None req-ac22a112-e9ca-445c-a23d-a39f8d7239ad tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72382) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 15:18:08 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.lightos [None req-ac22a112-e9ca-445c-a23d-a39f8d7239ad tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] LIGHTOS: no hostnqn found. {{(pid=72382) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 15:18:08 user nova-compute[72382]: DEBUG os_brick.utils [None req-ac22a112-e9ca-445c-a23d-a39f8d7239ad tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] <== get_connector_properties: return (179ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d2cfa7015fe', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 15:18:08 user nova-compute[72382]: DEBUG nova.virt.block_device [None req-ac22a112-e9ca-445c-a23d-a39f8d7239ad tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] [instance: b5aa7e23-9c2c-400e-a615-5839858749e1] Updating existing volume attachment record: b26dbc9f-82b0-4248-9d89-86678180621c {{(pid=72382) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 15:18:08 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-8627fbb2-f07f-4595-a72c-5724ed106893 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:18:08 user nova-compute[72382]: DEBUG nova.virt.libvirt.guest [None req-cc59ad8f-6273-4c23-8869-cc1a783ecb14 tempest-TestVolumeSwap-1225930191 tempest-TestVolumeSwap-1225930191-project-admin] COPY block job progress, current cursor: 10485760 final cursor: 1073741824 {{(pid=72382) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 09 15:18:08 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:18:08 user nova-compute[72382]: DEBUG nova.compute.provider_tree [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Inventory has not changed in ProviderTree for provider: 7b15b0e5-df4d-49db-833b-2855d21d10ae {{(pid=72382) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 15:18:08 user nova-compute[72382]: DEBUG nova.scheduler.client.report [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Inventory has not changed for provider 7b15b0e5-df4d-49db-833b-2855d21d10ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72382) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 15:18:09 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Compute_service record updated for user:user {{(pid=72382) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 15:18:09 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.829s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:18:09 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-8627fbb2-f07f-4595-a72c-5724ed106893 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.368s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:18:09 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-8627fbb2-f07f-4595-a72c-5724ed106893 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72382) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 15:18:09 user nova-compute[72382]: INFO nova.compute.claims [None req-8627fbb2-f07f-4595-a72c-5724ed106893 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] [instance: 0f510d75-5d1e-4a5c-b38f-731c299f0f5a] Claim successful on node user
Aug 09 15:18:09 user nova-compute[72382]: DEBUG nova.virt.libvirt.guest [None req-cc59ad8f-6273-4c23-8869-cc1a783ecb14 tempest-TestVolumeSwap-1225930191 tempest-TestVolumeSwap-1225930191-project-admin] COPY block job progress, current cursor: 166723584 final cursor: 1073741824 {{(pid=72382) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 09 15:18:09 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:18:09 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:18:09 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:18:09 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:18:09 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:18:09 user nova-compute[72382]: DEBUG nova.compute.manager [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72382) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 15:18:09 user nova-compute[72382]: DEBUG nova.compute.provider_tree [None req-8627fbb2-f07f-4595-a72c-5724ed106893 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Inventory has not changed in ProviderTree for provider: 7b15b0e5-df4d-49db-833b-2855d21d10ae {{(pid=72382) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 15:18:09 user nova-compute[72382]: DEBUG nova.scheduler.client.report [None req-8627fbb2-f07f-4595-a72c-5724ed106893 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Inventory has not changed for provider 7b15b0e5-df4d-49db-833b-2855d21d10ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72382) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 15:18:09 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-8627fbb2-f07f-4595-a72c-5724ed106893 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.661s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:18:09 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8627fbb2-f07f-4595-a72c-5724ed106893 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] [instance: 0f510d75-5d1e-4a5c-b38f-731c299f0f5a] Start building networks asynchronously for instance. {{(pid=72382) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 15:18:09 user nova-compute[72382]: DEBUG nova.virt.libvirt.guest [None req-cc59ad8f-6273-4c23-8869-cc1a783ecb14 tempest-TestVolumeSwap-1225930191 tempest-TestVolumeSwap-1225930191-project-admin] COPY block job progress, current cursor: 306184192 final cursor: 1073741824 {{(pid=72382) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 09 15:18:09 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8627fbb2-f07f-4595-a72c-5724ed106893 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] [instance: 0f510d75-5d1e-4a5c-b38f-731c299f0f5a] Allocating IP information in the background. {{(pid=72382) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 15:18:09 user nova-compute[72382]: DEBUG nova.network.neutron [None req-8627fbb2-f07f-4595-a72c-5724ed106893 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] [instance: 0f510d75-5d1e-4a5c-b38f-731c299f0f5a] allocate_for_instance() {{(pid=72382) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 15:18:09 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-8627fbb2-f07f-4595-a72c-5724ed106893 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] [instance: 0f510d75-5d1e-4a5c-b38f-731c299f0f5a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 15:18:09 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8627fbb2-f07f-4595-a72c-5724ed106893 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] [instance: 0f510d75-5d1e-4a5c-b38f-731c299f0f5a] Start building block device mappings for instance. {{(pid=72382) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 15:18:09 user nova-compute[72382]: INFO nova.virt.block_device [None req-8627fbb2-f07f-4595-a72c-5724ed106893 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] [instance: 0f510d75-5d1e-4a5c-b38f-731c299f0f5a] Booting with blank volume at /dev/vda
Aug 09 15:18:09 user nova-compute[72382]: DEBUG nova.policy [None req-8627fbb2-f07f-4595-a72c-5724ed106893 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e71af7a4912147cd9fab070cb77b275c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080d1ded4cd94e5083ee0b7e691b7363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72382) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 15:18:10 user nova-compute[72382]: DEBUG nova.virt.libvirt.guest [None req-cc59ad8f-6273-4c23-8869-cc1a783ecb14 tempest-TestVolumeSwap-1225930191 tempest-TestVolumeSwap-1225930191-project-admin] COPY block job progress, current cursor: 472907776 final cursor: 1073741824 {{(pid=72382) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 09 15:18:10 user nova-compute[72382]: DEBUG nova.virt.libvirt.guest [None req-cc59ad8f-6273-4c23-8869-cc1a783ecb14 tempest-TestVolumeSwap-1225930191 tempest-TestVolumeSwap-1225930191-project-admin] COPY block job progress, current cursor: 622854144 final cursor: 1073741824 {{(pid=72382) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 09 15:18:11 user nova-compute[72382]: DEBUG nova.virt.libvirt.guest [None req-cc59ad8f-6273-4c23-8869-cc1a783ecb14 tempest-TestVolumeSwap-1225930191 tempest-TestVolumeSwap-1225930191-project-admin] COPY block job progress, current cursor: 786432000 final cursor: 1073741824 {{(pid=72382) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 09 15:18:11 user nova-compute[72382]: DEBUG nova.network.neutron [None req-8627fbb2-f07f-4595-a72c-5724ed106893 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] [instance: 0f510d75-5d1e-4a5c-b38f-731c299f0f5a] Successfully created port: c67a8d45-c4ba-4302-940f-c05799ecc732 {{(pid=72382) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 15:18:11 user nova-compute[72382]: DEBUG nova.virt.libvirt.guest [None req-cc59ad8f-6273-4c23-8869-cc1a783ecb14 tempest-TestVolumeSwap-1225930191 tempest-TestVolumeSwap-1225930191-project-admin] COPY block job progress, current cursor: 916455424 final cursor: 1073741824 {{(pid=72382) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 09 15:18:12 user nova-compute[72382]: DEBUG nova.virt.libvirt.guest [None req-cc59ad8f-6273-4c23-8869-cc1a783ecb14 tempest-TestVolumeSwap-1225930191 tempest-TestVolumeSwap-1225930191-project-admin] COPY block job progress, current cursor: 1065353216 final cursor: 1073741824 {{(pid=72382) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 09 15:18:12 user nova-compute[72382]: DEBUG nova.network.neutron [None req-8627fbb2-f07f-4595-a72c-5724ed106893 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] [instance: 0f510d75-5d1e-4a5c-b38f-731c299f0f5a] Successfully updated port: c67a8d45-c4ba-4302-940f-c05799ecc732 {{(pid=72382) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 15:18:12 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-8627fbb2-f07f-4595-a72c-5724ed106893 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Acquiring lock "refresh_cache-0f510d75-5d1e-4a5c-b38f-731c299f0f5a" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 15:18:12 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-8627fbb2-f07f-4595-a72c-5724ed106893 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Acquired lock "refresh_cache-0f510d75-5d1e-4a5c-b38f-731c299f0f5a" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 15:18:12 user nova-compute[72382]: DEBUG nova.network.neutron [None req-8627fbb2-f07f-4595-a72c-5724ed106893 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] [instance: 0f510d75-5d1e-4a5c-b38f-731c299f0f5a] Building network info cache for instance {{(pid=72382) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 15:18:12 user nova-compute[72382]: DEBUG nova.compute.manager [req-caf09370-787d-44c5-bd4f-5027cc4f398b req-17df2bc0-6ca4-4ff0-815e-33b41ac2c852 service nova] [instance: 0f510d75-5d1e-4a5c-b38f-731c299f0f5a] Received event network-changed-c67a8d45-c4ba-4302-940f-c05799ecc732 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:18:12 user nova-compute[72382]: DEBUG nova.compute.manager [req-caf09370-787d-44c5-bd4f-5027cc4f398b req-17df2bc0-6ca4-4ff0-815e-33b41ac2c852 service nova] [instance: 0f510d75-5d1e-4a5c-b38f-731c299f0f5a] Refreshing instance network info cache due to event network-changed-c67a8d45-c4ba-4302-940f-c05799ecc732. {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 15:18:12 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-caf09370-787d-44c5-bd4f-5027cc4f398b req-17df2bc0-6ca4-4ff0-815e-33b41ac2c852 service nova] Acquiring lock "refresh_cache-0f510d75-5d1e-4a5c-b38f-731c299f0f5a" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 15:18:12 user nova-compute[72382]: DEBUG nova.network.neutron [None req-8627fbb2-f07f-4595-a72c-5724ed106893 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] [instance: 0f510d75-5d1e-4a5c-b38f-731c299f0f5a] Instance cache missing network info. {{(pid=72382) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 15:18:12 user nova-compute[72382]: DEBUG nova.virt.libvirt.guest [None req-cc59ad8f-6273-4c23-8869-cc1a783ecb14 tempest-TestVolumeSwap-1225930191 tempest-TestVolumeSwap-1225930191-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=72382) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 09 15:18:12 user nova-compute[72382]: DEBUG nova.compute.manager [req-fb9cb362-e5ce-4361-861d-3345fd5b2f4e req-1c0f0d81-f7f8-48b0-98e3-4384903be62f service nova] [instance: f1b4f73b-7a9e-4cf1-9d51-f32284f49c53] Received event network-changed-d031358f-2670-4942-9266-d9db448a078b {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:18:12 user nova-compute[72382]: DEBUG nova.compute.manager [req-fb9cb362-e5ce-4361-861d-3345fd5b2f4e req-1c0f0d81-f7f8-48b0-98e3-4384903be62f service nova] [instance: f1b4f73b-7a9e-4cf1-9d51-f32284f49c53] Refreshing instance network info cache due to event network-changed-d031358f-2670-4942-9266-d9db448a078b. {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 15:18:12 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-fb9cb362-e5ce-4361-861d-3345fd5b2f4e req-1c0f0d81-f7f8-48b0-98e3-4384903be62f service nova] Acquiring lock "refresh_cache-f1b4f73b-7a9e-4cf1-9d51-f32284f49c53" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 15:18:12 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-fb9cb362-e5ce-4361-861d-3345fd5b2f4e req-1c0f0d81-f7f8-48b0-98e3-4384903be62f service nova] Acquired lock "refresh_cache-f1b4f73b-7a9e-4cf1-9d51-f32284f49c53" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 15:18:12 user nova-compute[72382]: DEBUG nova.network.neutron [req-fb9cb362-e5ce-4361-861d-3345fd5b2f4e req-1c0f0d81-f7f8-48b0-98e3-4384903be62f service nova] [instance: f1b4f73b-7a9e-4cf1-9d51-f32284f49c53] Refreshing network info cache for port d031358f-2670-4942-9266-d9db448a078b {{(pid=72382) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 15:18:12 user nova-compute[72382]: DEBUG nova.network.neutron [None req-8627fbb2-f07f-4595-a72c-5724ed106893 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] [instance: 0f510d75-5d1e-4a5c-b38f-731c299f0f5a] Updating instance_info_cache with network_info: [{"id": "c67a8d45-c4ba-4302-940f-c05799ecc732", "address": "fa:16:3e:02:6d:5d", "network": {"id": "d47e3749-fdff-4112-bd72-69ca584efe1f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-302967634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "080d1ded4cd94e5083ee0b7e691b7363", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc67a8d45-c4", "ovs_interfaceid": "c67a8d45-c4ba-4302-940f-c05799ecc732", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:18:12 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-8627fbb2-f07f-4595-a72c-5724ed106893 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Releasing lock "refresh_cache-0f510d75-5d1e-4a5c-b38f-731c299f0f5a" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 15:18:12 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8627fbb2-f07f-4595-a72c-5724ed106893 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] [instance: 0f510d75-5d1e-4a5c-b38f-731c299f0f5a] Instance network_info: |[{"id": "c67a8d45-c4ba-4302-940f-c05799ecc732", "address": "fa:16:3e:02:6d:5d", "network": {"id": "d47e3749-fdff-4112-bd72-69ca584efe1f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-302967634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "080d1ded4cd94e5083ee0b7e691b7363", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc67a8d45-c4", "ovs_interfaceid": "c67a8d45-c4ba-4302-940f-c05799ecc732", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72382) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 15:18:12 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-caf09370-787d-44c5-bd4f-5027cc4f398b req-17df2bc0-6ca4-4ff0-815e-33b41ac2c852 service nova] Acquired lock "refresh_cache-0f510d75-5d1e-4a5c-b38f-731c299f0f5a" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 15:18:12 user nova-compute[72382]: DEBUG nova.network.neutron [req-caf09370-787d-44c5-bd4f-5027cc4f398b req-17df2bc0-6ca4-4ff0-815e-33b41ac2c852 service nova] [instance: 0f510d75-5d1e-4a5c-b38f-731c299f0f5a] Refreshing network info cache for port c67a8d45-c4ba-4302-940f-c05799ecc732 {{(pid=72382) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 15:18:12 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cc59ad8f-6273-4c23-8869-cc1a783ecb14 tempest-TestVolumeSwap-1225930191 tempest-TestVolumeSwap-1225930191-project-admin] [instance: 9a82f146-97ce-4319-8b25-c1b090965e53] calling os-brick to detach iSCSI Volume {{(pid=72382) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 15:18:12 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc59ad8f-6273-4c23-8869-cc1a783ecb14 tempest-TestVolumeSwap-1225930191 tempest-TestVolumeSwap-1225930191-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2a0c768340>, {'target_iqns': ['iqn.2010-10.org.openstack:ad1e2adc-5d1a-4718-8971-7d362e291602'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'avodyQXL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 15:18:12 user nova-compute[72382]: WARNING os_brick.initiator.connectors.base [None req-cc59ad8f-6273-4c23-8869-cc1a783ecb14 tempest-TestVolumeSwap-1225930191 tempest-TestVolumeSwap-1225930191-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 15:18:12 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-cc59ad8f-6273-4c23-8869-cc1a783ecb14 tempest-TestVolumeSwap-1225930191 tempest-TestVolumeSwap-1225930191-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 15:18:12 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-cc59ad8f-6273-4c23-8869-cc1a783ecb14 tempest-TestVolumeSwap-1225930191 tempest-TestVolumeSwap-1225930191-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 15:18:12 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc59ad8f-6273-4c23-8869-cc1a783ecb14 tempest-TestVolumeSwap-1225930191 tempest-TestVolumeSwap-1225930191-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ad1e2adc-5d1a-4718-8971-7d362e291602', 0)] {{(pid=72382) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 15:18:12 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:18:12 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:18:12 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bbe5870-e4b5-4ef2-9dae-9b0ed7e4e2fe]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:16ef1023-88b6-4e22-9b4b-45515b25ca9b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:344efe6d-5a52-4d0d-a34e-da8627a1e09f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5a13916f-1416-4b94-9e10-96f9e6415753\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ad1e2adc-5d1a-4718-8971-7d362e291602\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e2267629-52cf-439c-9083-3e8384c67f08\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:18:12 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:18:12 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:18:12 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e381aa3-930a-45ba-bc49-5df01ed000d8]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:344efe6d-5a52-4d0d-a34e-da8627a1e09f (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2267629-52cf-439c-9083-3e8384c67f08 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a13916f-1416-4b94-9e10-96f9e6415753 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16ef1023-88b6-4e22-9b4b-45515b25ca9b (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad1e2adc-5d1a-4718-8971-7d362e291602 (non-flash)\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:18:12 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc59ad8f-6273-4c23-8869-cc1a783ecb14 tempest-TestVolumeSwap-1225930191 tempest-TestVolumeSwap-1225930191-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:344efe6d-5a52-4d0d-a34e-da8627a1e09f (non-flash)
Aug 09 15:18:12 user nova-compute[72382]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2267629-52cf-439c-9083-3e8384c67f08 (non-flash)
Aug 09 15:18:12 user nova-compute[72382]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a13916f-1416-4b94-9e10-96f9e6415753 (non-flash)
Aug 09 15:18:12 user nova-compute[72382]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16ef1023-88b6-4e22-9b4b-45515b25ca9b (non-flash)
Aug 09 15:18:12 user nova-compute[72382]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad1e2adc-5d1a-4718-8971-7d362e291602 (non-flash)
Aug 09 15:18:12 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 15:18:12 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc59ad8f-6273-4c23-8869-cc1a783ecb14 tempest-TestVolumeSwap-1225930191 tempest-TestVolumeSwap-1225930191-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:344efe6d-5a52-4d0d-a34e-da8627a1e09f (non-flash)
Aug 09 15:18:12 user nova-compute[72382]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2267629-52cf-439c-9083-3e8384c67f08 (non-flash)
Aug 09 15:18:12 user nova-compute[72382]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a13916f-1416-4b94-9e10-96f9e6415753 (non-flash)
Aug 09 15:18:12 user nova-compute[72382]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16ef1023-88b6-4e22-9b4b-45515b25ca9b (non-flash)
Aug 09 15:18:12 user nova-compute[72382]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad1e2adc-5d1a-4718-8971-7d362e291602 (non-flash)
Aug 09 15:18:12 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 15:18:12 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc59ad8f-6273-4c23-8869-cc1a783ecb14 tempest-TestVolumeSwap-1225930191 tempest-TestVolumeSwap-1225930191-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2a0c31f910>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ad1e2adc-5d1a-4718-8971-7d362e291602'): ({'sde'}, set())}) {{(pid=72382) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 15:18:12 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-cc59ad8f-6273-4c23-8869-cc1a783ecb14 tempest-TestVolumeSwap-1225930191 tempest-TestVolumeSwap-1225930191-project-admin] Removing single pathed devices sde {{(pid=72382) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 15:18:12 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:18:12 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:18:12 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fe5d47b-272e-49a3-a717-d6d98339c876]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:18:12 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:18:12 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:18:12 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[53228114-d490-4cab-ae7d-51502577be8a]: (4, ('ok\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:18:12 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-cc59ad8f-6273-4c23-8869-cc1a783ecb14 tempest-TestVolumeSwap-1225930191 tempest-TestVolumeSwap-1225930191-project-admin] Flushing IO for device /dev/sde {{(pid=72382) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 15:18:12 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:18:13 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:18:13 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a0ce140-3d81-43f3-bb49-0e4c4daac492]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:18:13 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-cc59ad8f-6273-4c23-8869-cc1a783ecb14 tempest-TestVolumeSwap-1225930191 tempest-TestVolumeSwap-1225930191-project-admin] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72382) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 15:18:13 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:18:13 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.042s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:18:13 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[928d558a-7ae5-4c8e-9642-e8d5ed376b48]: (4, ('1', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:18:13 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-cc59ad8f-6273-4c23-8869-cc1a783ecb14 tempest-TestVolumeSwap-1225930191 tempest-TestVolumeSwap-1225930191-project-admin] Checking to see if SCSI volumes sde have been removed. {{(pid=72382) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 15:18:13 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-cc59ad8f-6273-4c23-8869-cc1a783ecb14 tempest-TestVolumeSwap-1225930191 tempest-TestVolumeSwap-1225930191-project-admin] SCSI volumes sde have been removed. {{(pid=72382) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 15:18:13 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc59ad8f-6273-4c23-8869-cc1a783ecb14 tempest-TestVolumeSwap-1225930191 tempest-TestVolumeSwap-1225930191-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ad1e2adc-5d1a-4718-8971-7d362e291602')] {{(pid=72382) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 15:18:13 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad1e2adc-5d1a-4718-8971-7d362e291602 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:18:13 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad1e2adc-5d1a-4718-8971-7d362e291602 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.137s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:18:13 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[55cf2e9e-0a51-422c-b887-21aee840131f]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:18:13 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc59ad8f-6273-4c23-8869-cc1a783ecb14 tempest-TestVolumeSwap-1225930191 tempest-TestVolumeSwap-1225930191-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:18:13 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad1e2adc-5d1a-4718-8971-7d362e291602 -p 172.16.0.220:3260 --logout {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:18:13 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad1e2adc-5d1a-4718-8971-7d362e291602 -p 172.16.0.220:3260 --logout" returned: 0 in 0.193s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:18:13 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfa382fa-022c-498d-9781-f57e17fd3e5e]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:ad1e2adc-5d1a-4718-8971-7d362e291602, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:ad1e2adc-5d1a-4718-8971-7d362e291602, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:18:13 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc59ad8f-6273-4c23-8869-cc1a783ecb14 tempest-TestVolumeSwap-1225930191 tempest-TestVolumeSwap-1225930191-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:ad1e2adc-5d1a-4718-8971-7d362e291602, portal: 172.16.0.220,3260]
Aug 09 15:18:13 user nova-compute[72382]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:ad1e2adc-5d1a-4718-8971-7d362e291602, portal: 172.16.0.220,3260] successful.
Aug 09 15:18:13 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:18:13 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad1e2adc-5d1a-4718-8971-7d362e291602 -p 172.16.0.220:3260 --op delete {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:18:13 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad1e2adc-5d1a-4718-8971-7d362e291602 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:18:13 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4789510-9209-4665-b6e7-2e3e4fb21c66]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:18:13 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc59ad8f-6273-4c23-8869-cc1a783ecb14 tempest-TestVolumeSwap-1225930191 tempest-TestVolumeSwap-1225930191-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:18:13 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-cc59ad8f-6273-4c23-8869-cc1a783ecb14 tempest-TestVolumeSwap-1225930191 tempest-TestVolumeSwap-1225930191-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.592s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 15:18:13 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc59ad8f-6273-4c23-8869-cc1a783ecb14 tempest-TestVolumeSwap-1225930191 tempest-TestVolumeSwap-1225930191-project-admin] <== disconnect_volume: return (593ms) None {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 15:18:13 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cc59ad8f-6273-4c23-8869-cc1a783ecb14 tempest-TestVolumeSwap-1225930191 tempest-TestVolumeSwap-1225930191-project-admin] [instance: 9a82f146-97ce-4319-8b25-c1b090965e53] Disconnected iSCSI Volume {{(pid=72382) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 15:18:13 user nova-compute[72382]: DEBUG nova.compute.manager [None req-cc59ad8f-6273-4c23-8869-cc1a783ecb14 tempest-TestVolumeSwap-1225930191 tempest-TestVolumeSwap-1225930191-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:344efe6d-5a52-4d0d-a34e-da8627a1e09f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qiuZemSC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, 'status': 'reserved', 'instance': '9a82f146-97ce-4319-8b25-c1b090965e53', 'attached_at': '', 'detached_at': '', 'volume_id': '344efe6d-5a52-4d0d-a34e-da8627a1e09f', 'serial'} {{(pid=72382) _swap_volume /opt/stack/nova/nova/compute/manager.py:7711}}
Aug 09 15:18:13 user nova-compute[72382]: DEBUG nova.compute.manager [None req-cc59ad8f-6273-4c23-8869-cc1a783ecb14 tempest-TestVolumeSwap-1225930191 tempest-TestVolumeSwap-1225930191-project-admin] [instance: 9a82f146-97ce-4319-8b25-c1b090965e53] swap_volume: removing Cinder connection for volume ad1e2adc-5d1a-4718-8971-7d362e291602 {{(pid=72382) _swap_volume /opt/stack/nova/nova/compute/manager.py:7756}}
Aug 09 15:18:13 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:18:13 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:18:13 user nova-compute[72382]: DEBUG nova.network.neutron [req-caf09370-787d-44c5-bd4f-5027cc4f398b req-17df2bc0-6ca4-4ff0-815e-33b41ac2c852 service nova] [instance: 0f510d75-5d1e-4a5c-b38f-731c299f0f5a] Updated VIF entry in instance network info cache for port c67a8d45-c4ba-4302-940f-c05799ecc732. {{(pid=72382) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 15:18:13 user nova-compute[72382]: DEBUG nova.network.neutron [req-caf09370-787d-44c5-bd4f-5027cc4f398b req-17df2bc0-6ca4-4ff0-815e-33b41ac2c852 service nova] [instance: 0f510d75-5d1e-4a5c-b38f-731c299f0f5a] Updating instance_info_cache with network_info: [{"id": "c67a8d45-c4ba-4302-940f-c05799ecc732", "address": "fa:16:3e:02:6d:5d", "network": {"id": "d47e3749-fdff-4112-bd72-69ca584efe1f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-302967634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "080d1ded4cd94e5083ee0b7e691b7363", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc67a8d45-c4", "ovs_interfaceid": "c67a8d45-c4ba-4302-940f-c05799ecc732", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:18:13 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-caf09370-787d-44c5-bd4f-5027cc4f398b req-17df2bc0-6ca4-4ff0-815e-33b41ac2c852 service nova] Releasing lock "refresh_cache-0f510d75-5d1e-4a5c-b38f-731c299f0f5a" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 15:18:13 user nova-compute[72382]: DEBUG nova.network.neutron [req-fb9cb362-e5ce-4361-861d-3345fd5b2f4e req-1c0f0d81-f7f8-48b0-98e3-4384903be62f service nova] [instance: f1b4f73b-7a9e-4cf1-9d51-f32284f49c53] Updated VIF entry in instance network info cache for port d031358f-2670-4942-9266-d9db448a078b. {{(pid=72382) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 15:18:13 user nova-compute[72382]: DEBUG nova.network.neutron [req-fb9cb362-e5ce-4361-861d-3345fd5b2f4e req-1c0f0d81-f7f8-48b0-98e3-4384903be62f service nova] [instance: f1b4f73b-7a9e-4cf1-9d51-f32284f49c53] Updating instance_info_cache with network_info: [{"id": "d031358f-2670-4942-9266-d9db448a078b", "address": "fa:16:3e:4d:2e:d1", "network": {"id": "6c42873e-d293-4fe2-8d72-d048d58d0141", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1386426199-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7345242bf74a4b91a057182d9b5172c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd031358f-26", "ovs_interfaceid": "d031358f-2670-4942-9266-d9db448a078b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3cea2e31-e2a9-4b8a-976b-ce818aaca460", "address": "fa:16:3e:ef:80:eb", "network": {"id": "b16bed11-36bd-4428-a500-f0ad85bfaf2d", "bridge": "br-int", "label": "tempest-device-tagging-net1-483768340", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.27", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7345242bf74a4b91a057182d9b5172c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3cea2e31-e2", "ovs_interfaceid": "3cea2e31-e2a9-4b8a-976b-ce818aaca460", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fcd90f6b-ef1b-4f9d-9ced-b98f7be4bc55", "address": "fa:16:3e:90:b6:32", "network": {"id": "b16bed11-36bd-4428-a500-f0ad85bfaf2d", "bridge": "br-int", "label": "tempest-device-tagging-net1-483768340", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.115", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7345242bf74a4b91a057182d9b5172c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcd90f6b-ef", "ovs_interfaceid": "fcd90f6b-ef1b-4f9d-9ced-b98f7be4bc55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d96a280e-5aeb-4a7c-97da-431e5f42c7f6", "address": "fa:16:3e:90:60:1f", "network": {"id": "b16bed11-36bd-4428-a500-f0ad85bfaf2d", "bridge": "br-int", "label": "tempest-device-tagging-net1-483768340", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.234", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7345242bf74a4b91a057182d9b5172c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd96a280e-5a", "ovs_interfaceid": "d96a280e-5aeb-4a7c-97da-431e5f42c7f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "92c19874-960c-4e03-8537-6ae44812a1da", "address": "fa:16:3e:a2:61:33", "network": {"id": "b16bed11-36bd-4428-a500-f0ad85bfaf2d", "bridge": "br-int", "label": "tempest-device-tagging-net1-483768340", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.114", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7345242bf74a4b91a057182d9b5172c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92c19874-96", "ovs_interfaceid": "92c19874-960c-4e03-8537-6ae44812a1da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6830a784-9d5e-4efe-8b35-9d1713e0c8ce", "address": "fa:16:3e:99:2e:fe", "network": {"id": "5bf13de0-38d0-4177-9863-980a7c39151c", "bridge": "br-int", "label": "tempest-device-tagging-net2-427749890", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7345242bf74a4b91a057182d9b5172c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6830a784-9d", "ovs_interfaceid": "6830a784-9d5e-4efe-8b35-9d1713e0c8ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "650ae32c-3dec-4bad-8ff0-6ad423e1cb21", "address": "fa:16:3e:c9:be:0b", "network": {"id": "5bf13de0-38d0-4177-9863-980a7c39151c", "bridge": "br-int", "label": "tempest-device-tagging-net2-427749890", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7345242bf74a4b91a057182d9b5172c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap650ae32c-3d", "ovs_interfaceid": "650ae32c-3dec-4bad-8ff0-6ad423e1cb21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:18:13 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-fb9cb362-e5ce-4361-861d-3345fd5b2f4e req-1c0f0d81-f7f8-48b0-98e3-4384903be62f service nova] Releasing lock "refresh_cache-f1b4f73b-7a9e-4cf1-9d51-f32284f49c53" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 15:18:14 user nova-compute[72382]: DEBUG nova.compute.manager [None req-cc59ad8f-6273-4c23-8869-cc1a783ecb14 tempest-TestVolumeSwap-1225930191 tempest-TestVolumeSwap-1225930191-project-admin] [instance: 9a82f146-97ce-4319-8b25-c1b090965e53] swap_volume: Updating volume ad1e2adc-5d1a-4718-8971-7d362e291602 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqns": ["iqn.2010-10.org.openstack:344efe6d-5a52-4d0d-a34e-da8627a1e09f"], "target_portals": ["172.16.0.220:3260"], "target_luns": [0], "target_discovered": false, "auth_method": "CHAP", "auth_username": "qiuZemSC", "auth_password": "HeY94TU1pVdJkF", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdf", "volume_id": "344efe6d-5a52-4d0d-a34e-da8627a1e09f"}, "status": "reserved", "instance": "9a82f146-97ce-4319-8b25-c1b090965e53", "attached_at": "", "detached_at": "", "volume_id": "344efe6d-5a52-4d0d-a34e-da8627a1e09f", "serial": "344efe6d-5a52-4d0d-a34e-da8627a1e09f"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '344efe6d-5a52-4d0d-a34e-da8627a1e09f', 'no_device': None, 'attachment_id': 'c01e9999-ec33-4038-9c0f-41234f26975a'} {{(pid=72382) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7904}}
Aug 09 15:18:14 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-cc59ad8f-6273-4c23-8869-cc1a783ecb14 tempest-TestVolumeSwap-1225930191 tempest-TestVolumeSwap-1225930191-project-admin] Lock "9a82f146-97ce-4319-8b25-c1b090965e53" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 16.281s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:18:14 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-84cdb645-ea72-4c8c-9930-f6786758445c tempest-TestVolumeSwap-1225930191 tempest-TestVolumeSwap-1225930191-project-admin] Acquiring lock "9a82f146-97ce-4319-8b25-c1b090965e53" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:18:14 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-84cdb645-ea72-4c8c-9930-f6786758445c tempest-TestVolumeSwap-1225930191 tempest-TestVolumeSwap-1225930191-project-admin] Lock "9a82f146-97ce-4319-8b25-c1b090965e53" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:18:14 user nova-compute[72382]: DEBUG os_brick.utils [None req-84cdb645-ea72-4c8c-9930-f6786758445c tempest-TestVolumeSwap-1225930191 tempest-TestVolumeSwap-1225930191-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 15:18:14 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:18:15 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:18:15 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4026748-2c52-4a3f-bf2a-92b2609d8cd5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d2cfa7015fe\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:18:15 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:18:15 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:18:15 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfbd8210-93a0-4641-9fd8-625b55a5c6f4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:18:15 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:18:15 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:18:15 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2f22883-ac70-4d50-a7bd-1d6e0c88b348]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:18:15 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc61b0ce-195d-4d7e-907b-95e7ba9e49db]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:18:15 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-84cdb645-ea72-4c8c-9930-f6786758445c tempest-TestVolumeSwap-1225930191 tempest-TestVolumeSwap-1225930191-project-admin] Running cmd (subprocess): nvme version {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:18:15 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-84cdb645-ea72-4c8c-9930-f6786758445c tempest-TestVolumeSwap-1225930191 tempest-TestVolumeSwap-1225930191-project-admin] 'nvme version' failed. Not Retrying. {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 15:18:15 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.nvmeof [None req-84cdb645-ea72-4c8c-9930-f6786758445c tempest-TestVolumeSwap-1225930191 tempest-TestVolumeSwap-1225930191-project-admin] nvme not present on system {{(pid=72382) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 15:18:15 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:18:15 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 15:18:15 user nova-compute[72382]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 15:18:15 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bb0b565-4168-48ab-a785-a5671ad05ce9]: (4, '') {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:18:15 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.lightos [None req-84cdb645-ea72-4c8c-9930-f6786758445c tempest-TestVolumeSwap-1225930191 tempest-TestVolumeSwap-1225930191-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72382) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 15:18:15 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.lightos [None req-84cdb645-ea72-4c8c-9930-f6786758445c tempest-TestVolumeSwap-1225930191 tempest-TestVolumeSwap-1225930191-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72382) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 15:18:15 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.lightos [None req-84cdb645-ea72-4c8c-9930-f6786758445c tempest-TestVolumeSwap-1225930191 tempest-TestVolumeSwap-1225930191-project-admin] LIGHTOS: no hostnqn found. {{(pid=72382) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 15:18:15 user nova-compute[72382]: DEBUG os_brick.utils [None req-84cdb645-ea72-4c8c-9930-f6786758445c tempest-TestVolumeSwap-1225930191 tempest-TestVolumeSwap-1225930191-project-admin] <== get_connector_properties: return (188ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d2cfa7015fe', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 15:18:15 user nova-compute[72382]: INFO nova.compute.manager [None req-84cdb645-ea72-4c8c-9930-f6786758445c tempest-TestVolumeSwap-1225930191 tempest-TestVolumeSwap-1225930191-project-admin] [instance: 9a82f146-97ce-4319-8b25-c1b090965e53] Swapping volume 344efe6d-5a52-4d0d-a34e-da8627a1e09f for ad1e2adc-5d1a-4718-8971-7d362e291602
Aug 09 15:18:15 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-2544ea4f-5263-465f-8936-f92a2cdc1b77 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] Acquiring lock "f1b4f73b-7a9e-4cf1-9d51-f32284f49c53" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:18:15 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-2544ea4f-5263-465f-8936-f92a2cdc1b77 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] Lock "f1b4f73b-7a9e-4cf1-9d51-f32284f49c53" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:18:15 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-2544ea4f-5263-465f-8936-f92a2cdc1b77 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] Acquiring lock "f1b4f73b-7a9e-4cf1-9d51-f32284f49c53-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:18:15 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-2544ea4f-5263-465f-8936-f92a2cdc1b77 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] Lock "f1b4f73b-7a9e-4cf1-9d51-f32284f49c53-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:18:15 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-2544ea4f-5263-465f-8936-f92a2cdc1b77 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] Lock "f1b4f73b-7a9e-4cf1-9d51-f32284f49c53-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:18:15 user nova-compute[72382]: INFO nova.compute.manager [None req-2544ea4f-5263-465f-8936-f92a2cdc1b77 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] [instance: f1b4f73b-7a9e-4cf1-9d51-f32284f49c53] Terminating instance
Aug 09 15:18:15 user nova-compute[72382]: DEBUG nova.compute.manager [None req-2544ea4f-5263-465f-8936-f92a2cdc1b77 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] [instance: f1b4f73b-7a9e-4cf1-9d51-f32284f49c53] Start destroying the instance on the hypervisor. {{(pid=72382) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 15:18:15 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:18:15 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:18:15 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:18:15 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:18:15 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:18:15 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:18:15 user nova-compute[72382]: DEBUG os_brick.utils [None req-8627fbb2-f07f-4595-a72c-5724ed106893 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 15:18:15 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:18:15 user nova-compute[72382]: DEBUG nova.compute.manager [req-04a403ac-255b-4fd4-9f78-78d30dad6205 req-b403cdb3-01c3-4213-981f-2f3223ffd78a service nova] [instance: f1b4f73b-7a9e-4cf1-9d51-f32284f49c53] Received event network-vif-unplugged-d031358f-2670-4942-9266-d9db448a078b {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:18:15 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-04a403ac-255b-4fd4-9f78-78d30dad6205 req-b403cdb3-01c3-4213-981f-2f3223ffd78a service nova] Acquiring lock "f1b4f73b-7a9e-4cf1-9d51-f32284f49c53-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:18:15 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-04a403ac-255b-4fd4-9f78-78d30dad6205 req-b403cdb3-01c3-4213-981f-2f3223ffd78a service nova] Lock "f1b4f73b-7a9e-4cf1-9d51-f32284f49c53-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:18:15 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-04a403ac-255b-4fd4-9f78-78d30dad6205 req-b403cdb3-01c3-4213-981f-2f3223ffd78a service nova] Lock "f1b4f73b-7a9e-4cf1-9d51-f32284f49c53-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:18:15 user nova-compute[72382]: DEBUG nova.compute.manager [req-04a403ac-255b-4fd4-9f78-78d30dad6205 req-b403cdb3-01c3-4213-981f-2f3223ffd78a service nova] [instance: f1b4f73b-7a9e-4cf1-9d51-f32284f49c53] No waiting events found dispatching network-vif-unplugged-d031358f-2670-4942-9266-d9db448a078b {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:18:15 user nova-compute[72382]: DEBUG nova.compute.manager [req-04a403ac-255b-4fd4-9f78-78d30dad6205 req-b403cdb3-01c3-4213-981f-2f3223ffd78a service nova] [instance: f1b4f73b-7a9e-4cf1-9d51-f32284f49c53] Received event network-vif-unplugged-d031358f-2670-4942-9266-d9db448a078b for instance with task_state deleting. {{(pid=72382) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 15:18:15 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:18:15 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.025s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:18:15 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[16460ddd-65f0-4314-a5bd-fe7dad82cca2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d2cfa7015fe\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:18:15 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:18:15 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:18:15 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe7a2a41-942f-4e82-88a3-d9baea062c44]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:18:15 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:18:15 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:18:15 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:18:15 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[936bd64f-a25d-4b3d-b4cc-e9e2df8f48e5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:18:15 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[d28e7756-ce54-4e85-92b6-ced8116f0828]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:18:15 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-8627fbb2-f07f-4595-a72c-5724ed106893 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Running cmd (subprocess): nvme version {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:18:15 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-8627fbb2-f07f-4595-a72c-5724ed106893 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] 'nvme version' failed. Not Retrying. {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 15:18:15 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:18:15 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8627fbb2-f07f-4595-a72c-5724ed106893 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] nvme not present on system {{(pid=72382) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 15:18:15 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:18:15 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 15:18:15 user nova-compute[72382]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 15:18:15 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[851bca12-654b-4ef3-89a1-25e0e7d8997a]: (4, '') {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:18:16 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.lightos [None req-8627fbb2-f07f-4595-a72c-5724ed106893 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72382) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 15:18:16 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.lightos [None req-8627fbb2-f07f-4595-a72c-5724ed106893 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72382) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 15:18:16 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.lightos [None req-8627fbb2-f07f-4595-a72c-5724ed106893 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] LIGHTOS: no hostnqn found. {{(pid=72382) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 15:18:16 user nova-compute[72382]: DEBUG os_brick.utils [None req-8627fbb2-f07f-4595-a72c-5724ed106893 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] <== get_connector_properties: return (174ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d2cfa7015fe', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 15:18:16 user nova-compute[72382]: DEBUG nova.virt.block_device [None req-8627fbb2-f07f-4595-a72c-5724ed106893 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] [instance: 0f510d75-5d1e-4a5c-b38f-731c299f0f5a] Updating existing volume attachment record: 942f03cb-1574-4554-bff0-2b8050295136 {{(pid=72382) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 15:18:16 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:18:16 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:18:16 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:18:16 user nova-compute[72382]: DEBUG nova.compute.manager [req-2a75cd33-0ad2-4c51-9f8f-5da9206c328c req-a6c4186f-83f3-4363-837d-ef0798f100cc service nova] [instance: f1b4f73b-7a9e-4cf1-9d51-f32284f49c53] Received event network-vif-unplugged-fcd90f6b-ef1b-4f9d-9ced-b98f7be4bc55 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:18:16 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-2a75cd33-0ad2-4c51-9f8f-5da9206c328c req-a6c4186f-83f3-4363-837d-ef0798f100cc service nova] Acquiring lock "f1b4f73b-7a9e-4cf1-9d51-f32284f49c53-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:18:16 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-2a75cd33-0ad2-4c51-9f8f-5da9206c328c req-a6c4186f-83f3-4363-837d-ef0798f100cc service nova] Lock "f1b4f73b-7a9e-4cf1-9d51-f32284f49c53-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:18:16 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-2a75cd33-0ad2-4c51-9f8f-5da9206c328c req-a6c4186f-83f3-4363-837d-ef0798f100cc service nova] Lock "f1b4f73b-7a9e-4cf1-9d51-f32284f49c53-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:18:16 user nova-compute[72382]: DEBUG nova.compute.manager [req-2a75cd33-0ad2-4c51-9f8f-5da9206c328c req-a6c4186f-83f3-4363-837d-ef0798f100cc service nova] [instance: f1b4f73b-7a9e-4cf1-9d51-f32284f49c53] No waiting events found dispatching network-vif-unplugged-fcd90f6b-ef1b-4f9d-9ced-b98f7be4bc55 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:18:16 user nova-compute[72382]: DEBUG nova.compute.manager [req-2a75cd33-0ad2-4c51-9f8f-5da9206c328c req-a6c4186f-83f3-4363-837d-ef0798f100cc service nova] [instance: f1b4f73b-7a9e-4cf1-9d51-f32284f49c53] Received event network-vif-unplugged-fcd90f6b-ef1b-4f9d-9ced-b98f7be4bc55 for instance with task_state deleting. {{(pid=72382) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 15:18:16 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:18:16 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:18:16 user nova-compute[72382]: DEBUG nova.compute.manager [req-0aed5cb7-ea76-4185-bb8f-69ef97a21bd4 req-cc2f035a-ed51-4bad-90be-fd59a0e91085 service nova] [instance: f1b4f73b-7a9e-4cf1-9d51-f32284f49c53] Received event network-vif-unplugged-d96a280e-5aeb-4a7c-97da-431e5f42c7f6 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:18:16 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-0aed5cb7-ea76-4185-bb8f-69ef97a21bd4 req-cc2f035a-ed51-4bad-90be-fd59a0e91085 service nova] Acquiring lock "f1b4f73b-7a9e-4cf1-9d51-f32284f49c53-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:18:16 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-0aed5cb7-ea76-4185-bb8f-69ef97a21bd4 req-cc2f035a-ed51-4bad-90be-fd59a0e91085 service nova] Lock "f1b4f73b-7a9e-4cf1-9d51-f32284f49c53-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:18:16 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-0aed5cb7-ea76-4185-bb8f-69ef97a21bd4 req-cc2f035a-ed51-4bad-90be-fd59a0e91085 service nova] Lock "f1b4f73b-7a9e-4cf1-9d51-f32284f49c53-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:18:16 user nova-compute[72382]: DEBUG nova.compute.manager [req-0aed5cb7-ea76-4185-bb8f-69ef97a21bd4 req-cc2f035a-ed51-4bad-90be-fd59a0e91085 service nova] [instance: f1b4f73b-7a9e-4cf1-9d51-f32284f49c53] No waiting events found dispatching network-vif-unplugged-d96a280e-5aeb-4a7c-97da-431e5f42c7f6 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:18:16 user nova-compute[72382]: DEBUG nova.compute.manager [req-0aed5cb7-ea76-4185-bb8f-69ef97a21bd4 req-cc2f035a-ed51-4bad-90be-fd59a0e91085 service nova] [instance: f1b4f73b-7a9e-4cf1-9d51-f32284f49c53] Received event network-vif-unplugged-d96a280e-5aeb-4a7c-97da-431e5f42c7f6 for instance with task_state deleting. {{(pid=72382) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 15:18:16 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:18:16 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:18:16 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:18:16 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:18:16 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:18:16 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:18:16 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:18:16 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:18:17 user nova-compute[72382]: INFO nova.virt.libvirt.driver [-] [instance: f1b4f73b-7a9e-4cf1-9d51-f32284f49c53] Instance destroyed successfully.
Aug 09 15:18:17 user nova-compute[72382]: DEBUG nova.objects.instance [None req-2544ea4f-5263-465f-8936-f92a2cdc1b77 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] Lazy-loading 'resources' on Instance uuid f1b4f73b-7a9e-4cf1-9d51-f32284f49c53 {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:18:17 user nova-compute[72382]: DEBUG nova.virt.libvirt.vif [None req-2544ea4f-5263-465f-8936-f92a2cdc1b77 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T15:16:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-572693492',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-572693492',id=12,image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMb7zhMvTYtSMjdbttccgrhGtZnLO3To5atuqn2KzXxPdjBeWNkfUC7xHzQcOqU2f9y/wGWlWICsIErR+5PTjvgcRPYq/Fn5iownuIQu/C79E2xKR9om6708gJPHzSBRPQ==',key_name='tempest-keypair-767486892',keypairs=<?>,launch_index=0,launched_at=2023-08-09T15:17:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7345242bf74a4b91a057182d9b5172c4',ramdisk_id='',reservation_id='r-oprrtn26',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1008702709',owner_user_name='tempest-TaggedBootDevicesTest-1008702709-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T15:17:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4a14592e76e2409aa5baf44221d227a4',uuid=f1b4f73b-7a9e-4cf1-9d51-f32284f49c53,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d031358f-2670-4942-9266-d9db448a078b", "address": "fa:16:3e:4d:2e:d1", "network": {"id": "6c42873e-d293-4fe2-8d72-d048d58d0141", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1386426199-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7345242bf74a4b91a057182d9b5172c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd031358f-26", "ovs_interfaceid": "d031358f-2670-4942-9266-d9db448a078b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 15:18:17 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-2544ea4f-5263-465f-8936-f92a2cdc1b77 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] Converting VIF {"id": "d031358f-2670-4942-9266-d9db448a078b", "address": "fa:16:3e:4d:2e:d1", "network": {"id": "6c42873e-d293-4fe2-8d72-d048d58d0141", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1386426199-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7345242bf74a4b91a057182d9b5172c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd031358f-26", "ovs_interfaceid": "d031358f-2670-4942-9266-d9db448a078b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 15:18:17 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-2544ea4f-5263-465f-8936-f92a2cdc1b77 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4d:2e:d1,bridge_name='br-int',has_traffic_filtering=True,id=d031358f-2670-4942-9266-d9db448a078b,network=Network(6c42873e-d293-4fe2-8d72-d048d58d0141),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd031358f-26') {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 15:18:17 user nova-compute[72382]: DEBUG os_vif [None req-2544ea4f-5263-465f-8936-f92a2cdc1b77 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4d:2e:d1,bridge_name='br-int',has_traffic_filtering=True,id=d031358f-2670-4942-9266-d9db448a078b,network=Network(6c42873e-d293-4fe2-8d72-d048d58d0141),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd031358f-26') {{(pid=72382) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 15:18:17 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:18:17 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd031358f-26, bridge=br-int, if_exists=True) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:18:17 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:18:17 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:18:17 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:18:17 user nova-compute[72382]: INFO os_vif [None req-2544ea4f-5263-465f-8936-f92a2cdc1b77 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4d:2e:d1,bridge_name='br-int',has_traffic_filtering=True,id=d031358f-2670-4942-9266-d9db448a078b,network=Network(6c42873e-d293-4fe2-8d72-d048d58d0141),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd031358f-26')
Aug 09 15:18:17 user nova-compute[72382]: DEBUG nova.virt.libvirt.vif [None req-2544ea4f-5263-465f-8936-f92a2cdc1b77 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T15:16:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-572693492',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-572693492',id=12,image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMb7zhMvTYtSMjdbttccgrhGtZnLO3To5atuqn2KzXxPdjBeWNkfUC7xHzQcOqU2f9y/wGWlWICsIErR+5PTjvgcRPYq/Fn5iownuIQu/C79E2xKR9om6708gJPHzSBRPQ==',key_name='tempest-keypair-767486892',keypairs=<?>,launch_index=0,launched_at=2023-08-09T15:17:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7345242bf74a4b91a057182d9b5172c4',ramdisk_id='',reservation_id='r-oprrtn26',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1008702709',owner_user_name='tempest-TaggedBootDevicesTest-1008702709-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T15:17:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4a14592e76e2409aa5baf44221d227a4',uuid=f1b4f73b-7a9e-4cf1-9d51-f32284f49c53,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3cea2e31-e2a9-4b8a-976b-ce818aaca460", "address": "fa:16:3e:ef:80:eb", "network": {"id": "b16bed11-36bd-4428-a500-f0ad85bfaf2d", "bridge": "br-int", "label": "tempest-device-tagging-net1-483768340", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.27", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7345242bf74a4b91a057182d9b5172c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3cea2e31-e2", "ovs_interfaceid": "3cea2e31-e2a9-4b8a-976b-ce818aaca460", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72382) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 15:18:17 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-2544ea4f-5263-465f-8936-f92a2cdc1b77 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] Converting VIF {"id": "3cea2e31-e2a9-4b8a-976b-ce818aaca460", "address": "fa:16:3e:ef:80:eb", "network": {"id": "b16bed11-36bd-4428-a500-f0ad85bfaf2d", "bridge": "br-int", "label": "tempest-device-tagging-net1-483768340", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.27", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7345242bf74a4b91a057182d9b5172c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3cea2e31-e2", "ovs_interfaceid": "3cea2e31-e2a9-4b8a-976b-ce818aaca460", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 15:18:17 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-2544ea4f-5263-465f-8936-f92a2cdc1b77 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ef:80:eb,bridge_name='br-int',has_traffic_filtering=True,id=3cea2e31-e2a9-4b8a-976b-ce818aaca460,network=Network(b16bed11-36bd-4428-a500-f0ad85bfaf2d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3cea2e31-e2') {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 15:18:17 user nova-compute[72382]: DEBUG os_vif [None req-2544ea4f-5263-465f-8936-f92a2cdc1b77 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ef:80:eb,bridge_name='br-int',has_traffic_filtering=True,id=3cea2e31-e2a9-4b8a-976b-ce818aaca460,network=Network(b16bed11-36bd-4428-a500-f0ad85bfaf2d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3cea2e31-e2') {{(pid=72382) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 15:18:17 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:18:17 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3cea2e31-e2, bridge=br-int, if_exists=True) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:18:17 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:18:17 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:18:17 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:18:17 user nova-compute[72382]: INFO os_vif [None req-2544ea4f-5263-465f-8936-f92a2cdc1b77 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ef:80:eb,bridge_name='br-int',has_traffic_filtering=True,id=3cea2e31-e2a9-4b8a-976b-ce818aaca460,network=Network(b16bed11-36bd-4428-a500-f0ad85bfaf2d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3cea2e31-e2')
Aug 09 15:18:17 user nova-compute[72382]: DEBUG nova.virt.libvirt.vif [None req-2544ea4f-5263-465f-8936-f92a2cdc1b77 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T15:16:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-572693492',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-572693492',id=12,image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMb7zhMvTYtSMjdbttccgrhGtZnLO3To5atuqn2KzXxPdjBeWNkfUC7xHzQcOqU2f9y/wGWlWICsIErR+5PTjvgcRPYq/Fn5iownuIQu/C79E2xKR9om6708gJPHzSBRPQ==',key_name='tempest-keypair-767486892',keypairs=<?>,launch_index=0,launched_at=2023-08-09T15:17:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7345242bf74a4b91a057182d9b5172c4',ramdisk_id='',reservation_id='r-oprrtn26',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1008702709',owner_user_name='tempest-TaggedBootDevicesTest-1008702709-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T15:17:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4a14592e76e2409aa5baf44221d227a4',uuid=f1b4f73b-7a9e-4cf1-9d51-f32284f49c53,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fcd90f6b-ef1b-4f9d-9ced-b98f7be4bc55", "address": "fa:16:3e:90:b6:32", "network": {"id": "b16bed11-36bd-4428-a500-f0ad85bfaf2d", "bridge": "br-int", "label": "tempest-device-tagging-net1-483768340", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.115", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7345242bf74a4b91a057182d9b5172c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcd90f6b-ef", "ovs_interfaceid": "fcd90f6b-ef1b-4f9d-9ced-b98f7be4bc55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72382) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 15:18:17 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-2544ea4f-5263-465f-8936-f92a2cdc1b77 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] Converting VIF {"id": "fcd90f6b-ef1b-4f9d-9ced-b98f7be4bc55", "address": "fa:16:3e:90:b6:32", "network": {"id": "b16bed11-36bd-4428-a500-f0ad85bfaf2d", "bridge": "br-int", "label": "tempest-device-tagging-net1-483768340", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.115", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7345242bf74a4b91a057182d9b5172c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcd90f6b-ef", "ovs_interfaceid": "fcd90f6b-ef1b-4f9d-9ced-b98f7be4bc55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 15:18:17 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-2544ea4f-5263-465f-8936-f92a2cdc1b77 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:90:b6:32,bridge_name='br-int',has_traffic_filtering=True,id=fcd90f6b-ef1b-4f9d-9ced-b98f7be4bc55,network=Network(b16bed11-36bd-4428-a500-f0ad85bfaf2d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapfcd90f6b-ef') {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 15:18:17 user nova-compute[72382]: DEBUG os_vif [None req-2544ea4f-5263-465f-8936-f92a2cdc1b77 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:90:b6:32,bridge_name='br-int',has_traffic_filtering=True,id=fcd90f6b-ef1b-4f9d-9ced-b98f7be4bc55,network=Network(b16bed11-36bd-4428-a500-f0ad85bfaf2d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapfcd90f6b-ef') {{(pid=72382) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 15:18:17 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:18:17 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfcd90f6b-ef, bridge=br-int, if_exists=True) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:18:17 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:18:17 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:18:17 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:18:17 user nova-compute[72382]: INFO os_vif [None req-2544ea4f-5263-465f-8936-f92a2cdc1b77 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:90:b6:32,bridge_name='br-int',has_traffic_filtering=True,id=fcd90f6b-ef1b-4f9d-9ced-b98f7be4bc55,network=Network(b16bed11-36bd-4428-a500-f0ad85bfaf2d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapfcd90f6b-ef')
Aug 09 15:18:17 user nova-compute[72382]: DEBUG nova.virt.libvirt.vif [None req-2544ea4f-5263-465f-8936-f92a2cdc1b77 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T15:16:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-572693492',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-572693492',id=12,image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMb7zhMvTYtSMjdbttccgrhGtZnLO3To5atuqn2KzXxPdjBeWNkfUC7xHzQcOqU2f9y/wGWlWICsIErR+5PTjvgcRPYq/Fn5iownuIQu/C79E2xKR9om6708gJPHzSBRPQ==',key_name='tempest-keypair-767486892',keypairs=<?>,launch_index=0,launched_at=2023-08-09T15:17:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7345242bf74a4b91a057182d9b5172c4',ramdisk_id='',reservation_id='r-oprrtn26',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1008702709',owner_user_name='tempest-TaggedBootDevicesTest-1008702709-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T15:17:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4a14592e76e2409aa5baf44221d227a4',uuid=f1b4f73b-7a9e-4cf1-9d51-f32284f49c53,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d96a280e-5aeb-4a7c-97da-431e5f42c7f6", "address": "fa:16:3e:90:60:1f", "network": {"id": "b16bed11-36bd-4428-a500-f0ad85bfaf2d", "bridge": "br-int", "label": "tempest-device-tagging-net1-483768340", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.234", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7345242bf74a4b91a057182d9b5172c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd96a280e-5a", "ovs_interfaceid": "d96a280e-5aeb-4a7c-97da-431e5f42c7f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 15:18:17 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-2544ea4f-5263-465f-8936-f92a2cdc1b77 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] Converting VIF {"id": "d96a280e-5aeb-4a7c-97da-431e5f42c7f6", "address": "fa:16:3e:90:60:1f", "network": {"id": "b16bed11-36bd-4428-a500-f0ad85bfaf2d", "bridge": "br-int", "label": "tempest-device-tagging-net1-483768340", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.234", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7345242bf74a4b91a057182d9b5172c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd96a280e-5a", "ovs_interfaceid": "d96a280e-5aeb-4a7c-97da-431e5f42c7f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 15:18:17 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-2544ea4f-5263-465f-8936-f92a2cdc1b77 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:90:60:1f,bridge_name='br-int',has_traffic_filtering=True,id=d96a280e-5aeb-4a7c-97da-431e5f42c7f6,network=Network(b16bed11-36bd-4428-a500-f0ad85bfaf2d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd96a280e-5a') {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 15:18:17 user nova-compute[72382]: DEBUG os_vif [None req-2544ea4f-5263-465f-8936-f92a2cdc1b77 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:90:60:1f,bridge_name='br-int',has_traffic_filtering=True,id=d96a280e-5aeb-4a7c-97da-431e5f42c7f6,network=Network(b16bed11-36bd-4428-a500-f0ad85bfaf2d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd96a280e-5a') {{(pid=72382) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 15:18:17 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:18:17 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd96a280e-5a, bridge=br-int, if_exists=True) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:18:17 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:18:17 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:18:17 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:18:17 user nova-compute[72382]: INFO os_vif [None req-2544ea4f-5263-465f-8936-f92a2cdc1b77 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:90:60:1f,bridge_name='br-int',has_traffic_filtering=True,id=d96a280e-5aeb-4a7c-97da-431e5f42c7f6,network=Network(b16bed11-36bd-4428-a500-f0ad85bfaf2d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd96a280e-5a')
Aug 09 15:18:17 user nova-compute[72382]: DEBUG nova.virt.libvirt.vif [None req-2544ea4f-5263-465f-8936-f92a2cdc1b77 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T15:16:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-572693492',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-572693492',id=12,image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMb7zhMvTYtSMjdbttccgrhGtZnLO3To5atuqn2KzXxPdjBeWNkfUC7xHzQcOqU2f9y/wGWlWICsIErR+5PTjvgcRPYq/Fn5iownuIQu/C79E2xKR9om6708gJPHzSBRPQ==',key_name='tempest-keypair-767486892',keypairs=<?>,launch_index=0,launched_at=2023-08-09T15:17:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7345242bf74a4b91a057182d9b5172c4',ramdisk_id='',reservation_id='r-oprrtn26',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1008702709',owner_user_name='tempest-TaggedBootDevicesTest-1008702709-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T15:17:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4a14592e76e2409aa5baf44221d227a4',uuid=f1b4f73b-7a9e-4cf1-9d51-f32284f49c53,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "92c19874-960c-4e03-8537-6ae44812a1da", "address": "fa:16:3e:a2:61:33", "network": {"id": "b16bed11-36bd-4428-a500-f0ad85bfaf2d", "bridge": "br-int", "label": "tempest-device-tagging-net1-483768340", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.114", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7345242bf74a4b91a057182d9b5172c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92c19874-96", "ovs_interfaceid": "92c19874-960c-4e03-8537-6ae44812a1da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 15:18:17 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-2544ea4f-5263-465f-8936-f92a2cdc1b77 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] Converting VIF {"id": "92c19874-960c-4e03-8537-6ae44812a1da", "address": "fa:16:3e:a2:61:33", "network": {"id": "b16bed11-36bd-4428-a500-f0ad85bfaf2d", "bridge": "br-int", "label": "tempest-device-tagging-net1-483768340", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.114", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7345242bf74a4b91a057182d9b5172c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92c19874-96", "ovs_interfaceid": "92c19874-960c-4e03-8537-6ae44812a1da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 15:18:17 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-2544ea4f-5263-465f-8936-f92a2cdc1b77 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a2:61:33,bridge_name='br-int',has_traffic_filtering=True,id=92c19874-960c-4e03-8537-6ae44812a1da,network=Network(b16bed11-36bd-4428-a500-f0ad85bfaf2d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92c19874-96') {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 15:18:17 user nova-compute[72382]: DEBUG os_vif [None req-2544ea4f-5263-465f-8936-f92a2cdc1b77 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:61:33,bridge_name='br-int',has_traffic_filtering=True,id=92c19874-960c-4e03-8537-6ae44812a1da,network=Network(b16bed11-36bd-4428-a500-f0ad85bfaf2d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92c19874-96') {{(pid=72382) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 15:18:17 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:18:17 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap92c19874-96, bridge=br-int, if_exists=True) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:18:17 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:18:17 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:18:17 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:18:17 user nova-compute[72382]: INFO os_vif [None req-2544ea4f-5263-465f-8936-f92a2cdc1b77 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:61:33,bridge_name='br-int',has_traffic_filtering=True,id=92c19874-960c-4e03-8537-6ae44812a1da,network=Network(b16bed11-36bd-4428-a500-f0ad85bfaf2d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92c19874-96')
Aug 09 15:18:17 user nova-compute[72382]: DEBUG nova.virt.libvirt.vif [None req-2544ea4f-5263-465f-8936-f92a2cdc1b77 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T15:16:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-572693492',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-572693492',id=12,image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMb7zhMvTYtSMjdbttccgrhGtZnLO3To5atuqn2KzXxPdjBeWNkfUC7xHzQcOqU2f9y/wGWlWICsIErR+5PTjvgcRPYq/Fn5iownuIQu/C79E2xKR9om6708gJPHzSBRPQ==',key_name='tempest-keypair-767486892',keypairs=<?>,launch_index=0,launched_at=2023-08-09T15:17:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7345242bf74a4b91a057182d9b5172c4',ramdisk_id='',reservation_id='r-oprrtn26',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1008702709',owner_user_name='tempest-TaggedBootDevicesTest-1008702709-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T15:17:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4a14592e76e2409aa5baf44221d227a4',uuid=f1b4f73b-7a9e-4cf1-9d51-f32284f49c53,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6830a784-9d5e-4efe-8b35-9d1713e0c8ce", "address": "fa:16:3e:99:2e:fe", "network": {"id": "5bf13de0-38d0-4177-9863-980a7c39151c", "bridge": "br-int", "label": "tempest-device-tagging-net2-427749890", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7345242bf74a4b91a057182d9b5172c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6830a784-9d", "ovs_interfaceid": "6830a784-9d5e-4efe-8b35-9d1713e0c8ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 15:18:17 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-2544ea4f-5263-465f-8936-f92a2cdc1b77 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] Converting VIF {"id": "6830a784-9d5e-4efe-8b35-9d1713e0c8ce", "address": "fa:16:3e:99:2e:fe", "network": {"id": "5bf13de0-38d0-4177-9863-980a7c39151c", "bridge": "br-int", "label": "tempest-device-tagging-net2-427749890", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7345242bf74a4b91a057182d9b5172c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6830a784-9d", "ovs_interfaceid": "6830a784-9d5e-4efe-8b35-9d1713e0c8ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 15:18:17 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-2544ea4f-5263-465f-8936-f92a2cdc1b77 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:99:2e:fe,bridge_name='br-int',has_traffic_filtering=True,id=6830a784-9d5e-4efe-8b35-9d1713e0c8ce,network=Network(5bf13de0-38d0-4177-9863-980a7c39151c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6830a784-9d') {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 15:18:17 user nova-compute[72382]: DEBUG os_vif [None req-2544ea4f-5263-465f-8936-f92a2cdc1b77 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:99:2e:fe,bridge_name='br-int',has_traffic_filtering=True,id=6830a784-9d5e-4efe-8b35-9d1713e0c8ce,network=Network(5bf13de0-38d0-4177-9863-980a7c39151c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6830a784-9d') {{(pid=72382) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 15:18:17 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:18:17 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6830a784-9d, bridge=br-int, if_exists=True) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:18:17 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:18:17 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:18:17 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:18:17 user nova-compute[72382]: INFO os_vif [None req-2544ea4f-5263-465f-8936-f92a2cdc1b77 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:99:2e:fe,bridge_name='br-int',has_traffic_filtering=True,id=6830a784-9d5e-4efe-8b35-9d1713e0c8ce,network=Network(5bf13de0-38d0-4177-9863-980a7c39151c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6830a784-9d')
Aug 09 15:18:17 user nova-compute[72382]: DEBUG nova.virt.libvirt.vif [None req-2544ea4f-5263-465f-8936-f92a2cdc1b77 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T15:16:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-572693492',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-572693492',id=12,image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMb7zhMvTYtSMjdbttccgrhGtZnLO3To5atuqn2KzXxPdjBeWNkfUC7xHzQcOqU2f9y/wGWlWICsIErR+5PTjvgcRPYq/Fn5iownuIQu/C79E2xKR9om6708gJPHzSBRPQ==',key_name='tempest-keypair-767486892',keypairs=<?>,launch_index=0,launched_at=2023-08-09T15:17:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7345242bf74a4b91a057182d9b5172c4',ramdisk_id='',reservation_id='r-oprrtn26',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1008702709',owner_user_name='tempest-TaggedBootDevicesTest-1008702709-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T15:17:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4a14592e76e2409aa5baf44221d227a4',uuid=f1b4f73b-7a9e-4cf1-9d51-f32284f49c53,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "650ae32c-3dec-4bad-8ff0-6ad423e1cb21", "address": "fa:16:3e:c9:be:0b", "network": {"id": "5bf13de0-38d0-4177-9863-980a7c39151c", "bridge": "br-int", "label": "tempest-device-tagging-net2-427749890", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7345242bf74a4b91a057182d9b5172c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap650ae32c-3d", "ovs_interfaceid": "650ae32c-3dec-4bad-8ff0-6ad423e1cb21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 15:18:17 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-2544ea4f-5263-465f-8936-f92a2cdc1b77 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] Converting VIF {"id": "650ae32c-3dec-4bad-8ff0-6ad423e1cb21", "address": "fa:16:3e:c9:be:0b", "network": {"id": "5bf13de0-38d0-4177-9863-980a7c39151c", "bridge": "br-int", "label": "tempest-device-tagging-net2-427749890", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7345242bf74a4b91a057182d9b5172c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap650ae32c-3d", "ovs_interfaceid": "650ae32c-3dec-4bad-8ff0-6ad423e1cb21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 15:18:17 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-2544ea4f-5263-465f-8936-f92a2cdc1b77 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c9:be:0b,bridge_name='br-int',has_traffic_filtering=True,id=650ae32c-3dec-4bad-8ff0-6ad423e1cb21,network=Network(5bf13de0-38d0-4177-9863-980a7c39151c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap650ae32c-3d') {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 15:18:17 user nova-compute[72382]: DEBUG os_vif [None req-2544ea4f-5263-465f-8936-f92a2cdc1b77 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:be:0b,bridge_name='br-int',has_traffic_filtering=True,id=650ae32c-3dec-4bad-8ff0-6ad423e1cb21,network=Network(5bf13de0-38d0-4177-9863-980a7c39151c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap650ae32c-3d') {{(pid=72382) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 15:18:17 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:18:17 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap650ae32c-3d, bridge=br-int, if_exists=True) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:18:17 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:18:17 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:18:17 user nova-compute[72382]: INFO os_vif [None req-2544ea4f-5263-465f-8936-f92a2cdc1b77 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:be:0b,bridge_name='br-int',has_traffic_filtering=True,id=650ae32c-3dec-4bad-8ff0-6ad423e1cb21,network=Network(5bf13de0-38d0-4177-9863-980a7c39151c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap650ae32c-3d')
Aug 09 15:18:17 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2544ea4f-5263-465f-8936-f92a2cdc1b77 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] [instance: f1b4f73b-7a9e-4cf1-9d51-f32284f49c53] calling os-brick to detach iSCSI Volume {{(pid=72382) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 15:18:17 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-2544ea4f-5263-465f-8936-f92a2cdc1b77 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2a0c768340>, {'target_iqns': ['iqn.2010-10.org.openstack:e2267629-52cf-439c-9083-3e8384c67f08'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rDYvqdHM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 15:18:17 user nova-compute[72382]: WARNING os_brick.initiator.connectors.base [None req-2544ea4f-5263-465f-8936-f92a2cdc1b77 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 15:18:17 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-2544ea4f-5263-465f-8936-f92a2cdc1b77 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 15:18:17 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-2544ea4f-5263-465f-8936-f92a2cdc1b77 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 15:18:17 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-2544ea4f-5263-465f-8936-f92a2cdc1b77 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e2267629-52cf-439c-9083-3e8384c67f08', 0)] {{(pid=72382) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 15:18:17 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:18:17 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:18:17 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[92130fa6-786a-49e9-8478-fdbe6982d0b1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:16ef1023-88b6-4e22-9b4b-45515b25ca9b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:344efe6d-5a52-4d0d-a34e-da8627a1e09f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5a13916f-1416-4b94-9e10-96f9e6415753\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e2267629-52cf-439c-9083-3e8384c67f08\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:18:17 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:18:17 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:18:17 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[35210a4b-f926-41ea-9b2b-22c7fad989f2]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:344efe6d-5a52-4d0d-a34e-da8627a1e09f (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2267629-52cf-439c-9083-3e8384c67f08 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a13916f-1416-4b94-9e10-96f9e6415753 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16ef1023-88b6-4e22-9b4b-45515b25ca9b (non-flash)\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:18:17 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-2544ea4f-5263-465f-8936-f92a2cdc1b77 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:344efe6d-5a52-4d0d-a34e-da8627a1e09f (non-flash)
Aug 09 15:18:17 user nova-compute[72382]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2267629-52cf-439c-9083-3e8384c67f08 (non-flash)
Aug 09 15:18:17 user nova-compute[72382]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a13916f-1416-4b94-9e10-96f9e6415753 (non-flash)
Aug 09 15:18:17 user nova-compute[72382]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16ef1023-88b6-4e22-9b4b-45515b25ca9b (non-flash)
Aug 09 15:18:17 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 15:18:17 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-2544ea4f-5263-465f-8936-f92a2cdc1b77 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:344efe6d-5a52-4d0d-a34e-da8627a1e09f (non-flash)
Aug 09 15:18:17 user nova-compute[72382]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2267629-52cf-439c-9083-3e8384c67f08 (non-flash)
Aug 09 15:18:17 user nova-compute[72382]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a13916f-1416-4b94-9e10-96f9e6415753 (non-flash)
Aug 09 15:18:17 user nova-compute[72382]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16ef1023-88b6-4e22-9b4b-45515b25ca9b (non-flash)
Aug 09 15:18:17 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 15:18:17 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-2544ea4f-5263-465f-8936-f92a2cdc1b77 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2a0c34a4d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e2267629-52cf-439c-9083-3e8384c67f08'): ({'sdb'}, set())}) {{(pid=72382) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 15:18:17 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-2544ea4f-5263-465f-8936-f92a2cdc1b77 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] Removing single pathed devices sdb {{(pid=72382) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 15:18:17 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:18:17 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:18:17 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[30710a0d-acd4-4ecb-8c0c-fa60a2445e4b]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:18:17 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:18:17 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:18:17 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[474c6283-11d0-4a66-8533-489cf33f318f]: (4, ('ok\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:18:17 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-2544ea4f-5263-465f-8936-f92a2cdc1b77 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] Flushing IO for device /dev/sdb {{(pid=72382) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 15:18:17 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:18:17 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.019s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:18:17 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[d69d9a3a-7a7e-4987-a304-aa13bb534a22]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:18:17 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-2544ea4f-5263-465f-8936-f92a2cdc1b77 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72382) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 15:18:17 user nova-compute[72382]: DEBUG nova.compute.manager [req-8b1c39f4-7708-49ec-a6ce-9f51663e0b65 req-6cf27fba-edf8-4499-8403-0a612cffdddc service nova] [instance: f1b4f73b-7a9e-4cf1-9d51-f32284f49c53] Received event network-vif-plugged-d031358f-2670-4942-9266-d9db448a078b {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:18:17 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-8b1c39f4-7708-49ec-a6ce-9f51663e0b65 req-6cf27fba-edf8-4499-8403-0a612cffdddc service nova] Acquiring lock "f1b4f73b-7a9e-4cf1-9d51-f32284f49c53-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:18:17 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-8b1c39f4-7708-49ec-a6ce-9f51663e0b65 req-6cf27fba-edf8-4499-8403-0a612cffdddc service nova] Lock "f1b4f73b-7a9e-4cf1-9d51-f32284f49c53-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:18:17 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-8b1c39f4-7708-49ec-a6ce-9f51663e0b65 req-6cf27fba-edf8-4499-8403-0a612cffdddc service nova] Lock "f1b4f73b-7a9e-4cf1-9d51-f32284f49c53-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:18:17 user nova-compute[72382]: DEBUG nova.compute.manager [req-8b1c39f4-7708-49ec-a6ce-9f51663e0b65 req-6cf27fba-edf8-4499-8403-0a612cffdddc service nova] [instance: f1b4f73b-7a9e-4cf1-9d51-f32284f49c53] No waiting events found dispatching network-vif-plugged-d031358f-2670-4942-9266-d9db448a078b {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:18:17 user nova-compute[72382]: WARNING nova.compute.manager [req-8b1c39f4-7708-49ec-a6ce-9f51663e0b65 req-6cf27fba-edf8-4499-8403-0a612cffdddc service nova] [instance: f1b4f73b-7a9e-4cf1-9d51-f32284f49c53] Received unexpected event network-vif-plugged-d031358f-2670-4942-9266-d9db448a078b for instance with vm_state active and task_state deleting.
Aug 09 15:18:17 user nova-compute[72382]: DEBUG nova.compute.manager [req-8b1c39f4-7708-49ec-a6ce-9f51663e0b65 req-6cf27fba-edf8-4499-8403-0a612cffdddc service nova] [instance: f1b4f73b-7a9e-4cf1-9d51-f32284f49c53] Received event network-vif-unplugged-3cea2e31-e2a9-4b8a-976b-ce818aaca460 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:18:17 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-8b1c39f4-7708-49ec-a6ce-9f51663e0b65 req-6cf27fba-edf8-4499-8403-0a612cffdddc service nova] Acquiring lock "f1b4f73b-7a9e-4cf1-9d51-f32284f49c53-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:18:17 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-8b1c39f4-7708-49ec-a6ce-9f51663e0b65 req-6cf27fba-edf8-4499-8403-0a612cffdddc service nova] Lock "f1b4f73b-7a9e-4cf1-9d51-f32284f49c53-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:18:17 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-8b1c39f4-7708-49ec-a6ce-9f51663e0b65 req-6cf27fba-edf8-4499-8403-0a612cffdddc service nova] Lock "f1b4f73b-7a9e-4cf1-9d51-f32284f49c53-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:18:17 user nova-compute[72382]: DEBUG nova.compute.manager [req-8b1c39f4-7708-49ec-a6ce-9f51663e0b65 req-6cf27fba-edf8-4499-8403-0a612cffdddc service nova] [instance: f1b4f73b-7a9e-4cf1-9d51-f32284f49c53] No waiting events found dispatching network-vif-unplugged-3cea2e31-e2a9-4b8a-976b-ce818aaca460 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:18:17 user nova-compute[72382]: DEBUG nova.compute.manager [req-8b1c39f4-7708-49ec-a6ce-9f51663e0b65 req-6cf27fba-edf8-4499-8403-0a612cffdddc service nova] [instance: f1b4f73b-7a9e-4cf1-9d51-f32284f49c53] Received event network-vif-unplugged-3cea2e31-e2a9-4b8a-976b-ce818aaca460 for instance with task_state deleting. {{(pid=72382) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 15:18:17 user nova-compute[72382]: DEBUG nova.compute.manager [req-8b1c39f4-7708-49ec-a6ce-9f51663e0b65 req-6cf27fba-edf8-4499-8403-0a612cffdddc service nova] [instance: f1b4f73b-7a9e-4cf1-9d51-f32284f49c53] Received event network-vif-plugged-3cea2e31-e2a9-4b8a-976b-ce818aaca460 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:18:17 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-8b1c39f4-7708-49ec-a6ce-9f51663e0b65 req-6cf27fba-edf8-4499-8403-0a612cffdddc service nova] Acquiring lock "f1b4f73b-7a9e-4cf1-9d51-f32284f49c53-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:18:17 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-8b1c39f4-7708-49ec-a6ce-9f51663e0b65 req-6cf27fba-edf8-4499-8403-0a612cffdddc service nova] Lock "f1b4f73b-7a9e-4cf1-9d51-f32284f49c53-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:18:17 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-8b1c39f4-7708-49ec-a6ce-9f51663e0b65 req-6cf27fba-edf8-4499-8403-0a612cffdddc service nova] Lock "f1b4f73b-7a9e-4cf1-9d51-f32284f49c53-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:18:17 user nova-compute[72382]: DEBUG nova.compute.manager [req-8b1c39f4-7708-49ec-a6ce-9f51663e0b65 req-6cf27fba-edf8-4499-8403-0a612cffdddc service nova] [instance: f1b4f73b-7a9e-4cf1-9d51-f32284f49c53] No waiting events found dispatching network-vif-plugged-3cea2e31-e2a9-4b8a-976b-ce818aaca460 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:18:17 user nova-compute[72382]: WARNING nova.compute.manager [req-8b1c39f4-7708-49ec-a6ce-9f51663e0b65 req-6cf27fba-edf8-4499-8403-0a612cffdddc service nova] [instance: f1b4f73b-7a9e-4cf1-9d51-f32284f49c53] Received unexpected event network-vif-plugged-3cea2e31-e2a9-4b8a-976b-ce818aaca460 for instance with vm_state active and task_state deleting.
Aug 09 15:18:17 user nova-compute[72382]: DEBUG nova.compute.manager [req-8b1c39f4-7708-49ec-a6ce-9f51663e0b65 req-6cf27fba-edf8-4499-8403-0a612cffdddc service nova] [instance: f1b4f73b-7a9e-4cf1-9d51-f32284f49c53] Received event network-vif-unplugged-6830a784-9d5e-4efe-8b35-9d1713e0c8ce {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:18:17 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-8b1c39f4-7708-49ec-a6ce-9f51663e0b65 req-6cf27fba-edf8-4499-8403-0a612cffdddc service nova] Acquiring lock "f1b4f73b-7a9e-4cf1-9d51-f32284f49c53-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:18:17 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-8b1c39f4-7708-49ec-a6ce-9f51663e0b65 req-6cf27fba-edf8-4499-8403-0a612cffdddc service nova] Lock "f1b4f73b-7a9e-4cf1-9d51-f32284f49c53-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:18:17 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-8b1c39f4-7708-49ec-a6ce-9f51663e0b65 req-6cf27fba-edf8-4499-8403-0a612cffdddc service nova] Lock "f1b4f73b-7a9e-4cf1-9d51-f32284f49c53-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:18:17 user nova-compute[72382]: DEBUG nova.compute.manager [req-8b1c39f4-7708-49ec-a6ce-9f51663e0b65 req-6cf27fba-edf8-4499-8403-0a612cffdddc service nova] [instance: f1b4f73b-7a9e-4cf1-9d51-f32284f49c53] No waiting events found dispatching network-vif-unplugged-6830a784-9d5e-4efe-8b35-9d1713e0c8ce {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:18:17 user nova-compute[72382]: DEBUG nova.compute.manager [req-8b1c39f4-7708-49ec-a6ce-9f51663e0b65 req-6cf27fba-edf8-4499-8403-0a612cffdddc service nova] [instance: f1b4f73b-7a9e-4cf1-9d51-f32284f49c53] Received event network-vif-unplugged-6830a784-9d5e-4efe-8b35-9d1713e0c8ce for instance with task_state deleting. {{(pid=72382) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 15:18:17 user nova-compute[72382]: DEBUG nova.compute.manager [req-8b1c39f4-7708-49ec-a6ce-9f51663e0b65 req-6cf27fba-edf8-4499-8403-0a612cffdddc service nova] [instance: f1b4f73b-7a9e-4cf1-9d51-f32284f49c53] Received event network-vif-plugged-6830a784-9d5e-4efe-8b35-9d1713e0c8ce {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:18:17 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-8b1c39f4-7708-49ec-a6ce-9f51663e0b65 req-6cf27fba-edf8-4499-8403-0a612cffdddc service nova] Acquiring lock "f1b4f73b-7a9e-4cf1-9d51-f32284f49c53-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:18:17 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-8b1c39f4-7708-49ec-a6ce-9f51663e0b65 req-6cf27fba-edf8-4499-8403-0a612cffdddc service nova] Lock "f1b4f73b-7a9e-4cf1-9d51-f32284f49c53-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:18:17 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-8b1c39f4-7708-49ec-a6ce-9f51663e0b65 req-6cf27fba-edf8-4499-8403-0a612cffdddc service nova] Lock "f1b4f73b-7a9e-4cf1-9d51-f32284f49c53-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:18:17 user nova-compute[72382]: DEBUG nova.compute.manager [req-8b1c39f4-7708-49ec-a6ce-9f51663e0b65 req-6cf27fba-edf8-4499-8403-0a612cffdddc service nova] [instance: f1b4f73b-7a9e-4cf1-9d51-f32284f49c53] No waiting events found dispatching network-vif-plugged-6830a784-9d5e-4efe-8b35-9d1713e0c8ce {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:18:17 user nova-compute[72382]: WARNING nova.compute.manager [req-8b1c39f4-7708-49ec-a6ce-9f51663e0b65 req-6cf27fba-edf8-4499-8403-0a612cffdddc service nova] [instance: f1b4f73b-7a9e-4cf1-9d51-f32284f49c53] Received unexpected event network-vif-plugged-6830a784-9d5e-4efe-8b35-9d1713e0c8ce for instance with vm_state active and task_state deleting.
Aug 09 15:18:17 user nova-compute[72382]: DEBUG nova.compute.manager [req-8b1c39f4-7708-49ec-a6ce-9f51663e0b65 req-6cf27fba-edf8-4499-8403-0a612cffdddc service nova] [instance: f1b4f73b-7a9e-4cf1-9d51-f32284f49c53] Received event network-vif-unplugged-650ae32c-3dec-4bad-8ff0-6ad423e1cb21 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:18:17 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-8b1c39f4-7708-49ec-a6ce-9f51663e0b65 req-6cf27fba-edf8-4499-8403-0a612cffdddc service nova] Acquiring lock "f1b4f73b-7a9e-4cf1-9d51-f32284f49c53-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:18:17 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-8b1c39f4-7708-49ec-a6ce-9f51663e0b65 req-6cf27fba-edf8-4499-8403-0a612cffdddc service nova] Lock "f1b4f73b-7a9e-4cf1-9d51-f32284f49c53-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:18:17 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-8b1c39f4-7708-49ec-a6ce-9f51663e0b65 req-6cf27fba-edf8-4499-8403-0a612cffdddc service nova] Lock "f1b4f73b-7a9e-4cf1-9d51-f32284f49c53-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:18:17 user nova-compute[72382]: DEBUG nova.compute.manager [req-8b1c39f4-7708-49ec-a6ce-9f51663e0b65 req-6cf27fba-edf8-4499-8403-0a612cffdddc service nova] [instance: f1b4f73b-7a9e-4cf1-9d51-f32284f49c53] No waiting events found dispatching network-vif-unplugged-650ae32c-3dec-4bad-8ff0-6ad423e1cb21 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:18:17 user nova-compute[72382]: DEBUG nova.compute.manager [req-8b1c39f4-7708-49ec-a6ce-9f51663e0b65 req-6cf27fba-edf8-4499-8403-0a612cffdddc service nova] [instance: f1b4f73b-7a9e-4cf1-9d51-f32284f49c53] Received event network-vif-unplugged-650ae32c-3dec-4bad-8ff0-6ad423e1cb21 for instance with task_state deleting. {{(pid=72382) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 15:18:17 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:18:17 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.047s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:18:17 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[b90d5966-381d-4718-b0a5-ae863fb36a39]: (4, ('1', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:18:17 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-2544ea4f-5263-465f-8936-f92a2cdc1b77 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72382) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 15:18:17 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-2544ea4f-5263-465f-8936-f92a2cdc1b77 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] SCSI volumes sdb have been removed. {{(pid=72382) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 15:18:17 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-2544ea4f-5263-465f-8936-f92a2cdc1b77 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e2267629-52cf-439c-9083-3e8384c67f08')] {{(pid=72382) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 15:18:17 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2267629-52cf-439c-9083-3e8384c67f08 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:18:17 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2267629-52cf-439c-9083-3e8384c67f08 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:18:17 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[4318252d-103c-4eb5-b85a-0bb8d4058851]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:18:17 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-2544ea4f-5263-465f-8936-f92a2cdc1b77 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:18:17 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2267629-52cf-439c-9083-3e8384c67f08 -p 172.16.0.220:3260 --logout {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:18:18 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2267629-52cf-439c-9083-3e8384c67f08 -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:18:18 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[51a4039c-6300-44ea-94cf-410d7b9daa93]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:e2267629-52cf-439c-9083-3e8384c67f08, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:e2267629-52cf-439c-9083-3e8384c67f08, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:18:18 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-2544ea4f-5263-465f-8936-f92a2cdc1b77 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:e2267629-52cf-439c-9083-3e8384c67f08, portal: 172.16.0.220,3260]
Aug 09 15:18:18 user nova-compute[72382]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:e2267629-52cf-439c-9083-3e8384c67f08, portal: 172.16.0.220,3260] successful.
Aug 09 15:18:18 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:18:18 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2267629-52cf-439c-9083-3e8384c67f08 -p 172.16.0.220:3260 --op delete {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:18:18 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2267629-52cf-439c-9083-3e8384c67f08 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:18:18 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[21741fcd-1a4c-4cd6-a4f8-fc8ed37d06d1]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:18:18 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-2544ea4f-5263-465f-8936-f92a2cdc1b77 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:18:18 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-2544ea4f-5263-465f-8936-f92a2cdc1b77 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.311s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 15:18:18 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-2544ea4f-5263-465f-8936-f92a2cdc1b77 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] <== disconnect_volume: return (314ms) None {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 15:18:18 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2544ea4f-5263-465f-8936-f92a2cdc1b77 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] [instance: f1b4f73b-7a9e-4cf1-9d51-f32284f49c53] Disconnected iSCSI Volume {{(pid=72382) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 15:18:18 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2544ea4f-5263-465f-8936-f92a2cdc1b77 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] [instance: f1b4f73b-7a9e-4cf1-9d51-f32284f49c53] calling os-brick to detach iSCSI Volume {{(pid=72382) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 15:18:18 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-2544ea4f-5263-465f-8936-f92a2cdc1b77 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2a0c768340>, {'target_iqns': ['iqn.2010-10.org.openstack:5a13916f-1416-4b94-9e10-96f9e6415753'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FDiNaqEe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 15:18:18 user nova-compute[72382]: WARNING os_brick.initiator.connectors.base [None req-2544ea4f-5263-465f-8936-f92a2cdc1b77 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 15:18:18 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-2544ea4f-5263-465f-8936-f92a2cdc1b77 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 15:18:18 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-2544ea4f-5263-465f-8936-f92a2cdc1b77 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 15:18:18 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-2544ea4f-5263-465f-8936-f92a2cdc1b77 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5a13916f-1416-4b94-9e10-96f9e6415753', 0)] {{(pid=72382) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 15:18:18 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:18:18 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:18:18 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[37b31eb9-a94a-41b5-ac69-f58ea56b12cd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:16ef1023-88b6-4e22-9b4b-45515b25ca9b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:344efe6d-5a52-4d0d-a34e-da8627a1e09f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5a13916f-1416-4b94-9e10-96f9e6415753\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:18:18 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:18:18 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:18:18 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6ec49bb-fae6-47ae-8cd5-51ac4c779859]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:344efe6d-5a52-4d0d-a34e-da8627a1e09f (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a13916f-1416-4b94-9e10-96f9e6415753 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16ef1023-88b6-4e22-9b4b-45515b25ca9b (non-flash)\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:18:18 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-2544ea4f-5263-465f-8936-f92a2cdc1b77 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:344efe6d-5a52-4d0d-a34e-da8627a1e09f (non-flash)
Aug 09 15:18:18 user nova-compute[72382]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a13916f-1416-4b94-9e10-96f9e6415753 (non-flash)
Aug 09 15:18:18 user nova-compute[72382]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16ef1023-88b6-4e22-9b4b-45515b25ca9b (non-flash)
Aug 09 15:18:18 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 15:18:18 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-2544ea4f-5263-465f-8936-f92a2cdc1b77 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:344efe6d-5a52-4d0d-a34e-da8627a1e09f (non-flash)
Aug 09 15:18:18 user nova-compute[72382]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a13916f-1416-4b94-9e10-96f9e6415753 (non-flash)
Aug 09 15:18:18 user nova-compute[72382]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16ef1023-88b6-4e22-9b4b-45515b25ca9b (non-flash)
Aug 09 15:18:18 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 15:18:18 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-2544ea4f-5263-465f-8936-f92a2cdc1b77 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2a0c34a4d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5a13916f-1416-4b94-9e10-96f9e6415753'): ({'sdc'}, set())}) {{(pid=72382) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 15:18:18 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-2544ea4f-5263-465f-8936-f92a2cdc1b77 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] Removing single pathed devices sdc {{(pid=72382) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 15:18:18 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:18:18 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:18:18 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[b720da1c-c801-4f9f-94bd-0d52011a7bc0]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:18:18 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:18:18 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:18:18 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab1d2e32-d660-42a4-b253-d42a8e37a507]: (4, ('ok\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:18:18 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-2544ea4f-5263-465f-8936-f92a2cdc1b77 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] Flushing IO for device /dev/sdc {{(pid=72382) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 15:18:18 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:18:18 user nova-compute[72382]: DEBUG nova.compute.manager [req-3d3bf615-ab50-40a0-890f-05200b83d1f6 req-d56bd47f-7ef4-4625-aab4-9a0edc05b1c1 service nova] [instance: f1b4f73b-7a9e-4cf1-9d51-f32284f49c53] Received event network-vif-plugged-fcd90f6b-ef1b-4f9d-9ced-b98f7be4bc55 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:18:18 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-3d3bf615-ab50-40a0-890f-05200b83d1f6 req-d56bd47f-7ef4-4625-aab4-9a0edc05b1c1 service nova] Acquiring lock "f1b4f73b-7a9e-4cf1-9d51-f32284f49c53-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:18:18 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-3d3bf615-ab50-40a0-890f-05200b83d1f6 req-d56bd47f-7ef4-4625-aab4-9a0edc05b1c1 service nova] Lock "f1b4f73b-7a9e-4cf1-9d51-f32284f49c53-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:18:18 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-3d3bf615-ab50-40a0-890f-05200b83d1f6 req-d56bd47f-7ef4-4625-aab4-9a0edc05b1c1 service nova] Lock "f1b4f73b-7a9e-4cf1-9d51-f32284f49c53-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:18:18 user nova-compute[72382]: DEBUG nova.compute.manager [req-3d3bf615-ab50-40a0-890f-05200b83d1f6 req-d56bd47f-7ef4-4625-aab4-9a0edc05b1c1 service nova] [instance: f1b4f73b-7a9e-4cf1-9d51-f32284f49c53] No waiting events found dispatching network-vif-plugged-fcd90f6b-ef1b-4f9d-9ced-b98f7be4bc55 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:18:18 user nova-compute[72382]: WARNING nova.compute.manager [req-3d3bf615-ab50-40a0-890f-05200b83d1f6 req-d56bd47f-7ef4-4625-aab4-9a0edc05b1c1 service nova] [instance: f1b4f73b-7a9e-4cf1-9d51-f32284f49c53] Received unexpected event network-vif-plugged-fcd90f6b-ef1b-4f9d-9ced-b98f7be4bc55 for instance with vm_state active and task_state deleting.
Aug 09 15:18:18 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:18:18 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[415c9ef6-765a-4a58-b45d-1b84e7f80bf1]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:18:18 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-2544ea4f-5263-465f-8936-f92a2cdc1b77 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72382) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 15:18:18 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:18:18 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.041s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:18:18 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[e499afd7-4bac-40b0-b302-d9dbf29717af]: (4, ('1', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:18:18 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-2544ea4f-5263-465f-8936-f92a2cdc1b77 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72382) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 15:18:18 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-2544ea4f-5263-465f-8936-f92a2cdc1b77 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] SCSI volumes sdc have been removed. {{(pid=72382) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 15:18:18 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-2544ea4f-5263-465f-8936-f92a2cdc1b77 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5a13916f-1416-4b94-9e10-96f9e6415753')] {{(pid=72382) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 15:18:18 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a13916f-1416-4b94-9e10-96f9e6415753 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:18:18 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a13916f-1416-4b94-9e10-96f9e6415753 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:18:18 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[18e92b3a-1da3-469a-b826-1b9cdbaa1346]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:18:18 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-2544ea4f-5263-465f-8936-f92a2cdc1b77 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:18:18 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a13916f-1416-4b94-9e10-96f9e6415753 -p 172.16.0.220:3260 --logout {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:18:18 user nova-compute[72382]: DEBUG nova.compute.manager [req-1326f2a8-a922-4a99-8fc7-61faec3670d6 req-2af096f4-b6dc-4c25-86a5-507d6291f9a1 service nova] [instance: f1b4f73b-7a9e-4cf1-9d51-f32284f49c53] Received event network-vif-plugged-d96a280e-5aeb-4a7c-97da-431e5f42c7f6 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:18:18 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-1326f2a8-a922-4a99-8fc7-61faec3670d6 req-2af096f4-b6dc-4c25-86a5-507d6291f9a1 service nova] Acquiring lock "f1b4f73b-7a9e-4cf1-9d51-f32284f49c53-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:18:18 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-1326f2a8-a922-4a99-8fc7-61faec3670d6 req-2af096f4-b6dc-4c25-86a5-507d6291f9a1 service nova] Lock "f1b4f73b-7a9e-4cf1-9d51-f32284f49c53-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:18:18 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-1326f2a8-a922-4a99-8fc7-61faec3670d6 req-2af096f4-b6dc-4c25-86a5-507d6291f9a1 service nova] Lock "f1b4f73b-7a9e-4cf1-9d51-f32284f49c53-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:18:18 user nova-compute[72382]: DEBUG nova.compute.manager [req-1326f2a8-a922-4a99-8fc7-61faec3670d6 req-2af096f4-b6dc-4c25-86a5-507d6291f9a1 service nova] [instance: f1b4f73b-7a9e-4cf1-9d51-f32284f49c53] No waiting events found dispatching network-vif-plugged-d96a280e-5aeb-4a7c-97da-431e5f42c7f6 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:18:18 user nova-compute[72382]: WARNING nova.compute.manager [req-1326f2a8-a922-4a99-8fc7-61faec3670d6 req-2af096f4-b6dc-4c25-86a5-507d6291f9a1 service nova] [instance: f1b4f73b-7a9e-4cf1-9d51-f32284f49c53] Received unexpected event network-vif-plugged-d96a280e-5aeb-4a7c-97da-431e5f42c7f6 for instance with vm_state active and task_state deleting.
Aug 09 15:18:18 user nova-compute[72382]: DEBUG nova.compute.manager [req-1326f2a8-a922-4a99-8fc7-61faec3670d6 req-2af096f4-b6dc-4c25-86a5-507d6291f9a1 service nova] [instance: f1b4f73b-7a9e-4cf1-9d51-f32284f49c53] Received event network-vif-unplugged-92c19874-960c-4e03-8537-6ae44812a1da {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:18:18 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-1326f2a8-a922-4a99-8fc7-61faec3670d6 req-2af096f4-b6dc-4c25-86a5-507d6291f9a1 service nova] Acquiring lock "f1b4f73b-7a9e-4cf1-9d51-f32284f49c53-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:18:18 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-1326f2a8-a922-4a99-8fc7-61faec3670d6 req-2af096f4-b6dc-4c25-86a5-507d6291f9a1 service nova] Lock "f1b4f73b-7a9e-4cf1-9d51-f32284f49c53-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:18:18 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-1326f2a8-a922-4a99-8fc7-61faec3670d6 req-2af096f4-b6dc-4c25-86a5-507d6291f9a1 service nova] Lock "f1b4f73b-7a9e-4cf1-9d51-f32284f49c53-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:18:18 user nova-compute[72382]: DEBUG nova.compute.manager [req-1326f2a8-a922-4a99-8fc7-61faec3670d6 req-2af096f4-b6dc-4c25-86a5-507d6291f9a1 service nova] [instance: f1b4f73b-7a9e-4cf1-9d51-f32284f49c53] No waiting events found dispatching network-vif-unplugged-92c19874-960c-4e03-8537-6ae44812a1da {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:18:18 user nova-compute[72382]: DEBUG nova.compute.manager [req-1326f2a8-a922-4a99-8fc7-61faec3670d6 req-2af096f4-b6dc-4c25-86a5-507d6291f9a1 service nova] [instance: f1b4f73b-7a9e-4cf1-9d51-f32284f49c53] Received event network-vif-unplugged-92c19874-960c-4e03-8537-6ae44812a1da for instance with task_state deleting. {{(pid=72382) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 15:18:18 user nova-compute[72382]: DEBUG nova.compute.manager [req-1326f2a8-a922-4a99-8fc7-61faec3670d6 req-2af096f4-b6dc-4c25-86a5-507d6291f9a1 service nova] [instance: f1b4f73b-7a9e-4cf1-9d51-f32284f49c53] Received event network-vif-plugged-92c19874-960c-4e03-8537-6ae44812a1da {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:18:18 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-1326f2a8-a922-4a99-8fc7-61faec3670d6 req-2af096f4-b6dc-4c25-86a5-507d6291f9a1 service nova] Acquiring lock "f1b4f73b-7a9e-4cf1-9d51-f32284f49c53-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:18:18 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-1326f2a8-a922-4a99-8fc7-61faec3670d6 req-2af096f4-b6dc-4c25-86a5-507d6291f9a1 service nova] Lock "f1b4f73b-7a9e-4cf1-9d51-f32284f49c53-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:18:18 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-1326f2a8-a922-4a99-8fc7-61faec3670d6 req-2af096f4-b6dc-4c25-86a5-507d6291f9a1 service nova] Lock "f1b4f73b-7a9e-4cf1-9d51-f32284f49c53-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:18:18 user nova-compute[72382]: DEBUG nova.compute.manager [req-1326f2a8-a922-4a99-8fc7-61faec3670d6 req-2af096f4-b6dc-4c25-86a5-507d6291f9a1 service nova] [instance: f1b4f73b-7a9e-4cf1-9d51-f32284f49c53] No waiting events found dispatching network-vif-plugged-92c19874-960c-4e03-8537-6ae44812a1da {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:18:18 user nova-compute[72382]: WARNING nova.compute.manager [req-1326f2a8-a922-4a99-8fc7-61faec3670d6 req-2af096f4-b6dc-4c25-86a5-507d6291f9a1 service nova] [instance: f1b4f73b-7a9e-4cf1-9d51-f32284f49c53] Received unexpected event network-vif-plugged-92c19874-960c-4e03-8537-6ae44812a1da for instance with vm_state active and task_state deleting.
Aug 09 15:18:18 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a13916f-1416-4b94-9e10-96f9e6415753 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:18:18 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[2833bfd7-004b-4717-ac13-a5ff959b78d0]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:5a13916f-1416-4b94-9e10-96f9e6415753, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:5a13916f-1416-4b94-9e10-96f9e6415753, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:18:18 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-2544ea4f-5263-465f-8936-f92a2cdc1b77 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:5a13916f-1416-4b94-9e10-96f9e6415753, portal: 172.16.0.220,3260]
Aug 09 15:18:18 user nova-compute[72382]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:5a13916f-1416-4b94-9e10-96f9e6415753, portal: 172.16.0.220,3260] successful.
Aug 09 15:18:18 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:18:18 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a13916f-1416-4b94-9e10-96f9e6415753 -p 172.16.0.220:3260 --op delete {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:18:18 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a13916f-1416-4b94-9e10-96f9e6415753 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:18:18 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e0b4075-a310-4fde-9eda-a792fb584f5d]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:18:18 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-2544ea4f-5263-465f-8936-f92a2cdc1b77 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:18:18 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-2544ea4f-5263-465f-8936-f92a2cdc1b77 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.348s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 15:18:18 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-2544ea4f-5263-465f-8936-f92a2cdc1b77 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] <== disconnect_volume: return (351ms) None {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 15:18:18 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2544ea4f-5263-465f-8936-f92a2cdc1b77 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] [instance: f1b4f73b-7a9e-4cf1-9d51-f32284f49c53] Disconnected iSCSI Volume {{(pid=72382) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 15:18:18 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2544ea4f-5263-465f-8936-f92a2cdc1b77 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] [instance: f1b4f73b-7a9e-4cf1-9d51-f32284f49c53] calling os-brick to detach iSCSI Volume {{(pid=72382) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 15:18:18 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-2544ea4f-5263-465f-8936-f92a2cdc1b77 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2a0c768340>, {'target_iqns': ['iqn.2010-10.org.openstack:16ef1023-88b6-4e22-9b4b-45515b25ca9b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lseWJYAz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 15:18:18 user nova-compute[72382]: WARNING os_brick.initiator.connectors.base [None req-2544ea4f-5263-465f-8936-f92a2cdc1b77 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 15:18:18 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-2544ea4f-5263-465f-8936-f92a2cdc1b77 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 15:18:18 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-2544ea4f-5263-465f-8936-f92a2cdc1b77 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 15:18:18 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-2544ea4f-5263-465f-8936-f92a2cdc1b77 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:16ef1023-88b6-4e22-9b4b-45515b25ca9b', 0)] {{(pid=72382) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 15:18:18 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:18:18 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.028s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:18:18 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[631bf098-2299-4787-8a61-d130354da51c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:16ef1023-88b6-4e22-9b4b-45515b25ca9b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:344efe6d-5a52-4d0d-a34e-da8627a1e09f\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:18:18 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:18:18 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:18:18 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5f37d63-9547-44fd-9e74-850c91d59e94]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:344efe6d-5a52-4d0d-a34e-da8627a1e09f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16ef1023-88b6-4e22-9b4b-45515b25ca9b (non-flash)\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:18:18 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-2544ea4f-5263-465f-8936-f92a2cdc1b77 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:344efe6d-5a52-4d0d-a34e-da8627a1e09f (non-flash)
Aug 09 15:18:18 user nova-compute[72382]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16ef1023-88b6-4e22-9b4b-45515b25ca9b (non-flash)
Aug 09 15:18:18 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 15:18:18 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-2544ea4f-5263-465f-8936-f92a2cdc1b77 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:344efe6d-5a52-4d0d-a34e-da8627a1e09f (non-flash)
Aug 09 15:18:18 user nova-compute[72382]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16ef1023-88b6-4e22-9b4b-45515b25ca9b (non-flash)
Aug 09 15:18:18 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 15:18:18 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-2544ea4f-5263-465f-8936-f92a2cdc1b77 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2a242c4160>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:16ef1023-88b6-4e22-9b4b-45515b25ca9b'): ({'sdd'}, set())}) {{(pid=72382) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 15:18:18 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-2544ea4f-5263-465f-8936-f92a2cdc1b77 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] Removing single pathed devices sdd {{(pid=72382) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 15:18:18 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:18:18 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:18:18 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[b477039d-e53e-4aa1-9658-1697e01076fe]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:18:18 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:18:18 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.023s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:18:18 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[78b20569-8253-4012-9436-d536ca8239ab]: (4, ('ok\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:18:18 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-2544ea4f-5263-465f-8936-f92a2cdc1b77 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] Flushing IO for device /dev/sdd {{(pid=72382) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 15:18:18 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:18:18 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:18:18 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[accc507b-08f8-4b79-8fde-3b6344cf3a15]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:18:18 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-2544ea4f-5263-465f-8936-f92a2cdc1b77 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72382) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 15:18:18 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:18:18 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.045s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:18:18 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[612b642d-eefb-4398-877c-f4ee132c8d5a]: (4, ('1', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:18:18 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-2544ea4f-5263-465f-8936-f92a2cdc1b77 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72382) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 15:18:18 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-2544ea4f-5263-465f-8936-f92a2cdc1b77 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] SCSI volumes sdd have been removed. {{(pid=72382) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 15:18:18 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-2544ea4f-5263-465f-8936-f92a2cdc1b77 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:16ef1023-88b6-4e22-9b4b-45515b25ca9b')] {{(pid=72382) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 15:18:18 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16ef1023-88b6-4e22-9b4b-45515b25ca9b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:18:18 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16ef1023-88b6-4e22-9b4b-45515b25ca9b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:18:18 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[adabd471-15cc-4e24-b801-e4d7eca67c4c]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:18:18 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-2544ea4f-5263-465f-8936-f92a2cdc1b77 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:18:18 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16ef1023-88b6-4e22-9b4b-45515b25ca9b -p 172.16.0.220:3260 --logout {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:18:18 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16ef1023-88b6-4e22-9b4b-45515b25ca9b -p 172.16.0.220:3260 --logout" returned: 0 in 0.045s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:18:18 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[49ba68fa-5ac7-4822-9988-56fa63e2e70c]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:16ef1023-88b6-4e22-9b4b-45515b25ca9b, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:16ef1023-88b6-4e22-9b4b-45515b25ca9b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:18:18 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-2544ea4f-5263-465f-8936-f92a2cdc1b77 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:16ef1023-88b6-4e22-9b4b-45515b25ca9b, portal: 172.16.0.220,3260]
Aug 09 15:18:18 user nova-compute[72382]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:16ef1023-88b6-4e22-9b4b-45515b25ca9b, portal: 172.16.0.220,3260] successful.
Aug 09 15:18:18 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:18:18 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16ef1023-88b6-4e22-9b4b-45515b25ca9b -p 172.16.0.220:3260 --op delete {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:18:18 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16ef1023-88b6-4e22-9b4b-45515b25ca9b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:18:18 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ecc7d43-2343-4a4f-afe3-cc12bda1bda5]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:18:18 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-2544ea4f-5263-465f-8936-f92a2cdc1b77 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:18:18 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-2544ea4f-5263-465f-8936-f92a2cdc1b77 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.289s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 15:18:18 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-2544ea4f-5263-465f-8936-f92a2cdc1b77 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] <== disconnect_volume: return (290ms) None {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 15:18:18 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2544ea4f-5263-465f-8936-f92a2cdc1b77 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] [instance: f1b4f73b-7a9e-4cf1-9d51-f32284f49c53] Disconnected iSCSI Volume {{(pid=72382) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 15:18:18 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-2544ea4f-5263-465f-8936-f92a2cdc1b77 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] [instance: f1b4f73b-7a9e-4cf1-9d51-f32284f49c53] Deleting instance files /opt/stack/data/nova/instances/f1b4f73b-7a9e-4cf1-9d51-f32284f49c53_del
Aug 09 15:18:18 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-2544ea4f-5263-465f-8936-f92a2cdc1b77 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] [instance: f1b4f73b-7a9e-4cf1-9d51-f32284f49c53] Deletion of /opt/stack/data/nova/instances/f1b4f73b-7a9e-4cf1-9d51-f32284f49c53_del complete
Aug 09 15:18:18 user nova-compute[72382]: INFO nova.compute.manager [None req-2544ea4f-5263-465f-8936-f92a2cdc1b77 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] [instance: f1b4f73b-7a9e-4cf1-9d51-f32284f49c53] Took 3.36 seconds to destroy the instance on the hypervisor.
Aug 09 15:18:18 user nova-compute[72382]: DEBUG oslo.service.loopingcall [None req-2544ea4f-5263-465f-8936-f92a2cdc1b77 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72382) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 15:18:18 user nova-compute[72382]: DEBUG nova.compute.manager [-] [instance: f1b4f73b-7a9e-4cf1-9d51-f32284f49c53] Deallocating network for instance {{(pid=72382) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 15:18:18 user nova-compute[72382]: DEBUG nova.network.neutron [-] [instance: f1b4f73b-7a9e-4cf1-9d51-f32284f49c53] deallocate_for_instance() {{(pid=72382) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 15:18:18 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:18:19 user nova-compute[72382]: DEBUG nova.compute.manager [req-422c5027-8582-4eac-b463-c752998b362c req-b5e9fdbb-9356-4974-8848-e165bed9073a service nova] [instance: f1b4f73b-7a9e-4cf1-9d51-f32284f49c53] Received event network-vif-plugged-650ae32c-3dec-4bad-8ff0-6ad423e1cb21 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:18:19 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-422c5027-8582-4eac-b463-c752998b362c req-b5e9fdbb-9356-4974-8848-e165bed9073a service nova] Acquiring lock "f1b4f73b-7a9e-4cf1-9d51-f32284f49c53-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:18:19 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-422c5027-8582-4eac-b463-c752998b362c req-b5e9fdbb-9356-4974-8848-e165bed9073a service nova] Lock "f1b4f73b-7a9e-4cf1-9d51-f32284f49c53-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:18:19 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-422c5027-8582-4eac-b463-c752998b362c req-b5e9fdbb-9356-4974-8848-e165bed9073a service nova] Lock "f1b4f73b-7a9e-4cf1-9d51-f32284f49c53-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:18:19 user nova-compute[72382]: DEBUG nova.compute.manager [req-422c5027-8582-4eac-b463-c752998b362c req-b5e9fdbb-9356-4974-8848-e165bed9073a service nova] [instance: f1b4f73b-7a9e-4cf1-9d51-f32284f49c53] No waiting events found dispatching network-vif-plugged-650ae32c-3dec-4bad-8ff0-6ad423e1cb21 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:18:19 user nova-compute[72382]: WARNING nova.compute.manager [req-422c5027-8582-4eac-b463-c752998b362c req-b5e9fdbb-9356-4974-8848-e165bed9073a service nova] [instance: f1b4f73b-7a9e-4cf1-9d51-f32284f49c53] Received unexpected event network-vif-plugged-650ae32c-3dec-4bad-8ff0-6ad423e1cb21 for instance with vm_state active and task_state deleting.
Aug 09 15:18:21 user nova-compute[72382]: DEBUG nova.compute.manager [req-99461ed5-7b7a-4061-97d2-e5e781e843e0 req-74035799-5615-4fef-82a4-a5392aa7915d service nova] [instance: f1b4f73b-7a9e-4cf1-9d51-f32284f49c53] Received event network-vif-deleted-d031358f-2670-4942-9266-d9db448a078b {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:18:21 user nova-compute[72382]: INFO nova.compute.manager [req-99461ed5-7b7a-4061-97d2-e5e781e843e0 req-74035799-5615-4fef-82a4-a5392aa7915d service nova] [instance: f1b4f73b-7a9e-4cf1-9d51-f32284f49c53] Neutron deleted interface d031358f-2670-4942-9266-d9db448a078b; detaching it from the instance and deleting it from the info cache
Aug 09 15:18:21 user nova-compute[72382]: DEBUG nova.network.neutron [req-99461ed5-7b7a-4061-97d2-e5e781e843e0 req-74035799-5615-4fef-82a4-a5392aa7915d service nova] [instance: f1b4f73b-7a9e-4cf1-9d51-f32284f49c53] Updating instance_info_cache with network_info: [{"id": "3cea2e31-e2a9-4b8a-976b-ce818aaca460", "address": "fa:16:3e:ef:80:eb", "network": {"id": "b16bed11-36bd-4428-a500-f0ad85bfaf2d", "bridge": "br-int", "label": "tempest-device-tagging-net1-483768340", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.27", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7345242bf74a4b91a057182d9b5172c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3cea2e31-e2", "ovs_interfaceid": "3cea2e31-e2a9-4b8a-976b-ce818aaca460", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fcd90f6b-ef1b-4f9d-9ced-b98f7be4bc55", "address": "fa:16:3e:90:b6:32", "network": {"id": "b16bed11-36bd-4428-a500-f0ad85bfaf2d", "bridge": "br-int", "label": "tempest-device-tagging-net1-483768340", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.115", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7345242bf74a4b91a057182d9b5172c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcd90f6b-ef", "ovs_interfaceid": "fcd90f6b-ef1b-4f9d-9ced-b98f7be4bc55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d96a280e-5aeb-4a7c-97da-431e5f42c7f6", "address": "fa:16:3e:90:60:1f", "network": {"id": "b16bed11-36bd-4428-a500-f0ad85bfaf2d", "bridge": "br-int", "label": "tempest-device-tagging-net1-483768340", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.234", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7345242bf74a4b91a057182d9b5172c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd96a280e-5a", "ovs_interfaceid": "d96a280e-5aeb-4a7c-97da-431e5f42c7f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "92c19874-960c-4e03-8537-6ae44812a1da", "address": "fa:16:3e:a2:61:33", "network": {"id": "b16bed11-36bd-4428-a500-f0ad85bfaf2d", "bridge": "br-int", "label": "tempest-device-tagging-net1-483768340", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.114", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7345242bf74a4b91a057182d9b5172c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92c19874-96", "ovs_interfaceid": "92c19874-960c-4e03-8537-6ae44812a1da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6830a784-9d5e-4efe-8b35-9d1713e0c8ce", "address": "fa:16:3e:99:2e:fe", "network": {"id": "5bf13de0-38d0-4177-9863-980a7c39151c", "bridge": "br-int", "label": "tempest-device-tagging-net2-427749890", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7345242bf74a4b91a057182d9b5172c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6830a784-9d", "ovs_interfaceid": "6830a784-9d5e-4efe-8b35-9d1713e0c8ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "650ae32c-3dec-4bad-8ff0-6ad423e1cb21", "address": "fa:16:3e:c9:be:0b", "network": {"id": "5bf13de0-38d0-4177-9863-980a7c39151c", "bridge": "br-int", "label": "tempest-device-tagging-net2-427749890", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7345242bf74a4b91a057182d9b5172c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap650ae32c-3d", "ovs_interfaceid": "650ae32c-3dec-4bad-8ff0-6ad423e1cb21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:18:21 user nova-compute[72382]: DEBUG nova.compute.manager [req-99461ed5-7b7a-4061-97d2-e5e781e843e0 req-74035799-5615-4fef-82a4-a5392aa7915d service nova] [instance: f1b4f73b-7a9e-4cf1-9d51-f32284f49c53] Detach interface failed, port_id=d031358f-2670-4942-9266-d9db448a078b, reason: Instance f1b4f73b-7a9e-4cf1-9d51-f32284f49c53 could not be found. {{(pid=72382) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 09 15:18:22 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ac22a112-e9ca-445c-a23d-a39f8d7239ad tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] [instance: b5aa7e23-9c2c-400e-a615-5839858749e1] Calling os-brick to attach iSCSI Volume {{(pid=72382) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 15:18:22 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac22a112-e9ca-445c-a23d-a39f8d7239ad tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2a0c768340>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:9c2a0938-fb5c-434c-91ba-15e8823c1348'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xwYsrRaA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 15:18:22 user nova-compute[72382]: WARNING os_brick.initiator.connectors.base [None req-ac22a112-e9ca-445c-a23d-a39f8d7239ad tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 15:18:22 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-ac22a112-e9ca-445c-a23d-a39f8d7239ad tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 15:18:22 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-ac22a112-e9ca-445c-a23d-a39f8d7239ad tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 15:18:22 user nova-compute[72382]: WARNING os_brick.initiator.connectors.base [None req-ac22a112-e9ca-445c-a23d-a39f8d7239ad tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 15:18:22 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-ac22a112-e9ca-445c-a23d-a39f8d7239ad tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9c2a0938-fb5c-434c-91ba-15e8823c1348" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 15:18:22 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-ac22a112-e9ca-445c-a23d-a39f8d7239ad tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9c2a0938-fb5c-434c-91ba-15e8823c1348" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 15:18:22 user nova-compute[72382]: INFO os_brick.initiator.connectors.iscsi [None req-ac22a112-e9ca-445c-a23d-a39f8d7239ad tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 15:18:22 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c2a0938-fb5c-434c-91ba-15e8823c1348 -p 172.16.0.220:3260 {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:18:22 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c2a0938-fb5c-434c-91ba-15e8823c1348 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:18:22 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b50f91a-3eca-4a6a-af27-d9029390c48f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:18:22 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac22a112-e9ca-445c-a23d-a39f8d7239ad tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 15:18:22 user nova-compute[72382]:  {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:18:22 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c2a0938-fb5c-434c-91ba-15e8823c1348 -p 172.16.0.220:3260 --interface default --op new {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:18:22 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c2a0938-fb5c-434c-91ba-15e8823c1348 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:18:22 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cdd6a25-356b-45c7-82dd-38ef00d21c5c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9c2a0938-fb5c-434c-91ba-15e8823c1348] added\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:18:22 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac22a112-e9ca-445c-a23d-a39f8d7239ad tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9c2a0938-fb5c-434c-91ba-15e8823c1348] added
Aug 09 15:18:22 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:18:22 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c2a0938-fb5c-434c-91ba-15e8823c1348 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:18:22 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c2a0938-fb5c-434c-91ba-15e8823c1348 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:18:22 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[e940b1bd-4ea8-4ebf-8ac1-3ee632b5dd61]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:18:22 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac22a112-e9ca-445c-a23d-a39f8d7239ad tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:18:22 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c2a0938-fb5c-434c-91ba-15e8823c1348 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:18:22 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c2a0938-fb5c-434c-91ba-15e8823c1348 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:18:22 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bd4ca7c-46b8-4db5-bfef-97b1d9314e74]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:18:22 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac22a112-e9ca-445c-a23d-a39f8d7239ad tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:18:22 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c2a0938-fb5c-434c-91ba-15e8823c1348 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xwYsrRaA {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:18:22 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c2a0938-fb5c-434c-91ba-15e8823c1348 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xwYsrRaA" returned: 0 in 0.019s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:18:22 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[d13b20d9-8d31-4f64-88ed-1c5e92159b0e]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:18:22 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac22a112-e9ca-445c-a23d-a39f8d7239ad tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xwYsrRaA'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:18:22 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c2a0938-fb5c-434c-91ba-15e8823c1348 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:18:22 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c2a0938-fb5c-434c-91ba-15e8823c1348 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:18:22 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d08ae96-a2d6-48a4-a183-56783d31f3c8]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:18:22 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac22a112-e9ca-445c-a23d-a39f8d7239ad tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:18:22 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:18:22 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:18:22 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[548c01a7-d9fc-46c5-82ac-0d5acee16e1e]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:344efe6d-5a52-4d0d-a34e-da8627a1e09f (non-flash)\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:18:22 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac22a112-e9ca-445c-a23d-a39f8d7239ad tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:344efe6d-5a52-4d0d-a34e-da8627a1e09f (non-flash)
Aug 09 15:18:22 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 15:18:22 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac22a112-e9ca-445c-a23d-a39f8d7239ad tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:344efe6d-5a52-4d0d-a34e-da8627a1e09f (non-flash)
Aug 09 15:18:22 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 15:18:22 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c2a0938-fb5c-434c-91ba-15e8823c1348 -p 172.16.0.220:3260 --login {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:18:22 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c2a0938-fb5c-434c-91ba-15e8823c1348 -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:18:22 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb5b0379-8ceb-412a-814e-382c3aaa1373]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9c2a0938-fb5c-434c-91ba-15e8823c1348, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9c2a0938-fb5c-434c-91ba-15e8823c1348, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:18:22 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac22a112-e9ca-445c-a23d-a39f8d7239ad tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9c2a0938-fb5c-434c-91ba-15e8823c1348, portal: 172.16.0.220,3260]
Aug 09 15:18:22 user nova-compute[72382]: Login to [iface: default, target: iqn.2010-10.org.openstack:9c2a0938-fb5c-434c-91ba-15e8823c1348, portal: 172.16.0.220,3260] successful.
Aug 09 15:18:22 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:18:22 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c2a0938-fb5c-434c-91ba-15e8823c1348 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:18:22 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c2a0938-fb5c-434c-91ba-15e8823c1348 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:18:22 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[39b560e5-384d-4726-a058-c4e92d7199dc]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:18:22 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac22a112-e9ca-445c-a23d-a39f8d7239ad tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:18:22 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:18:22 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:18:22 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[2df63cbf-fe58-4ccf-b0ed-2f5c6bc94851]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:344efe6d-5a52-4d0d-a34e-da8627a1e09f (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c2a0938-fb5c-434c-91ba-15e8823c1348 (non-flash)\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:18:22 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac22a112-e9ca-445c-a23d-a39f8d7239ad tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:344efe6d-5a52-4d0d-a34e-da8627a1e09f (non-flash)
Aug 09 15:18:22 user nova-compute[72382]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c2a0938-fb5c-434c-91ba-15e8823c1348 (non-flash)
Aug 09 15:18:22 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 15:18:22 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac22a112-e9ca-445c-a23d-a39f8d7239ad tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:344efe6d-5a52-4d0d-a34e-da8627a1e09f (non-flash)
Aug 09 15:18:22 user nova-compute[72382]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c2a0938-fb5c-434c-91ba-15e8823c1348 (non-flash)
Aug 09 15:18:22 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 15:18:22 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-ac22a112-e9ca-445c-a23d-a39f8d7239ad tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9c2a0938-fb5c-434c-91ba-15e8823c1348" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.277s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 15:18:22 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac22a112-e9ca-445c-a23d-a39f8d7239ad tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] Connected to 172.16.0.220:3260 {{(pid=72382) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 15:18:22 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-ac22a112-e9ca-445c-a23d-a39f8d7239ad tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] HCTL ('33', '-', '-', 0) found on session 11 with lun 0 {{(pid=72382) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 15:18:22 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-ac22a112-e9ca-445c-a23d-a39f8d7239ad tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72382) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 15:18:22 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:18:22 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:18:22 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[14a8d9f5-64bd-40aa-ad17-90bfba6eb856]: (4, ('- - 0', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:18:22 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-ac22a112-e9ca-445c-a23d-a39f8d7239ad tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] Searching for a device in session 11 and hctl ['33', '*', '*', 0] yield: None {{(pid=72382) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 15:18:22 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:18:23 user nova-compute[72382]: DEBUG nova.compute.manager [req-1f8a8e58-02e6-411c-ac28-de0069536d98 req-295f79f0-87d3-4110-b268-105cd845343f service nova] [instance: f1b4f73b-7a9e-4cf1-9d51-f32284f49c53] Received event network-vif-deleted-650ae32c-3dec-4bad-8ff0-6ad423e1cb21 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:18:23 user nova-compute[72382]: INFO nova.compute.manager [req-1f8a8e58-02e6-411c-ac28-de0069536d98 req-295f79f0-87d3-4110-b268-105cd845343f service nova] [instance: f1b4f73b-7a9e-4cf1-9d51-f32284f49c53] Neutron deleted interface 650ae32c-3dec-4bad-8ff0-6ad423e1cb21; detaching it from the instance and deleting it from the info cache
Aug 09 15:18:23 user nova-compute[72382]: DEBUG nova.network.neutron [req-1f8a8e58-02e6-411c-ac28-de0069536d98 req-295f79f0-87d3-4110-b268-105cd845343f service nova] [instance: f1b4f73b-7a9e-4cf1-9d51-f32284f49c53] Updating instance_info_cache with network_info: [{"id": "3cea2e31-e2a9-4b8a-976b-ce818aaca460", "address": "fa:16:3e:ef:80:eb", "network": {"id": "b16bed11-36bd-4428-a500-f0ad85bfaf2d", "bridge": "br-int", "label": "tempest-device-tagging-net1-483768340", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.27", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7345242bf74a4b91a057182d9b5172c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3cea2e31-e2", "ovs_interfaceid": "3cea2e31-e2a9-4b8a-976b-ce818aaca460", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fcd90f6b-ef1b-4f9d-9ced-b98f7be4bc55", "address": "fa:16:3e:90:b6:32", "network": {"id": "b16bed11-36bd-4428-a500-f0ad85bfaf2d", "bridge": "br-int", "label": "tempest-device-tagging-net1-483768340", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.115", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7345242bf74a4b91a057182d9b5172c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcd90f6b-ef", "ovs_interfaceid": "fcd90f6b-ef1b-4f9d-9ced-b98f7be4bc55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d96a280e-5aeb-4a7c-97da-431e5f42c7f6", "address": "fa:16:3e:90:60:1f", "network": {"id": "b16bed11-36bd-4428-a500-f0ad85bfaf2d", "bridge": "br-int", "label": "tempest-device-tagging-net1-483768340", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.234", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7345242bf74a4b91a057182d9b5172c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd96a280e-5a", "ovs_interfaceid": "d96a280e-5aeb-4a7c-97da-431e5f42c7f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "92c19874-960c-4e03-8537-6ae44812a1da", "address": "fa:16:3e:a2:61:33", "network": {"id": "b16bed11-36bd-4428-a500-f0ad85bfaf2d", "bridge": "br-int", "label": "tempest-device-tagging-net1-483768340", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.114", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7345242bf74a4b91a057182d9b5172c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92c19874-96", "ovs_interfaceid": "92c19874-960c-4e03-8537-6ae44812a1da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6830a784-9d5e-4efe-8b35-9d1713e0c8ce", "address": "fa:16:3e:99:2e:fe", "network": {"id": "5bf13de0-38d0-4177-9863-980a7c39151c", "bridge": "br-int", "label": "tempest-device-tagging-net2-427749890", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7345242bf74a4b91a057182d9b5172c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6830a784-9d", "ovs_interfaceid": "6830a784-9d5e-4efe-8b35-9d1713e0c8ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:18:23 user nova-compute[72382]: DEBUG nova.compute.manager [req-1f8a8e58-02e6-411c-ac28-de0069536d98 req-295f79f0-87d3-4110-b268-105cd845343f service nova] [instance: f1b4f73b-7a9e-4cf1-9d51-f32284f49c53] Detach interface failed, port_id=650ae32c-3dec-4bad-8ff0-6ad423e1cb21, reason: Instance f1b4f73b-7a9e-4cf1-9d51-f32284f49c53 could not be found. {{(pid=72382) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 09 15:18:23 user nova-compute[72382]: DEBUG nova.compute.manager [req-1f8a8e58-02e6-411c-ac28-de0069536d98 req-295f79f0-87d3-4110-b268-105cd845343f service nova] [instance: f1b4f73b-7a9e-4cf1-9d51-f32284f49c53] Received event network-vif-deleted-6830a784-9d5e-4efe-8b35-9d1713e0c8ce {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:18:23 user nova-compute[72382]: INFO nova.compute.manager [req-1f8a8e58-02e6-411c-ac28-de0069536d98 req-295f79f0-87d3-4110-b268-105cd845343f service nova] [instance: f1b4f73b-7a9e-4cf1-9d51-f32284f49c53] Neutron deleted interface 6830a784-9d5e-4efe-8b35-9d1713e0c8ce; detaching it from the instance and deleting it from the info cache
Aug 09 15:18:23 user nova-compute[72382]: DEBUG nova.network.neutron [req-1f8a8e58-02e6-411c-ac28-de0069536d98 req-295f79f0-87d3-4110-b268-105cd845343f service nova] [instance: f1b4f73b-7a9e-4cf1-9d51-f32284f49c53] Updating instance_info_cache with network_info: [{"id": "3cea2e31-e2a9-4b8a-976b-ce818aaca460", "address": "fa:16:3e:ef:80:eb", "network": {"id": "b16bed11-36bd-4428-a500-f0ad85bfaf2d", "bridge": "br-int", "label": "tempest-device-tagging-net1-483768340", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.27", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7345242bf74a4b91a057182d9b5172c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3cea2e31-e2", "ovs_interfaceid": "3cea2e31-e2a9-4b8a-976b-ce818aaca460", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fcd90f6b-ef1b-4f9d-9ced-b98f7be4bc55", "address": "fa:16:3e:90:b6:32", "network": {"id": "b16bed11-36bd-4428-a500-f0ad85bfaf2d", "bridge": "br-int", "label": "tempest-device-tagging-net1-483768340", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.115", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7345242bf74a4b91a057182d9b5172c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcd90f6b-ef", "ovs_interfaceid": "fcd90f6b-ef1b-4f9d-9ced-b98f7be4bc55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d96a280e-5aeb-4a7c-97da-431e5f42c7f6", "address": "fa:16:3e:90:60:1f", "network": {"id": "b16bed11-36bd-4428-a500-f0ad85bfaf2d", "bridge": "br-int", "label": "tempest-device-tagging-net1-483768340", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.234", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7345242bf74a4b91a057182d9b5172c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd96a280e-5a", "ovs_interfaceid": "d96a280e-5aeb-4a7c-97da-431e5f42c7f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "92c19874-960c-4e03-8537-6ae44812a1da", "address": "fa:16:3e:a2:61:33", "network": {"id": "b16bed11-36bd-4428-a500-f0ad85bfaf2d", "bridge": "br-int", "label": "tempest-device-tagging-net1-483768340", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.114", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7345242bf74a4b91a057182d9b5172c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92c19874-96", "ovs_interfaceid": "92c19874-960c-4e03-8537-6ae44812a1da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:18:23 user nova-compute[72382]: DEBUG nova.compute.manager [req-1f8a8e58-02e6-411c-ac28-de0069536d98 req-295f79f0-87d3-4110-b268-105cd845343f service nova] [instance: f1b4f73b-7a9e-4cf1-9d51-f32284f49c53] Detach interface failed, port_id=6830a784-9d5e-4efe-8b35-9d1713e0c8ce, reason: Instance f1b4f73b-7a9e-4cf1-9d51-f32284f49c53 could not be found. {{(pid=72382) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 09 15:18:23 user nova-compute[72382]: DEBUG nova.compute.manager [req-1f8a8e58-02e6-411c-ac28-de0069536d98 req-295f79f0-87d3-4110-b268-105cd845343f service nova] [instance: f1b4f73b-7a9e-4cf1-9d51-f32284f49c53] Received event network-vif-deleted-92c19874-960c-4e03-8537-6ae44812a1da {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:18:23 user nova-compute[72382]: INFO nova.compute.manager [req-1f8a8e58-02e6-411c-ac28-de0069536d98 req-295f79f0-87d3-4110-b268-105cd845343f service nova] [instance: f1b4f73b-7a9e-4cf1-9d51-f32284f49c53] Neutron deleted interface 92c19874-960c-4e03-8537-6ae44812a1da; detaching it from the instance and deleting it from the info cache
Aug 09 15:18:23 user nova-compute[72382]: DEBUG nova.network.neutron [req-1f8a8e58-02e6-411c-ac28-de0069536d98 req-295f79f0-87d3-4110-b268-105cd845343f service nova] [instance: f1b4f73b-7a9e-4cf1-9d51-f32284f49c53] Updating instance_info_cache with network_info: [{"id": "3cea2e31-e2a9-4b8a-976b-ce818aaca460", "address": "fa:16:3e:ef:80:eb", "network": {"id": "b16bed11-36bd-4428-a500-f0ad85bfaf2d", "bridge": "br-int", "label": "tempest-device-tagging-net1-483768340", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.27", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7345242bf74a4b91a057182d9b5172c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3cea2e31-e2", "ovs_interfaceid": "3cea2e31-e2a9-4b8a-976b-ce818aaca460", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fcd90f6b-ef1b-4f9d-9ced-b98f7be4bc55", "address": "fa:16:3e:90:b6:32", "network": {"id": "b16bed11-36bd-4428-a500-f0ad85bfaf2d", "bridge": "br-int", "label": "tempest-device-tagging-net1-483768340", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.115", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7345242bf74a4b91a057182d9b5172c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcd90f6b-ef", "ovs_interfaceid": "fcd90f6b-ef1b-4f9d-9ced-b98f7be4bc55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d96a280e-5aeb-4a7c-97da-431e5f42c7f6", "address": "fa:16:3e:90:60:1f", "network": {"id": "b16bed11-36bd-4428-a500-f0ad85bfaf2d", "bridge": "br-int", "label": "tempest-device-tagging-net1-483768340", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.234", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7345242bf74a4b91a057182d9b5172c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd96a280e-5a", "ovs_interfaceid": "d96a280e-5aeb-4a7c-97da-431e5f42c7f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:18:23 user nova-compute[72382]: DEBUG nova.compute.manager [req-1f8a8e58-02e6-411c-ac28-de0069536d98 req-295f79f0-87d3-4110-b268-105cd845343f service nova] [instance: f1b4f73b-7a9e-4cf1-9d51-f32284f49c53] Detach interface failed, port_id=92c19874-960c-4e03-8537-6ae44812a1da, reason: Instance f1b4f73b-7a9e-4cf1-9d51-f32284f49c53 could not be found. {{(pid=72382) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 09 15:18:23 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-ac22a112-e9ca-445c-a23d-a39f8d7239ad tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] Searching for a device in session 11 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72382) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 15:18:23 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac22a112-e9ca-445c-a23d-a39f8d7239ad tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xwYsrRaA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72382) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 15:18:23 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-ac22a112-e9ca-445c-a23d-a39f8d7239ad tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.309s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 15:18:23 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac22a112-e9ca-445c-a23d-a39f8d7239ad tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] <== connect_volume: return (1310ms) {'type': 'block', 'scsi_wwn': '23634383434336463', 'path': '/dev/sdb'} {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 15:18:23 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ac22a112-e9ca-445c-a23d-a39f8d7239ad tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] [instance: b5aa7e23-9c2c-400e-a615-5839858749e1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23634383434336463', 'path': '/dev/sdb'} {{(pid=72382) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 15:18:23 user nova-compute[72382]: DEBUG nova.objects.instance [None req-ac22a112-e9ca-445c-a23d-a39f8d7239ad tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] Lazy-loading 'flavor' on Instance uuid b5aa7e23-9c2c-400e-a615-5839858749e1 {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:18:23 user nova-compute[72382]: DEBUG nova.virt.libvirt.guest [None req-ac22a112-e9ca-445c-a23d-a39f8d7239ad tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 15:18:23 user nova-compute[72382]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 15:18:23 user nova-compute[72382]:   <source dev="/dev/sdb"/>
Aug 09 15:18:23 user nova-compute[72382]:   <target dev="vdb" bus="virtio"/>
Aug 09 15:18:23 user nova-compute[72382]:   <serial>9c2a0938-fb5c-434c-91ba-15e8823c1348</serial>
Aug 09 15:18:23 user nova-compute[72382]: </disk>
Aug 09 15:18:23 user nova-compute[72382]:  {{(pid=72382) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 15:18:23 user nova-compute[72382]: DEBUG nova.network.neutron [-] [instance: f1b4f73b-7a9e-4cf1-9d51-f32284f49c53] Updating instance_info_cache with network_info: [] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:18:23 user nova-compute[72382]: INFO nova.compute.manager [-] [instance: f1b4f73b-7a9e-4cf1-9d51-f32284f49c53] Took 4.70 seconds to deallocate network for instance.
Aug 09 15:18:23 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:18:23 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-ac22a112-e9ca-445c-a23d-a39f8d7239ad tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] No BDM found with device name vda, not building metadata. {{(pid=72382) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 15:18:23 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-ac22a112-e9ca-445c-a23d-a39f8d7239ad tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72382) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 15:18:23 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-ac22a112-e9ca-445c-a23d-a39f8d7239ad tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] No VIF found with MAC fa:16:3e:f1:64:50, not building metadata {{(pid=72382) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 15:18:24 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-ac22a112-e9ca-445c-a23d-a39f8d7239ad tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] Lock "b5aa7e23-9c2c-400e-a615-5839858749e1" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 16.043s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:18:25 user nova-compute[72382]: DEBUG nova.compute.manager [req-fa5f688a-1246-46d8-b762-9bb8722e363a req-f77e3d24-d65a-4dad-b297-1fb5f9f8fee3 service nova] [instance: f1b4f73b-7a9e-4cf1-9d51-f32284f49c53] Received event network-vif-deleted-d96a280e-5aeb-4a7c-97da-431e5f42c7f6 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:18:25 user nova-compute[72382]: DEBUG nova.compute.manager [None req-84cdb645-ea72-4c8c-9930-f6786758445c tempest-TestVolumeSwap-1225930191 tempest-TestVolumeSwap-1225930191-project-admin] [instance: 9a82f146-97ce-4319-8b25-c1b090965e53] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:ad1e2adc-5d1a-4718-8971-7d362e291602'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'avodyQXL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '9a82f146-97ce-4319-8b25-c1b090965e53', 'attached_at': '', 'detached_at': '', 'volume_id': 'ad1e2adc-5d1a-4718-8971-7d362e291602', 'serial': 'ad1e2adc-5d1a-4718-8971-7d362e291602'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:344efe6d-5a52-4d0d-a34e-da8627a1e09f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qiuZemSC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf', 'volume_id': '344efe6d-5a52-4d0d-a34e-da8627a1e09f'}, 'status': 'reserved', 'instance': '9a82f146-97ce-4319-8b25-c1b090965e53', 'attached_at': '', 'detached_at': '', 'volume_id': '344efe6d-5a52-4d0d-a34e-da8627a1e09f', 'serial'} {{(pid=72382) _swap_volume /opt/stack/nova/nova/compute/manager.py:7702}}
Aug 09 15:18:25 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-84cdb645-ea72-4c8c-9930-f6786758445c tempest-TestVolumeSwap-1225930191 tempest-TestVolumeSwap-1225930191-project-admin] [instance: 9a82f146-97ce-4319-8b25-c1b090965e53] Calling os-brick to attach iSCSI Volume {{(pid=72382) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 15:18:25 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-84cdb645-ea72-4c8c-9930-f6786758445c tempest-TestVolumeSwap-1225930191 tempest-TestVolumeSwap-1225930191-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2a0c768340>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:ad1e2adc-5d1a-4718-8971-7d362e291602'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'avodyQXL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 15:18:25 user nova-compute[72382]: WARNING os_brick.initiator.connectors.base [None req-84cdb645-ea72-4c8c-9930-f6786758445c tempest-TestVolumeSwap-1225930191 tempest-TestVolumeSwap-1225930191-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 15:18:25 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-84cdb645-ea72-4c8c-9930-f6786758445c tempest-TestVolumeSwap-1225930191 tempest-TestVolumeSwap-1225930191-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 15:18:25 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-84cdb645-ea72-4c8c-9930-f6786758445c tempest-TestVolumeSwap-1225930191 tempest-TestVolumeSwap-1225930191-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 15:18:25 user nova-compute[72382]: WARNING os_brick.initiator.connectors.base [None req-84cdb645-ea72-4c8c-9930-f6786758445c tempest-TestVolumeSwap-1225930191 tempest-TestVolumeSwap-1225930191-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 15:18:25 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-84cdb645-ea72-4c8c-9930-f6786758445c tempest-TestVolumeSwap-1225930191 tempest-TestVolumeSwap-1225930191-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ad1e2adc-5d1a-4718-8971-7d362e291602" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 15:18:25 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-84cdb645-ea72-4c8c-9930-f6786758445c tempest-TestVolumeSwap-1225930191 tempest-TestVolumeSwap-1225930191-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ad1e2adc-5d1a-4718-8971-7d362e291602" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 15:18:25 user nova-compute[72382]: INFO os_brick.initiator.connectors.iscsi [None req-84cdb645-ea72-4c8c-9930-f6786758445c tempest-TestVolumeSwap-1225930191 tempest-TestVolumeSwap-1225930191-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 15:18:25 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad1e2adc-5d1a-4718-8971-7d362e291602 -p 172.16.0.220:3260 {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:18:25 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad1e2adc-5d1a-4718-8971-7d362e291602 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:18:25 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2a485a6-4b0f-46b3-bcfd-7f98ad8cead4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:18:25 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-84cdb645-ea72-4c8c-9930-f6786758445c tempest-TestVolumeSwap-1225930191 tempest-TestVolumeSwap-1225930191-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 15:18:25 user nova-compute[72382]:  {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:18:25 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad1e2adc-5d1a-4718-8971-7d362e291602 -p 172.16.0.220:3260 --interface default --op new {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:18:25 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad1e2adc-5d1a-4718-8971-7d362e291602 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:18:25 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ad7ff3b-3eec-407b-90f7-5dd222a5184f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ad1e2adc-5d1a-4718-8971-7d362e291602] added\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:18:25 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-84cdb645-ea72-4c8c-9930-f6786758445c tempest-TestVolumeSwap-1225930191 tempest-TestVolumeSwap-1225930191-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ad1e2adc-5d1a-4718-8971-7d362e291602] added
Aug 09 15:18:25 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:18:25 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad1e2adc-5d1a-4718-8971-7d362e291602 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:18:25 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad1e2adc-5d1a-4718-8971-7d362e291602 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:18:25 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8263e64-c3a8-4793-a2e9-9e170c8db11a]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:18:25 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-84cdb645-ea72-4c8c-9930-f6786758445c tempest-TestVolumeSwap-1225930191 tempest-TestVolumeSwap-1225930191-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:18:25 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad1e2adc-5d1a-4718-8971-7d362e291602 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:18:25 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad1e2adc-5d1a-4718-8971-7d362e291602 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:18:25 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[abd1a9c2-13b5-49ec-b524-4e0accb86960]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:18:25 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-84cdb645-ea72-4c8c-9930-f6786758445c tempest-TestVolumeSwap-1225930191 tempest-TestVolumeSwap-1225930191-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:18:25 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad1e2adc-5d1a-4718-8971-7d362e291602 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v avodyQXL {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:18:25 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad1e2adc-5d1a-4718-8971-7d362e291602 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v avodyQXL" returned: 0 in 0.021s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:18:25 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[1485ec6c-b916-4546-9991-6eab7d63c8f9]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:18:25 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-84cdb645-ea72-4c8c-9930-f6786758445c tempest-TestVolumeSwap-1225930191 tempest-TestVolumeSwap-1225930191-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'avodyQXL'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:18:25 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad1e2adc-5d1a-4718-8971-7d362e291602 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:18:25 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad1e2adc-5d1a-4718-8971-7d362e291602 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:18:25 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[a53ebbff-2d86-4af5-8b61-88f2f401ce3f]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:18:25 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-84cdb645-ea72-4c8c-9930-f6786758445c tempest-TestVolumeSwap-1225930191 tempest-TestVolumeSwap-1225930191-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:18:25 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:18:25 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:18:25 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[897cb891-e021-4b04-a345-8dfc361ef078]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:344efe6d-5a52-4d0d-a34e-da8627a1e09f (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c2a0938-fb5c-434c-91ba-15e8823c1348 (non-flash)\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:18:25 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-84cdb645-ea72-4c8c-9930-f6786758445c tempest-TestVolumeSwap-1225930191 tempest-TestVolumeSwap-1225930191-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:344efe6d-5a52-4d0d-a34e-da8627a1e09f (non-flash)
Aug 09 15:18:25 user nova-compute[72382]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c2a0938-fb5c-434c-91ba-15e8823c1348 (non-flash)
Aug 09 15:18:25 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 15:18:25 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-84cdb645-ea72-4c8c-9930-f6786758445c tempest-TestVolumeSwap-1225930191 tempest-TestVolumeSwap-1225930191-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:344efe6d-5a52-4d0d-a34e-da8627a1e09f (non-flash)
Aug 09 15:18:25 user nova-compute[72382]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c2a0938-fb5c-434c-91ba-15e8823c1348 (non-flash)
Aug 09 15:18:25 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 15:18:25 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad1e2adc-5d1a-4718-8971-7d362e291602 -p 172.16.0.220:3260 --login {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:18:25 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad1e2adc-5d1a-4718-8971-7d362e291602 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:18:25 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ab76732-dc62-4eaa-a1f4-6941a7b4cbe1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ad1e2adc-5d1a-4718-8971-7d362e291602, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ad1e2adc-5d1a-4718-8971-7d362e291602, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:18:25 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-84cdb645-ea72-4c8c-9930-f6786758445c tempest-TestVolumeSwap-1225930191 tempest-TestVolumeSwap-1225930191-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ad1e2adc-5d1a-4718-8971-7d362e291602, portal: 172.16.0.220,3260]
Aug 09 15:18:25 user nova-compute[72382]: Login to [iface: default, target: iqn.2010-10.org.openstack:ad1e2adc-5d1a-4718-8971-7d362e291602, portal: 172.16.0.220,3260] successful.
Aug 09 15:18:25 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:18:25 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad1e2adc-5d1a-4718-8971-7d362e291602 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:18:25 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad1e2adc-5d1a-4718-8971-7d362e291602 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:18:25 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0429bf7-2891-4476-af5d-12db37cbbaec]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:18:25 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-84cdb645-ea72-4c8c-9930-f6786758445c tempest-TestVolumeSwap-1225930191 tempest-TestVolumeSwap-1225930191-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:18:25 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:18:25 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:18:25 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[176dbb71-2664-4585-8ad5-0e493c3136bb]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:344efe6d-5a52-4d0d-a34e-da8627a1e09f (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c2a0938-fb5c-434c-91ba-15e8823c1348 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad1e2adc-5d1a-4718-8971-7d362e291602 (non-flash)\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:18:25 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-84cdb645-ea72-4c8c-9930-f6786758445c tempest-TestVolumeSwap-1225930191 tempest-TestVolumeSwap-1225930191-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:344efe6d-5a52-4d0d-a34e-da8627a1e09f (non-flash)
Aug 09 15:18:25 user nova-compute[72382]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c2a0938-fb5c-434c-91ba-15e8823c1348 (non-flash)
Aug 09 15:18:25 user nova-compute[72382]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad1e2adc-5d1a-4718-8971-7d362e291602 (non-flash)
Aug 09 15:18:25 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 15:18:25 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-84cdb645-ea72-4c8c-9930-f6786758445c tempest-TestVolumeSwap-1225930191 tempest-TestVolumeSwap-1225930191-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:344efe6d-5a52-4d0d-a34e-da8627a1e09f (non-flash)
Aug 09 15:18:25 user nova-compute[72382]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c2a0938-fb5c-434c-91ba-15e8823c1348 (non-flash)
Aug 09 15:18:25 user nova-compute[72382]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad1e2adc-5d1a-4718-8971-7d362e291602 (non-flash)
Aug 09 15:18:25 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 15:18:25 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-84cdb645-ea72-4c8c-9930-f6786758445c tempest-TestVolumeSwap-1225930191 tempest-TestVolumeSwap-1225930191-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ad1e2adc-5d1a-4718-8971-7d362e291602" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.275s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 15:18:25 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-84cdb645-ea72-4c8c-9930-f6786758445c tempest-TestVolumeSwap-1225930191 tempest-TestVolumeSwap-1225930191-project-admin] Connected to 172.16.0.220:3260 {{(pid=72382) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 15:18:25 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-84cdb645-ea72-4c8c-9930-f6786758445c tempest-TestVolumeSwap-1225930191 tempest-TestVolumeSwap-1225930191-project-admin] HCTL ('34', '-', '-', 0) found on session 12 with lun 0 {{(pid=72382) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 15:18:25 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-84cdb645-ea72-4c8c-9930-f6786758445c tempest-TestVolumeSwap-1225930191 tempest-TestVolumeSwap-1225930191-project-admin] Scanning host 34 c: -, t: -, l: 0) {{(pid=72382) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 15:18:25 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:18:25 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:18:25 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[14e31677-600b-4ac3-9403-faf9c34e2516]: (4, ('- - 0', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:18:25 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-84cdb645-ea72-4c8c-9930-f6786758445c tempest-TestVolumeSwap-1225930191 tempest-TestVolumeSwap-1225930191-project-admin] Searching for a device in session 12 and hctl ['34', '*', '*', 0] yield: None {{(pid=72382) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 15:18:26 user nova-compute[72382]: INFO nova.compute.manager [None req-2544ea4f-5263-465f-8936-f92a2cdc1b77 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] [instance: f1b4f73b-7a9e-4cf1-9d51-f32284f49c53] Took 2.56 seconds to detach 3 volumes for instance.
Aug 09 15:18:26 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-2544ea4f-5263-465f-8936-f92a2cdc1b77 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:18:26 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-2544ea4f-5263-465f-8936-f92a2cdc1b77 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:18:26 user nova-compute[72382]: DEBUG nova.compute.provider_tree [None req-2544ea4f-5263-465f-8936-f92a2cdc1b77 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] Inventory has not changed in ProviderTree for provider: 7b15b0e5-df4d-49db-833b-2855d21d10ae {{(pid=72382) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 15:18:26 user nova-compute[72382]: DEBUG nova.scheduler.client.report [None req-2544ea4f-5263-465f-8936-f92a2cdc1b77 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] Inventory has not changed for provider 7b15b0e5-df4d-49db-833b-2855d21d10ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72382) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 15:18:26 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-2544ea4f-5263-465f-8936-f92a2cdc1b77 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.409s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:18:26 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8627fbb2-f07f-4595-a72c-5724ed106893 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] [instance: 0f510d75-5d1e-4a5c-b38f-731c299f0f5a] Start spawning the instance on the hypervisor. {{(pid=72382) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 15:18:26 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-8627fbb2-f07f-4595-a72c-5724ed106893 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] [instance: 0f510d75-5d1e-4a5c-b38f-731c299f0f5a] Creating instance directory {{(pid=72382) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 15:18:26 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-8627fbb2-f07f-4595-a72c-5724ed106893 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] [instance: 0f510d75-5d1e-4a5c-b38f-731c299f0f5a] Creating image(s)
Aug 09 15:18:26 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-8627fbb2-f07f-4595-a72c-5724ed106893 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] [instance: 0f510d75-5d1e-4a5c-b38f-731c299f0f5a] Did not create local disks {{(pid=72382) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 09 15:18:26 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-8627fbb2-f07f-4595-a72c-5724ed106893 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] [instance: 0f510d75-5d1e-4a5c-b38f-731c299f0f5a] Ensure instance console log exists: /opt/stack/data/nova/instances/0f510d75-5d1e-4a5c-b38f-731c299f0f5a/console.log {{(pid=72382) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 15:18:26 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-8627fbb2-f07f-4595-a72c-5724ed106893 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:18:26 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-8627fbb2-f07f-4595-a72c-5724ed106893 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:18:26 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-8627fbb2-f07f-4595-a72c-5724ed106893 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:18:26 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-8627fbb2-f07f-4595-a72c-5724ed106893 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] [instance: 0f510d75-5d1e-4a5c-b38f-731c299f0f5a] Start _get_guest_xml network_info=[{"id": "c67a8d45-c4ba-4302-940f-c05799ecc732", "address": "fa:16:3e:02:6d:5d", "network": {"id": "d47e3749-fdff-4112-bd72-69ca584efe1f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-302967634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "080d1ded4cd94e5083ee0b7e691b7363", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc67a8d45-c4", "ovs_interfaceid": "c67a8d45-c4ba-4302-940f-c05799ecc732", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T15:11:25Z,direct_url=<?>,disk_format='qcow2',id=a79f2cea-eb27-4631-aaf3-05e7d9e411b4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a638990e12cc4d6eabb6d55e13be6bdf',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T15:11:27Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QpOYqIyf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '0f510d75-5d1e-4a5c-b38f-731c299f0f5a', 'attached_at': '', 'detached_at': '', 'volume_id': '05583e93-152e-49cd-8466-12d60f49c457', 'serial': '05583e93-152e-49cd-8466-12d60f49c457'}, 'disk_bus': 'virtio', 'attachment_id': '942f03cb-1574-4554-bff0-2b8050295136', 'delete_on_termination': False, 'volume_type': None} {{(pid=72382) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 15:18:26 user nova-compute[72382]: INFO nova.scheduler.client.report [None req-2544ea4f-5263-465f-8936-f92a2cdc1b77 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] Deleted allocations for instance f1b4f73b-7a9e-4cf1-9d51-f32284f49c53
Aug 09 15:18:26 user nova-compute[72382]: WARNING nova.virt.libvirt.driver [None req-8627fbb2-f07f-4595-a72c-5724ed106893 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 15:18:26 user nova-compute[72382]: WARNING nova.virt.libvirt.driver [None req-8627fbb2-f07f-4595-a72c-5724ed106893 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 15:18:26 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-8627fbb2-f07f-4595-a72c-5724ed106893 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72382) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 15:18:26 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-8627fbb2-f07f-4595-a72c-5724ed106893 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] CPU controller missing on host. {{(pid=72382) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 15:18:26 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-8627fbb2-f07f-4595-a72c-5724ed106893 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72382) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 15:18:26 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-8627fbb2-f07f-4595-a72c-5724ed106893 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] CPU controller found on host. {{(pid=72382) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 15:18:26 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-8627fbb2-f07f-4595-a72c-5724ed106893 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72382) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 15:18:26 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-8627fbb2-f07f-4595-a72c-5724ed106893 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T15:11:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T15:11:25Z,direct_url=<?>,disk_format='qcow2',id=a79f2cea-eb27-4631-aaf3-05e7d9e411b4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a638990e12cc4d6eabb6d55e13be6bdf',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T15:11:27Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 15:18:26 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-8627fbb2-f07f-4595-a72c-5724ed106893 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Flavor limits 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 15:18:26 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-8627fbb2-f07f-4595-a72c-5724ed106893 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Image limits 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 15:18:26 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-8627fbb2-f07f-4595-a72c-5724ed106893 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Flavor pref 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 15:18:26 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-8627fbb2-f07f-4595-a72c-5724ed106893 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Image pref 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 15:18:26 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-8627fbb2-f07f-4595-a72c-5724ed106893 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 15:18:26 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-8627fbb2-f07f-4595-a72c-5724ed106893 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 15:18:26 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-8627fbb2-f07f-4595-a72c-5724ed106893 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72382) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 15:18:26 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-8627fbb2-f07f-4595-a72c-5724ed106893 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Got 1 possible topologies {{(pid=72382) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 15:18:26 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-8627fbb2-f07f-4595-a72c-5724ed106893 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 15:18:26 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-8627fbb2-f07f-4595-a72c-5724ed106893 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 15:18:26 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8627fbb2-f07f-4595-a72c-5724ed106893 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] [instance: 0f510d75-5d1e-4a5c-b38f-731c299f0f5a] Calling os-brick to attach iSCSI Volume {{(pid=72382) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 15:18:26 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-8627fbb2-f07f-4595-a72c-5724ed106893 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2a0c768340>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QpOYqIyf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 15:18:26 user nova-compute[72382]: WARNING os_brick.initiator.connectors.base [None req-8627fbb2-f07f-4595-a72c-5724ed106893 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 15:18:26 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-8627fbb2-f07f-4595-a72c-5724ed106893 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 15:18:26 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-84cdb645-ea72-4c8c-9930-f6786758445c tempest-TestVolumeSwap-1225930191 tempest-TestVolumeSwap-1225930191-project-admin] Searching for a device in session 12 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72382) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 15:18:26 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-84cdb645-ea72-4c8c-9930-f6786758445c tempest-TestVolumeSwap-1225930191 tempest-TestVolumeSwap-1225930191-project-admin] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'avodyQXL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72382) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 15:18:26 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-84cdb645-ea72-4c8c-9930-f6786758445c tempest-TestVolumeSwap-1225930191 tempest-TestVolumeSwap-1225930191-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.305s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 15:18:26 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-84cdb645-ea72-4c8c-9930-f6786758445c tempest-TestVolumeSwap-1225930191 tempest-TestVolumeSwap-1225930191-project-admin] <== connect_volume: return (1306ms) {'type': 'block', 'scsi_wwn': '23234323435383435', 'path': '/dev/sdc'} {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 15:18:26 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-84cdb645-ea72-4c8c-9930-f6786758445c tempest-TestVolumeSwap-1225930191 tempest-TestVolumeSwap-1225930191-project-admin] [instance: 9a82f146-97ce-4319-8b25-c1b090965e53] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23234323435383435', 'path': '/dev/sdc'} {{(pid=72382) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 15:18:26 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-8627fbb2-f07f-4595-a72c-5724ed106893 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.023s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 15:18:26 user nova-compute[72382]: WARNING os_brick.initiator.connectors.base [None req-8627fbb2-f07f-4595-a72c-5724ed106893 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 15:18:26 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-8627fbb2-f07f-4595-a72c-5724ed106893 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 15:18:26 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-8627fbb2-f07f-4595-a72c-5724ed106893 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 15:18:26 user nova-compute[72382]: INFO os_brick.initiator.connectors.iscsi [None req-8627fbb2-f07f-4595-a72c-5724ed106893 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 15:18:26 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 -p 172.16.0.220:3260 {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:18:26 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-2544ea4f-5263-465f-8936-f92a2cdc1b77 tempest-TaggedBootDevicesTest-1008702709 tempest-TaggedBootDevicesTest-1008702709-project-member] Lock "f1b4f73b-7a9e-4cf1-9d51-f32284f49c53" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 11.247s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:18:26 user nova-compute[72382]: DEBUG nova.objects.instance [None req-84cdb645-ea72-4c8c-9930-f6786758445c tempest-TestVolumeSwap-1225930191 tempest-TestVolumeSwap-1225930191-project-admin] Lazy-loading 'flavor' on Instance uuid 9a82f146-97ce-4319-8b25-c1b090965e53 {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:18:26 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:18:26 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[81e41b2c-f763-4e93-a737-61da74b2c983]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:18:26 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-8627fbb2-f07f-4595-a72c-5724ed106893 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 15:18:26 user nova-compute[72382]:  {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:18:26 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 -p 172.16.0.220:3260 --interface default --op new {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:18:26 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:18:26 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[58eb7ba7-9b60-4a06-9b14-3d976a830f0d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457] added\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:18:26 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-8627fbb2-f07f-4595-a72c-5724ed106893 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457] added
Aug 09 15:18:26 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:18:26 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:18:26 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:18:26 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6762781-04bc-4903-815b-2d77f127f591]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:18:26 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-8627fbb2-f07f-4595-a72c-5724ed106893 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:18:26 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:18:26 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:18:26 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[93ad83a4-5894-414c-8f16-6a77f0c29cc9]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:18:26 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-8627fbb2-f07f-4595-a72c-5724ed106893 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:18:26 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QpOYqIyf {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:18:26 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QpOYqIyf" returned: 0 in 0.019s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:18:26 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a76439d-b9f7-4c7a-81f8-feb9d7c8819e]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:18:26 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-8627fbb2-f07f-4595-a72c-5724ed106893 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QpOYqIyf'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:18:26 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:18:26 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:18:26 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[8edf7973-bafc-4570-9d2a-0fe70f6f1978]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:18:26 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-8627fbb2-f07f-4595-a72c-5724ed106893 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:18:26 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:18:26 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:18:26 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[33d342bd-a758-47ba-adaa-3c95b41d32a2]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:344efe6d-5a52-4d0d-a34e-da8627a1e09f (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c2a0938-fb5c-434c-91ba-15e8823c1348 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad1e2adc-5d1a-4718-8971-7d362e291602 (non-flash)\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:18:26 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-8627fbb2-f07f-4595-a72c-5724ed106893 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:344efe6d-5a52-4d0d-a34e-da8627a1e09f (non-flash)
Aug 09 15:18:26 user nova-compute[72382]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c2a0938-fb5c-434c-91ba-15e8823c1348 (non-flash)
Aug 09 15:18:26 user nova-compute[72382]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad1e2adc-5d1a-4718-8971-7d362e291602 (non-flash)
Aug 09 15:18:26 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 15:18:26 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-8627fbb2-f07f-4595-a72c-5724ed106893 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:344efe6d-5a52-4d0d-a34e-da8627a1e09f (non-flash)
Aug 09 15:18:26 user nova-compute[72382]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c2a0938-fb5c-434c-91ba-15e8823c1348 (non-flash)
Aug 09 15:18:26 user nova-compute[72382]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad1e2adc-5d1a-4718-8971-7d362e291602 (non-flash)
Aug 09 15:18:26 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 15:18:26 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 -p 172.16.0.220:3260 --login {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:18:26 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:18:26 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[960894f4-be0b-4f09-b09a-754d839c18cf]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:18:26 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-8627fbb2-f07f-4595-a72c-5724ed106893 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457, portal: 172.16.0.220,3260]
Aug 09 15:18:26 user nova-compute[72382]: Login to [iface: default, target: iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457, portal: 172.16.0.220,3260] successful.
Aug 09 15:18:26 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:18:26 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:18:26 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:18:26 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[98e7f0b6-cc9c-4518-9c10-6509efc336cd]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:18:26 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-8627fbb2-f07f-4595-a72c-5724ed106893 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:18:26 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:18:26 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:18:26 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[3214bd34-a4c4-45f4-8a3b-ee0191ce4562]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:344efe6d-5a52-4d0d-a34e-da8627a1e09f (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c2a0938-fb5c-434c-91ba-15e8823c1348 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad1e2adc-5d1a-4718-8971-7d362e291602 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:18:26 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-8627fbb2-f07f-4595-a72c-5724ed106893 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:344efe6d-5a52-4d0d-a34e-da8627a1e09f (non-flash)
Aug 09 15:18:26 user nova-compute[72382]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c2a0938-fb5c-434c-91ba-15e8823c1348 (non-flash)
Aug 09 15:18:26 user nova-compute[72382]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad1e2adc-5d1a-4718-8971-7d362e291602 (non-flash)
Aug 09 15:18:26 user nova-compute[72382]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)
Aug 09 15:18:26 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 15:18:26 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-8627fbb2-f07f-4595-a72c-5724ed106893 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:344efe6d-5a52-4d0d-a34e-da8627a1e09f (non-flash)
Aug 09 15:18:26 user nova-compute[72382]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c2a0938-fb5c-434c-91ba-15e8823c1348 (non-flash)
Aug 09 15:18:26 user nova-compute[72382]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad1e2adc-5d1a-4718-8971-7d362e291602 (non-flash)
Aug 09 15:18:26 user nova-compute[72382]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)
Aug 09 15:18:26 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 15:18:26 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-8627fbb2-f07f-4595-a72c-5724ed106893 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.280s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 15:18:26 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-8627fbb2-f07f-4595-a72c-5724ed106893 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Connected to 172.16.0.220:3260 {{(pid=72382) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 15:18:26 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-8627fbb2-f07f-4595-a72c-5724ed106893 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] HCTL ('35', '-', '-', 0) found on session 13 with lun 0 {{(pid=72382) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 15:18:26 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-8627fbb2-f07f-4595-a72c-5724ed106893 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72382) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 15:18:26 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:18:26 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:18:26 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[044e2db4-b005-42c6-905e-c9a0d8adf2c8]: (4, ('- - 0', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:18:26 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-8627fbb2-f07f-4595-a72c-5724ed106893 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Searching for a device in session 13 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72382) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 15:18:26 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-8627fbb2-f07f-4595-a72c-5724ed106893 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QpOYqIyf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72382) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 15:18:27 user nova-compute[72382]: DEBUG nova.virt.libvirt.guest [None req-84cdb645-ea72-4c8c-9930-f6786758445c tempest-TestVolumeSwap-1225930191 tempest-TestVolumeSwap-1225930191-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=72382) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 09 15:18:27 user nova-compute[72382]: DEBUG nova.virt.libvirt.guest [None req-84cdb645-ea72-4c8c-9930-f6786758445c tempest-TestVolumeSwap-1225930191 tempest-TestVolumeSwap-1225930191-project-admin] COPY block job progress, current cursor: 124780544 final cursor: 1073741824 {{(pid=72382) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 09 15:18:27 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:18:27 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-8627fbb2-f07f-4595-a72c-5724ed106893 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.315s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 15:18:27 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-8627fbb2-f07f-4595-a72c-5724ed106893 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] <== connect_volume: return (1338ms) {'type': 'block', 'scsi_wwn': '26133633134313133', 'path': '/dev/sdd'} {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 15:18:27 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8627fbb2-f07f-4595-a72c-5724ed106893 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] [instance: 0f510d75-5d1e-4a5c-b38f-731c299f0f5a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26133633134313133', 'path': '/dev/sdd'} {{(pid=72382) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 15:18:28 user nova-compute[72382]: DEBUG nova.virt.libvirt.vif [None req-8627fbb2-f07f-4595-a72c-5724ed106893 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T15:18:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1329934953',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1329934953',id=14,image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='080d1ded4cd94e5083ee0b7e691b7363',ramdisk_id='',reservation_id='r-r90gykan',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1187177274',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T15:18:10Z,user_data=None,user_id='e71af7a4912147cd9fab070cb77b275c',uuid=0f510d75-5d1e-4a5c-b38f-731c299f0f5a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c67a8d45-c4ba-4302-940f-c05799ecc732", "address": "fa:16:3e:02:6d:5d", "network": {"id": "d47e3749-fdff-4112-bd72-69ca584efe1f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-302967634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "080d1ded4cd94e5083ee0b7e691b7363", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc67a8d45-c4", "ovs_interfaceid": "c67a8d45-c4ba-4302-940f-c05799ecc732", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72382) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 15:18:28 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-8627fbb2-f07f-4595-a72c-5724ed106893 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Converting VIF {"id": "c67a8d45-c4ba-4302-940f-c05799ecc732", "address": "fa:16:3e:02:6d:5d", "network": {"id": "d47e3749-fdff-4112-bd72-69ca584efe1f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-302967634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "080d1ded4cd94e5083ee0b7e691b7363", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc67a8d45-c4", "ovs_interfaceid": "c67a8d45-c4ba-4302-940f-c05799ecc732", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 15:18:28 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-8627fbb2-f07f-4595-a72c-5724ed106893 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:02:6d:5d,bridge_name='br-int',has_traffic_filtering=True,id=c67a8d45-c4ba-4302-940f-c05799ecc732,network=Network(d47e3749-fdff-4112-bd72-69ca584efe1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc67a8d45-c4') {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 15:18:28 user nova-compute[72382]: DEBUG nova.objects.instance [None req-8627fbb2-f07f-4595-a72c-5724ed106893 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Lazy-loading 'pci_devices' on Instance uuid 0f510d75-5d1e-4a5c-b38f-731c299f0f5a {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:18:28 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-8627fbb2-f07f-4595-a72c-5724ed106893 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] [instance: 0f510d75-5d1e-4a5c-b38f-731c299f0f5a] End _get_guest_xml xml=<domain type="kvm">
Aug 09 15:18:28 user nova-compute[72382]:   <uuid>0f510d75-5d1e-4a5c-b38f-731c299f0f5a</uuid>
Aug 09 15:18:28 user nova-compute[72382]:   <name>instance-0000000e</name>
Aug 09 15:18:28 user nova-compute[72382]:   <memory>524288</memory>
Aug 09 15:18:28 user nova-compute[72382]:   <vcpu>1</vcpu>
Aug 09 15:18:28 user nova-compute[72382]:   <metadata>
Aug 09 15:18:28 user nova-compute[72382]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 15:18:28 user nova-compute[72382]:       <nova:package version="0.0.0"/>
Aug 09 15:18:28 user nova-compute[72382]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1329934953</nova:name>
Aug 09 15:18:28 user nova-compute[72382]:       <nova:creationTime>2023-08-09 15:18:26</nova:creationTime>
Aug 09 15:18:28 user nova-compute[72382]:       <nova:flavor name="m1.tiny">
Aug 09 15:18:28 user nova-compute[72382]:         <nova:memory>512</nova:memory>
Aug 09 15:18:28 user nova-compute[72382]:         <nova:disk>1</nova:disk>
Aug 09 15:18:28 user nova-compute[72382]:         <nova:swap>0</nova:swap>
Aug 09 15:18:28 user nova-compute[72382]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 15:18:28 user nova-compute[72382]:         <nova:vcpus>1</nova:vcpus>
Aug 09 15:18:28 user nova-compute[72382]:       </nova:flavor>
Aug 09 15:18:28 user nova-compute[72382]:       <nova:owner>
Aug 09 15:18:28 user nova-compute[72382]:         <nova:user uuid="e71af7a4912147cd9fab070cb77b275c">tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member</nova:user>
Aug 09 15:18:28 user nova-compute[72382]:         <nova:project uuid="080d1ded4cd94e5083ee0b7e691b7363">tempest-ServerBootFromVolumeStableRescueTest-1187177274</nova:project>
Aug 09 15:18:28 user nova-compute[72382]:       </nova:owner>
Aug 09 15:18:28 user nova-compute[72382]:       <nova:root type="image" uuid="a79f2cea-eb27-4631-aaf3-05e7d9e411b4"/>
Aug 09 15:18:28 user nova-compute[72382]:       <nova:ports>
Aug 09 15:18:28 user nova-compute[72382]:         <nova:port uuid="c67a8d45-c4ba-4302-940f-c05799ecc732">
Aug 09 15:18:28 user nova-compute[72382]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 09 15:18:28 user nova-compute[72382]:         </nova:port>
Aug 09 15:18:28 user nova-compute[72382]:       </nova:ports>
Aug 09 15:18:28 user nova-compute[72382]:     </nova:instance>
Aug 09 15:18:28 user nova-compute[72382]:   </metadata>
Aug 09 15:18:28 user nova-compute[72382]:   <sysinfo type="smbios">
Aug 09 15:18:28 user nova-compute[72382]:     <system>
Aug 09 15:18:28 user nova-compute[72382]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 15:18:28 user nova-compute[72382]:       <entry name="product">OpenStack Nova</entry>
Aug 09 15:18:28 user nova-compute[72382]:       <entry name="version">0.0.0</entry>
Aug 09 15:18:28 user nova-compute[72382]:       <entry name="serial">0f510d75-5d1e-4a5c-b38f-731c299f0f5a</entry>
Aug 09 15:18:28 user nova-compute[72382]:       <entry name="uuid">0f510d75-5d1e-4a5c-b38f-731c299f0f5a</entry>
Aug 09 15:18:28 user nova-compute[72382]:       <entry name="family">Virtual Machine</entry>
Aug 09 15:18:28 user nova-compute[72382]:     </system>
Aug 09 15:18:28 user nova-compute[72382]:   </sysinfo>
Aug 09 15:18:28 user nova-compute[72382]:   <os>
Aug 09 15:18:28 user nova-compute[72382]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 15:18:28 user nova-compute[72382]:     <boot dev="hd"/>
Aug 09 15:18:28 user nova-compute[72382]:     <smbios mode="sysinfo"/>
Aug 09 15:18:28 user nova-compute[72382]:   </os>
Aug 09 15:18:28 user nova-compute[72382]:   <features>
Aug 09 15:18:28 user nova-compute[72382]:     <acpi/>
Aug 09 15:18:28 user nova-compute[72382]:     <apic/>
Aug 09 15:18:28 user nova-compute[72382]:     <vmcoreinfo/>
Aug 09 15:18:28 user nova-compute[72382]:   </features>
Aug 09 15:18:28 user nova-compute[72382]:   <clock offset="utc">
Aug 09 15:18:28 user nova-compute[72382]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 15:18:28 user nova-compute[72382]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 15:18:28 user nova-compute[72382]:     <timer name="hpet" present="no"/>
Aug 09 15:18:28 user nova-compute[72382]:   </clock>
Aug 09 15:18:28 user nova-compute[72382]:   <cpu mode="custom" match="exact">
Aug 09 15:18:28 user nova-compute[72382]:     <model>Nehalem</model>
Aug 09 15:18:28 user nova-compute[72382]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 15:18:28 user nova-compute[72382]:   </cpu>
Aug 09 15:18:28 user nova-compute[72382]:   <devices>
Aug 09 15:18:28 user nova-compute[72382]:     <disk type="block" device="disk">
Aug 09 15:18:28 user nova-compute[72382]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 15:18:28 user nova-compute[72382]:       <source dev="/dev/sdd"/>
Aug 09 15:18:28 user nova-compute[72382]:       <target dev="vda" bus="virtio"/>
Aug 09 15:18:28 user nova-compute[72382]:       <serial>05583e93-152e-49cd-8466-12d60f49c457</serial>
Aug 09 15:18:28 user nova-compute[72382]:     </disk>
Aug 09 15:18:28 user nova-compute[72382]:     <interface type="ethernet">
Aug 09 15:18:28 user nova-compute[72382]:       <mac address="fa:16:3e:02:6d:5d"/>
Aug 09 15:18:28 user nova-compute[72382]:       <model type="virtio"/>
Aug 09 15:18:28 user nova-compute[72382]:       <mtu size="1442"/>
Aug 09 15:18:28 user nova-compute[72382]:       <target dev="tapc67a8d45-c4"/>
Aug 09 15:18:28 user nova-compute[72382]:     </interface>
Aug 09 15:18:28 user nova-compute[72382]:     <serial type="pty">
Aug 09 15:18:28 user nova-compute[72382]:       <log file="/opt/stack/data/nova/instances/0f510d75-5d1e-4a5c-b38f-731c299f0f5a/console.log" append="off"/>
Aug 09 15:18:28 user nova-compute[72382]:     </serial>
Aug 09 15:18:28 user nova-compute[72382]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 15:18:28 user nova-compute[72382]:     <video>
Aug 09 15:18:28 user nova-compute[72382]:       <model type="virtio"/>
Aug 09 15:18:28 user nova-compute[72382]:     </video>
Aug 09 15:18:28 user nova-compute[72382]:     <rng model="virtio">
Aug 09 15:18:28 user nova-compute[72382]:       <backend model="random">/dev/urandom</backend>
Aug 09 15:18:28 user nova-compute[72382]:     </rng>
Aug 09 15:18:28 user nova-compute[72382]:     <controller type="usb" index="0" model="none"/>
Aug 09 15:18:28 user nova-compute[72382]:     <memballoon model="virtio">
Aug 09 15:18:28 user nova-compute[72382]:       <stats period="10"/>
Aug 09 15:18:28 user nova-compute[72382]:     </memballoon>
Aug 09 15:18:28 user nova-compute[72382]:   </devices>
Aug 09 15:18:28 user nova-compute[72382]: </domain>
Aug 09 15:18:28 user nova-compute[72382]:  {{(pid=72382) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 15:18:28 user nova-compute[72382]: DEBUG nova.virt.libvirt.vif [None req-8627fbb2-f07f-4595-a72c-5724ed106893 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T15:18:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1329934953',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1329934953',id=14,image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='080d1ded4cd94e5083ee0b7e691b7363',ramdisk_id='',reservation_id='r-r90gykan',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1187177274',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T15:18:10Z,user_data=None,user_id='e71af7a4912147cd9fab070cb77b275c',uuid=0f510d75-5d1e-4a5c-b38f-731c299f0f5a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c67a8d45-c4ba-4302-940f-c05799ecc732", "address": "fa:16:3e:02:6d:5d", "network": {"id": "d47e3749-fdff-4112-bd72-69ca584efe1f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-302967634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "080d1ded4cd94e5083ee0b7e691b7363", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc67a8d45-c4", "ovs_interfaceid": "c67a8d45-c4ba-4302-940f-c05799ecc732", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 15:18:28 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-8627fbb2-f07f-4595-a72c-5724ed106893 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Converting VIF {"id": "c67a8d45-c4ba-4302-940f-c05799ecc732", "address": "fa:16:3e:02:6d:5d", "network": {"id": "d47e3749-fdff-4112-bd72-69ca584efe1f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-302967634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "080d1ded4cd94e5083ee0b7e691b7363", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc67a8d45-c4", "ovs_interfaceid": "c67a8d45-c4ba-4302-940f-c05799ecc732", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 15:18:28 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-8627fbb2-f07f-4595-a72c-5724ed106893 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:02:6d:5d,bridge_name='br-int',has_traffic_filtering=True,id=c67a8d45-c4ba-4302-940f-c05799ecc732,network=Network(d47e3749-fdff-4112-bd72-69ca584efe1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc67a8d45-c4') {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 15:18:28 user nova-compute[72382]: DEBUG os_vif [None req-8627fbb2-f07f-4595-a72c-5724ed106893 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:02:6d:5d,bridge_name='br-int',has_traffic_filtering=True,id=c67a8d45-c4ba-4302-940f-c05799ecc732,network=Network(d47e3749-fdff-4112-bd72-69ca584efe1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc67a8d45-c4') {{(pid=72382) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 15:18:28 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:18:28 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:18:28 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 15:18:28 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:18:28 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc67a8d45-c4, may_exist=True, interface_attrs={}) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:18:28 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc67a8d45-c4, col_values=(('external_ids', {'iface-id': 'c67a8d45-c4ba-4302-940f-c05799ecc732', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:02:6d:5d', 'vm-uuid': '0f510d75-5d1e-4a5c-b38f-731c299f0f5a'}),), if_exists=True) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:18:28 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:18:28 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:18:28 user nova-compute[72382]: INFO os_vif [None req-8627fbb2-f07f-4595-a72c-5724ed106893 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:02:6d:5d,bridge_name='br-int',has_traffic_filtering=True,id=c67a8d45-c4ba-4302-940f-c05799ecc732,network=Network(d47e3749-fdff-4112-bd72-69ca584efe1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc67a8d45-c4')
Aug 09 15:18:28 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-8627fbb2-f07f-4595-a72c-5724ed106893 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] No BDM found with device name vda, not building metadata. {{(pid=72382) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 15:18:28 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-8627fbb2-f07f-4595-a72c-5724ed106893 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] No VIF found with MAC fa:16:3e:02:6d:5d, not building metadata {{(pid=72382) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 15:18:28 user nova-compute[72382]: DEBUG nova.virt.libvirt.guest [None req-84cdb645-ea72-4c8c-9930-f6786758445c tempest-TestVolumeSwap-1225930191 tempest-TestVolumeSwap-1225930191-project-admin] COPY block job progress, current cursor: 256901120 final cursor: 1073741824 {{(pid=72382) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 09 15:18:28 user nova-compute[72382]: DEBUG nova.virt.libvirt.guest [None req-84cdb645-ea72-4c8c-9930-f6786758445c tempest-TestVolumeSwap-1225930191 tempest-TestVolumeSwap-1225930191-project-admin] COPY block job progress, current cursor: 438304768 final cursor: 1073741824 {{(pid=72382) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 09 15:18:29 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-1514202a-5017-470c-ae35-962edbedfdce tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] Acquiring lock "b5aa7e23-9c2c-400e-a615-5839858749e1" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:18:29 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-1514202a-5017-470c-ae35-962edbedfdce tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] Lock "b5aa7e23-9c2c-400e-a615-5839858749e1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:18:29 user nova-compute[72382]: DEBUG nova.objects.instance [None req-1514202a-5017-470c-ae35-962edbedfdce tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] Lazy-loading 'flavor' on Instance uuid b5aa7e23-9c2c-400e-a615-5839858749e1 {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:18:29 user nova-compute[72382]: DEBUG nova.virt.libvirt.guest [None req-84cdb645-ea72-4c8c-9930-f6786758445c tempest-TestVolumeSwap-1225930191 tempest-TestVolumeSwap-1225930191-project-admin] COPY block job progress, current cursor: 520093696 final cursor: 1073741824 {{(pid=72382) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 09 15:18:29 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-1514202a-5017-470c-ae35-962edbedfdce tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] Lock "b5aa7e23-9c2c-400e-a615-5839858749e1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.275s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:18:29 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-1514202a-5017-470c-ae35-962edbedfdce tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] Acquiring lock "b5aa7e23-9c2c-400e-a615-5839858749e1" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:18:29 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-1514202a-5017-470c-ae35-962edbedfdce tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] Lock "b5aa7e23-9c2c-400e-a615-5839858749e1" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:18:29 user nova-compute[72382]: INFO nova.compute.manager [None req-1514202a-5017-470c-ae35-962edbedfdce tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] [instance: b5aa7e23-9c2c-400e-a615-5839858749e1] Attaching volume 4b091ba1-b5b0-4a67-af72-757195ad808a to /dev/vdc
Aug 09 15:18:29 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:18:29 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:18:29 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:18:29 user nova-compute[72382]: DEBUG os_brick.utils [None req-1514202a-5017-470c-ae35-962edbedfdce tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 15:18:29 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:18:29 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:18:29 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8360c1c-5a1a-46c4-9f40-b59912428e14]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d2cfa7015fe\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:18:29 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:18:29 user nova-compute[72382]: DEBUG nova.virt.libvirt.guest [None req-84cdb645-ea72-4c8c-9930-f6786758445c tempest-TestVolumeSwap-1225930191 tempest-TestVolumeSwap-1225930191-project-admin] COPY block job progress, current cursor: 651165696 final cursor: 1073741824 {{(pid=72382) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 09 15:18:29 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:18:29 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d704553-030e-4b0e-8da6-af0f08622d12]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:18:29 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:18:29 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.025s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:18:29 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7fd7600-9ac8-4170-9e95-008b7c09e95b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:18:29 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cc3d280-1fcb-4e82-8195-f420d6435ee4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:18:29 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-1514202a-5017-470c-ae35-962edbedfdce tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] Running cmd (subprocess): nvme version {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:18:29 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-1514202a-5017-470c-ae35-962edbedfdce tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] 'nvme version' failed. Not Retrying. {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 15:18:29 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1514202a-5017-470c-ae35-962edbedfdce tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] nvme not present on system {{(pid=72382) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 15:18:29 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:18:29 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 15:18:29 user nova-compute[72382]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 15:18:29 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e84768a-2b50-427c-89cb-3dba8dabcc89]: (4, '') {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:18:29 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.lightos [None req-1514202a-5017-470c-ae35-962edbedfdce tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72382) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 15:18:29 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.lightos [None req-1514202a-5017-470c-ae35-962edbedfdce tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72382) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 15:18:29 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.lightos [None req-1514202a-5017-470c-ae35-962edbedfdce tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] LIGHTOS: no hostnqn found. {{(pid=72382) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 15:18:29 user nova-compute[72382]: DEBUG os_brick.utils [None req-1514202a-5017-470c-ae35-962edbedfdce tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] <== get_connector_properties: return (156ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d2cfa7015fe', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 15:18:29 user nova-compute[72382]: DEBUG nova.virt.block_device [None req-1514202a-5017-470c-ae35-962edbedfdce tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] [instance: b5aa7e23-9c2c-400e-a615-5839858749e1] Updating existing volume attachment record: f75045d2-7076-4aa1-8f17-2ce80cd90244 {{(pid=72382) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 15:18:29 user nova-compute[72382]: DEBUG nova.compute.manager [req-ac61fa1d-29b9-4814-9d42-9c223ce355bd req-e18762b8-9610-44d0-82b0-f7e84efa8bd5 service nova] [instance: 0f510d75-5d1e-4a5c-b38f-731c299f0f5a] Received event network-vif-plugged-c67a8d45-c4ba-4302-940f-c05799ecc732 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:18:29 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-ac61fa1d-29b9-4814-9d42-9c223ce355bd req-e18762b8-9610-44d0-82b0-f7e84efa8bd5 service nova] Acquiring lock "0f510d75-5d1e-4a5c-b38f-731c299f0f5a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:18:29 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-ac61fa1d-29b9-4814-9d42-9c223ce355bd req-e18762b8-9610-44d0-82b0-f7e84efa8bd5 service nova] Lock "0f510d75-5d1e-4a5c-b38f-731c299f0f5a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:18:29 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-ac61fa1d-29b9-4814-9d42-9c223ce355bd req-e18762b8-9610-44d0-82b0-f7e84efa8bd5 service nova] Lock "0f510d75-5d1e-4a5c-b38f-731c299f0f5a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:18:29 user nova-compute[72382]: DEBUG nova.compute.manager [req-ac61fa1d-29b9-4814-9d42-9c223ce355bd req-e18762b8-9610-44d0-82b0-f7e84efa8bd5 service nova] [instance: 0f510d75-5d1e-4a5c-b38f-731c299f0f5a] No waiting events found dispatching network-vif-plugged-c67a8d45-c4ba-4302-940f-c05799ecc732 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:18:29 user nova-compute[72382]: WARNING nova.compute.manager [req-ac61fa1d-29b9-4814-9d42-9c223ce355bd req-e18762b8-9610-44d0-82b0-f7e84efa8bd5 service nova] [instance: 0f510d75-5d1e-4a5c-b38f-731c299f0f5a] Received unexpected event network-vif-plugged-c67a8d45-c4ba-4302-940f-c05799ecc732 for instance with vm_state building and task_state spawning.
Aug 09 15:18:30 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:18:30 user nova-compute[72382]: DEBUG nova.virt.libvirt.guest [None req-84cdb645-ea72-4c8c-9930-f6786758445c tempest-TestVolumeSwap-1225930191 tempest-TestVolumeSwap-1225930191-project-admin] COPY block job progress, current cursor: 752877568 final cursor: 1073741824 {{(pid=72382) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 09 15:18:30 user nova-compute[72382]: DEBUG nova.virt.libvirt.guest [None req-84cdb645-ea72-4c8c-9930-f6786758445c tempest-TestVolumeSwap-1225930191 tempest-TestVolumeSwap-1225930191-project-admin] COPY block job progress, current cursor: 916455424 final cursor: 1073741824 {{(pid=72382) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 09 15:18:31 user nova-compute[72382]: DEBUG nova.virt.libvirt.guest [None req-84cdb645-ea72-4c8c-9930-f6786758445c tempest-TestVolumeSwap-1225930191 tempest-TestVolumeSwap-1225930191-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=72382) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 09 15:18:31 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-84cdb645-ea72-4c8c-9930-f6786758445c tempest-TestVolumeSwap-1225930191 tempest-TestVolumeSwap-1225930191-project-admin] [instance: 9a82f146-97ce-4319-8b25-c1b090965e53] calling os-brick to detach iSCSI Volume {{(pid=72382) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 15:18:31 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-84cdb645-ea72-4c8c-9930-f6786758445c tempest-TestVolumeSwap-1225930191 tempest-TestVolumeSwap-1225930191-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2a0c768340>, {'target_iqns': ['iqn.2010-10.org.openstack:344efe6d-5a52-4d0d-a34e-da8627a1e09f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qiuZemSC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf', 'volume_id': '344efe6d-5a52-4d0d-a34e-da8627a1e09f'}, None), 'kwargs': False}}" {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 15:18:31 user nova-compute[72382]: WARNING os_brick.initiator.connectors.base [None req-84cdb645-ea72-4c8c-9930-f6786758445c tempest-TestVolumeSwap-1225930191 tempest-TestVolumeSwap-1225930191-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 15:18:31 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-84cdb645-ea72-4c8c-9930-f6786758445c tempest-TestVolumeSwap-1225930191 tempest-TestVolumeSwap-1225930191-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 15:18:31 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-84cdb645-ea72-4c8c-9930-f6786758445c tempest-TestVolumeSwap-1225930191 tempest-TestVolumeSwap-1225930191-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 15:18:31 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-84cdb645-ea72-4c8c-9930-f6786758445c tempest-TestVolumeSwap-1225930191 tempest-TestVolumeSwap-1225930191-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:344efe6d-5a52-4d0d-a34e-da8627a1e09f', 0)] {{(pid=72382) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 15:18:31 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:18:31 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:18:31 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8d126a2-67e9-46aa-940b-1e9d78b3514a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:344efe6d-5a52-4d0d-a34e-da8627a1e09f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9c2a0938-fb5c-434c-91ba-15e8823c1348\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ad1e2adc-5d1a-4718-8971-7d362e291602\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:18:31 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:18:31 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:18:31 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2baa3c6-b01d-4ef6-8cda-3b4007f40c32]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:344efe6d-5a52-4d0d-a34e-da8627a1e09f (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c2a0938-fb5c-434c-91ba-15e8823c1348 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad1e2adc-5d1a-4718-8971-7d362e291602 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:18:31 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-84cdb645-ea72-4c8c-9930-f6786758445c tempest-TestVolumeSwap-1225930191 tempest-TestVolumeSwap-1225930191-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:344efe6d-5a52-4d0d-a34e-da8627a1e09f (non-flash)
Aug 09 15:18:31 user nova-compute[72382]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c2a0938-fb5c-434c-91ba-15e8823c1348 (non-flash)
Aug 09 15:18:31 user nova-compute[72382]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad1e2adc-5d1a-4718-8971-7d362e291602 (non-flash)
Aug 09 15:18:31 user nova-compute[72382]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)
Aug 09 15:18:31 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 15:18:31 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-84cdb645-ea72-4c8c-9930-f6786758445c tempest-TestVolumeSwap-1225930191 tempest-TestVolumeSwap-1225930191-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:344efe6d-5a52-4d0d-a34e-da8627a1e09f (non-flash)
Aug 09 15:18:31 user nova-compute[72382]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c2a0938-fb5c-434c-91ba-15e8823c1348 (non-flash)
Aug 09 15:18:31 user nova-compute[72382]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad1e2adc-5d1a-4718-8971-7d362e291602 (non-flash)
Aug 09 15:18:31 user nova-compute[72382]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)
Aug 09 15:18:31 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 15:18:31 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-84cdb645-ea72-4c8c-9930-f6786758445c tempest-TestVolumeSwap-1225930191 tempest-TestVolumeSwap-1225930191-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2a0c34acb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:344efe6d-5a52-4d0d-a34e-da8627a1e09f'): ({'sdf'}, set())}) {{(pid=72382) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 15:18:31 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-84cdb645-ea72-4c8c-9930-f6786758445c tempest-TestVolumeSwap-1225930191 tempest-TestVolumeSwap-1225930191-project-admin] Removing single pathed devices sdf {{(pid=72382) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 15:18:31 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:18:31 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:18:31 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3c50a47-2732-48f0-a3de-10140f6e83e0]: (4, ('path checker states:\nup                  3\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:18:31 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:18:31 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.023s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:18:31 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2b61e42-8da6-4f18-875d-5862f0202adc]: (4, ('ok\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:18:31 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-84cdb645-ea72-4c8c-9930-f6786758445c tempest-TestVolumeSwap-1225930191 tempest-TestVolumeSwap-1225930191-project-admin] Flushing IO for device /dev/sdf {{(pid=72382) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 15:18:31 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:18:31 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.016s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:18:31 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[95dfe0aa-ea8e-41d7-b091-89297c4e4a1a]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:18:31 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-84cdb645-ea72-4c8c-9930-f6786758445c tempest-TestVolumeSwap-1225930191 tempest-TestVolumeSwap-1225930191-project-admin] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=72382) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 15:18:31 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:18:31 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.043s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:18:31 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[0159f31f-bf5a-49e1-93a2-2928521d1078]: (4, ('1', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:18:31 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-84cdb645-ea72-4c8c-9930-f6786758445c tempest-TestVolumeSwap-1225930191 tempest-TestVolumeSwap-1225930191-project-admin] Checking to see if SCSI volumes sdf have been removed. {{(pid=72382) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 15:18:31 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-84cdb645-ea72-4c8c-9930-f6786758445c tempest-TestVolumeSwap-1225930191 tempest-TestVolumeSwap-1225930191-project-admin] SCSI volumes sdf have been removed. {{(pid=72382) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 15:18:31 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-84cdb645-ea72-4c8c-9930-f6786758445c tempest-TestVolumeSwap-1225930191 tempest-TestVolumeSwap-1225930191-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:344efe6d-5a52-4d0d-a34e-da8627a1e09f')] {{(pid=72382) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 15:18:31 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:344efe6d-5a52-4d0d-a34e-da8627a1e09f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:18:31 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:344efe6d-5a52-4d0d-a34e-da8627a1e09f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:18:31 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[00e7b16e-5b0b-4847-ac7c-4b847ba2b98d]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:18:31 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-84cdb645-ea72-4c8c-9930-f6786758445c tempest-TestVolumeSwap-1225930191 tempest-TestVolumeSwap-1225930191-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:18:31 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:344efe6d-5a52-4d0d-a34e-da8627a1e09f -p 172.16.0.220:3260 --logout {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:18:31 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:344efe6d-5a52-4d0d-a34e-da8627a1e09f -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:18:31 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[71167aaa-c773-4695-a9ca-db06a1ef04af]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:344efe6d-5a52-4d0d-a34e-da8627a1e09f, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:344efe6d-5a52-4d0d-a34e-da8627a1e09f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:18:31 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-84cdb645-ea72-4c8c-9930-f6786758445c tempest-TestVolumeSwap-1225930191 tempest-TestVolumeSwap-1225930191-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:344efe6d-5a52-4d0d-a34e-da8627a1e09f, portal: 172.16.0.220,3260]
Aug 09 15:18:31 user nova-compute[72382]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:344efe6d-5a52-4d0d-a34e-da8627a1e09f, portal: 172.16.0.220,3260] successful.
Aug 09 15:18:31 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:18:31 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:344efe6d-5a52-4d0d-a34e-da8627a1e09f -p 172.16.0.220:3260 --op delete {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:18:31 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:344efe6d-5a52-4d0d-a34e-da8627a1e09f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:18:31 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb737777-2f48-4396-bf0e-552fd4d0e99c]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:18:31 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-84cdb645-ea72-4c8c-9930-f6786758445c tempest-TestVolumeSwap-1225930191 tempest-TestVolumeSwap-1225930191-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:18:31 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-84cdb645-ea72-4c8c-9930-f6786758445c tempest-TestVolumeSwap-1225930191 tempest-TestVolumeSwap-1225930191-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.321s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 15:18:31 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-84cdb645-ea72-4c8c-9930-f6786758445c tempest-TestVolumeSwap-1225930191 tempest-TestVolumeSwap-1225930191-project-admin] <== disconnect_volume: return (323ms) None {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 15:18:31 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-84cdb645-ea72-4c8c-9930-f6786758445c tempest-TestVolumeSwap-1225930191 tempest-TestVolumeSwap-1225930191-project-admin] [instance: 9a82f146-97ce-4319-8b25-c1b090965e53] Disconnected iSCSI Volume {{(pid=72382) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 15:18:31 user nova-compute[72382]: DEBUG nova.compute.manager [None req-84cdb645-ea72-4c8c-9930-f6786758445c tempest-TestVolumeSwap-1225930191 tempest-TestVolumeSwap-1225930191-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:ad1e2adc-5d1a-4718-8971-7d362e291602'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'avodyQXL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': '9a82f146-97ce-4319-8b25-c1b090965e53', 'attached_at': '', 'detached_at': '', 'volume_id': 'ad1e2adc-5d1a-4718-8971-7d362e291602', 'serial'} {{(pid=72382) _swap_volume /opt/stack/nova/nova/compute/manager.py:7711}}
Aug 09 15:18:31 user nova-compute[72382]: DEBUG nova.compute.manager [None req-84cdb645-ea72-4c8c-9930-f6786758445c tempest-TestVolumeSwap-1225930191 tempest-TestVolumeSwap-1225930191-project-admin] [instance: 9a82f146-97ce-4319-8b25-c1b090965e53] swap_volume: removing Cinder connection for volume 344efe6d-5a52-4d0d-a34e-da8627a1e09f {{(pid=72382) _swap_volume /opt/stack/nova/nova/compute/manager.py:7756}}
Aug 09 15:18:32 user nova-compute[72382]: DEBUG nova.compute.manager [req-df8c4522-837d-47ca-9600-b7d8fcb0bef4 req-3e960dd2-ed09-4983-bcbf-e55c13ad0400 service nova] [instance: 0f510d75-5d1e-4a5c-b38f-731c299f0f5a] Received event network-vif-plugged-c67a8d45-c4ba-4302-940f-c05799ecc732 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:18:32 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-df8c4522-837d-47ca-9600-b7d8fcb0bef4 req-3e960dd2-ed09-4983-bcbf-e55c13ad0400 service nova] Acquiring lock "0f510d75-5d1e-4a5c-b38f-731c299f0f5a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:18:32 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-df8c4522-837d-47ca-9600-b7d8fcb0bef4 req-3e960dd2-ed09-4983-bcbf-e55c13ad0400 service nova] Lock "0f510d75-5d1e-4a5c-b38f-731c299f0f5a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:18:32 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-df8c4522-837d-47ca-9600-b7d8fcb0bef4 req-3e960dd2-ed09-4983-bcbf-e55c13ad0400 service nova] Lock "0f510d75-5d1e-4a5c-b38f-731c299f0f5a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:18:32 user nova-compute[72382]: DEBUG nova.compute.manager [req-df8c4522-837d-47ca-9600-b7d8fcb0bef4 req-3e960dd2-ed09-4983-bcbf-e55c13ad0400 service nova] [instance: 0f510d75-5d1e-4a5c-b38f-731c299f0f5a] No waiting events found dispatching network-vif-plugged-c67a8d45-c4ba-4302-940f-c05799ecc732 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:18:32 user nova-compute[72382]: WARNING nova.compute.manager [req-df8c4522-837d-47ca-9600-b7d8fcb0bef4 req-3e960dd2-ed09-4983-bcbf-e55c13ad0400 service nova] [instance: 0f510d75-5d1e-4a5c-b38f-731c299f0f5a] Received unexpected event network-vif-plugged-c67a8d45-c4ba-4302-940f-c05799ecc732 for instance with vm_state building and task_state spawning.
Aug 09 15:18:32 user nova-compute[72382]: DEBUG nova.virt.driver [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Emitting event <LifecycleEvent: 1691594312.1614015, 0f510d75-5d1e-4a5c-b38f-731c299f0f5a => Resumed> {{(pid=72382) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 15:18:32 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 0f510d75-5d1e-4a5c-b38f-731c299f0f5a] VM Resumed (Lifecycle Event)
Aug 09 15:18:32 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8627fbb2-f07f-4595-a72c-5724ed106893 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] [instance: 0f510d75-5d1e-4a5c-b38f-731c299f0f5a] Instance event wait completed in 0 seconds for  {{(pid=72382) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 15:18:32 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-8627fbb2-f07f-4595-a72c-5724ed106893 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] [instance: 0f510d75-5d1e-4a5c-b38f-731c299f0f5a] Guest created on hypervisor {{(pid=72382) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 15:18:32 user nova-compute[72382]: INFO nova.virt.libvirt.driver [-] [instance: 0f510d75-5d1e-4a5c-b38f-731c299f0f5a] Instance spawned successfully.
Aug 09 15:18:32 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-8627fbb2-f07f-4595-a72c-5724ed106893 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] [instance: 0f510d75-5d1e-4a5c-b38f-731c299f0f5a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 15:18:32 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 0f510d75-5d1e-4a5c-b38f-731c299f0f5a] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:18:32 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 0f510d75-5d1e-4a5c-b38f-731c299f0f5a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72382) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 15:18:32 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-8627fbb2-f07f-4595-a72c-5724ed106893 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] [instance: 0f510d75-5d1e-4a5c-b38f-731c299f0f5a] Found default for hw_cdrom_bus of ide {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:18:32 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-8627fbb2-f07f-4595-a72c-5724ed106893 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] [instance: 0f510d75-5d1e-4a5c-b38f-731c299f0f5a] Found default for hw_disk_bus of virtio {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:18:32 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-8627fbb2-f07f-4595-a72c-5724ed106893 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] [instance: 0f510d75-5d1e-4a5c-b38f-731c299f0f5a] Found default for hw_input_bus of None {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:18:32 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-8627fbb2-f07f-4595-a72c-5724ed106893 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] [instance: 0f510d75-5d1e-4a5c-b38f-731c299f0f5a] Found default for hw_pointer_model of None {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:18:32 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-8627fbb2-f07f-4595-a72c-5724ed106893 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] [instance: 0f510d75-5d1e-4a5c-b38f-731c299f0f5a] Found default for hw_video_model of virtio {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:18:32 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-8627fbb2-f07f-4595-a72c-5724ed106893 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] [instance: 0f510d75-5d1e-4a5c-b38f-731c299f0f5a] Found default for hw_vif_model of virtio {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:18:32 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 0f510d75-5d1e-4a5c-b38f-731c299f0f5a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 15:18:32 user nova-compute[72382]: DEBUG nova.virt.driver [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Emitting event <LifecycleEvent: 1691594312.1630275, 0f510d75-5d1e-4a5c-b38f-731c299f0f5a => Started> {{(pid=72382) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 15:18:32 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 0f510d75-5d1e-4a5c-b38f-731c299f0f5a] VM Started (Lifecycle Event)
Aug 09 15:18:32 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 0f510d75-5d1e-4a5c-b38f-731c299f0f5a] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:18:32 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 0f510d75-5d1e-4a5c-b38f-731c299f0f5a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72382) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 15:18:32 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 0f510d75-5d1e-4a5c-b38f-731c299f0f5a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 15:18:32 user nova-compute[72382]: INFO nova.compute.manager [None req-8627fbb2-f07f-4595-a72c-5724ed106893 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] [instance: 0f510d75-5d1e-4a5c-b38f-731c299f0f5a] Took 5.71 seconds to spawn the instance on the hypervisor.
Aug 09 15:18:32 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8627fbb2-f07f-4595-a72c-5724ed106893 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] [instance: 0f510d75-5d1e-4a5c-b38f-731c299f0f5a] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:18:32 user nova-compute[72382]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691594297.3608558, f1b4f73b-7a9e-4cf1-9d51-f32284f49c53 => Stopped> {{(pid=72382) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 15:18:32 user nova-compute[72382]: INFO nova.compute.manager [-] [instance: f1b4f73b-7a9e-4cf1-9d51-f32284f49c53] VM Stopped (Lifecycle Event)
Aug 09 15:18:32 user nova-compute[72382]: DEBUG nova.compute.manager [None req-6e94d5a4-1a6c-4b12-930f-b07af120a08a None None] [instance: f1b4f73b-7a9e-4cf1-9d51-f32284f49c53] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:18:32 user nova-compute[72382]: INFO nova.compute.manager [None req-8627fbb2-f07f-4595-a72c-5724ed106893 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] [instance: 0f510d75-5d1e-4a5c-b38f-731c299f0f5a] Took 23.78 seconds to build instance.
Aug 09 15:18:32 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-8627fbb2-f07f-4595-a72c-5724ed106893 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Lock "0f510d75-5d1e-4a5c-b38f-731c299f0f5a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 23.893s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:18:32 user nova-compute[72382]: DEBUG nova.compute.manager [None req-84cdb645-ea72-4c8c-9930-f6786758445c tempest-TestVolumeSwap-1225930191 tempest-TestVolumeSwap-1225930191-project-admin] [instance: 9a82f146-97ce-4319-8b25-c1b090965e53] swap_volume: Updating volume 344efe6d-5a52-4d0d-a34e-da8627a1e09f BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqns": ["iqn.2010-10.org.openstack:ad1e2adc-5d1a-4718-8971-7d362e291602"], "target_portals": ["172.16.0.220:3260"], "target_luns": [0], "target_discovered": false, "auth_method": "CHAP", "auth_username": "avodyQXL", "auth_password": "FJrSY7qCGtDsUz", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdc", "volume_id": "ad1e2adc-5d1a-4718-8971-7d362e291602"}, "status": "reserved", "instance": "9a82f146-97ce-4319-8b25-c1b090965e53", "attached_at": "", "detached_at": "", "volume_id": "ad1e2adc-5d1a-4718-8971-7d362e291602", "serial": "ad1e2adc-5d1a-4718-8971-7d362e291602"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': 'ad1e2adc-5d1a-4718-8971-7d362e291602', 'no_device': None, 'attachment_id': '258e25e4-5bfd-431c-b1b0-97513ea2195f'} {{(pid=72382) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7904}}
Aug 09 15:18:32 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-84cdb645-ea72-4c8c-9930-f6786758445c tempest-TestVolumeSwap-1225930191 tempest-TestVolumeSwap-1225930191-project-admin] Lock "9a82f146-97ce-4319-8b25-c1b090965e53" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 17.703s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:18:33 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:18:33 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-23bc2f5a-4902-4af9-bafc-5c29067d5965 tempest-TestVolumeSwap-583684665 tempest-TestVolumeSwap-583684665-project-member] Acquiring lock "9a82f146-97ce-4319-8b25-c1b090965e53" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:18:33 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-23bc2f5a-4902-4af9-bafc-5c29067d5965 tempest-TestVolumeSwap-583684665 tempest-TestVolumeSwap-583684665-project-member] Lock "9a82f146-97ce-4319-8b25-c1b090965e53" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:18:33 user nova-compute[72382]: INFO nova.compute.manager [None req-23bc2f5a-4902-4af9-bafc-5c29067d5965 tempest-TestVolumeSwap-583684665 tempest-TestVolumeSwap-583684665-project-member] [instance: 9a82f146-97ce-4319-8b25-c1b090965e53] Detaching volume ad1e2adc-5d1a-4718-8971-7d362e291602
Aug 09 15:18:33 user nova-compute[72382]: INFO nova.virt.block_device [None req-23bc2f5a-4902-4af9-bafc-5c29067d5965 tempest-TestVolumeSwap-583684665 tempest-TestVolumeSwap-583684665-project-member] [instance: 9a82f146-97ce-4319-8b25-c1b090965e53] Attempting to driver detach volume ad1e2adc-5d1a-4718-8971-7d362e291602 from mountpoint /dev/vdb
Aug 09 15:18:33 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-23bc2f5a-4902-4af9-bafc-5c29067d5965 tempest-TestVolumeSwap-583684665 tempest-TestVolumeSwap-583684665-project-member] Attempting to detach device vdb from instance 9a82f146-97ce-4319-8b25-c1b090965e53 from the persistent domain config. {{(pid=72382) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 15:18:33 user nova-compute[72382]: DEBUG nova.virt.libvirt.guest [None req-23bc2f5a-4902-4af9-bafc-5c29067d5965 tempest-TestVolumeSwap-583684665 tempest-TestVolumeSwap-583684665-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 15:18:33 user nova-compute[72382]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 15:18:33 user nova-compute[72382]:   <source dev="/dev/sdc"/>
Aug 09 15:18:33 user nova-compute[72382]:   <target dev="vdb" bus="virtio"/>
Aug 09 15:18:33 user nova-compute[72382]:   <serial>ad1e2adc-5d1a-4718-8971-7d362e291602</serial>
Aug 09 15:18:33 user nova-compute[72382]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 15:18:33 user nova-compute[72382]: </disk>
Aug 09 15:18:33 user nova-compute[72382]:  {{(pid=72382) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 15:18:33 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-23bc2f5a-4902-4af9-bafc-5c29067d5965 tempest-TestVolumeSwap-583684665 tempest-TestVolumeSwap-583684665-project-member] Successfully detached device vdb from instance 9a82f146-97ce-4319-8b25-c1b090965e53 from the persistent domain config.
Aug 09 15:18:33 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-23bc2f5a-4902-4af9-bafc-5c29067d5965 tempest-TestVolumeSwap-583684665 tempest-TestVolumeSwap-583684665-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 9a82f146-97ce-4319-8b25-c1b090965e53 from the live domain config. {{(pid=72382) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 15:18:33 user nova-compute[72382]: DEBUG nova.virt.libvirt.guest [None req-23bc2f5a-4902-4af9-bafc-5c29067d5965 tempest-TestVolumeSwap-583684665 tempest-TestVolumeSwap-583684665-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 15:18:33 user nova-compute[72382]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 15:18:33 user nova-compute[72382]:   <source dev="/dev/sdc"/>
Aug 09 15:18:33 user nova-compute[72382]:   <target dev="vdb" bus="virtio"/>
Aug 09 15:18:33 user nova-compute[72382]:   <serial>ad1e2adc-5d1a-4718-8971-7d362e291602</serial>
Aug 09 15:18:33 user nova-compute[72382]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 15:18:33 user nova-compute[72382]: </disk>
Aug 09 15:18:33 user nova-compute[72382]:  {{(pid=72382) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 15:18:33 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:18:34 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Received event <DeviceRemovedEvent: 1691594314.1231308, 9a82f146-97ce-4319-8b25-c1b090965e53 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72382) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 15:18:34 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-23bc2f5a-4902-4af9-bafc-5c29067d5965 tempest-TestVolumeSwap-583684665 tempest-TestVolumeSwap-583684665-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 9a82f146-97ce-4319-8b25-c1b090965e53 {{(pid=72382) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 15:18:34 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-23bc2f5a-4902-4af9-bafc-5c29067d5965 tempest-TestVolumeSwap-583684665 tempest-TestVolumeSwap-583684665-project-member] Successfully detached device vdb from instance 9a82f146-97ce-4319-8b25-c1b090965e53 from the live domain config.
Aug 09 15:18:34 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-23bc2f5a-4902-4af9-bafc-5c29067d5965 tempest-TestVolumeSwap-583684665 tempest-TestVolumeSwap-583684665-project-member] [instance: 9a82f146-97ce-4319-8b25-c1b090965e53] calling os-brick to detach iSCSI Volume {{(pid=72382) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 15:18:34 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-23bc2f5a-4902-4af9-bafc-5c29067d5965 tempest-TestVolumeSwap-583684665 tempest-TestVolumeSwap-583684665-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2a0c768340>, {'target_iqns': ['iqn.2010-10.org.openstack:ad1e2adc-5d1a-4718-8971-7d362e291602'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'avodyQXL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc', 'volume_id': 'ad1e2adc-5d1a-4718-8971-7d362e291602'}, None), 'kwargs': False}}" {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 15:18:34 user nova-compute[72382]: WARNING os_brick.initiator.connectors.base [None req-23bc2f5a-4902-4af9-bafc-5c29067d5965 tempest-TestVolumeSwap-583684665 tempest-TestVolumeSwap-583684665-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 15:18:34 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-23bc2f5a-4902-4af9-bafc-5c29067d5965 tempest-TestVolumeSwap-583684665 tempest-TestVolumeSwap-583684665-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 15:18:34 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-23bc2f5a-4902-4af9-bafc-5c29067d5965 tempest-TestVolumeSwap-583684665 tempest-TestVolumeSwap-583684665-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 15:18:34 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-23bc2f5a-4902-4af9-bafc-5c29067d5965 tempest-TestVolumeSwap-583684665 tempest-TestVolumeSwap-583684665-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ad1e2adc-5d1a-4718-8971-7d362e291602', 0)] {{(pid=72382) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 15:18:34 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:18:34 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:18:34 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ef02409-390d-4c50-a10b-f2b41135267a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9c2a0938-fb5c-434c-91ba-15e8823c1348\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ad1e2adc-5d1a-4718-8971-7d362e291602\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:18:34 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:18:34 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:18:34 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[443d4fa2-dfae-43b4-92b1-16a6a81d7858]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c2a0938-fb5c-434c-91ba-15e8823c1348 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad1e2adc-5d1a-4718-8971-7d362e291602 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:18:34 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-23bc2f5a-4902-4af9-bafc-5c29067d5965 tempest-TestVolumeSwap-583684665 tempest-TestVolumeSwap-583684665-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c2a0938-fb5c-434c-91ba-15e8823c1348 (non-flash)
Aug 09 15:18:34 user nova-compute[72382]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad1e2adc-5d1a-4718-8971-7d362e291602 (non-flash)
Aug 09 15:18:34 user nova-compute[72382]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)
Aug 09 15:18:34 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 15:18:34 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-23bc2f5a-4902-4af9-bafc-5c29067d5965 tempest-TestVolumeSwap-583684665 tempest-TestVolumeSwap-583684665-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c2a0938-fb5c-434c-91ba-15e8823c1348 (non-flash)
Aug 09 15:18:34 user nova-compute[72382]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad1e2adc-5d1a-4718-8971-7d362e291602 (non-flash)
Aug 09 15:18:34 user nova-compute[72382]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)
Aug 09 15:18:34 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 15:18:34 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-23bc2f5a-4902-4af9-bafc-5c29067d5965 tempest-TestVolumeSwap-583684665 tempest-TestVolumeSwap-583684665-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2a0c33e7a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ad1e2adc-5d1a-4718-8971-7d362e291602'): ({'sdc'}, set())}) {{(pid=72382) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 15:18:34 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-23bc2f5a-4902-4af9-bafc-5c29067d5965 tempest-TestVolumeSwap-583684665 tempest-TestVolumeSwap-583684665-project-member] Removing single pathed devices sdc {{(pid=72382) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 15:18:34 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:18:34 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:18:34 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[68d957ad-188d-499d-871a-9098997b68ef]: (4, ('path checker states:\nup                  2\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:18:34 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:18:34 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:18:34 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[80874bc5-f5db-4243-8094-c377615bc20d]: (4, ('ok\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:18:34 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-23bc2f5a-4902-4af9-bafc-5c29067d5965 tempest-TestVolumeSwap-583684665 tempest-TestVolumeSwap-583684665-project-member] Flushing IO for device /dev/sdc {{(pid=72382) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 15:18:34 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:18:34 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:18:34 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[a78c5674-74f3-4e9f-bf88-40f0fc70f111]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:18:34 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-23bc2f5a-4902-4af9-bafc-5c29067d5965 tempest-TestVolumeSwap-583684665 tempest-TestVolumeSwap-583684665-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72382) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 15:18:34 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:18:34 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.043s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:18:34 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[60d98223-e780-4a93-a700-1efa0e7d1cd7]: (4, ('1', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:18:34 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-23bc2f5a-4902-4af9-bafc-5c29067d5965 tempest-TestVolumeSwap-583684665 tempest-TestVolumeSwap-583684665-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72382) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 15:18:34 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-23bc2f5a-4902-4af9-bafc-5c29067d5965 tempest-TestVolumeSwap-583684665 tempest-TestVolumeSwap-583684665-project-member] SCSI volumes sdc have been removed. {{(pid=72382) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 15:18:34 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-23bc2f5a-4902-4af9-bafc-5c29067d5965 tempest-TestVolumeSwap-583684665 tempest-TestVolumeSwap-583684665-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ad1e2adc-5d1a-4718-8971-7d362e291602')] {{(pid=72382) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 15:18:34 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad1e2adc-5d1a-4718-8971-7d362e291602 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:18:34 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad1e2adc-5d1a-4718-8971-7d362e291602 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:18:34 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dd69da6-0895-46b8-93cc-6ec7861d73a3]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:18:34 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-23bc2f5a-4902-4af9-bafc-5c29067d5965 tempest-TestVolumeSwap-583684665 tempest-TestVolumeSwap-583684665-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:18:34 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad1e2adc-5d1a-4718-8971-7d362e291602 -p 172.16.0.220:3260 --logout {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:18:34 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad1e2adc-5d1a-4718-8971-7d362e291602 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:18:34 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1340b30-3feb-49ea-b1dd-329286713dee]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:ad1e2adc-5d1a-4718-8971-7d362e291602, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:ad1e2adc-5d1a-4718-8971-7d362e291602, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:18:34 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-23bc2f5a-4902-4af9-bafc-5c29067d5965 tempest-TestVolumeSwap-583684665 tempest-TestVolumeSwap-583684665-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:ad1e2adc-5d1a-4718-8971-7d362e291602, portal: 172.16.0.220,3260]
Aug 09 15:18:34 user nova-compute[72382]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:ad1e2adc-5d1a-4718-8971-7d362e291602, portal: 172.16.0.220,3260] successful.
Aug 09 15:18:34 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:18:34 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad1e2adc-5d1a-4718-8971-7d362e291602 -p 172.16.0.220:3260 --op delete {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:18:34 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad1e2adc-5d1a-4718-8971-7d362e291602 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:18:34 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ef903f1-7151-48a1-8c2e-3c63d3b0dd10]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:18:34 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-23bc2f5a-4902-4af9-bafc-5c29067d5965 tempest-TestVolumeSwap-583684665 tempest-TestVolumeSwap-583684665-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:18:34 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-23bc2f5a-4902-4af9-bafc-5c29067d5965 tempest-TestVolumeSwap-583684665 tempest-TestVolumeSwap-583684665-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.279s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 15:18:34 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-23bc2f5a-4902-4af9-bafc-5c29067d5965 tempest-TestVolumeSwap-583684665 tempest-TestVolumeSwap-583684665-project-member] <== disconnect_volume: return (279ms) None {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 15:18:34 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-23bc2f5a-4902-4af9-bafc-5c29067d5965 tempest-TestVolumeSwap-583684665 tempest-TestVolumeSwap-583684665-project-member] [instance: 9a82f146-97ce-4319-8b25-c1b090965e53] Disconnected iSCSI Volume {{(pid=72382) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 15:18:35 user nova-compute[72382]: DEBUG nova.objects.instance [None req-23bc2f5a-4902-4af9-bafc-5c29067d5965 tempest-TestVolumeSwap-583684665 tempest-TestVolumeSwap-583684665-project-member] Lazy-loading 'flavor' on Instance uuid 9a82f146-97ce-4319-8b25-c1b090965e53 {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:18:35 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-23bc2f5a-4902-4af9-bafc-5c29067d5965 tempest-TestVolumeSwap-583684665 tempest-TestVolumeSwap-583684665-project-member] Lock "9a82f146-97ce-4319-8b25-c1b090965e53" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.660s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:18:38 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:18:38 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1514202a-5017-470c-ae35-962edbedfdce tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] [instance: b5aa7e23-9c2c-400e-a615-5839858749e1] Calling os-brick to attach iSCSI Volume {{(pid=72382) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 15:18:38 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-1514202a-5017-470c-ae35-962edbedfdce tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2a0c768340>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:4b091ba1-b5b0-4a67-af72-757195ad808a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pTlLmQUh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 15:18:38 user nova-compute[72382]: WARNING os_brick.initiator.connectors.base [None req-1514202a-5017-470c-ae35-962edbedfdce tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 15:18:38 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-1514202a-5017-470c-ae35-962edbedfdce tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 15:18:38 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-1514202a-5017-470c-ae35-962edbedfdce tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 15:18:38 user nova-compute[72382]: WARNING os_brick.initiator.connectors.base [None req-1514202a-5017-470c-ae35-962edbedfdce tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 15:18:38 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-1514202a-5017-470c-ae35-962edbedfdce tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4b091ba1-b5b0-4a67-af72-757195ad808a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 15:18:38 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-1514202a-5017-470c-ae35-962edbedfdce tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4b091ba1-b5b0-4a67-af72-757195ad808a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 15:18:38 user nova-compute[72382]: INFO os_brick.initiator.connectors.iscsi [None req-1514202a-5017-470c-ae35-962edbedfdce tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 15:18:38 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b091ba1-b5b0-4a67-af72-757195ad808a -p 172.16.0.220:3260 {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:18:38 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:18:38 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b091ba1-b5b0-4a67-af72-757195ad808a -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:18:38 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[48ac3d86-40a5-4038-ba4a-f5e1911aacb0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:18:38 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-1514202a-5017-470c-ae35-962edbedfdce tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 15:18:38 user nova-compute[72382]:  {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:18:38 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b091ba1-b5b0-4a67-af72-757195ad808a -p 172.16.0.220:3260 --interface default --op new {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:18:38 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b091ba1-b5b0-4a67-af72-757195ad808a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:18:38 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[bed27b26-20af-45dc-8bd7-d38defa28a3e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4b091ba1-b5b0-4a67-af72-757195ad808a] added\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:18:38 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-1514202a-5017-470c-ae35-962edbedfdce tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4b091ba1-b5b0-4a67-af72-757195ad808a] added
Aug 09 15:18:38 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:18:38 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b091ba1-b5b0-4a67-af72-757195ad808a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:18:38 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b091ba1-b5b0-4a67-af72-757195ad808a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:18:38 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[37bb0c16-5d19-40ba-aa1c-baeebf8b730e]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:18:38 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-1514202a-5017-470c-ae35-962edbedfdce tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:18:38 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b091ba1-b5b0-4a67-af72-757195ad808a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:18:38 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b091ba1-b5b0-4a67-af72-757195ad808a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:18:38 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[313f87c1-ed97-4708-8a7c-aecd99670662]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:18:38 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-1514202a-5017-470c-ae35-962edbedfdce tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:18:38 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b091ba1-b5b0-4a67-af72-757195ad808a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pTlLmQUh {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:18:38 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b091ba1-b5b0-4a67-af72-757195ad808a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pTlLmQUh" returned: 0 in 0.017s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:18:38 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[591ef99f-4297-45bd-b666-fdc42205a270]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:18:38 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-1514202a-5017-470c-ae35-962edbedfdce tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pTlLmQUh'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:18:38 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b091ba1-b5b0-4a67-af72-757195ad808a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:18:38 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b091ba1-b5b0-4a67-af72-757195ad808a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:18:38 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c497df2-f4b2-4e0a-b9b7-ee754054d9c0]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:18:38 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-1514202a-5017-470c-ae35-962edbedfdce tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:18:38 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:18:38 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:18:38 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e0392d5-30e8-4969-89b8-8677ca66c5a7]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c2a0938-fb5c-434c-91ba-15e8823c1348 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:18:38 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-1514202a-5017-470c-ae35-962edbedfdce tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c2a0938-fb5c-434c-91ba-15e8823c1348 (non-flash)
Aug 09 15:18:38 user nova-compute[72382]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)
Aug 09 15:18:38 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 15:18:38 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-1514202a-5017-470c-ae35-962edbedfdce tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c2a0938-fb5c-434c-91ba-15e8823c1348 (non-flash)
Aug 09 15:18:38 user nova-compute[72382]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)
Aug 09 15:18:38 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 15:18:38 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b091ba1-b5b0-4a67-af72-757195ad808a -p 172.16.0.220:3260 --login {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:18:39 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b091ba1-b5b0-4a67-af72-757195ad808a -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:18:39 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfb18ad3-0352-4322-a801-bc3215427c1a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4b091ba1-b5b0-4a67-af72-757195ad808a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4b091ba1-b5b0-4a67-af72-757195ad808a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:18:39 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-1514202a-5017-470c-ae35-962edbedfdce tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4b091ba1-b5b0-4a67-af72-757195ad808a, portal: 172.16.0.220,3260]
Aug 09 15:18:39 user nova-compute[72382]: Login to [iface: default, target: iqn.2010-10.org.openstack:4b091ba1-b5b0-4a67-af72-757195ad808a, portal: 172.16.0.220,3260] successful.
Aug 09 15:18:39 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:18:39 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b091ba1-b5b0-4a67-af72-757195ad808a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:18:39 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b091ba1-b5b0-4a67-af72-757195ad808a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:18:39 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[19591c34-9dde-4229-9fac-f7a07bd7d0b5]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:18:39 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-1514202a-5017-470c-ae35-962edbedfdce tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:18:39 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:18:39 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:18:39 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[f94c5207-46ff-4834-b40d-70bed157a540]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c2a0938-fb5c-434c-91ba-15e8823c1348 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b091ba1-b5b0-4a67-af72-757195ad808a (non-flash)\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:18:39 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-1514202a-5017-470c-ae35-962edbedfdce tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c2a0938-fb5c-434c-91ba-15e8823c1348 (non-flash)
Aug 09 15:18:39 user nova-compute[72382]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)
Aug 09 15:18:39 user nova-compute[72382]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b091ba1-b5b0-4a67-af72-757195ad808a (non-flash)
Aug 09 15:18:39 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 15:18:39 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-1514202a-5017-470c-ae35-962edbedfdce tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c2a0938-fb5c-434c-91ba-15e8823c1348 (non-flash)
Aug 09 15:18:39 user nova-compute[72382]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)
Aug 09 15:18:39 user nova-compute[72382]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b091ba1-b5b0-4a67-af72-757195ad808a (non-flash)
Aug 09 15:18:39 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 15:18:39 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-1514202a-5017-470c-ae35-962edbedfdce tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4b091ba1-b5b0-4a67-af72-757195ad808a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.274s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 15:18:39 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-1514202a-5017-470c-ae35-962edbedfdce tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] Connected to 172.16.0.220:3260 {{(pid=72382) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 15:18:39 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-1514202a-5017-470c-ae35-962edbedfdce tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] HCTL ('34', '-', '-', 0) found on session 14 with lun 0 {{(pid=72382) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 15:18:39 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-1514202a-5017-470c-ae35-962edbedfdce tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72382) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 15:18:39 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:18:39 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:18:39 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c4582c1-ab72-4804-baf6-2cd3cfa6e86f]: (4, ('- - 0', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:18:39 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-1514202a-5017-470c-ae35-962edbedfdce tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] Searching for a device in session 14 and hctl ['34', '*', '*', 0] yield: None {{(pid=72382) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 15:18:40 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-1514202a-5017-470c-ae35-962edbedfdce tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] Searching for a device in session 14 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72382) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 15:18:40 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-1514202a-5017-470c-ae35-962edbedfdce tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pTlLmQUh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72382) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 15:18:40 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-1514202a-5017-470c-ae35-962edbedfdce tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.364s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 15:18:40 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-1514202a-5017-470c-ae35-962edbedfdce tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] <== connect_volume: return (1366ms) {'type': 'block', 'scsi_wwn': '23634653337316664', 'path': '/dev/sdc'} {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 15:18:40 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1514202a-5017-470c-ae35-962edbedfdce tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] [instance: b5aa7e23-9c2c-400e-a615-5839858749e1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23634653337316664', 'path': '/dev/sdc'} {{(pid=72382) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 15:18:40 user nova-compute[72382]: DEBUG nova.objects.instance [None req-1514202a-5017-470c-ae35-962edbedfdce tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] Lazy-loading 'flavor' on Instance uuid b5aa7e23-9c2c-400e-a615-5839858749e1 {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:18:40 user nova-compute[72382]: DEBUG nova.virt.libvirt.guest [None req-1514202a-5017-470c-ae35-962edbedfdce tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 15:18:40 user nova-compute[72382]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 15:18:40 user nova-compute[72382]:   <source dev="/dev/sdc"/>
Aug 09 15:18:40 user nova-compute[72382]:   <target dev="vdc" bus="virtio"/>
Aug 09 15:18:40 user nova-compute[72382]:   <serial>4b091ba1-b5b0-4a67-af72-757195ad808a</serial>
Aug 09 15:18:40 user nova-compute[72382]: </disk>
Aug 09 15:18:40 user nova-compute[72382]:  {{(pid=72382) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 15:18:40 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-1514202a-5017-470c-ae35-962edbedfdce tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] No BDM found with device name vda, not building metadata. {{(pid=72382) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 15:18:40 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-1514202a-5017-470c-ae35-962edbedfdce tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72382) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 15:18:40 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-1514202a-5017-470c-ae35-962edbedfdce tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72382) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 15:18:40 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-1514202a-5017-470c-ae35-962edbedfdce tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] No VIF found with MAC fa:16:3e:f1:64:50, not building metadata {{(pid=72382) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 15:18:40 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-1514202a-5017-470c-ae35-962edbedfdce tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] Lock "b5aa7e23-9c2c-400e-a615-5839858749e1" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.265s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:18:41 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-0a1f884c-b3dd-4e95-ab55-3b1bde449d4e tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] Acquiring lock "b5aa7e23-9c2c-400e-a615-5839858749e1" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:18:41 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-0a1f884c-b3dd-4e95-ab55-3b1bde449d4e tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] Lock "b5aa7e23-9c2c-400e-a615-5839858749e1" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:18:41 user nova-compute[72382]: INFO nova.compute.manager [None req-0a1f884c-b3dd-4e95-ab55-3b1bde449d4e tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] [instance: b5aa7e23-9c2c-400e-a615-5839858749e1] Detaching volume 4b091ba1-b5b0-4a67-af72-757195ad808a
Aug 09 15:18:41 user nova-compute[72382]: INFO nova.virt.block_device [None req-0a1f884c-b3dd-4e95-ab55-3b1bde449d4e tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] [instance: b5aa7e23-9c2c-400e-a615-5839858749e1] Attempting to driver detach volume 4b091ba1-b5b0-4a67-af72-757195ad808a from mountpoint /dev/vdc
Aug 09 15:18:41 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-0a1f884c-b3dd-4e95-ab55-3b1bde449d4e tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] Attempting to detach device vdc from instance b5aa7e23-9c2c-400e-a615-5839858749e1 from the persistent domain config. {{(pid=72382) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 15:18:41 user nova-compute[72382]: DEBUG nova.virt.libvirt.guest [None req-0a1f884c-b3dd-4e95-ab55-3b1bde449d4e tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 15:18:41 user nova-compute[72382]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 15:18:41 user nova-compute[72382]:   <source dev="/dev/sdc"/>
Aug 09 15:18:41 user nova-compute[72382]:   <target dev="vdc" bus="virtio"/>
Aug 09 15:18:41 user nova-compute[72382]:   <serial>4b091ba1-b5b0-4a67-af72-757195ad808a</serial>
Aug 09 15:18:41 user nova-compute[72382]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 09 15:18:41 user nova-compute[72382]: </disk>
Aug 09 15:18:41 user nova-compute[72382]:  {{(pid=72382) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 15:18:41 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-0a1f884c-b3dd-4e95-ab55-3b1bde449d4e tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] Successfully detached device vdc from instance b5aa7e23-9c2c-400e-a615-5839858749e1 from the persistent domain config.
Aug 09 15:18:41 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-0a1f884c-b3dd-4e95-ab55-3b1bde449d4e tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance b5aa7e23-9c2c-400e-a615-5839858749e1 from the live domain config. {{(pid=72382) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 15:18:41 user nova-compute[72382]: DEBUG nova.virt.libvirt.guest [None req-0a1f884c-b3dd-4e95-ab55-3b1bde449d4e tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 15:18:41 user nova-compute[72382]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 15:18:41 user nova-compute[72382]:   <source dev="/dev/sdc"/>
Aug 09 15:18:41 user nova-compute[72382]:   <target dev="vdc" bus="virtio"/>
Aug 09 15:18:41 user nova-compute[72382]:   <serial>4b091ba1-b5b0-4a67-af72-757195ad808a</serial>
Aug 09 15:18:41 user nova-compute[72382]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 09 15:18:41 user nova-compute[72382]: </disk>
Aug 09 15:18:41 user nova-compute[72382]:  {{(pid=72382) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 15:18:42 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Received event <DeviceRemovedEvent: 1691594322.3033814, b5aa7e23-9c2c-400e-a615-5839858749e1 => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=72382) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 15:18:42 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-0a1f884c-b3dd-4e95-ab55-3b1bde449d4e tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance b5aa7e23-9c2c-400e-a615-5839858749e1 {{(pid=72382) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 15:18:42 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-0a1f884c-b3dd-4e95-ab55-3b1bde449d4e tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] Successfully detached device vdc from instance b5aa7e23-9c2c-400e-a615-5839858749e1 from the live domain config.
Aug 09 15:18:42 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0a1f884c-b3dd-4e95-ab55-3b1bde449d4e tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] [instance: b5aa7e23-9c2c-400e-a615-5839858749e1] calling os-brick to detach iSCSI Volume {{(pid=72382) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 15:18:42 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a1f884c-b3dd-4e95-ab55-3b1bde449d4e tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2a0c768340>, {'target_iqns': ['iqn.2010-10.org.openstack:4b091ba1-b5b0-4a67-af72-757195ad808a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pTlLmQUh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 15:18:42 user nova-compute[72382]: WARNING os_brick.initiator.connectors.base [None req-0a1f884c-b3dd-4e95-ab55-3b1bde449d4e tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 15:18:42 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-0a1f884c-b3dd-4e95-ab55-3b1bde449d4e tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 15:18:42 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-0a1f884c-b3dd-4e95-ab55-3b1bde449d4e tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 15:18:42 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a1f884c-b3dd-4e95-ab55-3b1bde449d4e tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4b091ba1-b5b0-4a67-af72-757195ad808a', 0)] {{(pid=72382) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 15:18:42 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:18:42 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:18:42 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[05f8a760-4790-42b0-b211-5febcb9b0a7e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4b091ba1-b5b0-4a67-af72-757195ad808a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9c2a0938-fb5c-434c-91ba-15e8823c1348\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:18:42 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:18:42 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:18:42 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f6028e7-4ab5-4bc1-812f-2702a59c1b38]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c2a0938-fb5c-434c-91ba-15e8823c1348 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b091ba1-b5b0-4a67-af72-757195ad808a (non-flash)\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:18:42 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a1f884c-b3dd-4e95-ab55-3b1bde449d4e tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c2a0938-fb5c-434c-91ba-15e8823c1348 (non-flash)
Aug 09 15:18:42 user nova-compute[72382]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)
Aug 09 15:18:42 user nova-compute[72382]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b091ba1-b5b0-4a67-af72-757195ad808a (non-flash)
Aug 09 15:18:42 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 15:18:42 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a1f884c-b3dd-4e95-ab55-3b1bde449d4e tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c2a0938-fb5c-434c-91ba-15e8823c1348 (non-flash)
Aug 09 15:18:42 user nova-compute[72382]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)
Aug 09 15:18:42 user nova-compute[72382]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b091ba1-b5b0-4a67-af72-757195ad808a (non-flash)
Aug 09 15:18:42 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 15:18:42 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a1f884c-b3dd-4e95-ab55-3b1bde449d4e tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2a0c349c60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4b091ba1-b5b0-4a67-af72-757195ad808a'): ({'sdc'}, set())}) {{(pid=72382) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 15:18:42 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-0a1f884c-b3dd-4e95-ab55-3b1bde449d4e tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] Removing single pathed devices sdc {{(pid=72382) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 15:18:42 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:18:42 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:18:42 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[60af4cce-a138-4364-aa6b-b353990fab52]: (4, ('path checker states:\nup                  2\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:18:42 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:18:42 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:18:42 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[3417f164-a4cd-43f9-bd61-048e05a46b56]: (4, ('ok\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:18:42 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-0a1f884c-b3dd-4e95-ab55-3b1bde449d4e tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] Flushing IO for device /dev/sdc {{(pid=72382) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 15:18:42 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:18:42 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:18:42 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7fa5331-4876-46d7-a072-1d3fa7c6703e]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:18:42 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-0a1f884c-b3dd-4e95-ab55-3b1bde449d4e tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72382) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 15:18:42 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:18:42 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.045s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:18:42 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[444061d8-a582-49cb-995e-0ebac03e201d]: (4, ('1', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:18:42 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-0a1f884c-b3dd-4e95-ab55-3b1bde449d4e tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72382) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 15:18:42 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-0a1f884c-b3dd-4e95-ab55-3b1bde449d4e tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] SCSI volumes sdc have been removed. {{(pid=72382) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 15:18:42 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a1f884c-b3dd-4e95-ab55-3b1bde449d4e tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4b091ba1-b5b0-4a67-af72-757195ad808a')] {{(pid=72382) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 15:18:42 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b091ba1-b5b0-4a67-af72-757195ad808a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:18:42 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b091ba1-b5b0-4a67-af72-757195ad808a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:18:42 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[c273223b-e906-467b-9d64-288a7f5d65a6]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:18:42 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a1f884c-b3dd-4e95-ab55-3b1bde449d4e tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:18:42 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b091ba1-b5b0-4a67-af72-757195ad808a -p 172.16.0.220:3260 --logout {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:18:42 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b091ba1-b5b0-4a67-af72-757195ad808a -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:18:42 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0ea2126-bae5-487f-921f-cb0b660eec27]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:4b091ba1-b5b0-4a67-af72-757195ad808a, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:4b091ba1-b5b0-4a67-af72-757195ad808a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:18:42 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a1f884c-b3dd-4e95-ab55-3b1bde449d4e tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:4b091ba1-b5b0-4a67-af72-757195ad808a, portal: 172.16.0.220,3260]
Aug 09 15:18:42 user nova-compute[72382]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:4b091ba1-b5b0-4a67-af72-757195ad808a, portal: 172.16.0.220,3260] successful.
Aug 09 15:18:42 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:18:42 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b091ba1-b5b0-4a67-af72-757195ad808a -p 172.16.0.220:3260 --op delete {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:18:42 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b091ba1-b5b0-4a67-af72-757195ad808a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:18:42 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[57002cef-e149-4c83-91fe-90c67c66d513]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:18:42 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a1f884c-b3dd-4e95-ab55-3b1bde449d4e tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:18:42 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-0a1f884c-b3dd-4e95-ab55-3b1bde449d4e tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.295s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 15:18:42 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a1f884c-b3dd-4e95-ab55-3b1bde449d4e tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] <== disconnect_volume: return (296ms) None {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 15:18:42 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0a1f884c-b3dd-4e95-ab55-3b1bde449d4e tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] [instance: b5aa7e23-9c2c-400e-a615-5839858749e1] Disconnected iSCSI Volume {{(pid=72382) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 15:18:43 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:18:43 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-f82d40e6-1278-4cc3-980f-a691c9b71d38 tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] Acquiring lock "ea6afcf7-0b8b-43d8-af1d-9c132a659711" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:18:43 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-f82d40e6-1278-4cc3-980f-a691c9b71d38 tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] Lock "ea6afcf7-0b8b-43d8-af1d-9c132a659711" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:18:43 user nova-compute[72382]: DEBUG nova.compute.manager [None req-f82d40e6-1278-4cc3-980f-a691c9b71d38 tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] [instance: ea6afcf7-0b8b-43d8-af1d-9c132a659711] Starting instance... {{(pid=72382) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 15:18:43 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-f82d40e6-1278-4cc3-980f-a691c9b71d38 tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:18:43 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-f82d40e6-1278-4cc3-980f-a691c9b71d38 tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:18:43 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-f82d40e6-1278-4cc3-980f-a691c9b71d38 tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72382) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 15:18:43 user nova-compute[72382]: INFO nova.compute.claims [None req-f82d40e6-1278-4cc3-980f-a691c9b71d38 tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] [instance: ea6afcf7-0b8b-43d8-af1d-9c132a659711] Claim successful on node user
Aug 09 15:18:43 user nova-compute[72382]: DEBUG nova.objects.instance [None req-0a1f884c-b3dd-4e95-ab55-3b1bde449d4e tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] Lazy-loading 'flavor' on Instance uuid b5aa7e23-9c2c-400e-a615-5839858749e1 {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:18:43 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-0a1f884c-b3dd-4e95-ab55-3b1bde449d4e tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] Lock "b5aa7e23-9c2c-400e-a615-5839858749e1" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.711s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:18:43 user nova-compute[72382]: DEBUG nova.compute.provider_tree [None req-f82d40e6-1278-4cc3-980f-a691c9b71d38 tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] Inventory has not changed in ProviderTree for provider: 7b15b0e5-df4d-49db-833b-2855d21d10ae {{(pid=72382) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 15:18:43 user nova-compute[72382]: DEBUG nova.scheduler.client.report [None req-f82d40e6-1278-4cc3-980f-a691c9b71d38 tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] Inventory has not changed for provider 7b15b0e5-df4d-49db-833b-2855d21d10ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72382) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 15:18:43 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-f82d40e6-1278-4cc3-980f-a691c9b71d38 tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.495s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:18:43 user nova-compute[72382]: DEBUG nova.compute.manager [None req-f82d40e6-1278-4cc3-980f-a691c9b71d38 tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] [instance: ea6afcf7-0b8b-43d8-af1d-9c132a659711] Start building networks asynchronously for instance. {{(pid=72382) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 15:18:43 user nova-compute[72382]: DEBUG nova.compute.manager [None req-f82d40e6-1278-4cc3-980f-a691c9b71d38 tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] [instance: ea6afcf7-0b8b-43d8-af1d-9c132a659711] Allocating IP information in the background. {{(pid=72382) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 15:18:43 user nova-compute[72382]: DEBUG nova.network.neutron [None req-f82d40e6-1278-4cc3-980f-a691c9b71d38 tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] [instance: ea6afcf7-0b8b-43d8-af1d-9c132a659711] allocate_for_instance() {{(pid=72382) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 15:18:43 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-f82d40e6-1278-4cc3-980f-a691c9b71d38 tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] [instance: ea6afcf7-0b8b-43d8-af1d-9c132a659711] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 15:18:43 user nova-compute[72382]: DEBUG nova.compute.manager [None req-f82d40e6-1278-4cc3-980f-a691c9b71d38 tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] [instance: ea6afcf7-0b8b-43d8-af1d-9c132a659711] Start building block device mappings for instance. {{(pid=72382) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 15:18:44 user nova-compute[72382]: DEBUG nova.policy [None req-f82d40e6-1278-4cc3-980f-a691c9b71d38 tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '374f2148fb524924acc7e1e968e73fe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b98e20f61c34fd6aa28cef7ceadf0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72382) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 15:18:44 user nova-compute[72382]: DEBUG nova.compute.manager [None req-f82d40e6-1278-4cc3-980f-a691c9b71d38 tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] [instance: ea6afcf7-0b8b-43d8-af1d-9c132a659711] Start spawning the instance on the hypervisor. {{(pid=72382) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 15:18:44 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-f82d40e6-1278-4cc3-980f-a691c9b71d38 tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] [instance: ea6afcf7-0b8b-43d8-af1d-9c132a659711] Creating instance directory {{(pid=72382) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 15:18:44 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-f82d40e6-1278-4cc3-980f-a691c9b71d38 tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] [instance: ea6afcf7-0b8b-43d8-af1d-9c132a659711] Creating image(s)
Aug 09 15:18:44 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-f82d40e6-1278-4cc3-980f-a691c9b71d38 tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] Acquiring lock "/opt/stack/data/nova/instances/ea6afcf7-0b8b-43d8-af1d-9c132a659711/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:18:44 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-f82d40e6-1278-4cc3-980f-a691c9b71d38 tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] Lock "/opt/stack/data/nova/instances/ea6afcf7-0b8b-43d8-af1d-9c132a659711/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:18:44 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-f82d40e6-1278-4cc3-980f-a691c9b71d38 tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] Lock "/opt/stack/data/nova/instances/ea6afcf7-0b8b-43d8-af1d-9c132a659711/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:18:44 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-f82d40e6-1278-4cc3-980f-a691c9b71d38 tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:18:44 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-f82d40e6-1278-4cc3-980f-a691c9b71d38 tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b --force-share --output=json" returned: 0 in 0.153s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:18:44 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-f82d40e6-1278-4cc3-980f-a691c9b71d38 tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] Acquiring lock "383812ff437283e0191ed5b9ecc04c27f1162b0b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:18:44 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-f82d40e6-1278-4cc3-980f-a691c9b71d38 tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] Lock "383812ff437283e0191ed5b9ecc04c27f1162b0b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:18:44 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-f82d40e6-1278-4cc3-980f-a691c9b71d38 tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:18:44 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-f82d40e6-1278-4cc3-980f-a691c9b71d38 tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b --force-share --output=json" returned: 0 in 0.125s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:18:44 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-f82d40e6-1278-4cc3-980f-a691c9b71d38 tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b,backing_fmt=raw /opt/stack/data/nova/instances/ea6afcf7-0b8b-43d8-af1d-9c132a659711/disk 1073741824 {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:18:44 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-f82d40e6-1278-4cc3-980f-a691c9b71d38 tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b,backing_fmt=raw /opt/stack/data/nova/instances/ea6afcf7-0b8b-43d8-af1d-9c132a659711/disk 1073741824" returned: 0 in 0.046s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:18:44 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-f82d40e6-1278-4cc3-980f-a691c9b71d38 tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] Lock "383812ff437283e0191ed5b9ecc04c27f1162b0b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.178s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:18:44 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-f82d40e6-1278-4cc3-980f-a691c9b71d38 tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:18:44 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-f82d40e6-1278-4cc3-980f-a691c9b71d38 tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b --force-share --output=json" returned: 0 in 0.126s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:18:44 user nova-compute[72382]: DEBUG nova.virt.disk.api [None req-f82d40e6-1278-4cc3-980f-a691c9b71d38 tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ea6afcf7-0b8b-43d8-af1d-9c132a659711/disk. size=1073741824 {{(pid=72382) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 15:18:44 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-f82d40e6-1278-4cc3-980f-a691c9b71d38 tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea6afcf7-0b8b-43d8-af1d-9c132a659711/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:18:44 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-f82d40e6-1278-4cc3-980f-a691c9b71d38 tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea6afcf7-0b8b-43d8-af1d-9c132a659711/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:18:44 user nova-compute[72382]: DEBUG nova.virt.disk.api [None req-f82d40e6-1278-4cc3-980f-a691c9b71d38 tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] Cannot resize image /opt/stack/data/nova/instances/ea6afcf7-0b8b-43d8-af1d-9c132a659711/disk to a smaller size. {{(pid=72382) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 15:18:44 user nova-compute[72382]: DEBUG nova.objects.instance [None req-f82d40e6-1278-4cc3-980f-a691c9b71d38 tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] Lazy-loading 'migration_context' on Instance uuid ea6afcf7-0b8b-43d8-af1d-9c132a659711 {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:18:44 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-f82d40e6-1278-4cc3-980f-a691c9b71d38 tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] [instance: ea6afcf7-0b8b-43d8-af1d-9c132a659711] Created local disks {{(pid=72382) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 15:18:44 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-f82d40e6-1278-4cc3-980f-a691c9b71d38 tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] [instance: ea6afcf7-0b8b-43d8-af1d-9c132a659711] Ensure instance console log exists: /opt/stack/data/nova/instances/ea6afcf7-0b8b-43d8-af1d-9c132a659711/console.log {{(pid=72382) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 15:18:44 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-f82d40e6-1278-4cc3-980f-a691c9b71d38 tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:18:44 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-f82d40e6-1278-4cc3-980f-a691c9b71d38 tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:18:44 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-f82d40e6-1278-4cc3-980f-a691c9b71d38 tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:18:44 user nova-compute[72382]: DEBUG nova.network.neutron [None req-f82d40e6-1278-4cc3-980f-a691c9b71d38 tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] [instance: ea6afcf7-0b8b-43d8-af1d-9c132a659711] Successfully created port: 4bb8ca7e-4ce8-4fc1-a5d0-4e3b5e796338 {{(pid=72382) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 15:18:45 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:18:45 user nova-compute[72382]: DEBUG nova.network.neutron [None req-f82d40e6-1278-4cc3-980f-a691c9b71d38 tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] [instance: ea6afcf7-0b8b-43d8-af1d-9c132a659711] Successfully updated port: 4bb8ca7e-4ce8-4fc1-a5d0-4e3b5e796338 {{(pid=72382) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 15:18:45 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-f82d40e6-1278-4cc3-980f-a691c9b71d38 tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] Acquiring lock "refresh_cache-ea6afcf7-0b8b-43d8-af1d-9c132a659711" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 15:18:45 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-f82d40e6-1278-4cc3-980f-a691c9b71d38 tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] Acquired lock "refresh_cache-ea6afcf7-0b8b-43d8-af1d-9c132a659711" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 15:18:45 user nova-compute[72382]: DEBUG nova.network.neutron [None req-f82d40e6-1278-4cc3-980f-a691c9b71d38 tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] [instance: ea6afcf7-0b8b-43d8-af1d-9c132a659711] Building network info cache for instance {{(pid=72382) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 15:18:45 user nova-compute[72382]: DEBUG nova.compute.manager [req-bad19af6-a8e7-4fe6-a454-4ebb45c12e9b req-2073fe97-4b36-46c9-acae-e92b18e5e831 service nova] [instance: ea6afcf7-0b8b-43d8-af1d-9c132a659711] Received event network-changed-4bb8ca7e-4ce8-4fc1-a5d0-4e3b5e796338 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:18:45 user nova-compute[72382]: DEBUG nova.compute.manager [req-bad19af6-a8e7-4fe6-a454-4ebb45c12e9b req-2073fe97-4b36-46c9-acae-e92b18e5e831 service nova] [instance: ea6afcf7-0b8b-43d8-af1d-9c132a659711] Refreshing instance network info cache due to event network-changed-4bb8ca7e-4ce8-4fc1-a5d0-4e3b5e796338. {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 15:18:45 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-bad19af6-a8e7-4fe6-a454-4ebb45c12e9b req-2073fe97-4b36-46c9-acae-e92b18e5e831 service nova] Acquiring lock "refresh_cache-ea6afcf7-0b8b-43d8-af1d-9c132a659711" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 15:18:45 user nova-compute[72382]: DEBUG nova.network.neutron [None req-f82d40e6-1278-4cc3-980f-a691c9b71d38 tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] [instance: ea6afcf7-0b8b-43d8-af1d-9c132a659711] Instance cache missing network info. {{(pid=72382) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 15:18:46 user nova-compute[72382]: DEBUG nova.network.neutron [None req-f82d40e6-1278-4cc3-980f-a691c9b71d38 tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] [instance: ea6afcf7-0b8b-43d8-af1d-9c132a659711] Updating instance_info_cache with network_info: [{"id": "4bb8ca7e-4ce8-4fc1-a5d0-4e3b5e796338", "address": "fa:16:3e:ea:a3:a5", "network": {"id": "1a0f18df-96f2-4c90-8e53-fcbfc8f17bc4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1771770150-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b98e20f61c34fd6aa28cef7ceadf0d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4bb8ca7e-4c", "ovs_interfaceid": "4bb8ca7e-4ce8-4fc1-a5d0-4e3b5e796338", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:18:46 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-f82d40e6-1278-4cc3-980f-a691c9b71d38 tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] Releasing lock "refresh_cache-ea6afcf7-0b8b-43d8-af1d-9c132a659711" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 15:18:46 user nova-compute[72382]: DEBUG nova.compute.manager [None req-f82d40e6-1278-4cc3-980f-a691c9b71d38 tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] [instance: ea6afcf7-0b8b-43d8-af1d-9c132a659711] Instance network_info: |[{"id": "4bb8ca7e-4ce8-4fc1-a5d0-4e3b5e796338", "address": "fa:16:3e:ea:a3:a5", "network": {"id": "1a0f18df-96f2-4c90-8e53-fcbfc8f17bc4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1771770150-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b98e20f61c34fd6aa28cef7ceadf0d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4bb8ca7e-4c", "ovs_interfaceid": "4bb8ca7e-4ce8-4fc1-a5d0-4e3b5e796338", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72382) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 15:18:46 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-bad19af6-a8e7-4fe6-a454-4ebb45c12e9b req-2073fe97-4b36-46c9-acae-e92b18e5e831 service nova] Acquired lock "refresh_cache-ea6afcf7-0b8b-43d8-af1d-9c132a659711" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 15:18:46 user nova-compute[72382]: DEBUG nova.network.neutron [req-bad19af6-a8e7-4fe6-a454-4ebb45c12e9b req-2073fe97-4b36-46c9-acae-e92b18e5e831 service nova] [instance: ea6afcf7-0b8b-43d8-af1d-9c132a659711] Refreshing network info cache for port 4bb8ca7e-4ce8-4fc1-a5d0-4e3b5e796338 {{(pid=72382) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 15:18:46 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-f82d40e6-1278-4cc3-980f-a691c9b71d38 tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] [instance: ea6afcf7-0b8b-43d8-af1d-9c132a659711] Start _get_guest_xml network_info=[{"id": "4bb8ca7e-4ce8-4fc1-a5d0-4e3b5e796338", "address": "fa:16:3e:ea:a3:a5", "network": {"id": "1a0f18df-96f2-4c90-8e53-fcbfc8f17bc4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1771770150-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b98e20f61c34fd6aa28cef7ceadf0d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4bb8ca7e-4c", "ovs_interfaceid": "4bb8ca7e-4ce8-4fc1-a5d0-4e3b5e796338", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T15:11:25Z,direct_url=<?>,disk_format='qcow2',id=a79f2cea-eb27-4631-aaf3-05e7d9e411b4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a638990e12cc4d6eabb6d55e13be6bdf',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T15:11:27Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'a79f2cea-eb27-4631-aaf3-05e7d9e411b4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72382) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 15:18:46 user nova-compute[72382]: WARNING nova.virt.libvirt.driver [None req-f82d40e6-1278-4cc3-980f-a691c9b71d38 tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 15:18:46 user nova-compute[72382]: WARNING nova.virt.libvirt.driver [None req-f82d40e6-1278-4cc3-980f-a691c9b71d38 tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 15:18:46 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-f82d40e6-1278-4cc3-980f-a691c9b71d38 tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72382) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 15:18:46 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-f82d40e6-1278-4cc3-980f-a691c9b71d38 tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] CPU controller missing on host. {{(pid=72382) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 15:18:46 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-f82d40e6-1278-4cc3-980f-a691c9b71d38 tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72382) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 15:18:46 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-f82d40e6-1278-4cc3-980f-a691c9b71d38 tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] CPU controller found on host. {{(pid=72382) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 15:18:46 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-f82d40e6-1278-4cc3-980f-a691c9b71d38 tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72382) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 15:18:46 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-f82d40e6-1278-4cc3-980f-a691c9b71d38 tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T15:11:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T15:11:25Z,direct_url=<?>,disk_format='qcow2',id=a79f2cea-eb27-4631-aaf3-05e7d9e411b4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a638990e12cc4d6eabb6d55e13be6bdf',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T15:11:27Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 15:18:46 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-f82d40e6-1278-4cc3-980f-a691c9b71d38 tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] Flavor limits 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 15:18:46 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-f82d40e6-1278-4cc3-980f-a691c9b71d38 tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] Image limits 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 15:18:46 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-f82d40e6-1278-4cc3-980f-a691c9b71d38 tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] Flavor pref 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 15:18:46 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-f82d40e6-1278-4cc3-980f-a691c9b71d38 tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] Image pref 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 15:18:46 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-f82d40e6-1278-4cc3-980f-a691c9b71d38 tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 15:18:46 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-f82d40e6-1278-4cc3-980f-a691c9b71d38 tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 15:18:46 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-f82d40e6-1278-4cc3-980f-a691c9b71d38 tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72382) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 15:18:46 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-f82d40e6-1278-4cc3-980f-a691c9b71d38 tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] Got 1 possible topologies {{(pid=72382) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 15:18:46 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-f82d40e6-1278-4cc3-980f-a691c9b71d38 tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 15:18:46 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-f82d40e6-1278-4cc3-980f-a691c9b71d38 tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 15:18:46 user nova-compute[72382]: DEBUG nova.virt.libvirt.vif [None req-f82d40e6-1278-4cc3-980f-a691c9b71d38 tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T15:18:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1136496910',display_name='tempest-VolumesAdminNegativeTest-server-1136496910',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1136496910',id=15,image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3b98e20f61c34fd6aa28cef7ceadf0d3',ramdisk_id='',reservation_id='r-78uiuzca',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-993781103',owner_user_name='tempest-VolumesAdminNegativeTest-993781103-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T15:18:44Z,user_data=None,user_id='374f2148fb524924acc7e1e968e73fe1',uuid=ea6afcf7-0b8b-43d8-af1d-9c132a659711,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4bb8ca7e-4ce8-4fc1-a5d0-4e3b5e796338", "address": "fa:16:3e:ea:a3:a5", "network": {"id": "1a0f18df-96f2-4c90-8e53-fcbfc8f17bc4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1771770150-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b98e20f61c34fd6aa28cef7ceadf0d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4bb8ca7e-4c", "ovs_interfaceid": "4bb8ca7e-4ce8-4fc1-a5d0-4e3b5e796338", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72382) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 15:18:46 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-f82d40e6-1278-4cc3-980f-a691c9b71d38 tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] Converting VIF {"id": "4bb8ca7e-4ce8-4fc1-a5d0-4e3b5e796338", "address": "fa:16:3e:ea:a3:a5", "network": {"id": "1a0f18df-96f2-4c90-8e53-fcbfc8f17bc4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1771770150-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b98e20f61c34fd6aa28cef7ceadf0d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4bb8ca7e-4c", "ovs_interfaceid": "4bb8ca7e-4ce8-4fc1-a5d0-4e3b5e796338", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 15:18:46 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-f82d40e6-1278-4cc3-980f-a691c9b71d38 tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ea:a3:a5,bridge_name='br-int',has_traffic_filtering=True,id=4bb8ca7e-4ce8-4fc1-a5d0-4e3b5e796338,network=Network(1a0f18df-96f2-4c90-8e53-fcbfc8f17bc4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4bb8ca7e-4c') {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 15:18:46 user nova-compute[72382]: DEBUG nova.objects.instance [None req-f82d40e6-1278-4cc3-980f-a691c9b71d38 tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] Lazy-loading 'pci_devices' on Instance uuid ea6afcf7-0b8b-43d8-af1d-9c132a659711 {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:18:46 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-f82d40e6-1278-4cc3-980f-a691c9b71d38 tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] [instance: ea6afcf7-0b8b-43d8-af1d-9c132a659711] End _get_guest_xml xml=<domain type="kvm">
Aug 09 15:18:46 user nova-compute[72382]:   <uuid>ea6afcf7-0b8b-43d8-af1d-9c132a659711</uuid>
Aug 09 15:18:46 user nova-compute[72382]:   <name>instance-0000000f</name>
Aug 09 15:18:46 user nova-compute[72382]:   <memory>524288</memory>
Aug 09 15:18:46 user nova-compute[72382]:   <vcpu>1</vcpu>
Aug 09 15:18:46 user nova-compute[72382]:   <metadata>
Aug 09 15:18:46 user nova-compute[72382]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 15:18:46 user nova-compute[72382]:       <nova:package version="0.0.0"/>
Aug 09 15:18:46 user nova-compute[72382]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1136496910</nova:name>
Aug 09 15:18:46 user nova-compute[72382]:       <nova:creationTime>2023-08-09 15:18:46</nova:creationTime>
Aug 09 15:18:46 user nova-compute[72382]:       <nova:flavor name="m1.tiny">
Aug 09 15:18:46 user nova-compute[72382]:         <nova:memory>512</nova:memory>
Aug 09 15:18:46 user nova-compute[72382]:         <nova:disk>1</nova:disk>
Aug 09 15:18:46 user nova-compute[72382]:         <nova:swap>0</nova:swap>
Aug 09 15:18:46 user nova-compute[72382]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 15:18:46 user nova-compute[72382]:         <nova:vcpus>1</nova:vcpus>
Aug 09 15:18:46 user nova-compute[72382]:       </nova:flavor>
Aug 09 15:18:46 user nova-compute[72382]:       <nova:owner>
Aug 09 15:18:46 user nova-compute[72382]:         <nova:user uuid="374f2148fb524924acc7e1e968e73fe1">tempest-VolumesAdminNegativeTest-993781103-project-member</nova:user>
Aug 09 15:18:46 user nova-compute[72382]:         <nova:project uuid="3b98e20f61c34fd6aa28cef7ceadf0d3">tempest-VolumesAdminNegativeTest-993781103</nova:project>
Aug 09 15:18:46 user nova-compute[72382]:       </nova:owner>
Aug 09 15:18:46 user nova-compute[72382]:       <nova:root type="image" uuid="a79f2cea-eb27-4631-aaf3-05e7d9e411b4"/>
Aug 09 15:18:46 user nova-compute[72382]:       <nova:ports>
Aug 09 15:18:46 user nova-compute[72382]:         <nova:port uuid="4bb8ca7e-4ce8-4fc1-a5d0-4e3b5e796338">
Aug 09 15:18:46 user nova-compute[72382]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 09 15:18:46 user nova-compute[72382]:         </nova:port>
Aug 09 15:18:46 user nova-compute[72382]:       </nova:ports>
Aug 09 15:18:46 user nova-compute[72382]:     </nova:instance>
Aug 09 15:18:46 user nova-compute[72382]:   </metadata>
Aug 09 15:18:46 user nova-compute[72382]:   <sysinfo type="smbios">
Aug 09 15:18:46 user nova-compute[72382]:     <system>
Aug 09 15:18:46 user nova-compute[72382]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 15:18:46 user nova-compute[72382]:       <entry name="product">OpenStack Nova</entry>
Aug 09 15:18:46 user nova-compute[72382]:       <entry name="version">0.0.0</entry>
Aug 09 15:18:46 user nova-compute[72382]:       <entry name="serial">ea6afcf7-0b8b-43d8-af1d-9c132a659711</entry>
Aug 09 15:18:46 user nova-compute[72382]:       <entry name="uuid">ea6afcf7-0b8b-43d8-af1d-9c132a659711</entry>
Aug 09 15:18:46 user nova-compute[72382]:       <entry name="family">Virtual Machine</entry>
Aug 09 15:18:46 user nova-compute[72382]:     </system>
Aug 09 15:18:46 user nova-compute[72382]:   </sysinfo>
Aug 09 15:18:46 user nova-compute[72382]:   <os>
Aug 09 15:18:46 user nova-compute[72382]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 15:18:46 user nova-compute[72382]:     <boot dev="hd"/>
Aug 09 15:18:46 user nova-compute[72382]:     <smbios mode="sysinfo"/>
Aug 09 15:18:46 user nova-compute[72382]:   </os>
Aug 09 15:18:46 user nova-compute[72382]:   <features>
Aug 09 15:18:46 user nova-compute[72382]:     <acpi/>
Aug 09 15:18:46 user nova-compute[72382]:     <apic/>
Aug 09 15:18:46 user nova-compute[72382]:     <vmcoreinfo/>
Aug 09 15:18:46 user nova-compute[72382]:   </features>
Aug 09 15:18:46 user nova-compute[72382]:   <clock offset="utc">
Aug 09 15:18:46 user nova-compute[72382]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 15:18:46 user nova-compute[72382]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 15:18:46 user nova-compute[72382]:     <timer name="hpet" present="no"/>
Aug 09 15:18:46 user nova-compute[72382]:   </clock>
Aug 09 15:18:46 user nova-compute[72382]:   <cpu mode="custom" match="exact">
Aug 09 15:18:46 user nova-compute[72382]:     <model>Nehalem</model>
Aug 09 15:18:46 user nova-compute[72382]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 15:18:46 user nova-compute[72382]:   </cpu>
Aug 09 15:18:46 user nova-compute[72382]:   <devices>
Aug 09 15:18:46 user nova-compute[72382]:     <disk type="file" device="disk">
Aug 09 15:18:46 user nova-compute[72382]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 15:18:46 user nova-compute[72382]:       <source file="/opt/stack/data/nova/instances/ea6afcf7-0b8b-43d8-af1d-9c132a659711/disk"/>
Aug 09 15:18:46 user nova-compute[72382]:       <target dev="vda" bus="virtio"/>
Aug 09 15:18:46 user nova-compute[72382]:     </disk>
Aug 09 15:18:46 user nova-compute[72382]:     <interface type="ethernet">
Aug 09 15:18:46 user nova-compute[72382]:       <mac address="fa:16:3e:ea:a3:a5"/>
Aug 09 15:18:46 user nova-compute[72382]:       <model type="virtio"/>
Aug 09 15:18:46 user nova-compute[72382]:       <mtu size="1442"/>
Aug 09 15:18:46 user nova-compute[72382]:       <target dev="tap4bb8ca7e-4c"/>
Aug 09 15:18:46 user nova-compute[72382]:     </interface>
Aug 09 15:18:46 user nova-compute[72382]:     <serial type="pty">
Aug 09 15:18:46 user nova-compute[72382]:       <log file="/opt/stack/data/nova/instances/ea6afcf7-0b8b-43d8-af1d-9c132a659711/console.log" append="off"/>
Aug 09 15:18:46 user nova-compute[72382]:     </serial>
Aug 09 15:18:46 user nova-compute[72382]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 15:18:46 user nova-compute[72382]:     <video>
Aug 09 15:18:46 user nova-compute[72382]:       <model type="virtio"/>
Aug 09 15:18:46 user nova-compute[72382]:     </video>
Aug 09 15:18:46 user nova-compute[72382]:     <rng model="virtio">
Aug 09 15:18:46 user nova-compute[72382]:       <backend model="random">/dev/urandom</backend>
Aug 09 15:18:46 user nova-compute[72382]:     </rng>
Aug 09 15:18:46 user nova-compute[72382]:     <controller type="usb" index="0" model="none"/>
Aug 09 15:18:46 user nova-compute[72382]:     <memballoon model="virtio">
Aug 09 15:18:46 user nova-compute[72382]:       <stats period="10"/>
Aug 09 15:18:46 user nova-compute[72382]:     </memballoon>
Aug 09 15:18:46 user nova-compute[72382]:   </devices>
Aug 09 15:18:46 user nova-compute[72382]: </domain>
Aug 09 15:18:46 user nova-compute[72382]:  {{(pid=72382) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 15:18:46 user nova-compute[72382]: DEBUG nova.virt.libvirt.vif [None req-f82d40e6-1278-4cc3-980f-a691c9b71d38 tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T15:18:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1136496910',display_name='tempest-VolumesAdminNegativeTest-server-1136496910',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1136496910',id=15,image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3b98e20f61c34fd6aa28cef7ceadf0d3',ramdisk_id='',reservation_id='r-78uiuzca',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-993781103',owner_user_name='tempest-VolumesAdminNegativeTest-993781103-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T15:18:44Z,user_data=None,user_id='374f2148fb524924acc7e1e968e73fe1',uuid=ea6afcf7-0b8b-43d8-af1d-9c132a659711,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4bb8ca7e-4ce8-4fc1-a5d0-4e3b5e796338", "address": "fa:16:3e:ea:a3:a5", "network": {"id": "1a0f18df-96f2-4c90-8e53-fcbfc8f17bc4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1771770150-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b98e20f61c34fd6aa28cef7ceadf0d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4bb8ca7e-4c", "ovs_interfaceid": "4bb8ca7e-4ce8-4fc1-a5d0-4e3b5e796338", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 15:18:46 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-f82d40e6-1278-4cc3-980f-a691c9b71d38 tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] Converting VIF {"id": "4bb8ca7e-4ce8-4fc1-a5d0-4e3b5e796338", "address": "fa:16:3e:ea:a3:a5", "network": {"id": "1a0f18df-96f2-4c90-8e53-fcbfc8f17bc4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1771770150-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b98e20f61c34fd6aa28cef7ceadf0d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4bb8ca7e-4c", "ovs_interfaceid": "4bb8ca7e-4ce8-4fc1-a5d0-4e3b5e796338", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 15:18:46 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-f82d40e6-1278-4cc3-980f-a691c9b71d38 tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ea:a3:a5,bridge_name='br-int',has_traffic_filtering=True,id=4bb8ca7e-4ce8-4fc1-a5d0-4e3b5e796338,network=Network(1a0f18df-96f2-4c90-8e53-fcbfc8f17bc4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4bb8ca7e-4c') {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 15:18:46 user nova-compute[72382]: DEBUG os_vif [None req-f82d40e6-1278-4cc3-980f-a691c9b71d38 tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:a3:a5,bridge_name='br-int',has_traffic_filtering=True,id=4bb8ca7e-4ce8-4fc1-a5d0-4e3b5e796338,network=Network(1a0f18df-96f2-4c90-8e53-fcbfc8f17bc4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4bb8ca7e-4c') {{(pid=72382) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 15:18:46 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:18:46 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:18:46 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 15:18:46 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:18:46 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4bb8ca7e-4c, may_exist=True, interface_attrs={}) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:18:46 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4bb8ca7e-4c, col_values=(('external_ids', {'iface-id': '4bb8ca7e-4ce8-4fc1-a5d0-4e3b5e796338', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ea:a3:a5', 'vm-uuid': 'ea6afcf7-0b8b-43d8-af1d-9c132a659711'}),), if_exists=True) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:18:46 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:18:46 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:18:46 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:18:46 user nova-compute[72382]: INFO os_vif [None req-f82d40e6-1278-4cc3-980f-a691c9b71d38 tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:a3:a5,bridge_name='br-int',has_traffic_filtering=True,id=4bb8ca7e-4ce8-4fc1-a5d0-4e3b5e796338,network=Network(1a0f18df-96f2-4c90-8e53-fcbfc8f17bc4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4bb8ca7e-4c')
Aug 09 15:18:46 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-f82d40e6-1278-4cc3-980f-a691c9b71d38 tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] No BDM found with device name vda, not building metadata. {{(pid=72382) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 15:18:46 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-f82d40e6-1278-4cc3-980f-a691c9b71d38 tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] No VIF found with MAC fa:16:3e:ea:a3:a5, not building metadata {{(pid=72382) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 15:18:47 user nova-compute[72382]: DEBUG nova.network.neutron [req-bad19af6-a8e7-4fe6-a454-4ebb45c12e9b req-2073fe97-4b36-46c9-acae-e92b18e5e831 service nova] [instance: ea6afcf7-0b8b-43d8-af1d-9c132a659711] Updated VIF entry in instance network info cache for port 4bb8ca7e-4ce8-4fc1-a5d0-4e3b5e796338. {{(pid=72382) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 15:18:47 user nova-compute[72382]: DEBUG nova.network.neutron [req-bad19af6-a8e7-4fe6-a454-4ebb45c12e9b req-2073fe97-4b36-46c9-acae-e92b18e5e831 service nova] [instance: ea6afcf7-0b8b-43d8-af1d-9c132a659711] Updating instance_info_cache with network_info: [{"id": "4bb8ca7e-4ce8-4fc1-a5d0-4e3b5e796338", "address": "fa:16:3e:ea:a3:a5", "network": {"id": "1a0f18df-96f2-4c90-8e53-fcbfc8f17bc4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1771770150-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b98e20f61c34fd6aa28cef7ceadf0d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4bb8ca7e-4c", "ovs_interfaceid": "4bb8ca7e-4ce8-4fc1-a5d0-4e3b5e796338", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:18:47 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-bad19af6-a8e7-4fe6-a454-4ebb45c12e9b req-2073fe97-4b36-46c9-acae-e92b18e5e831 service nova] Releasing lock "refresh_cache-ea6afcf7-0b8b-43d8-af1d-9c132a659711" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 15:18:48 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:18:48 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:18:48 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:18:48 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:18:48 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:18:48 user nova-compute[72382]: DEBUG nova.compute.manager [req-323bfab8-cdc8-45a4-9f32-54b4dc636722 req-ff0e7dc1-3881-48aa-a242-d153b728c3de service nova] [instance: ea6afcf7-0b8b-43d8-af1d-9c132a659711] Received event network-vif-plugged-4bb8ca7e-4ce8-4fc1-a5d0-4e3b5e796338 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:18:48 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-323bfab8-cdc8-45a4-9f32-54b4dc636722 req-ff0e7dc1-3881-48aa-a242-d153b728c3de service nova] Acquiring lock "ea6afcf7-0b8b-43d8-af1d-9c132a659711-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:18:48 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-323bfab8-cdc8-45a4-9f32-54b4dc636722 req-ff0e7dc1-3881-48aa-a242-d153b728c3de service nova] Lock "ea6afcf7-0b8b-43d8-af1d-9c132a659711-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:18:48 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-323bfab8-cdc8-45a4-9f32-54b4dc636722 req-ff0e7dc1-3881-48aa-a242-d153b728c3de service nova] Lock "ea6afcf7-0b8b-43d8-af1d-9c132a659711-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:18:48 user nova-compute[72382]: DEBUG nova.compute.manager [req-323bfab8-cdc8-45a4-9f32-54b4dc636722 req-ff0e7dc1-3881-48aa-a242-d153b728c3de service nova] [instance: ea6afcf7-0b8b-43d8-af1d-9c132a659711] No waiting events found dispatching network-vif-plugged-4bb8ca7e-4ce8-4fc1-a5d0-4e3b5e796338 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:18:48 user nova-compute[72382]: WARNING nova.compute.manager [req-323bfab8-cdc8-45a4-9f32-54b4dc636722 req-ff0e7dc1-3881-48aa-a242-d153b728c3de service nova] [instance: ea6afcf7-0b8b-43d8-af1d-9c132a659711] Received unexpected event network-vif-plugged-4bb8ca7e-4ce8-4fc1-a5d0-4e3b5e796338 for instance with vm_state building and task_state spawning.
Aug 09 15:18:48 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-f238e07a-2c2e-44ef-8f42-b77bea20193e tempest-VolumesAssistedSnapshotsTest-459543424 tempest-VolumesAssistedSnapshotsTest-459543424-project-member] Acquiring lock "f0a7fa25-4520-4f40-9515-b88e3d2fd910" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:18:48 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-f238e07a-2c2e-44ef-8f42-b77bea20193e tempest-VolumesAssistedSnapshotsTest-459543424 tempest-VolumesAssistedSnapshotsTest-459543424-project-member] Lock "f0a7fa25-4520-4f40-9515-b88e3d2fd910" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:18:48 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-f238e07a-2c2e-44ef-8f42-b77bea20193e tempest-VolumesAssistedSnapshotsTest-459543424 tempest-VolumesAssistedSnapshotsTest-459543424-project-member] Acquiring lock "f0a7fa25-4520-4f40-9515-b88e3d2fd910-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:18:48 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-f238e07a-2c2e-44ef-8f42-b77bea20193e tempest-VolumesAssistedSnapshotsTest-459543424 tempest-VolumesAssistedSnapshotsTest-459543424-project-member] Lock "f0a7fa25-4520-4f40-9515-b88e3d2fd910-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:18:48 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-f238e07a-2c2e-44ef-8f42-b77bea20193e tempest-VolumesAssistedSnapshotsTest-459543424 tempest-VolumesAssistedSnapshotsTest-459543424-project-member] Lock "f0a7fa25-4520-4f40-9515-b88e3d2fd910-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:18:48 user nova-compute[72382]: INFO nova.compute.manager [None req-f238e07a-2c2e-44ef-8f42-b77bea20193e tempest-VolumesAssistedSnapshotsTest-459543424 tempest-VolumesAssistedSnapshotsTest-459543424-project-member] [instance: f0a7fa25-4520-4f40-9515-b88e3d2fd910] Terminating instance
Aug 09 15:18:48 user nova-compute[72382]: DEBUG nova.compute.manager [None req-f238e07a-2c2e-44ef-8f42-b77bea20193e tempest-VolumesAssistedSnapshotsTest-459543424 tempest-VolumesAssistedSnapshotsTest-459543424-project-member] [instance: f0a7fa25-4520-4f40-9515-b88e3d2fd910] Start destroying the instance on the hypervisor. {{(pid=72382) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 15:18:48 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:18:48 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:18:48 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:18:48 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:18:49 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-55b3f601-ee38-4ae0-a419-4c74bbff7760 tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] Acquiring lock "23f25946-de3a-43fb-97a4-1f9a787e6e51" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:18:49 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-55b3f601-ee38-4ae0-a419-4c74bbff7760 tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] Lock "23f25946-de3a-43fb-97a4-1f9a787e6e51" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:18:49 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-55b3f601-ee38-4ae0-a419-4c74bbff7760 tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] Acquiring lock "23f25946-de3a-43fb-97a4-1f9a787e6e51-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:18:49 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-55b3f601-ee38-4ae0-a419-4c74bbff7760 tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] Lock "23f25946-de3a-43fb-97a4-1f9a787e6e51-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:18:49 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-55b3f601-ee38-4ae0-a419-4c74bbff7760 tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] Lock "23f25946-de3a-43fb-97a4-1f9a787e6e51-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:18:49 user nova-compute[72382]: INFO nova.compute.manager [None req-55b3f601-ee38-4ae0-a419-4c74bbff7760 tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] [instance: 23f25946-de3a-43fb-97a4-1f9a787e6e51] Terminating instance
Aug 09 15:18:49 user nova-compute[72382]: DEBUG nova.compute.manager [None req-55b3f601-ee38-4ae0-a419-4c74bbff7760 tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] [instance: 23f25946-de3a-43fb-97a4-1f9a787e6e51] Start destroying the instance on the hypervisor. {{(pid=72382) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 15:18:49 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:18:49 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:18:49 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:18:49 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:18:49 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:18:49 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:18:49 user nova-compute[72382]: INFO nova.virt.libvirt.driver [-] [instance: f0a7fa25-4520-4f40-9515-b88e3d2fd910] Instance destroyed successfully.
Aug 09 15:18:49 user nova-compute[72382]: DEBUG nova.objects.instance [None req-f238e07a-2c2e-44ef-8f42-b77bea20193e tempest-VolumesAssistedSnapshotsTest-459543424 tempest-VolumesAssistedSnapshotsTest-459543424-project-member] Lazy-loading 'resources' on Instance uuid f0a7fa25-4520-4f40-9515-b88e3d2fd910 {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:18:49 user nova-compute[72382]: DEBUG nova.virt.libvirt.vif [None req-f238e07a-2c2e-44ef-8f42-b77bea20193e tempest-VolumesAssistedSnapshotsTest-459543424 tempest-VolumesAssistedSnapshotsTest-459543424-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T15:15:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-199751692',display_name='tempest-VolumesAssistedSnapshotsTest-server-199751692',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-199751692',id=7,image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNxu0OS/NToDrwr8TZFshbe/JIUtEnU+tqzMSpGlDt7M12sNrzWEZR3BYOGiTVgImoLFrkmYFhFMHDKabEh2A0WEQqvaAu83twZck9/QqR2weIDWA2VeJXxATgkR1efc8Q==',key_name='tempest-keypair-1457840792',keypairs=<?>,launch_index=0,launched_at=2023-08-09T15:15:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dcde0eaf3243471280e72b35b04a1022',ramdisk_id='',reservation_id='r-rdk0kvj2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-459543424',owner_user_name='tempest-VolumesAssistedSnapshotsTest-459543424-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T15:15:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='51c6aec879314db3a142d69bcfbd18f3',uuid=f0a7fa25-4520-4f40-9515-b88e3d2fd910,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5b8a4395-5fb8-4ae6-a987-127e82862327", "address": "fa:16:3e:55:d7:da", "network": {"id": "cdb7cc30-fb6f-4cb2-8162-a15463a93a4a", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1417098143-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.27", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dcde0eaf3243471280e72b35b04a1022", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b8a4395-5f", "ovs_interfaceid": "5b8a4395-5fb8-4ae6-a987-127e82862327", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 15:18:49 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-f238e07a-2c2e-44ef-8f42-b77bea20193e tempest-VolumesAssistedSnapshotsTest-459543424 tempest-VolumesAssistedSnapshotsTest-459543424-project-member] Converting VIF {"id": "5b8a4395-5fb8-4ae6-a987-127e82862327", "address": "fa:16:3e:55:d7:da", "network": {"id": "cdb7cc30-fb6f-4cb2-8162-a15463a93a4a", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1417098143-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.27", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dcde0eaf3243471280e72b35b04a1022", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b8a4395-5f", "ovs_interfaceid": "5b8a4395-5fb8-4ae6-a987-127e82862327", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 15:18:49 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-f238e07a-2c2e-44ef-8f42-b77bea20193e tempest-VolumesAssistedSnapshotsTest-459543424 tempest-VolumesAssistedSnapshotsTest-459543424-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:55:d7:da,bridge_name='br-int',has_traffic_filtering=True,id=5b8a4395-5fb8-4ae6-a987-127e82862327,network=Network(cdb7cc30-fb6f-4cb2-8162-a15463a93a4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b8a4395-5f') {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 15:18:49 user nova-compute[72382]: DEBUG os_vif [None req-f238e07a-2c2e-44ef-8f42-b77bea20193e tempest-VolumesAssistedSnapshotsTest-459543424 tempest-VolumesAssistedSnapshotsTest-459543424-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:55:d7:da,bridge_name='br-int',has_traffic_filtering=True,id=5b8a4395-5fb8-4ae6-a987-127e82862327,network=Network(cdb7cc30-fb6f-4cb2-8162-a15463a93a4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b8a4395-5f') {{(pid=72382) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 15:18:49 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:18:49 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5b8a4395-5f, bridge=br-int, if_exists=True) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:18:49 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:18:49 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:18:49 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:18:49 user nova-compute[72382]: INFO os_vif [None req-f238e07a-2c2e-44ef-8f42-b77bea20193e tempest-VolumesAssistedSnapshotsTest-459543424 tempest-VolumesAssistedSnapshotsTest-459543424-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:55:d7:da,bridge_name='br-int',has_traffic_filtering=True,id=5b8a4395-5fb8-4ae6-a987-127e82862327,network=Network(cdb7cc30-fb6f-4cb2-8162-a15463a93a4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b8a4395-5f')
Aug 09 15:18:49 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-f238e07a-2c2e-44ef-8f42-b77bea20193e tempest-VolumesAssistedSnapshotsTest-459543424 tempest-VolumesAssistedSnapshotsTest-459543424-project-member] [instance: f0a7fa25-4520-4f40-9515-b88e3d2fd910] Deleting instance files /opt/stack/data/nova/instances/f0a7fa25-4520-4f40-9515-b88e3d2fd910_del
Aug 09 15:18:49 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-f238e07a-2c2e-44ef-8f42-b77bea20193e tempest-VolumesAssistedSnapshotsTest-459543424 tempest-VolumesAssistedSnapshotsTest-459543424-project-member] [instance: f0a7fa25-4520-4f40-9515-b88e3d2fd910] Deletion of /opt/stack/data/nova/instances/f0a7fa25-4520-4f40-9515-b88e3d2fd910_del complete
Aug 09 15:18:49 user nova-compute[72382]: DEBUG nova.compute.manager [req-ba2177aa-79ae-4aa0-97f7-cfb7ab608baf req-ab85e0ec-09a0-4d5e-8a2a-11c14e8d7ad0 service nova] [instance: 23f25946-de3a-43fb-97a4-1f9a787e6e51] Received event network-vif-unplugged-1c588f02-cc2c-47f1-8918-bf9b1d3ea215 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:18:49 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-ba2177aa-79ae-4aa0-97f7-cfb7ab608baf req-ab85e0ec-09a0-4d5e-8a2a-11c14e8d7ad0 service nova] Acquiring lock "23f25946-de3a-43fb-97a4-1f9a787e6e51-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:18:49 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-ba2177aa-79ae-4aa0-97f7-cfb7ab608baf req-ab85e0ec-09a0-4d5e-8a2a-11c14e8d7ad0 service nova] Lock "23f25946-de3a-43fb-97a4-1f9a787e6e51-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:18:49 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-ba2177aa-79ae-4aa0-97f7-cfb7ab608baf req-ab85e0ec-09a0-4d5e-8a2a-11c14e8d7ad0 service nova] Lock "23f25946-de3a-43fb-97a4-1f9a787e6e51-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:18:49 user nova-compute[72382]: DEBUG nova.compute.manager [req-ba2177aa-79ae-4aa0-97f7-cfb7ab608baf req-ab85e0ec-09a0-4d5e-8a2a-11c14e8d7ad0 service nova] [instance: 23f25946-de3a-43fb-97a4-1f9a787e6e51] No waiting events found dispatching network-vif-unplugged-1c588f02-cc2c-47f1-8918-bf9b1d3ea215 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:18:49 user nova-compute[72382]: DEBUG nova.compute.manager [req-ba2177aa-79ae-4aa0-97f7-cfb7ab608baf req-ab85e0ec-09a0-4d5e-8a2a-11c14e8d7ad0 service nova] [instance: 23f25946-de3a-43fb-97a4-1f9a787e6e51] Received event network-vif-unplugged-1c588f02-cc2c-47f1-8918-bf9b1d3ea215 for instance with task_state deleting. {{(pid=72382) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 15:18:49 user nova-compute[72382]: INFO nova.compute.manager [None req-f238e07a-2c2e-44ef-8f42-b77bea20193e tempest-VolumesAssistedSnapshotsTest-459543424 tempest-VolumesAssistedSnapshotsTest-459543424-project-member] [instance: f0a7fa25-4520-4f40-9515-b88e3d2fd910] Took 1.01 seconds to destroy the instance on the hypervisor.
Aug 09 15:18:49 user nova-compute[72382]: DEBUG oslo.service.loopingcall [None req-f238e07a-2c2e-44ef-8f42-b77bea20193e tempest-VolumesAssistedSnapshotsTest-459543424 tempest-VolumesAssistedSnapshotsTest-459543424-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72382) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 15:18:49 user nova-compute[72382]: DEBUG nova.compute.manager [-] [instance: f0a7fa25-4520-4f40-9515-b88e3d2fd910] Deallocating network for instance {{(pid=72382) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 15:18:49 user nova-compute[72382]: DEBUG nova.network.neutron [-] [instance: f0a7fa25-4520-4f40-9515-b88e3d2fd910] deallocate_for_instance() {{(pid=72382) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 15:18:49 user nova-compute[72382]: INFO nova.virt.libvirt.driver [-] [instance: 23f25946-de3a-43fb-97a4-1f9a787e6e51] Instance destroyed successfully.
Aug 09 15:18:49 user nova-compute[72382]: DEBUG nova.objects.instance [None req-55b3f601-ee38-4ae0-a419-4c74bbff7760 tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] Lazy-loading 'resources' on Instance uuid 23f25946-de3a-43fb-97a4-1f9a787e6e51 {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:18:49 user nova-compute[72382]: DEBUG nova.virt.libvirt.vif [None req-55b3f601-ee38-4ae0-a419-4c74bbff7760 tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T15:15:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-176087286',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-176087286',id=9,image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF4pKUdXj5zZfLZFWCxFHz8jMa5yp/7/IPCXi1mkSKd0mYycvxd7H8zaZJVqn1Nt7uBCqZDaWzic3f3975RUjfs8oAsAozBRZ/XXtDelWRnO6lHLhAgDLjQA+jzema7e1g==',key_name='tempest-keypair-1955626579',keypairs=<?>,launch_index=0,launched_at=2023-08-09T15:15:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b84d09ad643146859e76996c09ba02c7',ramdisk_id='',reservation_id='r-sy0nsoiy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-605331854',owner_user_name='tempest-TaggedAttachmentsTest-605331854-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T15:16:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='97fa102d2fed4045a326b0f5efbd1b1c',uuid=23f25946-de3a-43fb-97a4-1f9a787e6e51,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1c588f02-cc2c-47f1-8918-bf9b1d3ea215", "address": "fa:16:3e:b1:4d:7d", "network": {"id": "e5132afa-231c-471e-b11a-a6e972603b0c", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2085484007-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b84d09ad643146859e76996c09ba02c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c588f02-cc", "ovs_interfaceid": "1c588f02-cc2c-47f1-8918-bf9b1d3ea215", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 15:18:49 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-55b3f601-ee38-4ae0-a419-4c74bbff7760 tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] Converting VIF {"id": "1c588f02-cc2c-47f1-8918-bf9b1d3ea215", "address": "fa:16:3e:b1:4d:7d", "network": {"id": "e5132afa-231c-471e-b11a-a6e972603b0c", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2085484007-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b84d09ad643146859e76996c09ba02c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c588f02-cc", "ovs_interfaceid": "1c588f02-cc2c-47f1-8918-bf9b1d3ea215", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 15:18:49 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-55b3f601-ee38-4ae0-a419-4c74bbff7760 tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b1:4d:7d,bridge_name='br-int',has_traffic_filtering=True,id=1c588f02-cc2c-47f1-8918-bf9b1d3ea215,network=Network(e5132afa-231c-471e-b11a-a6e972603b0c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c588f02-cc') {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 15:18:49 user nova-compute[72382]: DEBUG os_vif [None req-55b3f601-ee38-4ae0-a419-4c74bbff7760 tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b1:4d:7d,bridge_name='br-int',has_traffic_filtering=True,id=1c588f02-cc2c-47f1-8918-bf9b1d3ea215,network=Network(e5132afa-231c-471e-b11a-a6e972603b0c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c588f02-cc') {{(pid=72382) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 15:18:49 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:18:49 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1c588f02-cc, bridge=br-int, if_exists=True) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:18:49 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:18:49 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:18:49 user nova-compute[72382]: INFO os_vif [None req-55b3f601-ee38-4ae0-a419-4c74bbff7760 tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b1:4d:7d,bridge_name='br-int',has_traffic_filtering=True,id=1c588f02-cc2c-47f1-8918-bf9b1d3ea215,network=Network(e5132afa-231c-471e-b11a-a6e972603b0c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c588f02-cc')
Aug 09 15:18:49 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-55b3f601-ee38-4ae0-a419-4c74bbff7760 tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] [instance: 23f25946-de3a-43fb-97a4-1f9a787e6e51] Deleting instance files /opt/stack/data/nova/instances/23f25946-de3a-43fb-97a4-1f9a787e6e51_del
Aug 09 15:18:49 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-55b3f601-ee38-4ae0-a419-4c74bbff7760 tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] [instance: 23f25946-de3a-43fb-97a4-1f9a787e6e51] Deletion of /opt/stack/data/nova/instances/23f25946-de3a-43fb-97a4-1f9a787e6e51_del complete
Aug 09 15:18:49 user nova-compute[72382]: INFO nova.compute.manager [None req-55b3f601-ee38-4ae0-a419-4c74bbff7760 tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] [instance: 23f25946-de3a-43fb-97a4-1f9a787e6e51] Took 0.94 seconds to destroy the instance on the hypervisor.
Aug 09 15:18:49 user nova-compute[72382]: DEBUG oslo.service.loopingcall [None req-55b3f601-ee38-4ae0-a419-4c74bbff7760 tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72382) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 15:18:49 user nova-compute[72382]: DEBUG nova.compute.manager [-] [instance: 23f25946-de3a-43fb-97a4-1f9a787e6e51] Deallocating network for instance {{(pid=72382) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 15:18:49 user nova-compute[72382]: DEBUG nova.network.neutron [-] [instance: 23f25946-de3a-43fb-97a4-1f9a787e6e51] deallocate_for_instance() {{(pid=72382) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 15:18:50 user nova-compute[72382]: DEBUG nova.compute.manager [req-0b74bfd5-63cf-4d1a-8a4a-c8be6522e5ac req-1a583df6-64f5-4782-b5c7-1fb6bd4f86da service nova] [instance: ea6afcf7-0b8b-43d8-af1d-9c132a659711] Received event network-vif-plugged-4bb8ca7e-4ce8-4fc1-a5d0-4e3b5e796338 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:18:50 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-0b74bfd5-63cf-4d1a-8a4a-c8be6522e5ac req-1a583df6-64f5-4782-b5c7-1fb6bd4f86da service nova] Acquiring lock "ea6afcf7-0b8b-43d8-af1d-9c132a659711-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:18:50 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-0b74bfd5-63cf-4d1a-8a4a-c8be6522e5ac req-1a583df6-64f5-4782-b5c7-1fb6bd4f86da service nova] Lock "ea6afcf7-0b8b-43d8-af1d-9c132a659711-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:18:50 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-0b74bfd5-63cf-4d1a-8a4a-c8be6522e5ac req-1a583df6-64f5-4782-b5c7-1fb6bd4f86da service nova] Lock "ea6afcf7-0b8b-43d8-af1d-9c132a659711-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:18:50 user nova-compute[72382]: DEBUG nova.compute.manager [req-0b74bfd5-63cf-4d1a-8a4a-c8be6522e5ac req-1a583df6-64f5-4782-b5c7-1fb6bd4f86da service nova] [instance: ea6afcf7-0b8b-43d8-af1d-9c132a659711] No waiting events found dispatching network-vif-plugged-4bb8ca7e-4ce8-4fc1-a5d0-4e3b5e796338 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:18:50 user nova-compute[72382]: WARNING nova.compute.manager [req-0b74bfd5-63cf-4d1a-8a4a-c8be6522e5ac req-1a583df6-64f5-4782-b5c7-1fb6bd4f86da service nova] [instance: ea6afcf7-0b8b-43d8-af1d-9c132a659711] Received unexpected event network-vif-plugged-4bb8ca7e-4ce8-4fc1-a5d0-4e3b5e796338 for instance with vm_state building and task_state spawning.
Aug 09 15:18:50 user nova-compute[72382]: DEBUG nova.compute.manager [req-0b74bfd5-63cf-4d1a-8a4a-c8be6522e5ac req-1a583df6-64f5-4782-b5c7-1fb6bd4f86da service nova] [instance: f0a7fa25-4520-4f40-9515-b88e3d2fd910] Received event network-vif-unplugged-5b8a4395-5fb8-4ae6-a987-127e82862327 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:18:50 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-0b74bfd5-63cf-4d1a-8a4a-c8be6522e5ac req-1a583df6-64f5-4782-b5c7-1fb6bd4f86da service nova] Acquiring lock "f0a7fa25-4520-4f40-9515-b88e3d2fd910-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:18:50 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-0b74bfd5-63cf-4d1a-8a4a-c8be6522e5ac req-1a583df6-64f5-4782-b5c7-1fb6bd4f86da service nova] Lock "f0a7fa25-4520-4f40-9515-b88e3d2fd910-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:18:50 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-0b74bfd5-63cf-4d1a-8a4a-c8be6522e5ac req-1a583df6-64f5-4782-b5c7-1fb6bd4f86da service nova] Lock "f0a7fa25-4520-4f40-9515-b88e3d2fd910-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:18:50 user nova-compute[72382]: DEBUG nova.compute.manager [req-0b74bfd5-63cf-4d1a-8a4a-c8be6522e5ac req-1a583df6-64f5-4782-b5c7-1fb6bd4f86da service nova] [instance: f0a7fa25-4520-4f40-9515-b88e3d2fd910] No waiting events found dispatching network-vif-unplugged-5b8a4395-5fb8-4ae6-a987-127e82862327 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:18:50 user nova-compute[72382]: DEBUG nova.compute.manager [req-0b74bfd5-63cf-4d1a-8a4a-c8be6522e5ac req-1a583df6-64f5-4782-b5c7-1fb6bd4f86da service nova] [instance: f0a7fa25-4520-4f40-9515-b88e3d2fd910] Received event network-vif-unplugged-5b8a4395-5fb8-4ae6-a987-127e82862327 for instance with task_state deleting. {{(pid=72382) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 15:18:50 user nova-compute[72382]: DEBUG nova.compute.manager [req-0b74bfd5-63cf-4d1a-8a4a-c8be6522e5ac req-1a583df6-64f5-4782-b5c7-1fb6bd4f86da service nova] [instance: f0a7fa25-4520-4f40-9515-b88e3d2fd910] Received event network-vif-plugged-5b8a4395-5fb8-4ae6-a987-127e82862327 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:18:50 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-0b74bfd5-63cf-4d1a-8a4a-c8be6522e5ac req-1a583df6-64f5-4782-b5c7-1fb6bd4f86da service nova] Acquiring lock "f0a7fa25-4520-4f40-9515-b88e3d2fd910-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:18:50 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-0b74bfd5-63cf-4d1a-8a4a-c8be6522e5ac req-1a583df6-64f5-4782-b5c7-1fb6bd4f86da service nova] Lock "f0a7fa25-4520-4f40-9515-b88e3d2fd910-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:18:50 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-0b74bfd5-63cf-4d1a-8a4a-c8be6522e5ac req-1a583df6-64f5-4782-b5c7-1fb6bd4f86da service nova] Lock "f0a7fa25-4520-4f40-9515-b88e3d2fd910-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:18:50 user nova-compute[72382]: DEBUG nova.compute.manager [req-0b74bfd5-63cf-4d1a-8a4a-c8be6522e5ac req-1a583df6-64f5-4782-b5c7-1fb6bd4f86da service nova] [instance: f0a7fa25-4520-4f40-9515-b88e3d2fd910] No waiting events found dispatching network-vif-plugged-5b8a4395-5fb8-4ae6-a987-127e82862327 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:18:50 user nova-compute[72382]: WARNING nova.compute.manager [req-0b74bfd5-63cf-4d1a-8a4a-c8be6522e5ac req-1a583df6-64f5-4782-b5c7-1fb6bd4f86da service nova] [instance: f0a7fa25-4520-4f40-9515-b88e3d2fd910] Received unexpected event network-vif-plugged-5b8a4395-5fb8-4ae6-a987-127e82862327 for instance with vm_state active and task_state deleting.
Aug 09 15:18:50 user nova-compute[72382]: DEBUG nova.virt.driver [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Emitting event <LifecycleEvent: 1691594330.686125, ea6afcf7-0b8b-43d8-af1d-9c132a659711 => Resumed> {{(pid=72382) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 15:18:50 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: ea6afcf7-0b8b-43d8-af1d-9c132a659711] VM Resumed (Lifecycle Event)
Aug 09 15:18:50 user nova-compute[72382]: DEBUG nova.compute.manager [None req-f82d40e6-1278-4cc3-980f-a691c9b71d38 tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] [instance: ea6afcf7-0b8b-43d8-af1d-9c132a659711] Instance event wait completed in 0 seconds for  {{(pid=72382) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 15:18:50 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-f82d40e6-1278-4cc3-980f-a691c9b71d38 tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] [instance: ea6afcf7-0b8b-43d8-af1d-9c132a659711] Guest created on hypervisor {{(pid=72382) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 15:18:50 user nova-compute[72382]: INFO nova.virt.libvirt.driver [-] [instance: ea6afcf7-0b8b-43d8-af1d-9c132a659711] Instance spawned successfully.
Aug 09 15:18:50 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-f82d40e6-1278-4cc3-980f-a691c9b71d38 tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] [instance: ea6afcf7-0b8b-43d8-af1d-9c132a659711] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 15:18:50 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: ea6afcf7-0b8b-43d8-af1d-9c132a659711] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:18:50 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-f82d40e6-1278-4cc3-980f-a691c9b71d38 tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] [instance: ea6afcf7-0b8b-43d8-af1d-9c132a659711] Found default for hw_cdrom_bus of ide {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:18:50 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-f82d40e6-1278-4cc3-980f-a691c9b71d38 tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] [instance: ea6afcf7-0b8b-43d8-af1d-9c132a659711] Found default for hw_disk_bus of virtio {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:18:50 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-f82d40e6-1278-4cc3-980f-a691c9b71d38 tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] [instance: ea6afcf7-0b8b-43d8-af1d-9c132a659711] Found default for hw_input_bus of None {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:18:50 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-f82d40e6-1278-4cc3-980f-a691c9b71d38 tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] [instance: ea6afcf7-0b8b-43d8-af1d-9c132a659711] Found default for hw_pointer_model of None {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:18:50 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-f82d40e6-1278-4cc3-980f-a691c9b71d38 tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] [instance: ea6afcf7-0b8b-43d8-af1d-9c132a659711] Found default for hw_video_model of virtio {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:18:50 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-f82d40e6-1278-4cc3-980f-a691c9b71d38 tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] [instance: ea6afcf7-0b8b-43d8-af1d-9c132a659711] Found default for hw_vif_model of virtio {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:18:50 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: ea6afcf7-0b8b-43d8-af1d-9c132a659711] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72382) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 15:18:50 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: ea6afcf7-0b8b-43d8-af1d-9c132a659711] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 15:18:50 user nova-compute[72382]: DEBUG nova.virt.driver [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Emitting event <LifecycleEvent: 1691594330.6870842, ea6afcf7-0b8b-43d8-af1d-9c132a659711 => Started> {{(pid=72382) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 15:18:50 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: ea6afcf7-0b8b-43d8-af1d-9c132a659711] VM Started (Lifecycle Event)
Aug 09 15:18:50 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: ea6afcf7-0b8b-43d8-af1d-9c132a659711] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:18:50 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: ea6afcf7-0b8b-43d8-af1d-9c132a659711] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72382) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 15:18:50 user nova-compute[72382]: INFO nova.compute.manager [None req-f82d40e6-1278-4cc3-980f-a691c9b71d38 tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] [instance: ea6afcf7-0b8b-43d8-af1d-9c132a659711] Took 6.65 seconds to spawn the instance on the hypervisor.
Aug 09 15:18:50 user nova-compute[72382]: DEBUG nova.compute.manager [None req-f82d40e6-1278-4cc3-980f-a691c9b71d38 tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] [instance: ea6afcf7-0b8b-43d8-af1d-9c132a659711] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:18:50 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: ea6afcf7-0b8b-43d8-af1d-9c132a659711] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 15:18:50 user nova-compute[72382]: INFO nova.compute.manager [None req-f82d40e6-1278-4cc3-980f-a691c9b71d38 tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] [instance: ea6afcf7-0b8b-43d8-af1d-9c132a659711] Took 7.56 seconds to build instance.
Aug 09 15:18:50 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-f82d40e6-1278-4cc3-980f-a691c9b71d38 tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] Lock "ea6afcf7-0b8b-43d8-af1d-9c132a659711" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.648s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:18:51 user nova-compute[72382]: DEBUG nova.network.neutron [-] [instance: f0a7fa25-4520-4f40-9515-b88e3d2fd910] Updating instance_info_cache with network_info: [] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:18:51 user nova-compute[72382]: INFO nova.compute.manager [-] [instance: f0a7fa25-4520-4f40-9515-b88e3d2fd910] Took 1.76 seconds to deallocate network for instance.
Aug 09 15:18:51 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-f238e07a-2c2e-44ef-8f42-b77bea20193e tempest-VolumesAssistedSnapshotsTest-459543424 tempest-VolumesAssistedSnapshotsTest-459543424-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:18:51 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-f238e07a-2c2e-44ef-8f42-b77bea20193e tempest-VolumesAssistedSnapshotsTest-459543424 tempest-VolumesAssistedSnapshotsTest-459543424-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:18:51 user nova-compute[72382]: DEBUG nova.compute.manager [req-b42e5588-16f9-40a2-817c-5f1c88702107 req-390ff9c7-ee46-4eb9-ab62-a3a846a667ee service nova] [instance: 23f25946-de3a-43fb-97a4-1f9a787e6e51] Received event network-vif-plugged-1c588f02-cc2c-47f1-8918-bf9b1d3ea215 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:18:51 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-b42e5588-16f9-40a2-817c-5f1c88702107 req-390ff9c7-ee46-4eb9-ab62-a3a846a667ee service nova] Acquiring lock "23f25946-de3a-43fb-97a4-1f9a787e6e51-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:18:51 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-b42e5588-16f9-40a2-817c-5f1c88702107 req-390ff9c7-ee46-4eb9-ab62-a3a846a667ee service nova] Lock "23f25946-de3a-43fb-97a4-1f9a787e6e51-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:18:51 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-b42e5588-16f9-40a2-817c-5f1c88702107 req-390ff9c7-ee46-4eb9-ab62-a3a846a667ee service nova] Lock "23f25946-de3a-43fb-97a4-1f9a787e6e51-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:18:51 user nova-compute[72382]: DEBUG nova.compute.manager [req-b42e5588-16f9-40a2-817c-5f1c88702107 req-390ff9c7-ee46-4eb9-ab62-a3a846a667ee service nova] [instance: 23f25946-de3a-43fb-97a4-1f9a787e6e51] No waiting events found dispatching network-vif-plugged-1c588f02-cc2c-47f1-8918-bf9b1d3ea215 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:18:51 user nova-compute[72382]: WARNING nova.compute.manager [req-b42e5588-16f9-40a2-817c-5f1c88702107 req-390ff9c7-ee46-4eb9-ab62-a3a846a667ee service nova] [instance: 23f25946-de3a-43fb-97a4-1f9a787e6e51] Received unexpected event network-vif-plugged-1c588f02-cc2c-47f1-8918-bf9b1d3ea215 for instance with vm_state active and task_state deleting.
Aug 09 15:18:51 user nova-compute[72382]: DEBUG nova.compute.manager [req-b42e5588-16f9-40a2-817c-5f1c88702107 req-390ff9c7-ee46-4eb9-ab62-a3a846a667ee service nova] [instance: f0a7fa25-4520-4f40-9515-b88e3d2fd910] Received event network-vif-deleted-5b8a4395-5fb8-4ae6-a987-127e82862327 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:18:51 user nova-compute[72382]: DEBUG nova.network.neutron [-] [instance: 23f25946-de3a-43fb-97a4-1f9a787e6e51] Updating instance_info_cache with network_info: [] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:18:51 user nova-compute[72382]: INFO nova.compute.manager [-] [instance: 23f25946-de3a-43fb-97a4-1f9a787e6e51] Took 1.90 seconds to deallocate network for instance.
Aug 09 15:18:51 user nova-compute[72382]: DEBUG nova.compute.provider_tree [None req-f238e07a-2c2e-44ef-8f42-b77bea20193e tempest-VolumesAssistedSnapshotsTest-459543424 tempest-VolumesAssistedSnapshotsTest-459543424-project-member] Inventory has not changed in ProviderTree for provider: 7b15b0e5-df4d-49db-833b-2855d21d10ae {{(pid=72382) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 15:18:51 user nova-compute[72382]: DEBUG nova.scheduler.client.report [None req-f238e07a-2c2e-44ef-8f42-b77bea20193e tempest-VolumesAssistedSnapshotsTest-459543424 tempest-VolumesAssistedSnapshotsTest-459543424-project-member] Inventory has not changed for provider 7b15b0e5-df4d-49db-833b-2855d21d10ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72382) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 15:18:51 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-55b3f601-ee38-4ae0-a419-4c74bbff7760 tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:18:51 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-f238e07a-2c2e-44ef-8f42-b77bea20193e tempest-VolumesAssistedSnapshotsTest-459543424 tempest-VolumesAssistedSnapshotsTest-459543424-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.516s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:18:51 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-55b3f601-ee38-4ae0-a419-4c74bbff7760 tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.022s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:18:52 user nova-compute[72382]: INFO nova.scheduler.client.report [None req-f238e07a-2c2e-44ef-8f42-b77bea20193e tempest-VolumesAssistedSnapshotsTest-459543424 tempest-VolumesAssistedSnapshotsTest-459543424-project-member] Deleted allocations for instance f0a7fa25-4520-4f40-9515-b88e3d2fd910
Aug 09 15:18:52 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-f238e07a-2c2e-44ef-8f42-b77bea20193e tempest-VolumesAssistedSnapshotsTest-459543424 tempest-VolumesAssistedSnapshotsTest-459543424-project-member] Lock "f0a7fa25-4520-4f40-9515-b88e3d2fd910" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.523s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:18:52 user nova-compute[72382]: DEBUG nova.compute.provider_tree [None req-55b3f601-ee38-4ae0-a419-4c74bbff7760 tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] Inventory has not changed in ProviderTree for provider: 7b15b0e5-df4d-49db-833b-2855d21d10ae {{(pid=72382) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 15:18:52 user nova-compute[72382]: DEBUG nova.scheduler.client.report [None req-55b3f601-ee38-4ae0-a419-4c74bbff7760 tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] Inventory has not changed for provider 7b15b0e5-df4d-49db-833b-2855d21d10ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72382) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 15:18:52 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-55b3f601-ee38-4ae0-a419-4c74bbff7760 tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.442s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:18:52 user nova-compute[72382]: INFO nova.scheduler.client.report [None req-55b3f601-ee38-4ae0-a419-4c74bbff7760 tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] Deleted allocations for instance 23f25946-de3a-43fb-97a4-1f9a787e6e51
Aug 09 15:18:52 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-55b3f601-ee38-4ae0-a419-4c74bbff7760 tempest-TaggedAttachmentsTest-605331854 tempest-TaggedAttachmentsTest-605331854-project-member] Lock "23f25946-de3a-43fb-97a4-1f9a787e6e51" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.527s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:18:53 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5b53529-2c3e-4da2-a100-2b5c0ebf4882 tempest-ServersNegativeTestJSON-1671359082 tempest-ServersNegativeTestJSON-1671359082-project-member] Acquiring lock "8b4be6ea-c8f6-420b-9453-c0558b6c4b9f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:18:53 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5b53529-2c3e-4da2-a100-2b5c0ebf4882 tempest-ServersNegativeTestJSON-1671359082 tempest-ServersNegativeTestJSON-1671359082-project-member] Lock "8b4be6ea-c8f6-420b-9453-c0558b6c4b9f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:18:53 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5b53529-2c3e-4da2-a100-2b5c0ebf4882 tempest-ServersNegativeTestJSON-1671359082 tempest-ServersNegativeTestJSON-1671359082-project-member] Acquiring lock "8b4be6ea-c8f6-420b-9453-c0558b6c4b9f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:18:53 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5b53529-2c3e-4da2-a100-2b5c0ebf4882 tempest-ServersNegativeTestJSON-1671359082 tempest-ServersNegativeTestJSON-1671359082-project-member] Lock "8b4be6ea-c8f6-420b-9453-c0558b6c4b9f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:18:53 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5b53529-2c3e-4da2-a100-2b5c0ebf4882 tempest-ServersNegativeTestJSON-1671359082 tempest-ServersNegativeTestJSON-1671359082-project-member] Lock "8b4be6ea-c8f6-420b-9453-c0558b6c4b9f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:18:53 user nova-compute[72382]: INFO nova.compute.manager [None req-e5b53529-2c3e-4da2-a100-2b5c0ebf4882 tempest-ServersNegativeTestJSON-1671359082 tempest-ServersNegativeTestJSON-1671359082-project-member] [instance: 8b4be6ea-c8f6-420b-9453-c0558b6c4b9f] Terminating instance
Aug 09 15:18:53 user nova-compute[72382]: DEBUG nova.compute.manager [None req-e5b53529-2c3e-4da2-a100-2b5c0ebf4882 tempest-ServersNegativeTestJSON-1671359082 tempest-ServersNegativeTestJSON-1671359082-project-member] [instance: 8b4be6ea-c8f6-420b-9453-c0558b6c4b9f] Start destroying the instance on the hypervisor. {{(pid=72382) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 15:18:53 user nova-compute[72382]: DEBUG nova.compute.manager [req-78eb651e-058b-4946-85c0-af24386a0d74 req-e44a5274-7067-44fc-a793-f913420897da service nova] [instance: 23f25946-de3a-43fb-97a4-1f9a787e6e51] Received event network-vif-deleted-1c588f02-cc2c-47f1-8918-bf9b1d3ea215 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:18:53 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:18:53 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:18:53 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:18:54 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:18:54 user nova-compute[72382]: DEBUG nova.compute.manager [req-c99d38ae-9a15-4694-92ad-39758b556f91 req-71eb83d2-6463-4429-a822-3089057a4bac service nova] [instance: 8b4be6ea-c8f6-420b-9453-c0558b6c4b9f] Received event network-vif-unplugged-69b23d47-a252-4a81-8119-00c851da530d {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:18:54 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-c99d38ae-9a15-4694-92ad-39758b556f91 req-71eb83d2-6463-4429-a822-3089057a4bac service nova] Acquiring lock "8b4be6ea-c8f6-420b-9453-c0558b6c4b9f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:18:54 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-c99d38ae-9a15-4694-92ad-39758b556f91 req-71eb83d2-6463-4429-a822-3089057a4bac service nova] Lock "8b4be6ea-c8f6-420b-9453-c0558b6c4b9f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:18:54 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-c99d38ae-9a15-4694-92ad-39758b556f91 req-71eb83d2-6463-4429-a822-3089057a4bac service nova] Lock "8b4be6ea-c8f6-420b-9453-c0558b6c4b9f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:18:54 user nova-compute[72382]: DEBUG nova.compute.manager [req-c99d38ae-9a15-4694-92ad-39758b556f91 req-71eb83d2-6463-4429-a822-3089057a4bac service nova] [instance: 8b4be6ea-c8f6-420b-9453-c0558b6c4b9f] No waiting events found dispatching network-vif-unplugged-69b23d47-a252-4a81-8119-00c851da530d {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:18:54 user nova-compute[72382]: DEBUG nova.compute.manager [req-c99d38ae-9a15-4694-92ad-39758b556f91 req-71eb83d2-6463-4429-a822-3089057a4bac service nova] [instance: 8b4be6ea-c8f6-420b-9453-c0558b6c4b9f] Received event network-vif-unplugged-69b23d47-a252-4a81-8119-00c851da530d for instance with task_state deleting. {{(pid=72382) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 15:18:54 user nova-compute[72382]: INFO nova.virt.libvirt.driver [-] [instance: 8b4be6ea-c8f6-420b-9453-c0558b6c4b9f] Instance destroyed successfully.
Aug 09 15:18:54 user nova-compute[72382]: DEBUG nova.objects.instance [None req-e5b53529-2c3e-4da2-a100-2b5c0ebf4882 tempest-ServersNegativeTestJSON-1671359082 tempest-ServersNegativeTestJSON-1671359082-project-member] Lazy-loading 'resources' on Instance uuid 8b4be6ea-c8f6-420b-9453-c0558b6c4b9f {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:18:54 user nova-compute[72382]: DEBUG nova.virt.libvirt.vif [None req-e5b53529-2c3e-4da2-a100-2b5c0ebf4882 tempest-ServersNegativeTestJSON-1671359082 tempest-ServersNegativeTestJSON-1671359082-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T15:17:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1006877955',display_name='tempest-ServersNegativeTestJSON-server-1006877955',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1006877955',id=13,image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-09T15:17:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8995b21c93c24ab19fcfad5c4939509f',ramdisk_id='',reservation_id='r-t415205w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1671359082',owner_user_name='tempest-ServersNegativeTestJSON-1671359082-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T15:17:12Z,user_data=None,user_id='5e4b3ed6be8f4c99ba979398388bf12d',uuid=8b4be6ea-c8f6-420b-9453-c0558b6c4b9f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "69b23d47-a252-4a81-8119-00c851da530d", "address": "fa:16:3e:15:5d:a8", "network": {"id": "32d8bb03-1dc6-499b-8b79-48938664dd3b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1565950502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8995b21c93c24ab19fcfad5c4939509f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69b23d47-a2", "ovs_interfaceid": "69b23d47-a252-4a81-8119-00c851da530d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 15:18:54 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-e5b53529-2c3e-4da2-a100-2b5c0ebf4882 tempest-ServersNegativeTestJSON-1671359082 tempest-ServersNegativeTestJSON-1671359082-project-member] Converting VIF {"id": "69b23d47-a252-4a81-8119-00c851da530d", "address": "fa:16:3e:15:5d:a8", "network": {"id": "32d8bb03-1dc6-499b-8b79-48938664dd3b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1565950502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8995b21c93c24ab19fcfad5c4939509f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69b23d47-a2", "ovs_interfaceid": "69b23d47-a252-4a81-8119-00c851da530d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 15:18:54 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-e5b53529-2c3e-4da2-a100-2b5c0ebf4882 tempest-ServersNegativeTestJSON-1671359082 tempest-ServersNegativeTestJSON-1671359082-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:15:5d:a8,bridge_name='br-int',has_traffic_filtering=True,id=69b23d47-a252-4a81-8119-00c851da530d,network=Network(32d8bb03-1dc6-499b-8b79-48938664dd3b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69b23d47-a2') {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 15:18:54 user nova-compute[72382]: DEBUG os_vif [None req-e5b53529-2c3e-4da2-a100-2b5c0ebf4882 tempest-ServersNegativeTestJSON-1671359082 tempest-ServersNegativeTestJSON-1671359082-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:5d:a8,bridge_name='br-int',has_traffic_filtering=True,id=69b23d47-a252-4a81-8119-00c851da530d,network=Network(32d8bb03-1dc6-499b-8b79-48938664dd3b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69b23d47-a2') {{(pid=72382) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 15:18:54 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:18:54 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap69b23d47-a2, bridge=br-int, if_exists=True) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:18:54 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:18:54 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:18:54 user nova-compute[72382]: INFO os_vif [None req-e5b53529-2c3e-4da2-a100-2b5c0ebf4882 tempest-ServersNegativeTestJSON-1671359082 tempest-ServersNegativeTestJSON-1671359082-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:5d:a8,bridge_name='br-int',has_traffic_filtering=True,id=69b23d47-a252-4a81-8119-00c851da530d,network=Network(32d8bb03-1dc6-499b-8b79-48938664dd3b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69b23d47-a2')
Aug 09 15:18:54 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-e5b53529-2c3e-4da2-a100-2b5c0ebf4882 tempest-ServersNegativeTestJSON-1671359082 tempest-ServersNegativeTestJSON-1671359082-project-member] [instance: 8b4be6ea-c8f6-420b-9453-c0558b6c4b9f] Deleting instance files /opt/stack/data/nova/instances/8b4be6ea-c8f6-420b-9453-c0558b6c4b9f_del
Aug 09 15:18:54 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-e5b53529-2c3e-4da2-a100-2b5c0ebf4882 tempest-ServersNegativeTestJSON-1671359082 tempest-ServersNegativeTestJSON-1671359082-project-member] [instance: 8b4be6ea-c8f6-420b-9453-c0558b6c4b9f] Deletion of /opt/stack/data/nova/instances/8b4be6ea-c8f6-420b-9453-c0558b6c4b9f_del complete
Aug 09 15:18:54 user nova-compute[72382]: INFO nova.compute.manager [None req-e5b53529-2c3e-4da2-a100-2b5c0ebf4882 tempest-ServersNegativeTestJSON-1671359082 tempest-ServersNegativeTestJSON-1671359082-project-member] [instance: 8b4be6ea-c8f6-420b-9453-c0558b6c4b9f] Took 0.88 seconds to destroy the instance on the hypervisor.
Aug 09 15:18:54 user nova-compute[72382]: DEBUG oslo.service.loopingcall [None req-e5b53529-2c3e-4da2-a100-2b5c0ebf4882 tempest-ServersNegativeTestJSON-1671359082 tempest-ServersNegativeTestJSON-1671359082-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72382) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 15:18:54 user nova-compute[72382]: DEBUG nova.compute.manager [-] [instance: 8b4be6ea-c8f6-420b-9453-c0558b6c4b9f] Deallocating network for instance {{(pid=72382) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 15:18:54 user nova-compute[72382]: DEBUG nova.network.neutron [-] [instance: 8b4be6ea-c8f6-420b-9453-c0558b6c4b9f] deallocate_for_instance() {{(pid=72382) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 15:18:54 user nova-compute[72382]: DEBUG nova.network.neutron [-] [instance: 8b4be6ea-c8f6-420b-9453-c0558b6c4b9f] Updating instance_info_cache with network_info: [] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:18:55 user nova-compute[72382]: INFO nova.compute.manager [-] [instance: 8b4be6ea-c8f6-420b-9453-c0558b6c4b9f] Took 0.46 seconds to deallocate network for instance.
Aug 09 15:18:55 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5b53529-2c3e-4da2-a100-2b5c0ebf4882 tempest-ServersNegativeTestJSON-1671359082 tempest-ServersNegativeTestJSON-1671359082-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:18:55 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5b53529-2c3e-4da2-a100-2b5c0ebf4882 tempest-ServersNegativeTestJSON-1671359082 tempest-ServersNegativeTestJSON-1671359082-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:18:55 user nova-compute[72382]: DEBUG nova.compute.provider_tree [None req-e5b53529-2c3e-4da2-a100-2b5c0ebf4882 tempest-ServersNegativeTestJSON-1671359082 tempest-ServersNegativeTestJSON-1671359082-project-member] Inventory has not changed in ProviderTree for provider: 7b15b0e5-df4d-49db-833b-2855d21d10ae {{(pid=72382) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 15:18:55 user nova-compute[72382]: DEBUG nova.scheduler.client.report [None req-e5b53529-2c3e-4da2-a100-2b5c0ebf4882 tempest-ServersNegativeTestJSON-1671359082 tempest-ServersNegativeTestJSON-1671359082-project-member] Inventory has not changed for provider 7b15b0e5-df4d-49db-833b-2855d21d10ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72382) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 15:18:55 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5b53529-2c3e-4da2-a100-2b5c0ebf4882 tempest-ServersNegativeTestJSON-1671359082 tempest-ServersNegativeTestJSON-1671359082-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.365s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:18:55 user nova-compute[72382]: INFO nova.scheduler.client.report [None req-e5b53529-2c3e-4da2-a100-2b5c0ebf4882 tempest-ServersNegativeTestJSON-1671359082 tempest-ServersNegativeTestJSON-1671359082-project-member] Deleted allocations for instance 8b4be6ea-c8f6-420b-9453-c0558b6c4b9f
Aug 09 15:18:55 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5b53529-2c3e-4da2-a100-2b5c0ebf4882 tempest-ServersNegativeTestJSON-1671359082 tempest-ServersNegativeTestJSON-1671359082-project-member] Lock "8b4be6ea-c8f6-420b-9453-c0558b6c4b9f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.911s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:18:55 user nova-compute[72382]: DEBUG nova.compute.manager [req-8b4489b4-8e35-4a60-84d3-8d702885a522 req-f728c167-1fc6-4aa6-8c69-6600a3528725 service nova] [instance: 8b4be6ea-c8f6-420b-9453-c0558b6c4b9f] Received event network-vif-deleted-69b23d47-a252-4a81-8119-00c851da530d {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:18:56 user nova-compute[72382]: DEBUG nova.compute.manager [req-2c742280-d9fa-4ce6-8d27-75343f36412c req-f00ef19d-fe7f-44c1-b2aa-4c45c113e290 service nova] [instance: 8b4be6ea-c8f6-420b-9453-c0558b6c4b9f] Received event network-vif-plugged-69b23d47-a252-4a81-8119-00c851da530d {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:18:56 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-2c742280-d9fa-4ce6-8d27-75343f36412c req-f00ef19d-fe7f-44c1-b2aa-4c45c113e290 service nova] Acquiring lock "8b4be6ea-c8f6-420b-9453-c0558b6c4b9f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:18:56 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-2c742280-d9fa-4ce6-8d27-75343f36412c req-f00ef19d-fe7f-44c1-b2aa-4c45c113e290 service nova] Lock "8b4be6ea-c8f6-420b-9453-c0558b6c4b9f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:18:56 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-2c742280-d9fa-4ce6-8d27-75343f36412c req-f00ef19d-fe7f-44c1-b2aa-4c45c113e290 service nova] Lock "8b4be6ea-c8f6-420b-9453-c0558b6c4b9f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:18:56 user nova-compute[72382]: DEBUG nova.compute.manager [req-2c742280-d9fa-4ce6-8d27-75343f36412c req-f00ef19d-fe7f-44c1-b2aa-4c45c113e290 service nova] [instance: 8b4be6ea-c8f6-420b-9453-c0558b6c4b9f] No waiting events found dispatching network-vif-plugged-69b23d47-a252-4a81-8119-00c851da530d {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:18:56 user nova-compute[72382]: WARNING nova.compute.manager [req-2c742280-d9fa-4ce6-8d27-75343f36412c req-f00ef19d-fe7f-44c1-b2aa-4c45c113e290 service nova] [instance: 8b4be6ea-c8f6-420b-9453-c0558b6c4b9f] Received unexpected event network-vif-plugged-69b23d47-a252-4a81-8119-00c851da530d for instance with vm_state deleted and task_state None.
Aug 09 15:18:56 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:18:58 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:18:58 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:18:59 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:19:01 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-af19d2ad-e299-4106-9b7b-70164413a975 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] Acquiring lock "8aa35482-60b8-4185-b14d-a2667fd3b5b7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:19:01 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-af19d2ad-e299-4106-9b7b-70164413a975 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] Lock "8aa35482-60b8-4185-b14d-a2667fd3b5b7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:19:01 user nova-compute[72382]: DEBUG nova.compute.manager [None req-af19d2ad-e299-4106-9b7b-70164413a975 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] [instance: 8aa35482-60b8-4185-b14d-a2667fd3b5b7] Starting instance... {{(pid=72382) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 15:19:01 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-af19d2ad-e299-4106-9b7b-70164413a975 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:19:01 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-af19d2ad-e299-4106-9b7b-70164413a975 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:19:01 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-af19d2ad-e299-4106-9b7b-70164413a975 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72382) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 15:19:01 user nova-compute[72382]: INFO nova.compute.claims [None req-af19d2ad-e299-4106-9b7b-70164413a975 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] [instance: 8aa35482-60b8-4185-b14d-a2667fd3b5b7] Claim successful on node user
Aug 09 15:19:02 user nova-compute[72382]: DEBUG nova.compute.provider_tree [None req-af19d2ad-e299-4106-9b7b-70164413a975 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] Inventory has not changed in ProviderTree for provider: 7b15b0e5-df4d-49db-833b-2855d21d10ae {{(pid=72382) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 15:19:02 user nova-compute[72382]: DEBUG nova.scheduler.client.report [None req-af19d2ad-e299-4106-9b7b-70164413a975 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] Inventory has not changed for provider 7b15b0e5-df4d-49db-833b-2855d21d10ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72382) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 15:19:02 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-af19d2ad-e299-4106-9b7b-70164413a975 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.458s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:19:02 user nova-compute[72382]: DEBUG nova.compute.manager [None req-af19d2ad-e299-4106-9b7b-70164413a975 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] [instance: 8aa35482-60b8-4185-b14d-a2667fd3b5b7] Start building networks asynchronously for instance. {{(pid=72382) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 15:19:02 user nova-compute[72382]: DEBUG nova.compute.manager [None req-af19d2ad-e299-4106-9b7b-70164413a975 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] [instance: 8aa35482-60b8-4185-b14d-a2667fd3b5b7] Allocating IP information in the background. {{(pid=72382) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 15:19:02 user nova-compute[72382]: DEBUG nova.network.neutron [None req-af19d2ad-e299-4106-9b7b-70164413a975 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] [instance: 8aa35482-60b8-4185-b14d-a2667fd3b5b7] allocate_for_instance() {{(pid=72382) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 15:19:02 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-af19d2ad-e299-4106-9b7b-70164413a975 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] [instance: 8aa35482-60b8-4185-b14d-a2667fd3b5b7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 15:19:02 user nova-compute[72382]: DEBUG nova.compute.manager [None req-af19d2ad-e299-4106-9b7b-70164413a975 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] [instance: 8aa35482-60b8-4185-b14d-a2667fd3b5b7] Start building block device mappings for instance. {{(pid=72382) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 15:19:02 user nova-compute[72382]: DEBUG nova.compute.manager [None req-af19d2ad-e299-4106-9b7b-70164413a975 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] [instance: 8aa35482-60b8-4185-b14d-a2667fd3b5b7] Start spawning the instance on the hypervisor. {{(pid=72382) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 15:19:02 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-af19d2ad-e299-4106-9b7b-70164413a975 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] [instance: 8aa35482-60b8-4185-b14d-a2667fd3b5b7] Creating instance directory {{(pid=72382) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 15:19:02 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-af19d2ad-e299-4106-9b7b-70164413a975 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] [instance: 8aa35482-60b8-4185-b14d-a2667fd3b5b7] Creating image(s)
Aug 09 15:19:02 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-af19d2ad-e299-4106-9b7b-70164413a975 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] Acquiring lock "/opt/stack/data/nova/instances/8aa35482-60b8-4185-b14d-a2667fd3b5b7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:19:02 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-af19d2ad-e299-4106-9b7b-70164413a975 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] Lock "/opt/stack/data/nova/instances/8aa35482-60b8-4185-b14d-a2667fd3b5b7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:19:02 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-af19d2ad-e299-4106-9b7b-70164413a975 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] Lock "/opt/stack/data/nova/instances/8aa35482-60b8-4185-b14d-a2667fd3b5b7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:19:02 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-af19d2ad-e299-4106-9b7b-70164413a975 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:19:02 user nova-compute[72382]: DEBUG nova.policy [None req-af19d2ad-e299-4106-9b7b-70164413a975 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1afcb1b9c1b04eecbc085bce97556046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bab7a1ba67749ba85f0785846ce0338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72382) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 15:19:02 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-af19d2ad-e299-4106-9b7b-70164413a975 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b --force-share --output=json" returned: 0 in 0.136s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:19:02 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-af19d2ad-e299-4106-9b7b-70164413a975 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] Acquiring lock "383812ff437283e0191ed5b9ecc04c27f1162b0b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:19:02 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-af19d2ad-e299-4106-9b7b-70164413a975 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] Lock "383812ff437283e0191ed5b9ecc04c27f1162b0b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:19:02 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-af19d2ad-e299-4106-9b7b-70164413a975 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:19:02 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-af19d2ad-e299-4106-9b7b-70164413a975 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b --force-share --output=json" returned: 0 in 0.128s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:19:02 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-af19d2ad-e299-4106-9b7b-70164413a975 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b,backing_fmt=raw /opt/stack/data/nova/instances/8aa35482-60b8-4185-b14d-a2667fd3b5b7/disk 1073741824 {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:19:02 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-af19d2ad-e299-4106-9b7b-70164413a975 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b,backing_fmt=raw /opt/stack/data/nova/instances/8aa35482-60b8-4185-b14d-a2667fd3b5b7/disk 1073741824" returned: 0 in 0.047s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:19:02 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-af19d2ad-e299-4106-9b7b-70164413a975 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] Lock "383812ff437283e0191ed5b9ecc04c27f1162b0b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.181s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:19:02 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-af19d2ad-e299-4106-9b7b-70164413a975 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:19:02 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:19:02 user nova-compute[72382]: DEBUG nova.compute.manager [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Starting heal instance info cache {{(pid=72382) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 15:19:02 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-af19d2ad-e299-4106-9b7b-70164413a975 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b --force-share --output=json" returned: 0 in 0.168s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:19:02 user nova-compute[72382]: DEBUG nova.virt.disk.api [None req-af19d2ad-e299-4106-9b7b-70164413a975 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8aa35482-60b8-4185-b14d-a2667fd3b5b7/disk. size=1073741824 {{(pid=72382) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 15:19:02 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-af19d2ad-e299-4106-9b7b-70164413a975 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8aa35482-60b8-4185-b14d-a2667fd3b5b7/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:19:03 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Acquiring lock "refresh_cache-266be814-4a2b-4f8e-a0f6-e8821fdeb95d" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 15:19:03 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Acquired lock "refresh_cache-266be814-4a2b-4f8e-a0f6-e8821fdeb95d" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 15:19:03 user nova-compute[72382]: DEBUG nova.network.neutron [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] [instance: 266be814-4a2b-4f8e-a0f6-e8821fdeb95d] Forcefully refreshing network info cache for instance {{(pid=72382) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 15:19:03 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-af19d2ad-e299-4106-9b7b-70164413a975 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8aa35482-60b8-4185-b14d-a2667fd3b5b7/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:19:03 user nova-compute[72382]: DEBUG nova.virt.disk.api [None req-af19d2ad-e299-4106-9b7b-70164413a975 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] Cannot resize image /opt/stack/data/nova/instances/8aa35482-60b8-4185-b14d-a2667fd3b5b7/disk to a smaller size. {{(pid=72382) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 15:19:03 user nova-compute[72382]: DEBUG nova.objects.instance [None req-af19d2ad-e299-4106-9b7b-70164413a975 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] Lazy-loading 'migration_context' on Instance uuid 8aa35482-60b8-4185-b14d-a2667fd3b5b7 {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:19:03 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-af19d2ad-e299-4106-9b7b-70164413a975 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] [instance: 8aa35482-60b8-4185-b14d-a2667fd3b5b7] Created local disks {{(pid=72382) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 15:19:03 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-af19d2ad-e299-4106-9b7b-70164413a975 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] [instance: 8aa35482-60b8-4185-b14d-a2667fd3b5b7] Ensure instance console log exists: /opt/stack/data/nova/instances/8aa35482-60b8-4185-b14d-a2667fd3b5b7/console.log {{(pid=72382) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 15:19:03 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-af19d2ad-e299-4106-9b7b-70164413a975 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:19:03 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-af19d2ad-e299-4106-9b7b-70164413a975 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:19:03 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-af19d2ad-e299-4106-9b7b-70164413a975 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:19:03 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:19:03 user nova-compute[72382]: DEBUG nova.network.neutron [None req-af19d2ad-e299-4106-9b7b-70164413a975 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] [instance: 8aa35482-60b8-4185-b14d-a2667fd3b5b7] Successfully created port: b4902494-07bb-48a3-b0f8-26115f2b04d6 {{(pid=72382) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 15:19:03 user nova-compute[72382]: DEBUG nova.network.neutron [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] [instance: 266be814-4a2b-4f8e-a0f6-e8821fdeb95d] Updating instance_info_cache with network_info: [{"id": "48650c01-c5a9-44f2-a481-5120c429a5a5", "address": "fa:16:3e:25:0d:d4", "network": {"id": "46ef00c7-17ee-4e45-ba1d-dcc0a417ea85", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1360012261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "990ba791030940d38360af5879c853c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48650c01-c5", "ovs_interfaceid": "48650c01-c5a9-44f2-a481-5120c429a5a5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:19:03 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Releasing lock "refresh_cache-266be814-4a2b-4f8e-a0f6-e8821fdeb95d" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 15:19:03 user nova-compute[72382]: DEBUG nova.compute.manager [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] [instance: 266be814-4a2b-4f8e-a0f6-e8821fdeb95d] Updated the network info_cache for instance {{(pid=72382) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 15:19:03 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:19:03 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:19:03 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:19:03 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:19:03 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Auditing locally available compute resources for user (node: user) {{(pid=72382) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 15:19:03 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:19:04 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea6afcf7-0b8b-43d8-af1d-9c132a659711/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:19:04 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea6afcf7-0b8b-43d8-af1d-9c132a659711/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:19:04 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea6afcf7-0b8b-43d8-af1d-9c132a659711/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:19:04 user nova-compute[72382]: DEBUG nova.network.neutron [None req-af19d2ad-e299-4106-9b7b-70164413a975 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] [instance: 8aa35482-60b8-4185-b14d-a2667fd3b5b7] Successfully updated port: b4902494-07bb-48a3-b0f8-26115f2b04d6 {{(pid=72382) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 15:19:04 user nova-compute[72382]: DEBUG nova.compute.manager [req-e6b54ad4-2eb4-40af-9137-093f38a10658 req-4197afb0-53ea-49e2-b483-0a404458187d service nova] [instance: 8aa35482-60b8-4185-b14d-a2667fd3b5b7] Received event network-changed-b4902494-07bb-48a3-b0f8-26115f2b04d6 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:19:04 user nova-compute[72382]: DEBUG nova.compute.manager [req-e6b54ad4-2eb4-40af-9137-093f38a10658 req-4197afb0-53ea-49e2-b483-0a404458187d service nova] [instance: 8aa35482-60b8-4185-b14d-a2667fd3b5b7] Refreshing instance network info cache due to event network-changed-b4902494-07bb-48a3-b0f8-26115f2b04d6. {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 15:19:04 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-e6b54ad4-2eb4-40af-9137-093f38a10658 req-4197afb0-53ea-49e2-b483-0a404458187d service nova] Acquiring lock "refresh_cache-8aa35482-60b8-4185-b14d-a2667fd3b5b7" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 15:19:04 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-e6b54ad4-2eb4-40af-9137-093f38a10658 req-4197afb0-53ea-49e2-b483-0a404458187d service nova] Acquired lock "refresh_cache-8aa35482-60b8-4185-b14d-a2667fd3b5b7" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 15:19:04 user nova-compute[72382]: DEBUG nova.network.neutron [req-e6b54ad4-2eb4-40af-9137-093f38a10658 req-4197afb0-53ea-49e2-b483-0a404458187d service nova] [instance: 8aa35482-60b8-4185-b14d-a2667fd3b5b7] Refreshing network info cache for port b4902494-07bb-48a3-b0f8-26115f2b04d6 {{(pid=72382) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 15:19:04 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-af19d2ad-e299-4106-9b7b-70164413a975 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] Acquiring lock "refresh_cache-8aa35482-60b8-4185-b14d-a2667fd3b5b7" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 15:19:04 user nova-compute[72382]: DEBUG nova.network.neutron [req-e6b54ad4-2eb4-40af-9137-093f38a10658 req-4197afb0-53ea-49e2-b483-0a404458187d service nova] [instance: 8aa35482-60b8-4185-b14d-a2667fd3b5b7] Instance cache missing network info. {{(pid=72382) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 15:19:04 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea6afcf7-0b8b-43d8-af1d-9c132a659711/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:19:04 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f780040f-b789-4b72-8986-813c7b9fe4a6/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:19:04 user nova-compute[72382]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691594329.4531474, f0a7fa25-4520-4f40-9515-b88e3d2fd910 => Stopped> {{(pid=72382) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 15:19:04 user nova-compute[72382]: INFO nova.compute.manager [-] [instance: f0a7fa25-4520-4f40-9515-b88e3d2fd910] VM Stopped (Lifecycle Event)
Aug 09 15:19:04 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:19:04 user nova-compute[72382]: DEBUG nova.compute.manager [None req-fc68cd47-a44e-4ed1-97b0-5c9774428b52 None None] [instance: f0a7fa25-4520-4f40-9515-b88e3d2fd910] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:19:04 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f780040f-b789-4b72-8986-813c7b9fe4a6/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:19:04 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f780040f-b789-4b72-8986-813c7b9fe4a6/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:19:04 user nova-compute[72382]: DEBUG nova.network.neutron [req-e6b54ad4-2eb4-40af-9137-093f38a10658 req-4197afb0-53ea-49e2-b483-0a404458187d service nova] [instance: 8aa35482-60b8-4185-b14d-a2667fd3b5b7] Updating instance_info_cache with network_info: [] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:19:04 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-e6b54ad4-2eb4-40af-9137-093f38a10658 req-4197afb0-53ea-49e2-b483-0a404458187d service nova] Releasing lock "refresh_cache-8aa35482-60b8-4185-b14d-a2667fd3b5b7" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 15:19:04 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-af19d2ad-e299-4106-9b7b-70164413a975 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] Acquired lock "refresh_cache-8aa35482-60b8-4185-b14d-a2667fd3b5b7" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 15:19:04 user nova-compute[72382]: DEBUG nova.network.neutron [None req-af19d2ad-e299-4106-9b7b-70164413a975 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] [instance: 8aa35482-60b8-4185-b14d-a2667fd3b5b7] Building network info cache for instance {{(pid=72382) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 15:19:04 user nova-compute[72382]: DEBUG nova.network.neutron [None req-af19d2ad-e299-4106-9b7b-70164413a975 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] [instance: 8aa35482-60b8-4185-b14d-a2667fd3b5b7] Instance cache missing network info. {{(pid=72382) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 15:19:04 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f780040f-b789-4b72-8986-813c7b9fe4a6/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:19:04 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/266be814-4a2b-4f8e-a0f6-e8821fdeb95d/disk.rescue --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:19:04 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/266be814-4a2b-4f8e-a0f6-e8821fdeb95d/disk.rescue --force-share --output=json" returned: 0 in 0.150s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:19:04 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/266be814-4a2b-4f8e-a0f6-e8821fdeb95d/disk.rescue --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:19:04 user nova-compute[72382]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691594329.8614168, 23f25946-de3a-43fb-97a4-1f9a787e6e51 => Stopped> {{(pid=72382) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 15:19:04 user nova-compute[72382]: INFO nova.compute.manager [-] [instance: 23f25946-de3a-43fb-97a4-1f9a787e6e51] VM Stopped (Lifecycle Event)
Aug 09 15:19:04 user nova-compute[72382]: DEBUG nova.compute.manager [None req-84271a1e-8701-4e37-b976-6254b83191af None None] [instance: 23f25946-de3a-43fb-97a4-1f9a787e6e51] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:19:04 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/266be814-4a2b-4f8e-a0f6-e8821fdeb95d/disk.rescue --force-share --output=json" returned: 0 in 0.138s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:19:04 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/266be814-4a2b-4f8e-a0f6-e8821fdeb95d/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:19:05 user nova-compute[72382]: DEBUG nova.network.neutron [None req-af19d2ad-e299-4106-9b7b-70164413a975 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] [instance: 8aa35482-60b8-4185-b14d-a2667fd3b5b7] Updating instance_info_cache with network_info: [{"id": "b4902494-07bb-48a3-b0f8-26115f2b04d6", "address": "fa:16:3e:d9:46:4b", "network": {"id": "effdc019-a66a-4e9b-a99c-4a7c5b715201", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-414399276-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bab7a1ba67749ba85f0785846ce0338", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4902494-07", "ovs_interfaceid": "b4902494-07bb-48a3-b0f8-26115f2b04d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:19:05 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-af19d2ad-e299-4106-9b7b-70164413a975 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] Releasing lock "refresh_cache-8aa35482-60b8-4185-b14d-a2667fd3b5b7" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 15:19:05 user nova-compute[72382]: DEBUG nova.compute.manager [None req-af19d2ad-e299-4106-9b7b-70164413a975 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] [instance: 8aa35482-60b8-4185-b14d-a2667fd3b5b7] Instance network_info: |[{"id": "b4902494-07bb-48a3-b0f8-26115f2b04d6", "address": "fa:16:3e:d9:46:4b", "network": {"id": "effdc019-a66a-4e9b-a99c-4a7c5b715201", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-414399276-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bab7a1ba67749ba85f0785846ce0338", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4902494-07", "ovs_interfaceid": "b4902494-07bb-48a3-b0f8-26115f2b04d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72382) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 15:19:05 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-af19d2ad-e299-4106-9b7b-70164413a975 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] [instance: 8aa35482-60b8-4185-b14d-a2667fd3b5b7] Start _get_guest_xml network_info=[{"id": "b4902494-07bb-48a3-b0f8-26115f2b04d6", "address": "fa:16:3e:d9:46:4b", "network": {"id": "effdc019-a66a-4e9b-a99c-4a7c5b715201", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-414399276-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bab7a1ba67749ba85f0785846ce0338", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4902494-07", "ovs_interfaceid": "b4902494-07bb-48a3-b0f8-26115f2b04d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T15:11:25Z,direct_url=<?>,disk_format='qcow2',id=a79f2cea-eb27-4631-aaf3-05e7d9e411b4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a638990e12cc4d6eabb6d55e13be6bdf',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T15:11:27Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'a79f2cea-eb27-4631-aaf3-05e7d9e411b4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72382) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 15:19:05 user nova-compute[72382]: WARNING nova.virt.libvirt.driver [None req-af19d2ad-e299-4106-9b7b-70164413a975 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 15:19:05 user nova-compute[72382]: WARNING nova.virt.libvirt.driver [None req-af19d2ad-e299-4106-9b7b-70164413a975 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 15:19:05 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-af19d2ad-e299-4106-9b7b-70164413a975 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72382) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 15:19:05 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-af19d2ad-e299-4106-9b7b-70164413a975 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] CPU controller missing on host. {{(pid=72382) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 15:19:05 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-af19d2ad-e299-4106-9b7b-70164413a975 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72382) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 15:19:05 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-af19d2ad-e299-4106-9b7b-70164413a975 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] CPU controller found on host. {{(pid=72382) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 15:19:05 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-af19d2ad-e299-4106-9b7b-70164413a975 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72382) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 15:19:05 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-af19d2ad-e299-4106-9b7b-70164413a975 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T15:11:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T15:11:25Z,direct_url=<?>,disk_format='qcow2',id=a79f2cea-eb27-4631-aaf3-05e7d9e411b4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a638990e12cc4d6eabb6d55e13be6bdf',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T15:11:27Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 15:19:05 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-af19d2ad-e299-4106-9b7b-70164413a975 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] Flavor limits 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 15:19:05 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-af19d2ad-e299-4106-9b7b-70164413a975 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] Image limits 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 15:19:05 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-af19d2ad-e299-4106-9b7b-70164413a975 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] Flavor pref 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 15:19:05 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-af19d2ad-e299-4106-9b7b-70164413a975 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] Image pref 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 15:19:05 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-af19d2ad-e299-4106-9b7b-70164413a975 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 15:19:05 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-af19d2ad-e299-4106-9b7b-70164413a975 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 15:19:05 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-af19d2ad-e299-4106-9b7b-70164413a975 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72382) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 15:19:05 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-af19d2ad-e299-4106-9b7b-70164413a975 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] Got 1 possible topologies {{(pid=72382) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 15:19:05 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-af19d2ad-e299-4106-9b7b-70164413a975 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 15:19:05 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-af19d2ad-e299-4106-9b7b-70164413a975 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 15:19:05 user nova-compute[72382]: DEBUG nova.virt.libvirt.vif [None req-af19d2ad-e299-4106-9b7b-70164413a975 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T15:19:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-341294476',display_name='tempest-ServerStableDeviceRescueTest-server-341294476',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-341294476',id=16,image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDSwCFKsEbYMyjyYEiifVNDRpUL+wgKrUr4wDsDSzZ9nQKSlq2Zyg/uMkgTj+Tetif7Q1/gEDWhIfZI9BKPsna9q628aX9WOBAayqzqMu/VUfXUdxiIc/aNSYqSeGLq3Rw==',key_name='tempest-keypair-1083668026',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9bab7a1ba67749ba85f0785846ce0338',ramdisk_id='',reservation_id='r-uxqtsogm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1490271161',owner_user_name='tempest-ServerStableDeviceRescueTest-1490271161-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T15:19:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1afcb1b9c1b04eecbc085bce97556046',uuid=8aa35482-60b8-4185-b14d-a2667fd3b5b7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b4902494-07bb-48a3-b0f8-26115f2b04d6", "address": "fa:16:3e:d9:46:4b", "network": {"id": "effdc019-a66a-4e9b-a99c-4a7c5b715201", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-414399276-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bab7a1ba67749ba85f0785846ce0338", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4902494-07", "ovs_interfaceid": "b4902494-07bb-48a3-b0f8-26115f2b04d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72382) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 15:19:05 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-af19d2ad-e299-4106-9b7b-70164413a975 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] Converting VIF {"id": "b4902494-07bb-48a3-b0f8-26115f2b04d6", "address": "fa:16:3e:d9:46:4b", "network": {"id": "effdc019-a66a-4e9b-a99c-4a7c5b715201", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-414399276-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bab7a1ba67749ba85f0785846ce0338", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4902494-07", "ovs_interfaceid": "b4902494-07bb-48a3-b0f8-26115f2b04d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 15:19:05 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-af19d2ad-e299-4106-9b7b-70164413a975 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d9:46:4b,bridge_name='br-int',has_traffic_filtering=True,id=b4902494-07bb-48a3-b0f8-26115f2b04d6,network=Network(effdc019-a66a-4e9b-a99c-4a7c5b715201),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4902494-07') {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 15:19:05 user nova-compute[72382]: DEBUG nova.objects.instance [None req-af19d2ad-e299-4106-9b7b-70164413a975 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] Lazy-loading 'pci_devices' on Instance uuid 8aa35482-60b8-4185-b14d-a2667fd3b5b7 {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:19:05 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/266be814-4a2b-4f8e-a0f6-e8821fdeb95d/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:19:05 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/266be814-4a2b-4f8e-a0f6-e8821fdeb95d/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:19:05 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-af19d2ad-e299-4106-9b7b-70164413a975 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] [instance: 8aa35482-60b8-4185-b14d-a2667fd3b5b7] End _get_guest_xml xml=<domain type="kvm">
Aug 09 15:19:05 user nova-compute[72382]:   <uuid>8aa35482-60b8-4185-b14d-a2667fd3b5b7</uuid>
Aug 09 15:19:05 user nova-compute[72382]:   <name>instance-00000010</name>
Aug 09 15:19:05 user nova-compute[72382]:   <memory>524288</memory>
Aug 09 15:19:05 user nova-compute[72382]:   <vcpu>1</vcpu>
Aug 09 15:19:05 user nova-compute[72382]:   <metadata>
Aug 09 15:19:05 user nova-compute[72382]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 15:19:05 user nova-compute[72382]:       <nova:package version="0.0.0"/>
Aug 09 15:19:05 user nova-compute[72382]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-341294476</nova:name>
Aug 09 15:19:05 user nova-compute[72382]:       <nova:creationTime>2023-08-09 15:19:05</nova:creationTime>
Aug 09 15:19:05 user nova-compute[72382]:       <nova:flavor name="m1.tiny">
Aug 09 15:19:05 user nova-compute[72382]:         <nova:memory>512</nova:memory>
Aug 09 15:19:05 user nova-compute[72382]:         <nova:disk>1</nova:disk>
Aug 09 15:19:05 user nova-compute[72382]:         <nova:swap>0</nova:swap>
Aug 09 15:19:05 user nova-compute[72382]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 15:19:05 user nova-compute[72382]:         <nova:vcpus>1</nova:vcpus>
Aug 09 15:19:05 user nova-compute[72382]:       </nova:flavor>
Aug 09 15:19:05 user nova-compute[72382]:       <nova:owner>
Aug 09 15:19:05 user nova-compute[72382]:         <nova:user uuid="1afcb1b9c1b04eecbc085bce97556046">tempest-ServerStableDeviceRescueTest-1490271161-project-member</nova:user>
Aug 09 15:19:05 user nova-compute[72382]:         <nova:project uuid="9bab7a1ba67749ba85f0785846ce0338">tempest-ServerStableDeviceRescueTest-1490271161</nova:project>
Aug 09 15:19:05 user nova-compute[72382]:       </nova:owner>
Aug 09 15:19:05 user nova-compute[72382]:       <nova:root type="image" uuid="a79f2cea-eb27-4631-aaf3-05e7d9e411b4"/>
Aug 09 15:19:05 user nova-compute[72382]:       <nova:ports>
Aug 09 15:19:05 user nova-compute[72382]:         <nova:port uuid="b4902494-07bb-48a3-b0f8-26115f2b04d6">
Aug 09 15:19:05 user nova-compute[72382]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 09 15:19:05 user nova-compute[72382]:         </nova:port>
Aug 09 15:19:05 user nova-compute[72382]:       </nova:ports>
Aug 09 15:19:05 user nova-compute[72382]:     </nova:instance>
Aug 09 15:19:05 user nova-compute[72382]:   </metadata>
Aug 09 15:19:05 user nova-compute[72382]:   <sysinfo type="smbios">
Aug 09 15:19:05 user nova-compute[72382]:     <system>
Aug 09 15:19:05 user nova-compute[72382]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 15:19:05 user nova-compute[72382]:       <entry name="product">OpenStack Nova</entry>
Aug 09 15:19:05 user nova-compute[72382]:       <entry name="version">0.0.0</entry>
Aug 09 15:19:05 user nova-compute[72382]:       <entry name="serial">8aa35482-60b8-4185-b14d-a2667fd3b5b7</entry>
Aug 09 15:19:05 user nova-compute[72382]:       <entry name="uuid">8aa35482-60b8-4185-b14d-a2667fd3b5b7</entry>
Aug 09 15:19:05 user nova-compute[72382]:       <entry name="family">Virtual Machine</entry>
Aug 09 15:19:05 user nova-compute[72382]:     </system>
Aug 09 15:19:05 user nova-compute[72382]:   </sysinfo>
Aug 09 15:19:05 user nova-compute[72382]:   <os>
Aug 09 15:19:05 user nova-compute[72382]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 15:19:05 user nova-compute[72382]:     <boot dev="hd"/>
Aug 09 15:19:05 user nova-compute[72382]:     <smbios mode="sysinfo"/>
Aug 09 15:19:05 user nova-compute[72382]:   </os>
Aug 09 15:19:05 user nova-compute[72382]:   <features>
Aug 09 15:19:05 user nova-compute[72382]:     <acpi/>
Aug 09 15:19:05 user nova-compute[72382]:     <apic/>
Aug 09 15:19:05 user nova-compute[72382]:     <vmcoreinfo/>
Aug 09 15:19:05 user nova-compute[72382]:   </features>
Aug 09 15:19:05 user nova-compute[72382]:   <clock offset="utc">
Aug 09 15:19:05 user nova-compute[72382]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 15:19:05 user nova-compute[72382]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 15:19:05 user nova-compute[72382]:     <timer name="hpet" present="no"/>
Aug 09 15:19:05 user nova-compute[72382]:   </clock>
Aug 09 15:19:05 user nova-compute[72382]:   <cpu mode="custom" match="exact">
Aug 09 15:19:05 user nova-compute[72382]:     <model>Nehalem</model>
Aug 09 15:19:05 user nova-compute[72382]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 15:19:05 user nova-compute[72382]:   </cpu>
Aug 09 15:19:05 user nova-compute[72382]:   <devices>
Aug 09 15:19:05 user nova-compute[72382]:     <disk type="file" device="disk">
Aug 09 15:19:05 user nova-compute[72382]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 15:19:05 user nova-compute[72382]:       <source file="/opt/stack/data/nova/instances/8aa35482-60b8-4185-b14d-a2667fd3b5b7/disk"/>
Aug 09 15:19:05 user nova-compute[72382]:       <target dev="vda" bus="virtio"/>
Aug 09 15:19:05 user nova-compute[72382]:     </disk>
Aug 09 15:19:05 user nova-compute[72382]:     <interface type="ethernet">
Aug 09 15:19:05 user nova-compute[72382]:       <mac address="fa:16:3e:d9:46:4b"/>
Aug 09 15:19:05 user nova-compute[72382]:       <model type="virtio"/>
Aug 09 15:19:05 user nova-compute[72382]:       <mtu size="1442"/>
Aug 09 15:19:05 user nova-compute[72382]:       <target dev="tapb4902494-07"/>
Aug 09 15:19:05 user nova-compute[72382]:     </interface>
Aug 09 15:19:05 user nova-compute[72382]:     <serial type="pty">
Aug 09 15:19:05 user nova-compute[72382]:       <log file="/opt/stack/data/nova/instances/8aa35482-60b8-4185-b14d-a2667fd3b5b7/console.log" append="off"/>
Aug 09 15:19:05 user nova-compute[72382]:     </serial>
Aug 09 15:19:05 user nova-compute[72382]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 15:19:05 user nova-compute[72382]:     <video>
Aug 09 15:19:05 user nova-compute[72382]:       <model type="virtio"/>
Aug 09 15:19:05 user nova-compute[72382]:     </video>
Aug 09 15:19:05 user nova-compute[72382]:     <rng model="virtio">
Aug 09 15:19:05 user nova-compute[72382]:       <backend model="random">/dev/urandom</backend>
Aug 09 15:19:05 user nova-compute[72382]:     </rng>
Aug 09 15:19:05 user nova-compute[72382]:     <controller type="usb" index="0" model="none"/>
Aug 09 15:19:05 user nova-compute[72382]:     <memballoon model="virtio">
Aug 09 15:19:05 user nova-compute[72382]:       <stats period="10"/>
Aug 09 15:19:05 user nova-compute[72382]:     </memballoon>
Aug 09 15:19:05 user nova-compute[72382]:   </devices>
Aug 09 15:19:05 user nova-compute[72382]: </domain>
Aug 09 15:19:05 user nova-compute[72382]:  {{(pid=72382) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 15:19:05 user nova-compute[72382]: DEBUG nova.virt.libvirt.vif [None req-af19d2ad-e299-4106-9b7b-70164413a975 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T15:19:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-341294476',display_name='tempest-ServerStableDeviceRescueTest-server-341294476',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-341294476',id=16,image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDSwCFKsEbYMyjyYEiifVNDRpUL+wgKrUr4wDsDSzZ9nQKSlq2Zyg/uMkgTj+Tetif7Q1/gEDWhIfZI9BKPsna9q628aX9WOBAayqzqMu/VUfXUdxiIc/aNSYqSeGLq3Rw==',key_name='tempest-keypair-1083668026',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9bab7a1ba67749ba85f0785846ce0338',ramdisk_id='',reservation_id='r-uxqtsogm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1490271161',owner_user_name='tempest-ServerStableDeviceRescueTest-1490271161-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T15:19:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1afcb1b9c1b04eecbc085bce97556046',uuid=8aa35482-60b8-4185-b14d-a2667fd3b5b7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b4902494-07bb-48a3-b0f8-26115f2b04d6", "address": "fa:16:3e:d9:46:4b", "network": {"id": "effdc019-a66a-4e9b-a99c-4a7c5b715201", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-414399276-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bab7a1ba67749ba85f0785846ce0338", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4902494-07", "ovs_interfaceid": "b4902494-07bb-48a3-b0f8-26115f2b04d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 15:19:05 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-af19d2ad-e299-4106-9b7b-70164413a975 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] Converting VIF {"id": "b4902494-07bb-48a3-b0f8-26115f2b04d6", "address": "fa:16:3e:d9:46:4b", "network": {"id": "effdc019-a66a-4e9b-a99c-4a7c5b715201", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-414399276-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bab7a1ba67749ba85f0785846ce0338", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4902494-07", "ovs_interfaceid": "b4902494-07bb-48a3-b0f8-26115f2b04d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 15:19:05 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-af19d2ad-e299-4106-9b7b-70164413a975 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d9:46:4b,bridge_name='br-int',has_traffic_filtering=True,id=b4902494-07bb-48a3-b0f8-26115f2b04d6,network=Network(effdc019-a66a-4e9b-a99c-4a7c5b715201),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4902494-07') {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 15:19:05 user nova-compute[72382]: DEBUG os_vif [None req-af19d2ad-e299-4106-9b7b-70164413a975 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:46:4b,bridge_name='br-int',has_traffic_filtering=True,id=b4902494-07bb-48a3-b0f8-26115f2b04d6,network=Network(effdc019-a66a-4e9b-a99c-4a7c5b715201),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4902494-07') {{(pid=72382) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 15:19:05 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:19:05 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:19:05 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 15:19:05 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:19:05 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb4902494-07, may_exist=True, interface_attrs={}) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:19:05 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb4902494-07, col_values=(('external_ids', {'iface-id': 'b4902494-07bb-48a3-b0f8-26115f2b04d6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d9:46:4b', 'vm-uuid': '8aa35482-60b8-4185-b14d-a2667fd3b5b7'}),), if_exists=True) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:19:05 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:19:05 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:19:05 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:19:05 user nova-compute[72382]: INFO os_vif [None req-af19d2ad-e299-4106-9b7b-70164413a975 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:46:4b,bridge_name='br-int',has_traffic_filtering=True,id=b4902494-07bb-48a3-b0f8-26115f2b04d6,network=Network(effdc019-a66a-4e9b-a99c-4a7c5b715201),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4902494-07')
Aug 09 15:19:05 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-af19d2ad-e299-4106-9b7b-70164413a975 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] No BDM found with device name vda, not building metadata. {{(pid=72382) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 15:19:05 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-af19d2ad-e299-4106-9b7b-70164413a975 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] No VIF found with MAC fa:16:3e:d9:46:4b, not building metadata {{(pid=72382) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 15:19:05 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/266be814-4a2b-4f8e-a0f6-e8821fdeb95d/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:19:05 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a33515b3-3ef4-4f76-a8d8-e7008b5bbb79/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:19:05 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a33515b3-3ef4-4f76-a8d8-e7008b5bbb79/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:19:05 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a33515b3-3ef4-4f76-a8d8-e7008b5bbb79/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:19:05 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a33515b3-3ef4-4f76-a8d8-e7008b5bbb79/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:19:05 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/777e49ea-b674-4c3f-9cdd-ac2113032632/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:19:05 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/777e49ea-b674-4c3f-9cdd-ac2113032632/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:19:05 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/777e49ea-b674-4c3f-9cdd-ac2113032632/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:19:05 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/777e49ea-b674-4c3f-9cdd-ac2113032632/disk --force-share --output=json" returned: 0 in 0.128s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:19:05 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44afd1bf-fa5c-4b3e-8752-b16853fef54e/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:19:05 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44afd1bf-fa5c-4b3e-8752-b16853fef54e/disk --force-share --output=json" returned: 0 in 0.127s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:19:06 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44afd1bf-fa5c-4b3e-8752-b16853fef54e/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:19:06 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44afd1bf-fa5c-4b3e-8752-b16853fef54e/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:19:06 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72382) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 15:19:06 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a82f146-97ce-4319-8b25-c1b090965e53/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:19:06 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a82f146-97ce-4319-8b25-c1b090965e53/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:19:06 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a82f146-97ce-4319-8b25-c1b090965e53/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:19:06 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a82f146-97ce-4319-8b25-c1b090965e53/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:19:06 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9766433-4c5a-40ed-a212-715a24f42b91/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:19:06 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:19:06 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:19:06 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:19:06 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9766433-4c5a-40ed-a212-715a24f42b91/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:19:06 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9766433-4c5a-40ed-a212-715a24f42b91/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:19:06 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9766433-4c5a-40ed-a212-715a24f42b91/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:19:06 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5aa7e23-9c2c-400e-a615-5839858749e1/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:19:06 user nova-compute[72382]: DEBUG nova.compute.manager [req-29330392-03ee-48f4-a271-140d655f4a2a req-5b9f2d3a-ba9a-4ace-afa7-67b1e45944af service nova] [instance: 8aa35482-60b8-4185-b14d-a2667fd3b5b7] Received event network-vif-plugged-b4902494-07bb-48a3-b0f8-26115f2b04d6 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:19:06 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-29330392-03ee-48f4-a271-140d655f4a2a req-5b9f2d3a-ba9a-4ace-afa7-67b1e45944af service nova] Acquiring lock "8aa35482-60b8-4185-b14d-a2667fd3b5b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:19:06 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-29330392-03ee-48f4-a271-140d655f4a2a req-5b9f2d3a-ba9a-4ace-afa7-67b1e45944af service nova] Lock "8aa35482-60b8-4185-b14d-a2667fd3b5b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:19:06 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-29330392-03ee-48f4-a271-140d655f4a2a req-5b9f2d3a-ba9a-4ace-afa7-67b1e45944af service nova] Lock "8aa35482-60b8-4185-b14d-a2667fd3b5b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:19:06 user nova-compute[72382]: DEBUG nova.compute.manager [req-29330392-03ee-48f4-a271-140d655f4a2a req-5b9f2d3a-ba9a-4ace-afa7-67b1e45944af service nova] [instance: 8aa35482-60b8-4185-b14d-a2667fd3b5b7] No waiting events found dispatching network-vif-plugged-b4902494-07bb-48a3-b0f8-26115f2b04d6 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:19:06 user nova-compute[72382]: WARNING nova.compute.manager [req-29330392-03ee-48f4-a271-140d655f4a2a req-5b9f2d3a-ba9a-4ace-afa7-67b1e45944af service nova] [instance: 8aa35482-60b8-4185-b14d-a2667fd3b5b7] Received unexpected event network-vif-plugged-b4902494-07bb-48a3-b0f8-26115f2b04d6 for instance with vm_state building and task_state spawning.
Aug 09 15:19:06 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5aa7e23-9c2c-400e-a615-5839858749e1/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:19:06 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5aa7e23-9c2c-400e-a615-5839858749e1/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:19:07 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5aa7e23-9c2c-400e-a615-5839858749e1/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:19:07 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72382) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 15:19:07 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:19:07 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-3aa08854-682b-403c-bdbd-cd437d00abae tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Acquiring lock "c9766433-4c5a-40ed-a212-715a24f42b91" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:19:07 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-3aa08854-682b-403c-bdbd-cd437d00abae tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Lock "c9766433-4c5a-40ed-a212-715a24f42b91" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:19:07 user nova-compute[72382]: WARNING nova.virt.libvirt.driver [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 15:19:07 user nova-compute[72382]: WARNING nova.virt.libvirt.driver [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 15:19:07 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Hypervisor/Node resource view: name=user free_ram=7511MB free_disk=25.755077362060547GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72382) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 15:19:07 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:19:07 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:19:07 user nova-compute[72382]: DEBUG nova.objects.instance [None req-3aa08854-682b-403c-bdbd-cd437d00abae tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Lazy-loading 'flavor' on Instance uuid c9766433-4c5a-40ed-a212-715a24f42b91 {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:19:07 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-3aa08854-682b-403c-bdbd-cd437d00abae tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Lock "c9766433-4c5a-40ed-a212-715a24f42b91" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.062s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:19:07 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance f780040f-b789-4b72-8986-813c7b9fe4a6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:19:07 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance 777e49ea-b674-4c3f-9cdd-ac2113032632 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:19:07 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance 44afd1bf-fa5c-4b3e-8752-b16853fef54e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:19:07 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance 266be814-4a2b-4f8e-a0f6-e8821fdeb95d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:19:07 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance c9766433-4c5a-40ed-a212-715a24f42b91 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:19:07 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance a33515b3-3ef4-4f76-a8d8-e7008b5bbb79 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:19:07 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance 9a82f146-97ce-4319-8b25-c1b090965e53 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:19:07 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance b5aa7e23-9c2c-400e-a615-5839858749e1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:19:07 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance 0f510d75-5d1e-4a5c-b38f-731c299f0f5a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:19:07 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance ea6afcf7-0b8b-43d8-af1d-9c132a659711 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:19:07 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance 8aa35482-60b8-4185-b14d-a2667fd3b5b7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:19:07 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=72382) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 15:19:07 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=72382) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 15:19:07 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-3aa08854-682b-403c-bdbd-cd437d00abae tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Acquiring lock "c9766433-4c5a-40ed-a212-715a24f42b91" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:19:07 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-3aa08854-682b-403c-bdbd-cd437d00abae tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Lock "c9766433-4c5a-40ed-a212-715a24f42b91" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:19:07 user nova-compute[72382]: INFO nova.compute.manager [None req-3aa08854-682b-403c-bdbd-cd437d00abae tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] [instance: c9766433-4c5a-40ed-a212-715a24f42b91] Attaching volume fb47e85c-aaa9-4165-8be3-125572b68a87 to /dev/vdb
Aug 09 15:19:07 user nova-compute[72382]: DEBUG os_brick.utils [None req-3aa08854-682b-403c-bdbd-cd437d00abae tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 15:19:07 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:19:07 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:19:07 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[431a6a52-e62a-4d37-8852-ce71ac344cbf]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d2cfa7015fe\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:19:07 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:19:07 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:19:07 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9ce6ba6-1660-4be0-a761-29e4af97a3cb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:19:07 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:19:07 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:19:07 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[04f51fc2-fd57-45da-ba92-a1883e7f332f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:19:07 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[297ff124-2c48-40cc-b1f1-026c975fac06]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:19:07 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-3aa08854-682b-403c-bdbd-cd437d00abae tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Running cmd (subprocess): nvme version {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:19:08 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-3aa08854-682b-403c-bdbd-cd437d00abae tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] 'nvme version' failed. Not Retrying. {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 15:19:08 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3aa08854-682b-403c-bdbd-cd437d00abae tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] nvme not present on system {{(pid=72382) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 15:19:08 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:19:08 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 15:19:08 user nova-compute[72382]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 15:19:08 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a28510a-1734-43ad-ae5a-7aacc77e3e3f]: (4, '') {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:19:08 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.lightos [None req-3aa08854-682b-403c-bdbd-cd437d00abae tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72382) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 15:19:08 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.lightos [None req-3aa08854-682b-403c-bdbd-cd437d00abae tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72382) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 15:19:08 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.lightos [None req-3aa08854-682b-403c-bdbd-cd437d00abae tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] LIGHTOS: no hostnqn found. {{(pid=72382) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 15:19:08 user nova-compute[72382]: DEBUG os_brick.utils [None req-3aa08854-682b-403c-bdbd-cd437d00abae tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d2cfa7015fe', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 15:19:08 user nova-compute[72382]: DEBUG nova.virt.block_device [None req-3aa08854-682b-403c-bdbd-cd437d00abae tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] [instance: c9766433-4c5a-40ed-a212-715a24f42b91] Updating existing volume attachment record: aac4b04f-5db3-4d7a-be90-184b5dc9b9c9 {{(pid=72382) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 15:19:08 user nova-compute[72382]: DEBUG nova.compute.provider_tree [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Inventory has not changed in ProviderTree for provider: 7b15b0e5-df4d-49db-833b-2855d21d10ae {{(pid=72382) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 15:19:08 user nova-compute[72382]: DEBUG nova.scheduler.client.report [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Inventory has not changed for provider 7b15b0e5-df4d-49db-833b-2855d21d10ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72382) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 15:19:08 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Compute_service record updated for user:user {{(pid=72382) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 15:19:08 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.605s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:19:08 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:19:08 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:19:08 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:19:08 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:19:08 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:19:08 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:19:08 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:19:08 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:19:08 user nova-compute[72382]: DEBUG nova.compute.manager [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72382) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 15:19:08 user nova-compute[72382]: DEBUG nova.compute.manager [None req-af19d2ad-e299-4106-9b7b-70164413a975 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] [instance: 8aa35482-60b8-4185-b14d-a2667fd3b5b7] Instance event wait completed in 0 seconds for  {{(pid=72382) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 15:19:08 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-af19d2ad-e299-4106-9b7b-70164413a975 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] [instance: 8aa35482-60b8-4185-b14d-a2667fd3b5b7] Guest created on hypervisor {{(pid=72382) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 15:19:08 user nova-compute[72382]: DEBUG nova.virt.driver [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Emitting event <LifecycleEvent: 1691594348.7396069, 8aa35482-60b8-4185-b14d-a2667fd3b5b7 => Resumed> {{(pid=72382) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 15:19:08 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 8aa35482-60b8-4185-b14d-a2667fd3b5b7] VM Resumed (Lifecycle Event)
Aug 09 15:19:08 user nova-compute[72382]: INFO nova.virt.libvirt.driver [-] [instance: 8aa35482-60b8-4185-b14d-a2667fd3b5b7] Instance spawned successfully.
Aug 09 15:19:08 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-af19d2ad-e299-4106-9b7b-70164413a975 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] [instance: 8aa35482-60b8-4185-b14d-a2667fd3b5b7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 15:19:08 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 8aa35482-60b8-4185-b14d-a2667fd3b5b7] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:19:08 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-af19d2ad-e299-4106-9b7b-70164413a975 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] [instance: 8aa35482-60b8-4185-b14d-a2667fd3b5b7] Found default for hw_cdrom_bus of ide {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:19:08 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-af19d2ad-e299-4106-9b7b-70164413a975 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] [instance: 8aa35482-60b8-4185-b14d-a2667fd3b5b7] Found default for hw_disk_bus of virtio {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:19:08 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-af19d2ad-e299-4106-9b7b-70164413a975 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] [instance: 8aa35482-60b8-4185-b14d-a2667fd3b5b7] Found default for hw_input_bus of None {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:19:08 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-af19d2ad-e299-4106-9b7b-70164413a975 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] [instance: 8aa35482-60b8-4185-b14d-a2667fd3b5b7] Found default for hw_pointer_model of None {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:19:08 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-af19d2ad-e299-4106-9b7b-70164413a975 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] [instance: 8aa35482-60b8-4185-b14d-a2667fd3b5b7] Found default for hw_video_model of virtio {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:19:08 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-af19d2ad-e299-4106-9b7b-70164413a975 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] [instance: 8aa35482-60b8-4185-b14d-a2667fd3b5b7] Found default for hw_vif_model of virtio {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:19:08 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 8aa35482-60b8-4185-b14d-a2667fd3b5b7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72382) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 15:19:08 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 8aa35482-60b8-4185-b14d-a2667fd3b5b7] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 15:19:08 user nova-compute[72382]: DEBUG nova.virt.driver [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Emitting event <LifecycleEvent: 1691594348.7413683, 8aa35482-60b8-4185-b14d-a2667fd3b5b7 => Started> {{(pid=72382) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 15:19:08 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 8aa35482-60b8-4185-b14d-a2667fd3b5b7] VM Started (Lifecycle Event)
Aug 09 15:19:08 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 8aa35482-60b8-4185-b14d-a2667fd3b5b7] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:19:08 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 8aa35482-60b8-4185-b14d-a2667fd3b5b7] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72382) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 15:19:08 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 8aa35482-60b8-4185-b14d-a2667fd3b5b7] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 15:19:08 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:19:08 user nova-compute[72382]: INFO nova.compute.manager [None req-af19d2ad-e299-4106-9b7b-70164413a975 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] [instance: 8aa35482-60b8-4185-b14d-a2667fd3b5b7] Took 6.43 seconds to spawn the instance on the hypervisor.
Aug 09 15:19:08 user nova-compute[72382]: DEBUG nova.compute.manager [None req-af19d2ad-e299-4106-9b7b-70164413a975 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] [instance: 8aa35482-60b8-4185-b14d-a2667fd3b5b7] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:19:08 user nova-compute[72382]: INFO nova.compute.manager [None req-af19d2ad-e299-4106-9b7b-70164413a975 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] [instance: 8aa35482-60b8-4185-b14d-a2667fd3b5b7] Took 7.21 seconds to build instance.
Aug 09 15:19:08 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-af19d2ad-e299-4106-9b7b-70164413a975 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] Lock "8aa35482-60b8-4185-b14d-a2667fd3b5b7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.316s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:19:08 user nova-compute[72382]: DEBUG nova.compute.manager [req-a23bc5f2-b6a4-4a16-b52b-f038fb8af168 req-4f752e86-48e2-4a7e-a958-79b3a0f48bd1 service nova] [instance: 8aa35482-60b8-4185-b14d-a2667fd3b5b7] Received event network-vif-plugged-b4902494-07bb-48a3-b0f8-26115f2b04d6 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:19:08 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-a23bc5f2-b6a4-4a16-b52b-f038fb8af168 req-4f752e86-48e2-4a7e-a958-79b3a0f48bd1 service nova] Acquiring lock "8aa35482-60b8-4185-b14d-a2667fd3b5b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:19:08 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-a23bc5f2-b6a4-4a16-b52b-f038fb8af168 req-4f752e86-48e2-4a7e-a958-79b3a0f48bd1 service nova] Lock "8aa35482-60b8-4185-b14d-a2667fd3b5b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:19:08 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-a23bc5f2-b6a4-4a16-b52b-f038fb8af168 req-4f752e86-48e2-4a7e-a958-79b3a0f48bd1 service nova] Lock "8aa35482-60b8-4185-b14d-a2667fd3b5b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:19:08 user nova-compute[72382]: DEBUG nova.compute.manager [req-a23bc5f2-b6a4-4a16-b52b-f038fb8af168 req-4f752e86-48e2-4a7e-a958-79b3a0f48bd1 service nova] [instance: 8aa35482-60b8-4185-b14d-a2667fd3b5b7] No waiting events found dispatching network-vif-plugged-b4902494-07bb-48a3-b0f8-26115f2b04d6 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:19:08 user nova-compute[72382]: WARNING nova.compute.manager [req-a23bc5f2-b6a4-4a16-b52b-f038fb8af168 req-4f752e86-48e2-4a7e-a958-79b3a0f48bd1 service nova] [instance: 8aa35482-60b8-4185-b14d-a2667fd3b5b7] Received unexpected event network-vif-plugged-b4902494-07bb-48a3-b0f8-26115f2b04d6 for instance with vm_state active and task_state None.
Aug 09 15:19:09 user nova-compute[72382]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691594334.4406743, 8b4be6ea-c8f6-420b-9453-c0558b6c4b9f => Stopped> {{(pid=72382) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 15:19:09 user nova-compute[72382]: INFO nova.compute.manager [-] [instance: 8b4be6ea-c8f6-420b-9453-c0558b6c4b9f] VM Stopped (Lifecycle Event)
Aug 09 15:19:09 user nova-compute[72382]: DEBUG nova.compute.manager [None req-f59b4ace-5131-4b33-983c-6eef439866bb None None] [instance: 8b4be6ea-c8f6-420b-9453-c0558b6c4b9f] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:19:10 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:19:13 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:19:15 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:19:16 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3aa08854-682b-403c-bdbd-cd437d00abae tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] [instance: c9766433-4c5a-40ed-a212-715a24f42b91] Calling os-brick to attach iSCSI Volume {{(pid=72382) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 15:19:16 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-3aa08854-682b-403c-bdbd-cd437d00abae tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2a0c768340>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:fb47e85c-aaa9-4165-8be3-125572b68a87'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mtLoQzKG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 15:19:16 user nova-compute[72382]: WARNING os_brick.initiator.connectors.base [None req-3aa08854-682b-403c-bdbd-cd437d00abae tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 15:19:16 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-3aa08854-682b-403c-bdbd-cd437d00abae tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 15:19:16 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-3aa08854-682b-403c-bdbd-cd437d00abae tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 15:19:16 user nova-compute[72382]: WARNING os_brick.initiator.connectors.base [None req-3aa08854-682b-403c-bdbd-cd437d00abae tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 15:19:16 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-3aa08854-682b-403c-bdbd-cd437d00abae tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fb47e85c-aaa9-4165-8be3-125572b68a87" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 15:19:16 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-3aa08854-682b-403c-bdbd-cd437d00abae tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fb47e85c-aaa9-4165-8be3-125572b68a87" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 15:19:16 user nova-compute[72382]: INFO os_brick.initiator.connectors.iscsi [None req-3aa08854-682b-403c-bdbd-cd437d00abae tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 15:19:16 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb47e85c-aaa9-4165-8be3-125572b68a87 -p 172.16.0.220:3260 {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:19:16 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb47e85c-aaa9-4165-8be3-125572b68a87 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:19:16 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a8a1068-96bc-4366-9d00-3e60d0155226]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:19:16 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-3aa08854-682b-403c-bdbd-cd437d00abae tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 15:19:16 user nova-compute[72382]:  {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:19:16 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb47e85c-aaa9-4165-8be3-125572b68a87 -p 172.16.0.220:3260 --interface default --op new {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:19:16 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb47e85c-aaa9-4165-8be3-125572b68a87 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:19:16 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[29740968-360a-4e9d-aa8c-060adaebe1d6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fb47e85c-aaa9-4165-8be3-125572b68a87] added\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:19:16 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-3aa08854-682b-403c-bdbd-cd437d00abae tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fb47e85c-aaa9-4165-8be3-125572b68a87] added
Aug 09 15:19:16 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:19:16 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb47e85c-aaa9-4165-8be3-125572b68a87 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:19:16 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb47e85c-aaa9-4165-8be3-125572b68a87 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:19:16 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8f22022-528e-45c0-8cd0-dd75cf423e8a]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:19:16 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-3aa08854-682b-403c-bdbd-cd437d00abae tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:19:16 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb47e85c-aaa9-4165-8be3-125572b68a87 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:19:16 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb47e85c-aaa9-4165-8be3-125572b68a87 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:19:16 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcbd4a93-1cbc-4150-b192-1971785b790f]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:19:16 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-3aa08854-682b-403c-bdbd-cd437d00abae tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:19:16 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb47e85c-aaa9-4165-8be3-125572b68a87 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mtLoQzKG {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:19:16 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb47e85c-aaa9-4165-8be3-125572b68a87 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mtLoQzKG" returned: 0 in 0.018s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:19:16 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[be78d199-9426-4f1d-bba5-0889c21b9746]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:19:16 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-3aa08854-682b-403c-bdbd-cd437d00abae tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mtLoQzKG'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:19:16 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb47e85c-aaa9-4165-8be3-125572b68a87 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:19:16 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb47e85c-aaa9-4165-8be3-125572b68a87 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:19:16 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7faf901-e3b0-44c6-829a-b81a84317331]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:19:16 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-3aa08854-682b-403c-bdbd-cd437d00abae tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:19:16 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:19:16 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:19:16 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a3da9ee-6878-4470-b9e7-33f12a40ff81]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c2a0938-fb5c-434c-91ba-15e8823c1348 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:19:16 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-3aa08854-682b-403c-bdbd-cd437d00abae tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c2a0938-fb5c-434c-91ba-15e8823c1348 (non-flash)
Aug 09 15:19:16 user nova-compute[72382]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)
Aug 09 15:19:16 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 15:19:16 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-3aa08854-682b-403c-bdbd-cd437d00abae tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c2a0938-fb5c-434c-91ba-15e8823c1348 (non-flash)
Aug 09 15:19:16 user nova-compute[72382]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)
Aug 09 15:19:16 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 15:19:16 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb47e85c-aaa9-4165-8be3-125572b68a87 -p 172.16.0.220:3260 --login {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:19:17 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb47e85c-aaa9-4165-8be3-125572b68a87 -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:19:17 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[b962087e-f949-406d-917d-7959a1a2c89d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fb47e85c-aaa9-4165-8be3-125572b68a87, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fb47e85c-aaa9-4165-8be3-125572b68a87, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:19:17 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-3aa08854-682b-403c-bdbd-cd437d00abae tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fb47e85c-aaa9-4165-8be3-125572b68a87, portal: 172.16.0.220,3260]
Aug 09 15:19:17 user nova-compute[72382]: Login to [iface: default, target: iqn.2010-10.org.openstack:fb47e85c-aaa9-4165-8be3-125572b68a87, portal: 172.16.0.220,3260] successful.
Aug 09 15:19:17 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:19:17 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb47e85c-aaa9-4165-8be3-125572b68a87 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:19:17 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb47e85c-aaa9-4165-8be3-125572b68a87 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:19:17 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[57863dbc-828c-4395-8d83-31b8e20c53d5]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:19:17 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-3aa08854-682b-403c-bdbd-cd437d00abae tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:19:17 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:19:17 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:19:17 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a6b4bde-5fd7-4771-8cf6-fd07410486d6]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c2a0938-fb5c-434c-91ba-15e8823c1348 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb47e85c-aaa9-4165-8be3-125572b68a87 (non-flash)\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:19:17 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-3aa08854-682b-403c-bdbd-cd437d00abae tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c2a0938-fb5c-434c-91ba-15e8823c1348 (non-flash)
Aug 09 15:19:17 user nova-compute[72382]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)
Aug 09 15:19:17 user nova-compute[72382]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb47e85c-aaa9-4165-8be3-125572b68a87 (non-flash)
Aug 09 15:19:17 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 15:19:17 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-3aa08854-682b-403c-bdbd-cd437d00abae tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c2a0938-fb5c-434c-91ba-15e8823c1348 (non-flash)
Aug 09 15:19:17 user nova-compute[72382]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)
Aug 09 15:19:17 user nova-compute[72382]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb47e85c-aaa9-4165-8be3-125572b68a87 (non-flash)
Aug 09 15:19:17 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 15:19:17 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-3aa08854-682b-403c-bdbd-cd437d00abae tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fb47e85c-aaa9-4165-8be3-125572b68a87" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.295s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 15:19:17 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-3aa08854-682b-403c-bdbd-cd437d00abae tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Connected to 172.16.0.220:3260 {{(pid=72382) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 15:19:17 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-3aa08854-682b-403c-bdbd-cd437d00abae tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] HCTL ('34', '-', '-', 0) found on session 15 with lun 0 {{(pid=72382) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 15:19:17 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-3aa08854-682b-403c-bdbd-cd437d00abae tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72382) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 15:19:17 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:19:17 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.022s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:19:17 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f0c60f4-e97a-4ccc-aee0-5969375e9e26]: (4, ('- - 0', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:19:17 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-3aa08854-682b-403c-bdbd-cd437d00abae tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Searching for a device in session 15 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72382) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 15:19:17 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-3aa08854-682b-403c-bdbd-cd437d00abae tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mtLoQzKG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72382) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 15:19:18 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-3aa08854-682b-403c-bdbd-cd437d00abae tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.332s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 15:19:18 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-3aa08854-682b-403c-bdbd-cd437d00abae tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] <== connect_volume: return (1334ms) {'type': 'block', 'scsi_wwn': '23038616233303532', 'path': '/dev/sdc'} {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 15:19:18 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3aa08854-682b-403c-bdbd-cd437d00abae tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] [instance: c9766433-4c5a-40ed-a212-715a24f42b91] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23038616233303532', 'path': '/dev/sdc'} {{(pid=72382) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 15:19:18 user nova-compute[72382]: DEBUG nova.objects.instance [None req-3aa08854-682b-403c-bdbd-cd437d00abae tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Lazy-loading 'flavor' on Instance uuid c9766433-4c5a-40ed-a212-715a24f42b91 {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:19:18 user nova-compute[72382]: DEBUG nova.virt.libvirt.guest [None req-3aa08854-682b-403c-bdbd-cd437d00abae tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 15:19:18 user nova-compute[72382]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 15:19:18 user nova-compute[72382]:   <source dev="/dev/sdc"/>
Aug 09 15:19:18 user nova-compute[72382]:   <target dev="vdb" bus="virtio"/>
Aug 09 15:19:18 user nova-compute[72382]:   <serial>fb47e85c-aaa9-4165-8be3-125572b68a87</serial>
Aug 09 15:19:18 user nova-compute[72382]: </disk>
Aug 09 15:19:18 user nova-compute[72382]:  {{(pid=72382) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 15:19:18 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-3aa08854-682b-403c-bdbd-cd437d00abae tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] No BDM found with device name vda, not building metadata. {{(pid=72382) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 15:19:18 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-3aa08854-682b-403c-bdbd-cd437d00abae tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72382) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 15:19:18 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-3aa08854-682b-403c-bdbd-cd437d00abae tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] No VIF found with MAC fa:16:3e:66:9f:0b, not building metadata {{(pid=72382) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 15:19:18 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-3aa08854-682b-403c-bdbd-cd437d00abae tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Lock "c9766433-4c5a-40ed-a212-715a24f42b91" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.882s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:19:18 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:19:20 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:19:21 user nova-compute[72382]: DEBUG nova.compute.manager [None req-a4249476-c7ac-4092-aa28-25f3bea7b55b tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] [instance: c9766433-4c5a-40ed-a212-715a24f42b91] Stashing vm_state: active {{(pid=72382) _prep_resize /opt/stack/nova/nova/compute/manager.py:5535}}
Aug 09 15:19:21 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-a4249476-c7ac-4092-aa28-25f3bea7b55b tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:19:21 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-a4249476-c7ac-4092-aa28-25f3bea7b55b tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:19:21 user nova-compute[72382]: DEBUG nova.objects.instance [None req-a4249476-c7ac-4092-aa28-25f3bea7b55b tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Lazy-loading 'pci_requests' on Instance uuid c9766433-4c5a-40ed-a212-715a24f42b91 {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:19:21 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-a4249476-c7ac-4092-aa28-25f3bea7b55b tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72382) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 15:19:21 user nova-compute[72382]: INFO nova.compute.claims [None req-a4249476-c7ac-4092-aa28-25f3bea7b55b tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] [instance: c9766433-4c5a-40ed-a212-715a24f42b91] Claim successful on node user
Aug 09 15:19:21 user nova-compute[72382]: DEBUG nova.objects.instance [None req-a4249476-c7ac-4092-aa28-25f3bea7b55b tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Lazy-loading 'resources' on Instance uuid c9766433-4c5a-40ed-a212-715a24f42b91 {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:19:21 user nova-compute[72382]: DEBUG nova.objects.instance [None req-a4249476-c7ac-4092-aa28-25f3bea7b55b tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Lazy-loading 'pci_devices' on Instance uuid c9766433-4c5a-40ed-a212-715a24f42b91 {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:19:21 user nova-compute[72382]: INFO nova.compute.resource_tracker [None req-a4249476-c7ac-4092-aa28-25f3bea7b55b tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] [instance: c9766433-4c5a-40ed-a212-715a24f42b91] Updating resource usage from migration 9c66c3cd-1944-431d-8434-648b9448178d
Aug 09 15:19:21 user nova-compute[72382]: DEBUG nova.compute.provider_tree [None req-a4249476-c7ac-4092-aa28-25f3bea7b55b tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Inventory has not changed in ProviderTree for provider: 7b15b0e5-df4d-49db-833b-2855d21d10ae {{(pid=72382) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 15:19:21 user nova-compute[72382]: DEBUG nova.scheduler.client.report [None req-a4249476-c7ac-4092-aa28-25f3bea7b55b tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Inventory has not changed for provider 7b15b0e5-df4d-49db-833b-2855d21d10ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72382) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 15:19:21 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-a4249476-c7ac-4092-aa28-25f3bea7b55b tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.485s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:19:21 user nova-compute[72382]: INFO nova.compute.manager [None req-a4249476-c7ac-4092-aa28-25f3bea7b55b tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] [instance: c9766433-4c5a-40ed-a212-715a24f42b91] Migrating
Aug 09 15:19:21 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-a4249476-c7ac-4092-aa28-25f3bea7b55b tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 15:19:21 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-a4249476-c7ac-4092-aa28-25f3bea7b55b tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Acquired lock "compute-rpcapi-router" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 15:19:21 user nova-compute[72382]: INFO nova.compute.rpcapi [None req-a4249476-c7ac-4092-aa28-25f3bea7b55b tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Aug 09 15:19:21 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-a4249476-c7ac-4092-aa28-25f3bea7b55b tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Releasing lock "compute-rpcapi-router" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 15:19:21 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-a4249476-c7ac-4092-aa28-25f3bea7b55b tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Acquiring lock "refresh_cache-c9766433-4c5a-40ed-a212-715a24f42b91" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 15:19:21 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-a4249476-c7ac-4092-aa28-25f3bea7b55b tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Acquired lock "refresh_cache-c9766433-4c5a-40ed-a212-715a24f42b91" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 15:19:21 user nova-compute[72382]: DEBUG nova.network.neutron [None req-a4249476-c7ac-4092-aa28-25f3bea7b55b tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] [instance: c9766433-4c5a-40ed-a212-715a24f42b91] Building network info cache for instance {{(pid=72382) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 15:19:22 user nova-compute[72382]: DEBUG nova.network.neutron [None req-a4249476-c7ac-4092-aa28-25f3bea7b55b tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] [instance: c9766433-4c5a-40ed-a212-715a24f42b91] Updating instance_info_cache with network_info: [{"id": "599dae3b-13bb-47af-b889-0037e03d5e31", "address": "fa:16:3e:66:9f:0b", "network": {"id": "63303ac8-d370-4386-a6bc-576677b64740", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1379220233-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f45d010dd474c92a6b24bf977564ad1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap599dae3b-13", "ovs_interfaceid": "599dae3b-13bb-47af-b889-0037e03d5e31", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:19:22 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-a4249476-c7ac-4092-aa28-25f3bea7b55b tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Releasing lock "refresh_cache-c9766433-4c5a-40ed-a212-715a24f42b91" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 15:19:22 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-a4249476-c7ac-4092-aa28-25f3bea7b55b tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] [instance: c9766433-4c5a-40ed-a212-715a24f42b91] Starting migrate_disk_and_power_off {{(pid=72382) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Aug 09 15:19:22 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:19:22 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:19:22 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:19:22 user nova-compute[72382]: DEBUG nova.compute.manager [req-7ba40751-9e7f-453c-a5a4-3b09d654c52a req-5881f8aa-1827-49d9-bda9-212d667f747f service nova] [instance: c9766433-4c5a-40ed-a212-715a24f42b91] Received event network-vif-unplugged-599dae3b-13bb-47af-b889-0037e03d5e31 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:19:22 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-7ba40751-9e7f-453c-a5a4-3b09d654c52a req-5881f8aa-1827-49d9-bda9-212d667f747f service nova] Acquiring lock "c9766433-4c5a-40ed-a212-715a24f42b91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:19:22 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-7ba40751-9e7f-453c-a5a4-3b09d654c52a req-5881f8aa-1827-49d9-bda9-212d667f747f service nova] Lock "c9766433-4c5a-40ed-a212-715a24f42b91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:19:22 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-7ba40751-9e7f-453c-a5a4-3b09d654c52a req-5881f8aa-1827-49d9-bda9-212d667f747f service nova] Lock "c9766433-4c5a-40ed-a212-715a24f42b91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:19:22 user nova-compute[72382]: DEBUG nova.compute.manager [req-7ba40751-9e7f-453c-a5a4-3b09d654c52a req-5881f8aa-1827-49d9-bda9-212d667f747f service nova] [instance: c9766433-4c5a-40ed-a212-715a24f42b91] No waiting events found dispatching network-vif-unplugged-599dae3b-13bb-47af-b889-0037e03d5e31 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:19:22 user nova-compute[72382]: WARNING nova.compute.manager [req-7ba40751-9e7f-453c-a5a4-3b09d654c52a req-5881f8aa-1827-49d9-bda9-212d667f747f service nova] [instance: c9766433-4c5a-40ed-a212-715a24f42b91] Received unexpected event network-vif-unplugged-599dae3b-13bb-47af-b889-0037e03d5e31 for instance with vm_state active and task_state resize_migrating.
Aug 09 15:19:23 user nova-compute[72382]: INFO nova.virt.libvirt.driver [-] [instance: c9766433-4c5a-40ed-a212-715a24f42b91] Instance destroyed successfully.
Aug 09 15:19:23 user nova-compute[72382]: DEBUG nova.virt.libvirt.vif [None req-a4249476-c7ac-4092-aa28-25f3bea7b55b tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T15:15:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-2120220558',display_name='tempest-ServerActionsTestOtherB-server-2120220558',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-2120220558',id=5,image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOdAPO5nl2/3VDHoi/8yD5s8l1+mDVit5A+n/HDnoxJgZMgOR9rAXiFsYVLEG+MsUeEQU8np4/pg88xwFSbi1vuFZkvV9b5532CTazhkqSlb4YuAKF8mo8fSFbyD8FwytA==',key_name='tempest-keypair-1399201542',keypairs=<?>,launch_index=0,launched_at=2023-08-09T15:15:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='9f45d010dd474c92a6b24bf977564ad1',ramdisk_id='',reservation_id='r-rng7ms7j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-250545160',owner_user_name='tempest-ServerActionsTestOtherB-250545160-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T15:19:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='232fbbd15fea4894be7cebb13ea45cf9',uuid=c9766433-4c5a-40ed-a212-715a24f42b91,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "599dae3b-13bb-47af-b889-0037e03d5e31", "address": "fa:16:3e:66:9f:0b", "network": {"id": "63303ac8-d370-4386-a6bc-576677b64740", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1379220233-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1379220233-network", "vif_mac": "fa:16:3e:66:9f:0b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f45d010dd474c92a6b24bf977564ad1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap599dae3b-13", "ovs_interfaceid": "599dae3b-13bb-47af-b889-0037e03d5e31", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 15:19:23 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-a4249476-c7ac-4092-aa28-25f3bea7b55b tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Converting VIF {"id": "599dae3b-13bb-47af-b889-0037e03d5e31", "address": "fa:16:3e:66:9f:0b", "network": {"id": "63303ac8-d370-4386-a6bc-576677b64740", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1379220233-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1379220233-network", "vif_mac": "fa:16:3e:66:9f:0b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f45d010dd474c92a6b24bf977564ad1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap599dae3b-13", "ovs_interfaceid": "599dae3b-13bb-47af-b889-0037e03d5e31", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 15:19:23 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-a4249476-c7ac-4092-aa28-25f3bea7b55b tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:66:9f:0b,bridge_name='br-int',has_traffic_filtering=True,id=599dae3b-13bb-47af-b889-0037e03d5e31,network=Network(63303ac8-d370-4386-a6bc-576677b64740),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap599dae3b-13') {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 15:19:23 user nova-compute[72382]: DEBUG os_vif [None req-a4249476-c7ac-4092-aa28-25f3bea7b55b tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:66:9f:0b,bridge_name='br-int',has_traffic_filtering=True,id=599dae3b-13bb-47af-b889-0037e03d5e31,network=Network(63303ac8-d370-4386-a6bc-576677b64740),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap599dae3b-13') {{(pid=72382) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 15:19:23 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:19:23 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap599dae3b-13, bridge=br-int, if_exists=True) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:19:23 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:19:23 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:19:23 user nova-compute[72382]: INFO os_vif [None req-a4249476-c7ac-4092-aa28-25f3bea7b55b tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:66:9f:0b,bridge_name='br-int',has_traffic_filtering=True,id=599dae3b-13bb-47af-b889-0037e03d5e31,network=Network(63303ac8-d370-4386-a6bc-576677b64740),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap599dae3b-13')
Aug 09 15:19:23 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a4249476-c7ac-4092-aa28-25f3bea7b55b tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] [instance: c9766433-4c5a-40ed-a212-715a24f42b91] calling os-brick to detach iSCSI Volume {{(pid=72382) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 15:19:23 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4249476-c7ac-4092-aa28-25f3bea7b55b tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2a0c768340>, {'target_iqns': ['iqn.2010-10.org.openstack:fb47e85c-aaa9-4165-8be3-125572b68a87'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mtLoQzKG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 15:19:23 user nova-compute[72382]: WARNING os_brick.initiator.connectors.base [None req-a4249476-c7ac-4092-aa28-25f3bea7b55b tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 15:19:23 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-a4249476-c7ac-4092-aa28-25f3bea7b55b tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 15:19:23 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-a4249476-c7ac-4092-aa28-25f3bea7b55b tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 15:19:23 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4249476-c7ac-4092-aa28-25f3bea7b55b tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fb47e85c-aaa9-4165-8be3-125572b68a87', 0)] {{(pid=72382) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 15:19:23 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:19:23 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:19:23 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc117771-8860-4efb-b839-420284a99f53]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9c2a0938-fb5c-434c-91ba-15e8823c1348\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fb47e85c-aaa9-4165-8be3-125572b68a87\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:19:23 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:19:23 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:19:23 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1dfa899-367b-47f7-8e2e-eaaa1666b650]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c2a0938-fb5c-434c-91ba-15e8823c1348 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb47e85c-aaa9-4165-8be3-125572b68a87 (non-flash)\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:19:23 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4249476-c7ac-4092-aa28-25f3bea7b55b tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c2a0938-fb5c-434c-91ba-15e8823c1348 (non-flash)
Aug 09 15:19:23 user nova-compute[72382]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)
Aug 09 15:19:23 user nova-compute[72382]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb47e85c-aaa9-4165-8be3-125572b68a87 (non-flash)
Aug 09 15:19:23 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 15:19:23 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4249476-c7ac-4092-aa28-25f3bea7b55b tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c2a0938-fb5c-434c-91ba-15e8823c1348 (non-flash)
Aug 09 15:19:23 user nova-compute[72382]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)
Aug 09 15:19:23 user nova-compute[72382]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb47e85c-aaa9-4165-8be3-125572b68a87 (non-flash)
Aug 09 15:19:23 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 15:19:23 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4249476-c7ac-4092-aa28-25f3bea7b55b tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2a0c3652d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fb47e85c-aaa9-4165-8be3-125572b68a87'): ({'sdc'}, set())}) {{(pid=72382) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 15:19:23 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-a4249476-c7ac-4092-aa28-25f3bea7b55b tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Removing single pathed devices sdc {{(pid=72382) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 15:19:23 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:19:23 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:19:23 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[57255692-87c5-42dd-b52f-d405f7608786]: (4, ('path checker states:\nup                  2\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:19:23 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:19:23 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:19:23 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[73b817cb-6baa-45a9-b58b-9d4522d0a289]: (4, ('ok\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:19:23 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-a4249476-c7ac-4092-aa28-25f3bea7b55b tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Flushing IO for device /dev/sdc {{(pid=72382) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 15:19:23 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:19:23 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:19:23 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[629c870b-5074-4224-bfc9-1a98701784d2]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:19:23 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-a4249476-c7ac-4092-aa28-25f3bea7b55b tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72382) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 15:19:23 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:19:23 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.042s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:19:23 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5f57f50-5b39-4b84-909b-17974e0f1efe]: (4, ('1', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:19:23 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-a4249476-c7ac-4092-aa28-25f3bea7b55b tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72382) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 15:19:23 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-a4249476-c7ac-4092-aa28-25f3bea7b55b tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] SCSI volumes sdc have been removed. {{(pid=72382) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 15:19:23 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4249476-c7ac-4092-aa28-25f3bea7b55b tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fb47e85c-aaa9-4165-8be3-125572b68a87')] {{(pid=72382) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 15:19:23 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb47e85c-aaa9-4165-8be3-125572b68a87 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:19:23 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb47e85c-aaa9-4165-8be3-125572b68a87 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:19:23 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[05e1af0e-9112-4ea6-9e53-1c4d1f64cfb8]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:19:23 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4249476-c7ac-4092-aa28-25f3bea7b55b tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:19:23 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb47e85c-aaa9-4165-8be3-125572b68a87 -p 172.16.0.220:3260 --logout {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:19:23 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb47e85c-aaa9-4165-8be3-125572b68a87 -p 172.16.0.220:3260 --logout" returned: 0 in 0.048s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:19:23 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b4d952c-b5db-4fb3-b5e6-f15322c6737f]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:fb47e85c-aaa9-4165-8be3-125572b68a87, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:fb47e85c-aaa9-4165-8be3-125572b68a87, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:19:23 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4249476-c7ac-4092-aa28-25f3bea7b55b tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:fb47e85c-aaa9-4165-8be3-125572b68a87, portal: 172.16.0.220,3260]
Aug 09 15:19:23 user nova-compute[72382]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:fb47e85c-aaa9-4165-8be3-125572b68a87, portal: 172.16.0.220,3260] successful.
Aug 09 15:19:23 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:19:23 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb47e85c-aaa9-4165-8be3-125572b68a87 -p 172.16.0.220:3260 --op delete {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:19:23 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb47e85c-aaa9-4165-8be3-125572b68a87 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:19:23 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c358aea-d27f-4823-85b7-4640594b04e9]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:19:23 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4249476-c7ac-4092-aa28-25f3bea7b55b tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:19:23 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-a4249476-c7ac-4092-aa28-25f3bea7b55b tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.287s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 15:19:23 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4249476-c7ac-4092-aa28-25f3bea7b55b tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] <== disconnect_volume: return (289ms) None {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 15:19:23 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a4249476-c7ac-4092-aa28-25f3bea7b55b tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] [instance: c9766433-4c5a-40ed-a212-715a24f42b91] Disconnected iSCSI Volume {{(pid=72382) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 15:19:23 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-a4249476-c7ac-4092-aa28-25f3bea7b55b tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9766433-4c5a-40ed-a212-715a24f42b91/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:19:23 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-a4249476-c7ac-4092-aa28-25f3bea7b55b tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9766433-4c5a-40ed-a212-715a24f42b91/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:19:23 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-a4249476-c7ac-4092-aa28-25f3bea7b55b tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9766433-4c5a-40ed-a212-715a24f42b91/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:19:23 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-a4249476-c7ac-4092-aa28-25f3bea7b55b tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9766433-4c5a-40ed-a212-715a24f42b91/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:19:23 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-a4249476-c7ac-4092-aa28-25f3bea7b55b tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72382) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 15:19:23 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-a4249476-c7ac-4092-aa28-25f3bea7b55b tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/c9766433-4c5a-40ed-a212-715a24f42b91_resize/disk /opt/stack/data/nova/instances/c9766433-4c5a-40ed-a212-715a24f42b91/disk {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:19:23 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:19:24 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-87ed9fe4-c359-4c07-bef1-34a29c22ac3e tempest-TestVolumeSwap-583684665 tempest-TestVolumeSwap-583684665-project-member] Acquiring lock "9a82f146-97ce-4319-8b25-c1b090965e53" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:19:24 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-87ed9fe4-c359-4c07-bef1-34a29c22ac3e tempest-TestVolumeSwap-583684665 tempest-TestVolumeSwap-583684665-project-member] Lock "9a82f146-97ce-4319-8b25-c1b090965e53" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:19:24 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-87ed9fe4-c359-4c07-bef1-34a29c22ac3e tempest-TestVolumeSwap-583684665 tempest-TestVolumeSwap-583684665-project-member] Acquiring lock "9a82f146-97ce-4319-8b25-c1b090965e53-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:19:24 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-87ed9fe4-c359-4c07-bef1-34a29c22ac3e tempest-TestVolumeSwap-583684665 tempest-TestVolumeSwap-583684665-project-member] Lock "9a82f146-97ce-4319-8b25-c1b090965e53-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:19:24 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-87ed9fe4-c359-4c07-bef1-34a29c22ac3e tempest-TestVolumeSwap-583684665 tempest-TestVolumeSwap-583684665-project-member] Lock "9a82f146-97ce-4319-8b25-c1b090965e53-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:19:24 user nova-compute[72382]: INFO nova.compute.manager [None req-87ed9fe4-c359-4c07-bef1-34a29c22ac3e tempest-TestVolumeSwap-583684665 tempest-TestVolumeSwap-583684665-project-member] [instance: 9a82f146-97ce-4319-8b25-c1b090965e53] Terminating instance
Aug 09 15:19:24 user nova-compute[72382]: DEBUG nova.compute.manager [None req-87ed9fe4-c359-4c07-bef1-34a29c22ac3e tempest-TestVolumeSwap-583684665 tempest-TestVolumeSwap-583684665-project-member] [instance: 9a82f146-97ce-4319-8b25-c1b090965e53] Start destroying the instance on the hypervisor. {{(pid=72382) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 15:19:24 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:19:24 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:19:24 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:19:24 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:19:24 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:19:24 user nova-compute[72382]: DEBUG nova.compute.manager [req-c6e7de8a-aedd-4240-b7d4-e795af33e3e0 req-e5a70391-35b2-4853-a3dc-aa66c0af2199 service nova] [instance: 9a82f146-97ce-4319-8b25-c1b090965e53] Received event network-vif-unplugged-759df480-caa9-4610-893d-3784aaddf4b3 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:19:24 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-c6e7de8a-aedd-4240-b7d4-e795af33e3e0 req-e5a70391-35b2-4853-a3dc-aa66c0af2199 service nova] Acquiring lock "9a82f146-97ce-4319-8b25-c1b090965e53-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:19:24 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-c6e7de8a-aedd-4240-b7d4-e795af33e3e0 req-e5a70391-35b2-4853-a3dc-aa66c0af2199 service nova] Lock "9a82f146-97ce-4319-8b25-c1b090965e53-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:19:24 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-c6e7de8a-aedd-4240-b7d4-e795af33e3e0 req-e5a70391-35b2-4853-a3dc-aa66c0af2199 service nova] Lock "9a82f146-97ce-4319-8b25-c1b090965e53-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:19:24 user nova-compute[72382]: DEBUG nova.compute.manager [req-c6e7de8a-aedd-4240-b7d4-e795af33e3e0 req-e5a70391-35b2-4853-a3dc-aa66c0af2199 service nova] [instance: 9a82f146-97ce-4319-8b25-c1b090965e53] No waiting events found dispatching network-vif-unplugged-759df480-caa9-4610-893d-3784aaddf4b3 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:19:24 user nova-compute[72382]: DEBUG nova.compute.manager [req-c6e7de8a-aedd-4240-b7d4-e795af33e3e0 req-e5a70391-35b2-4853-a3dc-aa66c0af2199 service nova] [instance: 9a82f146-97ce-4319-8b25-c1b090965e53] Received event network-vif-unplugged-759df480-caa9-4610-893d-3784aaddf4b3 for instance with task_state deleting. {{(pid=72382) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 15:19:24 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-a4249476-c7ac-4092-aa28-25f3bea7b55b tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] CMD "cp -r /opt/stack/data/nova/instances/c9766433-4c5a-40ed-a212-715a24f42b91_resize/disk /opt/stack/data/nova/instances/c9766433-4c5a-40ed-a212-715a24f42b91/disk" returned: 0 in 0.672s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:19:24 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-a4249476-c7ac-4092-aa28-25f3bea7b55b tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/c9766433-4c5a-40ed-a212-715a24f42b91_resize/disk.info /opt/stack/data/nova/instances/c9766433-4c5a-40ed-a212-715a24f42b91/disk.info {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:19:24 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-a4249476-c7ac-4092-aa28-25f3bea7b55b tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] CMD "cp -r /opt/stack/data/nova/instances/c9766433-4c5a-40ed-a212-715a24f42b91_resize/disk.info /opt/stack/data/nova/instances/c9766433-4c5a-40ed-a212-715a24f42b91/disk.info" returned: 0 in 0.040s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:19:24 user nova-compute[72382]: INFO nova.virt.libvirt.driver [-] [instance: 9a82f146-97ce-4319-8b25-c1b090965e53] Instance destroyed successfully.
Aug 09 15:19:24 user nova-compute[72382]: DEBUG nova.objects.instance [None req-87ed9fe4-c359-4c07-bef1-34a29c22ac3e tempest-TestVolumeSwap-583684665 tempest-TestVolumeSwap-583684665-project-member] Lazy-loading 'resources' on Instance uuid 9a82f146-97ce-4319-8b25-c1b090965e53 {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:19:24 user nova-compute[72382]: DEBUG nova.compute.manager [req-6466e861-9f38-4d65-8991-cbf29d5cbcb8 req-a20e5840-3b48-4cb2-b0df-c1e075acfd68 service nova] [instance: c9766433-4c5a-40ed-a212-715a24f42b91] Received event network-vif-plugged-599dae3b-13bb-47af-b889-0037e03d5e31 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:19:24 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-6466e861-9f38-4d65-8991-cbf29d5cbcb8 req-a20e5840-3b48-4cb2-b0df-c1e075acfd68 service nova] Acquiring lock "c9766433-4c5a-40ed-a212-715a24f42b91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:19:24 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-6466e861-9f38-4d65-8991-cbf29d5cbcb8 req-a20e5840-3b48-4cb2-b0df-c1e075acfd68 service nova] Lock "c9766433-4c5a-40ed-a212-715a24f42b91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:19:24 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-6466e861-9f38-4d65-8991-cbf29d5cbcb8 req-a20e5840-3b48-4cb2-b0df-c1e075acfd68 service nova] Lock "c9766433-4c5a-40ed-a212-715a24f42b91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:19:24 user nova-compute[72382]: DEBUG nova.compute.manager [req-6466e861-9f38-4d65-8991-cbf29d5cbcb8 req-a20e5840-3b48-4cb2-b0df-c1e075acfd68 service nova] [instance: c9766433-4c5a-40ed-a212-715a24f42b91] No waiting events found dispatching network-vif-plugged-599dae3b-13bb-47af-b889-0037e03d5e31 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:19:24 user nova-compute[72382]: WARNING nova.compute.manager [req-6466e861-9f38-4d65-8991-cbf29d5cbcb8 req-a20e5840-3b48-4cb2-b0df-c1e075acfd68 service nova] [instance: c9766433-4c5a-40ed-a212-715a24f42b91] Received unexpected event network-vif-plugged-599dae3b-13bb-47af-b889-0037e03d5e31 for instance with vm_state active and task_state resize_migrating.
Aug 09 15:19:24 user nova-compute[72382]: DEBUG nova.virt.libvirt.vif [None req-87ed9fe4-c359-4c07-bef1-34a29c22ac3e tempest-TestVolumeSwap-583684665 tempest-TestVolumeSwap-583684665-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T15:15:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-2136349497',display_name='tempest-TestVolumeSwap-server-2136349497',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-2136349497',id=10,image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD4INTzqOUtJmSnJh1Eoc/6VL/ZJB2d4TtStHNFM3qdUiRDBv80UJ34Z9r/gBzURcH3+ZKqKuJ+1FmnlRe71prsqTjLuJRRRfoqNwXqe198BrDYu8rL10eFUe3DXcyiaKg==',key_name='tempest-keypair-1234113342',keypairs=<?>,launch_index=0,launched_at=2023-08-09T15:16:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d83791b742c0403ab043a6a41c81042e',ramdisk_id='',reservation_id='r-xhefoujb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-583684665',owner_user_name='tempest-TestVolumeSwap-583684665-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T15:16:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='02c5e77225644b918b4c675aad3b946b',uuid=9a82f146-97ce-4319-8b25-c1b090965e53,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "759df480-caa9-4610-893d-3784aaddf4b3", "address": "fa:16:3e:71:e7:dc", "network": {"id": "1cf9bb6d-ae38-4dd6-bd50-c20ff14c5ae6", "bridge": "br-int", "label": "tempest-TestVolumeSwap-488911533-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d83791b742c0403ab043a6a41c81042e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap759df480-ca", "ovs_interfaceid": "759df480-caa9-4610-893d-3784aaddf4b3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 15:19:24 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-87ed9fe4-c359-4c07-bef1-34a29c22ac3e tempest-TestVolumeSwap-583684665 tempest-TestVolumeSwap-583684665-project-member] Converting VIF {"id": "759df480-caa9-4610-893d-3784aaddf4b3", "address": "fa:16:3e:71:e7:dc", "network": {"id": "1cf9bb6d-ae38-4dd6-bd50-c20ff14c5ae6", "bridge": "br-int", "label": "tempest-TestVolumeSwap-488911533-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d83791b742c0403ab043a6a41c81042e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap759df480-ca", "ovs_interfaceid": "759df480-caa9-4610-893d-3784aaddf4b3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 15:19:24 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-87ed9fe4-c359-4c07-bef1-34a29c22ac3e tempest-TestVolumeSwap-583684665 tempest-TestVolumeSwap-583684665-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:71:e7:dc,bridge_name='br-int',has_traffic_filtering=True,id=759df480-caa9-4610-893d-3784aaddf4b3,network=Network(1cf9bb6d-ae38-4dd6-bd50-c20ff14c5ae6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap759df480-ca') {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 15:19:24 user nova-compute[72382]: DEBUG os_vif [None req-87ed9fe4-c359-4c07-bef1-34a29c22ac3e tempest-TestVolumeSwap-583684665 tempest-TestVolumeSwap-583684665-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:71:e7:dc,bridge_name='br-int',has_traffic_filtering=True,id=759df480-caa9-4610-893d-3784aaddf4b3,network=Network(1cf9bb6d-ae38-4dd6-bd50-c20ff14c5ae6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap759df480-ca') {{(pid=72382) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 15:19:24 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:19:24 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap759df480-ca, bridge=br-int, if_exists=True) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:19:24 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:19:24 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:19:24 user nova-compute[72382]: INFO os_vif [None req-87ed9fe4-c359-4c07-bef1-34a29c22ac3e tempest-TestVolumeSwap-583684665 tempest-TestVolumeSwap-583684665-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:71:e7:dc,bridge_name='br-int',has_traffic_filtering=True,id=759df480-caa9-4610-893d-3784aaddf4b3,network=Network(1cf9bb6d-ae38-4dd6-bd50-c20ff14c5ae6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap759df480-ca')
Aug 09 15:19:24 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-87ed9fe4-c359-4c07-bef1-34a29c22ac3e tempest-TestVolumeSwap-583684665 tempest-TestVolumeSwap-583684665-project-member] [instance: 9a82f146-97ce-4319-8b25-c1b090965e53] Deleting instance files /opt/stack/data/nova/instances/9a82f146-97ce-4319-8b25-c1b090965e53_del
Aug 09 15:19:24 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-87ed9fe4-c359-4c07-bef1-34a29c22ac3e tempest-TestVolumeSwap-583684665 tempest-TestVolumeSwap-583684665-project-member] [instance: 9a82f146-97ce-4319-8b25-c1b090965e53] Deletion of /opt/stack/data/nova/instances/9a82f146-97ce-4319-8b25-c1b090965e53_del complete
Aug 09 15:19:24 user nova-compute[72382]: INFO nova.compute.manager [None req-87ed9fe4-c359-4c07-bef1-34a29c22ac3e tempest-TestVolumeSwap-583684665 tempest-TestVolumeSwap-583684665-project-member] [instance: 9a82f146-97ce-4319-8b25-c1b090965e53] Took 0.94 seconds to destroy the instance on the hypervisor.
Aug 09 15:19:24 user nova-compute[72382]: DEBUG oslo.service.loopingcall [None req-87ed9fe4-c359-4c07-bef1-34a29c22ac3e tempest-TestVolumeSwap-583684665 tempest-TestVolumeSwap-583684665-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72382) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 15:19:24 user nova-compute[72382]: DEBUG nova.compute.manager [-] [instance: 9a82f146-97ce-4319-8b25-c1b090965e53] Deallocating network for instance {{(pid=72382) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 15:19:24 user nova-compute[72382]: DEBUG nova.network.neutron [-] [instance: 9a82f146-97ce-4319-8b25-c1b090965e53] deallocate_for_instance() {{(pid=72382) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 15:19:25 user nova-compute[72382]: DEBUG nova.network.neutron [None req-a4249476-c7ac-4092-aa28-25f3bea7b55b tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] [instance: c9766433-4c5a-40ed-a212-715a24f42b91] Port 599dae3b-13bb-47af-b889-0037e03d5e31 binding to destination host user is already ACTIVE {{(pid=72382) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Aug 09 15:19:25 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-a4249476-c7ac-4092-aa28-25f3bea7b55b tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Acquiring lock "c9766433-4c5a-40ed-a212-715a24f42b91-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:19:25 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-a4249476-c7ac-4092-aa28-25f3bea7b55b tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Lock "c9766433-4c5a-40ed-a212-715a24f42b91-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:19:25 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-a4249476-c7ac-4092-aa28-25f3bea7b55b tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Lock "c9766433-4c5a-40ed-a212-715a24f42b91-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:19:26 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-a4249476-c7ac-4092-aa28-25f3bea7b55b tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Acquiring lock "refresh_cache-c9766433-4c5a-40ed-a212-715a24f42b91" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 15:19:26 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-a4249476-c7ac-4092-aa28-25f3bea7b55b tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Acquired lock "refresh_cache-c9766433-4c5a-40ed-a212-715a24f42b91" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 15:19:26 user nova-compute[72382]: DEBUG nova.network.neutron [None req-a4249476-c7ac-4092-aa28-25f3bea7b55b tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] [instance: c9766433-4c5a-40ed-a212-715a24f42b91] Building network info cache for instance {{(pid=72382) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 15:19:26 user nova-compute[72382]: DEBUG nova.network.neutron [-] [instance: 9a82f146-97ce-4319-8b25-c1b090965e53] Updating instance_info_cache with network_info: [] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:19:26 user nova-compute[72382]: DEBUG nova.compute.manager [req-11c0fe60-583c-4c9d-8f9d-7efebe7a0f69 req-de2eb5a7-7a8e-4256-bea8-3b9eb9d3460e service nova] [instance: 9a82f146-97ce-4319-8b25-c1b090965e53] Received event network-vif-deleted-759df480-caa9-4610-893d-3784aaddf4b3 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:19:26 user nova-compute[72382]: INFO nova.compute.manager [req-11c0fe60-583c-4c9d-8f9d-7efebe7a0f69 req-de2eb5a7-7a8e-4256-bea8-3b9eb9d3460e service nova] [instance: 9a82f146-97ce-4319-8b25-c1b090965e53] Neutron deleted interface 759df480-caa9-4610-893d-3784aaddf4b3; detaching it from the instance and deleting it from the info cache
Aug 09 15:19:26 user nova-compute[72382]: DEBUG nova.network.neutron [req-11c0fe60-583c-4c9d-8f9d-7efebe7a0f69 req-de2eb5a7-7a8e-4256-bea8-3b9eb9d3460e service nova] [instance: 9a82f146-97ce-4319-8b25-c1b090965e53] Updating instance_info_cache with network_info: [] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:19:26 user nova-compute[72382]: INFO nova.compute.manager [-] [instance: 9a82f146-97ce-4319-8b25-c1b090965e53] Took 1.43 seconds to deallocate network for instance.
Aug 09 15:19:26 user nova-compute[72382]: DEBUG nova.compute.manager [req-11c0fe60-583c-4c9d-8f9d-7efebe7a0f69 req-de2eb5a7-7a8e-4256-bea8-3b9eb9d3460e service nova] [instance: 9a82f146-97ce-4319-8b25-c1b090965e53] Detach interface failed, port_id=759df480-caa9-4610-893d-3784aaddf4b3, reason: Instance 9a82f146-97ce-4319-8b25-c1b090965e53 could not be found. {{(pid=72382) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 09 15:19:26 user nova-compute[72382]: DEBUG nova.compute.manager [req-0c44550a-0c82-4c6c-b4cb-1b3d751d2064 req-224f125c-dd93-4abd-937d-4c42fda8f0fb service nova] [instance: 9a82f146-97ce-4319-8b25-c1b090965e53] Received event network-vif-plugged-759df480-caa9-4610-893d-3784aaddf4b3 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:19:26 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-0c44550a-0c82-4c6c-b4cb-1b3d751d2064 req-224f125c-dd93-4abd-937d-4c42fda8f0fb service nova] Acquiring lock "9a82f146-97ce-4319-8b25-c1b090965e53-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:19:26 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-0c44550a-0c82-4c6c-b4cb-1b3d751d2064 req-224f125c-dd93-4abd-937d-4c42fda8f0fb service nova] Lock "9a82f146-97ce-4319-8b25-c1b090965e53-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:19:26 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-0c44550a-0c82-4c6c-b4cb-1b3d751d2064 req-224f125c-dd93-4abd-937d-4c42fda8f0fb service nova] Lock "9a82f146-97ce-4319-8b25-c1b090965e53-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:19:26 user nova-compute[72382]: DEBUG nova.compute.manager [req-0c44550a-0c82-4c6c-b4cb-1b3d751d2064 req-224f125c-dd93-4abd-937d-4c42fda8f0fb service nova] [instance: 9a82f146-97ce-4319-8b25-c1b090965e53] No waiting events found dispatching network-vif-plugged-759df480-caa9-4610-893d-3784aaddf4b3 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:19:26 user nova-compute[72382]: WARNING nova.compute.manager [req-0c44550a-0c82-4c6c-b4cb-1b3d751d2064 req-224f125c-dd93-4abd-937d-4c42fda8f0fb service nova] [instance: 9a82f146-97ce-4319-8b25-c1b090965e53] Received unexpected event network-vif-plugged-759df480-caa9-4610-893d-3784aaddf4b3 for instance with vm_state active and task_state deleting.
Aug 09 15:19:26 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-87ed9fe4-c359-4c07-bef1-34a29c22ac3e tempest-TestVolumeSwap-583684665 tempest-TestVolumeSwap-583684665-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:19:26 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-87ed9fe4-c359-4c07-bef1-34a29c22ac3e tempest-TestVolumeSwap-583684665 tempest-TestVolumeSwap-583684665-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:19:26 user nova-compute[72382]: DEBUG nova.network.neutron [None req-a4249476-c7ac-4092-aa28-25f3bea7b55b tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] [instance: c9766433-4c5a-40ed-a212-715a24f42b91] Updating instance_info_cache with network_info: [{"id": "599dae3b-13bb-47af-b889-0037e03d5e31", "address": "fa:16:3e:66:9f:0b", "network": {"id": "63303ac8-d370-4386-a6bc-576677b64740", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1379220233-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f45d010dd474c92a6b24bf977564ad1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap599dae3b-13", "ovs_interfaceid": "599dae3b-13bb-47af-b889-0037e03d5e31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:19:26 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-a4249476-c7ac-4092-aa28-25f3bea7b55b tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Releasing lock "refresh_cache-c9766433-4c5a-40ed-a212-715a24f42b91" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 15:19:26 user nova-compute[72382]: DEBUG os_brick.utils [None req-a4249476-c7ac-4092-aa28-25f3bea7b55b tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 15:19:26 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:19:26 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:19:26 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[95aeebe2-48cf-4842-a82b-561e666c32db]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d2cfa7015fe\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:19:26 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:19:26 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:19:26 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b8eb886-5c6f-44be-a5ea-541e5b531a17]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:19:26 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:19:26 user nova-compute[72382]: DEBUG nova.compute.provider_tree [None req-87ed9fe4-c359-4c07-bef1-34a29c22ac3e tempest-TestVolumeSwap-583684665 tempest-TestVolumeSwap-583684665-project-member] Inventory has not changed in ProviderTree for provider: 7b15b0e5-df4d-49db-833b-2855d21d10ae {{(pid=72382) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 15:19:26 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:19:26 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[b390bf50-624a-43b8-8ed8-75c831155af4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:19:26 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[678f39fd-357b-4a78-b5d5-ff991081cc45]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:19:26 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-a4249476-c7ac-4092-aa28-25f3bea7b55b tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Running cmd (subprocess): nvme version {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:19:26 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-a4249476-c7ac-4092-aa28-25f3bea7b55b tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] 'nvme version' failed. Not Retrying. {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 15:19:26 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a4249476-c7ac-4092-aa28-25f3bea7b55b tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] nvme not present on system {{(pid=72382) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 15:19:26 user nova-compute[72382]: DEBUG nova.scheduler.client.report [None req-87ed9fe4-c359-4c07-bef1-34a29c22ac3e tempest-TestVolumeSwap-583684665 tempest-TestVolumeSwap-583684665-project-member] Inventory has not changed for provider 7b15b0e5-df4d-49db-833b-2855d21d10ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72382) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 15:19:26 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:19:26 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 15:19:26 user nova-compute[72382]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 15:19:26 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdb84f31-b34f-4a60-bd92-bb3994b6dc3a]: (4, '') {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:19:26 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.lightos [None req-a4249476-c7ac-4092-aa28-25f3bea7b55b tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72382) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 15:19:26 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.lightos [None req-a4249476-c7ac-4092-aa28-25f3bea7b55b tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72382) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 15:19:26 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.lightos [None req-a4249476-c7ac-4092-aa28-25f3bea7b55b tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] LIGHTOS: no hostnqn found. {{(pid=72382) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 15:19:26 user nova-compute[72382]: DEBUG os_brick.utils [None req-a4249476-c7ac-4092-aa28-25f3bea7b55b tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d2cfa7015fe', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 15:19:27 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-87ed9fe4-c359-4c07-bef1-34a29c22ac3e tempest-TestVolumeSwap-583684665 tempest-TestVolumeSwap-583684665-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.580s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:19:27 user nova-compute[72382]: INFO nova.scheduler.client.report [None req-87ed9fe4-c359-4c07-bef1-34a29c22ac3e tempest-TestVolumeSwap-583684665 tempest-TestVolumeSwap-583684665-project-member] Deleted allocations for instance 9a82f146-97ce-4319-8b25-c1b090965e53
Aug 09 15:19:27 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-87ed9fe4-c359-4c07-bef1-34a29c22ac3e tempest-TestVolumeSwap-583684665 tempest-TestVolumeSwap-583684665-project-member] Lock "9a82f146-97ce-4319-8b25-c1b090965e53" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.309s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:19:28 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:19:29 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:19:30 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:19:32 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e1896c8b-2176-426e-ad37-36557b1ce2a6 tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] Acquiring lock "b5aa7e23-9c2c-400e-a615-5839858749e1" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:19:32 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e1896c8b-2176-426e-ad37-36557b1ce2a6 tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] Lock "b5aa7e23-9c2c-400e-a615-5839858749e1" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:19:32 user nova-compute[72382]: INFO nova.compute.manager [None req-e1896c8b-2176-426e-ad37-36557b1ce2a6 tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] [instance: b5aa7e23-9c2c-400e-a615-5839858749e1] Detaching volume 9c2a0938-fb5c-434c-91ba-15e8823c1348
Aug 09 15:19:32 user nova-compute[72382]: INFO nova.virt.block_device [None req-e1896c8b-2176-426e-ad37-36557b1ce2a6 tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] [instance: b5aa7e23-9c2c-400e-a615-5839858749e1] Attempting to driver detach volume 9c2a0938-fb5c-434c-91ba-15e8823c1348 from mountpoint /dev/vdb
Aug 09 15:19:32 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-e1896c8b-2176-426e-ad37-36557b1ce2a6 tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] Attempting to detach device vdb from instance b5aa7e23-9c2c-400e-a615-5839858749e1 from the persistent domain config. {{(pid=72382) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 15:19:32 user nova-compute[72382]: DEBUG nova.virt.libvirt.guest [None req-e1896c8b-2176-426e-ad37-36557b1ce2a6 tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 15:19:32 user nova-compute[72382]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 15:19:32 user nova-compute[72382]:   <source dev="/dev/sdb"/>
Aug 09 15:19:32 user nova-compute[72382]:   <target dev="vdb" bus="virtio"/>
Aug 09 15:19:32 user nova-compute[72382]:   <serial>9c2a0938-fb5c-434c-91ba-15e8823c1348</serial>
Aug 09 15:19:32 user nova-compute[72382]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 15:19:32 user nova-compute[72382]: </disk>
Aug 09 15:19:32 user nova-compute[72382]:  {{(pid=72382) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 15:19:32 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-e1896c8b-2176-426e-ad37-36557b1ce2a6 tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] Successfully detached device vdb from instance b5aa7e23-9c2c-400e-a615-5839858749e1 from the persistent domain config.
Aug 09 15:19:32 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-e1896c8b-2176-426e-ad37-36557b1ce2a6 tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b5aa7e23-9c2c-400e-a615-5839858749e1 from the live domain config. {{(pid=72382) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 15:19:32 user nova-compute[72382]: DEBUG nova.virt.libvirt.guest [None req-e1896c8b-2176-426e-ad37-36557b1ce2a6 tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 15:19:32 user nova-compute[72382]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 15:19:32 user nova-compute[72382]:   <source dev="/dev/sdb"/>
Aug 09 15:19:32 user nova-compute[72382]:   <target dev="vdb" bus="virtio"/>
Aug 09 15:19:32 user nova-compute[72382]:   <serial>9c2a0938-fb5c-434c-91ba-15e8823c1348</serial>
Aug 09 15:19:32 user nova-compute[72382]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 15:19:32 user nova-compute[72382]: </disk>
Aug 09 15:19:32 user nova-compute[72382]:  {{(pid=72382) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 15:19:32 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Received event <DeviceRemovedEvent: 1691594372.9007592, b5aa7e23-9c2c-400e-a615-5839858749e1 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72382) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 15:19:32 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-e1896c8b-2176-426e-ad37-36557b1ce2a6 tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b5aa7e23-9c2c-400e-a615-5839858749e1 {{(pid=72382) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 15:19:32 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-e1896c8b-2176-426e-ad37-36557b1ce2a6 tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] Successfully detached device vdb from instance b5aa7e23-9c2c-400e-a615-5839858749e1 from the live domain config.
Aug 09 15:19:32 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e1896c8b-2176-426e-ad37-36557b1ce2a6 tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] [instance: b5aa7e23-9c2c-400e-a615-5839858749e1] calling os-brick to detach iSCSI Volume {{(pid=72382) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 15:19:32 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1896c8b-2176-426e-ad37-36557b1ce2a6 tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2a0c768340>, {'target_iqns': ['iqn.2010-10.org.openstack:9c2a0938-fb5c-434c-91ba-15e8823c1348'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xwYsrRaA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 15:19:32 user nova-compute[72382]: WARNING os_brick.initiator.connectors.base [None req-e1896c8b-2176-426e-ad37-36557b1ce2a6 tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 15:19:32 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-e1896c8b-2176-426e-ad37-36557b1ce2a6 tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 15:19:32 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-e1896c8b-2176-426e-ad37-36557b1ce2a6 tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 15:19:32 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1896c8b-2176-426e-ad37-36557b1ce2a6 tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9c2a0938-fb5c-434c-91ba-15e8823c1348', 0)] {{(pid=72382) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 15:19:32 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:19:32 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:19:32 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[2391ea83-306c-40c3-ba4c-693d0f6ad265]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9c2a0938-fb5c-434c-91ba-15e8823c1348\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:19:32 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:19:32 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:19:32 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3acda98-5974-4c61-a0ca-84ab6769db07]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c2a0938-fb5c-434c-91ba-15e8823c1348 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:19:32 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1896c8b-2176-426e-ad37-36557b1ce2a6 tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c2a0938-fb5c-434c-91ba-15e8823c1348 (non-flash)
Aug 09 15:19:32 user nova-compute[72382]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)
Aug 09 15:19:32 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 15:19:32 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1896c8b-2176-426e-ad37-36557b1ce2a6 tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c2a0938-fb5c-434c-91ba-15e8823c1348 (non-flash)
Aug 09 15:19:32 user nova-compute[72382]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)
Aug 09 15:19:32 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 15:19:32 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1896c8b-2176-426e-ad37-36557b1ce2a6 tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2a242c4b80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9c2a0938-fb5c-434c-91ba-15e8823c1348'): ({'sdb'}, set())}) {{(pid=72382) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 15:19:32 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-e1896c8b-2176-426e-ad37-36557b1ce2a6 tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] Removing single pathed devices sdb {{(pid=72382) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 15:19:32 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:19:32 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:19:32 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d2eaaf6-3b68-4f88-84b8-7fae1c80b38b]: (4, ('path checker states:\nup                  1\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:19:32 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:19:33 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:19:33 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[42ac94c0-1bdd-4448-860a-5fcb69c3c0c9]: (4, ('ok\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:19:33 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-e1896c8b-2176-426e-ad37-36557b1ce2a6 tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] Flushing IO for device /dev/sdb {{(pid=72382) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 15:19:33 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:19:33 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:19:33 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f6edf18-136d-49d4-89c1-e6f7bc28a675]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:19:33 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-e1896c8b-2176-426e-ad37-36557b1ce2a6 tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72382) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 15:19:33 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:19:33 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:19:33 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[d77a2f82-d3b9-435c-9121-c084c0e48343]: (4, ('1', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:19:33 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-e1896c8b-2176-426e-ad37-36557b1ce2a6 tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72382) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 15:19:33 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-e1896c8b-2176-426e-ad37-36557b1ce2a6 tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] SCSI volumes sdb have been removed. {{(pid=72382) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 15:19:33 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1896c8b-2176-426e-ad37-36557b1ce2a6 tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9c2a0938-fb5c-434c-91ba-15e8823c1348')] {{(pid=72382) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 15:19:33 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c2a0938-fb5c-434c-91ba-15e8823c1348 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:19:33 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c2a0938-fb5c-434c-91ba-15e8823c1348 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:19:33 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[06e79603-8e42-4f70-bd15-da9b2f0b4bcb]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:19:33 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1896c8b-2176-426e-ad37-36557b1ce2a6 tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:19:33 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c2a0938-fb5c-434c-91ba-15e8823c1348 -p 172.16.0.220:3260 --logout {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:19:33 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c2a0938-fb5c-434c-91ba-15e8823c1348 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:19:33 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[46dfde29-c0eb-447b-b53e-acd41b6cad5f]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:9c2a0938-fb5c-434c-91ba-15e8823c1348, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:9c2a0938-fb5c-434c-91ba-15e8823c1348, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:19:33 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1896c8b-2176-426e-ad37-36557b1ce2a6 tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:9c2a0938-fb5c-434c-91ba-15e8823c1348, portal: 172.16.0.220,3260]
Aug 09 15:19:33 user nova-compute[72382]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:9c2a0938-fb5c-434c-91ba-15e8823c1348, portal: 172.16.0.220,3260] successful.
Aug 09 15:19:33 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:19:33 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c2a0938-fb5c-434c-91ba-15e8823c1348 -p 172.16.0.220:3260 --op delete {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:19:33 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c2a0938-fb5c-434c-91ba-15e8823c1348 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:19:33 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b949c0e-b0b9-4e8b-94c3-e989802332bb]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:19:33 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1896c8b-2176-426e-ad37-36557b1ce2a6 tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:19:33 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-e1896c8b-2176-426e-ad37-36557b1ce2a6 tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.298s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 15:19:33 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1896c8b-2176-426e-ad37-36557b1ce2a6 tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] <== disconnect_volume: return (299ms) None {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 15:19:33 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e1896c8b-2176-426e-ad37-36557b1ce2a6 tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] [instance: b5aa7e23-9c2c-400e-a615-5839858749e1] Disconnected iSCSI Volume {{(pid=72382) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 15:19:33 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:19:33 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:19:34 user nova-compute[72382]: DEBUG nova.objects.instance [None req-e1896c8b-2176-426e-ad37-36557b1ce2a6 tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] Lazy-loading 'flavor' on Instance uuid b5aa7e23-9c2c-400e-a615-5839858749e1 {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:19:34 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e1896c8b-2176-426e-ad37-36557b1ce2a6 tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] Lock "b5aa7e23-9c2c-400e-a615-5839858749e1" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.810s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:19:34 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:19:35 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-a4249476-c7ac-4092-aa28-25f3bea7b55b tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] [instance: c9766433-4c5a-40ed-a212-715a24f42b91] Starting finish_migration {{(pid=72382) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Aug 09 15:19:35 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-a4249476-c7ac-4092-aa28-25f3bea7b55b tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] [instance: c9766433-4c5a-40ed-a212-715a24f42b91] Instance directory exists: not creating {{(pid=72382) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 09 15:19:35 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-a4249476-c7ac-4092-aa28-25f3bea7b55b tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] [instance: c9766433-4c5a-40ed-a212-715a24f42b91] Creating image(s)
Aug 09 15:19:35 user nova-compute[72382]: DEBUG nova.objects.instance [None req-a4249476-c7ac-4092-aa28-25f3bea7b55b tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Lazy-loading 'trusted_certs' on Instance uuid c9766433-4c5a-40ed-a212-715a24f42b91 {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:19:35 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-a4249476-c7ac-4092-aa28-25f3bea7b55b tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:19:35 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-a4249476-c7ac-4092-aa28-25f3bea7b55b tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b --force-share --output=json" returned: 0 in 0.139s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:19:35 user nova-compute[72382]: DEBUG nova.virt.disk.api [None req-a4249476-c7ac-4092-aa28-25f3bea7b55b tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c9766433-4c5a-40ed-a212-715a24f42b91/disk. size=21474836480 {{(pid=72382) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 15:19:35 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-a4249476-c7ac-4092-aa28-25f3bea7b55b tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9766433-4c5a-40ed-a212-715a24f42b91/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:19:35 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-a4249476-c7ac-4092-aa28-25f3bea7b55b tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9766433-4c5a-40ed-a212-715a24f42b91/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:19:35 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-a4249476-c7ac-4092-aa28-25f3bea7b55b tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Running cmd (subprocess): qemu-img resize /opt/stack/data/nova/instances/c9766433-4c5a-40ed-a212-715a24f42b91/disk 21474836480 {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:19:36 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-a4249476-c7ac-4092-aa28-25f3bea7b55b tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] CMD "qemu-img resize /opt/stack/data/nova/instances/c9766433-4c5a-40ed-a212-715a24f42b91/disk 21474836480" returned: 0 in 0.049s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:19:36 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-a4249476-c7ac-4092-aa28-25f3bea7b55b tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] [instance: c9766433-4c5a-40ed-a212-715a24f42b91] Did not create local disks {{(pid=72382) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 09 15:19:36 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-a4249476-c7ac-4092-aa28-25f3bea7b55b tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] [instance: c9766433-4c5a-40ed-a212-715a24f42b91] Ensure instance console log exists: /opt/stack/data/nova/instances/c9766433-4c5a-40ed-a212-715a24f42b91/console.log {{(pid=72382) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 15:19:36 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-a4249476-c7ac-4092-aa28-25f3bea7b55b tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:19:36 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-a4249476-c7ac-4092-aa28-25f3bea7b55b tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:19:36 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-a4249476-c7ac-4092-aa28-25f3bea7b55b tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:19:36 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-a4249476-c7ac-4092-aa28-25f3bea7b55b tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] [instance: c9766433-4c5a-40ed-a212-715a24f42b91] Start _get_guest_xml network_info=[{"id": "599dae3b-13bb-47af-b889-0037e03d5e31", "address": "fa:16:3e:66:9f:0b", "network": {"id": "63303ac8-d370-4386-a6bc-576677b64740", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1379220233-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1379220233-network", "vif_mac": "fa:16:3e:66:9f:0b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f45d010dd474c92a6b24bf977564ad1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap599dae3b-13", "ovs_interfaceid": "599dae3b-13bb-47af-b889-0037e03d5e31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T15:11:25Z,direct_url=<?>,disk_format='qcow2',id=a79f2cea-eb27-4631-aaf3-05e7d9e411b4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a638990e12cc4d6eabb6d55e13be6bdf',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T15:11:27Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'a79f2cea-eb27-4631-aaf3-05e7d9e411b4'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'boot_index': None, 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:fb47e85c-aaa9-4165-8be3-125572b68a87'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mtLoQzKG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'c9766433-4c5a-40ed-a212-715a24f42b91', 'attached_at': '2023-08-09T15:19:35.000000', 'detached_at': '', 'volume_id': 'fb47e85c-aaa9-4165-8be3-125572b68a87', 'serial': 'fb47e85c-aaa9-4165-8be3-125572b68a87'}, 'disk_bus': 'virtio', 'attachment_id': 'a15d3396-facd-4ac7-aec8-4707cb1a0f9d', 'delete_on_termination': False, 'volume_type': None} {{(pid=72382) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 15:19:36 user nova-compute[72382]: WARNING nova.virt.libvirt.driver [None req-a4249476-c7ac-4092-aa28-25f3bea7b55b tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 15:19:36 user nova-compute[72382]: WARNING nova.virt.libvirt.driver [None req-a4249476-c7ac-4092-aa28-25f3bea7b55b tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 15:19:36 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-a4249476-c7ac-4092-aa28-25f3bea7b55b tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72382) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 15:19:36 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-a4249476-c7ac-4092-aa28-25f3bea7b55b tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] CPU controller missing on host. {{(pid=72382) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 15:19:36 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-a4249476-c7ac-4092-aa28-25f3bea7b55b tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72382) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 15:19:36 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-a4249476-c7ac-4092-aa28-25f3bea7b55b tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] CPU controller found on host. {{(pid=72382) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 15:19:36 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-a4249476-c7ac-4092-aa28-25f3bea7b55b tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72382) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 15:19:36 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-a4249476-c7ac-4092-aa28-25f3bea7b55b tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T15:11:17Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T15:11:25Z,direct_url=<?>,disk_format='qcow2',id=a79f2cea-eb27-4631-aaf3-05e7d9e411b4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a638990e12cc4d6eabb6d55e13be6bdf',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T15:11:27Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 15:19:36 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-a4249476-c7ac-4092-aa28-25f3bea7b55b tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Flavor limits 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 15:19:36 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-a4249476-c7ac-4092-aa28-25f3bea7b55b tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Image limits 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 15:19:36 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-a4249476-c7ac-4092-aa28-25f3bea7b55b tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Flavor pref 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 15:19:36 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-a4249476-c7ac-4092-aa28-25f3bea7b55b tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Image pref 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 15:19:36 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-a4249476-c7ac-4092-aa28-25f3bea7b55b tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 15:19:36 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-a4249476-c7ac-4092-aa28-25f3bea7b55b tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 15:19:36 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-a4249476-c7ac-4092-aa28-25f3bea7b55b tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72382) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 15:19:36 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-a4249476-c7ac-4092-aa28-25f3bea7b55b tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Got 1 possible topologies {{(pid=72382) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 15:19:36 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-a4249476-c7ac-4092-aa28-25f3bea7b55b tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 15:19:36 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-a4249476-c7ac-4092-aa28-25f3bea7b55b tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 15:19:36 user nova-compute[72382]: DEBUG nova.objects.instance [None req-a4249476-c7ac-4092-aa28-25f3bea7b55b tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Lazy-loading 'vcpu_model' on Instance uuid c9766433-4c5a-40ed-a212-715a24f42b91 {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:19:36 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a4249476-c7ac-4092-aa28-25f3bea7b55b tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] [instance: c9766433-4c5a-40ed-a212-715a24f42b91] Calling os-brick to attach iSCSI Volume {{(pid=72382) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 15:19:36 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4249476-c7ac-4092-aa28-25f3bea7b55b tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2a0c768340>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:fb47e85c-aaa9-4165-8be3-125572b68a87'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mtLoQzKG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 15:19:36 user nova-compute[72382]: WARNING os_brick.initiator.connectors.base [None req-a4249476-c7ac-4092-aa28-25f3bea7b55b tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 15:19:36 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-a4249476-c7ac-4092-aa28-25f3bea7b55b tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 15:19:36 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-a4249476-c7ac-4092-aa28-25f3bea7b55b tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 15:19:36 user nova-compute[72382]: WARNING os_brick.initiator.connectors.base [None req-a4249476-c7ac-4092-aa28-25f3bea7b55b tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 15:19:36 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-a4249476-c7ac-4092-aa28-25f3bea7b55b tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fb47e85c-aaa9-4165-8be3-125572b68a87" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 15:19:36 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-a4249476-c7ac-4092-aa28-25f3bea7b55b tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fb47e85c-aaa9-4165-8be3-125572b68a87" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 15:19:36 user nova-compute[72382]: INFO os_brick.initiator.connectors.iscsi [None req-a4249476-c7ac-4092-aa28-25f3bea7b55b tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 15:19:36 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb47e85c-aaa9-4165-8be3-125572b68a87 -p 172.16.0.220:3260 {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:19:36 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb47e85c-aaa9-4165-8be3-125572b68a87 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:19:36 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[367e4555-9edb-4efc-9317-80229d048641]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:19:36 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4249476-c7ac-4092-aa28-25f3bea7b55b tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 15:19:36 user nova-compute[72382]:  {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:19:36 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb47e85c-aaa9-4165-8be3-125572b68a87 -p 172.16.0.220:3260 --interface default --op new {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:19:36 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb47e85c-aaa9-4165-8be3-125572b68a87 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:19:36 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[b896bcc0-bedb-4591-87d5-eb81cc8358e6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fb47e85c-aaa9-4165-8be3-125572b68a87] added\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:19:36 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4249476-c7ac-4092-aa28-25f3bea7b55b tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fb47e85c-aaa9-4165-8be3-125572b68a87] added
Aug 09 15:19:36 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:19:36 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb47e85c-aaa9-4165-8be3-125572b68a87 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:19:36 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb47e85c-aaa9-4165-8be3-125572b68a87 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:19:36 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[53ddc129-0c02-4c0d-87ef-91d1224d99ca]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:19:36 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4249476-c7ac-4092-aa28-25f3bea7b55b tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:19:36 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb47e85c-aaa9-4165-8be3-125572b68a87 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:19:36 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb47e85c-aaa9-4165-8be3-125572b68a87 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:19:36 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d01fb8c-a0ce-4560-adaa-9d93eee4359f]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:19:36 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4249476-c7ac-4092-aa28-25f3bea7b55b tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:19:36 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb47e85c-aaa9-4165-8be3-125572b68a87 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mtLoQzKG {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:19:36 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb47e85c-aaa9-4165-8be3-125572b68a87 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mtLoQzKG" returned: 0 in 0.019s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:19:36 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[daf67e32-2950-49f4-8b74-71738c13cd54]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:19:36 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4249476-c7ac-4092-aa28-25f3bea7b55b tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mtLoQzKG'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:19:36 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb47e85c-aaa9-4165-8be3-125572b68a87 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:19:36 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb47e85c-aaa9-4165-8be3-125572b68a87 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:19:36 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bf4ce29-9ff9-4f5f-9dcc-f4e03c38c5ca]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:19:36 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4249476-c7ac-4092-aa28-25f3bea7b55b tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:19:36 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:19:36 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:19:36 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c9edaea-7471-4edf-b5b2-0c0599d1311b]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:19:36 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4249476-c7ac-4092-aa28-25f3bea7b55b tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)
Aug 09 15:19:36 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 15:19:36 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4249476-c7ac-4092-aa28-25f3bea7b55b tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)
Aug 09 15:19:36 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 15:19:36 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb47e85c-aaa9-4165-8be3-125572b68a87 -p 172.16.0.220:3260 --login {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:19:36 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb47e85c-aaa9-4165-8be3-125572b68a87 -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:19:36 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1fe8b33-21d1-4362-a965-a644b7d8757a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fb47e85c-aaa9-4165-8be3-125572b68a87, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fb47e85c-aaa9-4165-8be3-125572b68a87, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:19:36 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4249476-c7ac-4092-aa28-25f3bea7b55b tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fb47e85c-aaa9-4165-8be3-125572b68a87, portal: 172.16.0.220,3260]
Aug 09 15:19:36 user nova-compute[72382]: Login to [iface: default, target: iqn.2010-10.org.openstack:fb47e85c-aaa9-4165-8be3-125572b68a87, portal: 172.16.0.220,3260] successful.
Aug 09 15:19:36 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:19:36 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb47e85c-aaa9-4165-8be3-125572b68a87 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:19:36 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb47e85c-aaa9-4165-8be3-125572b68a87 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:19:36 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4a56f1f-7b2c-4422-a446-318463bfdf08]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:19:36 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4249476-c7ac-4092-aa28-25f3bea7b55b tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:19:36 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:19:36 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:19:36 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b500d9c-efe8-4f6f-9a86-3c7514586fdf]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb47e85c-aaa9-4165-8be3-125572b68a87 (non-flash)\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:19:36 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4249476-c7ac-4092-aa28-25f3bea7b55b tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)
Aug 09 15:19:36 user nova-compute[72382]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb47e85c-aaa9-4165-8be3-125572b68a87 (non-flash)
Aug 09 15:19:36 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 15:19:36 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4249476-c7ac-4092-aa28-25f3bea7b55b tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)
Aug 09 15:19:36 user nova-compute[72382]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb47e85c-aaa9-4165-8be3-125572b68a87 (non-flash)
Aug 09 15:19:36 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 15:19:36 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-a4249476-c7ac-4092-aa28-25f3bea7b55b tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fb47e85c-aaa9-4165-8be3-125572b68a87" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.266s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 15:19:36 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4249476-c7ac-4092-aa28-25f3bea7b55b tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Connected to 172.16.0.220:3260 {{(pid=72382) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 15:19:36 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-a4249476-c7ac-4092-aa28-25f3bea7b55b tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] HCTL ('33', '-', '-', 0) found on session 16 with lun 0 {{(pid=72382) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 15:19:36 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-a4249476-c7ac-4092-aa28-25f3bea7b55b tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72382) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 15:19:36 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:19:36 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:19:36 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[6415c4fe-6ace-4dd5-a633-4529f88f9dd4]: (4, ('- - 0', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:19:36 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-a4249476-c7ac-4092-aa28-25f3bea7b55b tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Searching for a device in session 16 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72382) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 15:19:36 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4249476-c7ac-4092-aa28-25f3bea7b55b tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mtLoQzKG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72382) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 15:19:37 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-a4249476-c7ac-4092-aa28-25f3bea7b55b tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.298s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 15:19:37 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4249476-c7ac-4092-aa28-25f3bea7b55b tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] <== connect_volume: return (1300ms) {'type': 'block', 'scsi_wwn': '23038616233303532', 'path': '/dev/sdb'} {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 15:19:37 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a4249476-c7ac-4092-aa28-25f3bea7b55b tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] [instance: c9766433-4c5a-40ed-a212-715a24f42b91] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23038616233303532', 'path': '/dev/sdb'} {{(pid=72382) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 15:19:37 user nova-compute[72382]: DEBUG nova.virt.libvirt.vif [None req-a4249476-c7ac-4092-aa28-25f3bea7b55b tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T15:15:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-2120220558',display_name='tempest-ServerActionsTestOtherB-server-2120220558',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-2120220558',id=5,image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOdAPO5nl2/3VDHoi/8yD5s8l1+mDVit5A+n/HDnoxJgZMgOR9rAXiFsYVLEG+MsUeEQU8np4/pg88xwFSbi1vuFZkvV9b5532CTazhkqSlb4YuAKF8mo8fSFbyD8FwytA==',key_name='tempest-keypair-1399201542',keypairs=<?>,launch_index=0,launched_at=2023-08-09T15:15:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='9f45d010dd474c92a6b24bf977564ad1',ramdisk_id='',reservation_id='r-rng7ms7j',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-250545160',owner_user_name='tempest-ServerActionsTestOtherB-250545160-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T15:19:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='232fbbd15fea4894be7cebb13ea45cf9',uuid=c9766433-4c5a-40ed-a212-715a24f42b91,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "599dae3b-13bb-47af-b889-0037e03d5e31", "address": "fa:16:3e:66:9f:0b", "network": {"id": "63303ac8-d370-4386-a6bc-576677b64740", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1379220233-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1379220233-network", "vif_mac": "fa:16:3e:66:9f:0b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f45d010dd474c92a6b24bf977564ad1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap599dae3b-13", "ovs_interfaceid": "599dae3b-13bb-47af-b889-0037e03d5e31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72382) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 15:19:37 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-a4249476-c7ac-4092-aa28-25f3bea7b55b tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Converting VIF {"id": "599dae3b-13bb-47af-b889-0037e03d5e31", "address": "fa:16:3e:66:9f:0b", "network": {"id": "63303ac8-d370-4386-a6bc-576677b64740", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1379220233-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1379220233-network", "vif_mac": "fa:16:3e:66:9f:0b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f45d010dd474c92a6b24bf977564ad1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap599dae3b-13", "ovs_interfaceid": "599dae3b-13bb-47af-b889-0037e03d5e31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 15:19:37 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-a4249476-c7ac-4092-aa28-25f3bea7b55b tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:66:9f:0b,bridge_name='br-int',has_traffic_filtering=True,id=599dae3b-13bb-47af-b889-0037e03d5e31,network=Network(63303ac8-d370-4386-a6bc-576677b64740),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap599dae3b-13') {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 15:19:37 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-a4249476-c7ac-4092-aa28-25f3bea7b55b tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] [instance: c9766433-4c5a-40ed-a212-715a24f42b91] End _get_guest_xml xml=<domain type="kvm">
Aug 09 15:19:37 user nova-compute[72382]:   <uuid>c9766433-4c5a-40ed-a212-715a24f42b91</uuid>
Aug 09 15:19:37 user nova-compute[72382]:   <name>instance-00000005</name>
Aug 09 15:19:37 user nova-compute[72382]:   <memory>2097152</memory>
Aug 09 15:19:37 user nova-compute[72382]:   <vcpu>1</vcpu>
Aug 09 15:19:37 user nova-compute[72382]:   <metadata>
Aug 09 15:19:37 user nova-compute[72382]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 15:19:37 user nova-compute[72382]:       <nova:package version="0.0.0"/>
Aug 09 15:19:37 user nova-compute[72382]:       <nova:name>tempest-ServerActionsTestOtherB-server-2120220558</nova:name>
Aug 09 15:19:37 user nova-compute[72382]:       <nova:creationTime>2023-08-09 15:19:36</nova:creationTime>
Aug 09 15:19:37 user nova-compute[72382]:       <nova:flavor name="m1.small">
Aug 09 15:19:37 user nova-compute[72382]:         <nova:memory>2048</nova:memory>
Aug 09 15:19:37 user nova-compute[72382]:         <nova:disk>20</nova:disk>
Aug 09 15:19:37 user nova-compute[72382]:         <nova:swap>0</nova:swap>
Aug 09 15:19:37 user nova-compute[72382]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 15:19:37 user nova-compute[72382]:         <nova:vcpus>1</nova:vcpus>
Aug 09 15:19:37 user nova-compute[72382]:       </nova:flavor>
Aug 09 15:19:37 user nova-compute[72382]:       <nova:owner>
Aug 09 15:19:37 user nova-compute[72382]:         <nova:user uuid="232fbbd15fea4894be7cebb13ea45cf9">tempest-ServerActionsTestOtherB-250545160-project-member</nova:user>
Aug 09 15:19:37 user nova-compute[72382]:         <nova:project uuid="9f45d010dd474c92a6b24bf977564ad1">tempest-ServerActionsTestOtherB-250545160</nova:project>
Aug 09 15:19:37 user nova-compute[72382]:       </nova:owner>
Aug 09 15:19:37 user nova-compute[72382]:       <nova:root type="image" uuid="a79f2cea-eb27-4631-aaf3-05e7d9e411b4"/>
Aug 09 15:19:37 user nova-compute[72382]:       <nova:ports>
Aug 09 15:19:37 user nova-compute[72382]:         <nova:port uuid="599dae3b-13bb-47af-b889-0037e03d5e31">
Aug 09 15:19:37 user nova-compute[72382]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 09 15:19:37 user nova-compute[72382]:         </nova:port>
Aug 09 15:19:37 user nova-compute[72382]:       </nova:ports>
Aug 09 15:19:37 user nova-compute[72382]:     </nova:instance>
Aug 09 15:19:37 user nova-compute[72382]:   </metadata>
Aug 09 15:19:37 user nova-compute[72382]:   <sysinfo type="smbios">
Aug 09 15:19:37 user nova-compute[72382]:     <system>
Aug 09 15:19:37 user nova-compute[72382]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 15:19:37 user nova-compute[72382]:       <entry name="product">OpenStack Nova</entry>
Aug 09 15:19:37 user nova-compute[72382]:       <entry name="version">0.0.0</entry>
Aug 09 15:19:37 user nova-compute[72382]:       <entry name="serial">c9766433-4c5a-40ed-a212-715a24f42b91</entry>
Aug 09 15:19:37 user nova-compute[72382]:       <entry name="uuid">c9766433-4c5a-40ed-a212-715a24f42b91</entry>
Aug 09 15:19:37 user nova-compute[72382]:       <entry name="family">Virtual Machine</entry>
Aug 09 15:19:37 user nova-compute[72382]:     </system>
Aug 09 15:19:37 user nova-compute[72382]:   </sysinfo>
Aug 09 15:19:37 user nova-compute[72382]:   <os>
Aug 09 15:19:37 user nova-compute[72382]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 15:19:37 user nova-compute[72382]:     <boot dev="hd"/>
Aug 09 15:19:37 user nova-compute[72382]:     <smbios mode="sysinfo"/>
Aug 09 15:19:37 user nova-compute[72382]:   </os>
Aug 09 15:19:37 user nova-compute[72382]:   <features>
Aug 09 15:19:37 user nova-compute[72382]:     <acpi/>
Aug 09 15:19:37 user nova-compute[72382]:     <apic/>
Aug 09 15:19:37 user nova-compute[72382]:     <vmcoreinfo/>
Aug 09 15:19:37 user nova-compute[72382]:   </features>
Aug 09 15:19:37 user nova-compute[72382]:   <clock offset="utc">
Aug 09 15:19:37 user nova-compute[72382]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 15:19:37 user nova-compute[72382]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 15:19:37 user nova-compute[72382]:     <timer name="hpet" present="no"/>
Aug 09 15:19:37 user nova-compute[72382]:   </clock>
Aug 09 15:19:37 user nova-compute[72382]:   <cpu mode="custom" match="exact">
Aug 09 15:19:37 user nova-compute[72382]:     <model>Nehalem</model>
Aug 09 15:19:37 user nova-compute[72382]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 15:19:37 user nova-compute[72382]:   </cpu>
Aug 09 15:19:37 user nova-compute[72382]:   <devices>
Aug 09 15:19:37 user nova-compute[72382]:     <disk type="file" device="disk">
Aug 09 15:19:37 user nova-compute[72382]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 15:19:37 user nova-compute[72382]:       <source file="/opt/stack/data/nova/instances/c9766433-4c5a-40ed-a212-715a24f42b91/disk"/>
Aug 09 15:19:37 user nova-compute[72382]:       <target dev="vda" bus="virtio"/>
Aug 09 15:19:37 user nova-compute[72382]:     </disk>
Aug 09 15:19:37 user nova-compute[72382]:     <disk type="block" device="disk">
Aug 09 15:19:37 user nova-compute[72382]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 15:19:37 user nova-compute[72382]:       <source dev="/dev/sdb"/>
Aug 09 15:19:37 user nova-compute[72382]:       <target dev="vdb" bus="virtio"/>
Aug 09 15:19:37 user nova-compute[72382]:       <serial>fb47e85c-aaa9-4165-8be3-125572b68a87</serial>
Aug 09 15:19:37 user nova-compute[72382]:     </disk>
Aug 09 15:19:37 user nova-compute[72382]:     <interface type="ethernet">
Aug 09 15:19:37 user nova-compute[72382]:       <mac address="fa:16:3e:66:9f:0b"/>
Aug 09 15:19:37 user nova-compute[72382]:       <model type="virtio"/>
Aug 09 15:19:37 user nova-compute[72382]:       <mtu size="1442"/>
Aug 09 15:19:37 user nova-compute[72382]:       <target dev="tap599dae3b-13"/>
Aug 09 15:19:37 user nova-compute[72382]:     </interface>
Aug 09 15:19:37 user nova-compute[72382]:     <serial type="pty">
Aug 09 15:19:37 user nova-compute[72382]:       <log file="/opt/stack/data/nova/instances/c9766433-4c5a-40ed-a212-715a24f42b91/console.log" append="off"/>
Aug 09 15:19:37 user nova-compute[72382]:     </serial>
Aug 09 15:19:37 user nova-compute[72382]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 15:19:37 user nova-compute[72382]:     <video>
Aug 09 15:19:37 user nova-compute[72382]:       <model type="virtio"/>
Aug 09 15:19:37 user nova-compute[72382]:     </video>
Aug 09 15:19:37 user nova-compute[72382]:     <rng model="virtio">
Aug 09 15:19:37 user nova-compute[72382]:       <backend model="random">/dev/urandom</backend>
Aug 09 15:19:37 user nova-compute[72382]:     </rng>
Aug 09 15:19:37 user nova-compute[72382]:     <controller type="usb" index="0" model="none"/>
Aug 09 15:19:37 user nova-compute[72382]:     <memballoon model="virtio">
Aug 09 15:19:37 user nova-compute[72382]:       <stats period="10"/>
Aug 09 15:19:37 user nova-compute[72382]:     </memballoon>
Aug 09 15:19:37 user nova-compute[72382]:   </devices>
Aug 09 15:19:37 user nova-compute[72382]: </domain>
Aug 09 15:19:37 user nova-compute[72382]:  {{(pid=72382) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 15:19:37 user nova-compute[72382]: DEBUG nova.virt.libvirt.vif [None req-a4249476-c7ac-4092-aa28-25f3bea7b55b tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T15:15:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-2120220558',display_name='tempest-ServerActionsTestOtherB-server-2120220558',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-2120220558',id=5,image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOdAPO5nl2/3VDHoi/8yD5s8l1+mDVit5A+n/HDnoxJgZMgOR9rAXiFsYVLEG+MsUeEQU8np4/pg88xwFSbi1vuFZkvV9b5532CTazhkqSlb4YuAKF8mo8fSFbyD8FwytA==',key_name='tempest-keypair-1399201542',keypairs=<?>,launch_index=0,launched_at=2023-08-09T15:15:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='9f45d010dd474c92a6b24bf977564ad1',ramdisk_id='',reservation_id='r-rng7ms7j',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-250545160',owner_user_name='tempest-ServerActionsTestOtherB-250545160-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T15:19:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='232fbbd15fea4894be7cebb13ea45cf9',uuid=c9766433-4c5a-40ed-a212-715a24f42b91,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "599dae3b-13bb-47af-b889-0037e03d5e31", "address": "fa:16:3e:66:9f:0b", "network": {"id": "63303ac8-d370-4386-a6bc-576677b64740", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1379220233-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1379220233-network", "vif_mac": "fa:16:3e:66:9f:0b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f45d010dd474c92a6b24bf977564ad1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap599dae3b-13", "ovs_interfaceid": "599dae3b-13bb-47af-b889-0037e03d5e31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 15:19:37 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-a4249476-c7ac-4092-aa28-25f3bea7b55b tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Converting VIF {"id": "599dae3b-13bb-47af-b889-0037e03d5e31", "address": "fa:16:3e:66:9f:0b", "network": {"id": "63303ac8-d370-4386-a6bc-576677b64740", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1379220233-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1379220233-network", "vif_mac": "fa:16:3e:66:9f:0b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f45d010dd474c92a6b24bf977564ad1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap599dae3b-13", "ovs_interfaceid": "599dae3b-13bb-47af-b889-0037e03d5e31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 15:19:37 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-a4249476-c7ac-4092-aa28-25f3bea7b55b tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:66:9f:0b,bridge_name='br-int',has_traffic_filtering=True,id=599dae3b-13bb-47af-b889-0037e03d5e31,network=Network(63303ac8-d370-4386-a6bc-576677b64740),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap599dae3b-13') {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 15:19:37 user nova-compute[72382]: DEBUG os_vif [None req-a4249476-c7ac-4092-aa28-25f3bea7b55b tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:9f:0b,bridge_name='br-int',has_traffic_filtering=True,id=599dae3b-13bb-47af-b889-0037e03d5e31,network=Network(63303ac8-d370-4386-a6bc-576677b64740),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap599dae3b-13') {{(pid=72382) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 15:19:37 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:19:37 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:19:37 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 15:19:37 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:19:37 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap599dae3b-13, may_exist=True, interface_attrs={}) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:19:37 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap599dae3b-13, col_values=(('external_ids', {'iface-id': '599dae3b-13bb-47af-b889-0037e03d5e31', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:66:9f:0b', 'vm-uuid': 'c9766433-4c5a-40ed-a212-715a24f42b91'}),), if_exists=True) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:19:37 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:19:37 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:19:37 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:19:37 user nova-compute[72382]: INFO os_vif [None req-a4249476-c7ac-4092-aa28-25f3bea7b55b tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:9f:0b,bridge_name='br-int',has_traffic_filtering=True,id=599dae3b-13bb-47af-b889-0037e03d5e31,network=Network(63303ac8-d370-4386-a6bc-576677b64740),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap599dae3b-13')
Aug 09 15:19:37 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-a4249476-c7ac-4092-aa28-25f3bea7b55b tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] No BDM found with device name vda, not building metadata. {{(pid=72382) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 15:19:37 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-a4249476-c7ac-4092-aa28-25f3bea7b55b tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72382) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 15:19:37 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-a4249476-c7ac-4092-aa28-25f3bea7b55b tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] No VIF found with MAC fa:16:3e:66:9f:0b, not building metadata {{(pid=72382) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 15:19:38 user nova-compute[72382]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691594363.2351615, c9766433-4c5a-40ed-a212-715a24f42b91 => Stopped> {{(pid=72382) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 15:19:38 user nova-compute[72382]: INFO nova.compute.manager [-] [instance: c9766433-4c5a-40ed-a212-715a24f42b91] VM Stopped (Lifecycle Event)
Aug 09 15:19:38 user nova-compute[72382]: DEBUG nova.compute.manager [None req-c6ee2c7b-f40c-4f15-99e8-59c603538128 None None] [instance: c9766433-4c5a-40ed-a212-715a24f42b91] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:19:38 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:19:38 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:19:38 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:19:38 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:19:39 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:19:39 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:19:39 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:19:39 user nova-compute[72382]: DEBUG nova.compute.manager [req-eacc2f21-f6b3-4937-a594-ee0eaa4e7a31 req-0b5bce99-0f54-41c7-8d2c-db06cfda5e79 service nova] [instance: c9766433-4c5a-40ed-a212-715a24f42b91] Received event network-vif-plugged-599dae3b-13bb-47af-b889-0037e03d5e31 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:19:39 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-eacc2f21-f6b3-4937-a594-ee0eaa4e7a31 req-0b5bce99-0f54-41c7-8d2c-db06cfda5e79 service nova] Acquiring lock "c9766433-4c5a-40ed-a212-715a24f42b91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:19:39 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-eacc2f21-f6b3-4937-a594-ee0eaa4e7a31 req-0b5bce99-0f54-41c7-8d2c-db06cfda5e79 service nova] Lock "c9766433-4c5a-40ed-a212-715a24f42b91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:19:39 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-eacc2f21-f6b3-4937-a594-ee0eaa4e7a31 req-0b5bce99-0f54-41c7-8d2c-db06cfda5e79 service nova] Lock "c9766433-4c5a-40ed-a212-715a24f42b91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:19:39 user nova-compute[72382]: DEBUG nova.compute.manager [req-eacc2f21-f6b3-4937-a594-ee0eaa4e7a31 req-0b5bce99-0f54-41c7-8d2c-db06cfda5e79 service nova] [instance: c9766433-4c5a-40ed-a212-715a24f42b91] No waiting events found dispatching network-vif-plugged-599dae3b-13bb-47af-b889-0037e03d5e31 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:19:39 user nova-compute[72382]: WARNING nova.compute.manager [req-eacc2f21-f6b3-4937-a594-ee0eaa4e7a31 req-0b5bce99-0f54-41c7-8d2c-db06cfda5e79 service nova] [instance: c9766433-4c5a-40ed-a212-715a24f42b91] Received unexpected event network-vif-plugged-599dae3b-13bb-47af-b889-0037e03d5e31 for instance with vm_state active and task_state resize_finish.
Aug 09 15:19:39 user nova-compute[72382]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691594364.769865, 9a82f146-97ce-4319-8b25-c1b090965e53 => Stopped> {{(pid=72382) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 15:19:39 user nova-compute[72382]: INFO nova.compute.manager [-] [instance: 9a82f146-97ce-4319-8b25-c1b090965e53] VM Stopped (Lifecycle Event)
Aug 09 15:19:39 user nova-compute[72382]: DEBUG nova.compute.manager [None req-b0f2d3e9-cd81-4b8c-bc2e-d21ed9b21e1f None None] [instance: 9a82f146-97ce-4319-8b25-c1b090965e53] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:19:40 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:19:41 user nova-compute[72382]: DEBUG nova.virt.driver [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Emitting event <LifecycleEvent: 1691594381.437975, c9766433-4c5a-40ed-a212-715a24f42b91 => Resumed> {{(pid=72382) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 15:19:41 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: c9766433-4c5a-40ed-a212-715a24f42b91] VM Resumed (Lifecycle Event)
Aug 09 15:19:41 user nova-compute[72382]: DEBUG nova.compute.manager [None req-a4249476-c7ac-4092-aa28-25f3bea7b55b tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] [instance: c9766433-4c5a-40ed-a212-715a24f42b91] Instance event wait completed in 0 seconds for  {{(pid=72382) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 15:19:41 user nova-compute[72382]: INFO nova.virt.libvirt.driver [-] [instance: c9766433-4c5a-40ed-a212-715a24f42b91] Instance running successfully.
Aug 09 15:19:41 user nova-compute[72382]: DEBUG nova.virt.libvirt.guest [None req-a4249476-c7ac-4092-aa28-25f3bea7b55b tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] [instance: c9766433-4c5a-40ed-a212-715a24f42b91] Failed to set time: agent not configured {{(pid=72382) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Aug 09 15:19:41 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-a4249476-c7ac-4092-aa28-25f3bea7b55b tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] [instance: c9766433-4c5a-40ed-a212-715a24f42b91] finish_migration finished successfully. {{(pid=72382) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Aug 09 15:19:41 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: c9766433-4c5a-40ed-a212-715a24f42b91] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:19:41 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: c9766433-4c5a-40ed-a212-715a24f42b91] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=72382) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 15:19:41 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: c9766433-4c5a-40ed-a212-715a24f42b91] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 09 15:19:41 user nova-compute[72382]: DEBUG nova.virt.driver [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Emitting event <LifecycleEvent: 1691594381.4416282, c9766433-4c5a-40ed-a212-715a24f42b91 => Started> {{(pid=72382) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 15:19:41 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: c9766433-4c5a-40ed-a212-715a24f42b91] VM Started (Lifecycle Event)
Aug 09 15:19:41 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: c9766433-4c5a-40ed-a212-715a24f42b91] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:19:41 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: c9766433-4c5a-40ed-a212-715a24f42b91] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=72382) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 15:19:41 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: c9766433-4c5a-40ed-a212-715a24f42b91] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 09 15:19:41 user nova-compute[72382]: DEBUG nova.compute.manager [req-e538cdd7-3a71-4164-9224-030fd41abccb req-a24daacf-5f81-4acf-8283-51ad23d07196 service nova] [instance: c9766433-4c5a-40ed-a212-715a24f42b91] Received event network-vif-plugged-599dae3b-13bb-47af-b889-0037e03d5e31 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:19:41 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-e538cdd7-3a71-4164-9224-030fd41abccb req-a24daacf-5f81-4acf-8283-51ad23d07196 service nova] Acquiring lock "c9766433-4c5a-40ed-a212-715a24f42b91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:19:41 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-e538cdd7-3a71-4164-9224-030fd41abccb req-a24daacf-5f81-4acf-8283-51ad23d07196 service nova] Lock "c9766433-4c5a-40ed-a212-715a24f42b91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:19:41 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-e538cdd7-3a71-4164-9224-030fd41abccb req-a24daacf-5f81-4acf-8283-51ad23d07196 service nova] Lock "c9766433-4c5a-40ed-a212-715a24f42b91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:19:41 user nova-compute[72382]: DEBUG nova.compute.manager [req-e538cdd7-3a71-4164-9224-030fd41abccb req-a24daacf-5f81-4acf-8283-51ad23d07196 service nova] [instance: c9766433-4c5a-40ed-a212-715a24f42b91] No waiting events found dispatching network-vif-plugged-599dae3b-13bb-47af-b889-0037e03d5e31 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:19:41 user nova-compute[72382]: WARNING nova.compute.manager [req-e538cdd7-3a71-4164-9224-030fd41abccb req-a24daacf-5f81-4acf-8283-51ad23d07196 service nova] [instance: c9766433-4c5a-40ed-a212-715a24f42b91] Received unexpected event network-vif-plugged-599dae3b-13bb-47af-b889-0037e03d5e31 for instance with vm_state resized and task_state None.
Aug 09 15:19:42 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:19:43 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:19:43 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:19:45 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:19:47 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:19:48 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:19:48 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:19:49 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:19:51 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:19:52 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:19:52 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:19:53 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:19:56 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:19:57 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:19:58 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:19:59 user nova-compute[72382]: INFO nova.compute.manager [None req-641e18dd-d0f1-44b8-b5f2-8db6448c2d8a tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] [instance: 0f510d75-5d1e-4a5c-b38f-731c299f0f5a] Rescuing
Aug 09 15:19:59 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-641e18dd-d0f1-44b8-b5f2-8db6448c2d8a tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Acquiring lock "refresh_cache-0f510d75-5d1e-4a5c-b38f-731c299f0f5a" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 15:19:59 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-641e18dd-d0f1-44b8-b5f2-8db6448c2d8a tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Acquired lock "refresh_cache-0f510d75-5d1e-4a5c-b38f-731c299f0f5a" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 15:19:59 user nova-compute[72382]: DEBUG nova.network.neutron [None req-641e18dd-d0f1-44b8-b5f2-8db6448c2d8a tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] [instance: 0f510d75-5d1e-4a5c-b38f-731c299f0f5a] Building network info cache for instance {{(pid=72382) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 15:20:00 user nova-compute[72382]: DEBUG nova.network.neutron [None req-641e18dd-d0f1-44b8-b5f2-8db6448c2d8a tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] [instance: 0f510d75-5d1e-4a5c-b38f-731c299f0f5a] Updating instance_info_cache with network_info: [{"id": "c67a8d45-c4ba-4302-940f-c05799ecc732", "address": "fa:16:3e:02:6d:5d", "network": {"id": "d47e3749-fdff-4112-bd72-69ca584efe1f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-302967634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "080d1ded4cd94e5083ee0b7e691b7363", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc67a8d45-c4", "ovs_interfaceid": "c67a8d45-c4ba-4302-940f-c05799ecc732", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:20:00 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-641e18dd-d0f1-44b8-b5f2-8db6448c2d8a tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Releasing lock "refresh_cache-0f510d75-5d1e-4a5c-b38f-731c299f0f5a" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 15:20:00 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:20:00 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:20:01 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:20:01 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:20:01 user nova-compute[72382]: INFO nova.virt.libvirt.driver [-] [instance: 0f510d75-5d1e-4a5c-b38f-731c299f0f5a] Instance destroyed successfully.
Aug 09 15:20:01 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-641e18dd-d0f1-44b8-b5f2-8db6448c2d8a tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] [instance: 0f510d75-5d1e-4a5c-b38f-731c299f0f5a] Attempting a stable device rescue
Aug 09 15:20:01 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-641e18dd-d0f1-44b8-b5f2-8db6448c2d8a tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=72382) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 09 15:20:01 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-641e18dd-d0f1-44b8-b5f2-8db6448c2d8a tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] [instance: 0f510d75-5d1e-4a5c-b38f-731c299f0f5a] Instance directory exists: not creating {{(pid=72382) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 09 15:20:01 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-641e18dd-d0f1-44b8-b5f2-8db6448c2d8a tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] [instance: 0f510d75-5d1e-4a5c-b38f-731c299f0f5a] Creating image(s)
Aug 09 15:20:01 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-641e18dd-d0f1-44b8-b5f2-8db6448c2d8a tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Acquiring lock "/opt/stack/data/nova/instances/0f510d75-5d1e-4a5c-b38f-731c299f0f5a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:20:01 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-641e18dd-d0f1-44b8-b5f2-8db6448c2d8a tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Lock "/opt/stack/data/nova/instances/0f510d75-5d1e-4a5c-b38f-731c299f0f5a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:20:01 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-641e18dd-d0f1-44b8-b5f2-8db6448c2d8a tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Lock "/opt/stack/data/nova/instances/0f510d75-5d1e-4a5c-b38f-731c299f0f5a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:20:01 user nova-compute[72382]: DEBUG nova.objects.instance [None req-641e18dd-d0f1-44b8-b5f2-8db6448c2d8a tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Lazy-loading 'trusted_certs' on Instance uuid 0f510d75-5d1e-4a5c-b38f-731c299f0f5a {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:20:01 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-641e18dd-d0f1-44b8-b5f2-8db6448c2d8a tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Acquiring lock "97ba3ec2a011ee0bfacf71a14aeed71ea64663d4" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:20:01 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-641e18dd-d0f1-44b8-b5f2-8db6448c2d8a tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Lock "97ba3ec2a011ee0bfacf71a14aeed71ea64663d4" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:20:01 user nova-compute[72382]: DEBUG nova.compute.manager [req-79662d7a-7457-4070-a3ad-ecc6e187d08b req-e5b68680-5308-4d62-b086-130ec8ff42d9 service nova] [instance: 0f510d75-5d1e-4a5c-b38f-731c299f0f5a] Received event network-vif-unplugged-c67a8d45-c4ba-4302-940f-c05799ecc732 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:20:01 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-79662d7a-7457-4070-a3ad-ecc6e187d08b req-e5b68680-5308-4d62-b086-130ec8ff42d9 service nova] Acquiring lock "0f510d75-5d1e-4a5c-b38f-731c299f0f5a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:20:01 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-79662d7a-7457-4070-a3ad-ecc6e187d08b req-e5b68680-5308-4d62-b086-130ec8ff42d9 service nova] Lock "0f510d75-5d1e-4a5c-b38f-731c299f0f5a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:20:01 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-79662d7a-7457-4070-a3ad-ecc6e187d08b req-e5b68680-5308-4d62-b086-130ec8ff42d9 service nova] Lock "0f510d75-5d1e-4a5c-b38f-731c299f0f5a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:20:01 user nova-compute[72382]: DEBUG nova.compute.manager [req-79662d7a-7457-4070-a3ad-ecc6e187d08b req-e5b68680-5308-4d62-b086-130ec8ff42d9 service nova] [instance: 0f510d75-5d1e-4a5c-b38f-731c299f0f5a] No waiting events found dispatching network-vif-unplugged-c67a8d45-c4ba-4302-940f-c05799ecc732 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:20:01 user nova-compute[72382]: WARNING nova.compute.manager [req-79662d7a-7457-4070-a3ad-ecc6e187d08b req-e5b68680-5308-4d62-b086-130ec8ff42d9 service nova] [instance: 0f510d75-5d1e-4a5c-b38f-731c299f0f5a] Received unexpected event network-vif-unplugged-c67a8d45-c4ba-4302-940f-c05799ecc732 for instance with vm_state active and task_state rescuing.
Aug 09 15:20:02 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-641e18dd-d0f1-44b8-b5f2-8db6448c2d8a tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/97ba3ec2a011ee0bfacf71a14aeed71ea64663d4.part --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:20:02 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:20:02 user nova-compute[72382]: INFO nova.compute.manager [None req-7da76c05-26a3-4c90-8e72-94f8b9462e61 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] [instance: 44afd1bf-fa5c-4b3e-8752-b16853fef54e] Rescuing
Aug 09 15:20:02 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-7da76c05-26a3-4c90-8e72-94f8b9462e61 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Acquiring lock "refresh_cache-44afd1bf-fa5c-4b3e-8752-b16853fef54e" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 15:20:02 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-7da76c05-26a3-4c90-8e72-94f8b9462e61 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Acquired lock "refresh_cache-44afd1bf-fa5c-4b3e-8752-b16853fef54e" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 15:20:02 user nova-compute[72382]: DEBUG nova.network.neutron [None req-7da76c05-26a3-4c90-8e72-94f8b9462e61 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] [instance: 44afd1bf-fa5c-4b3e-8752-b16853fef54e] Building network info cache for instance {{(pid=72382) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 15:20:02 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:20:02 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:20:02 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:20:02 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:20:02 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Auditing locally available compute resources for user (node: user) {{(pid=72382) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 15:20:02 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-641e18dd-d0f1-44b8-b5f2-8db6448c2d8a tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/97ba3ec2a011ee0bfacf71a14aeed71ea64663d4.part --force-share --output=json" returned: 0 in 0.156s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:20:02 user nova-compute[72382]: DEBUG nova.virt.images [None req-641e18dd-d0f1-44b8-b5f2-8db6448c2d8a tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] f4111f07-a2b0-4eca-86a0-21bebbebdb33 was qcow2, converting to raw {{(pid=72382) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 09 15:20:02 user nova-compute[72382]: DEBUG nova.privsep.utils [None req-641e18dd-d0f1-44b8-b5f2-8db6448c2d8a tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72382) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 09 15:20:02 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-641e18dd-d0f1-44b8-b5f2-8db6448c2d8a tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/97ba3ec2a011ee0bfacf71a14aeed71ea64663d4.part /opt/stack/data/nova/instances/_base/97ba3ec2a011ee0bfacf71a14aeed71ea64663d4.converted {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:20:03 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea6afcf7-0b8b-43d8-af1d-9c132a659711/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:20:03 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-641e18dd-d0f1-44b8-b5f2-8db6448c2d8a tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/97ba3ec2a011ee0bfacf71a14aeed71ea64663d4.part /opt/stack/data/nova/instances/_base/97ba3ec2a011ee0bfacf71a14aeed71ea64663d4.converted" returned: 0 in 0.397s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:20:03 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-641e18dd-d0f1-44b8-b5f2-8db6448c2d8a tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/97ba3ec2a011ee0bfacf71a14aeed71ea64663d4.converted --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:20:03 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea6afcf7-0b8b-43d8-af1d-9c132a659711/disk --force-share --output=json" returned: 0 in 0.282s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:20:03 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea6afcf7-0b8b-43d8-af1d-9c132a659711/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:20:03 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-641e18dd-d0f1-44b8-b5f2-8db6448c2d8a tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/97ba3ec2a011ee0bfacf71a14aeed71ea64663d4.converted --force-share --output=json" returned: 0 in 0.152s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:20:03 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-641e18dd-d0f1-44b8-b5f2-8db6448c2d8a tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Lock "97ba3ec2a011ee0bfacf71a14aeed71ea64663d4" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.825s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:20:03 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-641e18dd-d0f1-44b8-b5f2-8db6448c2d8a tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Acquiring lock "97ba3ec2a011ee0bfacf71a14aeed71ea64663d4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:20:03 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-641e18dd-d0f1-44b8-b5f2-8db6448c2d8a tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Lock "97ba3ec2a011ee0bfacf71a14aeed71ea64663d4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:20:03 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-641e18dd-d0f1-44b8-b5f2-8db6448c2d8a tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/97ba3ec2a011ee0bfacf71a14aeed71ea64663d4 --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:20:03 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea6afcf7-0b8b-43d8-af1d-9c132a659711/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:20:03 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f780040f-b789-4b72-8986-813c7b9fe4a6/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:20:03 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-641e18dd-d0f1-44b8-b5f2-8db6448c2d8a tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/97ba3ec2a011ee0bfacf71a14aeed71ea64663d4 --force-share --output=json" returned: 0 in 0.165s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:20:03 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-641e18dd-d0f1-44b8-b5f2-8db6448c2d8a tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/97ba3ec2a011ee0bfacf71a14aeed71ea64663d4,backing_fmt=raw /opt/stack/data/nova/instances/0f510d75-5d1e-4a5c-b38f-731c299f0f5a/disk.rescue {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:20:03 user nova-compute[72382]: DEBUG nova.network.neutron [None req-7da76c05-26a3-4c90-8e72-94f8b9462e61 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] [instance: 44afd1bf-fa5c-4b3e-8752-b16853fef54e] Updating instance_info_cache with network_info: [{"id": "2a1d4c60-bc2a-4530-b3bd-2a12ae2d2098", "address": "fa:16:3e:6c:50:29", "network": {"id": "46ef00c7-17ee-4e45-ba1d-dcc0a417ea85", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1360012261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "990ba791030940d38360af5879c853c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a1d4c60-bc", "ovs_interfaceid": "2a1d4c60-bc2a-4530-b3bd-2a12ae2d2098", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:20:03 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-641e18dd-d0f1-44b8-b5f2-8db6448c2d8a tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/97ba3ec2a011ee0bfacf71a14aeed71ea64663d4,backing_fmt=raw /opt/stack/data/nova/instances/0f510d75-5d1e-4a5c-b38f-731c299f0f5a/disk.rescue" returned: 0 in 0.070s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:20:03 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-641e18dd-d0f1-44b8-b5f2-8db6448c2d8a tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Lock "97ba3ec2a011ee0bfacf71a14aeed71ea64663d4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.243s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:20:03 user nova-compute[72382]: DEBUG nova.objects.instance [None req-641e18dd-d0f1-44b8-b5f2-8db6448c2d8a tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Lazy-loading 'migration_context' on Instance uuid 0f510d75-5d1e-4a5c-b38f-731c299f0f5a {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:20:03 user nova-compute[72382]: DEBUG nova.compute.manager [req-ca452872-d3de-4b67-8906-dbe617b8b127 req-3d17a7b5-3216-45ac-ac33-084291282188 service nova] [instance: 0f510d75-5d1e-4a5c-b38f-731c299f0f5a] Received event network-vif-plugged-c67a8d45-c4ba-4302-940f-c05799ecc732 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:20:03 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-ca452872-d3de-4b67-8906-dbe617b8b127 req-3d17a7b5-3216-45ac-ac33-084291282188 service nova] Acquiring lock "0f510d75-5d1e-4a5c-b38f-731c299f0f5a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:20:03 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-ca452872-d3de-4b67-8906-dbe617b8b127 req-3d17a7b5-3216-45ac-ac33-084291282188 service nova] Lock "0f510d75-5d1e-4a5c-b38f-731c299f0f5a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:20:03 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-ca452872-d3de-4b67-8906-dbe617b8b127 req-3d17a7b5-3216-45ac-ac33-084291282188 service nova] Lock "0f510d75-5d1e-4a5c-b38f-731c299f0f5a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:20:03 user nova-compute[72382]: DEBUG nova.compute.manager [req-ca452872-d3de-4b67-8906-dbe617b8b127 req-3d17a7b5-3216-45ac-ac33-084291282188 service nova] [instance: 0f510d75-5d1e-4a5c-b38f-731c299f0f5a] No waiting events found dispatching network-vif-plugged-c67a8d45-c4ba-4302-940f-c05799ecc732 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:20:03 user nova-compute[72382]: WARNING nova.compute.manager [req-ca452872-d3de-4b67-8906-dbe617b8b127 req-3d17a7b5-3216-45ac-ac33-084291282188 service nova] [instance: 0f510d75-5d1e-4a5c-b38f-731c299f0f5a] Received unexpected event network-vif-plugged-c67a8d45-c4ba-4302-940f-c05799ecc732 for instance with vm_state active and task_state rescuing.
Aug 09 15:20:03 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f780040f-b789-4b72-8986-813c7b9fe4a6/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:20:03 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-7da76c05-26a3-4c90-8e72-94f8b9462e61 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Releasing lock "refresh_cache-44afd1bf-fa5c-4b3e-8752-b16853fef54e" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 15:20:03 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f780040f-b789-4b72-8986-813c7b9fe4a6/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:20:03 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-641e18dd-d0f1-44b8-b5f2-8db6448c2d8a tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] [instance: 0f510d75-5d1e-4a5c-b38f-731c299f0f5a] Created local disks {{(pid=72382) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 15:20:03 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-641e18dd-d0f1-44b8-b5f2-8db6448c2d8a tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] [instance: 0f510d75-5d1e-4a5c-b38f-731c299f0f5a] Start _get_guest_xml network_info=[{"id": "c67a8d45-c4ba-4302-940f-c05799ecc732", "address": "fa:16:3e:02:6d:5d", "network": {"id": "d47e3749-fdff-4112-bd72-69ca584efe1f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-302967634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-302967634-network", "vif_mac": "fa:16:3e:02:6d:5d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "080d1ded4cd94e5083ee0b7e691b7363", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc67a8d45-c4", "ovs_interfaceid": "c67a8d45-c4ba-4302-940f-c05799ecc732", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T15:11:25Z,direct_url=<?>,disk_format='qcow2',id=a79f2cea-eb27-4631-aaf3-05e7d9e411b4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a638990e12cc4d6eabb6d55e13be6bdf',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T15:11:27Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'f4111f07-a2b0-4eca-86a0-21bebbebdb33', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QpOYqIyf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': '0f510d75-5d1e-4a5c-b38f-731c299f0f5a', 'attached_at': '', 'detached_at': '', 'volume_id': '05583e93-152e-49cd-8466-12d60f49c457', 'serial': '05583e93-152e-49cd-8466-12d60f49c457'}, 'disk_bus': 'virtio', 'attachment_id': '942f03cb-1574-4554-bff0-2b8050295136', 'delete_on_termination': False, 'volume_type': None} {{(pid=72382) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 15:20:03 user nova-compute[72382]: DEBUG nova.objects.instance [None req-641e18dd-d0f1-44b8-b5f2-8db6448c2d8a tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Lazy-loading 'resources' on Instance uuid 0f510d75-5d1e-4a5c-b38f-731c299f0f5a {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:20:03 user nova-compute[72382]: DEBUG nova.objects.instance [None req-641e18dd-d0f1-44b8-b5f2-8db6448c2d8a tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Lazy-loading 'numa_topology' on Instance uuid 0f510d75-5d1e-4a5c-b38f-731c299f0f5a {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:20:03 user nova-compute[72382]: WARNING nova.virt.libvirt.driver [None req-641e18dd-d0f1-44b8-b5f2-8db6448c2d8a tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 15:20:03 user nova-compute[72382]: WARNING nova.virt.libvirt.driver [None req-641e18dd-d0f1-44b8-b5f2-8db6448c2d8a tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 15:20:03 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-641e18dd-d0f1-44b8-b5f2-8db6448c2d8a tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72382) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 15:20:03 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-641e18dd-d0f1-44b8-b5f2-8db6448c2d8a tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] CPU controller missing on host. {{(pid=72382) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 15:20:03 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-641e18dd-d0f1-44b8-b5f2-8db6448c2d8a tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72382) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 15:20:03 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-641e18dd-d0f1-44b8-b5f2-8db6448c2d8a tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] CPU controller found on host. {{(pid=72382) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 15:20:03 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-641e18dd-d0f1-44b8-b5f2-8db6448c2d8a tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72382) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 15:20:03 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-641e18dd-d0f1-44b8-b5f2-8db6448c2d8a tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T15:11:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T15:11:25Z,direct_url=<?>,disk_format='qcow2',id=a79f2cea-eb27-4631-aaf3-05e7d9e411b4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a638990e12cc4d6eabb6d55e13be6bdf',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T15:11:27Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 15:20:03 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-641e18dd-d0f1-44b8-b5f2-8db6448c2d8a tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Flavor limits 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 15:20:03 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-641e18dd-d0f1-44b8-b5f2-8db6448c2d8a tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Image limits 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 15:20:03 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-641e18dd-d0f1-44b8-b5f2-8db6448c2d8a tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Flavor pref 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 15:20:03 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-641e18dd-d0f1-44b8-b5f2-8db6448c2d8a tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Image pref 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 15:20:03 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-641e18dd-d0f1-44b8-b5f2-8db6448c2d8a tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 15:20:03 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-641e18dd-d0f1-44b8-b5f2-8db6448c2d8a tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 15:20:03 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-641e18dd-d0f1-44b8-b5f2-8db6448c2d8a tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72382) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 15:20:03 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-641e18dd-d0f1-44b8-b5f2-8db6448c2d8a tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Got 1 possible topologies {{(pid=72382) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 15:20:03 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-641e18dd-d0f1-44b8-b5f2-8db6448c2d8a tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 15:20:03 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-641e18dd-d0f1-44b8-b5f2-8db6448c2d8a tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 15:20:03 user nova-compute[72382]: DEBUG nova.objects.instance [None req-641e18dd-d0f1-44b8-b5f2-8db6448c2d8a tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Lazy-loading 'vcpu_model' on Instance uuid 0f510d75-5d1e-4a5c-b38f-731c299f0f5a {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:20:03 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:20:03 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-641e18dd-d0f1-44b8-b5f2-8db6448c2d8a tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] [instance: 0f510d75-5d1e-4a5c-b38f-731c299f0f5a] Calling os-brick to attach iSCSI Volume {{(pid=72382) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 15:20:03 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-641e18dd-d0f1-44b8-b5f2-8db6448c2d8a tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2a0c768340>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QpOYqIyf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 15:20:03 user nova-compute[72382]: WARNING os_brick.initiator.connectors.base [None req-641e18dd-d0f1-44b8-b5f2-8db6448c2d8a tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 15:20:03 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-641e18dd-d0f1-44b8-b5f2-8db6448c2d8a tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 15:20:03 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-641e18dd-d0f1-44b8-b5f2-8db6448c2d8a tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.005s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 15:20:03 user nova-compute[72382]: WARNING os_brick.initiator.connectors.base [None req-641e18dd-d0f1-44b8-b5f2-8db6448c2d8a tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 15:20:03 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-641e18dd-d0f1-44b8-b5f2-8db6448c2d8a tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 15:20:03 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-641e18dd-d0f1-44b8-b5f2-8db6448c2d8a tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 15:20:03 user nova-compute[72382]: INFO os_brick.initiator.connectors.iscsi [None req-641e18dd-d0f1-44b8-b5f2-8db6448c2d8a tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 15:20:03 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 -p 172.16.0.220:3260 {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:20:03 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f780040f-b789-4b72-8986-813c7b9fe4a6/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:20:03 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:20:03 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 -p 172.16.0.220:3260" returned: 0 in 0.021s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:20:03 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[37dca475-3543-4f11-8e6c-41378e1d620a]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = QpOYqIyf\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:20:04 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-641e18dd-d0f1-44b8-b5f2-8db6448c2d8a tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Aug 09 15:20:04 user nova-compute[72382]: node.name = iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457
Aug 09 15:20:04 user nova-compute[72382]: node.tpgt = -1
Aug 09 15:20:04 user nova-compute[72382]: node.startup = automatic
Aug 09 15:20:04 user nova-compute[72382]: node.leading_login = No
Aug 09 15:20:04 user nova-compute[72382]: iface.iscsi_ifacename = default
Aug 09 15:20:04 user nova-compute[72382]: iface.net_ifacename = <empty>
Aug 09 15:20:04 user nova-compute[72382]: iface.ipaddress = <empty>
Aug 09 15:20:04 user nova-compute[72382]: iface.prefix_len = 0
Aug 09 15:20:04 user nova-compute[72382]: iface.hwaddress = <empty>
Aug 09 15:20:04 user nova-compute[72382]: iface.transport_name = tcp
Aug 09 15:20:04 user nova-compute[72382]: iface.initiatorname = <empty>
Aug 09 15:20:04 user nova-compute[72382]: iface.state = <empty>
Aug 09 15:20:04 user nova-compute[72382]: iface.vlan_id = 0
Aug 09 15:20:04 user nova-compute[72382]: iface.vlan_priority = 0
Aug 09 15:20:04 user nova-compute[72382]: iface.vlan_state = <empty>
Aug 09 15:20:04 user nova-compute[72382]: iface.iface_num = 0
Aug 09 15:20:04 user nova-compute[72382]: iface.mtu = 0
Aug 09 15:20:04 user nova-compute[72382]: iface.port = 0
Aug 09 15:20:04 user nova-compute[72382]: iface.bootproto = <empty>
Aug 09 15:20:04 user nova-compute[72382]: iface.subnet_mask = <empty>
Aug 09 15:20:04 user nova-compute[72382]: iface.gateway = <empty>
Aug 09 15:20:04 user nova-compute[72382]: iface.dhcp_alt_client_id_state = <empty>
Aug 09 15:20:04 user nova-compute[72382]: iface.dhcp_alt_client_id = <empty>
Aug 09 15:20:04 user nova-compute[72382]: iface.dhcp_dns = <empty>
Aug 09 15:20:04 user nova-compute[72382]: iface.dhcp_learn_iqn = <empty>
Aug 09 15:20:04 user nova-compute[72382]: iface.dhcp_req_vendor_id_state = <empty>
Aug 09 15:20:04 user nova-compute[72382]: iface.dhcp_vendor_id_state = <empty>
Aug 09 15:20:04 user nova-compute[72382]: iface.dhcp_vendor_id = <empty>
Aug 09 15:20:04 user nova-compute[72382]: iface.dhcp_slp_da = <empty>
Aug 09 15:20:04 user nova-compute[72382]: iface.fragmentation = <empty>
Aug 09 15:20:04 user nova-compute[72382]: iface.gratuitous_arp = <empty>
Aug 09 15:20:04 user nova-compute[72382]: iface.incoming_forwarding = <empty>
Aug 09 15:20:04 user nova-compute[72382]: iface.tos_state = <empty>
Aug 09 15:20:04 user nova-compute[72382]: iface.tos = 0
Aug 09 15:20:04 user nova-compute[72382]: iface.ttl = 0
Aug 09 15:20:04 user nova-compute[72382]: iface.delayed_ack = <empty>
Aug 09 15:20:04 user nova-compute[72382]: iface.tcp_nagle = <empty>
Aug 09 15:20:04 user nova-compute[72382]: iface.tcp_wsf_state = <empty>
Aug 09 15:20:04 user nova-compute[72382]: iface.tcp_wsf = 0
Aug 09 15:20:04 user nova-compute[72382]: iface.tcp_timer_scale = 0
Aug 09 15:20:04 user nova-compute[72382]: iface.tcp_timestamp = <empty>
Aug 09 15:20:04 user nova-compute[72382]: iface.redirect = <empty>
Aug 09 15:20:04 user nova-compute[72382]: iface.def_task_mgmt_timeout = 0
Aug 09 15:20:04 user nova-compute[72382]: iface.header_digest = <empty>
Aug 09 15:20:04 user nova-compute[72382]: iface.data_digest = <empty>
Aug 09 15:20:04 user nova-compute[72382]: iface.immediate_data = <empty>
Aug 09 15:20:04 user nova-compute[72382]: iface.initial_r2t = <empty>
Aug 09 15:20:04 user nova-compute[72382]: iface.data_seq_inorder = <empty>
Aug 09 15:20:04 user nova-compute[72382]: iface.data_pdu_inorder = <empty>
Aug 09 15:20:04 user nova-compute[72382]: iface.erl = 0
Aug 09 15:20:04 user nova-compute[72382]: iface.max_receive_data_len = 0
Aug 09 15:20:04 user nova-compute[72382]: iface.first_burst_len = 0
Aug 09 15:20:04 user nova-compute[72382]: iface.max_outstanding_r2t = 0
Aug 09 15:20:04 user nova-compute[72382]: iface.max_burst_len = 0
Aug 09 15:20:04 user nova-compute[72382]: iface.chap_auth = <empty>
Aug 09 15:20:04 user nova-compute[72382]: iface.bidi_chap = <empty>
Aug 09 15:20:04 user nova-compute[72382]: iface.strict_login_compliance = <empty>
Aug 09 15:20:04 user nova-compute[72382]: iface.discovery_auth = <empty>
Aug 09 15:20:04 user nova-compute[72382]: iface.discovery_logout = <empty>
Aug 09 15:20:04 user nova-compute[72382]: node.discovery_address = <empty>
Aug 09 15:20:04 user nova-compute[72382]: node.discovery_port = 0
Aug 09 15:20:04 user nova-compute[72382]: node.discovery_type = static
Aug 09 15:20:04 user nova-compute[72382]: node.session.initial_cmdsn = 0
Aug 09 15:20:04 user nova-compute[72382]: node.session.initial_login_retry_max = 8
Aug 09 15:20:04 user nova-compute[72382]: node.session.xmit_thread_priority = -20
Aug 09 15:20:04 user nova-compute[72382]: node.session.cmds_max = 128
Aug 09 15:20:04 user nova-compute[72382]: node.session.queue_depth = 32
Aug 09 15:20:04 user nova-compute[72382]: node.session.nr_sessions = 1
Aug 09 15:20:04 user nova-compute[72382]: node.session.auth.authmethod = CHAP
Aug 09 15:20:04 user nova-compute[72382]: node.session.auth.username = QpOYqIyf
Aug 09 15:20:04 user nova-compute[72382]: node.session.auth.password = ***
Aug 09 15:20:04 user nova-compute[72382]: node.session.auth.username_in = <empty>
Aug 09 15:20:04 user nova-compute[72382]: node.session.auth.password_in = <empty>
Aug 09 15:20:04 user nova-compute[72382]: node.session.auth.chap_algs = MD5
Aug 09 15:20:04 user nova-compute[72382]: node.session.timeo.replacement_timeout = 120
Aug 09 15:20:04 user nova-compute[72382]: node.session.err_timeo.abort_timeout = 15
Aug 09 15:20:04 user nova-compute[72382]: node.session.err_timeo.lu_reset_timeout = 30
Aug 09 15:20:04 user nova-compute[72382]: node.session.err_timeo.tgt_reset_timeout = 30
Aug 09 15:20:04 user nova-compute[72382]: node.session.err_timeo.host_reset_timeout = 60
Aug 09 15:20:04 user nova-compute[72382]: node.session.iscsi.FastAbort = Yes
Aug 09 15:20:04 user nova-compute[72382]: node.session.iscsi.InitialR2T = No
Aug 09 15:20:04 user nova-compute[72382]: node.session.iscsi.ImmediateData = Yes
Aug 09 15:20:04 user nova-compute[72382]: node.session.iscsi.FirstBurstLength = 262144
Aug 09 15:20:04 user nova-compute[72382]: node.session.iscsi.MaxBurstLength = 16776192
Aug 09 15:20:04 user nova-compute[72382]: node.session.iscsi.DefaultTime2Retain = 0
Aug 09 15:20:04 user nova-compute[72382]: node.session.iscsi.DefaultTime2Wait = 2
Aug 09 15:20:04 user nova-compute[72382]: node.session.iscsi.MaxConnections = 1
Aug 09 15:20:04 user nova-compute[72382]: node.session.iscsi.MaxOutstandingR2T = 1
Aug 09 15:20:04 user nova-compute[72382]: node.session.iscsi.ERL = 0
Aug 09 15:20:04 user nova-compute[72382]: node.session.scan = manual
Aug 09 15:20:04 user nova-compute[72382]: node.session.reopen_max = 0
Aug 09 15:20:04 user nova-compute[72382]: node.conn[0].address = 172.16.0.220
Aug 09 15:20:04 user nova-compute[72382]: node.conn[0].port = 3260
Aug 09 15:20:04 user nova-compute[72382]: node.conn[0].startup = manual
Aug 09 15:20:04 user nova-compute[72382]: node.conn[0].tcp.window_size = 524288
Aug 09 15:20:04 user nova-compute[72382]: node.conn[0].tcp.type_of_service = 0
Aug 09 15:20:04 user nova-compute[72382]: node.conn[0].timeo.logout_timeout = 15
Aug 09 15:20:04 user nova-compute[72382]: node.conn[0].timeo.login_timeout = 15
Aug 09 15:20:04 user nova-compute[72382]: node.conn[0].timeo.auth_timeout = 45
Aug 09 15:20:04 user nova-compute[72382]: node.conn[0].timeo.noop_out_interval = 5
Aug 09 15:20:04 user nova-compute[72382]: node.conn[0].timeo.noop_out_timeout = 5
Aug 09 15:20:04 user nova-compute[72382]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Aug 09 15:20:04 user nova-compute[72382]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Aug 09 15:20:04 user nova-compute[72382]: node.conn[0].iscsi.HeaderDigest = None
Aug 09 15:20:04 user nova-compute[72382]: node.conn[0].iscsi.DataDigest = None
Aug 09 15:20:04 user nova-compute[72382]: node.conn[0].iscsi.IFMarker = No
Aug 09 15:20:04 user nova-compute[72382]: node.conn[0].iscsi.OFMarker = No
Aug 09 15:20:04 user nova-compute[72382]: # END RECORD
Aug 09 15:20:04 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:20:04 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/266be814-4a2b-4f8e-a0f6-e8821fdeb95d/disk.rescue --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:20:04 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:20:04 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:20:04 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4c76326-9928-4d06-9da7-1e30400d501b]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:20:04 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:20:04 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-641e18dd-d0f1-44b8-b5f2-8db6448c2d8a tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:20:04 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:20:04 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:20:04 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:20:04 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee58528b-7cea-4049-b89d-058868c519fd]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:20:04 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-641e18dd-d0f1-44b8-b5f2-8db6448c2d8a tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:20:04 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QpOYqIyf {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:20:04 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QpOYqIyf" returned: 0 in 0.018s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:20:04 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[249332f9-a247-4f84-b8d5-b590febda338]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:20:04 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-641e18dd-d0f1-44b8-b5f2-8db6448c2d8a tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QpOYqIyf'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:20:04 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:20:04 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.048s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:20:04 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a9daf21-8fc9-432c-95e3-3ea4bfdc6e26]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:20:04 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-641e18dd-d0f1-44b8-b5f2-8db6448c2d8a tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:20:04 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:20:04 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/266be814-4a2b-4f8e-a0f6-e8821fdeb95d/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:20:04 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/266be814-4a2b-4f8e-a0f6-e8821fdeb95d/disk.rescue --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:20:04 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:20:04 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[b61e56f1-31ef-4e45-870e-0ae46449c944]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb47e85c-aaa9-4165-8be3-125572b68a87 (non-flash)\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:20:04 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-641e18dd-d0f1-44b8-b5f2-8db6448c2d8a tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)
Aug 09 15:20:04 user nova-compute[72382]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb47e85c-aaa9-4165-8be3-125572b68a87 (non-flash)
Aug 09 15:20:04 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 15:20:04 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-641e18dd-d0f1-44b8-b5f2-8db6448c2d8a tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)
Aug 09 15:20:04 user nova-compute[72382]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb47e85c-aaa9-4165-8be3-125572b68a87 (non-flash)
Aug 09 15:20:04 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 15:20:04 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-641e18dd-d0f1-44b8-b5f2-8db6448c2d8a tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.260s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 15:20:04 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-641e18dd-d0f1-44b8-b5f2-8db6448c2d8a tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Connected to 172.16.0.220:3260 {{(pid=72382) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 15:20:04 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-641e18dd-d0f1-44b8-b5f2-8db6448c2d8a tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] HCTL ('35', '0', '0', 0) found on session 13 with lun 0 {{(pid=72382) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 15:20:04 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-641e18dd-d0f1-44b8-b5f2-8db6448c2d8a tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Scanning host 35 c: 0, t: 0, l: 0) {{(pid=72382) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 15:20:04 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:20:04 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.013s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:20:04 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd5b03dd-e56b-445d-81fe-437614611154]: (4, ('0 0 0', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:20:04 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-641e18dd-d0f1-44b8-b5f2-8db6448c2d8a tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Searching for a device in session 13 and hctl ('35', '0', '0', 0) yield: sdd {{(pid=72382) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 15:20:04 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-641e18dd-d0f1-44b8-b5f2-8db6448c2d8a tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QpOYqIyf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72382) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 15:20:04 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-641e18dd-d0f1-44b8-b5f2-8db6448c2d8a tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.287s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 15:20:04 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-641e18dd-d0f1-44b8-b5f2-8db6448c2d8a tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] <== connect_volume: return (292ms) {'type': 'block', 'scsi_wwn': '26133633134313133', 'path': '/dev/sdd'} {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 15:20:04 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-641e18dd-d0f1-44b8-b5f2-8db6448c2d8a tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] [instance: 0f510d75-5d1e-4a5c-b38f-731c299f0f5a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26133633134313133', 'path': '/dev/sdd'} {{(pid=72382) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 15:20:04 user nova-compute[72382]: DEBUG nova.virt.libvirt.vif [None req-641e18dd-d0f1-44b8-b5f2-8db6448c2d8a tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T15:18:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1329934953',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1329934953',id=14,image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-09T15:18:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='080d1ded4cd94e5083ee0b7e691b7363',ramdisk_id='',reservation_id='r-r90gykan',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1187177274',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T15:18:32Z,user_data=None,user_id='e71af7a4912147cd9fab070cb77b275c',uuid=0f510d75-5d1e-4a5c-b38f-731c299f0f5a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c67a8d45-c4ba-4302-940f-c05799ecc732", "address": "fa:16:3e:02:6d:5d", "network": {"id": "d47e3749-fdff-4112-bd72-69ca584efe1f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-302967634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-302967634-network", "vif_mac": "fa:16:3e:02:6d:5d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "080d1ded4cd94e5083ee0b7e691b7363", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc67a8d45-c4", "ovs_interfaceid": "c67a8d45-c4ba-4302-940f-c05799ecc732", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72382) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 15:20:04 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-641e18dd-d0f1-44b8-b5f2-8db6448c2d8a tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Converting VIF {"id": "c67a8d45-c4ba-4302-940f-c05799ecc732", "address": "fa:16:3e:02:6d:5d", "network": {"id": "d47e3749-fdff-4112-bd72-69ca584efe1f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-302967634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-302967634-network", "vif_mac": "fa:16:3e:02:6d:5d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "080d1ded4cd94e5083ee0b7e691b7363", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc67a8d45-c4", "ovs_interfaceid": "c67a8d45-c4ba-4302-940f-c05799ecc732", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 15:20:04 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-641e18dd-d0f1-44b8-b5f2-8db6448c2d8a tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:02:6d:5d,bridge_name='br-int',has_traffic_filtering=True,id=c67a8d45-c4ba-4302-940f-c05799ecc732,network=Network(d47e3749-fdff-4112-bd72-69ca584efe1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc67a8d45-c4') {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 15:20:04 user nova-compute[72382]: DEBUG nova.objects.instance [None req-641e18dd-d0f1-44b8-b5f2-8db6448c2d8a tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Lazy-loading 'pci_devices' on Instance uuid 0f510d75-5d1e-4a5c-b38f-731c299f0f5a {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:20:04 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:20:04 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:20:04 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-641e18dd-d0f1-44b8-b5f2-8db6448c2d8a tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] [instance: 0f510d75-5d1e-4a5c-b38f-731c299f0f5a] End _get_guest_xml xml=<domain type="kvm">
Aug 09 15:20:04 user nova-compute[72382]:   <uuid>0f510d75-5d1e-4a5c-b38f-731c299f0f5a</uuid>
Aug 09 15:20:04 user nova-compute[72382]:   <name>instance-0000000e</name>
Aug 09 15:20:04 user nova-compute[72382]:   <memory>524288</memory>
Aug 09 15:20:04 user nova-compute[72382]:   <vcpu>1</vcpu>
Aug 09 15:20:04 user nova-compute[72382]:   <metadata>
Aug 09 15:20:04 user nova-compute[72382]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 15:20:04 user nova-compute[72382]:       <nova:package version="0.0.0"/>
Aug 09 15:20:04 user nova-compute[72382]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1329934953</nova:name>
Aug 09 15:20:04 user nova-compute[72382]:       <nova:creationTime>2023-08-09 15:20:03</nova:creationTime>
Aug 09 15:20:04 user nova-compute[72382]:       <nova:flavor name="m1.tiny">
Aug 09 15:20:04 user nova-compute[72382]:         <nova:memory>512</nova:memory>
Aug 09 15:20:04 user nova-compute[72382]:         <nova:disk>1</nova:disk>
Aug 09 15:20:04 user nova-compute[72382]:         <nova:swap>0</nova:swap>
Aug 09 15:20:04 user nova-compute[72382]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 15:20:04 user nova-compute[72382]:         <nova:vcpus>1</nova:vcpus>
Aug 09 15:20:04 user nova-compute[72382]:       </nova:flavor>
Aug 09 15:20:04 user nova-compute[72382]:       <nova:owner>
Aug 09 15:20:04 user nova-compute[72382]:         <nova:user uuid="e71af7a4912147cd9fab070cb77b275c">tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member</nova:user>
Aug 09 15:20:04 user nova-compute[72382]:         <nova:project uuid="080d1ded4cd94e5083ee0b7e691b7363">tempest-ServerBootFromVolumeStableRescueTest-1187177274</nova:project>
Aug 09 15:20:04 user nova-compute[72382]:       </nova:owner>
Aug 09 15:20:04 user nova-compute[72382]:       <nova:root type="image" uuid="a79f2cea-eb27-4631-aaf3-05e7d9e411b4"/>
Aug 09 15:20:04 user nova-compute[72382]:       <nova:ports>
Aug 09 15:20:04 user nova-compute[72382]:         <nova:port uuid="c67a8d45-c4ba-4302-940f-c05799ecc732">
Aug 09 15:20:04 user nova-compute[72382]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 09 15:20:04 user nova-compute[72382]:         </nova:port>
Aug 09 15:20:04 user nova-compute[72382]:       </nova:ports>
Aug 09 15:20:04 user nova-compute[72382]:     </nova:instance>
Aug 09 15:20:04 user nova-compute[72382]:   </metadata>
Aug 09 15:20:04 user nova-compute[72382]:   <sysinfo type="smbios">
Aug 09 15:20:04 user nova-compute[72382]:     <system>
Aug 09 15:20:04 user nova-compute[72382]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 15:20:04 user nova-compute[72382]:       <entry name="product">OpenStack Nova</entry>
Aug 09 15:20:04 user nova-compute[72382]:       <entry name="version">0.0.0</entry>
Aug 09 15:20:04 user nova-compute[72382]:       <entry name="serial">0f510d75-5d1e-4a5c-b38f-731c299f0f5a</entry>
Aug 09 15:20:04 user nova-compute[72382]:       <entry name="uuid">0f510d75-5d1e-4a5c-b38f-731c299f0f5a</entry>
Aug 09 15:20:04 user nova-compute[72382]:       <entry name="family">Virtual Machine</entry>
Aug 09 15:20:04 user nova-compute[72382]:     </system>
Aug 09 15:20:04 user nova-compute[72382]:   </sysinfo>
Aug 09 15:20:04 user nova-compute[72382]:   <os>
Aug 09 15:20:04 user nova-compute[72382]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 15:20:04 user nova-compute[72382]:     <smbios mode="sysinfo"/>
Aug 09 15:20:04 user nova-compute[72382]:   </os>
Aug 09 15:20:04 user nova-compute[72382]:   <features>
Aug 09 15:20:04 user nova-compute[72382]:     <acpi/>
Aug 09 15:20:04 user nova-compute[72382]:     <apic/>
Aug 09 15:20:04 user nova-compute[72382]:     <vmcoreinfo/>
Aug 09 15:20:04 user nova-compute[72382]:   </features>
Aug 09 15:20:04 user nova-compute[72382]:   <clock offset="utc">
Aug 09 15:20:04 user nova-compute[72382]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 15:20:04 user nova-compute[72382]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 15:20:04 user nova-compute[72382]:     <timer name="hpet" present="no"/>
Aug 09 15:20:04 user nova-compute[72382]:   </clock>
Aug 09 15:20:04 user nova-compute[72382]:   <cpu mode="custom" match="exact">
Aug 09 15:20:04 user nova-compute[72382]:     <model>Nehalem</model>
Aug 09 15:20:04 user nova-compute[72382]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 15:20:04 user nova-compute[72382]:   </cpu>
Aug 09 15:20:04 user nova-compute[72382]:   <devices>
Aug 09 15:20:04 user nova-compute[72382]:     <disk type="block" device="disk">
Aug 09 15:20:04 user nova-compute[72382]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 15:20:04 user nova-compute[72382]:       <source dev="/dev/sdd"/>
Aug 09 15:20:04 user nova-compute[72382]:       <target dev="vda" bus="virtio"/>
Aug 09 15:20:04 user nova-compute[72382]:       <serial>05583e93-152e-49cd-8466-12d60f49c457</serial>
Aug 09 15:20:04 user nova-compute[72382]:     </disk>
Aug 09 15:20:04 user nova-compute[72382]:     <disk type="file" device="disk">
Aug 09 15:20:04 user nova-compute[72382]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 15:20:04 user nova-compute[72382]:       <source file="/opt/stack/data/nova/instances/0f510d75-5d1e-4a5c-b38f-731c299f0f5a/disk.rescue"/>
Aug 09 15:20:04 user nova-compute[72382]:       <target dev="vdb" bus="virtio"/>
Aug 09 15:20:04 user nova-compute[72382]:       <boot order="1"/>
Aug 09 15:20:04 user nova-compute[72382]:     </disk>
Aug 09 15:20:04 user nova-compute[72382]:     <interface type="ethernet">
Aug 09 15:20:04 user nova-compute[72382]:       <mac address="fa:16:3e:02:6d:5d"/>
Aug 09 15:20:04 user nova-compute[72382]:       <model type="virtio"/>
Aug 09 15:20:04 user nova-compute[72382]:       <mtu size="1442"/>
Aug 09 15:20:04 user nova-compute[72382]:       <target dev="tapc67a8d45-c4"/>
Aug 09 15:20:04 user nova-compute[72382]:     </interface>
Aug 09 15:20:04 user nova-compute[72382]:     <serial type="pty">
Aug 09 15:20:04 user nova-compute[72382]:       <log file="/opt/stack/data/nova/instances/0f510d75-5d1e-4a5c-b38f-731c299f0f5a/console.log" append="off"/>
Aug 09 15:20:04 user nova-compute[72382]:     </serial>
Aug 09 15:20:04 user nova-compute[72382]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 15:20:04 user nova-compute[72382]:     <video>
Aug 09 15:20:04 user nova-compute[72382]:       <model type="virtio"/>
Aug 09 15:20:04 user nova-compute[72382]:     </video>
Aug 09 15:20:04 user nova-compute[72382]:     <rng model="virtio">
Aug 09 15:20:04 user nova-compute[72382]:       <backend model="random">/dev/urandom</backend>
Aug 09 15:20:04 user nova-compute[72382]:     </rng>
Aug 09 15:20:04 user nova-compute[72382]:     <controller type="usb" index="0" model="none"/>
Aug 09 15:20:04 user nova-compute[72382]:     <memballoon model="virtio">
Aug 09 15:20:04 user nova-compute[72382]:       <stats period="10"/>
Aug 09 15:20:04 user nova-compute[72382]:     </memballoon>
Aug 09 15:20:04 user nova-compute[72382]:   </devices>
Aug 09 15:20:04 user nova-compute[72382]: </domain>
Aug 09 15:20:04 user nova-compute[72382]:  {{(pid=72382) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 15:20:04 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/266be814-4a2b-4f8e-a0f6-e8821fdeb95d/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:20:04 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/266be814-4a2b-4f8e-a0f6-e8821fdeb95d/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:20:04 user nova-compute[72382]: INFO nova.virt.libvirt.driver [-] [instance: 0f510d75-5d1e-4a5c-b38f-731c299f0f5a] Instance destroyed successfully.
Aug 09 15:20:04 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/266be814-4a2b-4f8e-a0f6-e8821fdeb95d/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:20:04 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/266be814-4a2b-4f8e-a0f6-e8821fdeb95d/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:20:04 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-641e18dd-d0f1-44b8-b5f2-8db6448c2d8a tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] No BDM found with device name vda, not building metadata. {{(pid=72382) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 15:20:04 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-641e18dd-d0f1-44b8-b5f2-8db6448c2d8a tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72382) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 15:20:04 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-641e18dd-d0f1-44b8-b5f2-8db6448c2d8a tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] No VIF found with MAC fa:16:3e:02:6d:5d, not building metadata {{(pid=72382) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 15:20:04 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/266be814-4a2b-4f8e-a0f6-e8821fdeb95d/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:20:04 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a33515b3-3ef4-4f76-a8d8-e7008b5bbb79/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:20:04 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a33515b3-3ef4-4f76-a8d8-e7008b5bbb79/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:20:04 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a33515b3-3ef4-4f76-a8d8-e7008b5bbb79/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:20:04 user nova-compute[72382]: INFO nova.virt.libvirt.driver [-] [instance: 44afd1bf-fa5c-4b3e-8752-b16853fef54e] Instance destroyed successfully.
Aug 09 15:20:04 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a33515b3-3ef4-4f76-a8d8-e7008b5bbb79/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:20:04 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-7da76c05-26a3-4c90-8e72-94f8b9462e61 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] [instance: 44afd1bf-fa5c-4b3e-8752-b16853fef54e] Attempting rescue
Aug 09 15:20:04 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-7da76c05-26a3-4c90-8e72-94f8b9462e61 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=72382) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 09 15:20:05 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/777e49ea-b674-4c3f-9cdd-ac2113032632/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:20:05 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-7da76c05-26a3-4c90-8e72-94f8b9462e61 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] [instance: 44afd1bf-fa5c-4b3e-8752-b16853fef54e] Instance directory exists: not creating {{(pid=72382) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 09 15:20:05 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-7da76c05-26a3-4c90-8e72-94f8b9462e61 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] [instance: 44afd1bf-fa5c-4b3e-8752-b16853fef54e] Creating image(s)
Aug 09 15:20:05 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-7da76c05-26a3-4c90-8e72-94f8b9462e61 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Acquiring lock "/opt/stack/data/nova/instances/44afd1bf-fa5c-4b3e-8752-b16853fef54e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:20:05 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-7da76c05-26a3-4c90-8e72-94f8b9462e61 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Lock "/opt/stack/data/nova/instances/44afd1bf-fa5c-4b3e-8752-b16853fef54e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.002s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:20:05 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-7da76c05-26a3-4c90-8e72-94f8b9462e61 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Lock "/opt/stack/data/nova/instances/44afd1bf-fa5c-4b3e-8752-b16853fef54e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:20:05 user nova-compute[72382]: DEBUG nova.objects.instance [None req-7da76c05-26a3-4c90-8e72-94f8b9462e61 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Lazy-loading 'trusted_certs' on Instance uuid 44afd1bf-fa5c-4b3e-8752-b16853fef54e {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:20:05 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-7da76c05-26a3-4c90-8e72-94f8b9462e61 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Acquiring lock "383812ff437283e0191ed5b9ecc04c27f1162b0b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:20:05 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-7da76c05-26a3-4c90-8e72-94f8b9462e61 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Lock "383812ff437283e0191ed5b9ecc04c27f1162b0b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:20:05 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-7da76c05-26a3-4c90-8e72-94f8b9462e61 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:20:05 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/777e49ea-b674-4c3f-9cdd-ac2113032632/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:20:05 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/777e49ea-b674-4c3f-9cdd-ac2113032632/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:20:05 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-7da76c05-26a3-4c90-8e72-94f8b9462e61 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b --force-share --output=json" returned: 0 in 0.169s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:20:05 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-7da76c05-26a3-4c90-8e72-94f8b9462e61 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b,backing_fmt=raw /opt/stack/data/nova/instances/44afd1bf-fa5c-4b3e-8752-b16853fef54e/disk.rescue {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:20:05 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-7da76c05-26a3-4c90-8e72-94f8b9462e61 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b,backing_fmt=raw /opt/stack/data/nova/instances/44afd1bf-fa5c-4b3e-8752-b16853fef54e/disk.rescue" returned: 0 in 0.052s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:20:05 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-7da76c05-26a3-4c90-8e72-94f8b9462e61 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Lock "383812ff437283e0191ed5b9ecc04c27f1162b0b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.228s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:20:05 user nova-compute[72382]: DEBUG nova.objects.instance [None req-7da76c05-26a3-4c90-8e72-94f8b9462e61 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Lazy-loading 'migration_context' on Instance uuid 44afd1bf-fa5c-4b3e-8752-b16853fef54e {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:20:05 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-7da76c05-26a3-4c90-8e72-94f8b9462e61 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] [instance: 44afd1bf-fa5c-4b3e-8752-b16853fef54e] Created local disks {{(pid=72382) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 15:20:05 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-7da76c05-26a3-4c90-8e72-94f8b9462e61 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] [instance: 44afd1bf-fa5c-4b3e-8752-b16853fef54e] Start _get_guest_xml network_info=[{"id": "2a1d4c60-bc2a-4530-b3bd-2a12ae2d2098", "address": "fa:16:3e:6c:50:29", "network": {"id": "46ef00c7-17ee-4e45-ba1d-dcc0a417ea85", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1360012261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1360012261-network", "vif_mac": "fa:16:3e:6c:50:29"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "990ba791030940d38360af5879c853c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a1d4c60-bc", "ovs_interfaceid": "2a1d4c60-bc2a-4530-b3bd-2a12ae2d2098", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T15:11:25Z,direct_url=<?>,disk_format='qcow2',id=a79f2cea-eb27-4631-aaf3-05e7d9e411b4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a638990e12cc4d6eabb6d55e13be6bdf',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T15:11:27Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'a79f2cea-eb27-4631-aaf3-05e7d9e411b4', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=72382) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 15:20:05 user nova-compute[72382]: DEBUG nova.objects.instance [None req-7da76c05-26a3-4c90-8e72-94f8b9462e61 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Lazy-loading 'resources' on Instance uuid 44afd1bf-fa5c-4b3e-8752-b16853fef54e {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:20:05 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/777e49ea-b674-4c3f-9cdd-ac2113032632/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:20:05 user nova-compute[72382]: DEBUG nova.objects.instance [None req-7da76c05-26a3-4c90-8e72-94f8b9462e61 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Lazy-loading 'numa_topology' on Instance uuid 44afd1bf-fa5c-4b3e-8752-b16853fef54e {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:20:05 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44afd1bf-fa5c-4b3e-8752-b16853fef54e/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:20:05 user nova-compute[72382]: WARNING nova.virt.libvirt.driver [None req-7da76c05-26a3-4c90-8e72-94f8b9462e61 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 15:20:05 user nova-compute[72382]: WARNING nova.virt.libvirt.driver [None req-7da76c05-26a3-4c90-8e72-94f8b9462e61 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 15:20:05 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-7da76c05-26a3-4c90-8e72-94f8b9462e61 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72382) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 15:20:05 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-7da76c05-26a3-4c90-8e72-94f8b9462e61 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] CPU controller missing on host. {{(pid=72382) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 15:20:05 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-7da76c05-26a3-4c90-8e72-94f8b9462e61 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72382) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 15:20:05 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-7da76c05-26a3-4c90-8e72-94f8b9462e61 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] CPU controller found on host. {{(pid=72382) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 15:20:05 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-7da76c05-26a3-4c90-8e72-94f8b9462e61 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72382) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 15:20:05 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-7da76c05-26a3-4c90-8e72-94f8b9462e61 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T15:11:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T15:11:25Z,direct_url=<?>,disk_format='qcow2',id=a79f2cea-eb27-4631-aaf3-05e7d9e411b4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a638990e12cc4d6eabb6d55e13be6bdf',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T15:11:27Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 15:20:05 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-7da76c05-26a3-4c90-8e72-94f8b9462e61 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Flavor limits 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 15:20:05 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-7da76c05-26a3-4c90-8e72-94f8b9462e61 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Image limits 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 15:20:05 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-7da76c05-26a3-4c90-8e72-94f8b9462e61 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Flavor pref 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 15:20:05 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-7da76c05-26a3-4c90-8e72-94f8b9462e61 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Image pref 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 15:20:05 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-7da76c05-26a3-4c90-8e72-94f8b9462e61 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 15:20:05 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-7da76c05-26a3-4c90-8e72-94f8b9462e61 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 15:20:05 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-7da76c05-26a3-4c90-8e72-94f8b9462e61 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72382) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 15:20:05 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-7da76c05-26a3-4c90-8e72-94f8b9462e61 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Got 1 possible topologies {{(pid=72382) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 15:20:05 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-7da76c05-26a3-4c90-8e72-94f8b9462e61 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 15:20:05 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-7da76c05-26a3-4c90-8e72-94f8b9462e61 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 15:20:05 user nova-compute[72382]: DEBUG nova.objects.instance [None req-7da76c05-26a3-4c90-8e72-94f8b9462e61 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Lazy-loading 'vcpu_model' on Instance uuid 44afd1bf-fa5c-4b3e-8752-b16853fef54e {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:20:05 user nova-compute[72382]: DEBUG nova.virt.libvirt.vif [None req-7da76c05-26a3-4c90-8e72-94f8b9462e61 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T15:15:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-201849157',display_name='tempest-ServerRescueNegativeTestJSON-server-201849157',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-201849157',id=3,image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-09T15:15:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='990ba791030940d38360af5879c853c5',ramdisk_id='',reservation_id='r-fqm5h5sw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-867522113',owner_user_name='tempest-ServerRescueNegativeTestJSON-867522113-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T15:15:36Z,user_data=None,user_id='f94ca386a2be42cfbc2407bb7520cd25',uuid=44afd1bf-fa5c-4b3e-8752-b16853fef54e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2a1d4c60-bc2a-4530-b3bd-2a12ae2d2098", "address": "fa:16:3e:6c:50:29", "network": {"id": "46ef00c7-17ee-4e45-ba1d-dcc0a417ea85", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1360012261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1360012261-network", "vif_mac": "fa:16:3e:6c:50:29"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "990ba791030940d38360af5879c853c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a1d4c60-bc", "ovs_interfaceid": "2a1d4c60-bc2a-4530-b3bd-2a12ae2d2098", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72382) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 15:20:05 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-7da76c05-26a3-4c90-8e72-94f8b9462e61 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Converting VIF {"id": "2a1d4c60-bc2a-4530-b3bd-2a12ae2d2098", "address": "fa:16:3e:6c:50:29", "network": {"id": "46ef00c7-17ee-4e45-ba1d-dcc0a417ea85", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1360012261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1360012261-network", "vif_mac": "fa:16:3e:6c:50:29"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "990ba791030940d38360af5879c853c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a1d4c60-bc", "ovs_interfaceid": "2a1d4c60-bc2a-4530-b3bd-2a12ae2d2098", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 15:20:05 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-7da76c05-26a3-4c90-8e72-94f8b9462e61 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6c:50:29,bridge_name='br-int',has_traffic_filtering=True,id=2a1d4c60-bc2a-4530-b3bd-2a12ae2d2098,network=Network(46ef00c7-17ee-4e45-ba1d-dcc0a417ea85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a1d4c60-bc') {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 15:20:05 user nova-compute[72382]: DEBUG nova.objects.instance [None req-7da76c05-26a3-4c90-8e72-94f8b9462e61 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Lazy-loading 'pci_devices' on Instance uuid 44afd1bf-fa5c-4b3e-8752-b16853fef54e {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:20:05 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-7da76c05-26a3-4c90-8e72-94f8b9462e61 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] [instance: 44afd1bf-fa5c-4b3e-8752-b16853fef54e] End _get_guest_xml xml=<domain type="kvm">
Aug 09 15:20:05 user nova-compute[72382]:   <uuid>44afd1bf-fa5c-4b3e-8752-b16853fef54e</uuid>
Aug 09 15:20:05 user nova-compute[72382]:   <name>instance-00000003</name>
Aug 09 15:20:05 user nova-compute[72382]:   <memory>524288</memory>
Aug 09 15:20:05 user nova-compute[72382]:   <vcpu>1</vcpu>
Aug 09 15:20:05 user nova-compute[72382]:   <metadata>
Aug 09 15:20:05 user nova-compute[72382]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 15:20:05 user nova-compute[72382]:       <nova:package version="0.0.0"/>
Aug 09 15:20:05 user nova-compute[72382]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-201849157</nova:name>
Aug 09 15:20:05 user nova-compute[72382]:       <nova:creationTime>2023-08-09 15:20:05</nova:creationTime>
Aug 09 15:20:05 user nova-compute[72382]:       <nova:flavor name="m1.tiny">
Aug 09 15:20:05 user nova-compute[72382]:         <nova:memory>512</nova:memory>
Aug 09 15:20:05 user nova-compute[72382]:         <nova:disk>1</nova:disk>
Aug 09 15:20:05 user nova-compute[72382]:         <nova:swap>0</nova:swap>
Aug 09 15:20:05 user nova-compute[72382]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 15:20:05 user nova-compute[72382]:         <nova:vcpus>1</nova:vcpus>
Aug 09 15:20:05 user nova-compute[72382]:       </nova:flavor>
Aug 09 15:20:05 user nova-compute[72382]:       <nova:owner>
Aug 09 15:20:05 user nova-compute[72382]:         <nova:user uuid="f94ca386a2be42cfbc2407bb7520cd25">tempest-ServerRescueNegativeTestJSON-867522113-project-member</nova:user>
Aug 09 15:20:05 user nova-compute[72382]:         <nova:project uuid="990ba791030940d38360af5879c853c5">tempest-ServerRescueNegativeTestJSON-867522113</nova:project>
Aug 09 15:20:05 user nova-compute[72382]:       </nova:owner>
Aug 09 15:20:05 user nova-compute[72382]:       <nova:root type="image" uuid="a79f2cea-eb27-4631-aaf3-05e7d9e411b4"/>
Aug 09 15:20:05 user nova-compute[72382]:       <nova:ports>
Aug 09 15:20:05 user nova-compute[72382]:         <nova:port uuid="2a1d4c60-bc2a-4530-b3bd-2a12ae2d2098">
Aug 09 15:20:05 user nova-compute[72382]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 09 15:20:05 user nova-compute[72382]:         </nova:port>
Aug 09 15:20:05 user nova-compute[72382]:       </nova:ports>
Aug 09 15:20:05 user nova-compute[72382]:     </nova:instance>
Aug 09 15:20:05 user nova-compute[72382]:   </metadata>
Aug 09 15:20:05 user nova-compute[72382]:   <sysinfo type="smbios">
Aug 09 15:20:05 user nova-compute[72382]:     <system>
Aug 09 15:20:05 user nova-compute[72382]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 15:20:05 user nova-compute[72382]:       <entry name="product">OpenStack Nova</entry>
Aug 09 15:20:05 user nova-compute[72382]:       <entry name="version">0.0.0</entry>
Aug 09 15:20:05 user nova-compute[72382]:       <entry name="serial">44afd1bf-fa5c-4b3e-8752-b16853fef54e</entry>
Aug 09 15:20:05 user nova-compute[72382]:       <entry name="uuid">44afd1bf-fa5c-4b3e-8752-b16853fef54e</entry>
Aug 09 15:20:05 user nova-compute[72382]:       <entry name="family">Virtual Machine</entry>
Aug 09 15:20:05 user nova-compute[72382]:     </system>
Aug 09 15:20:05 user nova-compute[72382]:   </sysinfo>
Aug 09 15:20:05 user nova-compute[72382]:   <os>
Aug 09 15:20:05 user nova-compute[72382]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 15:20:05 user nova-compute[72382]:     <smbios mode="sysinfo"/>
Aug 09 15:20:05 user nova-compute[72382]:   </os>
Aug 09 15:20:05 user nova-compute[72382]:   <features>
Aug 09 15:20:05 user nova-compute[72382]:     <acpi/>
Aug 09 15:20:05 user nova-compute[72382]:     <apic/>
Aug 09 15:20:05 user nova-compute[72382]:     <vmcoreinfo/>
Aug 09 15:20:05 user nova-compute[72382]:   </features>
Aug 09 15:20:05 user nova-compute[72382]:   <clock offset="utc">
Aug 09 15:20:05 user nova-compute[72382]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 15:20:05 user nova-compute[72382]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 15:20:05 user nova-compute[72382]:     <timer name="hpet" present="no"/>
Aug 09 15:20:05 user nova-compute[72382]:   </clock>
Aug 09 15:20:05 user nova-compute[72382]:   <cpu mode="custom" match="exact">
Aug 09 15:20:05 user nova-compute[72382]:     <model>Nehalem</model>
Aug 09 15:20:05 user nova-compute[72382]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 15:20:05 user nova-compute[72382]:   </cpu>
Aug 09 15:20:05 user nova-compute[72382]:   <devices>
Aug 09 15:20:05 user nova-compute[72382]:     <disk type="file" device="disk">
Aug 09 15:20:05 user nova-compute[72382]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 15:20:05 user nova-compute[72382]:       <source file="/opt/stack/data/nova/instances/44afd1bf-fa5c-4b3e-8752-b16853fef54e/disk.rescue"/>
Aug 09 15:20:05 user nova-compute[72382]:       <target dev="vda" bus="virtio"/>
Aug 09 15:20:05 user nova-compute[72382]:     </disk>
Aug 09 15:20:05 user nova-compute[72382]:     <disk type="file" device="disk">
Aug 09 15:20:05 user nova-compute[72382]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 15:20:05 user nova-compute[72382]:       <source file="/opt/stack/data/nova/instances/44afd1bf-fa5c-4b3e-8752-b16853fef54e/disk"/>
Aug 09 15:20:05 user nova-compute[72382]:       <target dev="vdb" bus="virtio"/>
Aug 09 15:20:05 user nova-compute[72382]:     </disk>
Aug 09 15:20:05 user nova-compute[72382]:     <interface type="ethernet">
Aug 09 15:20:05 user nova-compute[72382]:       <mac address="fa:16:3e:6c:50:29"/>
Aug 09 15:20:05 user nova-compute[72382]:       <model type="virtio"/>
Aug 09 15:20:05 user nova-compute[72382]:       <mtu size="1442"/>
Aug 09 15:20:05 user nova-compute[72382]:       <target dev="tap2a1d4c60-bc"/>
Aug 09 15:20:05 user nova-compute[72382]:     </interface>
Aug 09 15:20:05 user nova-compute[72382]:     <serial type="pty">
Aug 09 15:20:05 user nova-compute[72382]:       <log file="/opt/stack/data/nova/instances/44afd1bf-fa5c-4b3e-8752-b16853fef54e/console.log" append="off"/>
Aug 09 15:20:05 user nova-compute[72382]:     </serial>
Aug 09 15:20:05 user nova-compute[72382]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 15:20:05 user nova-compute[72382]:     <video>
Aug 09 15:20:05 user nova-compute[72382]:       <model type="virtio"/>
Aug 09 15:20:05 user nova-compute[72382]:     </video>
Aug 09 15:20:05 user nova-compute[72382]:     <rng model="virtio">
Aug 09 15:20:05 user nova-compute[72382]:       <backend model="random">/dev/urandom</backend>
Aug 09 15:20:05 user nova-compute[72382]:     </rng>
Aug 09 15:20:05 user nova-compute[72382]:     <controller type="usb" index="0" model="none"/>
Aug 09 15:20:05 user nova-compute[72382]:     <memballoon model="virtio">
Aug 09 15:20:05 user nova-compute[72382]:       <stats period="10"/>
Aug 09 15:20:05 user nova-compute[72382]:     </memballoon>
Aug 09 15:20:05 user nova-compute[72382]:   </devices>
Aug 09 15:20:05 user nova-compute[72382]: </domain>
Aug 09 15:20:05 user nova-compute[72382]:  {{(pid=72382) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 15:20:05 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44afd1bf-fa5c-4b3e-8752-b16853fef54e/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:20:05 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44afd1bf-fa5c-4b3e-8752-b16853fef54e/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:20:05 user nova-compute[72382]: INFO nova.virt.libvirt.driver [-] [instance: 44afd1bf-fa5c-4b3e-8752-b16853fef54e] Instance destroyed successfully.
Aug 09 15:20:05 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44afd1bf-fa5c-4b3e-8752-b16853fef54e/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:20:05 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-7da76c05-26a3-4c90-8e72-94f8b9462e61 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] No BDM found with device name vda, not building metadata. {{(pid=72382) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 15:20:05 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-7da76c05-26a3-4c90-8e72-94f8b9462e61 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72382) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 15:20:05 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-7da76c05-26a3-4c90-8e72-94f8b9462e61 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] No VIF found with MAC fa:16:3e:6c:50:29, not building metadata {{(pid=72382) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 15:20:05 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:20:05 user nova-compute[72382]: DEBUG nova.compute.manager [req-b904ee17-3620-4e06-97bf-944f98e1a7ce req-146ca645-d58c-41c7-8a32-633e736b2802 service nova] [instance: 44afd1bf-fa5c-4b3e-8752-b16853fef54e] Received event network-vif-unplugged-2a1d4c60-bc2a-4530-b3bd-2a12ae2d2098 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:20:05 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-b904ee17-3620-4e06-97bf-944f98e1a7ce req-146ca645-d58c-41c7-8a32-633e736b2802 service nova] Acquiring lock "44afd1bf-fa5c-4b3e-8752-b16853fef54e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:20:05 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-b904ee17-3620-4e06-97bf-944f98e1a7ce req-146ca645-d58c-41c7-8a32-633e736b2802 service nova] Lock "44afd1bf-fa5c-4b3e-8752-b16853fef54e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:20:05 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-b904ee17-3620-4e06-97bf-944f98e1a7ce req-146ca645-d58c-41c7-8a32-633e736b2802 service nova] Lock "44afd1bf-fa5c-4b3e-8752-b16853fef54e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.004s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:20:05 user nova-compute[72382]: DEBUG nova.compute.manager [req-b904ee17-3620-4e06-97bf-944f98e1a7ce req-146ca645-d58c-41c7-8a32-633e736b2802 service nova] [instance: 44afd1bf-fa5c-4b3e-8752-b16853fef54e] No waiting events found dispatching network-vif-unplugged-2a1d4c60-bc2a-4530-b3bd-2a12ae2d2098 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:20:05 user nova-compute[72382]: WARNING nova.compute.manager [req-b904ee17-3620-4e06-97bf-944f98e1a7ce req-146ca645-d58c-41c7-8a32-633e736b2802 service nova] [instance: 44afd1bf-fa5c-4b3e-8752-b16853fef54e] Received unexpected event network-vif-unplugged-2a1d4c60-bc2a-4530-b3bd-2a12ae2d2098 for instance with vm_state active and task_state rescuing.
Aug 09 15:20:05 user nova-compute[72382]: DEBUG nova.compute.manager [req-b904ee17-3620-4e06-97bf-944f98e1a7ce req-146ca645-d58c-41c7-8a32-633e736b2802 service nova] [instance: 44afd1bf-fa5c-4b3e-8752-b16853fef54e] Received event network-vif-plugged-2a1d4c60-bc2a-4530-b3bd-2a12ae2d2098 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:20:05 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-b904ee17-3620-4e06-97bf-944f98e1a7ce req-146ca645-d58c-41c7-8a32-633e736b2802 service nova] Acquiring lock "44afd1bf-fa5c-4b3e-8752-b16853fef54e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:20:05 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-b904ee17-3620-4e06-97bf-944f98e1a7ce req-146ca645-d58c-41c7-8a32-633e736b2802 service nova] Lock "44afd1bf-fa5c-4b3e-8752-b16853fef54e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:20:05 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-b904ee17-3620-4e06-97bf-944f98e1a7ce req-146ca645-d58c-41c7-8a32-633e736b2802 service nova] Lock "44afd1bf-fa5c-4b3e-8752-b16853fef54e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:20:05 user nova-compute[72382]: DEBUG nova.compute.manager [req-b904ee17-3620-4e06-97bf-944f98e1a7ce req-146ca645-d58c-41c7-8a32-633e736b2802 service nova] [instance: 44afd1bf-fa5c-4b3e-8752-b16853fef54e] No waiting events found dispatching network-vif-plugged-2a1d4c60-bc2a-4530-b3bd-2a12ae2d2098 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:20:05 user nova-compute[72382]: WARNING nova.compute.manager [req-b904ee17-3620-4e06-97bf-944f98e1a7ce req-146ca645-d58c-41c7-8a32-633e736b2802 service nova] [instance: 44afd1bf-fa5c-4b3e-8752-b16853fef54e] Received unexpected event network-vif-plugged-2a1d4c60-bc2a-4530-b3bd-2a12ae2d2098 for instance with vm_state active and task_state rescuing.
Aug 09 15:20:06 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:20:06 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:20:06 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:20:06 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:20:06 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:20:07 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72382) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 15:20:07 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f510d75-5d1e-4a5c-b38f-731c299f0f5a/disk.rescue --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:20:07 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:20:07 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:20:07 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:20:07 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:20:07 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f510d75-5d1e-4a5c-b38f-731c299f0f5a/disk.rescue --force-share --output=json" returned: 0 in 0.134s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:20:07 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f510d75-5d1e-4a5c-b38f-731c299f0f5a/disk.rescue --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:20:07 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:20:07 user nova-compute[72382]: DEBUG nova.compute.manager [req-a9dd951f-42c1-4618-9ce5-a34b4fdc4d69 req-5517df50-4a3a-49e6-9c4d-b4ee5f99aae4 service nova] [instance: 0f510d75-5d1e-4a5c-b38f-731c299f0f5a] Received event network-vif-plugged-c67a8d45-c4ba-4302-940f-c05799ecc732 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:20:07 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-a9dd951f-42c1-4618-9ce5-a34b4fdc4d69 req-5517df50-4a3a-49e6-9c4d-b4ee5f99aae4 service nova] Acquiring lock "0f510d75-5d1e-4a5c-b38f-731c299f0f5a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:20:07 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-a9dd951f-42c1-4618-9ce5-a34b4fdc4d69 req-5517df50-4a3a-49e6-9c4d-b4ee5f99aae4 service nova] Lock "0f510d75-5d1e-4a5c-b38f-731c299f0f5a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:20:07 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-a9dd951f-42c1-4618-9ce5-a34b4fdc4d69 req-5517df50-4a3a-49e6-9c4d-b4ee5f99aae4 service nova] Lock "0f510d75-5d1e-4a5c-b38f-731c299f0f5a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:20:07 user nova-compute[72382]: DEBUG nova.compute.manager [req-a9dd951f-42c1-4618-9ce5-a34b4fdc4d69 req-5517df50-4a3a-49e6-9c4d-b4ee5f99aae4 service nova] [instance: 0f510d75-5d1e-4a5c-b38f-731c299f0f5a] No waiting events found dispatching network-vif-plugged-c67a8d45-c4ba-4302-940f-c05799ecc732 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:20:07 user nova-compute[72382]: WARNING nova.compute.manager [req-a9dd951f-42c1-4618-9ce5-a34b4fdc4d69 req-5517df50-4a3a-49e6-9c4d-b4ee5f99aae4 service nova] [instance: 0f510d75-5d1e-4a5c-b38f-731c299f0f5a] Received unexpected event network-vif-plugged-c67a8d45-c4ba-4302-940f-c05799ecc732 for instance with vm_state active and task_state rescuing.
Aug 09 15:20:07 user nova-compute[72382]: DEBUG nova.compute.manager [req-a9dd951f-42c1-4618-9ce5-a34b4fdc4d69 req-5517df50-4a3a-49e6-9c4d-b4ee5f99aae4 service nova] [instance: 0f510d75-5d1e-4a5c-b38f-731c299f0f5a] Received event network-vif-plugged-c67a8d45-c4ba-4302-940f-c05799ecc732 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:20:07 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-a9dd951f-42c1-4618-9ce5-a34b4fdc4d69 req-5517df50-4a3a-49e6-9c4d-b4ee5f99aae4 service nova] Acquiring lock "0f510d75-5d1e-4a5c-b38f-731c299f0f5a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:20:07 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-a9dd951f-42c1-4618-9ce5-a34b4fdc4d69 req-5517df50-4a3a-49e6-9c4d-b4ee5f99aae4 service nova] Lock "0f510d75-5d1e-4a5c-b38f-731c299f0f5a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:20:07 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-a9dd951f-42c1-4618-9ce5-a34b4fdc4d69 req-5517df50-4a3a-49e6-9c4d-b4ee5f99aae4 service nova] Lock "0f510d75-5d1e-4a5c-b38f-731c299f0f5a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:20:07 user nova-compute[72382]: DEBUG nova.compute.manager [req-a9dd951f-42c1-4618-9ce5-a34b4fdc4d69 req-5517df50-4a3a-49e6-9c4d-b4ee5f99aae4 service nova] [instance: 0f510d75-5d1e-4a5c-b38f-731c299f0f5a] No waiting events found dispatching network-vif-plugged-c67a8d45-c4ba-4302-940f-c05799ecc732 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:20:07 user nova-compute[72382]: WARNING nova.compute.manager [req-a9dd951f-42c1-4618-9ce5-a34b4fdc4d69 req-5517df50-4a3a-49e6-9c4d-b4ee5f99aae4 service nova] [instance: 0f510d75-5d1e-4a5c-b38f-731c299f0f5a] Received unexpected event network-vif-plugged-c67a8d45-c4ba-4302-940f-c05799ecc732 for instance with vm_state active and task_state rescuing.
Aug 09 15:20:07 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f510d75-5d1e-4a5c-b38f-731c299f0f5a/disk.rescue --force-share --output=json" returned: 0 in 0.145s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:20:07 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9766433-4c5a-40ed-a212-715a24f42b91/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:20:08 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:20:08 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9766433-4c5a-40ed-a212-715a24f42b91/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:20:08 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9766433-4c5a-40ed-a212-715a24f42b91/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:20:08 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9766433-4c5a-40ed-a212-715a24f42b91/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:20:08 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72382) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 15:20:08 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8aa35482-60b8-4185-b14d-a2667fd3b5b7/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:20:08 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8aa35482-60b8-4185-b14d-a2667fd3b5b7/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:20:08 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8aa35482-60b8-4185-b14d-a2667fd3b5b7/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:20:08 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8aa35482-60b8-4185-b14d-a2667fd3b5b7/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:20:08 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5aa7e23-9c2c-400e-a615-5839858749e1/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:20:08 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5aa7e23-9c2c-400e-a615-5839858749e1/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:20:08 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5aa7e23-9c2c-400e-a615-5839858749e1/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:20:08 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5aa7e23-9c2c-400e-a615-5839858749e1/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:20:08 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:20:10 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:20:10 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Removed pending event for 0f510d75-5d1e-4a5c-b38f-731c299f0f5a due to event {{(pid=72382) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 09 15:20:10 user nova-compute[72382]: DEBUG nova.virt.driver [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Emitting event <LifecycleEvent: 1691594409.6445034, 0f510d75-5d1e-4a5c-b38f-731c299f0f5a => Resumed> {{(pid=72382) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 15:20:10 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 0f510d75-5d1e-4a5c-b38f-731c299f0f5a] VM Resumed (Lifecycle Event)
Aug 09 15:20:10 user nova-compute[72382]: DEBUG nova.compute.manager [req-48e6a345-faac-49de-9978-6501ffb690f4 req-2b51b639-6651-4ac1-b578-5f27126b72c8 service nova] [instance: 44afd1bf-fa5c-4b3e-8752-b16853fef54e] Received event network-vif-plugged-2a1d4c60-bc2a-4530-b3bd-2a12ae2d2098 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:20:10 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-48e6a345-faac-49de-9978-6501ffb690f4 req-2b51b639-6651-4ac1-b578-5f27126b72c8 service nova] Acquiring lock "44afd1bf-fa5c-4b3e-8752-b16853fef54e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:20:10 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-48e6a345-faac-49de-9978-6501ffb690f4 req-2b51b639-6651-4ac1-b578-5f27126b72c8 service nova] Lock "44afd1bf-fa5c-4b3e-8752-b16853fef54e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:20:10 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-48e6a345-faac-49de-9978-6501ffb690f4 req-2b51b639-6651-4ac1-b578-5f27126b72c8 service nova] Lock "44afd1bf-fa5c-4b3e-8752-b16853fef54e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:20:10 user nova-compute[72382]: DEBUG nova.compute.manager [req-48e6a345-faac-49de-9978-6501ffb690f4 req-2b51b639-6651-4ac1-b578-5f27126b72c8 service nova] [instance: 44afd1bf-fa5c-4b3e-8752-b16853fef54e] No waiting events found dispatching network-vif-plugged-2a1d4c60-bc2a-4530-b3bd-2a12ae2d2098 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:20:10 user nova-compute[72382]: WARNING nova.compute.manager [req-48e6a345-faac-49de-9978-6501ffb690f4 req-2b51b639-6651-4ac1-b578-5f27126b72c8 service nova] [instance: 44afd1bf-fa5c-4b3e-8752-b16853fef54e] Received unexpected event network-vif-plugged-2a1d4c60-bc2a-4530-b3bd-2a12ae2d2098 for instance with vm_state active and task_state rescuing.
Aug 09 15:20:10 user nova-compute[72382]: DEBUG nova.compute.manager [req-48e6a345-faac-49de-9978-6501ffb690f4 req-2b51b639-6651-4ac1-b578-5f27126b72c8 service nova] [instance: 44afd1bf-fa5c-4b3e-8752-b16853fef54e] Received event network-vif-plugged-2a1d4c60-bc2a-4530-b3bd-2a12ae2d2098 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:20:10 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-48e6a345-faac-49de-9978-6501ffb690f4 req-2b51b639-6651-4ac1-b578-5f27126b72c8 service nova] Acquiring lock "44afd1bf-fa5c-4b3e-8752-b16853fef54e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:20:10 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-48e6a345-faac-49de-9978-6501ffb690f4 req-2b51b639-6651-4ac1-b578-5f27126b72c8 service nova] Lock "44afd1bf-fa5c-4b3e-8752-b16853fef54e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:20:10 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-48e6a345-faac-49de-9978-6501ffb690f4 req-2b51b639-6651-4ac1-b578-5f27126b72c8 service nova] Lock "44afd1bf-fa5c-4b3e-8752-b16853fef54e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:20:10 user nova-compute[72382]: DEBUG nova.compute.manager [req-48e6a345-faac-49de-9978-6501ffb690f4 req-2b51b639-6651-4ac1-b578-5f27126b72c8 service nova] [instance: 44afd1bf-fa5c-4b3e-8752-b16853fef54e] No waiting events found dispatching network-vif-plugged-2a1d4c60-bc2a-4530-b3bd-2a12ae2d2098 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:20:10 user nova-compute[72382]: WARNING nova.compute.manager [req-48e6a345-faac-49de-9978-6501ffb690f4 req-2b51b639-6651-4ac1-b578-5f27126b72c8 service nova] [instance: 44afd1bf-fa5c-4b3e-8752-b16853fef54e] Received unexpected event network-vif-plugged-2a1d4c60-bc2a-4530-b3bd-2a12ae2d2098 for instance with vm_state active and task_state rescuing.
Aug 09 15:20:10 user nova-compute[72382]: DEBUG nova.compute.manager [None req-641e18dd-d0f1-44b8-b5f2-8db6448c2d8a tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] [instance: 0f510d75-5d1e-4a5c-b38f-731c299f0f5a] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:20:10 user nova-compute[72382]: DEBUG nova.compute.manager [None req-7da76c05-26a3-4c90-8e72-94f8b9462e61 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] [instance: 44afd1bf-fa5c-4b3e-8752-b16853fef54e] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:20:10 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 0f510d75-5d1e-4a5c-b38f-731c299f0f5a] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:20:10 user nova-compute[72382]: WARNING nova.virt.libvirt.driver [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 15:20:10 user nova-compute[72382]: WARNING nova.virt.libvirt.driver [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 15:20:10 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Hypervisor/Node resource view: name=user free_ram=7428MB free_disk=25.579425811767578GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72382) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 15:20:10 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:20:10 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:20:10 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 0f510d75-5d1e-4a5c-b38f-731c299f0f5a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72382) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 15:20:10 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 0f510d75-5d1e-4a5c-b38f-731c299f0f5a] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 09 15:20:10 user nova-compute[72382]: DEBUG nova.virt.driver [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Emitting event <LifecycleEvent: 1691594409.6455228, 0f510d75-5d1e-4a5c-b38f-731c299f0f5a => Started> {{(pid=72382) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 15:20:10 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 0f510d75-5d1e-4a5c-b38f-731c299f0f5a] VM Started (Lifecycle Event)
Aug 09 15:20:10 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 0f510d75-5d1e-4a5c-b38f-731c299f0f5a] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:20:10 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 0f510d75-5d1e-4a5c-b38f-731c299f0f5a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72382) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 15:20:10 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Removed pending event for 44afd1bf-fa5c-4b3e-8752-b16853fef54e due to event {{(pid=72382) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 09 15:20:10 user nova-compute[72382]: DEBUG nova.virt.driver [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Emitting event <LifecycleEvent: 1691594410.1061947, 44afd1bf-fa5c-4b3e-8752-b16853fef54e => Resumed> {{(pid=72382) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 15:20:10 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 44afd1bf-fa5c-4b3e-8752-b16853fef54e] VM Resumed (Lifecycle Event)
Aug 09 15:20:10 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Applying migration context for instance c9766433-4c5a-40ed-a212-715a24f42b91 as it has an incoming, in-progress migration 9c66c3cd-1944-431d-8434-648b9448178d. Migration status is finished {{(pid=72382) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 09 15:20:10 user nova-compute[72382]: INFO nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] [instance: c9766433-4c5a-40ed-a212-715a24f42b91] Updating resource usage from migration 9c66c3cd-1944-431d-8434-648b9448178d
Aug 09 15:20:10 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 44afd1bf-fa5c-4b3e-8752-b16853fef54e] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:20:10 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 44afd1bf-fa5c-4b3e-8752-b16853fef54e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72382) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 15:20:10 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance f780040f-b789-4b72-8986-813c7b9fe4a6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:20:10 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance 777e49ea-b674-4c3f-9cdd-ac2113032632 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:20:10 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance 44afd1bf-fa5c-4b3e-8752-b16853fef54e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:20:10 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance 266be814-4a2b-4f8e-a0f6-e8821fdeb95d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:20:10 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance a33515b3-3ef4-4f76-a8d8-e7008b5bbb79 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:20:10 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance b5aa7e23-9c2c-400e-a615-5839858749e1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:20:10 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance 0f510d75-5d1e-4a5c-b38f-731c299f0f5a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:20:10 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance ea6afcf7-0b8b-43d8-af1d-9c132a659711 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:20:10 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance 8aa35482-60b8-4185-b14d-a2667fd3b5b7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:20:10 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Migration 9c66c3cd-1944-431d-8434-648b9448178d is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 09 15:20:10 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance c9766433-4c5a-40ed-a212-715a24f42b91 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:20:10 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=72382) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 15:20:10 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=29GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=72382) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 15:20:10 user nova-compute[72382]: DEBUG nova.virt.driver [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Emitting event <LifecycleEvent: 1691594410.1065092, 44afd1bf-fa5c-4b3e-8752-b16853fef54e => Started> {{(pid=72382) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 15:20:10 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 44afd1bf-fa5c-4b3e-8752-b16853fef54e] VM Started (Lifecycle Event)
Aug 09 15:20:10 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 44afd1bf-fa5c-4b3e-8752-b16853fef54e] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:20:10 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 44afd1bf-fa5c-4b3e-8752-b16853fef54e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72382) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 15:20:11 user nova-compute[72382]: DEBUG nova.compute.provider_tree [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Inventory has not changed in ProviderTree for provider: 7b15b0e5-df4d-49db-833b-2855d21d10ae {{(pid=72382) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 15:20:11 user nova-compute[72382]: DEBUG nova.scheduler.client.report [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Inventory has not changed for provider 7b15b0e5-df4d-49db-833b-2855d21d10ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72382) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 15:20:11 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Compute_service record updated for user:user {{(pid=72382) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 15:20:11 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.717s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:20:12 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:20:13 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:20:13 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:20:13 user nova-compute[72382]: DEBUG nova.compute.manager [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Starting heal instance info cache {{(pid=72382) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 15:20:13 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Acquiring lock "refresh_cache-c9766433-4c5a-40ed-a212-715a24f42b91" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 15:20:13 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Acquired lock "refresh_cache-c9766433-4c5a-40ed-a212-715a24f42b91" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 15:20:13 user nova-compute[72382]: DEBUG nova.network.neutron [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] [instance: c9766433-4c5a-40ed-a212-715a24f42b91] Forcefully refreshing network info cache for instance {{(pid=72382) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 15:20:13 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:20:14 user nova-compute[72382]: DEBUG nova.network.neutron [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] [instance: c9766433-4c5a-40ed-a212-715a24f42b91] Updating instance_info_cache with network_info: [{"id": "599dae3b-13bb-47af-b889-0037e03d5e31", "address": "fa:16:3e:66:9f:0b", "network": {"id": "63303ac8-d370-4386-a6bc-576677b64740", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1379220233-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f45d010dd474c92a6b24bf977564ad1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap599dae3b-13", "ovs_interfaceid": "599dae3b-13bb-47af-b889-0037e03d5e31", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:20:14 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Releasing lock "refresh_cache-c9766433-4c5a-40ed-a212-715a24f42b91" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 15:20:14 user nova-compute[72382]: DEBUG nova.compute.manager [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] [instance: c9766433-4c5a-40ed-a212-715a24f42b91] Updated the network info_cache for instance {{(pid=72382) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 15:20:14 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:20:14 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:20:14 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:20:14 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:20:14 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:20:14 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:20:14 user nova-compute[72382]: DEBUG nova.compute.manager [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72382) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 15:20:17 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:20:19 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] Acquiring lock "cff2fb57-7d0b-4278-89ed-10a8ec5128ea" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:20:19 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] Lock "cff2fb57-7d0b-4278-89ed-10a8ec5128ea" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:20:19 user nova-compute[72382]: DEBUG nova.compute.manager [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] [instance: cff2fb57-7d0b-4278-89ed-10a8ec5128ea] Starting instance... {{(pid=72382) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 15:20:19 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:20:19 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:20:19 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72382) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 15:20:19 user nova-compute[72382]: INFO nova.compute.claims [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] [instance: cff2fb57-7d0b-4278-89ed-10a8ec5128ea] Claim successful on node user
Aug 09 15:20:20 user nova-compute[72382]: DEBUG nova.compute.provider_tree [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] Inventory has not changed in ProviderTree for provider: 7b15b0e5-df4d-49db-833b-2855d21d10ae {{(pid=72382) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 15:20:20 user nova-compute[72382]: DEBUG nova.scheduler.client.report [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] Inventory has not changed for provider 7b15b0e5-df4d-49db-833b-2855d21d10ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72382) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 15:20:20 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.786s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:20:20 user nova-compute[72382]: DEBUG nova.compute.manager [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] [instance: cff2fb57-7d0b-4278-89ed-10a8ec5128ea] Start building networks asynchronously for instance. {{(pid=72382) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 15:20:20 user nova-compute[72382]: DEBUG nova.compute.manager [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] [instance: cff2fb57-7d0b-4278-89ed-10a8ec5128ea] Allocating IP information in the background. {{(pid=72382) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 15:20:20 user nova-compute[72382]: DEBUG nova.network.neutron [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] [instance: cff2fb57-7d0b-4278-89ed-10a8ec5128ea] allocate_for_instance() {{(pid=72382) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 15:20:20 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] [instance: cff2fb57-7d0b-4278-89ed-10a8ec5128ea] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 15:20:20 user nova-compute[72382]: DEBUG nova.compute.manager [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] [instance: cff2fb57-7d0b-4278-89ed-10a8ec5128ea] Start building block device mappings for instance. {{(pid=72382) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 15:20:20 user nova-compute[72382]: INFO nova.virt.block_device [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] [instance: cff2fb57-7d0b-4278-89ed-10a8ec5128ea] Booting with volume e8bad821-ddd1-4287-806d-78ffdc34fa68 at /dev/vda
Aug 09 15:20:20 user nova-compute[72382]: DEBUG os_brick.utils [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 15:20:20 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:20:20 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:20:20 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3ae409d-3b4e-4d96-97ff-b30997c0840d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d2cfa7015fe\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:20:20 user nova-compute[72382]: DEBUG nova.policy [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '551eba2d528148b4b3b266f3dfb4a190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42fe649aa7cd43678bd4f2cb24f45e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72382) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 15:20:20 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:20:21 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.024s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:20:21 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[b79b4ba1-063b-4669-ac0c-2e5bc919b0f6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:20:21 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:20:21 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.027s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:20:21 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[7de53b60-a31f-44cf-903a-a2312fcb324c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:20:21 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e9ec487-a628-4c39-9513-17b16cdceb52]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:20:21 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] Running cmd (subprocess): nvme version {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:20:21 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] 'nvme version' failed. Not Retrying. {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 15:20:21 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.nvmeof [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] nvme not present on system {{(pid=72382) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 15:20:21 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:20:21 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 15:20:21 user nova-compute[72382]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 15:20:21 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7f8b710-683f-4cc5-8f75-777aa475ed7d]: (4, '') {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:20:21 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.lightos [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72382) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 15:20:21 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.lightos [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72382) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 15:20:21 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.lightos [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] LIGHTOS: no hostnqn found. {{(pid=72382) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 15:20:21 user nova-compute[72382]: DEBUG os_brick.utils [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] <== get_connector_properties: return (186ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d2cfa7015fe', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 15:20:21 user nova-compute[72382]: DEBUG nova.virt.block_device [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] [instance: cff2fb57-7d0b-4278-89ed-10a8ec5128ea] Updating existing volume attachment record: ba2ab33b-230b-4f12-a019-79f141c5235e {{(pid=72382) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 15:20:22 user nova-compute[72382]: DEBUG nova.network.neutron [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] [instance: cff2fb57-7d0b-4278-89ed-10a8ec5128ea] Successfully created port: 477e93e2-c6aa-47e7-bed7-62b4bb29a9ea {{(pid=72382) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 15:20:22 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-c623fd1c-4ab1-4838-9b39-373d181c1c82 tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] Acquiring lock "b5aa7e23-9c2c-400e-a615-5839858749e1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:20:22 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-c623fd1c-4ab1-4838-9b39-373d181c1c82 tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] Lock "b5aa7e23-9c2c-400e-a615-5839858749e1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:20:22 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-c623fd1c-4ab1-4838-9b39-373d181c1c82 tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] Acquiring lock "b5aa7e23-9c2c-400e-a615-5839858749e1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:20:22 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-c623fd1c-4ab1-4838-9b39-373d181c1c82 tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] Lock "b5aa7e23-9c2c-400e-a615-5839858749e1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:20:22 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-c623fd1c-4ab1-4838-9b39-373d181c1c82 tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] Lock "b5aa7e23-9c2c-400e-a615-5839858749e1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:20:22 user nova-compute[72382]: INFO nova.compute.manager [None req-c623fd1c-4ab1-4838-9b39-373d181c1c82 tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] [instance: b5aa7e23-9c2c-400e-a615-5839858749e1] Terminating instance
Aug 09 15:20:22 user nova-compute[72382]: DEBUG nova.compute.manager [None req-c623fd1c-4ab1-4838-9b39-373d181c1c82 tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] [instance: b5aa7e23-9c2c-400e-a615-5839858749e1] Start destroying the instance on the hypervisor. {{(pid=72382) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 15:20:22 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:20:22 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:20:22 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:20:22 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:20:23 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:20:23 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:20:23 user nova-compute[72382]: DEBUG nova.compute.manager [req-6434111e-7132-4feb-9008-534b3989cac7 req-3300a58d-1a7c-411c-bab1-e9c73304d506 service nova] [instance: b5aa7e23-9c2c-400e-a615-5839858749e1] Received event network-vif-unplugged-0d38f117-6eb0-4627-bc39-8bfd3ed800f6 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:20:23 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-6434111e-7132-4feb-9008-534b3989cac7 req-3300a58d-1a7c-411c-bab1-e9c73304d506 service nova] Acquiring lock "b5aa7e23-9c2c-400e-a615-5839858749e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:20:23 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-6434111e-7132-4feb-9008-534b3989cac7 req-3300a58d-1a7c-411c-bab1-e9c73304d506 service nova] Lock "b5aa7e23-9c2c-400e-a615-5839858749e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:20:23 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-6434111e-7132-4feb-9008-534b3989cac7 req-3300a58d-1a7c-411c-bab1-e9c73304d506 service nova] Lock "b5aa7e23-9c2c-400e-a615-5839858749e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:20:23 user nova-compute[72382]: DEBUG nova.compute.manager [req-6434111e-7132-4feb-9008-534b3989cac7 req-3300a58d-1a7c-411c-bab1-e9c73304d506 service nova] [instance: b5aa7e23-9c2c-400e-a615-5839858749e1] No waiting events found dispatching network-vif-unplugged-0d38f117-6eb0-4627-bc39-8bfd3ed800f6 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:20:23 user nova-compute[72382]: DEBUG nova.compute.manager [req-6434111e-7132-4feb-9008-534b3989cac7 req-3300a58d-1a7c-411c-bab1-e9c73304d506 service nova] [instance: b5aa7e23-9c2c-400e-a615-5839858749e1] Received event network-vif-unplugged-0d38f117-6eb0-4627-bc39-8bfd3ed800f6 for instance with task_state deleting. {{(pid=72382) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 15:20:23 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-4c0e184c-1d5b-43bf-8aab-4427076458a6 tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] Acquiring lock "83ebfda8-235d-4404-a973-991d75ae2bf6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:20:23 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-4c0e184c-1d5b-43bf-8aab-4427076458a6 tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] Lock "83ebfda8-235d-4404-a973-991d75ae2bf6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:20:23 user nova-compute[72382]: DEBUG nova.compute.manager [None req-4c0e184c-1d5b-43bf-8aab-4427076458a6 tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] [instance: 83ebfda8-235d-4404-a973-991d75ae2bf6] Starting instance... {{(pid=72382) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 15:20:23 user nova-compute[72382]: DEBUG nova.network.neutron [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] [instance: cff2fb57-7d0b-4278-89ed-10a8ec5128ea] Successfully created port: 17d8899d-82c0-4a46-97de-31253f7d1b82 {{(pid=72382) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 15:20:23 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-4c0e184c-1d5b-43bf-8aab-4427076458a6 tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:20:23 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-4c0e184c-1d5b-43bf-8aab-4427076458a6 tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:20:23 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-4c0e184c-1d5b-43bf-8aab-4427076458a6 tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72382) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 15:20:23 user nova-compute[72382]: INFO nova.compute.claims [None req-4c0e184c-1d5b-43bf-8aab-4427076458a6 tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] [instance: 83ebfda8-235d-4404-a973-991d75ae2bf6] Claim successful on node user
Aug 09 15:20:23 user nova-compute[72382]: INFO nova.virt.libvirt.driver [-] [instance: b5aa7e23-9c2c-400e-a615-5839858749e1] Instance destroyed successfully.
Aug 09 15:20:23 user nova-compute[72382]: DEBUG nova.objects.instance [None req-c623fd1c-4ab1-4838-9b39-373d181c1c82 tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] Lazy-loading 'resources' on Instance uuid b5aa7e23-9c2c-400e-a615-5839858749e1 {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:20:23 user nova-compute[72382]: DEBUG nova.virt.libvirt.vif [None req-c623fd1c-4ab1-4838-9b39-373d181c1c82 tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T15:16:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-590083111',display_name='tempest-TestServerVolumeAttachmentScenario-server-590083111',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-590083111',id=11,image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEwtSZCden37QZKDU1Ca41L3AZIFkgcTBEJnqYjicj/EdFplA5cU6qTKVOxrPWHrLxHUSxk/YaAXSMZMn0qvDpx6pefUAYKkJbU0Qr2WgqBuqwI7YaastcprM/E7ETKeiQ==',key_name='tempest-keypair-1369877973',keypairs=<?>,launch_index=0,launched_at=2023-08-09T15:16:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0d70953bf0414fc8b87d85c5bd77ecaa',ramdisk_id='',reservation_id='r-usvhnkud',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-540197035',owner_user_name='tempest-TestServerVolumeAttachmentScenario-540197035-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T15:16:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='47749ad054ff438cb0f79e0aba2514f1',uuid=b5aa7e23-9c2c-400e-a615-5839858749e1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0d38f117-6eb0-4627-bc39-8bfd3ed800f6", "address": "fa:16:3e:f1:64:50", "network": {"id": "0ea6f64f-105f-42c8-a5ad-56a358383e40", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1157085737-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.41", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d70953bf0414fc8b87d85c5bd77ecaa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d38f117-6e", "ovs_interfaceid": "0d38f117-6eb0-4627-bc39-8bfd3ed800f6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 15:20:23 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-c623fd1c-4ab1-4838-9b39-373d181c1c82 tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] Converting VIF {"id": "0d38f117-6eb0-4627-bc39-8bfd3ed800f6", "address": "fa:16:3e:f1:64:50", "network": {"id": "0ea6f64f-105f-42c8-a5ad-56a358383e40", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1157085737-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.41", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d70953bf0414fc8b87d85c5bd77ecaa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d38f117-6e", "ovs_interfaceid": "0d38f117-6eb0-4627-bc39-8bfd3ed800f6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 15:20:23 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-c623fd1c-4ab1-4838-9b39-373d181c1c82 tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f1:64:50,bridge_name='br-int',has_traffic_filtering=True,id=0d38f117-6eb0-4627-bc39-8bfd3ed800f6,network=Network(0ea6f64f-105f-42c8-a5ad-56a358383e40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d38f117-6e') {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 15:20:23 user nova-compute[72382]: DEBUG os_vif [None req-c623fd1c-4ab1-4838-9b39-373d181c1c82 tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f1:64:50,bridge_name='br-int',has_traffic_filtering=True,id=0d38f117-6eb0-4627-bc39-8bfd3ed800f6,network=Network(0ea6f64f-105f-42c8-a5ad-56a358383e40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d38f117-6e') {{(pid=72382) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 15:20:23 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:20:23 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0d38f117-6e, bridge=br-int, if_exists=True) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:20:23 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:20:23 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:20:23 user nova-compute[72382]: INFO os_vif [None req-c623fd1c-4ab1-4838-9b39-373d181c1c82 tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f1:64:50,bridge_name='br-int',has_traffic_filtering=True,id=0d38f117-6eb0-4627-bc39-8bfd3ed800f6,network=Network(0ea6f64f-105f-42c8-a5ad-56a358383e40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d38f117-6e')
Aug 09 15:20:23 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-c623fd1c-4ab1-4838-9b39-373d181c1c82 tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] [instance: b5aa7e23-9c2c-400e-a615-5839858749e1] Deleting instance files /opt/stack/data/nova/instances/b5aa7e23-9c2c-400e-a615-5839858749e1_del
Aug 09 15:20:23 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-c623fd1c-4ab1-4838-9b39-373d181c1c82 tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] [instance: b5aa7e23-9c2c-400e-a615-5839858749e1] Deletion of /opt/stack/data/nova/instances/b5aa7e23-9c2c-400e-a615-5839858749e1_del complete
Aug 09 15:20:23 user nova-compute[72382]: INFO nova.compute.manager [None req-c623fd1c-4ab1-4838-9b39-373d181c1c82 tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] [instance: b5aa7e23-9c2c-400e-a615-5839858749e1] Took 0.99 seconds to destroy the instance on the hypervisor.
Aug 09 15:20:23 user nova-compute[72382]: DEBUG oslo.service.loopingcall [None req-c623fd1c-4ab1-4838-9b39-373d181c1c82 tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72382) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 15:20:23 user nova-compute[72382]: DEBUG nova.compute.manager [-] [instance: b5aa7e23-9c2c-400e-a615-5839858749e1] Deallocating network for instance {{(pid=72382) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 15:20:23 user nova-compute[72382]: DEBUG nova.network.neutron [-] [instance: b5aa7e23-9c2c-400e-a615-5839858749e1] deallocate_for_instance() {{(pid=72382) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 15:20:23 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:20:24 user nova-compute[72382]: DEBUG nova.compute.provider_tree [None req-4c0e184c-1d5b-43bf-8aab-4427076458a6 tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] Inventory has not changed in ProviderTree for provider: 7b15b0e5-df4d-49db-833b-2855d21d10ae {{(pid=72382) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 15:20:24 user nova-compute[72382]: DEBUG nova.scheduler.client.report [None req-4c0e184c-1d5b-43bf-8aab-4427076458a6 tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] Inventory has not changed for provider 7b15b0e5-df4d-49db-833b-2855d21d10ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72382) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 15:20:24 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-4c0e184c-1d5b-43bf-8aab-4427076458a6 tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.633s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:20:24 user nova-compute[72382]: DEBUG nova.compute.manager [None req-4c0e184c-1d5b-43bf-8aab-4427076458a6 tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] [instance: 83ebfda8-235d-4404-a973-991d75ae2bf6] Start building networks asynchronously for instance. {{(pid=72382) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 15:20:24 user nova-compute[72382]: DEBUG nova.compute.manager [None req-4c0e184c-1d5b-43bf-8aab-4427076458a6 tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] [instance: 83ebfda8-235d-4404-a973-991d75ae2bf6] Allocating IP information in the background. {{(pid=72382) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 15:20:24 user nova-compute[72382]: DEBUG nova.network.neutron [None req-4c0e184c-1d5b-43bf-8aab-4427076458a6 tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] [instance: 83ebfda8-235d-4404-a973-991d75ae2bf6] allocate_for_instance() {{(pid=72382) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 15:20:24 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-4c0e184c-1d5b-43bf-8aab-4427076458a6 tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] [instance: 83ebfda8-235d-4404-a973-991d75ae2bf6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 15:20:24 user nova-compute[72382]: DEBUG nova.compute.manager [None req-4c0e184c-1d5b-43bf-8aab-4427076458a6 tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] [instance: 83ebfda8-235d-4404-a973-991d75ae2bf6] Start building block device mappings for instance. {{(pid=72382) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 15:20:24 user nova-compute[72382]: INFO nova.virt.block_device [None req-4c0e184c-1d5b-43bf-8aab-4427076458a6 tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] [instance: 83ebfda8-235d-4404-a973-991d75ae2bf6] Booting with volume 1cd86701-a303-4744-bf0c-31b5314bb87d at /dev/vda
Aug 09 15:20:24 user nova-compute[72382]: DEBUG os_brick.utils [None req-4c0e184c-1d5b-43bf-8aab-4427076458a6 tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 15:20:24 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:20:24 user nova-compute[72382]: DEBUG nova.policy [None req-4c0e184c-1d5b-43bf-8aab-4427076458a6 tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '73fe18c52fef46869d80a266455681f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b73f81b4814b6f86017c2c27f8762c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72382) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 15:20:24 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:20:24 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa47515d-e1f4-4f0c-b5bc-051b5cc2f8ee]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d2cfa7015fe\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:20:24 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:20:24 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:20:24 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fdf1a72-e451-43cf-823e-fd84af6c5112]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:20:24 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:20:24 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:20:24 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cad9649-7bbb-4b06-9173-791c91f865e5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:20:24 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[38a34f16-dbca-4553-866b-cc3549dabbb1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:20:24 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-4c0e184c-1d5b-43bf-8aab-4427076458a6 tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] Running cmd (subprocess): nvme version {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:20:24 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-4c0e184c-1d5b-43bf-8aab-4427076458a6 tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] 'nvme version' failed. Not Retrying. {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 15:20:24 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4c0e184c-1d5b-43bf-8aab-4427076458a6 tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] nvme not present on system {{(pid=72382) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 15:20:24 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:20:24 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 15:20:24 user nova-compute[72382]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 15:20:24 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0c8f660-e63e-45fb-96a7-2e6d1b2f5ed9]: (4, '') {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:20:24 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.lightos [None req-4c0e184c-1d5b-43bf-8aab-4427076458a6 tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72382) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 15:20:24 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.lightos [None req-4c0e184c-1d5b-43bf-8aab-4427076458a6 tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72382) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 15:20:24 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.lightos [None req-4c0e184c-1d5b-43bf-8aab-4427076458a6 tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] LIGHTOS: no hostnqn found. {{(pid=72382) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 15:20:24 user nova-compute[72382]: DEBUG os_brick.utils [None req-4c0e184c-1d5b-43bf-8aab-4427076458a6 tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d2cfa7015fe', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 15:20:24 user nova-compute[72382]: DEBUG nova.virt.block_device [None req-4c0e184c-1d5b-43bf-8aab-4427076458a6 tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] [instance: 83ebfda8-235d-4404-a973-991d75ae2bf6] Updating existing volume attachment record: c0ce4e9d-aaa7-4a58-b224-8ab0c6abb6de {{(pid=72382) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 15:20:25 user nova-compute[72382]: DEBUG nova.compute.manager [req-bf837aed-3ce8-4965-95f8-805e8b74b7c0 req-959a92b2-4fea-46ff-8e26-1d3371e9b85a service nova] [instance: b5aa7e23-9c2c-400e-a615-5839858749e1] Received event network-vif-plugged-0d38f117-6eb0-4627-bc39-8bfd3ed800f6 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:20:25 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-bf837aed-3ce8-4965-95f8-805e8b74b7c0 req-959a92b2-4fea-46ff-8e26-1d3371e9b85a service nova] Acquiring lock "b5aa7e23-9c2c-400e-a615-5839858749e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:20:25 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-bf837aed-3ce8-4965-95f8-805e8b74b7c0 req-959a92b2-4fea-46ff-8e26-1d3371e9b85a service nova] Lock "b5aa7e23-9c2c-400e-a615-5839858749e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:20:25 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-bf837aed-3ce8-4965-95f8-805e8b74b7c0 req-959a92b2-4fea-46ff-8e26-1d3371e9b85a service nova] Lock "b5aa7e23-9c2c-400e-a615-5839858749e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:20:25 user nova-compute[72382]: DEBUG nova.compute.manager [req-bf837aed-3ce8-4965-95f8-805e8b74b7c0 req-959a92b2-4fea-46ff-8e26-1d3371e9b85a service nova] [instance: b5aa7e23-9c2c-400e-a615-5839858749e1] No waiting events found dispatching network-vif-plugged-0d38f117-6eb0-4627-bc39-8bfd3ed800f6 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:20:25 user nova-compute[72382]: WARNING nova.compute.manager [req-bf837aed-3ce8-4965-95f8-805e8b74b7c0 req-959a92b2-4fea-46ff-8e26-1d3371e9b85a service nova] [instance: b5aa7e23-9c2c-400e-a615-5839858749e1] Received unexpected event network-vif-plugged-0d38f117-6eb0-4627-bc39-8bfd3ed800f6 for instance with vm_state active and task_state deleting.
Aug 09 15:20:25 user nova-compute[72382]: DEBUG nova.network.neutron [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] [instance: cff2fb57-7d0b-4278-89ed-10a8ec5128ea] Successfully created port: ce3acf5c-2e65-4650-aade-158b96a7d349 {{(pid=72382) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 15:20:26 user nova-compute[72382]: DEBUG nova.network.neutron [-] [instance: b5aa7e23-9c2c-400e-a615-5839858749e1] Updating instance_info_cache with network_info: [] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:20:26 user nova-compute[72382]: INFO nova.compute.manager [-] [instance: b5aa7e23-9c2c-400e-a615-5839858749e1] Took 2.73 seconds to deallocate network for instance.
Aug 09 15:20:26 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-c623fd1c-4ab1-4838-9b39-373d181c1c82 tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:20:26 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-c623fd1c-4ab1-4838-9b39-373d181c1c82 tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:20:26 user nova-compute[72382]: DEBUG nova.compute.manager [req-8d3f8bd7-bf7f-4b15-a9d8-b7c03a188af5 req-d30acbf9-ff76-47b4-9176-d7295d3e2bb5 service nova] [instance: b5aa7e23-9c2c-400e-a615-5839858749e1] Received event network-vif-deleted-0d38f117-6eb0-4627-bc39-8bfd3ed800f6 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:20:26 user nova-compute[72382]: DEBUG nova.network.neutron [None req-4c0e184c-1d5b-43bf-8aab-4427076458a6 tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] [instance: 83ebfda8-235d-4404-a973-991d75ae2bf6] Successfully created port: b2646c3a-cc2a-4782-a312-0582f2d377b1 {{(pid=72382) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 15:20:26 user nova-compute[72382]: DEBUG nova.compute.provider_tree [None req-c623fd1c-4ab1-4838-9b39-373d181c1c82 tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] Inventory has not changed in ProviderTree for provider: 7b15b0e5-df4d-49db-833b-2855d21d10ae {{(pid=72382) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 15:20:26 user nova-compute[72382]: DEBUG nova.scheduler.client.report [None req-c623fd1c-4ab1-4838-9b39-373d181c1c82 tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] Inventory has not changed for provider 7b15b0e5-df4d-49db-833b-2855d21d10ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72382) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 15:20:27 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-c623fd1c-4ab1-4838-9b39-373d181c1c82 tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.417s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:20:27 user nova-compute[72382]: INFO nova.scheduler.client.report [None req-c623fd1c-4ab1-4838-9b39-373d181c1c82 tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] Deleted allocations for instance b5aa7e23-9c2c-400e-a615-5839858749e1
Aug 09 15:20:27 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-c623fd1c-4ab1-4838-9b39-373d181c1c82 tempest-TestServerVolumeAttachmentScenario-540197035 tempest-TestServerVolumeAttachmentScenario-540197035-project-member] Lock "b5aa7e23-9c2c-400e-a615-5839858749e1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.419s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:20:27 user nova-compute[72382]: DEBUG nova.network.neutron [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] [instance: cff2fb57-7d0b-4278-89ed-10a8ec5128ea] Successfully created port: 802211f2-fc95-4940-87bf-eb0658b56ff1 {{(pid=72382) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 15:20:28 user nova-compute[72382]: DEBUG nova.network.neutron [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] [instance: cff2fb57-7d0b-4278-89ed-10a8ec5128ea] Successfully created port: bcf9d83a-a145-4d83-9df6-02eba42f64bf {{(pid=72382) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 15:20:28 user nova-compute[72382]: DEBUG nova.network.neutron [None req-4c0e184c-1d5b-43bf-8aab-4427076458a6 tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] [instance: 83ebfda8-235d-4404-a973-991d75ae2bf6] Successfully updated port: b2646c3a-cc2a-4782-a312-0582f2d377b1 {{(pid=72382) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 15:20:28 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:20:28 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-4c0e184c-1d5b-43bf-8aab-4427076458a6 tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] Acquiring lock "refresh_cache-83ebfda8-235d-4404-a973-991d75ae2bf6" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 15:20:28 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-4c0e184c-1d5b-43bf-8aab-4427076458a6 tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] Acquired lock "refresh_cache-83ebfda8-235d-4404-a973-991d75ae2bf6" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 15:20:28 user nova-compute[72382]: DEBUG nova.network.neutron [None req-4c0e184c-1d5b-43bf-8aab-4427076458a6 tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] [instance: 83ebfda8-235d-4404-a973-991d75ae2bf6] Building network info cache for instance {{(pid=72382) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 15:20:28 user nova-compute[72382]: DEBUG nova.compute.manager [req-d49a480a-73c7-4cb5-862c-18baa6d6c1b0 req-ce1f0a66-0fc5-4f1e-8526-634291ee0ff3 service nova] [instance: 83ebfda8-235d-4404-a973-991d75ae2bf6] Received event network-changed-b2646c3a-cc2a-4782-a312-0582f2d377b1 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:20:28 user nova-compute[72382]: DEBUG nova.compute.manager [req-d49a480a-73c7-4cb5-862c-18baa6d6c1b0 req-ce1f0a66-0fc5-4f1e-8526-634291ee0ff3 service nova] [instance: 83ebfda8-235d-4404-a973-991d75ae2bf6] Refreshing instance network info cache due to event network-changed-b2646c3a-cc2a-4782-a312-0582f2d377b1. {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 15:20:28 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-d49a480a-73c7-4cb5-862c-18baa6d6c1b0 req-ce1f0a66-0fc5-4f1e-8526-634291ee0ff3 service nova] Acquiring lock "refresh_cache-83ebfda8-235d-4404-a973-991d75ae2bf6" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 15:20:28 user nova-compute[72382]: DEBUG nova.network.neutron [None req-4c0e184c-1d5b-43bf-8aab-4427076458a6 tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] [instance: 83ebfda8-235d-4404-a973-991d75ae2bf6] Instance cache missing network info. {{(pid=72382) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 15:20:28 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:20:29 user nova-compute[72382]: DEBUG nova.network.neutron [None req-4c0e184c-1d5b-43bf-8aab-4427076458a6 tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] [instance: 83ebfda8-235d-4404-a973-991d75ae2bf6] Updating instance_info_cache with network_info: [{"id": "b2646c3a-cc2a-4782-a312-0582f2d377b1", "address": "fa:16:3e:01:06:06", "network": {"id": "2d5fadd3-a58b-4e71-971d-fa94edf0897d", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-6415310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06b73f81b4814b6f86017c2c27f8762c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2646c3a-cc", "ovs_interfaceid": "b2646c3a-cc2a-4782-a312-0582f2d377b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:20:30 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-4c0e184c-1d5b-43bf-8aab-4427076458a6 tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] Releasing lock "refresh_cache-83ebfda8-235d-4404-a973-991d75ae2bf6" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 15:20:30 user nova-compute[72382]: DEBUG nova.compute.manager [None req-4c0e184c-1d5b-43bf-8aab-4427076458a6 tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] [instance: 83ebfda8-235d-4404-a973-991d75ae2bf6] Instance network_info: |[{"id": "b2646c3a-cc2a-4782-a312-0582f2d377b1", "address": "fa:16:3e:01:06:06", "network": {"id": "2d5fadd3-a58b-4e71-971d-fa94edf0897d", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-6415310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06b73f81b4814b6f86017c2c27f8762c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2646c3a-cc", "ovs_interfaceid": "b2646c3a-cc2a-4782-a312-0582f2d377b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72382) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 15:20:30 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-d49a480a-73c7-4cb5-862c-18baa6d6c1b0 req-ce1f0a66-0fc5-4f1e-8526-634291ee0ff3 service nova] Acquired lock "refresh_cache-83ebfda8-235d-4404-a973-991d75ae2bf6" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 15:20:30 user nova-compute[72382]: DEBUG nova.network.neutron [req-d49a480a-73c7-4cb5-862c-18baa6d6c1b0 req-ce1f0a66-0fc5-4f1e-8526-634291ee0ff3 service nova] [instance: 83ebfda8-235d-4404-a973-991d75ae2bf6] Refreshing network info cache for port b2646c3a-cc2a-4782-a312-0582f2d377b1 {{(pid=72382) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 15:20:30 user nova-compute[72382]: DEBUG nova.network.neutron [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] [instance: cff2fb57-7d0b-4278-89ed-10a8ec5128ea] Successfully updated port: 477e93e2-c6aa-47e7-bed7-62b4bb29a9ea {{(pid=72382) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 15:20:30 user nova-compute[72382]: INFO nova.virt.block_device [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] [instance: cff2fb57-7d0b-4278-89ed-10a8ec5128ea] Booting with volume 184b0159-3cae-4d79-86b3-26a58437eb09 at /dev/vdb
Aug 09 15:20:30 user nova-compute[72382]: DEBUG os_brick.utils [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 15:20:30 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:20:30 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:20:30 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[14b42e53-5437-417e-ac71-a48db72e1394]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d2cfa7015fe\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:20:30 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:20:30 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:20:30 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[c96ae1ca-88e0-4dea-8616-dc7b63460d28]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:20:30 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:20:30 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:20:30 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dfc8db6-13e9-4be3-b854-c19551caf87b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:20:30 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[3aa93344-6f60-4890-8b52-d21f9864c991]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:20:30 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] Running cmd (subprocess): nvme version {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:20:30 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] 'nvme version' failed. Not Retrying. {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 15:20:30 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.nvmeof [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] nvme not present on system {{(pid=72382) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 15:20:30 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:20:30 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 15:20:30 user nova-compute[72382]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 15:20:30 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4a143b3-a15d-434b-8474-a06f42c85903]: (4, '') {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:20:30 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.lightos [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72382) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 15:20:30 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.lightos [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72382) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 15:20:30 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.lightos [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] LIGHTOS: no hostnqn found. {{(pid=72382) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 15:20:30 user nova-compute[72382]: DEBUG os_brick.utils [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d2cfa7015fe', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 15:20:30 user nova-compute[72382]: DEBUG nova.virt.block_device [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] [instance: cff2fb57-7d0b-4278-89ed-10a8ec5128ea] Updating existing volume attachment record: 34c5c983-c5bc-4871-a9eb-5569c9d5870f {{(pid=72382) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 15:20:30 user nova-compute[72382]: DEBUG nova.compute.manager [req-c77f5f71-5b9b-4f6c-b4de-4421f4d415bc req-b96aeb51-e188-4249-8e58-4a0efae99f99 service nova] [instance: cff2fb57-7d0b-4278-89ed-10a8ec5128ea] Received event network-changed-477e93e2-c6aa-47e7-bed7-62b4bb29a9ea {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:20:30 user nova-compute[72382]: DEBUG nova.compute.manager [req-c77f5f71-5b9b-4f6c-b4de-4421f4d415bc req-b96aeb51-e188-4249-8e58-4a0efae99f99 service nova] [instance: cff2fb57-7d0b-4278-89ed-10a8ec5128ea] Refreshing instance network info cache due to event network-changed-477e93e2-c6aa-47e7-bed7-62b4bb29a9ea. {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 15:20:30 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-c77f5f71-5b9b-4f6c-b4de-4421f4d415bc req-b96aeb51-e188-4249-8e58-4a0efae99f99 service nova] Acquiring lock "refresh_cache-cff2fb57-7d0b-4278-89ed-10a8ec5128ea" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 15:20:30 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-c77f5f71-5b9b-4f6c-b4de-4421f4d415bc req-b96aeb51-e188-4249-8e58-4a0efae99f99 service nova] Acquired lock "refresh_cache-cff2fb57-7d0b-4278-89ed-10a8ec5128ea" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 15:20:30 user nova-compute[72382]: DEBUG nova.network.neutron [req-c77f5f71-5b9b-4f6c-b4de-4421f4d415bc req-b96aeb51-e188-4249-8e58-4a0efae99f99 service nova] [instance: cff2fb57-7d0b-4278-89ed-10a8ec5128ea] Refreshing network info cache for port 477e93e2-c6aa-47e7-bed7-62b4bb29a9ea {{(pid=72382) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 15:20:30 user nova-compute[72382]: DEBUG nova.network.neutron [req-d49a480a-73c7-4cb5-862c-18baa6d6c1b0 req-ce1f0a66-0fc5-4f1e-8526-634291ee0ff3 service nova] [instance: 83ebfda8-235d-4404-a973-991d75ae2bf6] Updated VIF entry in instance network info cache for port b2646c3a-cc2a-4782-a312-0582f2d377b1. {{(pid=72382) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 15:20:30 user nova-compute[72382]: DEBUG nova.network.neutron [req-d49a480a-73c7-4cb5-862c-18baa6d6c1b0 req-ce1f0a66-0fc5-4f1e-8526-634291ee0ff3 service nova] [instance: 83ebfda8-235d-4404-a973-991d75ae2bf6] Updating instance_info_cache with network_info: [{"id": "b2646c3a-cc2a-4782-a312-0582f2d377b1", "address": "fa:16:3e:01:06:06", "network": {"id": "2d5fadd3-a58b-4e71-971d-fa94edf0897d", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-6415310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06b73f81b4814b6f86017c2c27f8762c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2646c3a-cc", "ovs_interfaceid": "b2646c3a-cc2a-4782-a312-0582f2d377b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:20:30 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-d49a480a-73c7-4cb5-862c-18baa6d6c1b0 req-ce1f0a66-0fc5-4f1e-8526-634291ee0ff3 service nova] Releasing lock "refresh_cache-83ebfda8-235d-4404-a973-991d75ae2bf6" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 15:20:31 user nova-compute[72382]: DEBUG nova.network.neutron [req-c77f5f71-5b9b-4f6c-b4de-4421f4d415bc req-b96aeb51-e188-4249-8e58-4a0efae99f99 service nova] [instance: cff2fb57-7d0b-4278-89ed-10a8ec5128ea] Instance cache missing network info. {{(pid=72382) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 15:20:31 user nova-compute[72382]: DEBUG nova.network.neutron [req-c77f5f71-5b9b-4f6c-b4de-4421f4d415bc req-b96aeb51-e188-4249-8e58-4a0efae99f99 service nova] [instance: cff2fb57-7d0b-4278-89ed-10a8ec5128ea] Updating instance_info_cache with network_info: [] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:20:31 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-c77f5f71-5b9b-4f6c-b4de-4421f4d415bc req-b96aeb51-e188-4249-8e58-4a0efae99f99 service nova] Releasing lock "refresh_cache-cff2fb57-7d0b-4278-89ed-10a8ec5128ea" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 15:20:31 user nova-compute[72382]: DEBUG nova.network.neutron [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] [instance: cff2fb57-7d0b-4278-89ed-10a8ec5128ea] Successfully updated port: 55cf98ab-8cd2-4704-971f-ee4ceebca331 {{(pid=72382) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 15:20:32 user nova-compute[72382]: DEBUG nova.network.neutron [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] [instance: cff2fb57-7d0b-4278-89ed-10a8ec5128ea] Successfully updated port: baeec4fc-3670-49f3-b42c-aab5ea116f45 {{(pid=72382) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 15:20:32 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:20:32 user nova-compute[72382]: DEBUG nova.compute.manager [req-908955df-423d-4461-9fb3-dad46e476c2a req-717506ba-d1dc-4935-a093-787e439670eb service nova] [instance: cff2fb57-7d0b-4278-89ed-10a8ec5128ea] Received event network-changed-55cf98ab-8cd2-4704-971f-ee4ceebca331 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:20:32 user nova-compute[72382]: DEBUG nova.compute.manager [req-908955df-423d-4461-9fb3-dad46e476c2a req-717506ba-d1dc-4935-a093-787e439670eb service nova] [instance: cff2fb57-7d0b-4278-89ed-10a8ec5128ea] Refreshing instance network info cache due to event network-changed-55cf98ab-8cd2-4704-971f-ee4ceebca331. {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 15:20:32 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-908955df-423d-4461-9fb3-dad46e476c2a req-717506ba-d1dc-4935-a093-787e439670eb service nova] Acquiring lock "refresh_cache-cff2fb57-7d0b-4278-89ed-10a8ec5128ea" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 15:20:32 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-908955df-423d-4461-9fb3-dad46e476c2a req-717506ba-d1dc-4935-a093-787e439670eb service nova] Acquired lock "refresh_cache-cff2fb57-7d0b-4278-89ed-10a8ec5128ea" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 15:20:32 user nova-compute[72382]: DEBUG nova.network.neutron [req-908955df-423d-4461-9fb3-dad46e476c2a req-717506ba-d1dc-4935-a093-787e439670eb service nova] [instance: cff2fb57-7d0b-4278-89ed-10a8ec5128ea] Refreshing network info cache for port 55cf98ab-8cd2-4704-971f-ee4ceebca331 {{(pid=72382) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 15:20:33 user nova-compute[72382]: DEBUG nova.network.neutron [req-908955df-423d-4461-9fb3-dad46e476c2a req-717506ba-d1dc-4935-a093-787e439670eb service nova] [instance: cff2fb57-7d0b-4278-89ed-10a8ec5128ea] Instance cache missing network info. {{(pid=72382) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 15:20:33 user nova-compute[72382]: DEBUG nova.network.neutron [req-908955df-423d-4461-9fb3-dad46e476c2a req-717506ba-d1dc-4935-a093-787e439670eb service nova] [instance: cff2fb57-7d0b-4278-89ed-10a8ec5128ea] Updating instance_info_cache with network_info: [] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:20:33 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-908955df-423d-4461-9fb3-dad46e476c2a req-717506ba-d1dc-4935-a093-787e439670eb service nova] Releasing lock "refresh_cache-cff2fb57-7d0b-4278-89ed-10a8ec5128ea" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 15:20:33 user nova-compute[72382]: DEBUG nova.compute.manager [req-908955df-423d-4461-9fb3-dad46e476c2a req-717506ba-d1dc-4935-a093-787e439670eb service nova] [instance: cff2fb57-7d0b-4278-89ed-10a8ec5128ea] Received event network-changed-baeec4fc-3670-49f3-b42c-aab5ea116f45 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:20:33 user nova-compute[72382]: DEBUG nova.compute.manager [req-908955df-423d-4461-9fb3-dad46e476c2a req-717506ba-d1dc-4935-a093-787e439670eb service nova] [instance: cff2fb57-7d0b-4278-89ed-10a8ec5128ea] Refreshing instance network info cache due to event network-changed-baeec4fc-3670-49f3-b42c-aab5ea116f45. {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 15:20:33 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-908955df-423d-4461-9fb3-dad46e476c2a req-717506ba-d1dc-4935-a093-787e439670eb service nova] Acquiring lock "refresh_cache-cff2fb57-7d0b-4278-89ed-10a8ec5128ea" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 15:20:33 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-908955df-423d-4461-9fb3-dad46e476c2a req-717506ba-d1dc-4935-a093-787e439670eb service nova] Acquired lock "refresh_cache-cff2fb57-7d0b-4278-89ed-10a8ec5128ea" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 15:20:33 user nova-compute[72382]: DEBUG nova.network.neutron [req-908955df-423d-4461-9fb3-dad46e476c2a req-717506ba-d1dc-4935-a093-787e439670eb service nova] [instance: cff2fb57-7d0b-4278-89ed-10a8ec5128ea] Refreshing network info cache for port baeec4fc-3670-49f3-b42c-aab5ea116f45 {{(pid=72382) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 15:20:33 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:20:33 user nova-compute[72382]: DEBUG nova.network.neutron [req-908955df-423d-4461-9fb3-dad46e476c2a req-717506ba-d1dc-4935-a093-787e439670eb service nova] [instance: cff2fb57-7d0b-4278-89ed-10a8ec5128ea] Instance cache missing network info. {{(pid=72382) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 15:20:33 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:20:33 user nova-compute[72382]: DEBUG nova.network.neutron [req-908955df-423d-4461-9fb3-dad46e476c2a req-717506ba-d1dc-4935-a093-787e439670eb service nova] [instance: cff2fb57-7d0b-4278-89ed-10a8ec5128ea] Updating instance_info_cache with network_info: [] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:20:33 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-908955df-423d-4461-9fb3-dad46e476c2a req-717506ba-d1dc-4935-a093-787e439670eb service nova] Releasing lock "refresh_cache-cff2fb57-7d0b-4278-89ed-10a8ec5128ea" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 15:20:34 user nova-compute[72382]: DEBUG nova.network.neutron [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] [instance: cff2fb57-7d0b-4278-89ed-10a8ec5128ea] Successfully updated port: 17d8899d-82c0-4a46-97de-31253f7d1b82 {{(pid=72382) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 15:20:34 user nova-compute[72382]: DEBUG nova.compute.manager [req-f9c88b10-04db-4fbe-bb23-1a13d5502199 req-0dceae15-b495-46a5-b836-67b4073f19fc service nova] [instance: cff2fb57-7d0b-4278-89ed-10a8ec5128ea] Received event network-changed-17d8899d-82c0-4a46-97de-31253f7d1b82 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:20:34 user nova-compute[72382]: DEBUG nova.compute.manager [req-f9c88b10-04db-4fbe-bb23-1a13d5502199 req-0dceae15-b495-46a5-b836-67b4073f19fc service nova] [instance: cff2fb57-7d0b-4278-89ed-10a8ec5128ea] Refreshing instance network info cache due to event network-changed-17d8899d-82c0-4a46-97de-31253f7d1b82. {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 15:20:34 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-f9c88b10-04db-4fbe-bb23-1a13d5502199 req-0dceae15-b495-46a5-b836-67b4073f19fc service nova] Acquiring lock "refresh_cache-cff2fb57-7d0b-4278-89ed-10a8ec5128ea" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 15:20:34 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-f9c88b10-04db-4fbe-bb23-1a13d5502199 req-0dceae15-b495-46a5-b836-67b4073f19fc service nova] Acquired lock "refresh_cache-cff2fb57-7d0b-4278-89ed-10a8ec5128ea" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 15:20:34 user nova-compute[72382]: DEBUG nova.network.neutron [req-f9c88b10-04db-4fbe-bb23-1a13d5502199 req-0dceae15-b495-46a5-b836-67b4073f19fc service nova] [instance: cff2fb57-7d0b-4278-89ed-10a8ec5128ea] Refreshing network info cache for port 17d8899d-82c0-4a46-97de-31253f7d1b82 {{(pid=72382) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 15:20:35 user nova-compute[72382]: DEBUG nova.network.neutron [req-f9c88b10-04db-4fbe-bb23-1a13d5502199 req-0dceae15-b495-46a5-b836-67b4073f19fc service nova] [instance: cff2fb57-7d0b-4278-89ed-10a8ec5128ea] Instance cache missing network info. {{(pid=72382) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 15:20:35 user nova-compute[72382]: DEBUG nova.network.neutron [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] [instance: cff2fb57-7d0b-4278-89ed-10a8ec5128ea] Successfully updated port: ce3acf5c-2e65-4650-aade-158b96a7d349 {{(pid=72382) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 15:20:35 user nova-compute[72382]: DEBUG nova.network.neutron [req-f9c88b10-04db-4fbe-bb23-1a13d5502199 req-0dceae15-b495-46a5-b836-67b4073f19fc service nova] [instance: cff2fb57-7d0b-4278-89ed-10a8ec5128ea] Updating instance_info_cache with network_info: [] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:20:35 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-f9c88b10-04db-4fbe-bb23-1a13d5502199 req-0dceae15-b495-46a5-b836-67b4073f19fc service nova] Releasing lock "refresh_cache-cff2fb57-7d0b-4278-89ed-10a8ec5128ea" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 15:20:36 user nova-compute[72382]: DEBUG nova.network.neutron [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] [instance: cff2fb57-7d0b-4278-89ed-10a8ec5128ea] Successfully updated port: 802211f2-fc95-4940-87bf-eb0658b56ff1 {{(pid=72382) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 15:20:36 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:20:37 user nova-compute[72382]: DEBUG nova.compute.manager [req-2429d5bd-0bf5-4ad7-94dc-81c7467db85e req-fa86db91-ffd3-4689-8d01-81448328d82e service nova] [instance: cff2fb57-7d0b-4278-89ed-10a8ec5128ea] Received event network-changed-ce3acf5c-2e65-4650-aade-158b96a7d349 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:20:37 user nova-compute[72382]: DEBUG nova.compute.manager [req-2429d5bd-0bf5-4ad7-94dc-81c7467db85e req-fa86db91-ffd3-4689-8d01-81448328d82e service nova] [instance: cff2fb57-7d0b-4278-89ed-10a8ec5128ea] Refreshing instance network info cache due to event network-changed-ce3acf5c-2e65-4650-aade-158b96a7d349. {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 15:20:37 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-2429d5bd-0bf5-4ad7-94dc-81c7467db85e req-fa86db91-ffd3-4689-8d01-81448328d82e service nova] Acquiring lock "refresh_cache-cff2fb57-7d0b-4278-89ed-10a8ec5128ea" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 15:20:37 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-2429d5bd-0bf5-4ad7-94dc-81c7467db85e req-fa86db91-ffd3-4689-8d01-81448328d82e service nova] Acquired lock "refresh_cache-cff2fb57-7d0b-4278-89ed-10a8ec5128ea" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 15:20:37 user nova-compute[72382]: DEBUG nova.network.neutron [req-2429d5bd-0bf5-4ad7-94dc-81c7467db85e req-fa86db91-ffd3-4689-8d01-81448328d82e service nova] [instance: cff2fb57-7d0b-4278-89ed-10a8ec5128ea] Refreshing network info cache for port ce3acf5c-2e65-4650-aade-158b96a7d349 {{(pid=72382) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 15:20:37 user nova-compute[72382]: DEBUG nova.network.neutron [req-2429d5bd-0bf5-4ad7-94dc-81c7467db85e req-fa86db91-ffd3-4689-8d01-81448328d82e service nova] [instance: cff2fb57-7d0b-4278-89ed-10a8ec5128ea] Instance cache missing network info. {{(pid=72382) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 15:20:37 user nova-compute[72382]: DEBUG nova.network.neutron [req-2429d5bd-0bf5-4ad7-94dc-81c7467db85e req-fa86db91-ffd3-4689-8d01-81448328d82e service nova] [instance: cff2fb57-7d0b-4278-89ed-10a8ec5128ea] Updating instance_info_cache with network_info: [] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:20:37 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-2429d5bd-0bf5-4ad7-94dc-81c7467db85e req-fa86db91-ffd3-4689-8d01-81448328d82e service nova] Releasing lock "refresh_cache-cff2fb57-7d0b-4278-89ed-10a8ec5128ea" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 15:20:37 user nova-compute[72382]: DEBUG nova.compute.manager [req-2429d5bd-0bf5-4ad7-94dc-81c7467db85e req-fa86db91-ffd3-4689-8d01-81448328d82e service nova] [instance: cff2fb57-7d0b-4278-89ed-10a8ec5128ea] Received event network-changed-802211f2-fc95-4940-87bf-eb0658b56ff1 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:20:37 user nova-compute[72382]: DEBUG nova.compute.manager [req-2429d5bd-0bf5-4ad7-94dc-81c7467db85e req-fa86db91-ffd3-4689-8d01-81448328d82e service nova] [instance: cff2fb57-7d0b-4278-89ed-10a8ec5128ea] Refreshing instance network info cache due to event network-changed-802211f2-fc95-4940-87bf-eb0658b56ff1. {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 15:20:37 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-2429d5bd-0bf5-4ad7-94dc-81c7467db85e req-fa86db91-ffd3-4689-8d01-81448328d82e service nova] Acquiring lock "refresh_cache-cff2fb57-7d0b-4278-89ed-10a8ec5128ea" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 15:20:37 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-2429d5bd-0bf5-4ad7-94dc-81c7467db85e req-fa86db91-ffd3-4689-8d01-81448328d82e service nova] Acquired lock "refresh_cache-cff2fb57-7d0b-4278-89ed-10a8ec5128ea" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 15:20:37 user nova-compute[72382]: DEBUG nova.network.neutron [req-2429d5bd-0bf5-4ad7-94dc-81c7467db85e req-fa86db91-ffd3-4689-8d01-81448328d82e service nova] [instance: cff2fb57-7d0b-4278-89ed-10a8ec5128ea] Refreshing network info cache for port 802211f2-fc95-4940-87bf-eb0658b56ff1 {{(pid=72382) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 15:20:37 user nova-compute[72382]: DEBUG nova.network.neutron [req-2429d5bd-0bf5-4ad7-94dc-81c7467db85e req-fa86db91-ffd3-4689-8d01-81448328d82e service nova] [instance: cff2fb57-7d0b-4278-89ed-10a8ec5128ea] Instance cache missing network info. {{(pid=72382) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 15:20:37 user nova-compute[72382]: DEBUG nova.network.neutron [req-2429d5bd-0bf5-4ad7-94dc-81c7467db85e req-fa86db91-ffd3-4689-8d01-81448328d82e service nova] [instance: cff2fb57-7d0b-4278-89ed-10a8ec5128ea] Updating instance_info_cache with network_info: [] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:20:37 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-2429d5bd-0bf5-4ad7-94dc-81c7467db85e req-fa86db91-ffd3-4689-8d01-81448328d82e service nova] Releasing lock "refresh_cache-cff2fb57-7d0b-4278-89ed-10a8ec5128ea" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 15:20:38 user nova-compute[72382]: DEBUG nova.network.neutron [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] [instance: cff2fb57-7d0b-4278-89ed-10a8ec5128ea] Successfully updated port: bcf9d83a-a145-4d83-9df6-02eba42f64bf {{(pid=72382) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 15:20:38 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] Acquiring lock "refresh_cache-cff2fb57-7d0b-4278-89ed-10a8ec5128ea" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 15:20:38 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] Acquired lock "refresh_cache-cff2fb57-7d0b-4278-89ed-10a8ec5128ea" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 15:20:38 user nova-compute[72382]: DEBUG nova.network.neutron [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] [instance: cff2fb57-7d0b-4278-89ed-10a8ec5128ea] Building network info cache for instance {{(pid=72382) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 15:20:38 user nova-compute[72382]: DEBUG nova.network.neutron [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] [instance: cff2fb57-7d0b-4278-89ed-10a8ec5128ea] Instance cache missing network info. {{(pid=72382) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 15:20:38 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:20:38 user nova-compute[72382]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691594423.6405573, b5aa7e23-9c2c-400e-a615-5839858749e1 => Stopped> {{(pid=72382) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 15:20:38 user nova-compute[72382]: INFO nova.compute.manager [-] [instance: b5aa7e23-9c2c-400e-a615-5839858749e1] VM Stopped (Lifecycle Event)
Aug 09 15:20:38 user nova-compute[72382]: DEBUG nova.compute.manager [None req-0870e94c-b213-4c49-8677-7748818f62bd None None] [instance: b5aa7e23-9c2c-400e-a615-5839858749e1] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:20:38 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:20:38 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:20:39 user nova-compute[72382]: DEBUG nova.compute.manager [req-2e0a957a-1e6a-4c2f-8f78-f3ea5260d29f req-76e87830-921b-4a92-93a3-4ad6d6089a67 service nova] [instance: cff2fb57-7d0b-4278-89ed-10a8ec5128ea] Received event network-changed-bcf9d83a-a145-4d83-9df6-02eba42f64bf {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:20:39 user nova-compute[72382]: DEBUG nova.compute.manager [req-2e0a957a-1e6a-4c2f-8f78-f3ea5260d29f req-76e87830-921b-4a92-93a3-4ad6d6089a67 service nova] [instance: cff2fb57-7d0b-4278-89ed-10a8ec5128ea] Refreshing instance network info cache due to event network-changed-bcf9d83a-a145-4d83-9df6-02eba42f64bf. {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 15:20:39 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-2e0a957a-1e6a-4c2f-8f78-f3ea5260d29f req-76e87830-921b-4a92-93a3-4ad6d6089a67 service nova] Acquiring lock "refresh_cache-cff2fb57-7d0b-4278-89ed-10a8ec5128ea" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 15:20:40 user nova-compute[72382]: INFO nova.virt.block_device [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] [instance: cff2fb57-7d0b-4278-89ed-10a8ec5128ea] Booting with volume 1c6be653-7ab8-4b40-9e28-43c1eca5e016 at /dev/vdc
Aug 09 15:20:40 user nova-compute[72382]: DEBUG os_brick.utils [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 15:20:40 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:20:40 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:20:40 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc7287bf-a8c4-4e94-86e1-b7c1d4f2a10c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d2cfa7015fe\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:20:40 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:20:40 user nova-compute[72382]: DEBUG nova.network.neutron [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] [instance: cff2fb57-7d0b-4278-89ed-10a8ec5128ea] Updating instance_info_cache with network_info: [{"id": "477e93e2-c6aa-47e7-bed7-62b4bb29a9ea", "address": "fa:16:3e:46:0b:d6", "network": {"id": "5f1aee90-5c93-4fe5-a140-7e3ac136489f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1100115541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42fe649aa7cd43678bd4f2cb24f45e18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap477e93e2-c6", "ovs_interfaceid": "477e93e2-c6aa-47e7-bed7-62b4bb29a9ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "55cf98ab-8cd2-4704-971f-ee4ceebca331", "address": "fa:16:3e:8c:34:e0", "network": {"id": "dc656a4e-c46c-4821-b492-2376b82b26ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-2053726028", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "42fe649aa7cd43678bd4f2cb24f45e18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55cf98ab-8c", "ovs_interfaceid": "55cf98ab-8cd2-4704-971f-ee4ceebca331", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "baeec4fc-3670-49f3-b42c-aab5ea116f45", "address": "fa:16:3e:72:b4:02", "network": {"id": "dc656a4e-c46c-4821-b492-2376b82b26ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-2053726028", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.135", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "42fe649aa7cd43678bd4f2cb24f45e18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbaeec4fc-36", "ovs_interfaceid": "baeec4fc-3670-49f3-b42c-aab5ea116f45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "17d8899d-82c0-4a46-97de-31253f7d1b82", "address": "fa:16:3e:7b:f5:ee", "network": {"id": "dc656a4e-c46c-4821-b492-2376b82b26ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-2053726028", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.153", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "42fe649aa7cd43678bd4f2cb24f45e18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17d8899d-82", "ovs_interfaceid": "17d8899d-82c0-4a46-97de-31253f7d1b82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ce3acf5c-2e65-4650-aade-158b96a7d349", "address": "fa:16:3e:ff:b7:1e", "network": {"id": "dc656a4e-c46c-4821-b492-2376b82b26ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-2053726028", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.132", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "42fe649aa7cd43678bd4f2cb24f45e18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce3acf5c-2e", "ovs_interfaceid": "ce3acf5c-2e65-4650-aade-158b96a7d349", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "802211f2-fc95-4940-87bf-eb0658b56ff1", "address": "fa:16:3e:dd:68:92", "network": {"id": "c8d9a670-b921-4ea7-bc32-64ef779aa86c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1431242330", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "42fe649aa7cd43678bd4f2cb24f45e18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap802211f2-fc", "ovs_interfaceid": "802211f2-fc95-4940-87bf-eb0658b56ff1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bcf9d83a-a145-4d83-9df6-02eba42f64bf", "address": "fa:16:3e:98:67:3f", "network": {"id": "c8d9a670-b921-4ea7-bc32-64ef779aa86c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1431242330", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "42fe649aa7cd43678bd4f2cb24f45e18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcf9d83a-a1", "ovs_interfaceid": "bcf9d83a-a145-4d83-9df6-02eba42f64bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:20:40 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:20:40 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[60f27563-0117-4eed-8603-8451cd39fac4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:20:40 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:20:41 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] Releasing lock "refresh_cache-cff2fb57-7d0b-4278-89ed-10a8ec5128ea" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 15:20:41 user nova-compute[72382]: DEBUG nova.compute.manager [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] [instance: cff2fb57-7d0b-4278-89ed-10a8ec5128ea] Instance network_info: |[{"id": "477e93e2-c6aa-47e7-bed7-62b4bb29a9ea", "address": "fa:16:3e:46:0b:d6", "network": {"id": "5f1aee90-5c93-4fe5-a140-7e3ac136489f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1100115541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42fe649aa7cd43678bd4f2cb24f45e18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap477e93e2-c6", "ovs_interfaceid": "477e93e2-c6aa-47e7-bed7-62b4bb29a9ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "55cf98ab-8cd2-4704-971f-ee4ceebca331", "address": "fa:16:3e:8c:34:e0", "network": {"id": "dc656a4e-c46c-4821-b492-2376b82b26ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-2053726028", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "42fe649aa7cd43678bd4f2cb24f45e18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55cf98ab-8c", "ovs_interfaceid": "55cf98ab-8cd2-4704-971f-ee4ceebca331", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "baeec4fc-3670-49f3-b42c-aab5ea116f45", "address": "fa:16:3e:72:b4:02", "network": {"id": "dc656a4e-c46c-4821-b492-2376b82b26ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-2053726028", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.135", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "42fe649aa7cd43678bd4f2cb24f45e18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbaeec4fc-36", "ovs_interfaceid": "baeec4fc-3670-49f3-b42c-aab5ea116f45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "17d8899d-82c0-4a46-97de-31253f7d1b82", "address": "fa:16:3e:7b:f5:ee", "network": {"id": "dc656a4e-c46c-4821-b492-2376b82b26ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-2053726028", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.153", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "42fe649aa7cd43678bd4f2cb24f45e18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17d8899d-82", "ovs_interfaceid": "17d8899d-82c0-4a46-97de-31253f7d1b82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ce3acf5c-2e65-4650-aade-158b96a7d349", "address": "fa:16:3e:ff:b7:1e", "network": {"id": "dc656a4e-c46c-4821-b492-2376b82b26ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-2053726028", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.132", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "42fe649aa7cd43678bd4f2cb24f45e18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce3acf5c-2e", "ovs_interfaceid": "ce3acf5c-2e65-4650-aade-158b96a7d349", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "802211f2-fc95-4940-87bf-eb0658b56ff1", "address": "fa:16:3e:dd:68:92", "network": {"id": "c8d9a670-b921-4ea7-bc32-64ef779aa86c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1431242330", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "42fe649aa7cd43678bd4f2cb24f45e18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap802211f2-fc", "ovs_interfaceid": "802211f2-fc95-4940-87bf-eb0658b56ff1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bcf9d83a-a145-4d83-9df6-02eba42f64bf", "address": "fa:16:3e:98:67:3f", "network": {"id": "c8d9a670-b921-4ea7-bc32-64ef779aa86c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1431242330", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "42fe649aa7cd43678bd4f2cb24f45e18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcf9d83a-a1", "ovs_interfaceid": "bcf9d83a-a145-4d83-9df6-02eba42f64bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72382) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 15:20:41 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:20:41 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[35a9e4a3-ad84-44b9-9e60-f46ae1dc978e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:20:41 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-2e0a957a-1e6a-4c2f-8f78-f3ea5260d29f req-76e87830-921b-4a92-93a3-4ad6d6089a67 service nova] Acquired lock "refresh_cache-cff2fb57-7d0b-4278-89ed-10a8ec5128ea" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 15:20:41 user nova-compute[72382]: DEBUG nova.network.neutron [req-2e0a957a-1e6a-4c2f-8f78-f3ea5260d29f req-76e87830-921b-4a92-93a3-4ad6d6089a67 service nova] [instance: cff2fb57-7d0b-4278-89ed-10a8ec5128ea] Refreshing network info cache for port bcf9d83a-a145-4d83-9df6-02eba42f64bf {{(pid=72382) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 15:20:41 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[8223c50d-3a01-47d7-9604-29549f4046e9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:20:41 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] Running cmd (subprocess): nvme version {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:20:41 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] 'nvme version' failed. Not Retrying. {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 15:20:41 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.nvmeof [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] nvme not present on system {{(pid=72382) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 15:20:41 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:20:41 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 15:20:41 user nova-compute[72382]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 15:20:41 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b81264c-ef7a-4afa-ae9d-eada04dd2b3d]: (4, '') {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:20:41 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.lightos [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72382) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 15:20:41 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.lightos [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72382) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 15:20:41 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.lightos [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] LIGHTOS: no hostnqn found. {{(pid=72382) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 15:20:41 user nova-compute[72382]: DEBUG os_brick.utils [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] <== get_connector_properties: return (143ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d2cfa7015fe', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 15:20:41 user nova-compute[72382]: DEBUG nova.virt.block_device [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] [instance: cff2fb57-7d0b-4278-89ed-10a8ec5128ea] Updating existing volume attachment record: 9b00728e-2eb0-41d2-b222-00ba3c2c6ae5 {{(pid=72382) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 15:20:41 user nova-compute[72382]: DEBUG nova.network.neutron [req-2e0a957a-1e6a-4c2f-8f78-f3ea5260d29f req-76e87830-921b-4a92-93a3-4ad6d6089a67 service nova] [instance: cff2fb57-7d0b-4278-89ed-10a8ec5128ea] Updated VIF entry in instance network info cache for port bcf9d83a-a145-4d83-9df6-02eba42f64bf. {{(pid=72382) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 15:20:41 user nova-compute[72382]: DEBUG nova.network.neutron [req-2e0a957a-1e6a-4c2f-8f78-f3ea5260d29f req-76e87830-921b-4a92-93a3-4ad6d6089a67 service nova] [instance: cff2fb57-7d0b-4278-89ed-10a8ec5128ea] Updating instance_info_cache with network_info: [{"id": "477e93e2-c6aa-47e7-bed7-62b4bb29a9ea", "address": "fa:16:3e:46:0b:d6", "network": {"id": "5f1aee90-5c93-4fe5-a140-7e3ac136489f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1100115541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42fe649aa7cd43678bd4f2cb24f45e18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap477e93e2-c6", "ovs_interfaceid": "477e93e2-c6aa-47e7-bed7-62b4bb29a9ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "55cf98ab-8cd2-4704-971f-ee4ceebca331", "address": "fa:16:3e:8c:34:e0", "network": {"id": "dc656a4e-c46c-4821-b492-2376b82b26ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-2053726028", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "42fe649aa7cd43678bd4f2cb24f45e18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55cf98ab-8c", "ovs_interfaceid": "55cf98ab-8cd2-4704-971f-ee4ceebca331", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "baeec4fc-3670-49f3-b42c-aab5ea116f45", "address": "fa:16:3e:72:b4:02", "network": {"id": "dc656a4e-c46c-4821-b492-2376b82b26ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-2053726028", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.135", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "42fe649aa7cd43678bd4f2cb24f45e18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbaeec4fc-36", "ovs_interfaceid": "baeec4fc-3670-49f3-b42c-aab5ea116f45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "17d8899d-82c0-4a46-97de-31253f7d1b82", "address": "fa:16:3e:7b:f5:ee", "network": {"id": "dc656a4e-c46c-4821-b492-2376b82b26ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-2053726028", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.153", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "42fe649aa7cd43678bd4f2cb24f45e18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17d8899d-82", "ovs_interfaceid": "17d8899d-82c0-4a46-97de-31253f7d1b82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ce3acf5c-2e65-4650-aade-158b96a7d349", "address": "fa:16:3e:ff:b7:1e", "network": {"id": "dc656a4e-c46c-4821-b492-2376b82b26ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-2053726028", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.132", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "42fe649aa7cd43678bd4f2cb24f45e18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce3acf5c-2e", "ovs_interfaceid": "ce3acf5c-2e65-4650-aade-158b96a7d349", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "802211f2-fc95-4940-87bf-eb0658b56ff1", "address": "fa:16:3e:dd:68:92", "network": {"id": "c8d9a670-b921-4ea7-bc32-64ef779aa86c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1431242330", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "42fe649aa7cd43678bd4f2cb24f45e18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap802211f2-fc", "ovs_interfaceid": "802211f2-fc95-4940-87bf-eb0658b56ff1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bcf9d83a-a145-4d83-9df6-02eba42f64bf", "address": "fa:16:3e:98:67:3f", "network": {"id": "c8d9a670-b921-4ea7-bc32-64ef779aa86c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1431242330", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "42fe649aa7cd43678bd4f2cb24f45e18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcf9d83a-a1", "ovs_interfaceid": "bcf9d83a-a145-4d83-9df6-02eba42f64bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:20:41 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-2e0a957a-1e6a-4c2f-8f78-f3ea5260d29f req-76e87830-921b-4a92-93a3-4ad6d6089a67 service nova] Releasing lock "refresh_cache-cff2fb57-7d0b-4278-89ed-10a8ec5128ea" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 15:20:41 user nova-compute[72382]: DEBUG nova.compute.manager [None req-4c0e184c-1d5b-43bf-8aab-4427076458a6 tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] [instance: 83ebfda8-235d-4404-a973-991d75ae2bf6] Start spawning the instance on the hypervisor. {{(pid=72382) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 15:20:41 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-4c0e184c-1d5b-43bf-8aab-4427076458a6 tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] [instance: 83ebfda8-235d-4404-a973-991d75ae2bf6] Creating instance directory {{(pid=72382) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 15:20:41 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-4c0e184c-1d5b-43bf-8aab-4427076458a6 tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] [instance: 83ebfda8-235d-4404-a973-991d75ae2bf6] Creating image(s)
Aug 09 15:20:41 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-4c0e184c-1d5b-43bf-8aab-4427076458a6 tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] [instance: 83ebfda8-235d-4404-a973-991d75ae2bf6] Did not create local disks {{(pid=72382) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 09 15:20:41 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-4c0e184c-1d5b-43bf-8aab-4427076458a6 tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] [instance: 83ebfda8-235d-4404-a973-991d75ae2bf6] Ensure instance console log exists: /opt/stack/data/nova/instances/83ebfda8-235d-4404-a973-991d75ae2bf6/console.log {{(pid=72382) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 15:20:41 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-4c0e184c-1d5b-43bf-8aab-4427076458a6 tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:20:41 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-4c0e184c-1d5b-43bf-8aab-4427076458a6 tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:20:41 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-4c0e184c-1d5b-43bf-8aab-4427076458a6 tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:20:41 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-4c0e184c-1d5b-43bf-8aab-4427076458a6 tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] [instance: 83ebfda8-235d-4404-a973-991d75ae2bf6] Start _get_guest_xml network_info=[{"id": "b2646c3a-cc2a-4782-a312-0582f2d377b1", "address": "fa:16:3e:01:06:06", "network": {"id": "2d5fadd3-a58b-4e71-971d-fa94edf0897d", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-6415310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06b73f81b4814b6f86017c2c27f8762c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2646c3a-cc", "ovs_interfaceid": "b2646c3a-cc2a-4782-a312-0582f2d377b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:1cd86701-a303-4744-bf0c-31b5314bb87d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DtKCGmgQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '83ebfda8-235d-4404-a973-991d75ae2bf6', 'attached_at': '', 'detached_at': '', 'volume_id': '1cd86701-a303-4744-bf0c-31b5314bb87d', 'serial': '1cd86701-a303-4744-bf0c-31b5314bb87d'}, 'disk_bus': 'virtio', 'attachment_id': 'c0ce4e9d-aaa7-4a58-b224-8ab0c6abb6de', 'delete_on_termination': True, 'volume_type': None} {{(pid=72382) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 15:20:41 user nova-compute[72382]: WARNING nova.virt.libvirt.driver [None req-4c0e184c-1d5b-43bf-8aab-4427076458a6 tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 15:20:41 user nova-compute[72382]: WARNING nova.virt.libvirt.driver [None req-4c0e184c-1d5b-43bf-8aab-4427076458a6 tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 15:20:41 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-4c0e184c-1d5b-43bf-8aab-4427076458a6 tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72382) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 15:20:41 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-4c0e184c-1d5b-43bf-8aab-4427076458a6 tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] CPU controller missing on host. {{(pid=72382) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 15:20:41 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-4c0e184c-1d5b-43bf-8aab-4427076458a6 tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72382) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 15:20:41 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-4c0e184c-1d5b-43bf-8aab-4427076458a6 tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] CPU controller found on host. {{(pid=72382) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 15:20:41 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-4c0e184c-1d5b-43bf-8aab-4427076458a6 tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72382) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 15:20:41 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-4c0e184c-1d5b-43bf-8aab-4427076458a6 tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T15:11:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 15:20:41 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-4c0e184c-1d5b-43bf-8aab-4427076458a6 tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] Flavor limits 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 15:20:41 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-4c0e184c-1d5b-43bf-8aab-4427076458a6 tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] Image limits 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 15:20:41 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-4c0e184c-1d5b-43bf-8aab-4427076458a6 tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] Flavor pref 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 15:20:41 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-4c0e184c-1d5b-43bf-8aab-4427076458a6 tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] Image pref 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 15:20:41 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-4c0e184c-1d5b-43bf-8aab-4427076458a6 tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 15:20:41 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-4c0e184c-1d5b-43bf-8aab-4427076458a6 tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 15:20:41 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-4c0e184c-1d5b-43bf-8aab-4427076458a6 tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72382) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 15:20:41 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-4c0e184c-1d5b-43bf-8aab-4427076458a6 tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] Got 1 possible topologies {{(pid=72382) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 15:20:41 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-4c0e184c-1d5b-43bf-8aab-4427076458a6 tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 15:20:41 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-4c0e184c-1d5b-43bf-8aab-4427076458a6 tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 15:20:42 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4c0e184c-1d5b-43bf-8aab-4427076458a6 tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] [instance: 83ebfda8-235d-4404-a973-991d75ae2bf6] Calling os-brick to attach iSCSI Volume {{(pid=72382) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 15:20:42 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c0e184c-1d5b-43bf-8aab-4427076458a6 tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2a0c768340>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:1cd86701-a303-4744-bf0c-31b5314bb87d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DtKCGmgQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 15:20:42 user nova-compute[72382]: WARNING os_brick.initiator.connectors.base [None req-4c0e184c-1d5b-43bf-8aab-4427076458a6 tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 15:20:42 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-4c0e184c-1d5b-43bf-8aab-4427076458a6 tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 15:20:42 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-4c0e184c-1d5b-43bf-8aab-4427076458a6 tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 15:20:42 user nova-compute[72382]: WARNING os_brick.initiator.connectors.base [None req-4c0e184c-1d5b-43bf-8aab-4427076458a6 tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 15:20:42 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-4c0e184c-1d5b-43bf-8aab-4427076458a6 tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1cd86701-a303-4744-bf0c-31b5314bb87d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 15:20:42 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-4c0e184c-1d5b-43bf-8aab-4427076458a6 tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1cd86701-a303-4744-bf0c-31b5314bb87d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 15:20:42 user nova-compute[72382]: INFO os_brick.initiator.connectors.iscsi [None req-4c0e184c-1d5b-43bf-8aab-4427076458a6 tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 15:20:42 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1cd86701-a303-4744-bf0c-31b5314bb87d -p 172.16.0.220:3260 {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:20:42 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1cd86701-a303-4744-bf0c-31b5314bb87d -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:20:42 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a8059de-1ef7-4597-8aca-bad8a881f004]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:20:42 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c0e184c-1d5b-43bf-8aab-4427076458a6 tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 15:20:42 user nova-compute[72382]:  {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:20:42 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1cd86701-a303-4744-bf0c-31b5314bb87d -p 172.16.0.220:3260 --interface default --op new {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:20:42 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1cd86701-a303-4744-bf0c-31b5314bb87d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:20:42 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dc1f17b-2207-4e51-837c-f075e9d462bc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1cd86701-a303-4744-bf0c-31b5314bb87d] added\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:20:42 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c0e184c-1d5b-43bf-8aab-4427076458a6 tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1cd86701-a303-4744-bf0c-31b5314bb87d] added
Aug 09 15:20:42 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:20:42 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1cd86701-a303-4744-bf0c-31b5314bb87d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:20:42 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1cd86701-a303-4744-bf0c-31b5314bb87d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:20:42 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[31d4b6ae-e5e6-49ba-a856-22ed0ff16c49]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:20:42 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c0e184c-1d5b-43bf-8aab-4427076458a6 tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:20:42 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1cd86701-a303-4744-bf0c-31b5314bb87d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:20:42 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1cd86701-a303-4744-bf0c-31b5314bb87d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:20:42 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e91c013-c696-401e-8476-3ffccdb8ac91]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:20:42 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c0e184c-1d5b-43bf-8aab-4427076458a6 tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:20:42 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1cd86701-a303-4744-bf0c-31b5314bb87d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DtKCGmgQ {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:20:42 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1cd86701-a303-4744-bf0c-31b5314bb87d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DtKCGmgQ" returned: 0 in 0.018s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:20:42 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[9af342d7-228b-4b3b-9458-7ab9bb9de93a]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:20:42 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c0e184c-1d5b-43bf-8aab-4427076458a6 tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DtKCGmgQ'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:20:42 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1cd86701-a303-4744-bf0c-31b5314bb87d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:20:42 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1cd86701-a303-4744-bf0c-31b5314bb87d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:20:42 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6108d2e-3b4f-4ac0-95b8-e5f31ecbc5df]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:20:42 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c0e184c-1d5b-43bf-8aab-4427076458a6 tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:20:42 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:20:42 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:20:42 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[9823732f-abce-49ed-899c-c274faacf4c9]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb47e85c-aaa9-4165-8be3-125572b68a87 (non-flash)\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:20:42 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c0e184c-1d5b-43bf-8aab-4427076458a6 tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)
Aug 09 15:20:42 user nova-compute[72382]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb47e85c-aaa9-4165-8be3-125572b68a87 (non-flash)
Aug 09 15:20:42 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 15:20:42 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c0e184c-1d5b-43bf-8aab-4427076458a6 tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)
Aug 09 15:20:42 user nova-compute[72382]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb47e85c-aaa9-4165-8be3-125572b68a87 (non-flash)
Aug 09 15:20:42 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 15:20:42 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1cd86701-a303-4744-bf0c-31b5314bb87d -p 172.16.0.220:3260 --login {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:20:42 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1cd86701-a303-4744-bf0c-31b5314bb87d -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:20:42 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee7465e3-8f0d-4cc9-a3ba-85fa1b69ec2b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1cd86701-a303-4744-bf0c-31b5314bb87d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1cd86701-a303-4744-bf0c-31b5314bb87d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:20:42 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c0e184c-1d5b-43bf-8aab-4427076458a6 tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1cd86701-a303-4744-bf0c-31b5314bb87d, portal: 172.16.0.220,3260]
Aug 09 15:20:42 user nova-compute[72382]: Login to [iface: default, target: iqn.2010-10.org.openstack:1cd86701-a303-4744-bf0c-31b5314bb87d, portal: 172.16.0.220,3260] successful.
Aug 09 15:20:42 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:20:42 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1cd86701-a303-4744-bf0c-31b5314bb87d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:20:42 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1cd86701-a303-4744-bf0c-31b5314bb87d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:20:42 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[21ef0b87-e06e-4161-8c64-d7b5334f3214]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:20:42 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c0e184c-1d5b-43bf-8aab-4427076458a6 tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:20:42 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:20:42 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:20:42 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d1c75bb-533d-4446-83c8-bf5ab4e07f07]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb47e85c-aaa9-4165-8be3-125572b68a87 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cd86701-a303-4744-bf0c-31b5314bb87d (non-flash)\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:20:42 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c0e184c-1d5b-43bf-8aab-4427076458a6 tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)
Aug 09 15:20:42 user nova-compute[72382]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb47e85c-aaa9-4165-8be3-125572b68a87 (non-flash)
Aug 09 15:20:42 user nova-compute[72382]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cd86701-a303-4744-bf0c-31b5314bb87d (non-flash)
Aug 09 15:20:42 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 15:20:42 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c0e184c-1d5b-43bf-8aab-4427076458a6 tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)
Aug 09 15:20:42 user nova-compute[72382]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb47e85c-aaa9-4165-8be3-125572b68a87 (non-flash)
Aug 09 15:20:42 user nova-compute[72382]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cd86701-a303-4744-bf0c-31b5314bb87d (non-flash)
Aug 09 15:20:42 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 15:20:42 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-4c0e184c-1d5b-43bf-8aab-4427076458a6 tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1cd86701-a303-4744-bf0c-31b5314bb87d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.282s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 15:20:42 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c0e184c-1d5b-43bf-8aab-4427076458a6 tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] Connected to 172.16.0.220:3260 {{(pid=72382) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 15:20:42 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-4c0e184c-1d5b-43bf-8aab-4427076458a6 tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] HCTL ('34', '-', '-', 0) found on session 17 with lun 0 {{(pid=72382) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 15:20:42 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-4c0e184c-1d5b-43bf-8aab-4427076458a6 tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72382) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 15:20:42 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:20:42 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:20:42 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1f5f1b0-eaf1-4c89-9371-847df8c390af]: (4, ('- - 0', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:20:42 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-4c0e184c-1d5b-43bf-8aab-4427076458a6 tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] Searching for a device in session 17 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72382) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 15:20:42 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c0e184c-1d5b-43bf-8aab-4427076458a6 tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DtKCGmgQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72382) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 15:20:43 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-4c0e184c-1d5b-43bf-8aab-4427076458a6 tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.315s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 15:20:43 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c0e184c-1d5b-43bf-8aab-4427076458a6 tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] <== connect_volume: return (1317ms) {'type': 'block', 'scsi_wwn': '26164646461303364', 'path': '/dev/sdc'} {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 15:20:43 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4c0e184c-1d5b-43bf-8aab-4427076458a6 tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] [instance: 83ebfda8-235d-4404-a973-991d75ae2bf6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26164646461303364', 'path': '/dev/sdc'} {{(pid=72382) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 15:20:43 user nova-compute[72382]: DEBUG nova.virt.libvirt.vif [None req-4c0e184c-1d5b-43bf-8aab-4427076458a6 tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T15:20:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1037132086',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1037132086',id=18,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK/8JZBAyiCRHjLU+07gy/t2h+p3lkIQbl96NVsR2p9wGaw/Fvc6SNhI+niTOYcEyNFmbQHRmczVv3rBDNqLPSp2H/dP3kVtyEs6hP+i37003AjknP2hCvSl6DqRbqcyoQ==',key_name='tempest-keypair-1733291193',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='06b73f81b4814b6f86017c2c27f8762c',ramdisk_id='',reservation_id='r-ndge7mr0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1877173112',owner_user_name='tempest-ServerActionsV293TestJSON-1877173112-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T15:20:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='73fe18c52fef46869d80a266455681f8',uuid=83ebfda8-235d-4404-a973-991d75ae2bf6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b2646c3a-cc2a-4782-a312-0582f2d377b1", "address": "fa:16:3e:01:06:06", "network": {"id": "2d5fadd3-a58b-4e71-971d-fa94edf0897d", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-6415310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06b73f81b4814b6f86017c2c27f8762c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2646c3a-cc", "ovs_interfaceid": "b2646c3a-cc2a-4782-a312-0582f2d377b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72382) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 15:20:43 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-4c0e184c-1d5b-43bf-8aab-4427076458a6 tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] Converting VIF {"id": "b2646c3a-cc2a-4782-a312-0582f2d377b1", "address": "fa:16:3e:01:06:06", "network": {"id": "2d5fadd3-a58b-4e71-971d-fa94edf0897d", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-6415310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06b73f81b4814b6f86017c2c27f8762c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2646c3a-cc", "ovs_interfaceid": "b2646c3a-cc2a-4782-a312-0582f2d377b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 15:20:43 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-4c0e184c-1d5b-43bf-8aab-4427076458a6 tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:01:06:06,bridge_name='br-int',has_traffic_filtering=True,id=b2646c3a-cc2a-4782-a312-0582f2d377b1,network=Network(2d5fadd3-a58b-4e71-971d-fa94edf0897d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2646c3a-cc') {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 15:20:43 user nova-compute[72382]: DEBUG nova.objects.instance [None req-4c0e184c-1d5b-43bf-8aab-4427076458a6 tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] Lazy-loading 'pci_devices' on Instance uuid 83ebfda8-235d-4404-a973-991d75ae2bf6 {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:20:43 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-4c0e184c-1d5b-43bf-8aab-4427076458a6 tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] [instance: 83ebfda8-235d-4404-a973-991d75ae2bf6] End _get_guest_xml xml=<domain type="kvm">
Aug 09 15:20:43 user nova-compute[72382]:   <uuid>83ebfda8-235d-4404-a973-991d75ae2bf6</uuid>
Aug 09 15:20:43 user nova-compute[72382]:   <name>instance-00000012</name>
Aug 09 15:20:43 user nova-compute[72382]:   <memory>524288</memory>
Aug 09 15:20:43 user nova-compute[72382]:   <vcpu>1</vcpu>
Aug 09 15:20:43 user nova-compute[72382]:   <metadata>
Aug 09 15:20:43 user nova-compute[72382]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 15:20:43 user nova-compute[72382]:       <nova:package version="0.0.0"/>
Aug 09 15:20:43 user nova-compute[72382]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1037132086</nova:name>
Aug 09 15:20:43 user nova-compute[72382]:       <nova:creationTime>2023-08-09 15:20:41</nova:creationTime>
Aug 09 15:20:43 user nova-compute[72382]:       <nova:flavor name="m1.tiny">
Aug 09 15:20:43 user nova-compute[72382]:         <nova:memory>512</nova:memory>
Aug 09 15:20:43 user nova-compute[72382]:         <nova:disk>1</nova:disk>
Aug 09 15:20:43 user nova-compute[72382]:         <nova:swap>0</nova:swap>
Aug 09 15:20:43 user nova-compute[72382]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 15:20:43 user nova-compute[72382]:         <nova:vcpus>1</nova:vcpus>
Aug 09 15:20:43 user nova-compute[72382]:       </nova:flavor>
Aug 09 15:20:43 user nova-compute[72382]:       <nova:owner>
Aug 09 15:20:43 user nova-compute[72382]:         <nova:user uuid="73fe18c52fef46869d80a266455681f8">tempest-ServerActionsV293TestJSON-1877173112-project-member</nova:user>
Aug 09 15:20:43 user nova-compute[72382]:         <nova:project uuid="06b73f81b4814b6f86017c2c27f8762c">tempest-ServerActionsV293TestJSON-1877173112</nova:project>
Aug 09 15:20:43 user nova-compute[72382]:       </nova:owner>
Aug 09 15:20:43 user nova-compute[72382]:       <nova:ports>
Aug 09 15:20:43 user nova-compute[72382]:         <nova:port uuid="b2646c3a-cc2a-4782-a312-0582f2d377b1">
Aug 09 15:20:43 user nova-compute[72382]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 09 15:20:43 user nova-compute[72382]:         </nova:port>
Aug 09 15:20:43 user nova-compute[72382]:       </nova:ports>
Aug 09 15:20:43 user nova-compute[72382]:     </nova:instance>
Aug 09 15:20:43 user nova-compute[72382]:   </metadata>
Aug 09 15:20:43 user nova-compute[72382]:   <sysinfo type="smbios">
Aug 09 15:20:43 user nova-compute[72382]:     <system>
Aug 09 15:20:43 user nova-compute[72382]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 15:20:43 user nova-compute[72382]:       <entry name="product">OpenStack Nova</entry>
Aug 09 15:20:43 user nova-compute[72382]:       <entry name="version">0.0.0</entry>
Aug 09 15:20:43 user nova-compute[72382]:       <entry name="serial">83ebfda8-235d-4404-a973-991d75ae2bf6</entry>
Aug 09 15:20:43 user nova-compute[72382]:       <entry name="uuid">83ebfda8-235d-4404-a973-991d75ae2bf6</entry>
Aug 09 15:20:43 user nova-compute[72382]:       <entry name="family">Virtual Machine</entry>
Aug 09 15:20:43 user nova-compute[72382]:     </system>
Aug 09 15:20:43 user nova-compute[72382]:   </sysinfo>
Aug 09 15:20:43 user nova-compute[72382]:   <os>
Aug 09 15:20:43 user nova-compute[72382]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 15:20:43 user nova-compute[72382]:     <boot dev="hd"/>
Aug 09 15:20:43 user nova-compute[72382]:     <smbios mode="sysinfo"/>
Aug 09 15:20:43 user nova-compute[72382]:   </os>
Aug 09 15:20:43 user nova-compute[72382]:   <features>
Aug 09 15:20:43 user nova-compute[72382]:     <acpi/>
Aug 09 15:20:43 user nova-compute[72382]:     <apic/>
Aug 09 15:20:43 user nova-compute[72382]:     <vmcoreinfo/>
Aug 09 15:20:43 user nova-compute[72382]:   </features>
Aug 09 15:20:43 user nova-compute[72382]:   <clock offset="utc">
Aug 09 15:20:43 user nova-compute[72382]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 15:20:43 user nova-compute[72382]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 15:20:43 user nova-compute[72382]:     <timer name="hpet" present="no"/>
Aug 09 15:20:43 user nova-compute[72382]:   </clock>
Aug 09 15:20:43 user nova-compute[72382]:   <cpu mode="custom" match="exact">
Aug 09 15:20:43 user nova-compute[72382]:     <model>Nehalem</model>
Aug 09 15:20:43 user nova-compute[72382]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 15:20:43 user nova-compute[72382]:   </cpu>
Aug 09 15:20:43 user nova-compute[72382]:   <devices>
Aug 09 15:20:43 user nova-compute[72382]:     <disk type="block" device="disk">
Aug 09 15:20:43 user nova-compute[72382]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 15:20:43 user nova-compute[72382]:       <source dev="/dev/sdc"/>
Aug 09 15:20:43 user nova-compute[72382]:       <target dev="vda" bus="virtio"/>
Aug 09 15:20:43 user nova-compute[72382]:       <serial>1cd86701-a303-4744-bf0c-31b5314bb87d</serial>
Aug 09 15:20:43 user nova-compute[72382]:     </disk>
Aug 09 15:20:43 user nova-compute[72382]:     <interface type="ethernet">
Aug 09 15:20:43 user nova-compute[72382]:       <mac address="fa:16:3e:01:06:06"/>
Aug 09 15:20:43 user nova-compute[72382]:       <model type="virtio"/>
Aug 09 15:20:43 user nova-compute[72382]:       <mtu size="1442"/>
Aug 09 15:20:43 user nova-compute[72382]:       <target dev="tapb2646c3a-cc"/>
Aug 09 15:20:43 user nova-compute[72382]:     </interface>
Aug 09 15:20:43 user nova-compute[72382]:     <serial type="pty">
Aug 09 15:20:43 user nova-compute[72382]:       <log file="/opt/stack/data/nova/instances/83ebfda8-235d-4404-a973-991d75ae2bf6/console.log" append="off"/>
Aug 09 15:20:43 user nova-compute[72382]:     </serial>
Aug 09 15:20:43 user nova-compute[72382]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 15:20:43 user nova-compute[72382]:     <video>
Aug 09 15:20:43 user nova-compute[72382]:       <model type="virtio"/>
Aug 09 15:20:43 user nova-compute[72382]:     </video>
Aug 09 15:20:43 user nova-compute[72382]:     <rng model="virtio">
Aug 09 15:20:43 user nova-compute[72382]:       <backend model="random">/dev/urandom</backend>
Aug 09 15:20:43 user nova-compute[72382]:     </rng>
Aug 09 15:20:43 user nova-compute[72382]:     <controller type="usb" index="0" model="none"/>
Aug 09 15:20:43 user nova-compute[72382]:     <memballoon model="virtio">
Aug 09 15:20:43 user nova-compute[72382]:       <stats period="10"/>
Aug 09 15:20:43 user nova-compute[72382]:     </memballoon>
Aug 09 15:20:43 user nova-compute[72382]:   </devices>
Aug 09 15:20:43 user nova-compute[72382]: </domain>
Aug 09 15:20:43 user nova-compute[72382]:  {{(pid=72382) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 15:20:43 user nova-compute[72382]: DEBUG nova.virt.libvirt.vif [None req-4c0e184c-1d5b-43bf-8aab-4427076458a6 tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T15:20:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1037132086',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1037132086',id=18,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK/8JZBAyiCRHjLU+07gy/t2h+p3lkIQbl96NVsR2p9wGaw/Fvc6SNhI+niTOYcEyNFmbQHRmczVv3rBDNqLPSp2H/dP3kVtyEs6hP+i37003AjknP2hCvSl6DqRbqcyoQ==',key_name='tempest-keypair-1733291193',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='06b73f81b4814b6f86017c2c27f8762c',ramdisk_id='',reservation_id='r-ndge7mr0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1877173112',owner_user_name='tempest-ServerActionsV293TestJSON-1877173112-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T15:20:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='73fe18c52fef46869d80a266455681f8',uuid=83ebfda8-235d-4404-a973-991d75ae2bf6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b2646c3a-cc2a-4782-a312-0582f2d377b1", "address": "fa:16:3e:01:06:06", "network": {"id": "2d5fadd3-a58b-4e71-971d-fa94edf0897d", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-6415310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06b73f81b4814b6f86017c2c27f8762c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2646c3a-cc", "ovs_interfaceid": "b2646c3a-cc2a-4782-a312-0582f2d377b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 15:20:43 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-4c0e184c-1d5b-43bf-8aab-4427076458a6 tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] Converting VIF {"id": "b2646c3a-cc2a-4782-a312-0582f2d377b1", "address": "fa:16:3e:01:06:06", "network": {"id": "2d5fadd3-a58b-4e71-971d-fa94edf0897d", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-6415310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06b73f81b4814b6f86017c2c27f8762c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2646c3a-cc", "ovs_interfaceid": "b2646c3a-cc2a-4782-a312-0582f2d377b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 15:20:43 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-4c0e184c-1d5b-43bf-8aab-4427076458a6 tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:01:06:06,bridge_name='br-int',has_traffic_filtering=True,id=b2646c3a-cc2a-4782-a312-0582f2d377b1,network=Network(2d5fadd3-a58b-4e71-971d-fa94edf0897d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2646c3a-cc') {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 15:20:43 user nova-compute[72382]: DEBUG os_vif [None req-4c0e184c-1d5b-43bf-8aab-4427076458a6 tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:01:06:06,bridge_name='br-int',has_traffic_filtering=True,id=b2646c3a-cc2a-4782-a312-0582f2d377b1,network=Network(2d5fadd3-a58b-4e71-971d-fa94edf0897d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2646c3a-cc') {{(pid=72382) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 15:20:43 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:20:43 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:20:43 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 15:20:43 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:20:43 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb2646c3a-cc, may_exist=True, interface_attrs={}) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:20:43 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb2646c3a-cc, col_values=(('external_ids', {'iface-id': 'b2646c3a-cc2a-4782-a312-0582f2d377b1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:01:06:06', 'vm-uuid': '83ebfda8-235d-4404-a973-991d75ae2bf6'}),), if_exists=True) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:20:43 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:20:43 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:20:43 user nova-compute[72382]: INFO os_vif [None req-4c0e184c-1d5b-43bf-8aab-4427076458a6 tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:01:06:06,bridge_name='br-int',has_traffic_filtering=True,id=b2646c3a-cc2a-4782-a312-0582f2d377b1,network=Network(2d5fadd3-a58b-4e71-971d-fa94edf0897d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2646c3a-cc')
Aug 09 15:20:43 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-4c0e184c-1d5b-43bf-8aab-4427076458a6 tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] No BDM found with device name vda, not building metadata. {{(pid=72382) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 15:20:43 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-4c0e184c-1d5b-43bf-8aab-4427076458a6 tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] No VIF found with MAC fa:16:3e:01:06:06, not building metadata {{(pid=72382) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 15:20:43 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:20:43 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:20:43 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:20:44 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:20:44 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:20:44 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:20:44 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:20:45 user nova-compute[72382]: DEBUG nova.compute.manager [req-c3e2b16f-7dc8-4bf8-81d3-83b85625152f req-c188a9cd-8404-4265-90fe-c17c211aab17 service nova] [instance: 83ebfda8-235d-4404-a973-991d75ae2bf6] Received event network-vif-plugged-b2646c3a-cc2a-4782-a312-0582f2d377b1 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:20:45 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-c3e2b16f-7dc8-4bf8-81d3-83b85625152f req-c188a9cd-8404-4265-90fe-c17c211aab17 service nova] Acquiring lock "83ebfda8-235d-4404-a973-991d75ae2bf6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:20:45 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-c3e2b16f-7dc8-4bf8-81d3-83b85625152f req-c188a9cd-8404-4265-90fe-c17c211aab17 service nova] Lock "83ebfda8-235d-4404-a973-991d75ae2bf6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:20:45 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-c3e2b16f-7dc8-4bf8-81d3-83b85625152f req-c188a9cd-8404-4265-90fe-c17c211aab17 service nova] Lock "83ebfda8-235d-4404-a973-991d75ae2bf6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:20:45 user nova-compute[72382]: DEBUG nova.compute.manager [req-c3e2b16f-7dc8-4bf8-81d3-83b85625152f req-c188a9cd-8404-4265-90fe-c17c211aab17 service nova] [instance: 83ebfda8-235d-4404-a973-991d75ae2bf6] No waiting events found dispatching network-vif-plugged-b2646c3a-cc2a-4782-a312-0582f2d377b1 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:20:45 user nova-compute[72382]: WARNING nova.compute.manager [req-c3e2b16f-7dc8-4bf8-81d3-83b85625152f req-c188a9cd-8404-4265-90fe-c17c211aab17 service nova] [instance: 83ebfda8-235d-4404-a973-991d75ae2bf6] Received unexpected event network-vif-plugged-b2646c3a-cc2a-4782-a312-0582f2d377b1 for instance with vm_state building and task_state spawning.
Aug 09 15:20:45 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:20:45 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:20:46 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:20:47 user nova-compute[72382]: DEBUG nova.compute.manager [req-652ebf4c-3aab-4ab4-aeb5-ec14bac52101 req-8f544cd0-5e2e-4ff2-8465-d7e6de794261 service nova] [instance: 83ebfda8-235d-4404-a973-991d75ae2bf6] Received event network-vif-plugged-b2646c3a-cc2a-4782-a312-0582f2d377b1 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:20:47 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-652ebf4c-3aab-4ab4-aeb5-ec14bac52101 req-8f544cd0-5e2e-4ff2-8465-d7e6de794261 service nova] Acquiring lock "83ebfda8-235d-4404-a973-991d75ae2bf6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:20:47 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-652ebf4c-3aab-4ab4-aeb5-ec14bac52101 req-8f544cd0-5e2e-4ff2-8465-d7e6de794261 service nova] Lock "83ebfda8-235d-4404-a973-991d75ae2bf6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:20:47 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-652ebf4c-3aab-4ab4-aeb5-ec14bac52101 req-8f544cd0-5e2e-4ff2-8465-d7e6de794261 service nova] Lock "83ebfda8-235d-4404-a973-991d75ae2bf6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:20:47 user nova-compute[72382]: DEBUG nova.compute.manager [req-652ebf4c-3aab-4ab4-aeb5-ec14bac52101 req-8f544cd0-5e2e-4ff2-8465-d7e6de794261 service nova] [instance: 83ebfda8-235d-4404-a973-991d75ae2bf6] No waiting events found dispatching network-vif-plugged-b2646c3a-cc2a-4782-a312-0582f2d377b1 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:20:47 user nova-compute[72382]: WARNING nova.compute.manager [req-652ebf4c-3aab-4ab4-aeb5-ec14bac52101 req-8f544cd0-5e2e-4ff2-8465-d7e6de794261 service nova] [instance: 83ebfda8-235d-4404-a973-991d75ae2bf6] Received unexpected event network-vif-plugged-b2646c3a-cc2a-4782-a312-0582f2d377b1 for instance with vm_state building and task_state spawning.
Aug 09 15:20:47 user nova-compute[72382]: DEBUG nova.virt.driver [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Emitting event <LifecycleEvent: 1691594447.4007134, 83ebfda8-235d-4404-a973-991d75ae2bf6 => Resumed> {{(pid=72382) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 15:20:47 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 83ebfda8-235d-4404-a973-991d75ae2bf6] VM Resumed (Lifecycle Event)
Aug 09 15:20:47 user nova-compute[72382]: DEBUG nova.compute.manager [None req-4c0e184c-1d5b-43bf-8aab-4427076458a6 tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] [instance: 83ebfda8-235d-4404-a973-991d75ae2bf6] Instance event wait completed in 0 seconds for  {{(pid=72382) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 15:20:47 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-4c0e184c-1d5b-43bf-8aab-4427076458a6 tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] [instance: 83ebfda8-235d-4404-a973-991d75ae2bf6] Guest created on hypervisor {{(pid=72382) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 15:20:47 user nova-compute[72382]: INFO nova.virt.libvirt.driver [-] [instance: 83ebfda8-235d-4404-a973-991d75ae2bf6] Instance spawned successfully.
Aug 09 15:20:47 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-4c0e184c-1d5b-43bf-8aab-4427076458a6 tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] [instance: 83ebfda8-235d-4404-a973-991d75ae2bf6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 15:20:47 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 83ebfda8-235d-4404-a973-991d75ae2bf6] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:20:47 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 83ebfda8-235d-4404-a973-991d75ae2bf6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72382) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 15:20:47 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-4c0e184c-1d5b-43bf-8aab-4427076458a6 tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] [instance: 83ebfda8-235d-4404-a973-991d75ae2bf6] Found default for hw_cdrom_bus of ide {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:20:47 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-4c0e184c-1d5b-43bf-8aab-4427076458a6 tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] [instance: 83ebfda8-235d-4404-a973-991d75ae2bf6] Found default for hw_disk_bus of virtio {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:20:47 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-4c0e184c-1d5b-43bf-8aab-4427076458a6 tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] [instance: 83ebfda8-235d-4404-a973-991d75ae2bf6] Found default for hw_input_bus of None {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:20:47 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-4c0e184c-1d5b-43bf-8aab-4427076458a6 tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] [instance: 83ebfda8-235d-4404-a973-991d75ae2bf6] Found default for hw_pointer_model of None {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:20:47 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-4c0e184c-1d5b-43bf-8aab-4427076458a6 tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] [instance: 83ebfda8-235d-4404-a973-991d75ae2bf6] Found default for hw_video_model of virtio {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:20:47 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-4c0e184c-1d5b-43bf-8aab-4427076458a6 tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] [instance: 83ebfda8-235d-4404-a973-991d75ae2bf6] Found default for hw_vif_model of virtio {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:20:47 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 83ebfda8-235d-4404-a973-991d75ae2bf6] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 15:20:47 user nova-compute[72382]: DEBUG nova.virt.driver [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Emitting event <LifecycleEvent: 1691594447.4027755, 83ebfda8-235d-4404-a973-991d75ae2bf6 => Started> {{(pid=72382) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 15:20:47 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 83ebfda8-235d-4404-a973-991d75ae2bf6] VM Started (Lifecycle Event)
Aug 09 15:20:47 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 83ebfda8-235d-4404-a973-991d75ae2bf6] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:20:47 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 83ebfda8-235d-4404-a973-991d75ae2bf6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72382) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 15:20:47 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 83ebfda8-235d-4404-a973-991d75ae2bf6] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 15:20:47 user nova-compute[72382]: INFO nova.compute.manager [None req-4c0e184c-1d5b-43bf-8aab-4427076458a6 tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] [instance: 83ebfda8-235d-4404-a973-991d75ae2bf6] Took 5.73 seconds to spawn the instance on the hypervisor.
Aug 09 15:20:47 user nova-compute[72382]: DEBUG nova.compute.manager [None req-4c0e184c-1d5b-43bf-8aab-4427076458a6 tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] [instance: 83ebfda8-235d-4404-a973-991d75ae2bf6] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:20:47 user nova-compute[72382]: INFO nova.compute.manager [None req-4c0e184c-1d5b-43bf-8aab-4427076458a6 tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] [instance: 83ebfda8-235d-4404-a973-991d75ae2bf6] Took 24.27 seconds to build instance.
Aug 09 15:20:47 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-4c0e184c-1d5b-43bf-8aab-4427076458a6 tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] Lock "83ebfda8-235d-4404-a973-991d75ae2bf6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 24.372s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:20:48 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:20:48 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-aaf2fadc-fe6e-41af-bc31-2c34724e77db tempest-VolumesActionsTest-536484564 tempest-VolumesActionsTest-536484564-project-member] Acquiring lock "d061ee79-0755-44a7-9929-086c274c9064" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:20:48 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-aaf2fadc-fe6e-41af-bc31-2c34724e77db tempest-VolumesActionsTest-536484564 tempest-VolumesActionsTest-536484564-project-member] Lock "d061ee79-0755-44a7-9929-086c274c9064" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:20:48 user nova-compute[72382]: DEBUG nova.compute.manager [None req-aaf2fadc-fe6e-41af-bc31-2c34724e77db tempest-VolumesActionsTest-536484564 tempest-VolumesActionsTest-536484564-project-member] [instance: d061ee79-0755-44a7-9929-086c274c9064] Starting instance... {{(pid=72382) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 15:20:48 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-aaf2fadc-fe6e-41af-bc31-2c34724e77db tempest-VolumesActionsTest-536484564 tempest-VolumesActionsTest-536484564-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:20:48 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-aaf2fadc-fe6e-41af-bc31-2c34724e77db tempest-VolumesActionsTest-536484564 tempest-VolumesActionsTest-536484564-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:20:48 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-aaf2fadc-fe6e-41af-bc31-2c34724e77db tempest-VolumesActionsTest-536484564 tempest-VolumesActionsTest-536484564-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72382) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 15:20:48 user nova-compute[72382]: INFO nova.compute.claims [None req-aaf2fadc-fe6e-41af-bc31-2c34724e77db tempest-VolumesActionsTest-536484564 tempest-VolumesActionsTest-536484564-project-member] [instance: d061ee79-0755-44a7-9929-086c274c9064] Claim successful on node user
Aug 09 15:20:48 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:20:49 user nova-compute[72382]: DEBUG nova.compute.provider_tree [None req-aaf2fadc-fe6e-41af-bc31-2c34724e77db tempest-VolumesActionsTest-536484564 tempest-VolumesActionsTest-536484564-project-member] Inventory has not changed in ProviderTree for provider: 7b15b0e5-df4d-49db-833b-2855d21d10ae {{(pid=72382) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 15:20:49 user nova-compute[72382]: DEBUG nova.scheduler.client.report [None req-aaf2fadc-fe6e-41af-bc31-2c34724e77db tempest-VolumesActionsTest-536484564 tempest-VolumesActionsTest-536484564-project-member] Inventory has not changed for provider 7b15b0e5-df4d-49db-833b-2855d21d10ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72382) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 15:20:49 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-aaf2fadc-fe6e-41af-bc31-2c34724e77db tempest-VolumesActionsTest-536484564 tempest-VolumesActionsTest-536484564-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.587s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:20:49 user nova-compute[72382]: DEBUG nova.compute.manager [None req-aaf2fadc-fe6e-41af-bc31-2c34724e77db tempest-VolumesActionsTest-536484564 tempest-VolumesActionsTest-536484564-project-member] [instance: d061ee79-0755-44a7-9929-086c274c9064] Start building networks asynchronously for instance. {{(pid=72382) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 15:20:49 user nova-compute[72382]: DEBUG nova.compute.manager [None req-aaf2fadc-fe6e-41af-bc31-2c34724e77db tempest-VolumesActionsTest-536484564 tempest-VolumesActionsTest-536484564-project-member] [instance: d061ee79-0755-44a7-9929-086c274c9064] Allocating IP information in the background. {{(pid=72382) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 15:20:49 user nova-compute[72382]: DEBUG nova.network.neutron [None req-aaf2fadc-fe6e-41af-bc31-2c34724e77db tempest-VolumesActionsTest-536484564 tempest-VolumesActionsTest-536484564-project-member] [instance: d061ee79-0755-44a7-9929-086c274c9064] allocate_for_instance() {{(pid=72382) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 15:20:49 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-aaf2fadc-fe6e-41af-bc31-2c34724e77db tempest-VolumesActionsTest-536484564 tempest-VolumesActionsTest-536484564-project-member] [instance: d061ee79-0755-44a7-9929-086c274c9064] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 15:20:49 user nova-compute[72382]: DEBUG nova.compute.manager [None req-aaf2fadc-fe6e-41af-bc31-2c34724e77db tempest-VolumesActionsTest-536484564 tempest-VolumesActionsTest-536484564-project-member] [instance: d061ee79-0755-44a7-9929-086c274c9064] Start building block device mappings for instance. {{(pid=72382) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 15:20:49 user nova-compute[72382]: DEBUG nova.policy [None req-aaf2fadc-fe6e-41af-bc31-2c34724e77db tempest-VolumesActionsTest-536484564 tempest-VolumesActionsTest-536484564-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'be6ec6133b0e451691ffeb5b710fde32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5b667ffa644ac1afe75bd518b86a4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72382) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 15:20:49 user nova-compute[72382]: DEBUG nova.compute.manager [None req-aaf2fadc-fe6e-41af-bc31-2c34724e77db tempest-VolumesActionsTest-536484564 tempest-VolumesActionsTest-536484564-project-member] [instance: d061ee79-0755-44a7-9929-086c274c9064] Start spawning the instance on the hypervisor. {{(pid=72382) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 15:20:49 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-aaf2fadc-fe6e-41af-bc31-2c34724e77db tempest-VolumesActionsTest-536484564 tempest-VolumesActionsTest-536484564-project-member] [instance: d061ee79-0755-44a7-9929-086c274c9064] Creating instance directory {{(pid=72382) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 15:20:49 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-aaf2fadc-fe6e-41af-bc31-2c34724e77db tempest-VolumesActionsTest-536484564 tempest-VolumesActionsTest-536484564-project-member] [instance: d061ee79-0755-44a7-9929-086c274c9064] Creating image(s)
Aug 09 15:20:49 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-aaf2fadc-fe6e-41af-bc31-2c34724e77db tempest-VolumesActionsTest-536484564 tempest-VolumesActionsTest-536484564-project-member] Acquiring lock "/opt/stack/data/nova/instances/d061ee79-0755-44a7-9929-086c274c9064/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:20:49 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-aaf2fadc-fe6e-41af-bc31-2c34724e77db tempest-VolumesActionsTest-536484564 tempest-VolumesActionsTest-536484564-project-member] Lock "/opt/stack/data/nova/instances/d061ee79-0755-44a7-9929-086c274c9064/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:20:49 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-aaf2fadc-fe6e-41af-bc31-2c34724e77db tempest-VolumesActionsTest-536484564 tempest-VolumesActionsTest-536484564-project-member] Lock "/opt/stack/data/nova/instances/d061ee79-0755-44a7-9929-086c274c9064/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:20:49 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-aaf2fadc-fe6e-41af-bc31-2c34724e77db tempest-VolumesActionsTest-536484564 tempest-VolumesActionsTest-536484564-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:20:49 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-b739455d-a6ee-4961-a0f3-c2fdf11e1402 tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] Acquiring lock "ea6afcf7-0b8b-43d8-af1d-9c132a659711" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:20:49 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-b739455d-a6ee-4961-a0f3-c2fdf11e1402 tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] Lock "ea6afcf7-0b8b-43d8-af1d-9c132a659711" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:20:49 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-b739455d-a6ee-4961-a0f3-c2fdf11e1402 tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] Acquiring lock "ea6afcf7-0b8b-43d8-af1d-9c132a659711-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:20:49 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-b739455d-a6ee-4961-a0f3-c2fdf11e1402 tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] Lock "ea6afcf7-0b8b-43d8-af1d-9c132a659711-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:20:49 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-b739455d-a6ee-4961-a0f3-c2fdf11e1402 tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] Lock "ea6afcf7-0b8b-43d8-af1d-9c132a659711-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:20:49 user nova-compute[72382]: INFO nova.compute.manager [None req-b739455d-a6ee-4961-a0f3-c2fdf11e1402 tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] [instance: ea6afcf7-0b8b-43d8-af1d-9c132a659711] Terminating instance
Aug 09 15:20:49 user nova-compute[72382]: DEBUG nova.compute.manager [None req-b739455d-a6ee-4961-a0f3-c2fdf11e1402 tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] [instance: ea6afcf7-0b8b-43d8-af1d-9c132a659711] Start destroying the instance on the hypervisor. {{(pid=72382) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 15:20:49 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-aaf2fadc-fe6e-41af-bc31-2c34724e77db tempest-VolumesActionsTest-536484564 tempest-VolumesActionsTest-536484564-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b --force-share --output=json" returned: 0 in 0.174s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:20:49 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-aaf2fadc-fe6e-41af-bc31-2c34724e77db tempest-VolumesActionsTest-536484564 tempest-VolumesActionsTest-536484564-project-member] Acquiring lock "383812ff437283e0191ed5b9ecc04c27f1162b0b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:20:49 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-aaf2fadc-fe6e-41af-bc31-2c34724e77db tempest-VolumesActionsTest-536484564 tempest-VolumesActionsTest-536484564-project-member] Lock "383812ff437283e0191ed5b9ecc04c27f1162b0b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:20:49 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-aaf2fadc-fe6e-41af-bc31-2c34724e77db tempest-VolumesActionsTest-536484564 tempest-VolumesActionsTest-536484564-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:20:49 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:20:49 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-aaf2fadc-fe6e-41af-bc31-2c34724e77db tempest-VolumesActionsTest-536484564 tempest-VolumesActionsTest-536484564-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b --force-share --output=json" returned: 0 in 0.170s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:20:49 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-aaf2fadc-fe6e-41af-bc31-2c34724e77db tempest-VolumesActionsTest-536484564 tempest-VolumesActionsTest-536484564-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b,backing_fmt=raw /opt/stack/data/nova/instances/d061ee79-0755-44a7-9929-086c274c9064/disk 1073741824 {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:20:49 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:20:49 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-aaf2fadc-fe6e-41af-bc31-2c34724e77db tempest-VolumesActionsTest-536484564 tempest-VolumesActionsTest-536484564-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b,backing_fmt=raw /opt/stack/data/nova/instances/d061ee79-0755-44a7-9929-086c274c9064/disk 1073741824" returned: 0 in 0.075s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:20:49 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-aaf2fadc-fe6e-41af-bc31-2c34724e77db tempest-VolumesActionsTest-536484564 tempest-VolumesActionsTest-536484564-project-member] Lock "383812ff437283e0191ed5b9ecc04c27f1162b0b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.251s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:20:49 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-aaf2fadc-fe6e-41af-bc31-2c34724e77db tempest-VolumesActionsTest-536484564 tempest-VolumesActionsTest-536484564-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:20:50 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-aaf2fadc-fe6e-41af-bc31-2c34724e77db tempest-VolumesActionsTest-536484564 tempest-VolumesActionsTest-536484564-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b --force-share --output=json" returned: 0 in 0.210s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:20:50 user nova-compute[72382]: DEBUG nova.virt.disk.api [None req-aaf2fadc-fe6e-41af-bc31-2c34724e77db tempest-VolumesActionsTest-536484564 tempest-VolumesActionsTest-536484564-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d061ee79-0755-44a7-9929-086c274c9064/disk. size=1073741824 {{(pid=72382) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 15:20:50 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-aaf2fadc-fe6e-41af-bc31-2c34724e77db tempest-VolumesActionsTest-536484564 tempest-VolumesActionsTest-536484564-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d061ee79-0755-44a7-9929-086c274c9064/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:20:50 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:20:50 user nova-compute[72382]: DEBUG nova.compute.manager [req-3cb7c06b-a7d3-47d8-b473-7439ea5e9c11 req-8d32c9f8-9001-4d2a-bd28-c47def3f88f4 service nova] [instance: ea6afcf7-0b8b-43d8-af1d-9c132a659711] Received event network-vif-unplugged-4bb8ca7e-4ce8-4fc1-a5d0-4e3b5e796338 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:20:50 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-3cb7c06b-a7d3-47d8-b473-7439ea5e9c11 req-8d32c9f8-9001-4d2a-bd28-c47def3f88f4 service nova] Acquiring lock "ea6afcf7-0b8b-43d8-af1d-9c132a659711-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:20:50 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-3cb7c06b-a7d3-47d8-b473-7439ea5e9c11 req-8d32c9f8-9001-4d2a-bd28-c47def3f88f4 service nova] Lock "ea6afcf7-0b8b-43d8-af1d-9c132a659711-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:20:50 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-3cb7c06b-a7d3-47d8-b473-7439ea5e9c11 req-8d32c9f8-9001-4d2a-bd28-c47def3f88f4 service nova] Lock "ea6afcf7-0b8b-43d8-af1d-9c132a659711-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:20:50 user nova-compute[72382]: DEBUG nova.compute.manager [req-3cb7c06b-a7d3-47d8-b473-7439ea5e9c11 req-8d32c9f8-9001-4d2a-bd28-c47def3f88f4 service nova] [instance: ea6afcf7-0b8b-43d8-af1d-9c132a659711] No waiting events found dispatching network-vif-unplugged-4bb8ca7e-4ce8-4fc1-a5d0-4e3b5e796338 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:20:50 user nova-compute[72382]: DEBUG nova.compute.manager [req-3cb7c06b-a7d3-47d8-b473-7439ea5e9c11 req-8d32c9f8-9001-4d2a-bd28-c47def3f88f4 service nova] [instance: ea6afcf7-0b8b-43d8-af1d-9c132a659711] Received event network-vif-unplugged-4bb8ca7e-4ce8-4fc1-a5d0-4e3b5e796338 for instance with task_state deleting. {{(pid=72382) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 15:20:50 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-aaf2fadc-fe6e-41af-bc31-2c34724e77db tempest-VolumesActionsTest-536484564 tempest-VolumesActionsTest-536484564-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d061ee79-0755-44a7-9929-086c274c9064/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:20:50 user nova-compute[72382]: DEBUG nova.virt.disk.api [None req-aaf2fadc-fe6e-41af-bc31-2c34724e77db tempest-VolumesActionsTest-536484564 tempest-VolumesActionsTest-536484564-project-member] Cannot resize image /opt/stack/data/nova/instances/d061ee79-0755-44a7-9929-086c274c9064/disk to a smaller size. {{(pid=72382) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 15:20:50 user nova-compute[72382]: DEBUG nova.objects.instance [None req-aaf2fadc-fe6e-41af-bc31-2c34724e77db tempest-VolumesActionsTest-536484564 tempest-VolumesActionsTest-536484564-project-member] Lazy-loading 'migration_context' on Instance uuid d061ee79-0755-44a7-9929-086c274c9064 {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:20:50 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-aaf2fadc-fe6e-41af-bc31-2c34724e77db tempest-VolumesActionsTest-536484564 tempest-VolumesActionsTest-536484564-project-member] [instance: d061ee79-0755-44a7-9929-086c274c9064] Created local disks {{(pid=72382) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 15:20:50 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-aaf2fadc-fe6e-41af-bc31-2c34724e77db tempest-VolumesActionsTest-536484564 tempest-VolumesActionsTest-536484564-project-member] [instance: d061ee79-0755-44a7-9929-086c274c9064] Ensure instance console log exists: /opt/stack/data/nova/instances/d061ee79-0755-44a7-9929-086c274c9064/console.log {{(pid=72382) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 15:20:50 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-aaf2fadc-fe6e-41af-bc31-2c34724e77db tempest-VolumesActionsTest-536484564 tempest-VolumesActionsTest-536484564-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:20:50 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-aaf2fadc-fe6e-41af-bc31-2c34724e77db tempest-VolumesActionsTest-536484564 tempest-VolumesActionsTest-536484564-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:20:50 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-aaf2fadc-fe6e-41af-bc31-2c34724e77db tempest-VolumesActionsTest-536484564 tempest-VolumesActionsTest-536484564-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:20:50 user nova-compute[72382]: INFO nova.virt.libvirt.driver [-] [instance: ea6afcf7-0b8b-43d8-af1d-9c132a659711] Instance destroyed successfully.
Aug 09 15:20:50 user nova-compute[72382]: DEBUG nova.objects.instance [None req-b739455d-a6ee-4961-a0f3-c2fdf11e1402 tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] Lazy-loading 'resources' on Instance uuid ea6afcf7-0b8b-43d8-af1d-9c132a659711 {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:20:50 user nova-compute[72382]: DEBUG nova.virt.libvirt.vif [None req-b739455d-a6ee-4961-a0f3-c2fdf11e1402 tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T15:18:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1136496910',display_name='tempest-VolumesAdminNegativeTest-server-1136496910',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1136496910',id=15,image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-09T15:18:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3b98e20f61c34fd6aa28cef7ceadf0d3',ramdisk_id='',reservation_id='r-78uiuzca',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-993781103',owner_user_name='tempest-VolumesAdminNegativeTest-993781103-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T15:18:51Z,user_data=None,user_id='374f2148fb524924acc7e1e968e73fe1',uuid=ea6afcf7-0b8b-43d8-af1d-9c132a659711,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4bb8ca7e-4ce8-4fc1-a5d0-4e3b5e796338", "address": "fa:16:3e:ea:a3:a5", "network": {"id": "1a0f18df-96f2-4c90-8e53-fcbfc8f17bc4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1771770150-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b98e20f61c34fd6aa28cef7ceadf0d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4bb8ca7e-4c", "ovs_interfaceid": "4bb8ca7e-4ce8-4fc1-a5d0-4e3b5e796338", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 15:20:50 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-b739455d-a6ee-4961-a0f3-c2fdf11e1402 tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] Converting VIF {"id": "4bb8ca7e-4ce8-4fc1-a5d0-4e3b5e796338", "address": "fa:16:3e:ea:a3:a5", "network": {"id": "1a0f18df-96f2-4c90-8e53-fcbfc8f17bc4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1771770150-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b98e20f61c34fd6aa28cef7ceadf0d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4bb8ca7e-4c", "ovs_interfaceid": "4bb8ca7e-4ce8-4fc1-a5d0-4e3b5e796338", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 15:20:50 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-b739455d-a6ee-4961-a0f3-c2fdf11e1402 tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ea:a3:a5,bridge_name='br-int',has_traffic_filtering=True,id=4bb8ca7e-4ce8-4fc1-a5d0-4e3b5e796338,network=Network(1a0f18df-96f2-4c90-8e53-fcbfc8f17bc4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4bb8ca7e-4c') {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 15:20:50 user nova-compute[72382]: DEBUG os_vif [None req-b739455d-a6ee-4961-a0f3-c2fdf11e1402 tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:a3:a5,bridge_name='br-int',has_traffic_filtering=True,id=4bb8ca7e-4ce8-4fc1-a5d0-4e3b5e796338,network=Network(1a0f18df-96f2-4c90-8e53-fcbfc8f17bc4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4bb8ca7e-4c') {{(pid=72382) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 15:20:50 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:20:50 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4bb8ca7e-4c, bridge=br-int, if_exists=True) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:20:50 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:20:50 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:20:50 user nova-compute[72382]: INFO os_vif [None req-b739455d-a6ee-4961-a0f3-c2fdf11e1402 tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:a3:a5,bridge_name='br-int',has_traffic_filtering=True,id=4bb8ca7e-4ce8-4fc1-a5d0-4e3b5e796338,network=Network(1a0f18df-96f2-4c90-8e53-fcbfc8f17bc4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4bb8ca7e-4c')
Aug 09 15:20:50 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-b739455d-a6ee-4961-a0f3-c2fdf11e1402 tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] [instance: ea6afcf7-0b8b-43d8-af1d-9c132a659711] Deleting instance files /opt/stack/data/nova/instances/ea6afcf7-0b8b-43d8-af1d-9c132a659711_del
Aug 09 15:20:50 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-b739455d-a6ee-4961-a0f3-c2fdf11e1402 tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] [instance: ea6afcf7-0b8b-43d8-af1d-9c132a659711] Deletion of /opt/stack/data/nova/instances/ea6afcf7-0b8b-43d8-af1d-9c132a659711_del complete
Aug 09 15:20:50 user nova-compute[72382]: DEBUG nova.network.neutron [None req-aaf2fadc-fe6e-41af-bc31-2c34724e77db tempest-VolumesActionsTest-536484564 tempest-VolumesActionsTest-536484564-project-member] [instance: d061ee79-0755-44a7-9929-086c274c9064] Successfully created port: b88483f9-249f-473e-a1eb-fee83c57a89b {{(pid=72382) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 15:20:50 user nova-compute[72382]: INFO nova.compute.manager [None req-b739455d-a6ee-4961-a0f3-c2fdf11e1402 tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] [instance: ea6afcf7-0b8b-43d8-af1d-9c132a659711] Took 1.06 seconds to destroy the instance on the hypervisor.
Aug 09 15:20:50 user nova-compute[72382]: DEBUG oslo.service.loopingcall [None req-b739455d-a6ee-4961-a0f3-c2fdf11e1402 tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72382) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 15:20:50 user nova-compute[72382]: DEBUG nova.compute.manager [-] [instance: ea6afcf7-0b8b-43d8-af1d-9c132a659711] Deallocating network for instance {{(pid=72382) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 15:20:50 user nova-compute[72382]: DEBUG nova.network.neutron [-] [instance: ea6afcf7-0b8b-43d8-af1d-9c132a659711] deallocate_for_instance() {{(pid=72382) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 15:20:51 user nova-compute[72382]: DEBUG nova.network.neutron [-] [instance: ea6afcf7-0b8b-43d8-af1d-9c132a659711] Updating instance_info_cache with network_info: [] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:20:51 user nova-compute[72382]: INFO nova.compute.manager [-] [instance: ea6afcf7-0b8b-43d8-af1d-9c132a659711] Took 1.26 seconds to deallocate network for instance.
Aug 09 15:20:51 user nova-compute[72382]: DEBUG nova.compute.manager [req-eeba3e91-2430-425a-a9af-d3c8fb0c1dbc req-6902028f-b83c-44f4-9989-bf3d3568f0f0 service nova] [instance: ea6afcf7-0b8b-43d8-af1d-9c132a659711] Received event network-vif-deleted-4bb8ca7e-4ce8-4fc1-a5d0-4e3b5e796338 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:20:52 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-b739455d-a6ee-4961-a0f3-c2fdf11e1402 tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:20:52 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-b739455d-a6ee-4961-a0f3-c2fdf11e1402 tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:20:52 user nova-compute[72382]: DEBUG nova.compute.manager [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] [instance: cff2fb57-7d0b-4278-89ed-10a8ec5128ea] Start spawning the instance on the hypervisor. {{(pid=72382) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 15:20:52 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] [instance: cff2fb57-7d0b-4278-89ed-10a8ec5128ea] Creating instance directory {{(pid=72382) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 15:20:52 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] [instance: cff2fb57-7d0b-4278-89ed-10a8ec5128ea] Creating image(s)
Aug 09 15:20:52 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] [instance: cff2fb57-7d0b-4278-89ed-10a8ec5128ea] Did not create local disks {{(pid=72382) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 09 15:20:52 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] [instance: cff2fb57-7d0b-4278-89ed-10a8ec5128ea] Ensure instance console log exists: /opt/stack/data/nova/instances/cff2fb57-7d0b-4278-89ed-10a8ec5128ea/console.log {{(pid=72382) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 15:20:52 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:20:52 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:20:52 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:20:52 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] [instance: cff2fb57-7d0b-4278-89ed-10a8ec5128ea] Start _get_guest_xml network_info=[{"id": "477e93e2-c6aa-47e7-bed7-62b4bb29a9ea", "address": "fa:16:3e:46:0b:d6", "network": {"id": "5f1aee90-5c93-4fe5-a140-7e3ac136489f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1100115541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42fe649aa7cd43678bd4f2cb24f45e18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap477e93e2-c6", "ovs_interfaceid": "477e93e2-c6aa-47e7-bed7-62b4bb29a9ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "55cf98ab-8cd2-4704-971f-ee4ceebca331", "address": "fa:16:3e:8c:34:e0", "network": {"id": "dc656a4e-c46c-4821-b492-2376b82b26ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-2053726028", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "42fe649aa7cd43678bd4f2cb24f45e18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55cf98ab-8c", "ovs_interfaceid": "55cf98ab-8cd2-4704-971f-ee4ceebca331", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "baeec4fc-3670-49f3-b42c-aab5ea116f45", "address": "fa:16:3e:72:b4:02", "network": {"id": "dc656a4e-c46c-4821-b492-2376b82b26ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-2053726028", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.135", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "42fe649aa7cd43678bd4f2cb24f45e18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbaeec4fc-36", "ovs_interfaceid": "baeec4fc-3670-49f3-b42c-aab5ea116f45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "17d8899d-82c0-4a46-97de-31253f7d1b82", "address": "fa:16:3e:7b:f5:ee", "network": {"id": "dc656a4e-c46c-4821-b492-2376b82b26ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-2053726028", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.153", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "42fe649aa7cd43678bd4f2cb24f45e18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17d8899d-82", "ovs_interfaceid": "17d8899d-82c0-4a46-97de-31253f7d1b82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ce3acf5c-2e65-4650-aade-158b96a7d349", "address": "fa:16:3e:ff:b7:1e", "network": {"id": "dc656a4e-c46c-4821-b492-2376b82b26ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-2053726028", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.132", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "42fe649aa7cd43678bd4f2cb24f45e18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce3acf5c-2e", "ovs_interfaceid": "ce3acf5c-2e65-4650-aade-158b96a7d349", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "802211f2-fc95-4940-87bf-eb0658b56ff1", "address": "fa:16:3e:dd:68:92", "network": {"id": "c8d9a670-b921-4ea7-bc32-64ef779aa86c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1431242330", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "42fe649aa7cd43678bd4f2cb24f45e18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap802211f2-fc", "ovs_interfaceid": "802211f2-fc95-4940-87bf-eb0658b56ff1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bcf9d83a-a145-4d83-9df6-02eba42f64bf", "address": "fa:16:3e:98:67:3f", "network": {"id": "c8d9a670-b921-4ea7-bc32-64ef779aa86c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1431242330", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "42fe649aa7cd43678bd4f2cb24f45e18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcf9d83a-a1", "ovs_interfaceid": "bcf9d83a-a145-4d83-9df6-02eba42f64bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T15:11:25Z,direct_url=<?>,disk_format='qcow2',id=a79f2cea-eb27-4631-aaf3-05e7d9e411b4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a638990e12cc4d6eabb6d55e13be6bdf',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T15:11:27Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:e8bad821-ddd1-4287-806d-78ffdc34fa68'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nTJNhKOi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'cff2fb57-7d0b-4278-89ed-10a8ec5128ea', 'attached_at': '', 'detached_at': '', 'volume_id': 'e8bad821-ddd1-4287-806d-78ffdc34fa68', 'serial': 'e8bad821-ddd1-4287-806d-78ffdc34fa68'}, 'disk_bus': 'virtio', 'attachment_id': 'ba2ab33b-230b-4f12-a019-79f141c5235e', 'delete_on_termination': False, 'volume_type': None}, {'guest_format': None, 'device_type': 'disk', 'boot_index': 1, 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:184b0159-3cae-4d79-86b3-26a58437eb09'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oyhkXTmn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'cff2fb57-7d0b-4278-89ed-10a8ec5128ea', 'attached_at': '', 'detached_at': '', 'volume_id': '184b0159-3cae-4d79-86b3-26a58437eb09', 'serial': '184b0159-3cae-4d79-86b3-26a58437eb09'}, 'disk_bus': 'virtio', 'attachment_id': '34c5c983-c5bc-4871-a9eb-5569c9d5870f', 'delete_on_termination': False, 'volume_type': None}, {'guest_format': None, 'device_type': 'disk', 'boot_index': 2, 'mount_device': '/dev/vdc', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:1c6be653-7ab8-4b40-9e28-43c1eca5e016'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lHczEwXN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'cff2fb57-7d0b-4278-89ed-10a8ec5128ea', 'attached_at': '', 'detached_at': '', 'volume_id': '1c6be653-7ab8-4b40-9e28-43c1eca5e016', 'serial': '1c6be653-7ab8-4b40-9e28-43c1eca5e016'}, 'disk_bus': 'virtio', 'attachment_id': '9b00728e-2eb0-41d2-b222-00ba3c2c6ae5', 'delete_on_termination': False, 'volume_type': None} {{(pid=72382) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 15:20:52 user nova-compute[72382]: WARNING nova.virt.libvirt.driver [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 15:20:52 user nova-compute[72382]: WARNING nova.virt.libvirt.driver [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 15:20:52 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72382) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 15:20:52 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] CPU controller missing on host. {{(pid=72382) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 15:20:52 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72382) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 15:20:52 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] CPU controller found on host. {{(pid=72382) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 15:20:52 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72382) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 15:20:52 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T15:11:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T15:11:25Z,direct_url=<?>,disk_format='qcow2',id=a79f2cea-eb27-4631-aaf3-05e7d9e411b4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a638990e12cc4d6eabb6d55e13be6bdf',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T15:11:27Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 15:20:52 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] Flavor limits 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 15:20:52 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] Image limits 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 15:20:52 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] Flavor pref 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 15:20:52 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] Image pref 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 15:20:52 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 15:20:52 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 15:20:52 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72382) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 15:20:52 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] Got 1 possible topologies {{(pid=72382) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 15:20:52 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 15:20:52 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 15:20:52 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] [instance: cff2fb57-7d0b-4278-89ed-10a8ec5128ea] Calling os-brick to attach iSCSI Volume {{(pid=72382) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 15:20:52 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2a0c768340>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:e8bad821-ddd1-4287-806d-78ffdc34fa68'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nTJNhKOi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 15:20:52 user nova-compute[72382]: WARNING os_brick.initiator.connectors.base [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 15:20:52 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 15:20:52 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 15:20:52 user nova-compute[72382]: WARNING os_brick.initiator.connectors.base [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 15:20:52 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e8bad821-ddd1-4287-806d-78ffdc34fa68" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 15:20:52 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e8bad821-ddd1-4287-806d-78ffdc34fa68" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 15:20:52 user nova-compute[72382]: INFO os_brick.initiator.connectors.iscsi [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 15:20:52 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8bad821-ddd1-4287-806d-78ffdc34fa68 -p 172.16.0.220:3260 {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:20:52 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8bad821-ddd1-4287-806d-78ffdc34fa68 -p 172.16.0.220:3260" returned: 21 in 0.026s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:20:52 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b82f737-a7aa-4a1f-8be4-cc4294619fd7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:20:52 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 15:20:52 user nova-compute[72382]:  {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:20:52 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8bad821-ddd1-4287-806d-78ffdc34fa68 -p 172.16.0.220:3260 --interface default --op new {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:20:52 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8bad821-ddd1-4287-806d-78ffdc34fa68 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.031s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:20:52 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[7947824c-5677-408e-93df-7aba6a97c170]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e8bad821-ddd1-4287-806d-78ffdc34fa68] added\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:20:52 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e8bad821-ddd1-4287-806d-78ffdc34fa68] added
Aug 09 15:20:52 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:20:52 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8bad821-ddd1-4287-806d-78ffdc34fa68 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:20:52 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8bad821-ddd1-4287-806d-78ffdc34fa68 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:20:52 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[b79e1b4b-8aa4-4ba0-b01b-09fd7a696b48]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:20:52 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:20:52 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8bad821-ddd1-4287-806d-78ffdc34fa68 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:20:52 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8bad821-ddd1-4287-806d-78ffdc34fa68 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.034s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:20:52 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[609a5133-9dfa-42e4-8ba7-7200e4beba56]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:20:52 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:20:52 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8bad821-ddd1-4287-806d-78ffdc34fa68 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nTJNhKOi {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:20:52 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8bad821-ddd1-4287-806d-78ffdc34fa68 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nTJNhKOi" returned: 0 in 0.021s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:20:52 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[d699c288-ba6c-4a55-a7d1-2c59de5c12b4]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:20:52 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nTJNhKOi'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:20:52 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8bad821-ddd1-4287-806d-78ffdc34fa68 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:20:52 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8bad821-ddd1-4287-806d-78ffdc34fa68 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:20:52 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[acaeab72-59a7-48bb-82e2-6500db2e5f32]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:20:52 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:20:52 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:20:52 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:20:52 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d494064-c68b-444e-a9f0-85bc96bcfb50]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb47e85c-aaa9-4165-8be3-125572b68a87 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cd86701-a303-4744-bf0c-31b5314bb87d (non-flash)\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:20:52 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)
Aug 09 15:20:52 user nova-compute[72382]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb47e85c-aaa9-4165-8be3-125572b68a87 (non-flash)
Aug 09 15:20:52 user nova-compute[72382]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cd86701-a303-4744-bf0c-31b5314bb87d (non-flash)
Aug 09 15:20:52 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 15:20:52 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)
Aug 09 15:20:52 user nova-compute[72382]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb47e85c-aaa9-4165-8be3-125572b68a87 (non-flash)
Aug 09 15:20:52 user nova-compute[72382]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cd86701-a303-4744-bf0c-31b5314bb87d (non-flash)
Aug 09 15:20:52 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 15:20:52 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8bad821-ddd1-4287-806d-78ffdc34fa68 -p 172.16.0.220:3260 --login {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:20:52 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8bad821-ddd1-4287-806d-78ffdc34fa68 -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:20:52 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[b372faaf-a0a2-4604-b82f-e90e6bc3f9e0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e8bad821-ddd1-4287-806d-78ffdc34fa68, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e8bad821-ddd1-4287-806d-78ffdc34fa68, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:20:52 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e8bad821-ddd1-4287-806d-78ffdc34fa68, portal: 172.16.0.220,3260]
Aug 09 15:20:52 user nova-compute[72382]: Login to [iface: default, target: iqn.2010-10.org.openstack:e8bad821-ddd1-4287-806d-78ffdc34fa68, portal: 172.16.0.220,3260] successful.
Aug 09 15:20:52 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:20:52 user nova-compute[72382]: DEBUG nova.compute.manager [req-deaa833d-2748-45bc-aa11-d146fe28aada req-6d49e7d6-6c98-4e47-aba6-340c82b1ebe8 service nova] [instance: ea6afcf7-0b8b-43d8-af1d-9c132a659711] Received event network-vif-plugged-4bb8ca7e-4ce8-4fc1-a5d0-4e3b5e796338 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:20:52 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-deaa833d-2748-45bc-aa11-d146fe28aada req-6d49e7d6-6c98-4e47-aba6-340c82b1ebe8 service nova] Acquiring lock "ea6afcf7-0b8b-43d8-af1d-9c132a659711-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:20:52 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-deaa833d-2748-45bc-aa11-d146fe28aada req-6d49e7d6-6c98-4e47-aba6-340c82b1ebe8 service nova] Lock "ea6afcf7-0b8b-43d8-af1d-9c132a659711-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:20:52 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-deaa833d-2748-45bc-aa11-d146fe28aada req-6d49e7d6-6c98-4e47-aba6-340c82b1ebe8 service nova] Lock "ea6afcf7-0b8b-43d8-af1d-9c132a659711-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:20:52 user nova-compute[72382]: DEBUG nova.compute.manager [req-deaa833d-2748-45bc-aa11-d146fe28aada req-6d49e7d6-6c98-4e47-aba6-340c82b1ebe8 service nova] [instance: ea6afcf7-0b8b-43d8-af1d-9c132a659711] No waiting events found dispatching network-vif-plugged-4bb8ca7e-4ce8-4fc1-a5d0-4e3b5e796338 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:20:52 user nova-compute[72382]: WARNING nova.compute.manager [req-deaa833d-2748-45bc-aa11-d146fe28aada req-6d49e7d6-6c98-4e47-aba6-340c82b1ebe8 service nova] [instance: ea6afcf7-0b8b-43d8-af1d-9c132a659711] Received unexpected event network-vif-plugged-4bb8ca7e-4ce8-4fc1-a5d0-4e3b5e796338 for instance with vm_state deleted and task_state None.
Aug 09 15:20:52 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8bad821-ddd1-4287-806d-78ffdc34fa68 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:20:52 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8bad821-ddd1-4287-806d-78ffdc34fa68 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:20:52 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[a947d843-d222-4a65-9356-85a1ace20731]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:20:52 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:20:52 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:20:52 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:20:52 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[8172883c-aeed-4dec-81e5-bd2749e004e3]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb47e85c-aaa9-4165-8be3-125572b68a87 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cd86701-a303-4744-bf0c-31b5314bb87d (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8bad821-ddd1-4287-806d-78ffdc34fa68 (non-flash)\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:20:52 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)
Aug 09 15:20:52 user nova-compute[72382]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb47e85c-aaa9-4165-8be3-125572b68a87 (non-flash)
Aug 09 15:20:52 user nova-compute[72382]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cd86701-a303-4744-bf0c-31b5314bb87d (non-flash)
Aug 09 15:20:52 user nova-compute[72382]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8bad821-ddd1-4287-806d-78ffdc34fa68 (non-flash)
Aug 09 15:20:52 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 15:20:52 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)
Aug 09 15:20:52 user nova-compute[72382]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb47e85c-aaa9-4165-8be3-125572b68a87 (non-flash)
Aug 09 15:20:52 user nova-compute[72382]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cd86701-a303-4744-bf0c-31b5314bb87d (non-flash)
Aug 09 15:20:52 user nova-compute[72382]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8bad821-ddd1-4287-806d-78ffdc34fa68 (non-flash)
Aug 09 15:20:52 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 15:20:52 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e8bad821-ddd1-4287-806d-78ffdc34fa68" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.372s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 15:20:52 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] Connected to 172.16.0.220:3260 {{(pid=72382) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 15:20:52 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] HCTL ('36', '-', '-', 0) found on session 18 with lun 0 {{(pid=72382) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 15:20:52 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72382) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 15:20:52 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:20:52 user nova-compute[72382]: DEBUG nova.compute.provider_tree [None req-b739455d-a6ee-4961-a0f3-c2fdf11e1402 tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] Inventory has not changed in ProviderTree for provider: 7b15b0e5-df4d-49db-833b-2855d21d10ae {{(pid=72382) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 15:20:52 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.023s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:20:52 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ce22c59-2bb0-4a52-85cd-411e39deb412]: (4, ('- - 0', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:20:52 user nova-compute[72382]: DEBUG nova.scheduler.client.report [None req-b739455d-a6ee-4961-a0f3-c2fdf11e1402 tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] Inventory has not changed for provider 7b15b0e5-df4d-49db-833b-2855d21d10ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72382) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 15:20:52 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] Searching for a device in session 18 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72382) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 15:20:52 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nTJNhKOi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72382) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 15:20:52 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-b739455d-a6ee-4961-a0f3-c2fdf11e1402 tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.591s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:20:52 user nova-compute[72382]: INFO nova.scheduler.client.report [None req-b739455d-a6ee-4961-a0f3-c2fdf11e1402 tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] Deleted allocations for instance ea6afcf7-0b8b-43d8-af1d-9c132a659711
Aug 09 15:20:52 user nova-compute[72382]: DEBUG nova.network.neutron [None req-aaf2fadc-fe6e-41af-bc31-2c34724e77db tempest-VolumesActionsTest-536484564 tempest-VolumesActionsTest-536484564-project-member] [instance: d061ee79-0755-44a7-9929-086c274c9064] Successfully updated port: b88483f9-249f-473e-a1eb-fee83c57a89b {{(pid=72382) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 15:20:52 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-aaf2fadc-fe6e-41af-bc31-2c34724e77db tempest-VolumesActionsTest-536484564 tempest-VolumesActionsTest-536484564-project-member] Acquiring lock "refresh_cache-d061ee79-0755-44a7-9929-086c274c9064" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 15:20:52 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-aaf2fadc-fe6e-41af-bc31-2c34724e77db tempest-VolumesActionsTest-536484564 tempest-VolumesActionsTest-536484564-project-member] Acquired lock "refresh_cache-d061ee79-0755-44a7-9929-086c274c9064" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 15:20:52 user nova-compute[72382]: DEBUG nova.network.neutron [None req-aaf2fadc-fe6e-41af-bc31-2c34724e77db tempest-VolumesActionsTest-536484564 tempest-VolumesActionsTest-536484564-project-member] [instance: d061ee79-0755-44a7-9929-086c274c9064] Building network info cache for instance {{(pid=72382) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 15:20:52 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-b739455d-a6ee-4961-a0f3-c2fdf11e1402 tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] Lock "ea6afcf7-0b8b-43d8-af1d-9c132a659711" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.187s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:20:52 user nova-compute[72382]: DEBUG nova.network.neutron [None req-aaf2fadc-fe6e-41af-bc31-2c34724e77db tempest-VolumesActionsTest-536484564 tempest-VolumesActionsTest-536484564-project-member] [instance: d061ee79-0755-44a7-9929-086c274c9064] Instance cache missing network info. {{(pid=72382) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 15:20:53 user nova-compute[72382]: DEBUG nova.network.neutron [None req-aaf2fadc-fe6e-41af-bc31-2c34724e77db tempest-VolumesActionsTest-536484564 tempest-VolumesActionsTest-536484564-project-member] [instance: d061ee79-0755-44a7-9929-086c274c9064] Updating instance_info_cache with network_info: [{"id": "b88483f9-249f-473e-a1eb-fee83c57a89b", "address": "fa:16:3e:28:6f:53", "network": {"id": "8cff6610-5196-4dc5-8213-fd83c40bf2b9", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2098434591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb5b667ffa644ac1afe75bd518b86a4d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb88483f9-24", "ovs_interfaceid": "b88483f9-249f-473e-a1eb-fee83c57a89b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:20:53 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-aaf2fadc-fe6e-41af-bc31-2c34724e77db tempest-VolumesActionsTest-536484564 tempest-VolumesActionsTest-536484564-project-member] Releasing lock "refresh_cache-d061ee79-0755-44a7-9929-086c274c9064" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 15:20:53 user nova-compute[72382]: DEBUG nova.compute.manager [None req-aaf2fadc-fe6e-41af-bc31-2c34724e77db tempest-VolumesActionsTest-536484564 tempest-VolumesActionsTest-536484564-project-member] [instance: d061ee79-0755-44a7-9929-086c274c9064] Instance network_info: |[{"id": "b88483f9-249f-473e-a1eb-fee83c57a89b", "address": "fa:16:3e:28:6f:53", "network": {"id": "8cff6610-5196-4dc5-8213-fd83c40bf2b9", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2098434591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb5b667ffa644ac1afe75bd518b86a4d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb88483f9-24", "ovs_interfaceid": "b88483f9-249f-473e-a1eb-fee83c57a89b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72382) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 15:20:53 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-aaf2fadc-fe6e-41af-bc31-2c34724e77db tempest-VolumesActionsTest-536484564 tempest-VolumesActionsTest-536484564-project-member] [instance: d061ee79-0755-44a7-9929-086c274c9064] Start _get_guest_xml network_info=[{"id": "b88483f9-249f-473e-a1eb-fee83c57a89b", "address": "fa:16:3e:28:6f:53", "network": {"id": "8cff6610-5196-4dc5-8213-fd83c40bf2b9", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2098434591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb5b667ffa644ac1afe75bd518b86a4d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb88483f9-24", "ovs_interfaceid": "b88483f9-249f-473e-a1eb-fee83c57a89b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T15:11:25Z,direct_url=<?>,disk_format='qcow2',id=a79f2cea-eb27-4631-aaf3-05e7d9e411b4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a638990e12cc4d6eabb6d55e13be6bdf',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T15:11:27Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'a79f2cea-eb27-4631-aaf3-05e7d9e411b4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72382) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 15:20:53 user nova-compute[72382]: WARNING nova.virt.libvirt.driver [None req-aaf2fadc-fe6e-41af-bc31-2c34724e77db tempest-VolumesActionsTest-536484564 tempest-VolumesActionsTest-536484564-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 15:20:53 user nova-compute[72382]: WARNING nova.virt.libvirt.driver [None req-aaf2fadc-fe6e-41af-bc31-2c34724e77db tempest-VolumesActionsTest-536484564 tempest-VolumesActionsTest-536484564-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 15:20:53 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-aaf2fadc-fe6e-41af-bc31-2c34724e77db tempest-VolumesActionsTest-536484564 tempest-VolumesActionsTest-536484564-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72382) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 15:20:53 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-aaf2fadc-fe6e-41af-bc31-2c34724e77db tempest-VolumesActionsTest-536484564 tempest-VolumesActionsTest-536484564-project-member] CPU controller missing on host. {{(pid=72382) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 15:20:53 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-aaf2fadc-fe6e-41af-bc31-2c34724e77db tempest-VolumesActionsTest-536484564 tempest-VolumesActionsTest-536484564-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72382) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 15:20:53 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-aaf2fadc-fe6e-41af-bc31-2c34724e77db tempest-VolumesActionsTest-536484564 tempest-VolumesActionsTest-536484564-project-member] CPU controller found on host. {{(pid=72382) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 15:20:53 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-aaf2fadc-fe6e-41af-bc31-2c34724e77db tempest-VolumesActionsTest-536484564 tempest-VolumesActionsTest-536484564-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72382) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 15:20:53 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-aaf2fadc-fe6e-41af-bc31-2c34724e77db tempest-VolumesActionsTest-536484564 tempest-VolumesActionsTest-536484564-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T15:11:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T15:11:25Z,direct_url=<?>,disk_format='qcow2',id=a79f2cea-eb27-4631-aaf3-05e7d9e411b4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a638990e12cc4d6eabb6d55e13be6bdf',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T15:11:27Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 15:20:53 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-aaf2fadc-fe6e-41af-bc31-2c34724e77db tempest-VolumesActionsTest-536484564 tempest-VolumesActionsTest-536484564-project-member] Flavor limits 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 15:20:53 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-aaf2fadc-fe6e-41af-bc31-2c34724e77db tempest-VolumesActionsTest-536484564 tempest-VolumesActionsTest-536484564-project-member] Image limits 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 15:20:53 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-aaf2fadc-fe6e-41af-bc31-2c34724e77db tempest-VolumesActionsTest-536484564 tempest-VolumesActionsTest-536484564-project-member] Flavor pref 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 15:20:53 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-aaf2fadc-fe6e-41af-bc31-2c34724e77db tempest-VolumesActionsTest-536484564 tempest-VolumesActionsTest-536484564-project-member] Image pref 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 15:20:53 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-aaf2fadc-fe6e-41af-bc31-2c34724e77db tempest-VolumesActionsTest-536484564 tempest-VolumesActionsTest-536484564-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 15:20:53 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-aaf2fadc-fe6e-41af-bc31-2c34724e77db tempest-VolumesActionsTest-536484564 tempest-VolumesActionsTest-536484564-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 15:20:53 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-aaf2fadc-fe6e-41af-bc31-2c34724e77db tempest-VolumesActionsTest-536484564 tempest-VolumesActionsTest-536484564-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72382) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 15:20:53 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-aaf2fadc-fe6e-41af-bc31-2c34724e77db tempest-VolumesActionsTest-536484564 tempest-VolumesActionsTest-536484564-project-member] Got 1 possible topologies {{(pid=72382) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 15:20:53 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-aaf2fadc-fe6e-41af-bc31-2c34724e77db tempest-VolumesActionsTest-536484564 tempest-VolumesActionsTest-536484564-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 15:20:53 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-aaf2fadc-fe6e-41af-bc31-2c34724e77db tempest-VolumesActionsTest-536484564 tempest-VolumesActionsTest-536484564-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 15:20:53 user nova-compute[72382]: DEBUG nova.virt.libvirt.vif [None req-aaf2fadc-fe6e-41af-bc31-2c34724e77db tempest-VolumesActionsTest-536484564 tempest-VolumesActionsTest-536484564-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T15:20:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-676114299',display_name='tempest-VolumesActionsTest-instance-676114299',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-676114299',id=19,image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bb5b667ffa644ac1afe75bd518b86a4d',ramdisk_id='',reservation_id='r-smlwahhz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-536484564',owner_user_name='tempest-VolumesActionsTest-536484564-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T15:20:49Z,user_data=None,user_id='be6ec6133b0e451691ffeb5b710fde32',uuid=d061ee79-0755-44a7-9929-086c274c9064,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b88483f9-249f-473e-a1eb-fee83c57a89b", "address": "fa:16:3e:28:6f:53", "network": {"id": "8cff6610-5196-4dc5-8213-fd83c40bf2b9", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2098434591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb5b667ffa644ac1afe75bd518b86a4d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb88483f9-24", "ovs_interfaceid": "b88483f9-249f-473e-a1eb-fee83c57a89b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72382) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 15:20:53 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-aaf2fadc-fe6e-41af-bc31-2c34724e77db tempest-VolumesActionsTest-536484564 tempest-VolumesActionsTest-536484564-project-member] Converting VIF {"id": "b88483f9-249f-473e-a1eb-fee83c57a89b", "address": "fa:16:3e:28:6f:53", "network": {"id": "8cff6610-5196-4dc5-8213-fd83c40bf2b9", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2098434591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb5b667ffa644ac1afe75bd518b86a4d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb88483f9-24", "ovs_interfaceid": "b88483f9-249f-473e-a1eb-fee83c57a89b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 15:20:53 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-aaf2fadc-fe6e-41af-bc31-2c34724e77db tempest-VolumesActionsTest-536484564 tempest-VolumesActionsTest-536484564-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:6f:53,bridge_name='br-int',has_traffic_filtering=True,id=b88483f9-249f-473e-a1eb-fee83c57a89b,network=Network(8cff6610-5196-4dc5-8213-fd83c40bf2b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb88483f9-24') {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 15:20:53 user nova-compute[72382]: DEBUG nova.objects.instance [None req-aaf2fadc-fe6e-41af-bc31-2c34724e77db tempest-VolumesActionsTest-536484564 tempest-VolumesActionsTest-536484564-project-member] Lazy-loading 'pci_devices' on Instance uuid d061ee79-0755-44a7-9929-086c274c9064 {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:20:53 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-aaf2fadc-fe6e-41af-bc31-2c34724e77db tempest-VolumesActionsTest-536484564 tempest-VolumesActionsTest-536484564-project-member] [instance: d061ee79-0755-44a7-9929-086c274c9064] End _get_guest_xml xml=<domain type="kvm">
Aug 09 15:20:53 user nova-compute[72382]:   <uuid>d061ee79-0755-44a7-9929-086c274c9064</uuid>
Aug 09 15:20:53 user nova-compute[72382]:   <name>instance-00000013</name>
Aug 09 15:20:53 user nova-compute[72382]:   <memory>524288</memory>
Aug 09 15:20:53 user nova-compute[72382]:   <vcpu>1</vcpu>
Aug 09 15:20:53 user nova-compute[72382]:   <metadata>
Aug 09 15:20:53 user nova-compute[72382]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 15:20:53 user nova-compute[72382]:       <nova:package version="0.0.0"/>
Aug 09 15:20:53 user nova-compute[72382]:       <nova:name>tempest-VolumesActionsTest-instance-676114299</nova:name>
Aug 09 15:20:53 user nova-compute[72382]:       <nova:creationTime>2023-08-09 15:20:53</nova:creationTime>
Aug 09 15:20:53 user nova-compute[72382]:       <nova:flavor name="m1.tiny">
Aug 09 15:20:53 user nova-compute[72382]:         <nova:memory>512</nova:memory>
Aug 09 15:20:53 user nova-compute[72382]:         <nova:disk>1</nova:disk>
Aug 09 15:20:53 user nova-compute[72382]:         <nova:swap>0</nova:swap>
Aug 09 15:20:53 user nova-compute[72382]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 15:20:53 user nova-compute[72382]:         <nova:vcpus>1</nova:vcpus>
Aug 09 15:20:53 user nova-compute[72382]:       </nova:flavor>
Aug 09 15:20:53 user nova-compute[72382]:       <nova:owner>
Aug 09 15:20:53 user nova-compute[72382]:         <nova:user uuid="be6ec6133b0e451691ffeb5b710fde32">tempest-VolumesActionsTest-536484564-project-member</nova:user>
Aug 09 15:20:53 user nova-compute[72382]:         <nova:project uuid="bb5b667ffa644ac1afe75bd518b86a4d">tempest-VolumesActionsTest-536484564</nova:project>
Aug 09 15:20:53 user nova-compute[72382]:       </nova:owner>
Aug 09 15:20:53 user nova-compute[72382]:       <nova:root type="image" uuid="a79f2cea-eb27-4631-aaf3-05e7d9e411b4"/>
Aug 09 15:20:53 user nova-compute[72382]:       <nova:ports>
Aug 09 15:20:53 user nova-compute[72382]:         <nova:port uuid="b88483f9-249f-473e-a1eb-fee83c57a89b">
Aug 09 15:20:53 user nova-compute[72382]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 09 15:20:53 user nova-compute[72382]:         </nova:port>
Aug 09 15:20:53 user nova-compute[72382]:       </nova:ports>
Aug 09 15:20:53 user nova-compute[72382]:     </nova:instance>
Aug 09 15:20:53 user nova-compute[72382]:   </metadata>
Aug 09 15:20:53 user nova-compute[72382]:   <sysinfo type="smbios">
Aug 09 15:20:53 user nova-compute[72382]:     <system>
Aug 09 15:20:53 user nova-compute[72382]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 15:20:53 user nova-compute[72382]:       <entry name="product">OpenStack Nova</entry>
Aug 09 15:20:53 user nova-compute[72382]:       <entry name="version">0.0.0</entry>
Aug 09 15:20:53 user nova-compute[72382]:       <entry name="serial">d061ee79-0755-44a7-9929-086c274c9064</entry>
Aug 09 15:20:53 user nova-compute[72382]:       <entry name="uuid">d061ee79-0755-44a7-9929-086c274c9064</entry>
Aug 09 15:20:53 user nova-compute[72382]:       <entry name="family">Virtual Machine</entry>
Aug 09 15:20:53 user nova-compute[72382]:     </system>
Aug 09 15:20:53 user nova-compute[72382]:   </sysinfo>
Aug 09 15:20:53 user nova-compute[72382]:   <os>
Aug 09 15:20:53 user nova-compute[72382]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 15:20:53 user nova-compute[72382]:     <boot dev="hd"/>
Aug 09 15:20:53 user nova-compute[72382]:     <smbios mode="sysinfo"/>
Aug 09 15:20:53 user nova-compute[72382]:   </os>
Aug 09 15:20:53 user nova-compute[72382]:   <features>
Aug 09 15:20:53 user nova-compute[72382]:     <acpi/>
Aug 09 15:20:53 user nova-compute[72382]:     <apic/>
Aug 09 15:20:53 user nova-compute[72382]:     <vmcoreinfo/>
Aug 09 15:20:53 user nova-compute[72382]:   </features>
Aug 09 15:20:53 user nova-compute[72382]:   <clock offset="utc">
Aug 09 15:20:53 user nova-compute[72382]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 15:20:53 user nova-compute[72382]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 15:20:53 user nova-compute[72382]:     <timer name="hpet" present="no"/>
Aug 09 15:20:53 user nova-compute[72382]:   </clock>
Aug 09 15:20:53 user nova-compute[72382]:   <cpu mode="custom" match="exact">
Aug 09 15:20:53 user nova-compute[72382]:     <model>Nehalem</model>
Aug 09 15:20:53 user nova-compute[72382]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 15:20:53 user nova-compute[72382]:   </cpu>
Aug 09 15:20:53 user nova-compute[72382]:   <devices>
Aug 09 15:20:53 user nova-compute[72382]:     <disk type="file" device="disk">
Aug 09 15:20:53 user nova-compute[72382]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 15:20:53 user nova-compute[72382]:       <source file="/opt/stack/data/nova/instances/d061ee79-0755-44a7-9929-086c274c9064/disk"/>
Aug 09 15:20:53 user nova-compute[72382]:       <target dev="vda" bus="virtio"/>
Aug 09 15:20:53 user nova-compute[72382]:     </disk>
Aug 09 15:20:53 user nova-compute[72382]:     <interface type="ethernet">
Aug 09 15:20:53 user nova-compute[72382]:       <mac address="fa:16:3e:28:6f:53"/>
Aug 09 15:20:53 user nova-compute[72382]:       <model type="virtio"/>
Aug 09 15:20:53 user nova-compute[72382]:       <mtu size="1442"/>
Aug 09 15:20:53 user nova-compute[72382]:       <target dev="tapb88483f9-24"/>
Aug 09 15:20:53 user nova-compute[72382]:     </interface>
Aug 09 15:20:53 user nova-compute[72382]:     <serial type="pty">
Aug 09 15:20:53 user nova-compute[72382]:       <log file="/opt/stack/data/nova/instances/d061ee79-0755-44a7-9929-086c274c9064/console.log" append="off"/>
Aug 09 15:20:53 user nova-compute[72382]:     </serial>
Aug 09 15:20:53 user nova-compute[72382]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 15:20:53 user nova-compute[72382]:     <video>
Aug 09 15:20:53 user nova-compute[72382]:       <model type="virtio"/>
Aug 09 15:20:53 user nova-compute[72382]:     </video>
Aug 09 15:20:53 user nova-compute[72382]:     <rng model="virtio">
Aug 09 15:20:53 user nova-compute[72382]:       <backend model="random">/dev/urandom</backend>
Aug 09 15:20:53 user nova-compute[72382]:     </rng>
Aug 09 15:20:53 user nova-compute[72382]:     <controller type="usb" index="0" model="none"/>
Aug 09 15:20:53 user nova-compute[72382]:     <memballoon model="virtio">
Aug 09 15:20:53 user nova-compute[72382]:       <stats period="10"/>
Aug 09 15:20:53 user nova-compute[72382]:     </memballoon>
Aug 09 15:20:53 user nova-compute[72382]:   </devices>
Aug 09 15:20:53 user nova-compute[72382]: </domain>
Aug 09 15:20:53 user nova-compute[72382]:  {{(pid=72382) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 15:20:53 user nova-compute[72382]: DEBUG nova.virt.libvirt.vif [None req-aaf2fadc-fe6e-41af-bc31-2c34724e77db tempest-VolumesActionsTest-536484564 tempest-VolumesActionsTest-536484564-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T15:20:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-676114299',display_name='tempest-VolumesActionsTest-instance-676114299',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-676114299',id=19,image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bb5b667ffa644ac1afe75bd518b86a4d',ramdisk_id='',reservation_id='r-smlwahhz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-536484564',owner_user_name='tempest-VolumesActionsTest-536484564-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T15:20:49Z,user_data=None,user_id='be6ec6133b0e451691ffeb5b710fde32',uuid=d061ee79-0755-44a7-9929-086c274c9064,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b88483f9-249f-473e-a1eb-fee83c57a89b", "address": "fa:16:3e:28:6f:53", "network": {"id": "8cff6610-5196-4dc5-8213-fd83c40bf2b9", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2098434591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb5b667ffa644ac1afe75bd518b86a4d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb88483f9-24", "ovs_interfaceid": "b88483f9-249f-473e-a1eb-fee83c57a89b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 15:20:53 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-aaf2fadc-fe6e-41af-bc31-2c34724e77db tempest-VolumesActionsTest-536484564 tempest-VolumesActionsTest-536484564-project-member] Converting VIF {"id": "b88483f9-249f-473e-a1eb-fee83c57a89b", "address": "fa:16:3e:28:6f:53", "network": {"id": "8cff6610-5196-4dc5-8213-fd83c40bf2b9", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2098434591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb5b667ffa644ac1afe75bd518b86a4d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb88483f9-24", "ovs_interfaceid": "b88483f9-249f-473e-a1eb-fee83c57a89b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 15:20:53 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-aaf2fadc-fe6e-41af-bc31-2c34724e77db tempest-VolumesActionsTest-536484564 tempest-VolumesActionsTest-536484564-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:6f:53,bridge_name='br-int',has_traffic_filtering=True,id=b88483f9-249f-473e-a1eb-fee83c57a89b,network=Network(8cff6610-5196-4dc5-8213-fd83c40bf2b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb88483f9-24') {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 15:20:53 user nova-compute[72382]: DEBUG os_vif [None req-aaf2fadc-fe6e-41af-bc31-2c34724e77db tempest-VolumesActionsTest-536484564 tempest-VolumesActionsTest-536484564-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:6f:53,bridge_name='br-int',has_traffic_filtering=True,id=b88483f9-249f-473e-a1eb-fee83c57a89b,network=Network(8cff6610-5196-4dc5-8213-fd83c40bf2b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb88483f9-24') {{(pid=72382) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 15:20:53 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:20:53 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:20:53 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 15:20:53 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:20:53 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb88483f9-24, may_exist=True, interface_attrs={}) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:20:53 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb88483f9-24, col_values=(('external_ids', {'iface-id': 'b88483f9-249f-473e-a1eb-fee83c57a89b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:28:6f:53', 'vm-uuid': 'd061ee79-0755-44a7-9929-086c274c9064'}),), if_exists=True) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:20:53 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:20:53 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:20:53 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:20:53 user nova-compute[72382]: INFO os_vif [None req-aaf2fadc-fe6e-41af-bc31-2c34724e77db tempest-VolumesActionsTest-536484564 tempest-VolumesActionsTest-536484564-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:6f:53,bridge_name='br-int',has_traffic_filtering=True,id=b88483f9-249f-473e-a1eb-fee83c57a89b,network=Network(8cff6610-5196-4dc5-8213-fd83c40bf2b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb88483f9-24')
Aug 09 15:20:53 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-aaf2fadc-fe6e-41af-bc31-2c34724e77db tempest-VolumesActionsTest-536484564 tempest-VolumesActionsTest-536484564-project-member] No BDM found with device name vda, not building metadata. {{(pid=72382) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 15:20:53 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-aaf2fadc-fe6e-41af-bc31-2c34724e77db tempest-VolumesActionsTest-536484564 tempest-VolumesActionsTest-536484564-project-member] No VIF found with MAC fa:16:3e:28:6f:53, not building metadata {{(pid=72382) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 15:20:53 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.441s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 15:20:53 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] <== connect_volume: return (1443ms) {'type': 'block', 'scsi_wwn': '23433373732616262', 'path': '/dev/sde'} {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 15:20:53 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] [instance: cff2fb57-7d0b-4278-89ed-10a8ec5128ea] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23433373732616262', 'path': '/dev/sde'} {{(pid=72382) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 15:20:53 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] [instance: cff2fb57-7d0b-4278-89ed-10a8ec5128ea] Calling os-brick to attach iSCSI Volume {{(pid=72382) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 15:20:53 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2a0c768340>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:184b0159-3cae-4d79-86b3-26a58437eb09'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oyhkXTmn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 15:20:53 user nova-compute[72382]: WARNING os_brick.initiator.connectors.base [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 15:20:53 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 15:20:53 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 15:20:53 user nova-compute[72382]: WARNING os_brick.initiator.connectors.base [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 15:20:53 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:184b0159-3cae-4d79-86b3-26a58437eb09" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 15:20:53 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:184b0159-3cae-4d79-86b3-26a58437eb09" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 15:20:53 user nova-compute[72382]: INFO os_brick.initiator.connectors.iscsi [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 15:20:53 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:184b0159-3cae-4d79-86b3-26a58437eb09 -p 172.16.0.220:3260 {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:20:53 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:184b0159-3cae-4d79-86b3-26a58437eb09 -p 172.16.0.220:3260" returned: 21 in 0.026s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:20:53 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[4438730f-c48f-45fa-9734-4d616359ee42]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:20:53 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 15:20:53 user nova-compute[72382]:  {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:20:53 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:184b0159-3cae-4d79-86b3-26a58437eb09 -p 172.16.0.220:3260 --interface default --op new {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:20:53 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:184b0159-3cae-4d79-86b3-26a58437eb09 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:20:53 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[882ea663-8fed-41a4-bdf7-b59fb7cb1169]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:184b0159-3cae-4d79-86b3-26a58437eb09] added\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:20:53 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:184b0159-3cae-4d79-86b3-26a58437eb09] added
Aug 09 15:20:53 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:20:53 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:184b0159-3cae-4d79-86b3-26a58437eb09 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:20:53 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:184b0159-3cae-4d79-86b3-26a58437eb09 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:20:53 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[614ab51d-2a9a-4960-8470-086b9b910ec7]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:20:53 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:20:53 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:184b0159-3cae-4d79-86b3-26a58437eb09 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:20:53 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:184b0159-3cae-4d79-86b3-26a58437eb09 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:20:53 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[80f01d10-f563-4b87-b98c-5fd1c0e31a8f]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:20:53 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:20:53 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:184b0159-3cae-4d79-86b3-26a58437eb09 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oyhkXTmn {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:20:53 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:184b0159-3cae-4d79-86b3-26a58437eb09 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oyhkXTmn" returned: 0 in 0.027s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:20:53 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[7681c13c-8380-4e3c-ad73-1535e21bbd26]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:20:53 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'oyhkXTmn'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:20:53 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:184b0159-3cae-4d79-86b3-26a58437eb09 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:20:53 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:184b0159-3cae-4d79-86b3-26a58437eb09 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:20:53 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f5ebf1b-9d59-4413-9682-8e0dfac888c7]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:20:53 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:20:53 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:20:53 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:20:53 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[160e5d9d-e96a-46be-bef8-3dcf5b1ab43f]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb47e85c-aaa9-4165-8be3-125572b68a87 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cd86701-a303-4744-bf0c-31b5314bb87d (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8bad821-ddd1-4287-806d-78ffdc34fa68 (non-flash)\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:20:53 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)
Aug 09 15:20:53 user nova-compute[72382]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb47e85c-aaa9-4165-8be3-125572b68a87 (non-flash)
Aug 09 15:20:53 user nova-compute[72382]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cd86701-a303-4744-bf0c-31b5314bb87d (non-flash)
Aug 09 15:20:53 user nova-compute[72382]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8bad821-ddd1-4287-806d-78ffdc34fa68 (non-flash)
Aug 09 15:20:53 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 15:20:53 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)
Aug 09 15:20:53 user nova-compute[72382]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb47e85c-aaa9-4165-8be3-125572b68a87 (non-flash)
Aug 09 15:20:53 user nova-compute[72382]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cd86701-a303-4744-bf0c-31b5314bb87d (non-flash)
Aug 09 15:20:53 user nova-compute[72382]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8bad821-ddd1-4287-806d-78ffdc34fa68 (non-flash)
Aug 09 15:20:53 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 15:20:53 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:184b0159-3cae-4d79-86b3-26a58437eb09 -p 172.16.0.220:3260 --login {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:20:53 user nova-compute[72382]: DEBUG nova.compute.manager [req-e5b42e60-f208-4455-8a27-6fb081d2a66b req-b481de01-99be-4bc9-a5c7-6972ce4e76a9 service nova] [instance: 8aa35482-60b8-4185-b14d-a2667fd3b5b7] Received event network-changed-b4902494-07bb-48a3-b0f8-26115f2b04d6 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:20:53 user nova-compute[72382]: DEBUG nova.compute.manager [req-e5b42e60-f208-4455-8a27-6fb081d2a66b req-b481de01-99be-4bc9-a5c7-6972ce4e76a9 service nova] [instance: 8aa35482-60b8-4185-b14d-a2667fd3b5b7] Refreshing instance network info cache due to event network-changed-b4902494-07bb-48a3-b0f8-26115f2b04d6. {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 15:20:53 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-e5b42e60-f208-4455-8a27-6fb081d2a66b req-b481de01-99be-4bc9-a5c7-6972ce4e76a9 service nova] Acquiring lock "refresh_cache-8aa35482-60b8-4185-b14d-a2667fd3b5b7" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 15:20:53 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-e5b42e60-f208-4455-8a27-6fb081d2a66b req-b481de01-99be-4bc9-a5c7-6972ce4e76a9 service nova] Acquired lock "refresh_cache-8aa35482-60b8-4185-b14d-a2667fd3b5b7" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 15:20:53 user nova-compute[72382]: DEBUG nova.network.neutron [req-e5b42e60-f208-4455-8a27-6fb081d2a66b req-b481de01-99be-4bc9-a5c7-6972ce4e76a9 service nova] [instance: 8aa35482-60b8-4185-b14d-a2667fd3b5b7] Refreshing network info cache for port b4902494-07bb-48a3-b0f8-26115f2b04d6 {{(pid=72382) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 15:20:53 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:184b0159-3cae-4d79-86b3-26a58437eb09 -p 172.16.0.220:3260 --login" returned: 0 in 0.082s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:20:53 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[4030eea4-585c-4eca-9171-d56ffa05be07]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:184b0159-3cae-4d79-86b3-26a58437eb09, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:184b0159-3cae-4d79-86b3-26a58437eb09, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:20:53 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:184b0159-3cae-4d79-86b3-26a58437eb09, portal: 172.16.0.220,3260]
Aug 09 15:20:53 user nova-compute[72382]: Login to [iface: default, target: iqn.2010-10.org.openstack:184b0159-3cae-4d79-86b3-26a58437eb09, portal: 172.16.0.220,3260] successful.
Aug 09 15:20:53 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:20:53 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:184b0159-3cae-4d79-86b3-26a58437eb09 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:20:53 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:184b0159-3cae-4d79-86b3-26a58437eb09 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:20:53 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[a98b7712-982e-4a8c-8561-904e4f3a1914]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:20:53 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:20:53 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:20:53 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:20:53 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:20:53 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e0edc80-3cac-456c-b42e-85991e78fa39]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb47e85c-aaa9-4165-8be3-125572b68a87 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cd86701-a303-4744-bf0c-31b5314bb87d (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8bad821-ddd1-4287-806d-78ffdc34fa68 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:184b0159-3cae-4d79-86b3-26a58437eb09 (non-flash)\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:20:53 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)
Aug 09 15:20:53 user nova-compute[72382]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb47e85c-aaa9-4165-8be3-125572b68a87 (non-flash)
Aug 09 15:20:53 user nova-compute[72382]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cd86701-a303-4744-bf0c-31b5314bb87d (non-flash)
Aug 09 15:20:53 user nova-compute[72382]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8bad821-ddd1-4287-806d-78ffdc34fa68 (non-flash)
Aug 09 15:20:53 user nova-compute[72382]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:184b0159-3cae-4d79-86b3-26a58437eb09 (non-flash)
Aug 09 15:20:53 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 15:20:53 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)
Aug 09 15:20:53 user nova-compute[72382]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb47e85c-aaa9-4165-8be3-125572b68a87 (non-flash)
Aug 09 15:20:53 user nova-compute[72382]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cd86701-a303-4744-bf0c-31b5314bb87d (non-flash)
Aug 09 15:20:53 user nova-compute[72382]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8bad821-ddd1-4287-806d-78ffdc34fa68 (non-flash)
Aug 09 15:20:53 user nova-compute[72382]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:184b0159-3cae-4d79-86b3-26a58437eb09 (non-flash)
Aug 09 15:20:53 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 15:20:53 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:184b0159-3cae-4d79-86b3-26a58437eb09" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.354s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 15:20:53 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] Connected to 172.16.0.220:3260 {{(pid=72382) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 15:20:53 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] HCTL ('37', '-', '-', 0) found on session 19 with lun 0 {{(pid=72382) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 15:20:53 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=72382) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 15:20:53 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:20:54 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.023s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:20:54 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[26a8077e-8397-406e-b9f3-d11ec38d0e42]: (4, ('- - 0', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:20:54 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] Searching for a device in session 19 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=72382) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 15:20:54 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oyhkXTmn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72382) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 15:20:54 user nova-compute[72382]: DEBUG nova.compute.manager [req-fcfdbc6a-4bf1-4486-bb75-3802859d4024 req-9518c4a5-c457-4e8c-822f-c570195585bf service nova] [instance: d061ee79-0755-44a7-9929-086c274c9064] Received event network-changed-b88483f9-249f-473e-a1eb-fee83c57a89b {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:20:54 user nova-compute[72382]: DEBUG nova.compute.manager [req-fcfdbc6a-4bf1-4486-bb75-3802859d4024 req-9518c4a5-c457-4e8c-822f-c570195585bf service nova] [instance: d061ee79-0755-44a7-9929-086c274c9064] Refreshing instance network info cache due to event network-changed-b88483f9-249f-473e-a1eb-fee83c57a89b. {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 15:20:54 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-fcfdbc6a-4bf1-4486-bb75-3802859d4024 req-9518c4a5-c457-4e8c-822f-c570195585bf service nova] Acquiring lock "refresh_cache-d061ee79-0755-44a7-9929-086c274c9064" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 15:20:54 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-fcfdbc6a-4bf1-4486-bb75-3802859d4024 req-9518c4a5-c457-4e8c-822f-c570195585bf service nova] Acquired lock "refresh_cache-d061ee79-0755-44a7-9929-086c274c9064" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 15:20:54 user nova-compute[72382]: DEBUG nova.network.neutron [req-fcfdbc6a-4bf1-4486-bb75-3802859d4024 req-9518c4a5-c457-4e8c-822f-c570195585bf service nova] [instance: d061ee79-0755-44a7-9929-086c274c9064] Refreshing network info cache for port b88483f9-249f-473e-a1eb-fee83c57a89b {{(pid=72382) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 15:20:54 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:20:54 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:20:54 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:20:54 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:20:55 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.403s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 15:20:55 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] <== connect_volume: return (1404ms) {'type': 'block', 'scsi_wwn': '23932666631366664', 'path': '/dev/sdf'} {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 15:20:55 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] [instance: cff2fb57-7d0b-4278-89ed-10a8ec5128ea] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23932666631366664', 'path': '/dev/sdf'} {{(pid=72382) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 15:20:55 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] [instance: cff2fb57-7d0b-4278-89ed-10a8ec5128ea] Calling os-brick to attach iSCSI Volume {{(pid=72382) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 15:20:55 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2a0c768340>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:1c6be653-7ab8-4b40-9e28-43c1eca5e016'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lHczEwXN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 15:20:55 user nova-compute[72382]: WARNING os_brick.initiator.connectors.base [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 15:20:55 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 15:20:55 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 15:20:55 user nova-compute[72382]: WARNING os_brick.initiator.connectors.base [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 15:20:55 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1c6be653-7ab8-4b40-9e28-43c1eca5e016" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 15:20:55 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1c6be653-7ab8-4b40-9e28-43c1eca5e016" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 15:20:55 user nova-compute[72382]: INFO os_brick.initiator.connectors.iscsi [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 15:20:55 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c6be653-7ab8-4b40-9e28-43c1eca5e016 -p 172.16.0.220:3260 {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:20:55 user nova-compute[72382]: DEBUG nova.compute.manager [None req-dfc20570-5d65-4841-a131-a9e322f786bd tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] [instance: 8aa35482-60b8-4185-b14d-a2667fd3b5b7] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:20:55 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c6be653-7ab8-4b40-9e28-43c1eca5e016 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:20:55 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0fc888b-de75-4c5c-9ca6-125de65a3725]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:20:55 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 15:20:55 user nova-compute[72382]:  {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:20:55 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c6be653-7ab8-4b40-9e28-43c1eca5e016 -p 172.16.0.220:3260 --interface default --op new {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:20:55 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c6be653-7ab8-4b40-9e28-43c1eca5e016 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.027s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:20:55 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[160a6a4c-3739-404b-909e-3e5d7184b47e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1c6be653-7ab8-4b40-9e28-43c1eca5e016] added\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:20:55 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1c6be653-7ab8-4b40-9e28-43c1eca5e016] added
Aug 09 15:20:55 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:20:55 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c6be653-7ab8-4b40-9e28-43c1eca5e016 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:20:55 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c6be653-7ab8-4b40-9e28-43c1eca5e016 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:20:55 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dfd27f3-2998-480a-bd91-d930c7146c9d]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:20:55 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:20:55 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c6be653-7ab8-4b40-9e28-43c1eca5e016 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:20:55 user nova-compute[72382]: INFO nova.compute.manager [None req-dfc20570-5d65-4841-a131-a9e322f786bd tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] [instance: 8aa35482-60b8-4185-b14d-a2667fd3b5b7] instance snapshotting
Aug 09 15:20:55 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c6be653-7ab8-4b40-9e28-43c1eca5e016 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.033s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:20:55 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8eca4c7-d321-4108-ab83-58d2f9065352]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:20:55 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:20:55 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c6be653-7ab8-4b40-9e28-43c1eca5e016 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lHczEwXN {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:20:55 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c6be653-7ab8-4b40-9e28-43c1eca5e016 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lHczEwXN" returned: 0 in 0.030s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:20:55 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b10d48f-6ebb-40ce-bdff-9a39a5a78c69]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:20:55 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lHczEwXN'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:20:55 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c6be653-7ab8-4b40-9e28-43c1eca5e016 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:20:55 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c6be653-7ab8-4b40-9e28-43c1eca5e016 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.030s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:20:55 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[93450936-7369-482a-a74e-e06f0c168bea]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:20:55 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:20:55 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:20:55 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:20:55 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fb4fcbc-b8d5-4fdb-905b-091562ecc493]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb47e85c-aaa9-4165-8be3-125572b68a87 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cd86701-a303-4744-bf0c-31b5314bb87d (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8bad821-ddd1-4287-806d-78ffdc34fa68 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:184b0159-3cae-4d79-86b3-26a58437eb09 (non-flash)\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:20:55 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)
Aug 09 15:20:55 user nova-compute[72382]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb47e85c-aaa9-4165-8be3-125572b68a87 (non-flash)
Aug 09 15:20:55 user nova-compute[72382]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cd86701-a303-4744-bf0c-31b5314bb87d (non-flash)
Aug 09 15:20:55 user nova-compute[72382]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8bad821-ddd1-4287-806d-78ffdc34fa68 (non-flash)
Aug 09 15:20:55 user nova-compute[72382]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:184b0159-3cae-4d79-86b3-26a58437eb09 (non-flash)
Aug 09 15:20:55 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 15:20:55 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)
Aug 09 15:20:55 user nova-compute[72382]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb47e85c-aaa9-4165-8be3-125572b68a87 (non-flash)
Aug 09 15:20:55 user nova-compute[72382]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cd86701-a303-4744-bf0c-31b5314bb87d (non-flash)
Aug 09 15:20:55 user nova-compute[72382]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8bad821-ddd1-4287-806d-78ffdc34fa68 (non-flash)
Aug 09 15:20:55 user nova-compute[72382]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:184b0159-3cae-4d79-86b3-26a58437eb09 (non-flash)
Aug 09 15:20:55 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 15:20:55 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c6be653-7ab8-4b40-9e28-43c1eca5e016 -p 172.16.0.220:3260 --login {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:20:55 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-dfc20570-5d65-4841-a131-a9e322f786bd tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] [instance: 8aa35482-60b8-4185-b14d-a2667fd3b5b7] Beginning live snapshot process
Aug 09 15:20:55 user nova-compute[72382]: DEBUG nova.compute.manager [req-0db76b8f-1d8c-45b2-afce-60507aae16de req-2515a97f-7df5-4d86-af26-e3df3cabbdd9 service nova] [instance: d061ee79-0755-44a7-9929-086c274c9064] Received event network-vif-plugged-b88483f9-249f-473e-a1eb-fee83c57a89b {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:20:55 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-0db76b8f-1d8c-45b2-afce-60507aae16de req-2515a97f-7df5-4d86-af26-e3df3cabbdd9 service nova] Acquiring lock "d061ee79-0755-44a7-9929-086c274c9064-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:20:55 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-0db76b8f-1d8c-45b2-afce-60507aae16de req-2515a97f-7df5-4d86-af26-e3df3cabbdd9 service nova] Lock "d061ee79-0755-44a7-9929-086c274c9064-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:20:55 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-0db76b8f-1d8c-45b2-afce-60507aae16de req-2515a97f-7df5-4d86-af26-e3df3cabbdd9 service nova] Lock "d061ee79-0755-44a7-9929-086c274c9064-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:20:55 user nova-compute[72382]: DEBUG nova.compute.manager [req-0db76b8f-1d8c-45b2-afce-60507aae16de req-2515a97f-7df5-4d86-af26-e3df3cabbdd9 service nova] [instance: d061ee79-0755-44a7-9929-086c274c9064] No waiting events found dispatching network-vif-plugged-b88483f9-249f-473e-a1eb-fee83c57a89b {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:20:55 user nova-compute[72382]: WARNING nova.compute.manager [req-0db76b8f-1d8c-45b2-afce-60507aae16de req-2515a97f-7df5-4d86-af26-e3df3cabbdd9 service nova] [instance: d061ee79-0755-44a7-9929-086c274c9064] Received unexpected event network-vif-plugged-b88483f9-249f-473e-a1eb-fee83c57a89b for instance with vm_state building and task_state spawning.
Aug 09 15:20:55 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c6be653-7ab8-4b40-9e28-43c1eca5e016 -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:20:55 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[95072432-e28f-404b-a006-dbb559b26cea]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1c6be653-7ab8-4b40-9e28-43c1eca5e016, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1c6be653-7ab8-4b40-9e28-43c1eca5e016, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:20:55 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1c6be653-7ab8-4b40-9e28-43c1eca5e016, portal: 172.16.0.220,3260]
Aug 09 15:20:55 user nova-compute[72382]: Login to [iface: default, target: iqn.2010-10.org.openstack:1c6be653-7ab8-4b40-9e28-43c1eca5e016, portal: 172.16.0.220,3260] successful.
Aug 09 15:20:55 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:20:55 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c6be653-7ab8-4b40-9e28-43c1eca5e016 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:20:55 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c6be653-7ab8-4b40-9e28-43c1eca5e016 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.031s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:20:55 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[72081d5d-108e-4363-9ea1-08c48d2d696f]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:20:55 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:20:55 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:20:55 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:20:55 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[225a1a50-5fbe-4e6e-8649-397f9bc98052]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb47e85c-aaa9-4165-8be3-125572b68a87 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cd86701-a303-4744-bf0c-31b5314bb87d (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8bad821-ddd1-4287-806d-78ffdc34fa68 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:184b0159-3cae-4d79-86b3-26a58437eb09 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c6be653-7ab8-4b40-9e28-43c1eca5e016 (non-flash)\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:20:55 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)
Aug 09 15:20:55 user nova-compute[72382]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb47e85c-aaa9-4165-8be3-125572b68a87 (non-flash)
Aug 09 15:20:55 user nova-compute[72382]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cd86701-a303-4744-bf0c-31b5314bb87d (non-flash)
Aug 09 15:20:55 user nova-compute[72382]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8bad821-ddd1-4287-806d-78ffdc34fa68 (non-flash)
Aug 09 15:20:55 user nova-compute[72382]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:184b0159-3cae-4d79-86b3-26a58437eb09 (non-flash)
Aug 09 15:20:55 user nova-compute[72382]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c6be653-7ab8-4b40-9e28-43c1eca5e016 (non-flash)
Aug 09 15:20:55 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 15:20:55 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)
Aug 09 15:20:55 user nova-compute[72382]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb47e85c-aaa9-4165-8be3-125572b68a87 (non-flash)
Aug 09 15:20:55 user nova-compute[72382]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cd86701-a303-4744-bf0c-31b5314bb87d (non-flash)
Aug 09 15:20:55 user nova-compute[72382]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8bad821-ddd1-4287-806d-78ffdc34fa68 (non-flash)
Aug 09 15:20:55 user nova-compute[72382]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:184b0159-3cae-4d79-86b3-26a58437eb09 (non-flash)
Aug 09 15:20:55 user nova-compute[72382]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c6be653-7ab8-4b40-9e28-43c1eca5e016 (non-flash)
Aug 09 15:20:55 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 15:20:55 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1c6be653-7ab8-4b40-9e28-43c1eca5e016" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.389s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 15:20:55 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] Connected to 172.16.0.220:3260 {{(pid=72382) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 15:20:55 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] HCTL ('38', '-', '-', 0) found on session 20 with lun 0 {{(pid=72382) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 15:20:55 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=72382) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 15:20:55 user nova-compute[72382]: DEBUG nova.network.neutron [req-e5b42e60-f208-4455-8a27-6fb081d2a66b req-b481de01-99be-4bc9-a5c7-6972ce4e76a9 service nova] [instance: 8aa35482-60b8-4185-b14d-a2667fd3b5b7] Updated VIF entry in instance network info cache for port b4902494-07bb-48a3-b0f8-26115f2b04d6. {{(pid=72382) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 15:20:55 user nova-compute[72382]: DEBUG nova.network.neutron [req-e5b42e60-f208-4455-8a27-6fb081d2a66b req-b481de01-99be-4bc9-a5c7-6972ce4e76a9 service nova] [instance: 8aa35482-60b8-4185-b14d-a2667fd3b5b7] Updating instance_info_cache with network_info: [{"id": "b4902494-07bb-48a3-b0f8-26115f2b04d6", "address": "fa:16:3e:d9:46:4b", "network": {"id": "effdc019-a66a-4e9b-a99c-4a7c5b715201", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-414399276-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.250", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bab7a1ba67749ba85f0785846ce0338", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4902494-07", "ovs_interfaceid": "b4902494-07bb-48a3-b0f8-26115f2b04d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:20:55 user nova-compute[72382]: DEBUG nova.network.neutron [req-fcfdbc6a-4bf1-4486-bb75-3802859d4024 req-9518c4a5-c457-4e8c-822f-c570195585bf service nova] [instance: d061ee79-0755-44a7-9929-086c274c9064] Updated VIF entry in instance network info cache for port b88483f9-249f-473e-a1eb-fee83c57a89b. {{(pid=72382) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 15:20:55 user nova-compute[72382]: DEBUG nova.network.neutron [req-fcfdbc6a-4bf1-4486-bb75-3802859d4024 req-9518c4a5-c457-4e8c-822f-c570195585bf service nova] [instance: d061ee79-0755-44a7-9929-086c274c9064] Updating instance_info_cache with network_info: [{"id": "b88483f9-249f-473e-a1eb-fee83c57a89b", "address": "fa:16:3e:28:6f:53", "network": {"id": "8cff6610-5196-4dc5-8213-fd83c40bf2b9", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2098434591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb5b667ffa644ac1afe75bd518b86a4d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb88483f9-24", "ovs_interfaceid": "b88483f9-249f-473e-a1eb-fee83c57a89b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:20:55 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:20:55 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-e5b42e60-f208-4455-8a27-6fb081d2a66b req-b481de01-99be-4bc9-a5c7-6972ce4e76a9 service nova] Releasing lock "refresh_cache-8aa35482-60b8-4185-b14d-a2667fd3b5b7" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 15:20:55 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.027s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:20:55 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[4557283e-2710-431b-b15d-9f83234f0c6c]: (4, ('- - 0', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:20:55 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] Searching for a device in session 20 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=72382) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 15:20:55 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] Connected to sdg using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lHczEwXN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72382) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 15:20:55 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-fcfdbc6a-4bf1-4486-bb75-3802859d4024 req-9518c4a5-c457-4e8c-822f-c570195585bf service nova] Releasing lock "refresh_cache-d061ee79-0755-44a7-9929-086c274c9064" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 15:20:55 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-dfc20570-5d65-4841-a131-a9e322f786bd tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8aa35482-60b8-4185-b14d-a2667fd3b5b7/disk --force-share --output=json -f qcow2 {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:20:55 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:20:55 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:20:55 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-dfc20570-5d65-4841-a131-a9e322f786bd tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8aa35482-60b8-4185-b14d-a2667fd3b5b7/disk --force-share --output=json -f qcow2" returned: 0 in 0.150s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:20:55 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-dfc20570-5d65-4841-a131-a9e322f786bd tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8aa35482-60b8-4185-b14d-a2667fd3b5b7/disk --force-share --output=json -f qcow2 {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:20:55 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:20:55 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-dfc20570-5d65-4841-a131-a9e322f786bd tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8aa35482-60b8-4185-b14d-a2667fd3b5b7/disk --force-share --output=json -f qcow2" returned: 0 in 0.159s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:20:55 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-dfc20570-5d65-4841-a131-a9e322f786bd tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:20:56 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-dfc20570-5d65-4841-a131-a9e322f786bd tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b --force-share --output=json" returned: 0 in 0.143s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:20:56 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-dfc20570-5d65-4841-a131-a9e322f786bd tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpgehr3g3r/468ac26055354d04aa4aa9a454943e15.delta 1073741824 {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:20:56 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-dfc20570-5d65-4841-a131-a9e322f786bd tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpgehr3g3r/468ac26055354d04aa4aa9a454943e15.delta 1073741824" returned: 0 in 0.127s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:20:56 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-dfc20570-5d65-4841-a131-a9e322f786bd tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] [instance: 8aa35482-60b8-4185-b14d-a2667fd3b5b7] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 09 15:20:56 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.439s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 15:20:56 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] <== connect_volume: return (1441ms) {'type': 'block', 'scsi_wwn': '23539333961633039', 'path': '/dev/sdg'} {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 15:20:56 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] [instance: cff2fb57-7d0b-4278-89ed-10a8ec5128ea] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23539333961633039', 'path': '/dev/sdg'} {{(pid=72382) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 15:20:56 user nova-compute[72382]: DEBUG nova.virt.libvirt.vif [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T15:20:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-169397074',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-169397074',id=17,image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNRMrYzvK3pYJ1FJMjc+V1i2P1GCZ7pr4peXof/MmhII+4Xmj4q6cN16NSsZ2VBvvUMajqTcHDJ4oijFZtGUhO6P/PbviQhdpIFcs92gxfNJp5GkGgqfjd5oki77f6xzQw==',key_name='tempest-keypair-889744656',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='42fe649aa7cd43678bd4f2cb24f45e18',ramdisk_id='',reservation_id='r-z007s7m7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1511835318',owner_user_name='tempest-TaggedBootDevicesTest_v242-1511835318-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T15:20:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='551eba2d528148b4b3b266f3dfb4a190',uuid=cff2fb57-7d0b-4278-89ed-10a8ec5128ea,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "477e93e2-c6aa-47e7-bed7-62b4bb29a9ea", "address": "fa:16:3e:46:0b:d6", "network": {"id": "5f1aee90-5c93-4fe5-a140-7e3ac136489f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1100115541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42fe649aa7cd43678bd4f2cb24f45e18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap477e93e2-c6", "ovs_interfaceid": "477e93e2-c6aa-47e7-bed7-62b4bb29a9ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72382) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 15:20:56 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] Converting VIF {"id": "477e93e2-c6aa-47e7-bed7-62b4bb29a9ea", "address": "fa:16:3e:46:0b:d6", "network": {"id": "5f1aee90-5c93-4fe5-a140-7e3ac136489f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1100115541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42fe649aa7cd43678bd4f2cb24f45e18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap477e93e2-c6", "ovs_interfaceid": "477e93e2-c6aa-47e7-bed7-62b4bb29a9ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 15:20:56 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:46:0b:d6,bridge_name='br-int',has_traffic_filtering=True,id=477e93e2-c6aa-47e7-bed7-62b4bb29a9ea,network=Network(5f1aee90-5c93-4fe5-a140-7e3ac136489f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap477e93e2-c6') {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 15:20:56 user nova-compute[72382]: DEBUG nova.virt.libvirt.vif [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T15:20:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-169397074',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-169397074',id=17,image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNRMrYzvK3pYJ1FJMjc+V1i2P1GCZ7pr4peXof/MmhII+4Xmj4q6cN16NSsZ2VBvvUMajqTcHDJ4oijFZtGUhO6P/PbviQhdpIFcs92gxfNJp5GkGgqfjd5oki77f6xzQw==',key_name='tempest-keypair-889744656',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='42fe649aa7cd43678bd4f2cb24f45e18',ramdisk_id='',reservation_id='r-z007s7m7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1511835318',owner_user_name='tempest-TaggedBootDevicesTest_v242-1511835318-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T15:20:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='551eba2d528148b4b3b266f3dfb4a190',uuid=cff2fb57-7d0b-4278-89ed-10a8ec5128ea,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "55cf98ab-8cd2-4704-971f-ee4ceebca331", "address": "fa:16:3e:8c:34:e0", "network": {"id": "dc656a4e-c46c-4821-b492-2376b82b26ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-2053726028", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "42fe649aa7cd43678bd4f2cb24f45e18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55cf98ab-8c", "ovs_interfaceid": "55cf98ab-8cd2-4704-971f-ee4ceebca331", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72382) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 15:20:56 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] Converting VIF {"id": "55cf98ab-8cd2-4704-971f-ee4ceebca331", "address": "fa:16:3e:8c:34:e0", "network": {"id": "dc656a4e-c46c-4821-b492-2376b82b26ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-2053726028", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "42fe649aa7cd43678bd4f2cb24f45e18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55cf98ab-8c", "ovs_interfaceid": "55cf98ab-8cd2-4704-971f-ee4ceebca331", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 15:20:56 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8c:34:e0,bridge_name='br-int',has_traffic_filtering=True,id=55cf98ab-8cd2-4704-971f-ee4ceebca331,network=Network(dc656a4e-c46c-4821-b492-2376b82b26ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap55cf98ab-8c') {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 15:20:56 user nova-compute[72382]: DEBUG nova.virt.libvirt.vif [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T15:20:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-169397074',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-169397074',id=17,image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNRMrYzvK3pYJ1FJMjc+V1i2P1GCZ7pr4peXof/MmhII+4Xmj4q6cN16NSsZ2VBvvUMajqTcHDJ4oijFZtGUhO6P/PbviQhdpIFcs92gxfNJp5GkGgqfjd5oki77f6xzQw==',key_name='tempest-keypair-889744656',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='42fe649aa7cd43678bd4f2cb24f45e18',ramdisk_id='',reservation_id='r-z007s7m7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1511835318',owner_user_name='tempest-TaggedBootDevicesTest_v242-1511835318-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T15:20:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='551eba2d528148b4b3b266f3dfb4a190',uuid=cff2fb57-7d0b-4278-89ed-10a8ec5128ea,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "baeec4fc-3670-49f3-b42c-aab5ea116f45", "address": "fa:16:3e:72:b4:02", "network": {"id": "dc656a4e-c46c-4821-b492-2376b82b26ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-2053726028", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.135", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "42fe649aa7cd43678bd4f2cb24f45e18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbaeec4fc-36", "ovs_interfaceid": "baeec4fc-3670-49f3-b42c-aab5ea116f45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72382) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 15:20:56 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] Converting VIF {"id": "baeec4fc-3670-49f3-b42c-aab5ea116f45", "address": "fa:16:3e:72:b4:02", "network": {"id": "dc656a4e-c46c-4821-b492-2376b82b26ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-2053726028", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.135", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "42fe649aa7cd43678bd4f2cb24f45e18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbaeec4fc-36", "ovs_interfaceid": "baeec4fc-3670-49f3-b42c-aab5ea116f45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 15:20:56 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:72:b4:02,bridge_name='br-int',has_traffic_filtering=True,id=baeec4fc-3670-49f3-b42c-aab5ea116f45,network=Network(dc656a4e-c46c-4821-b492-2376b82b26ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapbaeec4fc-36') {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 15:20:56 user nova-compute[72382]: DEBUG nova.virt.libvirt.vif [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T15:20:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-169397074',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-169397074',id=17,image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNRMrYzvK3pYJ1FJMjc+V1i2P1GCZ7pr4peXof/MmhII+4Xmj4q6cN16NSsZ2VBvvUMajqTcHDJ4oijFZtGUhO6P/PbviQhdpIFcs92gxfNJp5GkGgqfjd5oki77f6xzQw==',key_name='tempest-keypair-889744656',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='42fe649aa7cd43678bd4f2cb24f45e18',ramdisk_id='',reservation_id='r-z007s7m7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1511835318',owner_user_name='tempest-TaggedBootDevicesTest_v242-1511835318-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T15:20:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='551eba2d528148b4b3b266f3dfb4a190',uuid=cff2fb57-7d0b-4278-89ed-10a8ec5128ea,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "17d8899d-82c0-4a46-97de-31253f7d1b82", "address": "fa:16:3e:7b:f5:ee", "network": {"id": "dc656a4e-c46c-4821-b492-2376b82b26ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-2053726028", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.153", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "42fe649aa7cd43678bd4f2cb24f45e18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17d8899d-82", "ovs_interfaceid": "17d8899d-82c0-4a46-97de-31253f7d1b82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72382) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 15:20:56 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] Converting VIF {"id": "17d8899d-82c0-4a46-97de-31253f7d1b82", "address": "fa:16:3e:7b:f5:ee", "network": {"id": "dc656a4e-c46c-4821-b492-2376b82b26ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-2053726028", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.153", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "42fe649aa7cd43678bd4f2cb24f45e18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17d8899d-82", "ovs_interfaceid": "17d8899d-82c0-4a46-97de-31253f7d1b82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 15:20:56 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7b:f5:ee,bridge_name='br-int',has_traffic_filtering=True,id=17d8899d-82c0-4a46-97de-31253f7d1b82,network=Network(dc656a4e-c46c-4821-b492-2376b82b26ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap17d8899d-82') {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 15:20:56 user nova-compute[72382]: DEBUG nova.virt.libvirt.vif [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T15:20:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-169397074',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-169397074',id=17,image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNRMrYzvK3pYJ1FJMjc+V1i2P1GCZ7pr4peXof/MmhII+4Xmj4q6cN16NSsZ2VBvvUMajqTcHDJ4oijFZtGUhO6P/PbviQhdpIFcs92gxfNJp5GkGgqfjd5oki77f6xzQw==',key_name='tempest-keypair-889744656',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='42fe649aa7cd43678bd4f2cb24f45e18',ramdisk_id='',reservation_id='r-z007s7m7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1511835318',owner_user_name='tempest-TaggedBootDevicesTest_v242-1511835318-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T15:20:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='551eba2d528148b4b3b266f3dfb4a190',uuid=cff2fb57-7d0b-4278-89ed-10a8ec5128ea,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ce3acf5c-2e65-4650-aade-158b96a7d349", "address": "fa:16:3e:ff:b7:1e", "network": {"id": "dc656a4e-c46c-4821-b492-2376b82b26ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-2053726028", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.132", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "42fe649aa7cd43678bd4f2cb24f45e18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce3acf5c-2e", "ovs_interfaceid": "ce3acf5c-2e65-4650-aade-158b96a7d349", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72382) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 15:20:56 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] Converting VIF {"id": "ce3acf5c-2e65-4650-aade-158b96a7d349", "address": "fa:16:3e:ff:b7:1e", "network": {"id": "dc656a4e-c46c-4821-b492-2376b82b26ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-2053726028", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.132", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "42fe649aa7cd43678bd4f2cb24f45e18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce3acf5c-2e", "ovs_interfaceid": "ce3acf5c-2e65-4650-aade-158b96a7d349", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 15:20:56 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ff:b7:1e,bridge_name='br-int',has_traffic_filtering=True,id=ce3acf5c-2e65-4650-aade-158b96a7d349,network=Network(dc656a4e-c46c-4821-b492-2376b82b26ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce3acf5c-2e') {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 15:20:56 user nova-compute[72382]: DEBUG nova.virt.libvirt.vif [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T15:20:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-169397074',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-169397074',id=17,image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNRMrYzvK3pYJ1FJMjc+V1i2P1GCZ7pr4peXof/MmhII+4Xmj4q6cN16NSsZ2VBvvUMajqTcHDJ4oijFZtGUhO6P/PbviQhdpIFcs92gxfNJp5GkGgqfjd5oki77f6xzQw==',key_name='tempest-keypair-889744656',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='42fe649aa7cd43678bd4f2cb24f45e18',ramdisk_id='',reservation_id='r-z007s7m7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1511835318',owner_user_name='tempest-TaggedBootDevicesTest_v242-1511835318-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T15:20:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='551eba2d528148b4b3b266f3dfb4a190',uuid=cff2fb57-7d0b-4278-89ed-10a8ec5128ea,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "802211f2-fc95-4940-87bf-eb0658b56ff1", "address": "fa:16:3e:dd:68:92", "network": {"id": "c8d9a670-b921-4ea7-bc32-64ef779aa86c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1431242330", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "42fe649aa7cd43678bd4f2cb24f45e18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap802211f2-fc", "ovs_interfaceid": "802211f2-fc95-4940-87bf-eb0658b56ff1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72382) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 15:20:56 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] Converting VIF {"id": "802211f2-fc95-4940-87bf-eb0658b56ff1", "address": "fa:16:3e:dd:68:92", "network": {"id": "c8d9a670-b921-4ea7-bc32-64ef779aa86c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1431242330", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "42fe649aa7cd43678bd4f2cb24f45e18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap802211f2-fc", "ovs_interfaceid": "802211f2-fc95-4940-87bf-eb0658b56ff1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 15:20:56 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dd:68:92,bridge_name='br-int',has_traffic_filtering=True,id=802211f2-fc95-4940-87bf-eb0658b56ff1,network=Network(c8d9a670-b921-4ea7-bc32-64ef779aa86c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap802211f2-fc') {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 15:20:56 user nova-compute[72382]: DEBUG nova.virt.libvirt.vif [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T15:20:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-169397074',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-169397074',id=17,image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNRMrYzvK3pYJ1FJMjc+V1i2P1GCZ7pr4peXof/MmhII+4Xmj4q6cN16NSsZ2VBvvUMajqTcHDJ4oijFZtGUhO6P/PbviQhdpIFcs92gxfNJp5GkGgqfjd5oki77f6xzQw==',key_name='tempest-keypair-889744656',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='42fe649aa7cd43678bd4f2cb24f45e18',ramdisk_id='',reservation_id='r-z007s7m7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1511835318',owner_user_name='tempest-TaggedBootDevicesTest_v242-1511835318-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T15:20:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='551eba2d528148b4b3b266f3dfb4a190',uuid=cff2fb57-7d0b-4278-89ed-10a8ec5128ea,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bcf9d83a-a145-4d83-9df6-02eba42f64bf", "address": "fa:16:3e:98:67:3f", "network": {"id": "c8d9a670-b921-4ea7-bc32-64ef779aa86c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1431242330", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "42fe649aa7cd43678bd4f2cb24f45e18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcf9d83a-a1", "ovs_interfaceid": "bcf9d83a-a145-4d83-9df6-02eba42f64bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72382) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 15:20:56 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] Converting VIF {"id": "bcf9d83a-a145-4d83-9df6-02eba42f64bf", "address": "fa:16:3e:98:67:3f", "network": {"id": "c8d9a670-b921-4ea7-bc32-64ef779aa86c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1431242330", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "42fe649aa7cd43678bd4f2cb24f45e18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcf9d83a-a1", "ovs_interfaceid": "bcf9d83a-a145-4d83-9df6-02eba42f64bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 15:20:56 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:98:67:3f,bridge_name='br-int',has_traffic_filtering=True,id=bcf9d83a-a145-4d83-9df6-02eba42f64bf,network=Network(c8d9a670-b921-4ea7-bc32-64ef779aa86c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbcf9d83a-a1') {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 15:20:56 user nova-compute[72382]: DEBUG nova.objects.instance [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] Lazy-loading 'pci_devices' on Instance uuid cff2fb57-7d0b-4278-89ed-10a8ec5128ea {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:20:56 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] [instance: cff2fb57-7d0b-4278-89ed-10a8ec5128ea] End _get_guest_xml xml=<domain type="kvm">
Aug 09 15:20:56 user nova-compute[72382]:   <uuid>cff2fb57-7d0b-4278-89ed-10a8ec5128ea</uuid>
Aug 09 15:20:56 user nova-compute[72382]:   <name>instance-00000011</name>
Aug 09 15:20:56 user nova-compute[72382]:   <memory>524288</memory>
Aug 09 15:20:56 user nova-compute[72382]:   <vcpu>1</vcpu>
Aug 09 15:20:56 user nova-compute[72382]:   <metadata>
Aug 09 15:20:56 user nova-compute[72382]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 15:20:56 user nova-compute[72382]:       <nova:package version="0.0.0"/>
Aug 09 15:20:56 user nova-compute[72382]:       <nova:name>tempest-device-tagging-server-169397074</nova:name>
Aug 09 15:20:56 user nova-compute[72382]:       <nova:creationTime>2023-08-09 15:20:52</nova:creationTime>
Aug 09 15:20:56 user nova-compute[72382]:       <nova:flavor name="m1.tiny">
Aug 09 15:20:56 user nova-compute[72382]:         <nova:memory>512</nova:memory>
Aug 09 15:20:56 user nova-compute[72382]:         <nova:disk>1</nova:disk>
Aug 09 15:20:56 user nova-compute[72382]:         <nova:swap>0</nova:swap>
Aug 09 15:20:56 user nova-compute[72382]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 15:20:56 user nova-compute[72382]:         <nova:vcpus>1</nova:vcpus>
Aug 09 15:20:56 user nova-compute[72382]:       </nova:flavor>
Aug 09 15:20:56 user nova-compute[72382]:       <nova:owner>
Aug 09 15:20:56 user nova-compute[72382]:         <nova:user uuid="551eba2d528148b4b3b266f3dfb4a190">tempest-TaggedBootDevicesTest_v242-1511835318-project-member</nova:user>
Aug 09 15:20:56 user nova-compute[72382]:         <nova:project uuid="42fe649aa7cd43678bd4f2cb24f45e18">tempest-TaggedBootDevicesTest_v242-1511835318</nova:project>
Aug 09 15:20:56 user nova-compute[72382]:       </nova:owner>
Aug 09 15:20:56 user nova-compute[72382]:       <nova:root type="image" uuid="a79f2cea-eb27-4631-aaf3-05e7d9e411b4"/>
Aug 09 15:20:56 user nova-compute[72382]:       <nova:ports>
Aug 09 15:20:56 user nova-compute[72382]:         <nova:port uuid="477e93e2-c6aa-47e7-bed7-62b4bb29a9ea">
Aug 09 15:20:56 user nova-compute[72382]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 09 15:20:56 user nova-compute[72382]:         </nova:port>
Aug 09 15:20:56 user nova-compute[72382]:         <nova:port uuid="55cf98ab-8cd2-4704-971f-ee4ceebca331">
Aug 09 15:20:56 user nova-compute[72382]:           <nova:ip type="fixed" address="10.1.1.13" ipVersion="4"/>
Aug 09 15:20:56 user nova-compute[72382]:         </nova:port>
Aug 09 15:20:56 user nova-compute[72382]:         <nova:port uuid="baeec4fc-3670-49f3-b42c-aab5ea116f45">
Aug 09 15:20:56 user nova-compute[72382]:           <nova:ip type="fixed" address="10.1.1.135" ipVersion="4"/>
Aug 09 15:20:56 user nova-compute[72382]:         </nova:port>
Aug 09 15:20:56 user nova-compute[72382]:         <nova:port uuid="17d8899d-82c0-4a46-97de-31253f7d1b82">
Aug 09 15:20:56 user nova-compute[72382]:           <nova:ip type="fixed" address="10.1.1.153" ipVersion="4"/>
Aug 09 15:20:56 user nova-compute[72382]:         </nova:port>
Aug 09 15:20:56 user nova-compute[72382]:         <nova:port uuid="ce3acf5c-2e65-4650-aade-158b96a7d349">
Aug 09 15:20:56 user nova-compute[72382]:           <nova:ip type="fixed" address="10.1.1.132" ipVersion="4"/>
Aug 09 15:20:56 user nova-compute[72382]:         </nova:port>
Aug 09 15:20:56 user nova-compute[72382]:         <nova:port uuid="802211f2-fc95-4940-87bf-eb0658b56ff1">
Aug 09 15:20:56 user nova-compute[72382]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Aug 09 15:20:56 user nova-compute[72382]:         </nova:port>
Aug 09 15:20:56 user nova-compute[72382]:         <nova:port uuid="bcf9d83a-a145-4d83-9df6-02eba42f64bf">
Aug 09 15:20:56 user nova-compute[72382]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Aug 09 15:20:56 user nova-compute[72382]:         </nova:port>
Aug 09 15:20:56 user nova-compute[72382]:       </nova:ports>
Aug 09 15:20:56 user nova-compute[72382]:     </nova:instance>
Aug 09 15:20:56 user nova-compute[72382]:   </metadata>
Aug 09 15:20:56 user nova-compute[72382]:   <sysinfo type="smbios">
Aug 09 15:20:56 user nova-compute[72382]:     <system>
Aug 09 15:20:56 user nova-compute[72382]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 15:20:56 user nova-compute[72382]:       <entry name="product">OpenStack Nova</entry>
Aug 09 15:20:56 user nova-compute[72382]:       <entry name="version">0.0.0</entry>
Aug 09 15:20:56 user nova-compute[72382]:       <entry name="serial">cff2fb57-7d0b-4278-89ed-10a8ec5128ea</entry>
Aug 09 15:20:56 user nova-compute[72382]:       <entry name="uuid">cff2fb57-7d0b-4278-89ed-10a8ec5128ea</entry>
Aug 09 15:20:56 user nova-compute[72382]:       <entry name="family">Virtual Machine</entry>
Aug 09 15:20:56 user nova-compute[72382]:     </system>
Aug 09 15:20:56 user nova-compute[72382]:   </sysinfo>
Aug 09 15:20:56 user nova-compute[72382]:   <os>
Aug 09 15:20:56 user nova-compute[72382]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 15:20:56 user nova-compute[72382]:     <boot dev="hd"/>
Aug 09 15:20:56 user nova-compute[72382]:     <smbios mode="sysinfo"/>
Aug 09 15:20:56 user nova-compute[72382]:   </os>
Aug 09 15:20:56 user nova-compute[72382]:   <features>
Aug 09 15:20:56 user nova-compute[72382]:     <acpi/>
Aug 09 15:20:56 user nova-compute[72382]:     <apic/>
Aug 09 15:20:56 user nova-compute[72382]:     <vmcoreinfo/>
Aug 09 15:20:56 user nova-compute[72382]:   </features>
Aug 09 15:20:56 user nova-compute[72382]:   <clock offset="utc">
Aug 09 15:20:56 user nova-compute[72382]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 15:20:56 user nova-compute[72382]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 15:20:56 user nova-compute[72382]:     <timer name="hpet" present="no"/>
Aug 09 15:20:56 user nova-compute[72382]:   </clock>
Aug 09 15:20:56 user nova-compute[72382]:   <cpu mode="custom" match="exact">
Aug 09 15:20:56 user nova-compute[72382]:     <model>Nehalem</model>
Aug 09 15:20:56 user nova-compute[72382]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 15:20:56 user nova-compute[72382]:   </cpu>
Aug 09 15:20:56 user nova-compute[72382]:   <devices>
Aug 09 15:20:56 user nova-compute[72382]:     <disk type="file" device="cdrom">
Aug 09 15:20:56 user nova-compute[72382]:       <driver name="qemu" type="raw" cache="none"/>
Aug 09 15:20:56 user nova-compute[72382]:       <source file="/opt/stack/data/nova/instances/cff2fb57-7d0b-4278-89ed-10a8ec5128ea/disk.config"/>
Aug 09 15:20:56 user nova-compute[72382]:       <target dev="hda" bus="ide"/>
Aug 09 15:20:56 user nova-compute[72382]:     </disk>
Aug 09 15:20:56 user nova-compute[72382]:     <disk type="block" device="disk">
Aug 09 15:20:56 user nova-compute[72382]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 15:20:56 user nova-compute[72382]:       <source dev="/dev/sde"/>
Aug 09 15:20:56 user nova-compute[72382]:       <target dev="vda" bus="virtio"/>
Aug 09 15:20:56 user nova-compute[72382]:       <serial>e8bad821-ddd1-4287-806d-78ffdc34fa68</serial>
Aug 09 15:20:56 user nova-compute[72382]:     </disk>
Aug 09 15:20:56 user nova-compute[72382]:     <disk type="block" device="disk">
Aug 09 15:20:56 user nova-compute[72382]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 15:20:56 user nova-compute[72382]:       <source dev="/dev/sdf"/>
Aug 09 15:20:56 user nova-compute[72382]:       <target dev="vdb" bus="virtio"/>
Aug 09 15:20:56 user nova-compute[72382]:       <serial>184b0159-3cae-4d79-86b3-26a58437eb09</serial>
Aug 09 15:20:56 user nova-compute[72382]:     </disk>
Aug 09 15:20:56 user nova-compute[72382]:     <disk type="block" device="disk">
Aug 09 15:20:56 user nova-compute[72382]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 15:20:56 user nova-compute[72382]:       <source dev="/dev/sdg"/>
Aug 09 15:20:56 user nova-compute[72382]:       <target dev="vdc" bus="virtio"/>
Aug 09 15:20:56 user nova-compute[72382]:       <serial>1c6be653-7ab8-4b40-9e28-43c1eca5e016</serial>
Aug 09 15:20:56 user nova-compute[72382]:     </disk>
Aug 09 15:20:56 user nova-compute[72382]:     <interface type="ethernet">
Aug 09 15:20:56 user nova-compute[72382]:       <mac address="fa:16:3e:46:0b:d6"/>
Aug 09 15:20:56 user nova-compute[72382]:       <model type="virtio"/>
Aug 09 15:20:56 user nova-compute[72382]:       <mtu size="1442"/>
Aug 09 15:20:56 user nova-compute[72382]:       <target dev="tap477e93e2-c6"/>
Aug 09 15:20:56 user nova-compute[72382]:     </interface>
Aug 09 15:20:56 user nova-compute[72382]:     <interface type="ethernet">
Aug 09 15:20:56 user nova-compute[72382]:       <mac address="fa:16:3e:8c:34:e0"/>
Aug 09 15:20:56 user nova-compute[72382]:       <model type="virtio"/>
Aug 09 15:20:56 user nova-compute[72382]:       <mtu size="1442"/>
Aug 09 15:20:56 user nova-compute[72382]:       <target dev="tap55cf98ab-8c"/>
Aug 09 15:20:56 user nova-compute[72382]:     </interface>
Aug 09 15:20:56 user nova-compute[72382]:     <interface type="ethernet">
Aug 09 15:20:56 user nova-compute[72382]:       <mac address="fa:16:3e:72:b4:02"/>
Aug 09 15:20:56 user nova-compute[72382]:       <model type="virtio"/>
Aug 09 15:20:56 user nova-compute[72382]:       <mtu size="1442"/>
Aug 09 15:20:56 user nova-compute[72382]:       <target dev="tapbaeec4fc-36"/>
Aug 09 15:20:56 user nova-compute[72382]:     </interface>
Aug 09 15:20:56 user nova-compute[72382]:     <interface type="ethernet">
Aug 09 15:20:56 user nova-compute[72382]:       <mac address="fa:16:3e:7b:f5:ee"/>
Aug 09 15:20:56 user nova-compute[72382]:       <model type="virtio"/>
Aug 09 15:20:56 user nova-compute[72382]:       <mtu size="1442"/>
Aug 09 15:20:56 user nova-compute[72382]:       <target dev="tap17d8899d-82"/>
Aug 09 15:20:56 user nova-compute[72382]:     </interface>
Aug 09 15:20:56 user nova-compute[72382]:     <interface type="ethernet">
Aug 09 15:20:56 user nova-compute[72382]:       <mac address="fa:16:3e:ff:b7:1e"/>
Aug 09 15:20:56 user nova-compute[72382]:       <model type="virtio"/>
Aug 09 15:20:56 user nova-compute[72382]:       <mtu size="1442"/>
Aug 09 15:20:56 user nova-compute[72382]:       <target dev="tapce3acf5c-2e"/>
Aug 09 15:20:56 user nova-compute[72382]:     </interface>
Aug 09 15:20:56 user nova-compute[72382]:     <interface type="ethernet">
Aug 09 15:20:56 user nova-compute[72382]:       <mac address="fa:16:3e:dd:68:92"/>
Aug 09 15:20:56 user nova-compute[72382]:       <model type="virtio"/>
Aug 09 15:20:56 user nova-compute[72382]:       <mtu size="1442"/>
Aug 09 15:20:56 user nova-compute[72382]:       <target dev="tap802211f2-fc"/>
Aug 09 15:20:56 user nova-compute[72382]:     </interface>
Aug 09 15:20:56 user nova-compute[72382]:     <interface type="ethernet">
Aug 09 15:20:56 user nova-compute[72382]:       <mac address="fa:16:3e:98:67:3f"/>
Aug 09 15:20:56 user nova-compute[72382]:       <model type="virtio"/>
Aug 09 15:20:56 user nova-compute[72382]:       <mtu size="1442"/>
Aug 09 15:20:56 user nova-compute[72382]:       <target dev="tapbcf9d83a-a1"/>
Aug 09 15:20:56 user nova-compute[72382]:     </interface>
Aug 09 15:20:56 user nova-compute[72382]:     <serial type="pty">
Aug 09 15:20:56 user nova-compute[72382]:       <log file="/opt/stack/data/nova/instances/cff2fb57-7d0b-4278-89ed-10a8ec5128ea/console.log" append="off"/>
Aug 09 15:20:56 user nova-compute[72382]:     </serial>
Aug 09 15:20:56 user nova-compute[72382]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 15:20:56 user nova-compute[72382]:     <video>
Aug 09 15:20:56 user nova-compute[72382]:       <model type="virtio"/>
Aug 09 15:20:56 user nova-compute[72382]:     </video>
Aug 09 15:20:56 user nova-compute[72382]:     <rng model="virtio">
Aug 09 15:20:56 user nova-compute[72382]:       <backend model="random">/dev/urandom</backend>
Aug 09 15:20:56 user nova-compute[72382]:     </rng>
Aug 09 15:20:56 user nova-compute[72382]:     <controller type="usb" index="0" model="none"/>
Aug 09 15:20:56 user nova-compute[72382]:     <memballoon model="virtio">
Aug 09 15:20:56 user nova-compute[72382]:       <stats period="10"/>
Aug 09 15:20:56 user nova-compute[72382]:     </memballoon>
Aug 09 15:20:56 user nova-compute[72382]:   </devices>
Aug 09 15:20:56 user nova-compute[72382]: </domain>
Aug 09 15:20:56 user nova-compute[72382]:  {{(pid=72382) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 15:20:56 user nova-compute[72382]: DEBUG nova.virt.libvirt.vif [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T15:20:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-169397074',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-169397074',id=17,image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNRMrYzvK3pYJ1FJMjc+V1i2P1GCZ7pr4peXof/MmhII+4Xmj4q6cN16NSsZ2VBvvUMajqTcHDJ4oijFZtGUhO6P/PbviQhdpIFcs92gxfNJp5GkGgqfjd5oki77f6xzQw==',key_name='tempest-keypair-889744656',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='42fe649aa7cd43678bd4f2cb24f45e18',ramdisk_id='',reservation_id='r-z007s7m7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1511835318',owner_user_name='tempest-TaggedBootDevicesTest_v242-1511835318-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T15:20:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='551eba2d528148b4b3b266f3dfb4a190',uuid=cff2fb57-7d0b-4278-89ed-10a8ec5128ea,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "477e93e2-c6aa-47e7-bed7-62b4bb29a9ea", "address": "fa:16:3e:46:0b:d6", "network": {"id": "5f1aee90-5c93-4fe5-a140-7e3ac136489f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1100115541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42fe649aa7cd43678bd4f2cb24f45e18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap477e93e2-c6", "ovs_interfaceid": "477e93e2-c6aa-47e7-bed7-62b4bb29a9ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 15:20:56 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] Converting VIF {"id": "477e93e2-c6aa-47e7-bed7-62b4bb29a9ea", "address": "fa:16:3e:46:0b:d6", "network": {"id": "5f1aee90-5c93-4fe5-a140-7e3ac136489f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1100115541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42fe649aa7cd43678bd4f2cb24f45e18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap477e93e2-c6", "ovs_interfaceid": "477e93e2-c6aa-47e7-bed7-62b4bb29a9ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 15:20:56 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:46:0b:d6,bridge_name='br-int',has_traffic_filtering=True,id=477e93e2-c6aa-47e7-bed7-62b4bb29a9ea,network=Network(5f1aee90-5c93-4fe5-a140-7e3ac136489f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap477e93e2-c6') {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 15:20:56 user nova-compute[72382]: DEBUG os_vif [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:0b:d6,bridge_name='br-int',has_traffic_filtering=True,id=477e93e2-c6aa-47e7-bed7-62b4bb29a9ea,network=Network(5f1aee90-5c93-4fe5-a140-7e3ac136489f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap477e93e2-c6') {{(pid=72382) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 15:20:56 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:20:56 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:20:56 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 15:20:56 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:20:56 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap477e93e2-c6, may_exist=True, interface_attrs={}) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:20:56 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap477e93e2-c6, col_values=(('external_ids', {'iface-id': '477e93e2-c6aa-47e7-bed7-62b4bb29a9ea', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:46:0b:d6', 'vm-uuid': 'cff2fb57-7d0b-4278-89ed-10a8ec5128ea'}),), if_exists=True) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:20:56 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:20:56 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:20:56 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:20:56 user nova-compute[72382]: INFO os_vif [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:0b:d6,bridge_name='br-int',has_traffic_filtering=True,id=477e93e2-c6aa-47e7-bed7-62b4bb29a9ea,network=Network(5f1aee90-5c93-4fe5-a140-7e3ac136489f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap477e93e2-c6')
Aug 09 15:20:56 user nova-compute[72382]: DEBUG nova.virt.libvirt.vif [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T15:20:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-169397074',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-169397074',id=17,image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNRMrYzvK3pYJ1FJMjc+V1i2P1GCZ7pr4peXof/MmhII+4Xmj4q6cN16NSsZ2VBvvUMajqTcHDJ4oijFZtGUhO6P/PbviQhdpIFcs92gxfNJp5GkGgqfjd5oki77f6xzQw==',key_name='tempest-keypair-889744656',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='42fe649aa7cd43678bd4f2cb24f45e18',ramdisk_id='',reservation_id='r-z007s7m7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1511835318',owner_user_name='tempest-TaggedBootDevicesTest_v242-1511835318-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T15:20:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='551eba2d528148b4b3b266f3dfb4a190',uuid=cff2fb57-7d0b-4278-89ed-10a8ec5128ea,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "55cf98ab-8cd2-4704-971f-ee4ceebca331", "address": "fa:16:3e:8c:34:e0", "network": {"id": "dc656a4e-c46c-4821-b492-2376b82b26ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-2053726028", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "42fe649aa7cd43678bd4f2cb24f45e18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55cf98ab-8c", "ovs_interfaceid": "55cf98ab-8cd2-4704-971f-ee4ceebca331", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72382) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 15:20:56 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] Converting VIF {"id": "55cf98ab-8cd2-4704-971f-ee4ceebca331", "address": "fa:16:3e:8c:34:e0", "network": {"id": "dc656a4e-c46c-4821-b492-2376b82b26ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-2053726028", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "42fe649aa7cd43678bd4f2cb24f45e18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55cf98ab-8c", "ovs_interfaceid": "55cf98ab-8cd2-4704-971f-ee4ceebca331", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 15:20:56 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8c:34:e0,bridge_name='br-int',has_traffic_filtering=True,id=55cf98ab-8cd2-4704-971f-ee4ceebca331,network=Network(dc656a4e-c46c-4821-b492-2376b82b26ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap55cf98ab-8c') {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 15:20:56 user nova-compute[72382]: DEBUG os_vif [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:34:e0,bridge_name='br-int',has_traffic_filtering=True,id=55cf98ab-8cd2-4704-971f-ee4ceebca331,network=Network(dc656a4e-c46c-4821-b492-2376b82b26ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap55cf98ab-8c') {{(pid=72382) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 15:20:56 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:20:56 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:20:56 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 15:20:56 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:20:56 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap55cf98ab-8c, may_exist=True, interface_attrs={}) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:20:56 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap55cf98ab-8c, col_values=(('external_ids', {'iface-id': '55cf98ab-8cd2-4704-971f-ee4ceebca331', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8c:34:e0', 'vm-uuid': 'cff2fb57-7d0b-4278-89ed-10a8ec5128ea'}),), if_exists=True) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:20:56 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:20:56 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:20:56 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:20:56 user nova-compute[72382]: INFO os_vif [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:34:e0,bridge_name='br-int',has_traffic_filtering=True,id=55cf98ab-8cd2-4704-971f-ee4ceebca331,network=Network(dc656a4e-c46c-4821-b492-2376b82b26ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap55cf98ab-8c')
Aug 09 15:20:56 user nova-compute[72382]: DEBUG nova.virt.libvirt.vif [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T15:20:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-169397074',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-169397074',id=17,image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNRMrYzvK3pYJ1FJMjc+V1i2P1GCZ7pr4peXof/MmhII+4Xmj4q6cN16NSsZ2VBvvUMajqTcHDJ4oijFZtGUhO6P/PbviQhdpIFcs92gxfNJp5GkGgqfjd5oki77f6xzQw==',key_name='tempest-keypair-889744656',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='42fe649aa7cd43678bd4f2cb24f45e18',ramdisk_id='',reservation_id='r-z007s7m7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1511835318',owner_user_name='tempest-TaggedBootDevicesTest_v242-1511835318-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T15:20:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='551eba2d528148b4b3b266f3dfb4a190',uuid=cff2fb57-7d0b-4278-89ed-10a8ec5128ea,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "baeec4fc-3670-49f3-b42c-aab5ea116f45", "address": "fa:16:3e:72:b4:02", "network": {"id": "dc656a4e-c46c-4821-b492-2376b82b26ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-2053726028", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.135", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "42fe649aa7cd43678bd4f2cb24f45e18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbaeec4fc-36", "ovs_interfaceid": "baeec4fc-3670-49f3-b42c-aab5ea116f45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72382) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 15:20:56 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] Converting VIF {"id": "baeec4fc-3670-49f3-b42c-aab5ea116f45", "address": "fa:16:3e:72:b4:02", "network": {"id": "dc656a4e-c46c-4821-b492-2376b82b26ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-2053726028", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.135", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "42fe649aa7cd43678bd4f2cb24f45e18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbaeec4fc-36", "ovs_interfaceid": "baeec4fc-3670-49f3-b42c-aab5ea116f45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 15:20:56 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:72:b4:02,bridge_name='br-int',has_traffic_filtering=True,id=baeec4fc-3670-49f3-b42c-aab5ea116f45,network=Network(dc656a4e-c46c-4821-b492-2376b82b26ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapbaeec4fc-36') {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 15:20:56 user nova-compute[72382]: DEBUG os_vif [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:b4:02,bridge_name='br-int',has_traffic_filtering=True,id=baeec4fc-3670-49f3-b42c-aab5ea116f45,network=Network(dc656a4e-c46c-4821-b492-2376b82b26ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapbaeec4fc-36') {{(pid=72382) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 15:20:56 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:20:56 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:20:56 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 15:20:56 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:20:56 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbaeec4fc-36, may_exist=True, interface_attrs={}) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:20:56 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapbaeec4fc-36, col_values=(('external_ids', {'iface-id': 'baeec4fc-3670-49f3-b42c-aab5ea116f45', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:72:b4:02', 'vm-uuid': 'cff2fb57-7d0b-4278-89ed-10a8ec5128ea'}),), if_exists=True) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:20:56 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:20:56 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:20:56 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:20:56 user nova-compute[72382]: INFO os_vif [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:b4:02,bridge_name='br-int',has_traffic_filtering=True,id=baeec4fc-3670-49f3-b42c-aab5ea116f45,network=Network(dc656a4e-c46c-4821-b492-2376b82b26ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapbaeec4fc-36')
Aug 09 15:20:56 user nova-compute[72382]: DEBUG nova.virt.libvirt.vif [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T15:20:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-169397074',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-169397074',id=17,image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNRMrYzvK3pYJ1FJMjc+V1i2P1GCZ7pr4peXof/MmhII+4Xmj4q6cN16NSsZ2VBvvUMajqTcHDJ4oijFZtGUhO6P/PbviQhdpIFcs92gxfNJp5GkGgqfjd5oki77f6xzQw==',key_name='tempest-keypair-889744656',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='42fe649aa7cd43678bd4f2cb24f45e18',ramdisk_id='',reservation_id='r-z007s7m7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1511835318',owner_user_name='tempest-TaggedBootDevicesTest_v242-1511835318-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T15:20:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='551eba2d528148b4b3b266f3dfb4a190',uuid=cff2fb57-7d0b-4278-89ed-10a8ec5128ea,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "17d8899d-82c0-4a46-97de-31253f7d1b82", "address": "fa:16:3e:7b:f5:ee", "network": {"id": "dc656a4e-c46c-4821-b492-2376b82b26ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-2053726028", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.153", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "42fe649aa7cd43678bd4f2cb24f45e18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17d8899d-82", "ovs_interfaceid": "17d8899d-82c0-4a46-97de-31253f7d1b82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 15:20:56 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] Converting VIF {"id": "17d8899d-82c0-4a46-97de-31253f7d1b82", "address": "fa:16:3e:7b:f5:ee", "network": {"id": "dc656a4e-c46c-4821-b492-2376b82b26ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-2053726028", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.153", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "42fe649aa7cd43678bd4f2cb24f45e18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17d8899d-82", "ovs_interfaceid": "17d8899d-82c0-4a46-97de-31253f7d1b82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 15:20:56 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7b:f5:ee,bridge_name='br-int',has_traffic_filtering=True,id=17d8899d-82c0-4a46-97de-31253f7d1b82,network=Network(dc656a4e-c46c-4821-b492-2376b82b26ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap17d8899d-82') {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 15:20:56 user nova-compute[72382]: DEBUG os_vif [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:f5:ee,bridge_name='br-int',has_traffic_filtering=True,id=17d8899d-82c0-4a46-97de-31253f7d1b82,network=Network(dc656a4e-c46c-4821-b492-2376b82b26ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap17d8899d-82') {{(pid=72382) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 15:20:56 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:20:56 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:20:56 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 15:20:56 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:20:56 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap17d8899d-82, may_exist=True, interface_attrs={}) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:20:56 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap17d8899d-82, col_values=(('external_ids', {'iface-id': '17d8899d-82c0-4a46-97de-31253f7d1b82', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7b:f5:ee', 'vm-uuid': 'cff2fb57-7d0b-4278-89ed-10a8ec5128ea'}),), if_exists=True) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:20:56 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:20:56 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:20:56 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:20:56 user nova-compute[72382]: INFO os_vif [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:f5:ee,bridge_name='br-int',has_traffic_filtering=True,id=17d8899d-82c0-4a46-97de-31253f7d1b82,network=Network(dc656a4e-c46c-4821-b492-2376b82b26ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap17d8899d-82')
Aug 09 15:20:56 user nova-compute[72382]: DEBUG nova.virt.libvirt.vif [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T15:20:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-169397074',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-169397074',id=17,image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNRMrYzvK3pYJ1FJMjc+V1i2P1GCZ7pr4peXof/MmhII+4Xmj4q6cN16NSsZ2VBvvUMajqTcHDJ4oijFZtGUhO6P/PbviQhdpIFcs92gxfNJp5GkGgqfjd5oki77f6xzQw==',key_name='tempest-keypair-889744656',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='42fe649aa7cd43678bd4f2cb24f45e18',ramdisk_id='',reservation_id='r-z007s7m7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1511835318',owner_user_name='tempest-TaggedBootDevicesTest_v242-1511835318-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T15:20:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='551eba2d528148b4b3b266f3dfb4a190',uuid=cff2fb57-7d0b-4278-89ed-10a8ec5128ea,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ce3acf5c-2e65-4650-aade-158b96a7d349", "address": "fa:16:3e:ff:b7:1e", "network": {"id": "dc656a4e-c46c-4821-b492-2376b82b26ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-2053726028", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.132", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "42fe649aa7cd43678bd4f2cb24f45e18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce3acf5c-2e", "ovs_interfaceid": "ce3acf5c-2e65-4650-aade-158b96a7d349", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 15:20:56 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] Converting VIF {"id": "ce3acf5c-2e65-4650-aade-158b96a7d349", "address": "fa:16:3e:ff:b7:1e", "network": {"id": "dc656a4e-c46c-4821-b492-2376b82b26ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-2053726028", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.132", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "42fe649aa7cd43678bd4f2cb24f45e18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce3acf5c-2e", "ovs_interfaceid": "ce3acf5c-2e65-4650-aade-158b96a7d349", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 15:20:56 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ff:b7:1e,bridge_name='br-int',has_traffic_filtering=True,id=ce3acf5c-2e65-4650-aade-158b96a7d349,network=Network(dc656a4e-c46c-4821-b492-2376b82b26ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce3acf5c-2e') {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 15:20:56 user nova-compute[72382]: DEBUG os_vif [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:b7:1e,bridge_name='br-int',has_traffic_filtering=True,id=ce3acf5c-2e65-4650-aade-158b96a7d349,network=Network(dc656a4e-c46c-4821-b492-2376b82b26ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce3acf5c-2e') {{(pid=72382) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 15:20:56 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:20:56 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:20:56 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 15:20:56 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:20:56 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapce3acf5c-2e, may_exist=True, interface_attrs={}) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:20:56 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapce3acf5c-2e, col_values=(('external_ids', {'iface-id': 'ce3acf5c-2e65-4650-aade-158b96a7d349', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ff:b7:1e', 'vm-uuid': 'cff2fb57-7d0b-4278-89ed-10a8ec5128ea'}),), if_exists=True) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:20:56 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:20:56 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:20:56 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:20:56 user nova-compute[72382]: INFO os_vif [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:b7:1e,bridge_name='br-int',has_traffic_filtering=True,id=ce3acf5c-2e65-4650-aade-158b96a7d349,network=Network(dc656a4e-c46c-4821-b492-2376b82b26ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce3acf5c-2e')
Aug 09 15:20:56 user nova-compute[72382]: DEBUG nova.virt.libvirt.vif [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T15:20:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-169397074',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-169397074',id=17,image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNRMrYzvK3pYJ1FJMjc+V1i2P1GCZ7pr4peXof/MmhII+4Xmj4q6cN16NSsZ2VBvvUMajqTcHDJ4oijFZtGUhO6P/PbviQhdpIFcs92gxfNJp5GkGgqfjd5oki77f6xzQw==',key_name='tempest-keypair-889744656',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='42fe649aa7cd43678bd4f2cb24f45e18',ramdisk_id='',reservation_id='r-z007s7m7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1511835318',owner_user_name='tempest-TaggedBootDevicesTest_v242-1511835318-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T15:20:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='551eba2d528148b4b3b266f3dfb4a190',uuid=cff2fb57-7d0b-4278-89ed-10a8ec5128ea,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "802211f2-fc95-4940-87bf-eb0658b56ff1", "address": "fa:16:3e:dd:68:92", "network": {"id": "c8d9a670-b921-4ea7-bc32-64ef779aa86c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1431242330", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "42fe649aa7cd43678bd4f2cb24f45e18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap802211f2-fc", "ovs_interfaceid": "802211f2-fc95-4940-87bf-eb0658b56ff1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 15:20:56 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] Converting VIF {"id": "802211f2-fc95-4940-87bf-eb0658b56ff1", "address": "fa:16:3e:dd:68:92", "network": {"id": "c8d9a670-b921-4ea7-bc32-64ef779aa86c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1431242330", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "42fe649aa7cd43678bd4f2cb24f45e18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap802211f2-fc", "ovs_interfaceid": "802211f2-fc95-4940-87bf-eb0658b56ff1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 15:20:56 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dd:68:92,bridge_name='br-int',has_traffic_filtering=True,id=802211f2-fc95-4940-87bf-eb0658b56ff1,network=Network(c8d9a670-b921-4ea7-bc32-64ef779aa86c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap802211f2-fc') {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 15:20:56 user nova-compute[72382]: DEBUG os_vif [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:68:92,bridge_name='br-int',has_traffic_filtering=True,id=802211f2-fc95-4940-87bf-eb0658b56ff1,network=Network(c8d9a670-b921-4ea7-bc32-64ef779aa86c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap802211f2-fc') {{(pid=72382) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 15:20:56 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:20:56 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:20:56 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 15:20:56 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:20:56 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap802211f2-fc, may_exist=True, interface_attrs={}) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:20:56 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap802211f2-fc, col_values=(('external_ids', {'iface-id': '802211f2-fc95-4940-87bf-eb0658b56ff1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:dd:68:92', 'vm-uuid': 'cff2fb57-7d0b-4278-89ed-10a8ec5128ea'}),), if_exists=True) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:20:56 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:20:56 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:20:56 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:20:56 user nova-compute[72382]: INFO os_vif [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:68:92,bridge_name='br-int',has_traffic_filtering=True,id=802211f2-fc95-4940-87bf-eb0658b56ff1,network=Network(c8d9a670-b921-4ea7-bc32-64ef779aa86c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap802211f2-fc')
Aug 09 15:20:56 user nova-compute[72382]: DEBUG nova.virt.libvirt.vif [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T15:20:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-169397074',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-169397074',id=17,image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNRMrYzvK3pYJ1FJMjc+V1i2P1GCZ7pr4peXof/MmhII+4Xmj4q6cN16NSsZ2VBvvUMajqTcHDJ4oijFZtGUhO6P/PbviQhdpIFcs92gxfNJp5GkGgqfjd5oki77f6xzQw==',key_name='tempest-keypair-889744656',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='42fe649aa7cd43678bd4f2cb24f45e18',ramdisk_id='',reservation_id='r-z007s7m7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1511835318',owner_user_name='tempest-TaggedBootDevicesTest_v242-1511835318-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T15:20:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='551eba2d528148b4b3b266f3dfb4a190',uuid=cff2fb57-7d0b-4278-89ed-10a8ec5128ea,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bcf9d83a-a145-4d83-9df6-02eba42f64bf", "address": "fa:16:3e:98:67:3f", "network": {"id": "c8d9a670-b921-4ea7-bc32-64ef779aa86c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1431242330", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "42fe649aa7cd43678bd4f2cb24f45e18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcf9d83a-a1", "ovs_interfaceid": "bcf9d83a-a145-4d83-9df6-02eba42f64bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 15:20:56 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] Converting VIF {"id": "bcf9d83a-a145-4d83-9df6-02eba42f64bf", "address": "fa:16:3e:98:67:3f", "network": {"id": "c8d9a670-b921-4ea7-bc32-64ef779aa86c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1431242330", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "42fe649aa7cd43678bd4f2cb24f45e18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcf9d83a-a1", "ovs_interfaceid": "bcf9d83a-a145-4d83-9df6-02eba42f64bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 15:20:56 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:98:67:3f,bridge_name='br-int',has_traffic_filtering=True,id=bcf9d83a-a145-4d83-9df6-02eba42f64bf,network=Network(c8d9a670-b921-4ea7-bc32-64ef779aa86c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbcf9d83a-a1') {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 15:20:56 user nova-compute[72382]: DEBUG os_vif [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:67:3f,bridge_name='br-int',has_traffic_filtering=True,id=bcf9d83a-a145-4d83-9df6-02eba42f64bf,network=Network(c8d9a670-b921-4ea7-bc32-64ef779aa86c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbcf9d83a-a1') {{(pid=72382) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 15:20:56 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:20:56 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:20:56 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 15:20:56 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:20:56 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbcf9d83a-a1, may_exist=True, interface_attrs={}) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:20:56 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapbcf9d83a-a1, col_values=(('external_ids', {'iface-id': 'bcf9d83a-a145-4d83-9df6-02eba42f64bf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:98:67:3f', 'vm-uuid': 'cff2fb57-7d0b-4278-89ed-10a8ec5128ea'}),), if_exists=True) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:20:56 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:20:56 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:20:57 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:20:57 user nova-compute[72382]: INFO os_vif [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:67:3f,bridge_name='br-int',has_traffic_filtering=True,id=bcf9d83a-a145-4d83-9df6-02eba42f64bf,network=Network(c8d9a670-b921-4ea7-bc32-64ef779aa86c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbcf9d83a-a1')
Aug 09 15:20:57 user nova-compute[72382]: DEBUG nova.virt.libvirt.guest [None req-dfc20570-5d65-4841-a131-a9e322f786bd tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=72382) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 09 15:20:57 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] No BDM found with device name hda, not building metadata. {{(pid=72382) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 15:20:57 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72382) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 15:20:57 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] No VIF found with MAC fa:16:3e:46:0b:d6, not building metadata {{(pid=72382) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 15:20:57 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] No VIF found with MAC fa:16:3e:ff:b7:1e, not building metadata {{(pid=72382) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 15:20:57 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] [instance: cff2fb57-7d0b-4278-89ed-10a8ec5128ea] Using config drive
Aug 09 15:20:57 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] [instance: cff2fb57-7d0b-4278-89ed-10a8ec5128ea] Creating config drive at /opt/stack/data/nova/instances/cff2fb57-7d0b-4278-89ed-10a8ec5128ea/disk.config
Aug 09 15:20:57 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/cff2fb57-7d0b-4278-89ed-10a8ec5128ea/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp_ybegrrb {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:20:57 user nova-compute[72382]: DEBUG nova.compute.manager [req-9ac502a7-eb66-4717-82c3-9a20a4c6b785 req-ac152fb4-a452-4746-a00d-144da5ac8b0b service nova] [instance: d061ee79-0755-44a7-9929-086c274c9064] Received event network-vif-plugged-b88483f9-249f-473e-a1eb-fee83c57a89b {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:20:57 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-9ac502a7-eb66-4717-82c3-9a20a4c6b785 req-ac152fb4-a452-4746-a00d-144da5ac8b0b service nova] Acquiring lock "d061ee79-0755-44a7-9929-086c274c9064-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:20:57 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-9ac502a7-eb66-4717-82c3-9a20a4c6b785 req-ac152fb4-a452-4746-a00d-144da5ac8b0b service nova] Lock "d061ee79-0755-44a7-9929-086c274c9064-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:20:57 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-9ac502a7-eb66-4717-82c3-9a20a4c6b785 req-ac152fb4-a452-4746-a00d-144da5ac8b0b service nova] Lock "d061ee79-0755-44a7-9929-086c274c9064-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:20:57 user nova-compute[72382]: DEBUG nova.compute.manager [req-9ac502a7-eb66-4717-82c3-9a20a4c6b785 req-ac152fb4-a452-4746-a00d-144da5ac8b0b service nova] [instance: d061ee79-0755-44a7-9929-086c274c9064] No waiting events found dispatching network-vif-plugged-b88483f9-249f-473e-a1eb-fee83c57a89b {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:20:57 user nova-compute[72382]: WARNING nova.compute.manager [req-9ac502a7-eb66-4717-82c3-9a20a4c6b785 req-ac152fb4-a452-4746-a00d-144da5ac8b0b service nova] [instance: d061ee79-0755-44a7-9929-086c274c9064] Received unexpected event network-vif-plugged-b88483f9-249f-473e-a1eb-fee83c57a89b for instance with vm_state building and task_state spawning.
Aug 09 15:20:57 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/cff2fb57-7d0b-4278-89ed-10a8ec5128ea/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp_ybegrrb" returned: 0 in 0.055s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:20:57 user nova-compute[72382]: DEBUG nova.virt.libvirt.guest [None req-dfc20570-5d65-4841-a131-a9e322f786bd tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] COPY block job progress, current cursor: 53346304 final cursor: 75563008 {{(pid=72382) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 09 15:20:57 user nova-compute[72382]: DEBUG nova.virt.driver [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Emitting event <LifecycleEvent: 1691594457.8314369, d061ee79-0755-44a7-9929-086c274c9064 => Resumed> {{(pid=72382) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 15:20:57 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: d061ee79-0755-44a7-9929-086c274c9064] VM Resumed (Lifecycle Event)
Aug 09 15:20:57 user nova-compute[72382]: DEBUG nova.compute.manager [None req-aaf2fadc-fe6e-41af-bc31-2c34724e77db tempest-VolumesActionsTest-536484564 tempest-VolumesActionsTest-536484564-project-member] [instance: d061ee79-0755-44a7-9929-086c274c9064] Instance event wait completed in 0 seconds for  {{(pid=72382) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 15:20:57 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-aaf2fadc-fe6e-41af-bc31-2c34724e77db tempest-VolumesActionsTest-536484564 tempest-VolumesActionsTest-536484564-project-member] [instance: d061ee79-0755-44a7-9929-086c274c9064] Guest created on hypervisor {{(pid=72382) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 15:20:57 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: d061ee79-0755-44a7-9929-086c274c9064] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:20:57 user nova-compute[72382]: INFO nova.virt.libvirt.driver [-] [instance: d061ee79-0755-44a7-9929-086c274c9064] Instance spawned successfully.
Aug 09 15:20:57 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-aaf2fadc-fe6e-41af-bc31-2c34724e77db tempest-VolumesActionsTest-536484564 tempest-VolumesActionsTest-536484564-project-member] [instance: d061ee79-0755-44a7-9929-086c274c9064] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 15:20:57 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: d061ee79-0755-44a7-9929-086c274c9064] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72382) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 15:20:57 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:20:57 user nova-compute[72382]: DEBUG nova.compute.manager [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Cleaning up deleted instances {{(pid=72382) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 09 15:20:57 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: d061ee79-0755-44a7-9929-086c274c9064] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 15:20:57 user nova-compute[72382]: DEBUG nova.virt.driver [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Emitting event <LifecycleEvent: 1691594457.8379152, d061ee79-0755-44a7-9929-086c274c9064 => Started> {{(pid=72382) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 15:20:57 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: d061ee79-0755-44a7-9929-086c274c9064] VM Started (Lifecycle Event)
Aug 09 15:20:57 user nova-compute[72382]: DEBUG nova.compute.manager [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] There are 0 instances to clean {{(pid=72382) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 09 15:20:57 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-aaf2fadc-fe6e-41af-bc31-2c34724e77db tempest-VolumesActionsTest-536484564 tempest-VolumesActionsTest-536484564-project-member] [instance: d061ee79-0755-44a7-9929-086c274c9064] Found default for hw_cdrom_bus of ide {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:20:57 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-aaf2fadc-fe6e-41af-bc31-2c34724e77db tempest-VolumesActionsTest-536484564 tempest-VolumesActionsTest-536484564-project-member] [instance: d061ee79-0755-44a7-9929-086c274c9064] Found default for hw_disk_bus of virtio {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:20:57 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-aaf2fadc-fe6e-41af-bc31-2c34724e77db tempest-VolumesActionsTest-536484564 tempest-VolumesActionsTest-536484564-project-member] [instance: d061ee79-0755-44a7-9929-086c274c9064] Found default for hw_input_bus of None {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:20:57 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-aaf2fadc-fe6e-41af-bc31-2c34724e77db tempest-VolumesActionsTest-536484564 tempest-VolumesActionsTest-536484564-project-member] [instance: d061ee79-0755-44a7-9929-086c274c9064] Found default for hw_pointer_model of None {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:20:57 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-aaf2fadc-fe6e-41af-bc31-2c34724e77db tempest-VolumesActionsTest-536484564 tempest-VolumesActionsTest-536484564-project-member] [instance: d061ee79-0755-44a7-9929-086c274c9064] Found default for hw_video_model of virtio {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:20:57 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-aaf2fadc-fe6e-41af-bc31-2c34724e77db tempest-VolumesActionsTest-536484564 tempest-VolumesActionsTest-536484564-project-member] [instance: d061ee79-0755-44a7-9929-086c274c9064] Found default for hw_vif_model of virtio {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:20:57 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: d061ee79-0755-44a7-9929-086c274c9064] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:20:57 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: d061ee79-0755-44a7-9929-086c274c9064] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72382) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 15:20:57 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: d061ee79-0755-44a7-9929-086c274c9064] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 15:20:58 user nova-compute[72382]: INFO nova.compute.manager [None req-aaf2fadc-fe6e-41af-bc31-2c34724e77db tempest-VolumesActionsTest-536484564 tempest-VolumesActionsTest-536484564-project-member] [instance: d061ee79-0755-44a7-9929-086c274c9064] Took 8.58 seconds to spawn the instance on the hypervisor.
Aug 09 15:20:58 user nova-compute[72382]: DEBUG nova.compute.manager [None req-aaf2fadc-fe6e-41af-bc31-2c34724e77db tempest-VolumesActionsTest-536484564 tempest-VolumesActionsTest-536484564-project-member] [instance: d061ee79-0755-44a7-9929-086c274c9064] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:20:58 user nova-compute[72382]: DEBUG nova.virt.libvirt.guest [None req-dfc20570-5d65-4841-a131-a9e322f786bd tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=72382) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 09 15:20:58 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-dfc20570-5d65-4841-a131-a9e322f786bd tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] [instance: 8aa35482-60b8-4185-b14d-a2667fd3b5b7] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 09 15:20:58 user nova-compute[72382]: INFO nova.compute.manager [None req-aaf2fadc-fe6e-41af-bc31-2c34724e77db tempest-VolumesActionsTest-536484564 tempest-VolumesActionsTest-536484564-project-member] [instance: d061ee79-0755-44a7-9929-086c274c9064] Took 9.55 seconds to build instance.
Aug 09 15:20:58 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-aaf2fadc-fe6e-41af-bc31-2c34724e77db tempest-VolumesActionsTest-536484564 tempest-VolumesActionsTest-536484564-project-member] Lock "d061ee79-0755-44a7-9929-086c274c9064" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.648s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:20:58 user nova-compute[72382]: DEBUG nova.privsep.utils [None req-dfc20570-5d65-4841-a131-a9e322f786bd tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72382) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 09 15:20:58 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-dfc20570-5d65-4841-a131-a9e322f786bd tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpgehr3g3r/468ac26055354d04aa4aa9a454943e15.delta /opt/stack/data/nova/instances/snapshots/tmpgehr3g3r/468ac26055354d04aa4aa9a454943e15 {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:20:58 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:20:58 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:20:58 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:20:58 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:20:58 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-dfc20570-5d65-4841-a131-a9e322f786bd tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpgehr3g3r/468ac26055354d04aa4aa9a454943e15.delta /opt/stack/data/nova/instances/snapshots/tmpgehr3g3r/468ac26055354d04aa4aa9a454943e15" returned: 0 in 0.472s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:20:58 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-dfc20570-5d65-4841-a131-a9e322f786bd tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] [instance: 8aa35482-60b8-4185-b14d-a2667fd3b5b7] Snapshot extracted, beginning image upload
Aug 09 15:20:58 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:20:59 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:20:59 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:20:59 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:20:59 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:20:59 user nova-compute[72382]: DEBUG nova.compute.manager [req-bb43fd70-a30e-4904-b935-6590b5111c46 req-52801e62-d2d4-49f4-9296-3af1035b3981 service nova] [instance: cff2fb57-7d0b-4278-89ed-10a8ec5128ea] Received event network-vif-plugged-477e93e2-c6aa-47e7-bed7-62b4bb29a9ea {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:20:59 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-bb43fd70-a30e-4904-b935-6590b5111c46 req-52801e62-d2d4-49f4-9296-3af1035b3981 service nova] Acquiring lock "cff2fb57-7d0b-4278-89ed-10a8ec5128ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:20:59 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-bb43fd70-a30e-4904-b935-6590b5111c46 req-52801e62-d2d4-49f4-9296-3af1035b3981 service nova] Lock "cff2fb57-7d0b-4278-89ed-10a8ec5128ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:20:59 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-bb43fd70-a30e-4904-b935-6590b5111c46 req-52801e62-d2d4-49f4-9296-3af1035b3981 service nova] Lock "cff2fb57-7d0b-4278-89ed-10a8ec5128ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:20:59 user nova-compute[72382]: DEBUG nova.compute.manager [req-bb43fd70-a30e-4904-b935-6590b5111c46 req-52801e62-d2d4-49f4-9296-3af1035b3981 service nova] [instance: cff2fb57-7d0b-4278-89ed-10a8ec5128ea] No waiting events found dispatching network-vif-plugged-477e93e2-c6aa-47e7-bed7-62b4bb29a9ea {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:20:59 user nova-compute[72382]: WARNING nova.compute.manager [req-bb43fd70-a30e-4904-b935-6590b5111c46 req-52801e62-d2d4-49f4-9296-3af1035b3981 service nova] [instance: cff2fb57-7d0b-4278-89ed-10a8ec5128ea] Received unexpected event network-vif-plugged-477e93e2-c6aa-47e7-bed7-62b4bb29a9ea for instance with vm_state building and task_state spawning.
Aug 09 15:20:59 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:20:59 user nova-compute[72382]: DEBUG nova.compute.manager [req-66f1c918-90ea-4223-97b9-8f3c8575e703 req-b5876c8d-b179-4ff5-8a01-aa8fa54b07d7 service nova] [instance: cff2fb57-7d0b-4278-89ed-10a8ec5128ea] Received event network-vif-plugged-55cf98ab-8cd2-4704-971f-ee4ceebca331 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:20:59 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-66f1c918-90ea-4223-97b9-8f3c8575e703 req-b5876c8d-b179-4ff5-8a01-aa8fa54b07d7 service nova] Acquiring lock "cff2fb57-7d0b-4278-89ed-10a8ec5128ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:20:59 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-66f1c918-90ea-4223-97b9-8f3c8575e703 req-b5876c8d-b179-4ff5-8a01-aa8fa54b07d7 service nova] Lock "cff2fb57-7d0b-4278-89ed-10a8ec5128ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:20:59 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-66f1c918-90ea-4223-97b9-8f3c8575e703 req-b5876c8d-b179-4ff5-8a01-aa8fa54b07d7 service nova] Lock "cff2fb57-7d0b-4278-89ed-10a8ec5128ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:20:59 user nova-compute[72382]: DEBUG nova.compute.manager [req-66f1c918-90ea-4223-97b9-8f3c8575e703 req-b5876c8d-b179-4ff5-8a01-aa8fa54b07d7 service nova] [instance: cff2fb57-7d0b-4278-89ed-10a8ec5128ea] No waiting events found dispatching network-vif-plugged-55cf98ab-8cd2-4704-971f-ee4ceebca331 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:20:59 user nova-compute[72382]: WARNING nova.compute.manager [req-66f1c918-90ea-4223-97b9-8f3c8575e703 req-b5876c8d-b179-4ff5-8a01-aa8fa54b07d7 service nova] [instance: cff2fb57-7d0b-4278-89ed-10a8ec5128ea] Received unexpected event network-vif-plugged-55cf98ab-8cd2-4704-971f-ee4ceebca331 for instance with vm_state building and task_state spawning.
Aug 09 15:20:59 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:20:59 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:20:59 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:20:59 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:20:59 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:20:59 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:20:59 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:21:00 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:21:00 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:21:00 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:21:00 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:21:00 user nova-compute[72382]: DEBUG nova.compute.manager [req-8871a0dd-a605-41d3-8ffa-3422fd56e0ed req-43ce7eba-fa97-405a-baf5-7094867cea52 service nova] [instance: cff2fb57-7d0b-4278-89ed-10a8ec5128ea] Received event network-vif-plugged-17d8899d-82c0-4a46-97de-31253f7d1b82 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:21:00 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-8871a0dd-a605-41d3-8ffa-3422fd56e0ed req-43ce7eba-fa97-405a-baf5-7094867cea52 service nova] Acquiring lock "cff2fb57-7d0b-4278-89ed-10a8ec5128ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:21:00 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-8871a0dd-a605-41d3-8ffa-3422fd56e0ed req-43ce7eba-fa97-405a-baf5-7094867cea52 service nova] Lock "cff2fb57-7d0b-4278-89ed-10a8ec5128ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:21:00 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-8871a0dd-a605-41d3-8ffa-3422fd56e0ed req-43ce7eba-fa97-405a-baf5-7094867cea52 service nova] Lock "cff2fb57-7d0b-4278-89ed-10a8ec5128ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:21:00 user nova-compute[72382]: DEBUG nova.compute.manager [req-8871a0dd-a605-41d3-8ffa-3422fd56e0ed req-43ce7eba-fa97-405a-baf5-7094867cea52 service nova] [instance: cff2fb57-7d0b-4278-89ed-10a8ec5128ea] No waiting events found dispatching network-vif-plugged-17d8899d-82c0-4a46-97de-31253f7d1b82 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:21:00 user nova-compute[72382]: WARNING nova.compute.manager [req-8871a0dd-a605-41d3-8ffa-3422fd56e0ed req-43ce7eba-fa97-405a-baf5-7094867cea52 service nova] [instance: cff2fb57-7d0b-4278-89ed-10a8ec5128ea] Received unexpected event network-vif-plugged-17d8899d-82c0-4a46-97de-31253f7d1b82 for instance with vm_state building and task_state spawning.
Aug 09 15:21:00 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:21:00 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:21:00 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:21:00 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:21:00 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:21:00 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:21:00 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:21:01 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:21:01 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:21:01 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:21:01 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:21:01 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:21:01 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:21:01 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:21:01 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:21:01 user nova-compute[72382]: DEBUG nova.compute.manager [req-37850c85-79be-449a-9298-7a0262535263 req-a990b906-0cbe-4690-8960-05f0466a870f service nova] [instance: cff2fb57-7d0b-4278-89ed-10a8ec5128ea] Received event network-vif-plugged-477e93e2-c6aa-47e7-bed7-62b4bb29a9ea {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:21:01 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-37850c85-79be-449a-9298-7a0262535263 req-a990b906-0cbe-4690-8960-05f0466a870f service nova] Acquiring lock "cff2fb57-7d0b-4278-89ed-10a8ec5128ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:21:01 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-37850c85-79be-449a-9298-7a0262535263 req-a990b906-0cbe-4690-8960-05f0466a870f service nova] Lock "cff2fb57-7d0b-4278-89ed-10a8ec5128ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:21:01 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-37850c85-79be-449a-9298-7a0262535263 req-a990b906-0cbe-4690-8960-05f0466a870f service nova] Lock "cff2fb57-7d0b-4278-89ed-10a8ec5128ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:21:01 user nova-compute[72382]: DEBUG nova.compute.manager [req-37850c85-79be-449a-9298-7a0262535263 req-a990b906-0cbe-4690-8960-05f0466a870f service nova] [instance: cff2fb57-7d0b-4278-89ed-10a8ec5128ea] No waiting events found dispatching network-vif-plugged-477e93e2-c6aa-47e7-bed7-62b4bb29a9ea {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:21:01 user nova-compute[72382]: WARNING nova.compute.manager [req-37850c85-79be-449a-9298-7a0262535263 req-a990b906-0cbe-4690-8960-05f0466a870f service nova] [instance: cff2fb57-7d0b-4278-89ed-10a8ec5128ea] Received unexpected event network-vif-plugged-477e93e2-c6aa-47e7-bed7-62b4bb29a9ea for instance with vm_state building and task_state spawning.
Aug 09 15:21:01 user nova-compute[72382]: DEBUG nova.compute.manager [req-37850c85-79be-449a-9298-7a0262535263 req-a990b906-0cbe-4690-8960-05f0466a870f service nova] [instance: cff2fb57-7d0b-4278-89ed-10a8ec5128ea] Received event network-vif-plugged-baeec4fc-3670-49f3-b42c-aab5ea116f45 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:21:01 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-37850c85-79be-449a-9298-7a0262535263 req-a990b906-0cbe-4690-8960-05f0466a870f service nova] Acquiring lock "cff2fb57-7d0b-4278-89ed-10a8ec5128ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:21:01 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-37850c85-79be-449a-9298-7a0262535263 req-a990b906-0cbe-4690-8960-05f0466a870f service nova] Lock "cff2fb57-7d0b-4278-89ed-10a8ec5128ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:21:01 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-37850c85-79be-449a-9298-7a0262535263 req-a990b906-0cbe-4690-8960-05f0466a870f service nova] Lock "cff2fb57-7d0b-4278-89ed-10a8ec5128ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:21:01 user nova-compute[72382]: DEBUG nova.compute.manager [req-37850c85-79be-449a-9298-7a0262535263 req-a990b906-0cbe-4690-8960-05f0466a870f service nova] [instance: cff2fb57-7d0b-4278-89ed-10a8ec5128ea] No waiting events found dispatching network-vif-plugged-baeec4fc-3670-49f3-b42c-aab5ea116f45 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:21:01 user nova-compute[72382]: WARNING nova.compute.manager [req-37850c85-79be-449a-9298-7a0262535263 req-a990b906-0cbe-4690-8960-05f0466a870f service nova] [instance: cff2fb57-7d0b-4278-89ed-10a8ec5128ea] Received unexpected event network-vif-plugged-baeec4fc-3670-49f3-b42c-aab5ea116f45 for instance with vm_state building and task_state spawning.
Aug 09 15:21:01 user nova-compute[72382]: DEBUG nova.compute.manager [req-37850c85-79be-449a-9298-7a0262535263 req-a990b906-0cbe-4690-8960-05f0466a870f service nova] [instance: cff2fb57-7d0b-4278-89ed-10a8ec5128ea] Received event network-vif-plugged-baeec4fc-3670-49f3-b42c-aab5ea116f45 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:21:01 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-37850c85-79be-449a-9298-7a0262535263 req-a990b906-0cbe-4690-8960-05f0466a870f service nova] Acquiring lock "cff2fb57-7d0b-4278-89ed-10a8ec5128ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:21:01 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-37850c85-79be-449a-9298-7a0262535263 req-a990b906-0cbe-4690-8960-05f0466a870f service nova] Lock "cff2fb57-7d0b-4278-89ed-10a8ec5128ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:21:01 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-37850c85-79be-449a-9298-7a0262535263 req-a990b906-0cbe-4690-8960-05f0466a870f service nova] Lock "cff2fb57-7d0b-4278-89ed-10a8ec5128ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:21:01 user nova-compute[72382]: DEBUG nova.compute.manager [req-37850c85-79be-449a-9298-7a0262535263 req-a990b906-0cbe-4690-8960-05f0466a870f service nova] [instance: cff2fb57-7d0b-4278-89ed-10a8ec5128ea] No waiting events found dispatching network-vif-plugged-baeec4fc-3670-49f3-b42c-aab5ea116f45 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:21:01 user nova-compute[72382]: WARNING nova.compute.manager [req-37850c85-79be-449a-9298-7a0262535263 req-a990b906-0cbe-4690-8960-05f0466a870f service nova] [instance: cff2fb57-7d0b-4278-89ed-10a8ec5128ea] Received unexpected event network-vif-plugged-baeec4fc-3670-49f3-b42c-aab5ea116f45 for instance with vm_state building and task_state spawning.
Aug 09 15:21:01 user nova-compute[72382]: DEBUG nova.compute.manager [req-37850c85-79be-449a-9298-7a0262535263 req-a990b906-0cbe-4690-8960-05f0466a870f service nova] [instance: cff2fb57-7d0b-4278-89ed-10a8ec5128ea] Received event network-vif-plugged-ce3acf5c-2e65-4650-aade-158b96a7d349 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:21:01 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-37850c85-79be-449a-9298-7a0262535263 req-a990b906-0cbe-4690-8960-05f0466a870f service nova] Acquiring lock "cff2fb57-7d0b-4278-89ed-10a8ec5128ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:21:01 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-37850c85-79be-449a-9298-7a0262535263 req-a990b906-0cbe-4690-8960-05f0466a870f service nova] Lock "cff2fb57-7d0b-4278-89ed-10a8ec5128ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:21:01 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-37850c85-79be-449a-9298-7a0262535263 req-a990b906-0cbe-4690-8960-05f0466a870f service nova] Lock "cff2fb57-7d0b-4278-89ed-10a8ec5128ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:21:01 user nova-compute[72382]: DEBUG nova.compute.manager [req-37850c85-79be-449a-9298-7a0262535263 req-a990b906-0cbe-4690-8960-05f0466a870f service nova] [instance: cff2fb57-7d0b-4278-89ed-10a8ec5128ea] No waiting events found dispatching network-vif-plugged-ce3acf5c-2e65-4650-aade-158b96a7d349 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:21:01 user nova-compute[72382]: WARNING nova.compute.manager [req-37850c85-79be-449a-9298-7a0262535263 req-a990b906-0cbe-4690-8960-05f0466a870f service nova] [instance: cff2fb57-7d0b-4278-89ed-10a8ec5128ea] Received unexpected event network-vif-plugged-ce3acf5c-2e65-4650-aade-158b96a7d349 for instance with vm_state building and task_state spawning.
Aug 09 15:21:01 user nova-compute[72382]: DEBUG nova.compute.manager [req-37850c85-79be-449a-9298-7a0262535263 req-a990b906-0cbe-4690-8960-05f0466a870f service nova] [instance: cff2fb57-7d0b-4278-89ed-10a8ec5128ea] Received event network-vif-plugged-ce3acf5c-2e65-4650-aade-158b96a7d349 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:21:01 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-37850c85-79be-449a-9298-7a0262535263 req-a990b906-0cbe-4690-8960-05f0466a870f service nova] Acquiring lock "cff2fb57-7d0b-4278-89ed-10a8ec5128ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:21:01 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-37850c85-79be-449a-9298-7a0262535263 req-a990b906-0cbe-4690-8960-05f0466a870f service nova] Lock "cff2fb57-7d0b-4278-89ed-10a8ec5128ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:21:01 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-37850c85-79be-449a-9298-7a0262535263 req-a990b906-0cbe-4690-8960-05f0466a870f service nova] Lock "cff2fb57-7d0b-4278-89ed-10a8ec5128ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:21:01 user nova-compute[72382]: DEBUG nova.compute.manager [req-37850c85-79be-449a-9298-7a0262535263 req-a990b906-0cbe-4690-8960-05f0466a870f service nova] [instance: cff2fb57-7d0b-4278-89ed-10a8ec5128ea] No waiting events found dispatching network-vif-plugged-ce3acf5c-2e65-4650-aade-158b96a7d349 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:21:01 user nova-compute[72382]: WARNING nova.compute.manager [req-37850c85-79be-449a-9298-7a0262535263 req-a990b906-0cbe-4690-8960-05f0466a870f service nova] [instance: cff2fb57-7d0b-4278-89ed-10a8ec5128ea] Received unexpected event network-vif-plugged-ce3acf5c-2e65-4650-aade-158b96a7d349 for instance with vm_state building and task_state spawning.
Aug 09 15:21:01 user nova-compute[72382]: DEBUG nova.compute.manager [req-37850c85-79be-449a-9298-7a0262535263 req-a990b906-0cbe-4690-8960-05f0466a870f service nova] [instance: cff2fb57-7d0b-4278-89ed-10a8ec5128ea] Received event network-vif-plugged-802211f2-fc95-4940-87bf-eb0658b56ff1 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:21:01 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-37850c85-79be-449a-9298-7a0262535263 req-a990b906-0cbe-4690-8960-05f0466a870f service nova] Acquiring lock "cff2fb57-7d0b-4278-89ed-10a8ec5128ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:21:01 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-37850c85-79be-449a-9298-7a0262535263 req-a990b906-0cbe-4690-8960-05f0466a870f service nova] Lock "cff2fb57-7d0b-4278-89ed-10a8ec5128ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:21:01 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-37850c85-79be-449a-9298-7a0262535263 req-a990b906-0cbe-4690-8960-05f0466a870f service nova] Lock "cff2fb57-7d0b-4278-89ed-10a8ec5128ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:21:01 user nova-compute[72382]: DEBUG nova.compute.manager [req-37850c85-79be-449a-9298-7a0262535263 req-a990b906-0cbe-4690-8960-05f0466a870f service nova] [instance: cff2fb57-7d0b-4278-89ed-10a8ec5128ea] No waiting events found dispatching network-vif-plugged-802211f2-fc95-4940-87bf-eb0658b56ff1 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:21:01 user nova-compute[72382]: WARNING nova.compute.manager [req-37850c85-79be-449a-9298-7a0262535263 req-a990b906-0cbe-4690-8960-05f0466a870f service nova] [instance: cff2fb57-7d0b-4278-89ed-10a8ec5128ea] Received unexpected event network-vif-plugged-802211f2-fc95-4940-87bf-eb0658b56ff1 for instance with vm_state building and task_state spawning.
Aug 09 15:21:01 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:21:01 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:21:01 user nova-compute[72382]: DEBUG nova.compute.manager [req-53c3b028-152f-4e55-96e4-846b0d8a4a97 req-51071584-d9ad-48d0-911f-df49f85da15a service nova] [instance: cff2fb57-7d0b-4278-89ed-10a8ec5128ea] Received event network-vif-plugged-55cf98ab-8cd2-4704-971f-ee4ceebca331 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:21:01 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-53c3b028-152f-4e55-96e4-846b0d8a4a97 req-51071584-d9ad-48d0-911f-df49f85da15a service nova] Acquiring lock "cff2fb57-7d0b-4278-89ed-10a8ec5128ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:21:01 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-53c3b028-152f-4e55-96e4-846b0d8a4a97 req-51071584-d9ad-48d0-911f-df49f85da15a service nova] Lock "cff2fb57-7d0b-4278-89ed-10a8ec5128ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.006s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:21:01 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-53c3b028-152f-4e55-96e4-846b0d8a4a97 req-51071584-d9ad-48d0-911f-df49f85da15a service nova] Lock "cff2fb57-7d0b-4278-89ed-10a8ec5128ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:21:01 user nova-compute[72382]: DEBUG nova.compute.manager [req-53c3b028-152f-4e55-96e4-846b0d8a4a97 req-51071584-d9ad-48d0-911f-df49f85da15a service nova] [instance: cff2fb57-7d0b-4278-89ed-10a8ec5128ea] No waiting events found dispatching network-vif-plugged-55cf98ab-8cd2-4704-971f-ee4ceebca331 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:21:01 user nova-compute[72382]: WARNING nova.compute.manager [req-53c3b028-152f-4e55-96e4-846b0d8a4a97 req-51071584-d9ad-48d0-911f-df49f85da15a service nova] [instance: cff2fb57-7d0b-4278-89ed-10a8ec5128ea] Received unexpected event network-vif-plugged-55cf98ab-8cd2-4704-971f-ee4ceebca331 for instance with vm_state building and task_state spawning.
Aug 09 15:21:01 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:21:02 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:21:02 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:21:02 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:21:02 user nova-compute[72382]: DEBUG nova.compute.manager [req-6dd31c6b-1c10-41bd-aa82-9783deebac69 req-eb678790-ffb3-4774-91dc-caf1caea8296 service nova] [instance: cff2fb57-7d0b-4278-89ed-10a8ec5128ea] Received event network-vif-plugged-17d8899d-82c0-4a46-97de-31253f7d1b82 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:21:02 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-6dd31c6b-1c10-41bd-aa82-9783deebac69 req-eb678790-ffb3-4774-91dc-caf1caea8296 service nova] Acquiring lock "cff2fb57-7d0b-4278-89ed-10a8ec5128ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:21:02 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-6dd31c6b-1c10-41bd-aa82-9783deebac69 req-eb678790-ffb3-4774-91dc-caf1caea8296 service nova] Lock "cff2fb57-7d0b-4278-89ed-10a8ec5128ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:21:02 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-6dd31c6b-1c10-41bd-aa82-9783deebac69 req-eb678790-ffb3-4774-91dc-caf1caea8296 service nova] Lock "cff2fb57-7d0b-4278-89ed-10a8ec5128ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:21:02 user nova-compute[72382]: DEBUG nova.compute.manager [req-6dd31c6b-1c10-41bd-aa82-9783deebac69 req-eb678790-ffb3-4774-91dc-caf1caea8296 service nova] [instance: cff2fb57-7d0b-4278-89ed-10a8ec5128ea] No waiting events found dispatching network-vif-plugged-17d8899d-82c0-4a46-97de-31253f7d1b82 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:21:02 user nova-compute[72382]: WARNING nova.compute.manager [req-6dd31c6b-1c10-41bd-aa82-9783deebac69 req-eb678790-ffb3-4774-91dc-caf1caea8296 service nova] [instance: cff2fb57-7d0b-4278-89ed-10a8ec5128ea] Received unexpected event network-vif-plugged-17d8899d-82c0-4a46-97de-31253f7d1b82 for instance with vm_state building and task_state spawning.
Aug 09 15:21:03 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-dfc20570-5d65-4841-a131-a9e322f786bd tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] [instance: 8aa35482-60b8-4185-b14d-a2667fd3b5b7] Snapshot image upload complete
Aug 09 15:21:03 user nova-compute[72382]: INFO nova.compute.manager [None req-dfc20570-5d65-4841-a131-a9e322f786bd tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] [instance: 8aa35482-60b8-4185-b14d-a2667fd3b5b7] Took 7.92 seconds to snapshot the instance on the hypervisor.
Aug 09 15:21:03 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:21:03 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:21:03 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:21:03 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:21:03 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:21:03 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:21:03 user nova-compute[72382]: DEBUG nova.compute.manager [req-4450d0a4-18f9-40ee-852e-81bd42065346 req-37b97067-71c9-49a1-8dda-c494c1249067 service nova] [instance: cff2fb57-7d0b-4278-89ed-10a8ec5128ea] Received event network-vif-plugged-802211f2-fc95-4940-87bf-eb0658b56ff1 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:21:03 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-4450d0a4-18f9-40ee-852e-81bd42065346 req-37b97067-71c9-49a1-8dda-c494c1249067 service nova] Acquiring lock "cff2fb57-7d0b-4278-89ed-10a8ec5128ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:21:03 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-4450d0a4-18f9-40ee-852e-81bd42065346 req-37b97067-71c9-49a1-8dda-c494c1249067 service nova] Lock "cff2fb57-7d0b-4278-89ed-10a8ec5128ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:21:03 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-4450d0a4-18f9-40ee-852e-81bd42065346 req-37b97067-71c9-49a1-8dda-c494c1249067 service nova] Lock "cff2fb57-7d0b-4278-89ed-10a8ec5128ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:21:03 user nova-compute[72382]: DEBUG nova.compute.manager [req-4450d0a4-18f9-40ee-852e-81bd42065346 req-37b97067-71c9-49a1-8dda-c494c1249067 service nova] [instance: cff2fb57-7d0b-4278-89ed-10a8ec5128ea] No waiting events found dispatching network-vif-plugged-802211f2-fc95-4940-87bf-eb0658b56ff1 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:21:03 user nova-compute[72382]: WARNING nova.compute.manager [req-4450d0a4-18f9-40ee-852e-81bd42065346 req-37b97067-71c9-49a1-8dda-c494c1249067 service nova] [instance: cff2fb57-7d0b-4278-89ed-10a8ec5128ea] Received unexpected event network-vif-plugged-802211f2-fc95-4940-87bf-eb0658b56ff1 for instance with vm_state building and task_state spawning.
Aug 09 15:21:03 user nova-compute[72382]: DEBUG nova.compute.manager [req-4450d0a4-18f9-40ee-852e-81bd42065346 req-37b97067-71c9-49a1-8dda-c494c1249067 service nova] [instance: cff2fb57-7d0b-4278-89ed-10a8ec5128ea] Received event network-vif-plugged-bcf9d83a-a145-4d83-9df6-02eba42f64bf {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:21:03 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-4450d0a4-18f9-40ee-852e-81bd42065346 req-37b97067-71c9-49a1-8dda-c494c1249067 service nova] Acquiring lock "cff2fb57-7d0b-4278-89ed-10a8ec5128ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:21:03 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-4450d0a4-18f9-40ee-852e-81bd42065346 req-37b97067-71c9-49a1-8dda-c494c1249067 service nova] Lock "cff2fb57-7d0b-4278-89ed-10a8ec5128ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:21:03 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-4450d0a4-18f9-40ee-852e-81bd42065346 req-37b97067-71c9-49a1-8dda-c494c1249067 service nova] Lock "cff2fb57-7d0b-4278-89ed-10a8ec5128ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:21:03 user nova-compute[72382]: DEBUG nova.compute.manager [req-4450d0a4-18f9-40ee-852e-81bd42065346 req-37b97067-71c9-49a1-8dda-c494c1249067 service nova] [instance: cff2fb57-7d0b-4278-89ed-10a8ec5128ea] No waiting events found dispatching network-vif-plugged-bcf9d83a-a145-4d83-9df6-02eba42f64bf {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:21:03 user nova-compute[72382]: WARNING nova.compute.manager [req-4450d0a4-18f9-40ee-852e-81bd42065346 req-37b97067-71c9-49a1-8dda-c494c1249067 service nova] [instance: cff2fb57-7d0b-4278-89ed-10a8ec5128ea] Received unexpected event network-vif-plugged-bcf9d83a-a145-4d83-9df6-02eba42f64bf for instance with vm_state building and task_state spawning.
Aug 09 15:21:03 user nova-compute[72382]: DEBUG nova.compute.manager [req-4450d0a4-18f9-40ee-852e-81bd42065346 req-37b97067-71c9-49a1-8dda-c494c1249067 service nova] [instance: cff2fb57-7d0b-4278-89ed-10a8ec5128ea] Received event network-vif-plugged-bcf9d83a-a145-4d83-9df6-02eba42f64bf {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:21:03 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-4450d0a4-18f9-40ee-852e-81bd42065346 req-37b97067-71c9-49a1-8dda-c494c1249067 service nova] Acquiring lock "cff2fb57-7d0b-4278-89ed-10a8ec5128ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:21:03 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-4450d0a4-18f9-40ee-852e-81bd42065346 req-37b97067-71c9-49a1-8dda-c494c1249067 service nova] Lock "cff2fb57-7d0b-4278-89ed-10a8ec5128ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:21:03 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-4450d0a4-18f9-40ee-852e-81bd42065346 req-37b97067-71c9-49a1-8dda-c494c1249067 service nova] Lock "cff2fb57-7d0b-4278-89ed-10a8ec5128ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:21:03 user nova-compute[72382]: DEBUG nova.compute.manager [req-4450d0a4-18f9-40ee-852e-81bd42065346 req-37b97067-71c9-49a1-8dda-c494c1249067 service nova] [instance: cff2fb57-7d0b-4278-89ed-10a8ec5128ea] No waiting events found dispatching network-vif-plugged-bcf9d83a-a145-4d83-9df6-02eba42f64bf {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:21:03 user nova-compute[72382]: WARNING nova.compute.manager [req-4450d0a4-18f9-40ee-852e-81bd42065346 req-37b97067-71c9-49a1-8dda-c494c1249067 service nova] [instance: cff2fb57-7d0b-4278-89ed-10a8ec5128ea] Received unexpected event network-vif-plugged-bcf9d83a-a145-4d83-9df6-02eba42f64bf for instance with vm_state building and task_state spawning.
Aug 09 15:21:03 user nova-compute[72382]: DEBUG nova.virt.driver [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Emitting event <LifecycleEvent: 1691594463.817734, cff2fb57-7d0b-4278-89ed-10a8ec5128ea => Resumed> {{(pid=72382) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 15:21:03 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: cff2fb57-7d0b-4278-89ed-10a8ec5128ea] VM Resumed (Lifecycle Event)
Aug 09 15:21:03 user nova-compute[72382]: DEBUG nova.compute.manager [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] [instance: cff2fb57-7d0b-4278-89ed-10a8ec5128ea] Instance event wait completed in 0 seconds for  {{(pid=72382) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 15:21:03 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] [instance: cff2fb57-7d0b-4278-89ed-10a8ec5128ea] Guest created on hypervisor {{(pid=72382) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 15:21:03 user nova-compute[72382]: INFO nova.virt.libvirt.driver [-] [instance: cff2fb57-7d0b-4278-89ed-10a8ec5128ea] Instance spawned successfully.
Aug 09 15:21:03 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] [instance: cff2fb57-7d0b-4278-89ed-10a8ec5128ea] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 15:21:03 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: cff2fb57-7d0b-4278-89ed-10a8ec5128ea] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:21:03 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: cff2fb57-7d0b-4278-89ed-10a8ec5128ea] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72382) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 15:21:03 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] [instance: cff2fb57-7d0b-4278-89ed-10a8ec5128ea] Found default for hw_cdrom_bus of ide {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:21:03 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] [instance: cff2fb57-7d0b-4278-89ed-10a8ec5128ea] Found default for hw_disk_bus of virtio {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:21:03 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] [instance: cff2fb57-7d0b-4278-89ed-10a8ec5128ea] Found default for hw_input_bus of None {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:21:03 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] [instance: cff2fb57-7d0b-4278-89ed-10a8ec5128ea] Found default for hw_pointer_model of None {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:21:03 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] [instance: cff2fb57-7d0b-4278-89ed-10a8ec5128ea] Found default for hw_video_model of virtio {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:21:03 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] [instance: cff2fb57-7d0b-4278-89ed-10a8ec5128ea] Found default for hw_vif_model of virtio {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:21:03 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: cff2fb57-7d0b-4278-89ed-10a8ec5128ea] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 15:21:03 user nova-compute[72382]: DEBUG nova.virt.driver [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Emitting event <LifecycleEvent: 1691594463.8216836, cff2fb57-7d0b-4278-89ed-10a8ec5128ea => Started> {{(pid=72382) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 15:21:03 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: cff2fb57-7d0b-4278-89ed-10a8ec5128ea] VM Started (Lifecycle Event)
Aug 09 15:21:03 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: cff2fb57-7d0b-4278-89ed-10a8ec5128ea] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:21:03 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: cff2fb57-7d0b-4278-89ed-10a8ec5128ea] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72382) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 15:21:03 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: cff2fb57-7d0b-4278-89ed-10a8ec5128ea] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 15:21:03 user nova-compute[72382]: INFO nova.compute.manager [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] [instance: cff2fb57-7d0b-4278-89ed-10a8ec5128ea] Took 11.93 seconds to spawn the instance on the hypervisor.
Aug 09 15:21:03 user nova-compute[72382]: DEBUG nova.compute.manager [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] [instance: cff2fb57-7d0b-4278-89ed-10a8ec5128ea] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:21:03 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:21:04 user nova-compute[72382]: INFO nova.compute.manager [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] [instance: cff2fb57-7d0b-4278-89ed-10a8ec5128ea] Took 44.29 seconds to build instance.
Aug 09 15:21:04 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-531fd71e-c5dd-49da-8611-6615d8de1419 tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] Lock "cff2fb57-7d0b-4278-89ed-10a8ec5128ea" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 44.417s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:21:04 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:21:04 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:21:04 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:21:04 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:21:04 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Auditing locally available compute resources for user (node: user) {{(pid=72382) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 15:21:05 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f780040f-b789-4b72-8986-813c7b9fe4a6/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:21:05 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f780040f-b789-4b72-8986-813c7b9fe4a6/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:21:05 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f780040f-b789-4b72-8986-813c7b9fe4a6/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:21:05 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f780040f-b789-4b72-8986-813c7b9fe4a6/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:21:05 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/266be814-4a2b-4f8e-a0f6-e8821fdeb95d/disk.rescue --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:21:05 user nova-compute[72382]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691594450.4942164, ea6afcf7-0b8b-43d8-af1d-9c132a659711 => Stopped> {{(pid=72382) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 15:21:05 user nova-compute[72382]: INFO nova.compute.manager [-] [instance: ea6afcf7-0b8b-43d8-af1d-9c132a659711] VM Stopped (Lifecycle Event)
Aug 09 15:21:05 user nova-compute[72382]: DEBUG nova.compute.manager [None req-3d73d8ee-8692-4b31-b1e0-30a6c9386bb1 None None] [instance: ea6afcf7-0b8b-43d8-af1d-9c132a659711] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:21:05 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/266be814-4a2b-4f8e-a0f6-e8821fdeb95d/disk.rescue --force-share --output=json" returned: 0 in 0.139s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:21:05 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/266be814-4a2b-4f8e-a0f6-e8821fdeb95d/disk.rescue --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:21:05 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/266be814-4a2b-4f8e-a0f6-e8821fdeb95d/disk.rescue --force-share --output=json" returned: 0 in 0.134s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:21:05 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/266be814-4a2b-4f8e-a0f6-e8821fdeb95d/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:21:05 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/266be814-4a2b-4f8e-a0f6-e8821fdeb95d/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:21:05 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/266be814-4a2b-4f8e-a0f6-e8821fdeb95d/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:21:06 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/266be814-4a2b-4f8e-a0f6-e8821fdeb95d/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:21:06 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a33515b3-3ef4-4f76-a8d8-e7008b5bbb79/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:21:06 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a33515b3-3ef4-4f76-a8d8-e7008b5bbb79/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:21:06 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a33515b3-3ef4-4f76-a8d8-e7008b5bbb79/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:21:06 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a33515b3-3ef4-4f76-a8d8-e7008b5bbb79/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:21:06 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/777e49ea-b674-4c3f-9cdd-ac2113032632/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:21:06 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/777e49ea-b674-4c3f-9cdd-ac2113032632/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:21:06 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/777e49ea-b674-4c3f-9cdd-ac2113032632/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:21:06 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/777e49ea-b674-4c3f-9cdd-ac2113032632/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:21:06 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44afd1bf-fa5c-4b3e-8752-b16853fef54e/disk.rescue --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:21:06 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44afd1bf-fa5c-4b3e-8752-b16853fef54e/disk.rescue --force-share --output=json" returned: 0 in 0.150s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:21:06 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44afd1bf-fa5c-4b3e-8752-b16853fef54e/disk.rescue --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:21:06 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:21:06 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44afd1bf-fa5c-4b3e-8752-b16853fef54e/disk.rescue --force-share --output=json" returned: 0 in 0.152s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:21:06 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44afd1bf-fa5c-4b3e-8752-b16853fef54e/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:21:07 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44afd1bf-fa5c-4b3e-8752-b16853fef54e/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:21:07 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44afd1bf-fa5c-4b3e-8752-b16853fef54e/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:21:07 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44afd1bf-fa5c-4b3e-8752-b16853fef54e/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:21:07 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72382) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 15:21:07 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f510d75-5d1e-4a5c-b38f-731c299f0f5a/disk.rescue --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:21:07 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f510d75-5d1e-4a5c-b38f-731c299f0f5a/disk.rescue --force-share --output=json" returned: 0 in 0.205s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:21:07 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f510d75-5d1e-4a5c-b38f-731c299f0f5a/disk.rescue --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:21:07 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f510d75-5d1e-4a5c-b38f-731c299f0f5a/disk.rescue --force-share --output=json" returned: 0 in 0.170s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:21:07 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72382) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 15:21:07 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8aa35482-60b8-4185-b14d-a2667fd3b5b7/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:21:07 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8aa35482-60b8-4185-b14d-a2667fd3b5b7/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:21:07 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8aa35482-60b8-4185-b14d-a2667fd3b5b7/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:21:08 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8aa35482-60b8-4185-b14d-a2667fd3b5b7/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:21:08 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9766433-4c5a-40ed-a212-715a24f42b91/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:21:08 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9766433-4c5a-40ed-a212-715a24f42b91/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:21:08 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9766433-4c5a-40ed-a212-715a24f42b91/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:21:08 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9766433-4c5a-40ed-a212-715a24f42b91/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:21:08 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72382) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 15:21:08 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d061ee79-0755-44a7-9929-086c274c9064/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:21:08 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d061ee79-0755-44a7-9929-086c274c9064/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:21:08 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d061ee79-0755-44a7-9929-086c274c9064/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:21:08 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d061ee79-0755-44a7-9929-086c274c9064/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:21:08 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=72382) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 15:21:08 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=72382) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 15:21:08 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=72382) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 15:21:09 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:21:09 user nova-compute[72382]: WARNING nova.virt.libvirt.driver [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 15:21:09 user nova-compute[72382]: WARNING nova.virt.libvirt.driver [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 15:21:09 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Hypervisor/Node resource view: name=user free_ram=7099MB free_disk=25.567352294921875GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72382) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 15:21:09 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:21:09 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:21:09 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Applying migration context for instance c9766433-4c5a-40ed-a212-715a24f42b91 as it has an incoming, in-progress migration 9c66c3cd-1944-431d-8434-648b9448178d. Migration status is finished {{(pid=72382) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 09 15:21:09 user nova-compute[72382]: INFO nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] [instance: c9766433-4c5a-40ed-a212-715a24f42b91] Updating resource usage from migration 9c66c3cd-1944-431d-8434-648b9448178d
Aug 09 15:21:10 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance 83ebfda8-235d-4404-a973-991d75ae2bf6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:21:10 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance 0f510d75-5d1e-4a5c-b38f-731c299f0f5a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:21:10 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance f780040f-b789-4b72-8986-813c7b9fe4a6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:21:10 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance a33515b3-3ef4-4f76-a8d8-e7008b5bbb79 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:21:10 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance cff2fb57-7d0b-4278-89ed-10a8ec5128ea actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:21:10 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance 777e49ea-b674-4c3f-9cdd-ac2113032632 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:21:10 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance 266be814-4a2b-4f8e-a0f6-e8821fdeb95d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:21:10 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance 44afd1bf-fa5c-4b3e-8752-b16853fef54e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:21:10 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance 8aa35482-60b8-4185-b14d-a2667fd3b5b7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:21:10 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Migration 9c66c3cd-1944-431d-8434-648b9448178d is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 09 15:21:10 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance c9766433-4c5a-40ed-a212-715a24f42b91 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:21:10 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance d061ee79-0755-44a7-9929-086c274c9064 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:21:10 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=72382) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 15:21:10 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Final resource view: name=user phys_ram=16011MB used_ram=8192MB phys_disk=40GB used_disk=28GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=72382) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 15:21:10 user nova-compute[72382]: DEBUG nova.scheduler.client.report [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Refreshing inventories for resource provider 7b15b0e5-df4d-49db-833b-2855d21d10ae {{(pid=72382) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 09 15:21:10 user nova-compute[72382]: DEBUG nova.scheduler.client.report [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Updating ProviderTree inventory for provider 7b15b0e5-df4d-49db-833b-2855d21d10ae from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72382) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 09 15:21:10 user nova-compute[72382]: DEBUG nova.compute.provider_tree [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Updating inventory in ProviderTree for provider 7b15b0e5-df4d-49db-833b-2855d21d10ae with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72382) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 09 15:21:10 user nova-compute[72382]: DEBUG nova.scheduler.client.report [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Refreshing aggregate associations for resource provider 7b15b0e5-df4d-49db-833b-2855d21d10ae, aggregates: None {{(pid=72382) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 09 15:21:10 user nova-compute[72382]: DEBUG nova.scheduler.client.report [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Refreshing trait associations for resource provider 7b15b0e5-df4d-49db-833b-2855d21d10ae, traits: COMPUTE_DEVICE_TAGGING,COMPUTE_NODE,COMPUTE_VOLUME_EXTEND,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE42,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_MMX,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE2 {{(pid=72382) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 09 15:21:10 user nova-compute[72382]: DEBUG nova.compute.provider_tree [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Inventory has not changed in ProviderTree for provider: 7b15b0e5-df4d-49db-833b-2855d21d10ae {{(pid=72382) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 15:21:10 user nova-compute[72382]: DEBUG nova.scheduler.client.report [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Inventory has not changed for provider 7b15b0e5-df4d-49db-833b-2855d21d10ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72382) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 15:21:10 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Compute_service record updated for user:user {{(pid=72382) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 15:21:10 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.999s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:21:11 user nova-compute[72382]: DEBUG nova.network.neutron [None req-ab33db54-9d77-4ff9-867e-2099b6cc20f2 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] [instance: c9766433-4c5a-40ed-a212-715a24f42b91] Port 599dae3b-13bb-47af-b889-0037e03d5e31 binding to destination host user is already ACTIVE {{(pid=72382) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Aug 09 15:21:11 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-ab33db54-9d77-4ff9-867e-2099b6cc20f2 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Acquiring lock "refresh_cache-c9766433-4c5a-40ed-a212-715a24f42b91" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 15:21:11 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-ab33db54-9d77-4ff9-867e-2099b6cc20f2 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Acquired lock "refresh_cache-c9766433-4c5a-40ed-a212-715a24f42b91" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 15:21:11 user nova-compute[72382]: DEBUG nova.network.neutron [None req-ab33db54-9d77-4ff9-867e-2099b6cc20f2 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] [instance: c9766433-4c5a-40ed-a212-715a24f42b91] Building network info cache for instance {{(pid=72382) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 15:21:11 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:21:11 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:21:11 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:21:11 user nova-compute[72382]: DEBUG nova.compute.manager [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Starting heal instance info cache {{(pid=72382) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 15:21:11 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:21:12 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Acquiring lock "refresh_cache-a33515b3-3ef4-4f76-a8d8-e7008b5bbb79" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 15:21:12 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Acquired lock "refresh_cache-a33515b3-3ef4-4f76-a8d8-e7008b5bbb79" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 15:21:12 user nova-compute[72382]: DEBUG nova.network.neutron [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] [instance: a33515b3-3ef4-4f76-a8d8-e7008b5bbb79] Forcefully refreshing network info cache for instance {{(pid=72382) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 15:21:12 user nova-compute[72382]: DEBUG nova.network.neutron [None req-ab33db54-9d77-4ff9-867e-2099b6cc20f2 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] [instance: c9766433-4c5a-40ed-a212-715a24f42b91] Updating instance_info_cache with network_info: [{"id": "599dae3b-13bb-47af-b889-0037e03d5e31", "address": "fa:16:3e:66:9f:0b", "network": {"id": "63303ac8-d370-4386-a6bc-576677b64740", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1379220233-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f45d010dd474c92a6b24bf977564ad1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap599dae3b-13", "ovs_interfaceid": "599dae3b-13bb-47af-b889-0037e03d5e31", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:21:12 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-ab33db54-9d77-4ff9-867e-2099b6cc20f2 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Releasing lock "refresh_cache-c9766433-4c5a-40ed-a212-715a24f42b91" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 15:21:12 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-ab33db54-9d77-4ff9-867e-2099b6cc20f2 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] [instance: c9766433-4c5a-40ed-a212-715a24f42b91] Creating tmpfile /opt/stack/data/nova/instances/c9766433-4c5a-40ed-a212-715a24f42b91/tmpmoylahd0 to verify with other compute node that the instance is on the same shared storage. {{(pid=72382) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9622}}
Aug 09 15:21:12 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:21:12 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:21:12 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:21:12 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:21:12 user nova-compute[72382]: DEBUG nova.compute.manager [req-1856e996-d833-4fc0-b8eb-86e6cb2cfdf4 req-96dd6e56-622a-4870-a9ba-fb82e1956213 service nova] [instance: c9766433-4c5a-40ed-a212-715a24f42b91] Received event network-vif-unplugged-599dae3b-13bb-47af-b889-0037e03d5e31 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:21:12 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-1856e996-d833-4fc0-b8eb-86e6cb2cfdf4 req-96dd6e56-622a-4870-a9ba-fb82e1956213 service nova] Acquiring lock "c9766433-4c5a-40ed-a212-715a24f42b91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:21:12 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-1856e996-d833-4fc0-b8eb-86e6cb2cfdf4 req-96dd6e56-622a-4870-a9ba-fb82e1956213 service nova] Lock "c9766433-4c5a-40ed-a212-715a24f42b91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:21:12 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-1856e996-d833-4fc0-b8eb-86e6cb2cfdf4 req-96dd6e56-622a-4870-a9ba-fb82e1956213 service nova] Lock "c9766433-4c5a-40ed-a212-715a24f42b91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:21:12 user nova-compute[72382]: DEBUG nova.compute.manager [req-1856e996-d833-4fc0-b8eb-86e6cb2cfdf4 req-96dd6e56-622a-4870-a9ba-fb82e1956213 service nova] [instance: c9766433-4c5a-40ed-a212-715a24f42b91] No waiting events found dispatching network-vif-unplugged-599dae3b-13bb-47af-b889-0037e03d5e31 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:21:12 user nova-compute[72382]: WARNING nova.compute.manager [req-1856e996-d833-4fc0-b8eb-86e6cb2cfdf4 req-96dd6e56-622a-4870-a9ba-fb82e1956213 service nova] [instance: c9766433-4c5a-40ed-a212-715a24f42b91] Received unexpected event network-vif-unplugged-599dae3b-13bb-47af-b889-0037e03d5e31 for instance with vm_state resized and task_state resize_reverting.
Aug 09 15:21:12 user nova-compute[72382]: DEBUG nova.network.neutron [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] [instance: a33515b3-3ef4-4f76-a8d8-e7008b5bbb79] Updating instance_info_cache with network_info: [{"id": "32c23c7b-6885-4276-bca1-7d8a8cb924c1", "address": "fa:16:3e:e9:da:b6", "network": {"id": "1a0f18df-96f2-4c90-8e53-fcbfc8f17bc4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1771770150-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b98e20f61c34fd6aa28cef7ceadf0d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32c23c7b-68", "ovs_interfaceid": "32c23c7b-6885-4276-bca1-7d8a8cb924c1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:21:12 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Releasing lock "refresh_cache-a33515b3-3ef4-4f76-a8d8-e7008b5bbb79" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 15:21:12 user nova-compute[72382]: DEBUG nova.compute.manager [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] [instance: a33515b3-3ef4-4f76-a8d8-e7008b5bbb79] Updated the network info_cache for instance {{(pid=72382) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 15:21:12 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:21:12 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:21:12 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:21:12 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:21:12 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:21:12 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:21:12 user nova-compute[72382]: DEBUG nova.compute.manager [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72382) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 15:21:12 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:21:12 user nova-compute[72382]: DEBUG nova.compute.manager [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Cleaning up deleted instances with incomplete migration  {{(pid=72382) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 09 15:21:13 user nova-compute[72382]: INFO nova.virt.libvirt.driver [-] [instance: c9766433-4c5a-40ed-a212-715a24f42b91] Instance destroyed successfully.
Aug 09 15:21:13 user nova-compute[72382]: DEBUG nova.objects.instance [None req-ab33db54-9d77-4ff9-867e-2099b6cc20f2 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Lazy-loading 'resources' on Instance uuid c9766433-4c5a-40ed-a212-715a24f42b91 {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:21:13 user nova-compute[72382]: DEBUG nova.virt.libvirt.vif [None req-ab33db54-9d77-4ff9-867e-2099b6cc20f2 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T15:15:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-2120220558',display_name='tempest-ServerActionsTestOtherB-server-2120220558',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-2120220558',id=5,image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOdAPO5nl2/3VDHoi/8yD5s8l1+mDVit5A+n/HDnoxJgZMgOR9rAXiFsYVLEG+MsUeEQU8np4/pg88xwFSbi1vuFZkvV9b5532CTazhkqSlb4YuAKF8mo8fSFbyD8FwytA==',key_name='tempest-keypair-1399201542',keypairs=<?>,launch_index=0,launched_at=2023-08-09T15:19:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9f45d010dd474c92a6b24bf977564ad1',ramdisk_id='',reservation_id='r-rng7ms7j',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-250545160',owner_user_name='tempest-ServerActionsTestOtherB-250545160-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T15:19:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='232fbbd15fea4894be7cebb13ea45cf9',uuid=c9766433-4c5a-40ed-a212-715a24f42b91,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "599dae3b-13bb-47af-b889-0037e03d5e31", "address": "fa:16:3e:66:9f:0b", "network": {"id": "63303ac8-d370-4386-a6bc-576677b64740", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1379220233-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f45d010dd474c92a6b24bf977564ad1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap599dae3b-13", "ovs_interfaceid": "599dae3b-13bb-47af-b889-0037e03d5e31", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 15:21:13 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-ab33db54-9d77-4ff9-867e-2099b6cc20f2 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Converting VIF {"id": "599dae3b-13bb-47af-b889-0037e03d5e31", "address": "fa:16:3e:66:9f:0b", "network": {"id": "63303ac8-d370-4386-a6bc-576677b64740", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1379220233-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f45d010dd474c92a6b24bf977564ad1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap599dae3b-13", "ovs_interfaceid": "599dae3b-13bb-47af-b889-0037e03d5e31", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 15:21:13 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-ab33db54-9d77-4ff9-867e-2099b6cc20f2 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:66:9f:0b,bridge_name='br-int',has_traffic_filtering=True,id=599dae3b-13bb-47af-b889-0037e03d5e31,network=Network(63303ac8-d370-4386-a6bc-576677b64740),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap599dae3b-13') {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 15:21:13 user nova-compute[72382]: DEBUG os_vif [None req-ab33db54-9d77-4ff9-867e-2099b6cc20f2 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:66:9f:0b,bridge_name='br-int',has_traffic_filtering=True,id=599dae3b-13bb-47af-b889-0037e03d5e31,network=Network(63303ac8-d370-4386-a6bc-576677b64740),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap599dae3b-13') {{(pid=72382) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 15:21:13 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:21:13 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap599dae3b-13, bridge=br-int, if_exists=True) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:21:13 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:21:13 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:21:13 user nova-compute[72382]: INFO os_vif [None req-ab33db54-9d77-4ff9-867e-2099b6cc20f2 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:66:9f:0b,bridge_name='br-int',has_traffic_filtering=True,id=599dae3b-13bb-47af-b889-0037e03d5e31,network=Network(63303ac8-d370-4386-a6bc-576677b64740),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap599dae3b-13')
Aug 09 15:21:13 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ab33db54-9d77-4ff9-867e-2099b6cc20f2 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] [instance: c9766433-4c5a-40ed-a212-715a24f42b91] calling os-brick to detach iSCSI Volume {{(pid=72382) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 15:21:13 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab33db54-9d77-4ff9-867e-2099b6cc20f2 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2a0c768340>, {'target_iqns': ['iqn.2010-10.org.openstack:fb47e85c-aaa9-4165-8be3-125572b68a87'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mtLoQzKG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 15:21:13 user nova-compute[72382]: WARNING os_brick.initiator.connectors.base [None req-ab33db54-9d77-4ff9-867e-2099b6cc20f2 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 15:21:13 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-ab33db54-9d77-4ff9-867e-2099b6cc20f2 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 15:21:13 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-ab33db54-9d77-4ff9-867e-2099b6cc20f2 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 15:21:13 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab33db54-9d77-4ff9-867e-2099b6cc20f2 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fb47e85c-aaa9-4165-8be3-125572b68a87', 0)] {{(pid=72382) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 15:21:13 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:21:13 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:21:13 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[294b9d22-d604-4fe0-aff0-338b58316482]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:184b0159-3cae-4d79-86b3-26a58437eb09\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1c6be653-7ab8-4b40-9e28-43c1eca5e016\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1cd86701-a303-4744-bf0c-31b5314bb87d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e8bad821-ddd1-4287-806d-78ffdc34fa68\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fb47e85c-aaa9-4165-8be3-125572b68a87\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:21:13 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:21:13 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:21:13 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e99d1e5-d749-47f5-9beb-e53ad2218da5]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb47e85c-aaa9-4165-8be3-125572b68a87 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cd86701-a303-4744-bf0c-31b5314bb87d (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8bad821-ddd1-4287-806d-78ffdc34fa68 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:184b0159-3cae-4d79-86b3-26a58437eb09 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c6be653-7ab8-4b40-9e28-43c1eca5e016 (non-flash)\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:21:13 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab33db54-9d77-4ff9-867e-2099b6cc20f2 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)
Aug 09 15:21:13 user nova-compute[72382]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb47e85c-aaa9-4165-8be3-125572b68a87 (non-flash)
Aug 09 15:21:13 user nova-compute[72382]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cd86701-a303-4744-bf0c-31b5314bb87d (non-flash)
Aug 09 15:21:13 user nova-compute[72382]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8bad821-ddd1-4287-806d-78ffdc34fa68 (non-flash)
Aug 09 15:21:13 user nova-compute[72382]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:184b0159-3cae-4d79-86b3-26a58437eb09 (non-flash)
Aug 09 15:21:13 user nova-compute[72382]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c6be653-7ab8-4b40-9e28-43c1eca5e016 (non-flash)
Aug 09 15:21:13 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 15:21:13 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab33db54-9d77-4ff9-867e-2099b6cc20f2 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)
Aug 09 15:21:13 user nova-compute[72382]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb47e85c-aaa9-4165-8be3-125572b68a87 (non-flash)
Aug 09 15:21:13 user nova-compute[72382]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cd86701-a303-4744-bf0c-31b5314bb87d (non-flash)
Aug 09 15:21:13 user nova-compute[72382]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8bad821-ddd1-4287-806d-78ffdc34fa68 (non-flash)
Aug 09 15:21:13 user nova-compute[72382]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:184b0159-3cae-4d79-86b3-26a58437eb09 (non-flash)
Aug 09 15:21:13 user nova-compute[72382]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c6be653-7ab8-4b40-9e28-43c1eca5e016 (non-flash)
Aug 09 15:21:13 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 15:21:13 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab33db54-9d77-4ff9-867e-2099b6cc20f2 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2a0c3d5750>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fb47e85c-aaa9-4165-8be3-125572b68a87'): ({'sdb'}, set())}) {{(pid=72382) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 15:21:13 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-ab33db54-9d77-4ff9-867e-2099b6cc20f2 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Removing single pathed devices sdb {{(pid=72382) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 15:21:13 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:21:13 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:21:13 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[b161e433-7669-4cd3-955d-e912b3109e44]: (4, ('path checker states:\nup                  5\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:21:13 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:21:13 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:21:13 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[faa1ba37-2a47-45cd-9941-962d011af9fe]: (4, ('ok\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:21:13 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-ab33db54-9d77-4ff9-867e-2099b6cc20f2 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Flushing IO for device /dev/sdb {{(pid=72382) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 15:21:13 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:21:13 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:21:13 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b3bc20c-76cd-4a70-934f-2001d839f795]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:21:13 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-ab33db54-9d77-4ff9-867e-2099b6cc20f2 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72382) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 15:21:13 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:21:13 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.036s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:21:13 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[2272763b-7946-474e-8a58-850e3d4409ad]: (4, ('1', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:21:13 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-ab33db54-9d77-4ff9-867e-2099b6cc20f2 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72382) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 15:21:13 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-ab33db54-9d77-4ff9-867e-2099b6cc20f2 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] SCSI volumes sdb have been removed. {{(pid=72382) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 15:21:13 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab33db54-9d77-4ff9-867e-2099b6cc20f2 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fb47e85c-aaa9-4165-8be3-125572b68a87')] {{(pid=72382) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 15:21:13 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb47e85c-aaa9-4165-8be3-125572b68a87 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:21:13 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb47e85c-aaa9-4165-8be3-125572b68a87 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:21:13 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[504a858f-83cc-432d-9698-47d5bd378de5]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:21:13 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab33db54-9d77-4ff9-867e-2099b6cc20f2 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:21:13 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb47e85c-aaa9-4165-8be3-125572b68a87 -p 172.16.0.220:3260 --logout {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:21:13 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb47e85c-aaa9-4165-8be3-125572b68a87 -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:21:13 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[07669824-cf0f-4da6-b793-a89c9357fb08]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:fb47e85c-aaa9-4165-8be3-125572b68a87, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:fb47e85c-aaa9-4165-8be3-125572b68a87, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:21:13 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab33db54-9d77-4ff9-867e-2099b6cc20f2 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:fb47e85c-aaa9-4165-8be3-125572b68a87, portal: 172.16.0.220,3260]
Aug 09 15:21:13 user nova-compute[72382]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:fb47e85c-aaa9-4165-8be3-125572b68a87, portal: 172.16.0.220,3260] successful.
Aug 09 15:21:13 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:21:13 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb47e85c-aaa9-4165-8be3-125572b68a87 -p 172.16.0.220:3260 --op delete {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:21:13 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb47e85c-aaa9-4165-8be3-125572b68a87 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:21:13 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[023d6593-61ab-46ae-9ff7-a8dc6135b0d3]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:21:13 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab33db54-9d77-4ff9-867e-2099b6cc20f2 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:21:13 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-ab33db54-9d77-4ff9-867e-2099b6cc20f2 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.314s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 15:21:13 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab33db54-9d77-4ff9-867e-2099b6cc20f2 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] <== disconnect_volume: return (320ms) None {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 15:21:13 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ab33db54-9d77-4ff9-867e-2099b6cc20f2 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] [instance: c9766433-4c5a-40ed-a212-715a24f42b91] Disconnected iSCSI Volume {{(pid=72382) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 15:21:13 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:21:14 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-ab33db54-9d77-4ff9-867e-2099b6cc20f2 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:21:14 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-ab33db54-9d77-4ff9-867e-2099b6cc20f2 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:21:14 user nova-compute[72382]: DEBUG nova.objects.instance [None req-ab33db54-9d77-4ff9-867e-2099b6cc20f2 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Lazy-loading 'migration_context' on Instance uuid c9766433-4c5a-40ed-a212-715a24f42b91 {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:21:14 user nova-compute[72382]: DEBUG nova.compute.manager [req-f8ba886d-1662-4220-958f-ba42c1813d71 req-8880831f-4841-453b-a6bc-637b19f01b16 service nova] [instance: c9766433-4c5a-40ed-a212-715a24f42b91] Received event network-vif-plugged-599dae3b-13bb-47af-b889-0037e03d5e31 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:21:14 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-f8ba886d-1662-4220-958f-ba42c1813d71 req-8880831f-4841-453b-a6bc-637b19f01b16 service nova] Acquiring lock "c9766433-4c5a-40ed-a212-715a24f42b91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:21:14 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-f8ba886d-1662-4220-958f-ba42c1813d71 req-8880831f-4841-453b-a6bc-637b19f01b16 service nova] Lock "c9766433-4c5a-40ed-a212-715a24f42b91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:21:14 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-f8ba886d-1662-4220-958f-ba42c1813d71 req-8880831f-4841-453b-a6bc-637b19f01b16 service nova] Lock "c9766433-4c5a-40ed-a212-715a24f42b91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:21:14 user nova-compute[72382]: DEBUG nova.compute.manager [req-f8ba886d-1662-4220-958f-ba42c1813d71 req-8880831f-4841-453b-a6bc-637b19f01b16 service nova] [instance: c9766433-4c5a-40ed-a212-715a24f42b91] No waiting events found dispatching network-vif-plugged-599dae3b-13bb-47af-b889-0037e03d5e31 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:21:14 user nova-compute[72382]: WARNING nova.compute.manager [req-f8ba886d-1662-4220-958f-ba42c1813d71 req-8880831f-4841-453b-a6bc-637b19f01b16 service nova] [instance: c9766433-4c5a-40ed-a212-715a24f42b91] Received unexpected event network-vif-plugged-599dae3b-13bb-47af-b889-0037e03d5e31 for instance with vm_state resized and task_state resize_reverting.
Aug 09 15:21:15 user nova-compute[72382]: DEBUG nova.compute.provider_tree [None req-ab33db54-9d77-4ff9-867e-2099b6cc20f2 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Inventory has not changed in ProviderTree for provider: 7b15b0e5-df4d-49db-833b-2855d21d10ae {{(pid=72382) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 15:21:15 user nova-compute[72382]: DEBUG nova.scheduler.client.report [None req-ab33db54-9d77-4ff9-867e-2099b6cc20f2 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Inventory has not changed for provider 7b15b0e5-df4d-49db-833b-2855d21d10ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72382) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 15:21:15 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-ab33db54-9d77-4ff9-867e-2099b6cc20f2 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.453s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:21:15 user nova-compute[72382]: INFO nova.compute.manager [None req-ab33db54-9d77-4ff9-867e-2099b6cc20f2 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] [instance: c9766433-4c5a-40ed-a212-715a24f42b91] Swapping old allocation on dict_keys(['7b15b0e5-df4d-49db-833b-2855d21d10ae']) held by migration 9c66c3cd-1944-431d-8434-648b9448178d for instance
Aug 09 15:21:15 user nova-compute[72382]: DEBUG nova.scheduler.client.report [None req-ab33db54-9d77-4ff9-867e-2099b6cc20f2 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Overwriting current allocation {'allocations': {'7b15b0e5-df4d-49db-833b-2855d21d10ae': {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}, 'generation': 23}}, 'project_id': '9f45d010dd474c92a6b24bf977564ad1', 'user_id': '232fbbd15fea4894be7cebb13ea45cf9', 'consumer_generation': 1} on consumer c9766433-4c5a-40ed-a212-715a24f42b91 {{(pid=72382) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Aug 09 15:21:15 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-ab33db54-9d77-4ff9-867e-2099b6cc20f2 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Acquiring lock "refresh_cache-c9766433-4c5a-40ed-a212-715a24f42b91" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 15:21:15 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-ab33db54-9d77-4ff9-867e-2099b6cc20f2 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Acquired lock "refresh_cache-c9766433-4c5a-40ed-a212-715a24f42b91" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 15:21:15 user nova-compute[72382]: DEBUG nova.network.neutron [None req-ab33db54-9d77-4ff9-867e-2099b6cc20f2 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] [instance: c9766433-4c5a-40ed-a212-715a24f42b91] Building network info cache for instance {{(pid=72382) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 15:21:15 user nova-compute[72382]: DEBUG nova.network.neutron [None req-ab33db54-9d77-4ff9-867e-2099b6cc20f2 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] [instance: c9766433-4c5a-40ed-a212-715a24f42b91] Updating instance_info_cache with network_info: [{"id": "599dae3b-13bb-47af-b889-0037e03d5e31", "address": "fa:16:3e:66:9f:0b", "network": {"id": "63303ac8-d370-4386-a6bc-576677b64740", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1379220233-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f45d010dd474c92a6b24bf977564ad1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap599dae3b-13", "ovs_interfaceid": "599dae3b-13bb-47af-b889-0037e03d5e31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:21:15 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-ab33db54-9d77-4ff9-867e-2099b6cc20f2 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Releasing lock "refresh_cache-c9766433-4c5a-40ed-a212-715a24f42b91" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 15:21:15 user nova-compute[72382]: DEBUG os_brick.utils [None req-ab33db54-9d77-4ff9-867e-2099b6cc20f2 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 15:21:15 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:21:15 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:21:15 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[38b5d027-0b23-4a90-83eb-79bb07889f7d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d2cfa7015fe\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:21:16 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:21:16 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:21:16 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c43bfc5-3135-49ce-8c36-0038baa90bce]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:21:16 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:21:16 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:21:16 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac52b59c-cd15-4831-a245-9809ac7f6a30]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:21:16 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e5c51dc-76ca-40ec-95f5-c6e521e4afc2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:21:16 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-ab33db54-9d77-4ff9-867e-2099b6cc20f2 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Running cmd (subprocess): nvme version {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:21:16 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-ab33db54-9d77-4ff9-867e-2099b6cc20f2 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] 'nvme version' failed. Not Retrying. {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 15:21:16 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ab33db54-9d77-4ff9-867e-2099b6cc20f2 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] nvme not present on system {{(pid=72382) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 15:21:16 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:21:16 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 15:21:16 user nova-compute[72382]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 15:21:16 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[a950a07b-b73a-42ad-baed-5a896a7be4b7]: (4, '') {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:21:16 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.lightos [None req-ab33db54-9d77-4ff9-867e-2099b6cc20f2 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72382) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 15:21:16 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.lightos [None req-ab33db54-9d77-4ff9-867e-2099b6cc20f2 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72382) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 15:21:16 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.lightos [None req-ab33db54-9d77-4ff9-867e-2099b6cc20f2 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] LIGHTOS: no hostnqn found. {{(pid=72382) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 15:21:16 user nova-compute[72382]: DEBUG os_brick.utils [None req-ab33db54-9d77-4ff9-867e-2099b6cc20f2 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d2cfa7015fe', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 15:21:18 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:21:18 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:21:23 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:21:23 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:21:25 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-ab33db54-9d77-4ff9-867e-2099b6cc20f2 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] [instance: c9766433-4c5a-40ed-a212-715a24f42b91] Starting finish_revert_migration {{(pid=72382) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11819}}
Aug 09 15:21:25 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-ab33db54-9d77-4ff9-867e-2099b6cc20f2 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] [instance: c9766433-4c5a-40ed-a212-715a24f42b91] Start _get_guest_xml network_info=[{"id": "599dae3b-13bb-47af-b889-0037e03d5e31", "address": "fa:16:3e:66:9f:0b", "network": {"id": "63303ac8-d370-4386-a6bc-576677b64740", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1379220233-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f45d010dd474c92a6b24bf977564ad1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap599dae3b-13", "ovs_interfaceid": "599dae3b-13bb-47af-b889-0037e03d5e31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=a79f2cea-eb27-4631-aaf3-05e7d9e411b4,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'a79f2cea-eb27-4631-aaf3-05e7d9e411b4'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'boot_index': None, 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:fb47e85c-aaa9-4165-8be3-125572b68a87'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mtLoQzKG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'c9766433-4c5a-40ed-a212-715a24f42b91', 'attached_at': '2023-08-09T15:21:26.000000', 'detached_at': '', 'volume_id': 'fb47e85c-aaa9-4165-8be3-125572b68a87', 'serial': 'fb47e85c-aaa9-4165-8be3-125572b68a87'}, 'disk_bus': 'virtio', 'attachment_id': 'da090cba-57c9-47cc-ac66-d377fd737ce1', 'delete_on_termination': False, 'volume_type': None} {{(pid=72382) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 15:21:25 user nova-compute[72382]: WARNING nova.virt.libvirt.driver [None req-ab33db54-9d77-4ff9-867e-2099b6cc20f2 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 15:21:25 user nova-compute[72382]: WARNING nova.virt.libvirt.driver [None req-ab33db54-9d77-4ff9-867e-2099b6cc20f2 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 15:21:25 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-ab33db54-9d77-4ff9-867e-2099b6cc20f2 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72382) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 15:21:25 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-ab33db54-9d77-4ff9-867e-2099b6cc20f2 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] CPU controller missing on host. {{(pid=72382) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 15:21:25 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-ab33db54-9d77-4ff9-867e-2099b6cc20f2 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72382) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 15:21:25 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-ab33db54-9d77-4ff9-867e-2099b6cc20f2 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] CPU controller found on host. {{(pid=72382) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 15:21:25 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-ab33db54-9d77-4ff9-867e-2099b6cc20f2 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72382) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 15:21:25 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-ab33db54-9d77-4ff9-867e-2099b6cc20f2 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T15:11:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=a79f2cea-eb27-4631-aaf3-05e7d9e411b4,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 15:21:25 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-ab33db54-9d77-4ff9-867e-2099b6cc20f2 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Flavor limits 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 15:21:25 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-ab33db54-9d77-4ff9-867e-2099b6cc20f2 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Image limits 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 15:21:25 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-ab33db54-9d77-4ff9-867e-2099b6cc20f2 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Flavor pref 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 15:21:25 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-ab33db54-9d77-4ff9-867e-2099b6cc20f2 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Image pref 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 15:21:25 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-ab33db54-9d77-4ff9-867e-2099b6cc20f2 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 15:21:25 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-ab33db54-9d77-4ff9-867e-2099b6cc20f2 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 15:21:25 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-ab33db54-9d77-4ff9-867e-2099b6cc20f2 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72382) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 15:21:25 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-ab33db54-9d77-4ff9-867e-2099b6cc20f2 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Got 1 possible topologies {{(pid=72382) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 15:21:25 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-ab33db54-9d77-4ff9-867e-2099b6cc20f2 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 15:21:25 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-ab33db54-9d77-4ff9-867e-2099b6cc20f2 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 15:21:25 user nova-compute[72382]: DEBUG nova.objects.instance [None req-ab33db54-9d77-4ff9-867e-2099b6cc20f2 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Lazy-loading 'vcpu_model' on Instance uuid c9766433-4c5a-40ed-a212-715a24f42b91 {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:21:26 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ab33db54-9d77-4ff9-867e-2099b6cc20f2 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] [instance: c9766433-4c5a-40ed-a212-715a24f42b91] Calling os-brick to attach iSCSI Volume {{(pid=72382) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 15:21:26 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab33db54-9d77-4ff9-867e-2099b6cc20f2 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2a0c768340>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:fb47e85c-aaa9-4165-8be3-125572b68a87'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mtLoQzKG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 15:21:26 user nova-compute[72382]: WARNING os_brick.initiator.connectors.base [None req-ab33db54-9d77-4ff9-867e-2099b6cc20f2 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 15:21:26 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-ab33db54-9d77-4ff9-867e-2099b6cc20f2 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 15:21:26 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-ab33db54-9d77-4ff9-867e-2099b6cc20f2 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 15:21:26 user nova-compute[72382]: WARNING os_brick.initiator.connectors.base [None req-ab33db54-9d77-4ff9-867e-2099b6cc20f2 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 15:21:26 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-ab33db54-9d77-4ff9-867e-2099b6cc20f2 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fb47e85c-aaa9-4165-8be3-125572b68a87" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 15:21:26 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-ab33db54-9d77-4ff9-867e-2099b6cc20f2 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fb47e85c-aaa9-4165-8be3-125572b68a87" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 15:21:26 user nova-compute[72382]: INFO os_brick.initiator.connectors.iscsi [None req-ab33db54-9d77-4ff9-867e-2099b6cc20f2 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 15:21:26 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb47e85c-aaa9-4165-8be3-125572b68a87 -p 172.16.0.220:3260 {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:21:26 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb47e85c-aaa9-4165-8be3-125572b68a87 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:21:26 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d08e033-8020-42a9-b7f1-b027c4b7d2ae]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:21:26 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab33db54-9d77-4ff9-867e-2099b6cc20f2 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 15:21:26 user nova-compute[72382]:  {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:21:26 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb47e85c-aaa9-4165-8be3-125572b68a87 -p 172.16.0.220:3260 --interface default --op new {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:21:26 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb47e85c-aaa9-4165-8be3-125572b68a87 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:21:26 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0e6c26c-53cc-45c1-9a54-528317c40dce]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fb47e85c-aaa9-4165-8be3-125572b68a87] added\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:21:26 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab33db54-9d77-4ff9-867e-2099b6cc20f2 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fb47e85c-aaa9-4165-8be3-125572b68a87] added
Aug 09 15:21:26 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:21:26 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb47e85c-aaa9-4165-8be3-125572b68a87 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:21:26 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb47e85c-aaa9-4165-8be3-125572b68a87 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:21:26 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f05e281-428a-4ed9-9f38-4305e02fb074]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:21:26 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab33db54-9d77-4ff9-867e-2099b6cc20f2 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:21:26 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb47e85c-aaa9-4165-8be3-125572b68a87 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:21:26 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb47e85c-aaa9-4165-8be3-125572b68a87 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:21:26 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ef58dd2-2754-4614-86e2-7784bc598a03]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:21:26 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab33db54-9d77-4ff9-867e-2099b6cc20f2 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:21:26 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb47e85c-aaa9-4165-8be3-125572b68a87 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mtLoQzKG {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:21:26 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb47e85c-aaa9-4165-8be3-125572b68a87 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mtLoQzKG" returned: 0 in 0.052s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:21:26 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[f818dbbd-7d4b-46ac-b15a-78d579b272d1]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:21:26 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab33db54-9d77-4ff9-867e-2099b6cc20f2 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mtLoQzKG'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:21:26 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb47e85c-aaa9-4165-8be3-125572b68a87 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:21:26 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb47e85c-aaa9-4165-8be3-125572b68a87 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:21:26 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c33f3ed-db00-4160-9eec-aadbf41fdecc]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:21:26 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab33db54-9d77-4ff9-867e-2099b6cc20f2 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:21:26 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:21:26 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:21:26 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[96d8f3ac-3c06-4adf-9428-c62f3d17e475]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cd86701-a303-4744-bf0c-31b5314bb87d (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8bad821-ddd1-4287-806d-78ffdc34fa68 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:184b0159-3cae-4d79-86b3-26a58437eb09 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c6be653-7ab8-4b40-9e28-43c1eca5e016 (non-flash)\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:21:26 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab33db54-9d77-4ff9-867e-2099b6cc20f2 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)
Aug 09 15:21:26 user nova-compute[72382]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cd86701-a303-4744-bf0c-31b5314bb87d (non-flash)
Aug 09 15:21:26 user nova-compute[72382]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8bad821-ddd1-4287-806d-78ffdc34fa68 (non-flash)
Aug 09 15:21:26 user nova-compute[72382]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:184b0159-3cae-4d79-86b3-26a58437eb09 (non-flash)
Aug 09 15:21:26 user nova-compute[72382]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c6be653-7ab8-4b40-9e28-43c1eca5e016 (non-flash)
Aug 09 15:21:26 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 15:21:26 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab33db54-9d77-4ff9-867e-2099b6cc20f2 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)
Aug 09 15:21:26 user nova-compute[72382]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cd86701-a303-4744-bf0c-31b5314bb87d (non-flash)
Aug 09 15:21:26 user nova-compute[72382]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8bad821-ddd1-4287-806d-78ffdc34fa68 (non-flash)
Aug 09 15:21:26 user nova-compute[72382]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:184b0159-3cae-4d79-86b3-26a58437eb09 (non-flash)
Aug 09 15:21:26 user nova-compute[72382]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c6be653-7ab8-4b40-9e28-43c1eca5e016 (non-flash)
Aug 09 15:21:26 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 15:21:26 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb47e85c-aaa9-4165-8be3-125572b68a87 -p 172.16.0.220:3260 --login {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:21:26 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb47e85c-aaa9-4165-8be3-125572b68a87 -p 172.16.0.220:3260 --login" returned: 0 in 0.079s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:21:26 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[73eb07be-cf81-4046-820e-93ba8dbfadab]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fb47e85c-aaa9-4165-8be3-125572b68a87, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fb47e85c-aaa9-4165-8be3-125572b68a87, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:21:26 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab33db54-9d77-4ff9-867e-2099b6cc20f2 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fb47e85c-aaa9-4165-8be3-125572b68a87, portal: 172.16.0.220,3260]
Aug 09 15:21:26 user nova-compute[72382]: Login to [iface: default, target: iqn.2010-10.org.openstack:fb47e85c-aaa9-4165-8be3-125572b68a87, portal: 172.16.0.220,3260] successful.
Aug 09 15:21:26 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:21:26 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb47e85c-aaa9-4165-8be3-125572b68a87 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:21:26 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb47e85c-aaa9-4165-8be3-125572b68a87 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:21:26 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc0b82d9-4d7d-466f-bf18-ad2ec219fa15]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:21:26 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab33db54-9d77-4ff9-867e-2099b6cc20f2 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:21:26 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:21:26 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:21:26 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[c731fd4a-fb75-4f76-91a4-349ed853ce58]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cd86701-a303-4744-bf0c-31b5314bb87d (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8bad821-ddd1-4287-806d-78ffdc34fa68 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:184b0159-3cae-4d79-86b3-26a58437eb09 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c6be653-7ab8-4b40-9e28-43c1eca5e016 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb47e85c-aaa9-4165-8be3-125572b68a87 (non-flash)\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:21:26 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab33db54-9d77-4ff9-867e-2099b6cc20f2 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)
Aug 09 15:21:26 user nova-compute[72382]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cd86701-a303-4744-bf0c-31b5314bb87d (non-flash)
Aug 09 15:21:26 user nova-compute[72382]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8bad821-ddd1-4287-806d-78ffdc34fa68 (non-flash)
Aug 09 15:21:26 user nova-compute[72382]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:184b0159-3cae-4d79-86b3-26a58437eb09 (non-flash)
Aug 09 15:21:26 user nova-compute[72382]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c6be653-7ab8-4b40-9e28-43c1eca5e016 (non-flash)
Aug 09 15:21:26 user nova-compute[72382]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb47e85c-aaa9-4165-8be3-125572b68a87 (non-flash)
Aug 09 15:21:26 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 15:21:26 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab33db54-9d77-4ff9-867e-2099b6cc20f2 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)
Aug 09 15:21:26 user nova-compute[72382]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cd86701-a303-4744-bf0c-31b5314bb87d (non-flash)
Aug 09 15:21:26 user nova-compute[72382]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8bad821-ddd1-4287-806d-78ffdc34fa68 (non-flash)
Aug 09 15:21:26 user nova-compute[72382]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:184b0159-3cae-4d79-86b3-26a58437eb09 (non-flash)
Aug 09 15:21:26 user nova-compute[72382]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c6be653-7ab8-4b40-9e28-43c1eca5e016 (non-flash)
Aug 09 15:21:26 user nova-compute[72382]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb47e85c-aaa9-4165-8be3-125572b68a87 (non-flash)
Aug 09 15:21:26 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 15:21:26 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-ab33db54-9d77-4ff9-867e-2099b6cc20f2 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fb47e85c-aaa9-4165-8be3-125572b68a87" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.347s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 15:21:26 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab33db54-9d77-4ff9-867e-2099b6cc20f2 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Connected to 172.16.0.220:3260 {{(pid=72382) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 15:21:26 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-ab33db54-9d77-4ff9-867e-2099b6cc20f2 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] HCTL ('33', '-', '-', 0) found on session 21 with lun 0 {{(pid=72382) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 15:21:26 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-ab33db54-9d77-4ff9-867e-2099b6cc20f2 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72382) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 15:21:26 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:21:26 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:21:26 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4fcd414-c746-4cdf-acdd-b0683d94d0a5]: (4, ('- - 0', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:21:26 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-ab33db54-9d77-4ff9-867e-2099b6cc20f2 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Searching for a device in session 21 and hctl ['33', '*', '*', 0] yield: None {{(pid=72382) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 15:21:27 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-ab33db54-9d77-4ff9-867e-2099b6cc20f2 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Searching for a device in session 21 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72382) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 15:21:27 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab33db54-9d77-4ff9-867e-2099b6cc20f2 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mtLoQzKG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72382) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 15:21:27 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-ab33db54-9d77-4ff9-867e-2099b6cc20f2 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.378s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 15:21:27 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab33db54-9d77-4ff9-867e-2099b6cc20f2 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] <== connect_volume: return (1379ms) {'type': 'block', 'scsi_wwn': '23038616233303532', 'path': '/dev/sdb'} {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 15:21:27 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ab33db54-9d77-4ff9-867e-2099b6cc20f2 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] [instance: c9766433-4c5a-40ed-a212-715a24f42b91] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23038616233303532', 'path': '/dev/sdb'} {{(pid=72382) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 15:21:27 user nova-compute[72382]: DEBUG nova.virt.libvirt.vif [None req-ab33db54-9d77-4ff9-867e-2099b6cc20f2 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T15:15:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-2120220558',display_name='tempest-ServerActionsTestOtherB-server-2120220558',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-2120220558',id=5,image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOdAPO5nl2/3VDHoi/8yD5s8l1+mDVit5A+n/HDnoxJgZMgOR9rAXiFsYVLEG+MsUeEQU8np4/pg88xwFSbi1vuFZkvV9b5532CTazhkqSlb4YuAKF8mo8fSFbyD8FwytA==',key_name='tempest-keypair-1399201542',keypairs=<?>,launch_index=0,launched_at=2023-08-09T15:19:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='9f45d010dd474c92a6b24bf977564ad1',ramdisk_id='',reservation_id='r-rng7ms7j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-250545160',owner_user_name='tempest-ServerActionsTestOtherB-250545160-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T15:21:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='232fbbd15fea4894be7cebb13ea45cf9',uuid=c9766433-4c5a-40ed-a212-715a24f42b91,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "599dae3b-13bb-47af-b889-0037e03d5e31", "address": "fa:16:3e:66:9f:0b", "network": {"id": "63303ac8-d370-4386-a6bc-576677b64740", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1379220233-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f45d010dd474c92a6b24bf977564ad1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap599dae3b-13", "ovs_interfaceid": "599dae3b-13bb-47af-b889-0037e03d5e31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72382) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 15:21:27 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-ab33db54-9d77-4ff9-867e-2099b6cc20f2 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Converting VIF {"id": "599dae3b-13bb-47af-b889-0037e03d5e31", "address": "fa:16:3e:66:9f:0b", "network": {"id": "63303ac8-d370-4386-a6bc-576677b64740", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1379220233-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f45d010dd474c92a6b24bf977564ad1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap599dae3b-13", "ovs_interfaceid": "599dae3b-13bb-47af-b889-0037e03d5e31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 15:21:27 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-ab33db54-9d77-4ff9-867e-2099b6cc20f2 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:66:9f:0b,bridge_name='br-int',has_traffic_filtering=True,id=599dae3b-13bb-47af-b889-0037e03d5e31,network=Network(63303ac8-d370-4386-a6bc-576677b64740),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap599dae3b-13') {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 15:21:27 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-ab33db54-9d77-4ff9-867e-2099b6cc20f2 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] [instance: c9766433-4c5a-40ed-a212-715a24f42b91] End _get_guest_xml xml=<domain type="kvm">
Aug 09 15:21:27 user nova-compute[72382]:   <uuid>c9766433-4c5a-40ed-a212-715a24f42b91</uuid>
Aug 09 15:21:27 user nova-compute[72382]:   <name>instance-00000005</name>
Aug 09 15:21:27 user nova-compute[72382]:   <memory>524288</memory>
Aug 09 15:21:27 user nova-compute[72382]:   <vcpu>1</vcpu>
Aug 09 15:21:27 user nova-compute[72382]:   <metadata>
Aug 09 15:21:27 user nova-compute[72382]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 15:21:27 user nova-compute[72382]:       <nova:package version="0.0.0"/>
Aug 09 15:21:27 user nova-compute[72382]:       <nova:name>tempest-ServerActionsTestOtherB-server-2120220558</nova:name>
Aug 09 15:21:27 user nova-compute[72382]:       <nova:creationTime>2023-08-09 15:21:25</nova:creationTime>
Aug 09 15:21:27 user nova-compute[72382]:       <nova:flavor name="m1.tiny">
Aug 09 15:21:27 user nova-compute[72382]:         <nova:memory>512</nova:memory>
Aug 09 15:21:27 user nova-compute[72382]:         <nova:disk>1</nova:disk>
Aug 09 15:21:27 user nova-compute[72382]:         <nova:swap>0</nova:swap>
Aug 09 15:21:27 user nova-compute[72382]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 15:21:27 user nova-compute[72382]:         <nova:vcpus>1</nova:vcpus>
Aug 09 15:21:27 user nova-compute[72382]:       </nova:flavor>
Aug 09 15:21:27 user nova-compute[72382]:       <nova:owner>
Aug 09 15:21:27 user nova-compute[72382]:         <nova:user uuid="232fbbd15fea4894be7cebb13ea45cf9">tempest-ServerActionsTestOtherB-250545160-project-member</nova:user>
Aug 09 15:21:27 user nova-compute[72382]:         <nova:project uuid="9f45d010dd474c92a6b24bf977564ad1">tempest-ServerActionsTestOtherB-250545160</nova:project>
Aug 09 15:21:27 user nova-compute[72382]:       </nova:owner>
Aug 09 15:21:27 user nova-compute[72382]:       <nova:root type="image" uuid="a79f2cea-eb27-4631-aaf3-05e7d9e411b4"/>
Aug 09 15:21:27 user nova-compute[72382]:       <nova:ports>
Aug 09 15:21:27 user nova-compute[72382]:         <nova:port uuid="599dae3b-13bb-47af-b889-0037e03d5e31">
Aug 09 15:21:27 user nova-compute[72382]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 09 15:21:27 user nova-compute[72382]:         </nova:port>
Aug 09 15:21:27 user nova-compute[72382]:       </nova:ports>
Aug 09 15:21:27 user nova-compute[72382]:     </nova:instance>
Aug 09 15:21:27 user nova-compute[72382]:   </metadata>
Aug 09 15:21:27 user nova-compute[72382]:   <sysinfo type="smbios">
Aug 09 15:21:27 user nova-compute[72382]:     <system>
Aug 09 15:21:27 user nova-compute[72382]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 15:21:27 user nova-compute[72382]:       <entry name="product">OpenStack Nova</entry>
Aug 09 15:21:27 user nova-compute[72382]:       <entry name="version">0.0.0</entry>
Aug 09 15:21:27 user nova-compute[72382]:       <entry name="serial">c9766433-4c5a-40ed-a212-715a24f42b91</entry>
Aug 09 15:21:27 user nova-compute[72382]:       <entry name="uuid">c9766433-4c5a-40ed-a212-715a24f42b91</entry>
Aug 09 15:21:27 user nova-compute[72382]:       <entry name="family">Virtual Machine</entry>
Aug 09 15:21:27 user nova-compute[72382]:     </system>
Aug 09 15:21:27 user nova-compute[72382]:   </sysinfo>
Aug 09 15:21:27 user nova-compute[72382]:   <os>
Aug 09 15:21:27 user nova-compute[72382]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 15:21:27 user nova-compute[72382]:     <boot dev="hd"/>
Aug 09 15:21:27 user nova-compute[72382]:     <smbios mode="sysinfo"/>
Aug 09 15:21:27 user nova-compute[72382]:   </os>
Aug 09 15:21:27 user nova-compute[72382]:   <features>
Aug 09 15:21:27 user nova-compute[72382]:     <acpi/>
Aug 09 15:21:27 user nova-compute[72382]:     <apic/>
Aug 09 15:21:27 user nova-compute[72382]:     <vmcoreinfo/>
Aug 09 15:21:27 user nova-compute[72382]:   </features>
Aug 09 15:21:27 user nova-compute[72382]:   <clock offset="utc">
Aug 09 15:21:27 user nova-compute[72382]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 15:21:27 user nova-compute[72382]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 15:21:27 user nova-compute[72382]:     <timer name="hpet" present="no"/>
Aug 09 15:21:27 user nova-compute[72382]:   </clock>
Aug 09 15:21:27 user nova-compute[72382]:   <cpu mode="custom" match="exact">
Aug 09 15:21:27 user nova-compute[72382]:     <model>Nehalem</model>
Aug 09 15:21:27 user nova-compute[72382]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 15:21:27 user nova-compute[72382]:   </cpu>
Aug 09 15:21:27 user nova-compute[72382]:   <devices>
Aug 09 15:21:27 user nova-compute[72382]:     <disk type="file" device="disk">
Aug 09 15:21:27 user nova-compute[72382]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 15:21:27 user nova-compute[72382]:       <source file="/opt/stack/data/nova/instances/c9766433-4c5a-40ed-a212-715a24f42b91/disk"/>
Aug 09 15:21:27 user nova-compute[72382]:       <target dev="vda" bus="virtio"/>
Aug 09 15:21:27 user nova-compute[72382]:     </disk>
Aug 09 15:21:27 user nova-compute[72382]:     <disk type="block" device="disk">
Aug 09 15:21:27 user nova-compute[72382]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 15:21:27 user nova-compute[72382]:       <source dev="/dev/sdb"/>
Aug 09 15:21:27 user nova-compute[72382]:       <target dev="vdb" bus="virtio"/>
Aug 09 15:21:27 user nova-compute[72382]:       <serial>fb47e85c-aaa9-4165-8be3-125572b68a87</serial>
Aug 09 15:21:27 user nova-compute[72382]:     </disk>
Aug 09 15:21:27 user nova-compute[72382]:     <interface type="ethernet">
Aug 09 15:21:27 user nova-compute[72382]:       <mac address="fa:16:3e:66:9f:0b"/>
Aug 09 15:21:27 user nova-compute[72382]:       <model type="virtio"/>
Aug 09 15:21:27 user nova-compute[72382]:       <mtu size="1442"/>
Aug 09 15:21:27 user nova-compute[72382]:       <target dev="tap599dae3b-13"/>
Aug 09 15:21:27 user nova-compute[72382]:     </interface>
Aug 09 15:21:27 user nova-compute[72382]:     <serial type="pty">
Aug 09 15:21:27 user nova-compute[72382]:       <log file="/opt/stack/data/nova/instances/c9766433-4c5a-40ed-a212-715a24f42b91/console.log" append="off"/>
Aug 09 15:21:27 user nova-compute[72382]:     </serial>
Aug 09 15:21:27 user nova-compute[72382]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 15:21:27 user nova-compute[72382]:     <video>
Aug 09 15:21:27 user nova-compute[72382]:       <model type="virtio"/>
Aug 09 15:21:27 user nova-compute[72382]:     </video>
Aug 09 15:21:27 user nova-compute[72382]:     <rng model="virtio">
Aug 09 15:21:27 user nova-compute[72382]:       <backend model="random">/dev/urandom</backend>
Aug 09 15:21:27 user nova-compute[72382]:     </rng>
Aug 09 15:21:27 user nova-compute[72382]:     <controller type="usb" index="0" model="none"/>
Aug 09 15:21:27 user nova-compute[72382]:     <memballoon model="virtio">
Aug 09 15:21:27 user nova-compute[72382]:       <stats period="10"/>
Aug 09 15:21:27 user nova-compute[72382]:     </memballoon>
Aug 09 15:21:27 user nova-compute[72382]:   </devices>
Aug 09 15:21:27 user nova-compute[72382]: </domain>
Aug 09 15:21:27 user nova-compute[72382]:  {{(pid=72382) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 15:21:27 user nova-compute[72382]: DEBUG nova.virt.libvirt.vif [None req-ab33db54-9d77-4ff9-867e-2099b6cc20f2 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T15:15:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-2120220558',display_name='tempest-ServerActionsTestOtherB-server-2120220558',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-2120220558',id=5,image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOdAPO5nl2/3VDHoi/8yD5s8l1+mDVit5A+n/HDnoxJgZMgOR9rAXiFsYVLEG+MsUeEQU8np4/pg88xwFSbi1vuFZkvV9b5532CTazhkqSlb4YuAKF8mo8fSFbyD8FwytA==',key_name='tempest-keypair-1399201542',keypairs=<?>,launch_index=0,launched_at=2023-08-09T15:19:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='9f45d010dd474c92a6b24bf977564ad1',ramdisk_id='',reservation_id='r-rng7ms7j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-250545160',owner_user_name='tempest-ServerActionsTestOtherB-250545160-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T15:21:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='232fbbd15fea4894be7cebb13ea45cf9',uuid=c9766433-4c5a-40ed-a212-715a24f42b91,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "599dae3b-13bb-47af-b889-0037e03d5e31", "address": "fa:16:3e:66:9f:0b", "network": {"id": "63303ac8-d370-4386-a6bc-576677b64740", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1379220233-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f45d010dd474c92a6b24bf977564ad1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap599dae3b-13", "ovs_interfaceid": "599dae3b-13bb-47af-b889-0037e03d5e31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 15:21:27 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-ab33db54-9d77-4ff9-867e-2099b6cc20f2 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Converting VIF {"id": "599dae3b-13bb-47af-b889-0037e03d5e31", "address": "fa:16:3e:66:9f:0b", "network": {"id": "63303ac8-d370-4386-a6bc-576677b64740", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1379220233-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f45d010dd474c92a6b24bf977564ad1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap599dae3b-13", "ovs_interfaceid": "599dae3b-13bb-47af-b889-0037e03d5e31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 15:21:27 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-ab33db54-9d77-4ff9-867e-2099b6cc20f2 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:66:9f:0b,bridge_name='br-int',has_traffic_filtering=True,id=599dae3b-13bb-47af-b889-0037e03d5e31,network=Network(63303ac8-d370-4386-a6bc-576677b64740),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap599dae3b-13') {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 15:21:27 user nova-compute[72382]: DEBUG os_vif [None req-ab33db54-9d77-4ff9-867e-2099b6cc20f2 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:9f:0b,bridge_name='br-int',has_traffic_filtering=True,id=599dae3b-13bb-47af-b889-0037e03d5e31,network=Network(63303ac8-d370-4386-a6bc-576677b64740),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap599dae3b-13') {{(pid=72382) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 15:21:27 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:21:27 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:21:27 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 15:21:27 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:21:27 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap599dae3b-13, may_exist=True, interface_attrs={}) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:21:27 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap599dae3b-13, col_values=(('external_ids', {'iface-id': '599dae3b-13bb-47af-b889-0037e03d5e31', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:66:9f:0b', 'vm-uuid': 'c9766433-4c5a-40ed-a212-715a24f42b91'}),), if_exists=True) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:21:27 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:21:27 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:21:27 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:21:27 user nova-compute[72382]: INFO os_vif [None req-ab33db54-9d77-4ff9-867e-2099b6cc20f2 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:9f:0b,bridge_name='br-int',has_traffic_filtering=True,id=599dae3b-13bb-47af-b889-0037e03d5e31,network=Network(63303ac8-d370-4386-a6bc-576677b64740),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap599dae3b-13')
Aug 09 15:21:28 user nova-compute[72382]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691594473.2117639, c9766433-4c5a-40ed-a212-715a24f42b91 => Stopped> {{(pid=72382) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 15:21:28 user nova-compute[72382]: INFO nova.compute.manager [-] [instance: c9766433-4c5a-40ed-a212-715a24f42b91] VM Stopped (Lifecycle Event)
Aug 09 15:21:28 user nova-compute[72382]: DEBUG nova.compute.manager [None req-68484a15-0b55-43a7-9ebf-cacf2d8db83d None None] [instance: c9766433-4c5a-40ed-a212-715a24f42b91] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:21:28 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:21:28 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:21:28 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:21:28 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:21:29 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:21:29 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:21:29 user nova-compute[72382]: DEBUG nova.compute.manager [req-e0f5df9b-648f-4424-865e-770fab28dac7 req-73d85218-0d99-438e-9385-61b6dadeffb5 service nova] [instance: c9766433-4c5a-40ed-a212-715a24f42b91] Received event network-vif-plugged-599dae3b-13bb-47af-b889-0037e03d5e31 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:21:29 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-e0f5df9b-648f-4424-865e-770fab28dac7 req-73d85218-0d99-438e-9385-61b6dadeffb5 service nova] Acquiring lock "c9766433-4c5a-40ed-a212-715a24f42b91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:21:29 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-e0f5df9b-648f-4424-865e-770fab28dac7 req-73d85218-0d99-438e-9385-61b6dadeffb5 service nova] Lock "c9766433-4c5a-40ed-a212-715a24f42b91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:21:29 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-e0f5df9b-648f-4424-865e-770fab28dac7 req-73d85218-0d99-438e-9385-61b6dadeffb5 service nova] Lock "c9766433-4c5a-40ed-a212-715a24f42b91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:21:29 user nova-compute[72382]: DEBUG nova.compute.manager [req-e0f5df9b-648f-4424-865e-770fab28dac7 req-73d85218-0d99-438e-9385-61b6dadeffb5 service nova] [instance: c9766433-4c5a-40ed-a212-715a24f42b91] No waiting events found dispatching network-vif-plugged-599dae3b-13bb-47af-b889-0037e03d5e31 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:21:29 user nova-compute[72382]: WARNING nova.compute.manager [req-e0f5df9b-648f-4424-865e-770fab28dac7 req-73d85218-0d99-438e-9385-61b6dadeffb5 service nova] [instance: c9766433-4c5a-40ed-a212-715a24f42b91] Received unexpected event network-vif-plugged-599dae3b-13bb-47af-b889-0037e03d5e31 for instance with vm_state resized and task_state resize_reverting.
Aug 09 15:21:29 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:21:29 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:21:29 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:21:29 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:21:31 user nova-compute[72382]: DEBUG nova.virt.driver [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Emitting event <LifecycleEvent: 1691594491.1997263, c9766433-4c5a-40ed-a212-715a24f42b91 => Resumed> {{(pid=72382) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 15:21:31 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: c9766433-4c5a-40ed-a212-715a24f42b91] VM Resumed (Lifecycle Event)
Aug 09 15:21:31 user nova-compute[72382]: DEBUG nova.compute.manager [None req-ab33db54-9d77-4ff9-867e-2099b6cc20f2 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] [instance: c9766433-4c5a-40ed-a212-715a24f42b91] Instance event wait completed in 0 seconds for  {{(pid=72382) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 15:21:31 user nova-compute[72382]: INFO nova.virt.libvirt.driver [-] [instance: c9766433-4c5a-40ed-a212-715a24f42b91] Instance running successfully.
Aug 09 15:21:31 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-ab33db54-9d77-4ff9-867e-2099b6cc20f2 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] [instance: c9766433-4c5a-40ed-a212-715a24f42b91] finish_revert_migration finished successfully. {{(pid=72382) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11863}}
Aug 09 15:21:31 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: c9766433-4c5a-40ed-a212-715a24f42b91] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:21:31 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: c9766433-4c5a-40ed-a212-715a24f42b91] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=72382) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 15:21:31 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: c9766433-4c5a-40ed-a212-715a24f42b91] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Aug 09 15:21:31 user nova-compute[72382]: DEBUG nova.virt.driver [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Emitting event <LifecycleEvent: 1691594491.2014992, c9766433-4c5a-40ed-a212-715a24f42b91 => Started> {{(pid=72382) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 15:21:31 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: c9766433-4c5a-40ed-a212-715a24f42b91] VM Started (Lifecycle Event)
Aug 09 15:21:31 user nova-compute[72382]: DEBUG nova.compute.manager [req-cd93c2cc-5d95-4143-b799-4f480946a31d req-cfaaf209-37b1-422a-ac13-3c6d0a631908 service nova] [instance: c9766433-4c5a-40ed-a212-715a24f42b91] Received event network-vif-plugged-599dae3b-13bb-47af-b889-0037e03d5e31 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:21:31 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-cd93c2cc-5d95-4143-b799-4f480946a31d req-cfaaf209-37b1-422a-ac13-3c6d0a631908 service nova] Acquiring lock "c9766433-4c5a-40ed-a212-715a24f42b91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:21:31 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-cd93c2cc-5d95-4143-b799-4f480946a31d req-cfaaf209-37b1-422a-ac13-3c6d0a631908 service nova] Lock "c9766433-4c5a-40ed-a212-715a24f42b91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:21:31 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-cd93c2cc-5d95-4143-b799-4f480946a31d req-cfaaf209-37b1-422a-ac13-3c6d0a631908 service nova] Lock "c9766433-4c5a-40ed-a212-715a24f42b91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:21:31 user nova-compute[72382]: DEBUG nova.compute.manager [req-cd93c2cc-5d95-4143-b799-4f480946a31d req-cfaaf209-37b1-422a-ac13-3c6d0a631908 service nova] [instance: c9766433-4c5a-40ed-a212-715a24f42b91] No waiting events found dispatching network-vif-plugged-599dae3b-13bb-47af-b889-0037e03d5e31 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:21:31 user nova-compute[72382]: WARNING nova.compute.manager [req-cd93c2cc-5d95-4143-b799-4f480946a31d req-cfaaf209-37b1-422a-ac13-3c6d0a631908 service nova] [instance: c9766433-4c5a-40ed-a212-715a24f42b91] Received unexpected event network-vif-plugged-599dae3b-13bb-47af-b889-0037e03d5e31 for instance with vm_state resized and task_state resize_reverting.
Aug 09 15:21:31 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: c9766433-4c5a-40ed-a212-715a24f42b91] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:21:31 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: c9766433-4c5a-40ed-a212-715a24f42b91] Synchronizing instance power state after lifecycle event "Started"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=72382) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 15:21:31 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: c9766433-4c5a-40ed-a212-715a24f42b91] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Aug 09 15:21:31 user nova-compute[72382]: INFO nova.compute.manager [None req-ab33db54-9d77-4ff9-867e-2099b6cc20f2 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] [instance: c9766433-4c5a-40ed-a212-715a24f42b91] Updating instance to original state: 'active'
Aug 09 15:21:31 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:21:32 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:21:34 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:21:35 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:21:37 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:21:39 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:21:42 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:21:45 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-2a8c56c2-001d-4694-92af-b5e3776e09c4 tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] Acquiring lock "a33515b3-3ef4-4f76-a8d8-e7008b5bbb79" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:21:45 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-2a8c56c2-001d-4694-92af-b5e3776e09c4 tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] Lock "a33515b3-3ef4-4f76-a8d8-e7008b5bbb79" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:21:45 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-2a8c56c2-001d-4694-92af-b5e3776e09c4 tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] Acquiring lock "a33515b3-3ef4-4f76-a8d8-e7008b5bbb79-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:21:45 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-2a8c56c2-001d-4694-92af-b5e3776e09c4 tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] Lock "a33515b3-3ef4-4f76-a8d8-e7008b5bbb79-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:21:45 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-2a8c56c2-001d-4694-92af-b5e3776e09c4 tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] Lock "a33515b3-3ef4-4f76-a8d8-e7008b5bbb79-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:21:45 user nova-compute[72382]: INFO nova.compute.manager [None req-2a8c56c2-001d-4694-92af-b5e3776e09c4 tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] [instance: a33515b3-3ef4-4f76-a8d8-e7008b5bbb79] Terminating instance
Aug 09 15:21:45 user nova-compute[72382]: DEBUG nova.compute.manager [None req-2a8c56c2-001d-4694-92af-b5e3776e09c4 tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] [instance: a33515b3-3ef4-4f76-a8d8-e7008b5bbb79] Start destroying the instance on the hypervisor. {{(pid=72382) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 15:21:45 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:21:45 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:21:45 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:21:45 user nova-compute[72382]: DEBUG nova.compute.manager [req-b42a38dc-7667-4f6d-acff-f3fa57885815 req-982076cf-7744-4d55-9991-12d2eaa93202 service nova] [instance: a33515b3-3ef4-4f76-a8d8-e7008b5bbb79] Received event network-vif-unplugged-32c23c7b-6885-4276-bca1-7d8a8cb924c1 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:21:45 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-b42a38dc-7667-4f6d-acff-f3fa57885815 req-982076cf-7744-4d55-9991-12d2eaa93202 service nova] Acquiring lock "a33515b3-3ef4-4f76-a8d8-e7008b5bbb79-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:21:45 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-b42a38dc-7667-4f6d-acff-f3fa57885815 req-982076cf-7744-4d55-9991-12d2eaa93202 service nova] Lock "a33515b3-3ef4-4f76-a8d8-e7008b5bbb79-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:21:45 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-b42a38dc-7667-4f6d-acff-f3fa57885815 req-982076cf-7744-4d55-9991-12d2eaa93202 service nova] Lock "a33515b3-3ef4-4f76-a8d8-e7008b5bbb79-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:21:45 user nova-compute[72382]: DEBUG nova.compute.manager [req-b42a38dc-7667-4f6d-acff-f3fa57885815 req-982076cf-7744-4d55-9991-12d2eaa93202 service nova] [instance: a33515b3-3ef4-4f76-a8d8-e7008b5bbb79] No waiting events found dispatching network-vif-unplugged-32c23c7b-6885-4276-bca1-7d8a8cb924c1 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:21:45 user nova-compute[72382]: DEBUG nova.compute.manager [req-b42a38dc-7667-4f6d-acff-f3fa57885815 req-982076cf-7744-4d55-9991-12d2eaa93202 service nova] [instance: a33515b3-3ef4-4f76-a8d8-e7008b5bbb79] Received event network-vif-unplugged-32c23c7b-6885-4276-bca1-7d8a8cb924c1 for instance with task_state deleting. {{(pid=72382) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 15:21:46 user nova-compute[72382]: INFO nova.virt.libvirt.driver [-] [instance: a33515b3-3ef4-4f76-a8d8-e7008b5bbb79] Instance destroyed successfully.
Aug 09 15:21:46 user nova-compute[72382]: DEBUG nova.objects.instance [None req-2a8c56c2-001d-4694-92af-b5e3776e09c4 tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] Lazy-loading 'resources' on Instance uuid a33515b3-3ef4-4f76-a8d8-e7008b5bbb79 {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:21:46 user nova-compute[72382]: DEBUG nova.virt.libvirt.vif [None req-2a8c56c2-001d-4694-92af-b5e3776e09c4 tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T15:15:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-121310467',display_name='tempest-VolumesAdminNegativeTest-server-121310467',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-121310467',id=8,image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKtYYEScFXJJjXJKGs0FnYAmbxicTlVOICxG+4SQB/KUvoHhfJalbCph72m5nmpmoaO5/jQ2UjSHelByuWETKf6HGow4GS1Fc/gbHLkBERck7WUV5SqSTz/+fBQjPgtJnA==',key_name='tempest-keypair-1511525227',keypairs=<?>,launch_index=0,launched_at=2023-08-09T15:15:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3b98e20f61c34fd6aa28cef7ceadf0d3',ramdisk_id='',reservation_id='r-f0luiylm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-993781103',owner_user_name='tempest-VolumesAdminNegativeTest-993781103-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T15:15:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='374f2148fb524924acc7e1e968e73fe1',uuid=a33515b3-3ef4-4f76-a8d8-e7008b5bbb79,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "32c23c7b-6885-4276-bca1-7d8a8cb924c1", "address": "fa:16:3e:e9:da:b6", "network": {"id": "1a0f18df-96f2-4c90-8e53-fcbfc8f17bc4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1771770150-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b98e20f61c34fd6aa28cef7ceadf0d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32c23c7b-68", "ovs_interfaceid": "32c23c7b-6885-4276-bca1-7d8a8cb924c1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 15:21:46 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-2a8c56c2-001d-4694-92af-b5e3776e09c4 tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] Converting VIF {"id": "32c23c7b-6885-4276-bca1-7d8a8cb924c1", "address": "fa:16:3e:e9:da:b6", "network": {"id": "1a0f18df-96f2-4c90-8e53-fcbfc8f17bc4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1771770150-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b98e20f61c34fd6aa28cef7ceadf0d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32c23c7b-68", "ovs_interfaceid": "32c23c7b-6885-4276-bca1-7d8a8cb924c1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 15:21:46 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-2a8c56c2-001d-4694-92af-b5e3776e09c4 tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e9:da:b6,bridge_name='br-int',has_traffic_filtering=True,id=32c23c7b-6885-4276-bca1-7d8a8cb924c1,network=Network(1a0f18df-96f2-4c90-8e53-fcbfc8f17bc4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32c23c7b-68') {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 15:21:46 user nova-compute[72382]: DEBUG os_vif [None req-2a8c56c2-001d-4694-92af-b5e3776e09c4 tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e9:da:b6,bridge_name='br-int',has_traffic_filtering=True,id=32c23c7b-6885-4276-bca1-7d8a8cb924c1,network=Network(1a0f18df-96f2-4c90-8e53-fcbfc8f17bc4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32c23c7b-68') {{(pid=72382) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 15:21:46 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:21:46 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap32c23c7b-68, bridge=br-int, if_exists=True) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:21:46 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:21:46 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:21:46 user nova-compute[72382]: INFO os_vif [None req-2a8c56c2-001d-4694-92af-b5e3776e09c4 tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e9:da:b6,bridge_name='br-int',has_traffic_filtering=True,id=32c23c7b-6885-4276-bca1-7d8a8cb924c1,network=Network(1a0f18df-96f2-4c90-8e53-fcbfc8f17bc4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32c23c7b-68')
Aug 09 15:21:46 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-2a8c56c2-001d-4694-92af-b5e3776e09c4 tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] [instance: a33515b3-3ef4-4f76-a8d8-e7008b5bbb79] Deleting instance files /opt/stack/data/nova/instances/a33515b3-3ef4-4f76-a8d8-e7008b5bbb79_del
Aug 09 15:21:46 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-2a8c56c2-001d-4694-92af-b5e3776e09c4 tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] [instance: a33515b3-3ef4-4f76-a8d8-e7008b5bbb79] Deletion of /opt/stack/data/nova/instances/a33515b3-3ef4-4f76-a8d8-e7008b5bbb79_del complete
Aug 09 15:21:46 user nova-compute[72382]: INFO nova.compute.manager [None req-2a8c56c2-001d-4694-92af-b5e3776e09c4 tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] [instance: a33515b3-3ef4-4f76-a8d8-e7008b5bbb79] Took 0.88 seconds to destroy the instance on the hypervisor.
Aug 09 15:21:46 user nova-compute[72382]: DEBUG oslo.service.loopingcall [None req-2a8c56c2-001d-4694-92af-b5e3776e09c4 tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72382) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 15:21:46 user nova-compute[72382]: DEBUG nova.compute.manager [-] [instance: a33515b3-3ef4-4f76-a8d8-e7008b5bbb79] Deallocating network for instance {{(pid=72382) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 15:21:46 user nova-compute[72382]: DEBUG nova.network.neutron [-] [instance: a33515b3-3ef4-4f76-a8d8-e7008b5bbb79] deallocate_for_instance() {{(pid=72382) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 15:21:47 user nova-compute[72382]: DEBUG nova.network.neutron [-] [instance: a33515b3-3ef4-4f76-a8d8-e7008b5bbb79] Updating instance_info_cache with network_info: [] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:21:47 user nova-compute[72382]: INFO nova.compute.manager [-] [instance: a33515b3-3ef4-4f76-a8d8-e7008b5bbb79] Took 1.11 seconds to deallocate network for instance.
Aug 09 15:21:47 user nova-compute[72382]: DEBUG nova.compute.manager [req-ec472a39-6f21-43ad-905c-b25da3c8b8f8 req-f3b4383e-d887-40cb-8059-c0d3768d9398 service nova] [instance: a33515b3-3ef4-4f76-a8d8-e7008b5bbb79] Received event network-vif-deleted-32c23c7b-6885-4276-bca1-7d8a8cb924c1 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:21:47 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-2a8c56c2-001d-4694-92af-b5e3776e09c4 tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:21:47 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-2a8c56c2-001d-4694-92af-b5e3776e09c4 tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:21:47 user nova-compute[72382]: DEBUG nova.compute.manager [req-6ed94b64-085e-480c-8048-a53abb5fbb27 req-12dcd302-d091-422b-abfe-f3f737d5c2ed service nova] [instance: a33515b3-3ef4-4f76-a8d8-e7008b5bbb79] Received event network-vif-plugged-32c23c7b-6885-4276-bca1-7d8a8cb924c1 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:21:47 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-6ed94b64-085e-480c-8048-a53abb5fbb27 req-12dcd302-d091-422b-abfe-f3f737d5c2ed service nova] Acquiring lock "a33515b3-3ef4-4f76-a8d8-e7008b5bbb79-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:21:47 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-6ed94b64-085e-480c-8048-a53abb5fbb27 req-12dcd302-d091-422b-abfe-f3f737d5c2ed service nova] Lock "a33515b3-3ef4-4f76-a8d8-e7008b5bbb79-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:21:47 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-6ed94b64-085e-480c-8048-a53abb5fbb27 req-12dcd302-d091-422b-abfe-f3f737d5c2ed service nova] Lock "a33515b3-3ef4-4f76-a8d8-e7008b5bbb79-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:21:47 user nova-compute[72382]: DEBUG nova.compute.manager [req-6ed94b64-085e-480c-8048-a53abb5fbb27 req-12dcd302-d091-422b-abfe-f3f737d5c2ed service nova] [instance: a33515b3-3ef4-4f76-a8d8-e7008b5bbb79] No waiting events found dispatching network-vif-plugged-32c23c7b-6885-4276-bca1-7d8a8cb924c1 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:21:47 user nova-compute[72382]: WARNING nova.compute.manager [req-6ed94b64-085e-480c-8048-a53abb5fbb27 req-12dcd302-d091-422b-abfe-f3f737d5c2ed service nova] [instance: a33515b3-3ef4-4f76-a8d8-e7008b5bbb79] Received unexpected event network-vif-plugged-32c23c7b-6885-4276-bca1-7d8a8cb924c1 for instance with vm_state deleted and task_state None.
Aug 09 15:21:47 user nova-compute[72382]: DEBUG nova.compute.provider_tree [None req-2a8c56c2-001d-4694-92af-b5e3776e09c4 tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] Inventory has not changed in ProviderTree for provider: 7b15b0e5-df4d-49db-833b-2855d21d10ae {{(pid=72382) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 15:21:47 user nova-compute[72382]: DEBUG nova.scheduler.client.report [None req-2a8c56c2-001d-4694-92af-b5e3776e09c4 tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] Inventory has not changed for provider 7b15b0e5-df4d-49db-833b-2855d21d10ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72382) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 15:21:48 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-2a8c56c2-001d-4694-92af-b5e3776e09c4 tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.393s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:21:48 user nova-compute[72382]: INFO nova.scheduler.client.report [None req-2a8c56c2-001d-4694-92af-b5e3776e09c4 tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] Deleted allocations for instance a33515b3-3ef4-4f76-a8d8-e7008b5bbb79
Aug 09 15:21:48 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-2a8c56c2-001d-4694-92af-b5e3776e09c4 tempest-VolumesAdminNegativeTest-993781103 tempest-VolumesAdminNegativeTest-993781103-project-member] Lock "a33515b3-3ef4-4f76-a8d8-e7008b5bbb79" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.638s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:21:49 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:21:50 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._sync_power_states {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:21:50 user nova-compute[72382]: DEBUG nova.compute.manager [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Triggering sync for uuid f780040f-b789-4b72-8986-813c7b9fe4a6 {{(pid=72382) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 09 15:21:50 user nova-compute[72382]: DEBUG nova.compute.manager [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Triggering sync for uuid 777e49ea-b674-4c3f-9cdd-ac2113032632 {{(pid=72382) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 09 15:21:50 user nova-compute[72382]: DEBUG nova.compute.manager [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Triggering sync for uuid 44afd1bf-fa5c-4b3e-8752-b16853fef54e {{(pid=72382) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 09 15:21:50 user nova-compute[72382]: DEBUG nova.compute.manager [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Triggering sync for uuid 266be814-4a2b-4f8e-a0f6-e8821fdeb95d {{(pid=72382) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 09 15:21:50 user nova-compute[72382]: DEBUG nova.compute.manager [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Triggering sync for uuid c9766433-4c5a-40ed-a212-715a24f42b91 {{(pid=72382) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 09 15:21:50 user nova-compute[72382]: DEBUG nova.compute.manager [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Triggering sync for uuid 0f510d75-5d1e-4a5c-b38f-731c299f0f5a {{(pid=72382) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 09 15:21:50 user nova-compute[72382]: DEBUG nova.compute.manager [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Triggering sync for uuid 8aa35482-60b8-4185-b14d-a2667fd3b5b7 {{(pid=72382) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 09 15:21:50 user nova-compute[72382]: DEBUG nova.compute.manager [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Triggering sync for uuid cff2fb57-7d0b-4278-89ed-10a8ec5128ea {{(pid=72382) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 09 15:21:50 user nova-compute[72382]: DEBUG nova.compute.manager [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Triggering sync for uuid 83ebfda8-235d-4404-a973-991d75ae2bf6 {{(pid=72382) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 09 15:21:50 user nova-compute[72382]: DEBUG nova.compute.manager [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Triggering sync for uuid d061ee79-0755-44a7-9929-086c274c9064 {{(pid=72382) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 09 15:21:50 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Acquiring lock "f780040f-b789-4b72-8986-813c7b9fe4a6" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:21:50 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "f780040f-b789-4b72-8986-813c7b9fe4a6" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:21:50 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Acquiring lock "777e49ea-b674-4c3f-9cdd-ac2113032632" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:21:50 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "777e49ea-b674-4c3f-9cdd-ac2113032632" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:21:50 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Acquiring lock "44afd1bf-fa5c-4b3e-8752-b16853fef54e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:21:50 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "44afd1bf-fa5c-4b3e-8752-b16853fef54e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:21:50 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Acquiring lock "266be814-4a2b-4f8e-a0f6-e8821fdeb95d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:21:50 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "266be814-4a2b-4f8e-a0f6-e8821fdeb95d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:21:50 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Acquiring lock "c9766433-4c5a-40ed-a212-715a24f42b91" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:21:50 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "c9766433-4c5a-40ed-a212-715a24f42b91" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:21:50 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Acquiring lock "0f510d75-5d1e-4a5c-b38f-731c299f0f5a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:21:50 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "0f510d75-5d1e-4a5c-b38f-731c299f0f5a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:21:50 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Acquiring lock "8aa35482-60b8-4185-b14d-a2667fd3b5b7" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:21:50 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "8aa35482-60b8-4185-b14d-a2667fd3b5b7" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:21:50 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Acquiring lock "cff2fb57-7d0b-4278-89ed-10a8ec5128ea" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:21:50 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "cff2fb57-7d0b-4278-89ed-10a8ec5128ea" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:21:50 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Acquiring lock "83ebfda8-235d-4404-a973-991d75ae2bf6" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:21:50 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "83ebfda8-235d-4404-a973-991d75ae2bf6" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:21:50 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Acquiring lock "d061ee79-0755-44a7-9929-086c274c9064" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:21:50 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "d061ee79-0755-44a7-9929-086c274c9064" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:21:50 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "777e49ea-b674-4c3f-9cdd-ac2113032632" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.092s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:21:50 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "c9766433-4c5a-40ed-a212-715a24f42b91" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.093s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:21:50 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "266be814-4a2b-4f8e-a0f6-e8821fdeb95d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.097s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:21:50 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "cff2fb57-7d0b-4278-89ed-10a8ec5128ea" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.101s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:21:50 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "44afd1bf-fa5c-4b3e-8752-b16853fef54e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.122s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:21:50 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "8aa35482-60b8-4185-b14d-a2667fd3b5b7" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.118s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:21:50 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "0f510d75-5d1e-4a5c-b38f-731c299f0f5a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.125s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:21:50 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "f780040f-b789-4b72-8986-813c7b9fe4a6" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.136s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:21:50 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "d061ee79-0755-44a7-9929-086c274c9064" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.133s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:21:50 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "83ebfda8-235d-4404-a973-991d75ae2bf6" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.143s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:21:51 user nova-compute[72382]: INFO nova.compute.manager [None req-f48e80d1-e9bf-48f8-9b6f-7fb9f86d518e tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] [instance: 0f510d75-5d1e-4a5c-b38f-731c299f0f5a] Unrescuing
Aug 09 15:21:51 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-f48e80d1-e9bf-48f8-9b6f-7fb9f86d518e tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Acquiring lock "refresh_cache-0f510d75-5d1e-4a5c-b38f-731c299f0f5a" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 15:21:51 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-f48e80d1-e9bf-48f8-9b6f-7fb9f86d518e tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Acquired lock "refresh_cache-0f510d75-5d1e-4a5c-b38f-731c299f0f5a" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 15:21:51 user nova-compute[72382]: DEBUG nova.network.neutron [None req-f48e80d1-e9bf-48f8-9b6f-7fb9f86d518e tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] [instance: 0f510d75-5d1e-4a5c-b38f-731c299f0f5a] Building network info cache for instance {{(pid=72382) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 15:21:51 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:21:51 user nova-compute[72382]: DEBUG nova.network.neutron [None req-f48e80d1-e9bf-48f8-9b6f-7fb9f86d518e tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] [instance: 0f510d75-5d1e-4a5c-b38f-731c299f0f5a] Updating instance_info_cache with network_info: [{"id": "c67a8d45-c4ba-4302-940f-c05799ecc732", "address": "fa:16:3e:02:6d:5d", "network": {"id": "d47e3749-fdff-4112-bd72-69ca584efe1f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-302967634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "080d1ded4cd94e5083ee0b7e691b7363", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc67a8d45-c4", "ovs_interfaceid": "c67a8d45-c4ba-4302-940f-c05799ecc732", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:21:51 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-f48e80d1-e9bf-48f8-9b6f-7fb9f86d518e tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Releasing lock "refresh_cache-0f510d75-5d1e-4a5c-b38f-731c299f0f5a" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 15:21:51 user nova-compute[72382]: DEBUG nova.objects.instance [None req-f48e80d1-e9bf-48f8-9b6f-7fb9f86d518e tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Lazy-loading 'flavor' on Instance uuid 0f510d75-5d1e-4a5c-b38f-731c299f0f5a {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:21:51 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:21:51 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:21:52 user nova-compute[72382]: DEBUG nova.compute.manager [req-36c7c5ce-3bf2-4af5-820e-b1e8ed93aabd req-d04beb60-9ae5-4a16-aa02-43db41247ab0 service nova] [instance: 0f510d75-5d1e-4a5c-b38f-731c299f0f5a] Received event network-vif-unplugged-c67a8d45-c4ba-4302-940f-c05799ecc732 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:21:52 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-36c7c5ce-3bf2-4af5-820e-b1e8ed93aabd req-d04beb60-9ae5-4a16-aa02-43db41247ab0 service nova] Acquiring lock "0f510d75-5d1e-4a5c-b38f-731c299f0f5a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:21:52 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-36c7c5ce-3bf2-4af5-820e-b1e8ed93aabd req-d04beb60-9ae5-4a16-aa02-43db41247ab0 service nova] Lock "0f510d75-5d1e-4a5c-b38f-731c299f0f5a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:21:52 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-36c7c5ce-3bf2-4af5-820e-b1e8ed93aabd req-d04beb60-9ae5-4a16-aa02-43db41247ab0 service nova] Lock "0f510d75-5d1e-4a5c-b38f-731c299f0f5a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:21:52 user nova-compute[72382]: DEBUG nova.compute.manager [req-36c7c5ce-3bf2-4af5-820e-b1e8ed93aabd req-d04beb60-9ae5-4a16-aa02-43db41247ab0 service nova] [instance: 0f510d75-5d1e-4a5c-b38f-731c299f0f5a] No waiting events found dispatching network-vif-unplugged-c67a8d45-c4ba-4302-940f-c05799ecc732 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:21:52 user nova-compute[72382]: WARNING nova.compute.manager [req-36c7c5ce-3bf2-4af5-820e-b1e8ed93aabd req-d04beb60-9ae5-4a16-aa02-43db41247ab0 service nova] [instance: 0f510d75-5d1e-4a5c-b38f-731c299f0f5a] Received unexpected event network-vif-unplugged-c67a8d45-c4ba-4302-940f-c05799ecc732 for instance with vm_state rescued and task_state unrescuing.
Aug 09 15:21:52 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:21:52 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:21:52 user nova-compute[72382]: INFO nova.virt.libvirt.driver [-] [instance: 0f510d75-5d1e-4a5c-b38f-731c299f0f5a] Instance destroyed successfully.
Aug 09 15:21:54 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:21:54 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:21:54 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:21:54 user nova-compute[72382]: DEBUG nova.compute.manager [req-a57f1bc1-39bc-415c-a282-ee3b330a8aff req-c4cb29ee-b0a8-48d0-876c-e8bf1376a9d2 service nova] [instance: 0f510d75-5d1e-4a5c-b38f-731c299f0f5a] Received event network-vif-plugged-c67a8d45-c4ba-4302-940f-c05799ecc732 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:21:54 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-a57f1bc1-39bc-415c-a282-ee3b330a8aff req-c4cb29ee-b0a8-48d0-876c-e8bf1376a9d2 service nova] Acquiring lock "0f510d75-5d1e-4a5c-b38f-731c299f0f5a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:21:54 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-a57f1bc1-39bc-415c-a282-ee3b330a8aff req-c4cb29ee-b0a8-48d0-876c-e8bf1376a9d2 service nova] Lock "0f510d75-5d1e-4a5c-b38f-731c299f0f5a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:21:54 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-a57f1bc1-39bc-415c-a282-ee3b330a8aff req-c4cb29ee-b0a8-48d0-876c-e8bf1376a9d2 service nova] Lock "0f510d75-5d1e-4a5c-b38f-731c299f0f5a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:21:54 user nova-compute[72382]: DEBUG nova.compute.manager [req-a57f1bc1-39bc-415c-a282-ee3b330a8aff req-c4cb29ee-b0a8-48d0-876c-e8bf1376a9d2 service nova] [instance: 0f510d75-5d1e-4a5c-b38f-731c299f0f5a] No waiting events found dispatching network-vif-plugged-c67a8d45-c4ba-4302-940f-c05799ecc732 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:21:54 user nova-compute[72382]: WARNING nova.compute.manager [req-a57f1bc1-39bc-415c-a282-ee3b330a8aff req-c4cb29ee-b0a8-48d0-876c-e8bf1376a9d2 service nova] [instance: 0f510d75-5d1e-4a5c-b38f-731c299f0f5a] Received unexpected event network-vif-plugged-c67a8d45-c4ba-4302-940f-c05799ecc732 for instance with vm_state rescued and task_state unrescuing.
Aug 09 15:21:54 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:21:54 user nova-compute[72382]: INFO nova.compute.manager [None req-1e33f42f-e345-4648-867b-32d4a79abc37 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] [instance: 44afd1bf-fa5c-4b3e-8752-b16853fef54e] Unrescuing
Aug 09 15:21:54 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-1e33f42f-e345-4648-867b-32d4a79abc37 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Acquiring lock "refresh_cache-44afd1bf-fa5c-4b3e-8752-b16853fef54e" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 15:21:54 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-1e33f42f-e345-4648-867b-32d4a79abc37 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Acquired lock "refresh_cache-44afd1bf-fa5c-4b3e-8752-b16853fef54e" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 15:21:54 user nova-compute[72382]: DEBUG nova.network.neutron [None req-1e33f42f-e345-4648-867b-32d4a79abc37 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] [instance: 44afd1bf-fa5c-4b3e-8752-b16853fef54e] Building network info cache for instance {{(pid=72382) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 15:21:55 user nova-compute[72382]: DEBUG nova.network.neutron [None req-1e33f42f-e345-4648-867b-32d4a79abc37 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] [instance: 44afd1bf-fa5c-4b3e-8752-b16853fef54e] Updating instance_info_cache with network_info: [{"id": "2a1d4c60-bc2a-4530-b3bd-2a12ae2d2098", "address": "fa:16:3e:6c:50:29", "network": {"id": "46ef00c7-17ee-4e45-ba1d-dcc0a417ea85", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1360012261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "990ba791030940d38360af5879c853c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a1d4c60-bc", "ovs_interfaceid": "2a1d4c60-bc2a-4530-b3bd-2a12ae2d2098", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:21:55 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-1e33f42f-e345-4648-867b-32d4a79abc37 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Releasing lock "refresh_cache-44afd1bf-fa5c-4b3e-8752-b16853fef54e" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 15:21:55 user nova-compute[72382]: DEBUG nova.objects.instance [None req-1e33f42f-e345-4648-867b-32d4a79abc37 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Lazy-loading 'flavor' on Instance uuid 44afd1bf-fa5c-4b3e-8752-b16853fef54e {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:21:55 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:21:55 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:21:55 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:21:55 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:21:56 user nova-compute[72382]: DEBUG nova.compute.manager [req-b012dd9f-843c-4443-ba00-030bf0b8b401 req-d44ead18-93c8-4a2e-bb39-6a103f88d219 service nova] [instance: 0f510d75-5d1e-4a5c-b38f-731c299f0f5a] Received event network-vif-plugged-c67a8d45-c4ba-4302-940f-c05799ecc732 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:21:56 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-b012dd9f-843c-4443-ba00-030bf0b8b401 req-d44ead18-93c8-4a2e-bb39-6a103f88d219 service nova] Acquiring lock "0f510d75-5d1e-4a5c-b38f-731c299f0f5a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:21:56 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-b012dd9f-843c-4443-ba00-030bf0b8b401 req-d44ead18-93c8-4a2e-bb39-6a103f88d219 service nova] Lock "0f510d75-5d1e-4a5c-b38f-731c299f0f5a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:21:56 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-b012dd9f-843c-4443-ba00-030bf0b8b401 req-d44ead18-93c8-4a2e-bb39-6a103f88d219 service nova] Lock "0f510d75-5d1e-4a5c-b38f-731c299f0f5a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:21:56 user nova-compute[72382]: DEBUG nova.compute.manager [req-b012dd9f-843c-4443-ba00-030bf0b8b401 req-d44ead18-93c8-4a2e-bb39-6a103f88d219 service nova] [instance: 0f510d75-5d1e-4a5c-b38f-731c299f0f5a] No waiting events found dispatching network-vif-plugged-c67a8d45-c4ba-4302-940f-c05799ecc732 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:21:56 user nova-compute[72382]: WARNING nova.compute.manager [req-b012dd9f-843c-4443-ba00-030bf0b8b401 req-d44ead18-93c8-4a2e-bb39-6a103f88d219 service nova] [instance: 0f510d75-5d1e-4a5c-b38f-731c299f0f5a] Received unexpected event network-vif-plugged-c67a8d45-c4ba-4302-940f-c05799ecc732 for instance with vm_state rescued and task_state unrescuing.
Aug 09 15:21:56 user nova-compute[72382]: DEBUG nova.compute.manager [req-b012dd9f-843c-4443-ba00-030bf0b8b401 req-d44ead18-93c8-4a2e-bb39-6a103f88d219 service nova] [instance: 0f510d75-5d1e-4a5c-b38f-731c299f0f5a] Received event network-vif-plugged-c67a8d45-c4ba-4302-940f-c05799ecc732 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:21:56 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-b012dd9f-843c-4443-ba00-030bf0b8b401 req-d44ead18-93c8-4a2e-bb39-6a103f88d219 service nova] Acquiring lock "0f510d75-5d1e-4a5c-b38f-731c299f0f5a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:21:56 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-b012dd9f-843c-4443-ba00-030bf0b8b401 req-d44ead18-93c8-4a2e-bb39-6a103f88d219 service nova] Lock "0f510d75-5d1e-4a5c-b38f-731c299f0f5a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:21:56 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-b012dd9f-843c-4443-ba00-030bf0b8b401 req-d44ead18-93c8-4a2e-bb39-6a103f88d219 service nova] Lock "0f510d75-5d1e-4a5c-b38f-731c299f0f5a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:21:56 user nova-compute[72382]: DEBUG nova.compute.manager [req-b012dd9f-843c-4443-ba00-030bf0b8b401 req-d44ead18-93c8-4a2e-bb39-6a103f88d219 service nova] [instance: 0f510d75-5d1e-4a5c-b38f-731c299f0f5a] No waiting events found dispatching network-vif-plugged-c67a8d45-c4ba-4302-940f-c05799ecc732 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:21:56 user nova-compute[72382]: WARNING nova.compute.manager [req-b012dd9f-843c-4443-ba00-030bf0b8b401 req-d44ead18-93c8-4a2e-bb39-6a103f88d219 service nova] [instance: 0f510d75-5d1e-4a5c-b38f-731c299f0f5a] Received unexpected event network-vif-plugged-c67a8d45-c4ba-4302-940f-c05799ecc732 for instance with vm_state rescued and task_state unrescuing.
Aug 09 15:21:56 user nova-compute[72382]: DEBUG nova.compute.manager [req-b012dd9f-843c-4443-ba00-030bf0b8b401 req-d44ead18-93c8-4a2e-bb39-6a103f88d219 service nova] [instance: 44afd1bf-fa5c-4b3e-8752-b16853fef54e] Received event network-vif-unplugged-2a1d4c60-bc2a-4530-b3bd-2a12ae2d2098 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:21:56 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-b012dd9f-843c-4443-ba00-030bf0b8b401 req-d44ead18-93c8-4a2e-bb39-6a103f88d219 service nova] Acquiring lock "44afd1bf-fa5c-4b3e-8752-b16853fef54e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:21:56 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-b012dd9f-843c-4443-ba00-030bf0b8b401 req-d44ead18-93c8-4a2e-bb39-6a103f88d219 service nova] Lock "44afd1bf-fa5c-4b3e-8752-b16853fef54e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:21:56 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-b012dd9f-843c-4443-ba00-030bf0b8b401 req-d44ead18-93c8-4a2e-bb39-6a103f88d219 service nova] Lock "44afd1bf-fa5c-4b3e-8752-b16853fef54e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:21:56 user nova-compute[72382]: DEBUG nova.compute.manager [req-b012dd9f-843c-4443-ba00-030bf0b8b401 req-d44ead18-93c8-4a2e-bb39-6a103f88d219 service nova] [instance: 44afd1bf-fa5c-4b3e-8752-b16853fef54e] No waiting events found dispatching network-vif-unplugged-2a1d4c60-bc2a-4530-b3bd-2a12ae2d2098 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:21:56 user nova-compute[72382]: WARNING nova.compute.manager [req-b012dd9f-843c-4443-ba00-030bf0b8b401 req-d44ead18-93c8-4a2e-bb39-6a103f88d219 service nova] [instance: 44afd1bf-fa5c-4b3e-8752-b16853fef54e] Received unexpected event network-vif-unplugged-2a1d4c60-bc2a-4530-b3bd-2a12ae2d2098 for instance with vm_state rescued and task_state unrescuing.
Aug 09 15:21:56 user nova-compute[72382]: DEBUG nova.compute.manager [req-b012dd9f-843c-4443-ba00-030bf0b8b401 req-d44ead18-93c8-4a2e-bb39-6a103f88d219 service nova] [instance: 44afd1bf-fa5c-4b3e-8752-b16853fef54e] Received event network-vif-plugged-2a1d4c60-bc2a-4530-b3bd-2a12ae2d2098 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:21:56 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-b012dd9f-843c-4443-ba00-030bf0b8b401 req-d44ead18-93c8-4a2e-bb39-6a103f88d219 service nova] Acquiring lock "44afd1bf-fa5c-4b3e-8752-b16853fef54e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:21:56 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-b012dd9f-843c-4443-ba00-030bf0b8b401 req-d44ead18-93c8-4a2e-bb39-6a103f88d219 service nova] Lock "44afd1bf-fa5c-4b3e-8752-b16853fef54e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:21:56 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-b012dd9f-843c-4443-ba00-030bf0b8b401 req-d44ead18-93c8-4a2e-bb39-6a103f88d219 service nova] Lock "44afd1bf-fa5c-4b3e-8752-b16853fef54e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:21:56 user nova-compute[72382]: DEBUG nova.compute.manager [req-b012dd9f-843c-4443-ba00-030bf0b8b401 req-d44ead18-93c8-4a2e-bb39-6a103f88d219 service nova] [instance: 44afd1bf-fa5c-4b3e-8752-b16853fef54e] No waiting events found dispatching network-vif-plugged-2a1d4c60-bc2a-4530-b3bd-2a12ae2d2098 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:21:56 user nova-compute[72382]: WARNING nova.compute.manager [req-b012dd9f-843c-4443-ba00-030bf0b8b401 req-d44ead18-93c8-4a2e-bb39-6a103f88d219 service nova] [instance: 44afd1bf-fa5c-4b3e-8752-b16853fef54e] Received unexpected event network-vif-plugged-2a1d4c60-bc2a-4530-b3bd-2a12ae2d2098 for instance with vm_state rescued and task_state unrescuing.
Aug 09 15:21:56 user nova-compute[72382]: INFO nova.virt.libvirt.driver [-] [instance: 44afd1bf-fa5c-4b3e-8752-b16853fef54e] Instance destroyed successfully.
Aug 09 15:21:56 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:21:56 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Removed pending event for 0f510d75-5d1e-4a5c-b38f-731c299f0f5a due to event {{(pid=72382) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 09 15:21:56 user nova-compute[72382]: DEBUG nova.virt.driver [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Emitting event <LifecycleEvent: 1691594516.370807, 0f510d75-5d1e-4a5c-b38f-731c299f0f5a => Resumed> {{(pid=72382) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 15:21:56 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 0f510d75-5d1e-4a5c-b38f-731c299f0f5a] VM Resumed (Lifecycle Event)
Aug 09 15:21:56 user nova-compute[72382]: DEBUG nova.compute.manager [None req-f48e80d1-e9bf-48f8-9b6f-7fb9f86d518e tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] [instance: 0f510d75-5d1e-4a5c-b38f-731c299f0f5a] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:21:56 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 0f510d75-5d1e-4a5c-b38f-731c299f0f5a] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:21:56 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 0f510d75-5d1e-4a5c-b38f-731c299f0f5a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72382) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 15:21:56 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 0f510d75-5d1e-4a5c-b38f-731c299f0f5a] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 09 15:21:56 user nova-compute[72382]: DEBUG nova.virt.driver [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Emitting event <LifecycleEvent: 1691594516.3747575, 0f510d75-5d1e-4a5c-b38f-731c299f0f5a => Started> {{(pid=72382) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 15:21:56 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 0f510d75-5d1e-4a5c-b38f-731c299f0f5a] VM Started (Lifecycle Event)
Aug 09 15:21:56 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 0f510d75-5d1e-4a5c-b38f-731c299f0f5a] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:21:56 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 0f510d75-5d1e-4a5c-b38f-731c299f0f5a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72382) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 15:21:57 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:21:57 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:21:57 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:21:57 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:21:57 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:21:58 user nova-compute[72382]: DEBUG nova.compute.manager [req-2cd7c20c-85e5-4c1c-9fa8-067bb8291fbe req-b5421266-484c-477a-8ea0-1d9c1aaeed2b service nova] [instance: 44afd1bf-fa5c-4b3e-8752-b16853fef54e] Received event network-vif-plugged-2a1d4c60-bc2a-4530-b3bd-2a12ae2d2098 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:21:58 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-2cd7c20c-85e5-4c1c-9fa8-067bb8291fbe req-b5421266-484c-477a-8ea0-1d9c1aaeed2b service nova] Acquiring lock "44afd1bf-fa5c-4b3e-8752-b16853fef54e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:21:58 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-2cd7c20c-85e5-4c1c-9fa8-067bb8291fbe req-b5421266-484c-477a-8ea0-1d9c1aaeed2b service nova] Lock "44afd1bf-fa5c-4b3e-8752-b16853fef54e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:21:58 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-2cd7c20c-85e5-4c1c-9fa8-067bb8291fbe req-b5421266-484c-477a-8ea0-1d9c1aaeed2b service nova] Lock "44afd1bf-fa5c-4b3e-8752-b16853fef54e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:21:58 user nova-compute[72382]: DEBUG nova.compute.manager [req-2cd7c20c-85e5-4c1c-9fa8-067bb8291fbe req-b5421266-484c-477a-8ea0-1d9c1aaeed2b service nova] [instance: 44afd1bf-fa5c-4b3e-8752-b16853fef54e] No waiting events found dispatching network-vif-plugged-2a1d4c60-bc2a-4530-b3bd-2a12ae2d2098 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:21:58 user nova-compute[72382]: WARNING nova.compute.manager [req-2cd7c20c-85e5-4c1c-9fa8-067bb8291fbe req-b5421266-484c-477a-8ea0-1d9c1aaeed2b service nova] [instance: 44afd1bf-fa5c-4b3e-8752-b16853fef54e] Received unexpected event network-vif-plugged-2a1d4c60-bc2a-4530-b3bd-2a12ae2d2098 for instance with vm_state rescued and task_state unrescuing.
Aug 09 15:21:58 user nova-compute[72382]: DEBUG nova.compute.manager [req-2cd7c20c-85e5-4c1c-9fa8-067bb8291fbe req-b5421266-484c-477a-8ea0-1d9c1aaeed2b service nova] [instance: 44afd1bf-fa5c-4b3e-8752-b16853fef54e] Received event network-vif-plugged-2a1d4c60-bc2a-4530-b3bd-2a12ae2d2098 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:21:58 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-2cd7c20c-85e5-4c1c-9fa8-067bb8291fbe req-b5421266-484c-477a-8ea0-1d9c1aaeed2b service nova] Acquiring lock "44afd1bf-fa5c-4b3e-8752-b16853fef54e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:21:58 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-2cd7c20c-85e5-4c1c-9fa8-067bb8291fbe req-b5421266-484c-477a-8ea0-1d9c1aaeed2b service nova] Lock "44afd1bf-fa5c-4b3e-8752-b16853fef54e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:21:58 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-2cd7c20c-85e5-4c1c-9fa8-067bb8291fbe req-b5421266-484c-477a-8ea0-1d9c1aaeed2b service nova] Lock "44afd1bf-fa5c-4b3e-8752-b16853fef54e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:21:58 user nova-compute[72382]: DEBUG nova.compute.manager [req-2cd7c20c-85e5-4c1c-9fa8-067bb8291fbe req-b5421266-484c-477a-8ea0-1d9c1aaeed2b service nova] [instance: 44afd1bf-fa5c-4b3e-8752-b16853fef54e] No waiting events found dispatching network-vif-plugged-2a1d4c60-bc2a-4530-b3bd-2a12ae2d2098 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:21:58 user nova-compute[72382]: WARNING nova.compute.manager [req-2cd7c20c-85e5-4c1c-9fa8-067bb8291fbe req-b5421266-484c-477a-8ea0-1d9c1aaeed2b service nova] [instance: 44afd1bf-fa5c-4b3e-8752-b16853fef54e] Received unexpected event network-vif-plugged-2a1d4c60-bc2a-4530-b3bd-2a12ae2d2098 for instance with vm_state rescued and task_state unrescuing.
Aug 09 15:21:59 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:22:00 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Removed pending event for 44afd1bf-fa5c-4b3e-8752-b16853fef54e due to event {{(pid=72382) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 09 15:22:00 user nova-compute[72382]: DEBUG nova.virt.driver [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Emitting event <LifecycleEvent: 1691594520.088509, 44afd1bf-fa5c-4b3e-8752-b16853fef54e => Resumed> {{(pid=72382) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 15:22:00 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 44afd1bf-fa5c-4b3e-8752-b16853fef54e] VM Resumed (Lifecycle Event)
Aug 09 15:22:00 user nova-compute[72382]: DEBUG nova.compute.manager [None req-1e33f42f-e345-4648-867b-32d4a79abc37 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] [instance: 44afd1bf-fa5c-4b3e-8752-b16853fef54e] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:22:00 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 44afd1bf-fa5c-4b3e-8752-b16853fef54e] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:22:00 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 44afd1bf-fa5c-4b3e-8752-b16853fef54e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72382) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 15:22:00 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 44afd1bf-fa5c-4b3e-8752-b16853fef54e] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 09 15:22:00 user nova-compute[72382]: DEBUG nova.virt.driver [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Emitting event <LifecycleEvent: 1691594520.0890393, 44afd1bf-fa5c-4b3e-8752-b16853fef54e => Started> {{(pid=72382) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 15:22:00 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 44afd1bf-fa5c-4b3e-8752-b16853fef54e] VM Started (Lifecycle Event)
Aug 09 15:22:00 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 44afd1bf-fa5c-4b3e-8752-b16853fef54e] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:22:00 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 44afd1bf-fa5c-4b3e-8752-b16853fef54e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72382) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 15:22:01 user nova-compute[72382]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691594506.3260658, a33515b3-3ef4-4f76-a8d8-e7008b5bbb79 => Stopped> {{(pid=72382) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 15:22:01 user nova-compute[72382]: INFO nova.compute.manager [-] [instance: a33515b3-3ef4-4f76-a8d8-e7008b5bbb79] VM Stopped (Lifecycle Event)
Aug 09 15:22:01 user nova-compute[72382]: DEBUG nova.compute.manager [None req-adfcb39d-93a7-4f2c-933b-ac6162ad6ea5 None None] [instance: a33515b3-3ef4-4f76-a8d8-e7008b5bbb79] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:22:01 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:22:05 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:22:05 user nova-compute[72382]: DEBUG nova.compute.manager [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Starting heal instance info cache {{(pid=72382) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 15:22:05 user nova-compute[72382]: DEBUG nova.compute.manager [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Didn't find any instances for network info cache update. {{(pid=72382) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 09 15:22:05 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:22:05 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:22:05 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:22:05 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:22:05 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Auditing locally available compute resources for user (node: user) {{(pid=72382) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 15:22:06 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f780040f-b789-4b72-8986-813c7b9fe4a6/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:22:06 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f780040f-b789-4b72-8986-813c7b9fe4a6/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:22:06 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f780040f-b789-4b72-8986-813c7b9fe4a6/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:22:06 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:22:06 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f780040f-b789-4b72-8986-813c7b9fe4a6/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:22:06 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/266be814-4a2b-4f8e-a0f6-e8821fdeb95d/disk.rescue --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:22:06 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/266be814-4a2b-4f8e-a0f6-e8821fdeb95d/disk.rescue --force-share --output=json" returned: 0 in 0.133s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:22:06 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/266be814-4a2b-4f8e-a0f6-e8821fdeb95d/disk.rescue --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:22:06 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/266be814-4a2b-4f8e-a0f6-e8821fdeb95d/disk.rescue --force-share --output=json" returned: 0 in 0.129s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:22:06 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/266be814-4a2b-4f8e-a0f6-e8821fdeb95d/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:22:06 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/266be814-4a2b-4f8e-a0f6-e8821fdeb95d/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:22:06 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/266be814-4a2b-4f8e-a0f6-e8821fdeb95d/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:22:07 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/266be814-4a2b-4f8e-a0f6-e8821fdeb95d/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:22:07 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/777e49ea-b674-4c3f-9cdd-ac2113032632/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:22:07 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/777e49ea-b674-4c3f-9cdd-ac2113032632/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:22:07 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/777e49ea-b674-4c3f-9cdd-ac2113032632/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:22:07 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/777e49ea-b674-4c3f-9cdd-ac2113032632/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:22:07 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44afd1bf-fa5c-4b3e-8752-b16853fef54e/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:22:07 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44afd1bf-fa5c-4b3e-8752-b16853fef54e/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:22:07 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44afd1bf-fa5c-4b3e-8752-b16853fef54e/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:22:07 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44afd1bf-fa5c-4b3e-8752-b16853fef54e/disk --force-share --output=json" returned: 0 in 0.128s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:22:07 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72382) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 15:22:07 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72382) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 15:22:07 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8aa35482-60b8-4185-b14d-a2667fd3b5b7/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:22:07 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8aa35482-60b8-4185-b14d-a2667fd3b5b7/disk --force-share --output=json" returned: 0 in 0.128s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:22:07 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8aa35482-60b8-4185-b14d-a2667fd3b5b7/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:22:07 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8aa35482-60b8-4185-b14d-a2667fd3b5b7/disk --force-share --output=json" returned: 0 in 0.128s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:22:07 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9766433-4c5a-40ed-a212-715a24f42b91/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:22:08 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9766433-4c5a-40ed-a212-715a24f42b91/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:22:08 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9766433-4c5a-40ed-a212-715a24f42b91/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:22:08 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9766433-4c5a-40ed-a212-715a24f42b91/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:22:08 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72382) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 15:22:08 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d061ee79-0755-44a7-9929-086c274c9064/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:22:08 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d061ee79-0755-44a7-9929-086c274c9064/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:22:08 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d061ee79-0755-44a7-9929-086c274c9064/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:22:08 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d061ee79-0755-44a7-9929-086c274c9064/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:22:08 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=72382) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 15:22:08 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=72382) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 15:22:08 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=72382) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 15:22:09 user nova-compute[72382]: WARNING nova.virt.libvirt.driver [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 15:22:09 user nova-compute[72382]: WARNING nova.virt.libvirt.driver [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 15:22:09 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Hypervisor/Node resource view: name=user free_ram=7375MB free_disk=25.576034545898438GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72382) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 15:22:09 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:22:09 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:22:09 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance f780040f-b789-4b72-8986-813c7b9fe4a6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:22:09 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance 777e49ea-b674-4c3f-9cdd-ac2113032632 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:22:09 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance 44afd1bf-fa5c-4b3e-8752-b16853fef54e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:22:09 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance 266be814-4a2b-4f8e-a0f6-e8821fdeb95d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:22:09 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance 0f510d75-5d1e-4a5c-b38f-731c299f0f5a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:22:09 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance 8aa35482-60b8-4185-b14d-a2667fd3b5b7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:22:09 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance c9766433-4c5a-40ed-a212-715a24f42b91 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:22:09 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance cff2fb57-7d0b-4278-89ed-10a8ec5128ea actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:22:09 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance 83ebfda8-235d-4404-a973-991d75ae2bf6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:22:09 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance d061ee79-0755-44a7-9929-086c274c9064 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:22:09 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=72382) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 15:22:09 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=72382) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 15:22:09 user nova-compute[72382]: DEBUG nova.compute.provider_tree [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Inventory has not changed in ProviderTree for provider: 7b15b0e5-df4d-49db-833b-2855d21d10ae {{(pid=72382) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 15:22:09 user nova-compute[72382]: DEBUG nova.scheduler.client.report [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Inventory has not changed for provider 7b15b0e5-df4d-49db-833b-2855d21d10ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72382) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 15:22:09 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Compute_service record updated for user:user {{(pid=72382) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 15:22:09 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.529s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:22:10 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:22:10 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:22:10 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:22:10 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:22:10 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:22:10 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:22:10 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:22:10 user nova-compute[72382]: DEBUG nova.compute.manager [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72382) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 15:22:11 user nova-compute[72382]: DEBUG nova.compute.manager [req-293a7ebd-a728-4b19-a228-e5351810d256 req-4e79077a-38bb-4cdf-90a8-1413060c01db service nova] [instance: cff2fb57-7d0b-4278-89ed-10a8ec5128ea] Received event network-changed-477e93e2-c6aa-47e7-bed7-62b4bb29a9ea {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:22:11 user nova-compute[72382]: DEBUG nova.compute.manager [req-293a7ebd-a728-4b19-a228-e5351810d256 req-4e79077a-38bb-4cdf-90a8-1413060c01db service nova] [instance: cff2fb57-7d0b-4278-89ed-10a8ec5128ea] Refreshing instance network info cache due to event network-changed-477e93e2-c6aa-47e7-bed7-62b4bb29a9ea. {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 15:22:11 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-293a7ebd-a728-4b19-a228-e5351810d256 req-4e79077a-38bb-4cdf-90a8-1413060c01db service nova] Acquiring lock "refresh_cache-cff2fb57-7d0b-4278-89ed-10a8ec5128ea" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 15:22:11 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-293a7ebd-a728-4b19-a228-e5351810d256 req-4e79077a-38bb-4cdf-90a8-1413060c01db service nova] Acquired lock "refresh_cache-cff2fb57-7d0b-4278-89ed-10a8ec5128ea" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 15:22:11 user nova-compute[72382]: DEBUG nova.network.neutron [req-293a7ebd-a728-4b19-a228-e5351810d256 req-4e79077a-38bb-4cdf-90a8-1413060c01db service nova] [instance: cff2fb57-7d0b-4278-89ed-10a8ec5128ea] Refreshing network info cache for port 477e93e2-c6aa-47e7-bed7-62b4bb29a9ea {{(pid=72382) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 15:22:11 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:22:13 user nova-compute[72382]: DEBUG nova.network.neutron [req-293a7ebd-a728-4b19-a228-e5351810d256 req-4e79077a-38bb-4cdf-90a8-1413060c01db service nova] [instance: cff2fb57-7d0b-4278-89ed-10a8ec5128ea] Updated VIF entry in instance network info cache for port 477e93e2-c6aa-47e7-bed7-62b4bb29a9ea. {{(pid=72382) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 15:22:13 user nova-compute[72382]: DEBUG nova.network.neutron [req-293a7ebd-a728-4b19-a228-e5351810d256 req-4e79077a-38bb-4cdf-90a8-1413060c01db service nova] [instance: cff2fb57-7d0b-4278-89ed-10a8ec5128ea] Updating instance_info_cache with network_info: [{"id": "477e93e2-c6aa-47e7-bed7-62b4bb29a9ea", "address": "fa:16:3e:46:0b:d6", "network": {"id": "5f1aee90-5c93-4fe5-a140-7e3ac136489f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1100115541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42fe649aa7cd43678bd4f2cb24f45e18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap477e93e2-c6", "ovs_interfaceid": "477e93e2-c6aa-47e7-bed7-62b4bb29a9ea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "55cf98ab-8cd2-4704-971f-ee4ceebca331", "address": "fa:16:3e:8c:34:e0", "network": {"id": "dc656a4e-c46c-4821-b492-2376b82b26ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-2053726028", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "42fe649aa7cd43678bd4f2cb24f45e18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55cf98ab-8c", "ovs_interfaceid": "55cf98ab-8cd2-4704-971f-ee4ceebca331", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "baeec4fc-3670-49f3-b42c-aab5ea116f45", "address": "fa:16:3e:72:b4:02", "network": {"id": "dc656a4e-c46c-4821-b492-2376b82b26ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-2053726028", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.135", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "42fe649aa7cd43678bd4f2cb24f45e18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbaeec4fc-36", "ovs_interfaceid": "baeec4fc-3670-49f3-b42c-aab5ea116f45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "17d8899d-82c0-4a46-97de-31253f7d1b82", "address": "fa:16:3e:7b:f5:ee", "network": {"id": "dc656a4e-c46c-4821-b492-2376b82b26ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-2053726028", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.153", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "42fe649aa7cd43678bd4f2cb24f45e18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17d8899d-82", "ovs_interfaceid": "17d8899d-82c0-4a46-97de-31253f7d1b82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ce3acf5c-2e65-4650-aade-158b96a7d349", "address": "fa:16:3e:ff:b7:1e", "network": {"id": "dc656a4e-c46c-4821-b492-2376b82b26ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-2053726028", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.132", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "42fe649aa7cd43678bd4f2cb24f45e18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce3acf5c-2e", "ovs_interfaceid": "ce3acf5c-2e65-4650-aade-158b96a7d349", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "802211f2-fc95-4940-87bf-eb0658b56ff1", "address": "fa:16:3e:dd:68:92", "network": {"id": "c8d9a670-b921-4ea7-bc32-64ef779aa86c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1431242330", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "42fe649aa7cd43678bd4f2cb24f45e18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap802211f2-fc", "ovs_interfaceid": "802211f2-fc95-4940-87bf-eb0658b56ff1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bcf9d83a-a145-4d83-9df6-02eba42f64bf", "address": "fa:16:3e:98:67:3f", "network": {"id": "c8d9a670-b921-4ea7-bc32-64ef779aa86c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1431242330", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "42fe649aa7cd43678bd4f2cb24f45e18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcf9d83a-a1", "ovs_interfaceid": "bcf9d83a-a145-4d83-9df6-02eba42f64bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:22:13 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-293a7ebd-a728-4b19-a228-e5351810d256 req-4e79077a-38bb-4cdf-90a8-1413060c01db service nova] Releasing lock "refresh_cache-cff2fb57-7d0b-4278-89ed-10a8ec5128ea" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 15:22:14 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:22:14 user nova-compute[72382]: DEBUG nova.compute.manager [req-d5151001-0ffc-45cc-95cc-202eb983fc50 req-01d2108e-e82e-4a16-b442-fbae00ec7f36 service nova] [instance: 83ebfda8-235d-4404-a973-991d75ae2bf6] Received event network-changed-b2646c3a-cc2a-4782-a312-0582f2d377b1 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:22:14 user nova-compute[72382]: DEBUG nova.compute.manager [req-d5151001-0ffc-45cc-95cc-202eb983fc50 req-01d2108e-e82e-4a16-b442-fbae00ec7f36 service nova] [instance: 83ebfda8-235d-4404-a973-991d75ae2bf6] Refreshing instance network info cache due to event network-changed-b2646c3a-cc2a-4782-a312-0582f2d377b1. {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 15:22:14 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-d5151001-0ffc-45cc-95cc-202eb983fc50 req-01d2108e-e82e-4a16-b442-fbae00ec7f36 service nova] Acquiring lock "refresh_cache-83ebfda8-235d-4404-a973-991d75ae2bf6" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 15:22:14 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-d5151001-0ffc-45cc-95cc-202eb983fc50 req-01d2108e-e82e-4a16-b442-fbae00ec7f36 service nova] Acquired lock "refresh_cache-83ebfda8-235d-4404-a973-991d75ae2bf6" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 15:22:14 user nova-compute[72382]: DEBUG nova.network.neutron [req-d5151001-0ffc-45cc-95cc-202eb983fc50 req-01d2108e-e82e-4a16-b442-fbae00ec7f36 service nova] [instance: 83ebfda8-235d-4404-a973-991d75ae2bf6] Refreshing network info cache for port b2646c3a-cc2a-4782-a312-0582f2d377b1 {{(pid=72382) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 15:22:15 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-43064d7d-afca-4d1b-a704-4b98454e8ffb tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] Acquiring lock "cff2fb57-7d0b-4278-89ed-10a8ec5128ea" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:22:15 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-43064d7d-afca-4d1b-a704-4b98454e8ffb tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] Lock "cff2fb57-7d0b-4278-89ed-10a8ec5128ea" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:22:15 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-43064d7d-afca-4d1b-a704-4b98454e8ffb tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] Acquiring lock "cff2fb57-7d0b-4278-89ed-10a8ec5128ea-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:22:15 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-43064d7d-afca-4d1b-a704-4b98454e8ffb tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] Lock "cff2fb57-7d0b-4278-89ed-10a8ec5128ea-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:22:15 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-43064d7d-afca-4d1b-a704-4b98454e8ffb tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] Lock "cff2fb57-7d0b-4278-89ed-10a8ec5128ea-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:22:15 user nova-compute[72382]: INFO nova.compute.manager [None req-43064d7d-afca-4d1b-a704-4b98454e8ffb tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] [instance: cff2fb57-7d0b-4278-89ed-10a8ec5128ea] Terminating instance
Aug 09 15:22:15 user nova-compute[72382]: DEBUG nova.compute.manager [None req-43064d7d-afca-4d1b-a704-4b98454e8ffb tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] [instance: cff2fb57-7d0b-4278-89ed-10a8ec5128ea] Start destroying the instance on the hypervisor. {{(pid=72382) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 15:22:15 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:22:15 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:22:15 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:22:15 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:22:15 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:22:15 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:22:15 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:22:15 user nova-compute[72382]: DEBUG nova.compute.manager [req-5c757176-465c-4581-9ef3-9a54f6583f61 req-7bead04b-dd5b-4dbf-a5b9-db9ec895907d service nova] [instance: cff2fb57-7d0b-4278-89ed-10a8ec5128ea] Received event network-vif-unplugged-477e93e2-c6aa-47e7-bed7-62b4bb29a9ea {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:22:15 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-5c757176-465c-4581-9ef3-9a54f6583f61 req-7bead04b-dd5b-4dbf-a5b9-db9ec895907d service nova] Acquiring lock "cff2fb57-7d0b-4278-89ed-10a8ec5128ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:22:15 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-5c757176-465c-4581-9ef3-9a54f6583f61 req-7bead04b-dd5b-4dbf-a5b9-db9ec895907d service nova] Lock "cff2fb57-7d0b-4278-89ed-10a8ec5128ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:22:15 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-5c757176-465c-4581-9ef3-9a54f6583f61 req-7bead04b-dd5b-4dbf-a5b9-db9ec895907d service nova] Lock "cff2fb57-7d0b-4278-89ed-10a8ec5128ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:22:15 user nova-compute[72382]: DEBUG nova.compute.manager [req-5c757176-465c-4581-9ef3-9a54f6583f61 req-7bead04b-dd5b-4dbf-a5b9-db9ec895907d service nova] [instance: cff2fb57-7d0b-4278-89ed-10a8ec5128ea] No waiting events found dispatching network-vif-unplugged-477e93e2-c6aa-47e7-bed7-62b4bb29a9ea {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:22:15 user nova-compute[72382]: DEBUG nova.compute.manager [req-5c757176-465c-4581-9ef3-9a54f6583f61 req-7bead04b-dd5b-4dbf-a5b9-db9ec895907d service nova] [instance: cff2fb57-7d0b-4278-89ed-10a8ec5128ea] Received event network-vif-unplugged-477e93e2-c6aa-47e7-bed7-62b4bb29a9ea for instance with task_state deleting. {{(pid=72382) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 15:22:15 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:22:15 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:22:15 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:22:15 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:22:16 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:22:16 user nova-compute[72382]: INFO nova.compute.manager [None req-a96be5d9-2d97-44e6-b7d7-982c25f85e5b tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] [instance: 83ebfda8-235d-4404-a973-991d75ae2bf6] Rebuilding instance
Aug 09 15:22:16 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:22:16 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:22:16 user nova-compute[72382]: DEBUG nova.objects.instance [None req-a96be5d9-2d97-44e6-b7d7-982c25f85e5b tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] Lazy-loading 'trusted_certs' on Instance uuid 83ebfda8-235d-4404-a973-991d75ae2bf6 {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:22:16 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:22:16 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:22:16 user nova-compute[72382]: DEBUG nova.compute.manager [None req-a96be5d9-2d97-44e6-b7d7-982c25f85e5b tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] [instance: 83ebfda8-235d-4404-a973-991d75ae2bf6] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:22:16 user nova-compute[72382]: DEBUG nova.network.neutron [req-d5151001-0ffc-45cc-95cc-202eb983fc50 req-01d2108e-e82e-4a16-b442-fbae00ec7f36 service nova] [instance: 83ebfda8-235d-4404-a973-991d75ae2bf6] Updated VIF entry in instance network info cache for port b2646c3a-cc2a-4782-a312-0582f2d377b1. {{(pid=72382) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 15:22:16 user nova-compute[72382]: DEBUG nova.network.neutron [req-d5151001-0ffc-45cc-95cc-202eb983fc50 req-01d2108e-e82e-4a16-b442-fbae00ec7f36 service nova] [instance: 83ebfda8-235d-4404-a973-991d75ae2bf6] Updating instance_info_cache with network_info: [{"id": "b2646c3a-cc2a-4782-a312-0582f2d377b1", "address": "fa:16:3e:01:06:06", "network": {"id": "2d5fadd3-a58b-4e71-971d-fa94edf0897d", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-6415310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.176", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06b73f81b4814b6f86017c2c27f8762c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2646c3a-cc", "ovs_interfaceid": "b2646c3a-cc2a-4782-a312-0582f2d377b1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:22:16 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-d5151001-0ffc-45cc-95cc-202eb983fc50 req-01d2108e-e82e-4a16-b442-fbae00ec7f36 service nova] Releasing lock "refresh_cache-83ebfda8-235d-4404-a973-991d75ae2bf6" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 15:22:16 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:22:16 user nova-compute[72382]: DEBUG nova.objects.instance [None req-a96be5d9-2d97-44e6-b7d7-982c25f85e5b tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] Lazy-loading 'pci_requests' on Instance uuid 83ebfda8-235d-4404-a973-991d75ae2bf6 {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:22:16 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:22:16 user nova-compute[72382]: DEBUG nova.objects.instance [None req-a96be5d9-2d97-44e6-b7d7-982c25f85e5b tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] Lazy-loading 'pci_devices' on Instance uuid 83ebfda8-235d-4404-a973-991d75ae2bf6 {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:22:16 user nova-compute[72382]: DEBUG nova.objects.instance [None req-a96be5d9-2d97-44e6-b7d7-982c25f85e5b tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] Lazy-loading 'resources' on Instance uuid 83ebfda8-235d-4404-a973-991d75ae2bf6 {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:22:16 user nova-compute[72382]: DEBUG nova.objects.instance [None req-a96be5d9-2d97-44e6-b7d7-982c25f85e5b tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] Lazy-loading 'migration_context' on Instance uuid 83ebfda8-235d-4404-a973-991d75ae2bf6 {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:22:16 user nova-compute[72382]: DEBUG nova.objects.instance [None req-a96be5d9-2d97-44e6-b7d7-982c25f85e5b tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] [instance: 83ebfda8-235d-4404-a973-991d75ae2bf6] Trying to apply a migration context that does not seem to be set for this instance {{(pid=72382) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Aug 09 15:22:16 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:22:16 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:22:16 user nova-compute[72382]: DEBUG nova.compute.manager [req-67f0469d-ed42-4de5-ae62-8cd858f8d8de req-0ebc3af0-cc95-4976-b0f9-6b0c5c350c2a service nova] [instance: cff2fb57-7d0b-4278-89ed-10a8ec5128ea] Received event network-vif-unplugged-55cf98ab-8cd2-4704-971f-ee4ceebca331 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:22:16 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-67f0469d-ed42-4de5-ae62-8cd858f8d8de req-0ebc3af0-cc95-4976-b0f9-6b0c5c350c2a service nova] Acquiring lock "cff2fb57-7d0b-4278-89ed-10a8ec5128ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:22:16 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-67f0469d-ed42-4de5-ae62-8cd858f8d8de req-0ebc3af0-cc95-4976-b0f9-6b0c5c350c2a service nova] Lock "cff2fb57-7d0b-4278-89ed-10a8ec5128ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:22:16 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-67f0469d-ed42-4de5-ae62-8cd858f8d8de req-0ebc3af0-cc95-4976-b0f9-6b0c5c350c2a service nova] Lock "cff2fb57-7d0b-4278-89ed-10a8ec5128ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:22:16 user nova-compute[72382]: DEBUG nova.compute.manager [req-67f0469d-ed42-4de5-ae62-8cd858f8d8de req-0ebc3af0-cc95-4976-b0f9-6b0c5c350c2a service nova] [instance: cff2fb57-7d0b-4278-89ed-10a8ec5128ea] No waiting events found dispatching network-vif-unplugged-55cf98ab-8cd2-4704-971f-ee4ceebca331 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:22:16 user nova-compute[72382]: DEBUG nova.compute.manager [req-67f0469d-ed42-4de5-ae62-8cd858f8d8de req-0ebc3af0-cc95-4976-b0f9-6b0c5c350c2a service nova] [instance: cff2fb57-7d0b-4278-89ed-10a8ec5128ea] Received event network-vif-unplugged-55cf98ab-8cd2-4704-971f-ee4ceebca331 for instance with task_state deleting. {{(pid=72382) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 15:22:16 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:22:16 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:22:16 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:22:16 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:22:16 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:22:16 user nova-compute[72382]: DEBUG nova.compute.manager [req-77663335-be25-4ab8-bce5-fc1ed9b9fa03 req-913fa205-e271-4c26-afe6-bf82d5b724a1 service nova] [instance: cff2fb57-7d0b-4278-89ed-10a8ec5128ea] Received event network-vif-unplugged-17d8899d-82c0-4a46-97de-31253f7d1b82 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:22:16 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-77663335-be25-4ab8-bce5-fc1ed9b9fa03 req-913fa205-e271-4c26-afe6-bf82d5b724a1 service nova] Acquiring lock "cff2fb57-7d0b-4278-89ed-10a8ec5128ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:22:16 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-77663335-be25-4ab8-bce5-fc1ed9b9fa03 req-913fa205-e271-4c26-afe6-bf82d5b724a1 service nova] Lock "cff2fb57-7d0b-4278-89ed-10a8ec5128ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:22:16 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-77663335-be25-4ab8-bce5-fc1ed9b9fa03 req-913fa205-e271-4c26-afe6-bf82d5b724a1 service nova] Lock "cff2fb57-7d0b-4278-89ed-10a8ec5128ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:22:16 user nova-compute[72382]: DEBUG nova.compute.manager [req-77663335-be25-4ab8-bce5-fc1ed9b9fa03 req-913fa205-e271-4c26-afe6-bf82d5b724a1 service nova] [instance: cff2fb57-7d0b-4278-89ed-10a8ec5128ea] No waiting events found dispatching network-vif-unplugged-17d8899d-82c0-4a46-97de-31253f7d1b82 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:22:16 user nova-compute[72382]: DEBUG nova.compute.manager [req-77663335-be25-4ab8-bce5-fc1ed9b9fa03 req-913fa205-e271-4c26-afe6-bf82d5b724a1 service nova] [instance: cff2fb57-7d0b-4278-89ed-10a8ec5128ea] Received event network-vif-unplugged-17d8899d-82c0-4a46-97de-31253f7d1b82 for instance with task_state deleting. {{(pid=72382) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 15:22:16 user nova-compute[72382]: DEBUG nova.compute.manager [req-77663335-be25-4ab8-bce5-fc1ed9b9fa03 req-913fa205-e271-4c26-afe6-bf82d5b724a1 service nova] [instance: cff2fb57-7d0b-4278-89ed-10a8ec5128ea] Received event network-vif-plugged-17d8899d-82c0-4a46-97de-31253f7d1b82 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:22:16 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-77663335-be25-4ab8-bce5-fc1ed9b9fa03 req-913fa205-e271-4c26-afe6-bf82d5b724a1 service nova] Acquiring lock "cff2fb57-7d0b-4278-89ed-10a8ec5128ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:22:16 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-77663335-be25-4ab8-bce5-fc1ed9b9fa03 req-913fa205-e271-4c26-afe6-bf82d5b724a1 service nova] Lock "cff2fb57-7d0b-4278-89ed-10a8ec5128ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:22:16 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-77663335-be25-4ab8-bce5-fc1ed9b9fa03 req-913fa205-e271-4c26-afe6-bf82d5b724a1 service nova] Lock "cff2fb57-7d0b-4278-89ed-10a8ec5128ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:22:16 user nova-compute[72382]: DEBUG nova.compute.manager [req-77663335-be25-4ab8-bce5-fc1ed9b9fa03 req-913fa205-e271-4c26-afe6-bf82d5b724a1 service nova] [instance: cff2fb57-7d0b-4278-89ed-10a8ec5128ea] No waiting events found dispatching network-vif-plugged-17d8899d-82c0-4a46-97de-31253f7d1b82 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:22:16 user nova-compute[72382]: WARNING nova.compute.manager [req-77663335-be25-4ab8-bce5-fc1ed9b9fa03 req-913fa205-e271-4c26-afe6-bf82d5b724a1 service nova] [instance: cff2fb57-7d0b-4278-89ed-10a8ec5128ea] Received unexpected event network-vif-plugged-17d8899d-82c0-4a46-97de-31253f7d1b82 for instance with vm_state active and task_state deleting.
Aug 09 15:22:16 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:22:17 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:22:17 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:22:17 user nova-compute[72382]: INFO nova.virt.libvirt.driver [-] [instance: cff2fb57-7d0b-4278-89ed-10a8ec5128ea] Instance destroyed successfully.
Aug 09 15:22:17 user nova-compute[72382]: DEBUG nova.objects.instance [None req-43064d7d-afca-4d1b-a704-4b98454e8ffb tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] Lazy-loading 'resources' on Instance uuid cff2fb57-7d0b-4278-89ed-10a8ec5128ea {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:22:17 user nova-compute[72382]: INFO nova.virt.libvirt.driver [-] [instance: 83ebfda8-235d-4404-a973-991d75ae2bf6] Instance destroyed successfully.
Aug 09 15:22:17 user nova-compute[72382]: DEBUG nova.virt.libvirt.vif [None req-43064d7d-afca-4d1b-a704-4b98454e8ffb tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T15:20:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-169397074',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-169397074',id=17,image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNRMrYzvK3pYJ1FJMjc+V1i2P1GCZ7pr4peXof/MmhII+4Xmj4q6cN16NSsZ2VBvvUMajqTcHDJ4oijFZtGUhO6P/PbviQhdpIFcs92gxfNJp5GkGgqfjd5oki77f6xzQw==',key_name='tempest-keypair-889744656',keypairs=<?>,launch_index=0,launched_at=2023-08-09T15:21:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='42fe649aa7cd43678bd4f2cb24f45e18',ramdisk_id='',reservation_id='r-z007s7m7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1511835318',owner_user_name='tempest-TaggedBootDevicesTest_v242-1511835318-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T15:21:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='551eba2d528148b4b3b266f3dfb4a190',uuid=cff2fb57-7d0b-4278-89ed-10a8ec5128ea,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "477e93e2-c6aa-47e7-bed7-62b4bb29a9ea", "address": "fa:16:3e:46:0b:d6", "network": {"id": "5f1aee90-5c93-4fe5-a140-7e3ac136489f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1100115541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42fe649aa7cd43678bd4f2cb24f45e18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap477e93e2-c6", "ovs_interfaceid": "477e93e2-c6aa-47e7-bed7-62b4bb29a9ea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 15:22:17 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-43064d7d-afca-4d1b-a704-4b98454e8ffb tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] Converting VIF {"id": "477e93e2-c6aa-47e7-bed7-62b4bb29a9ea", "address": "fa:16:3e:46:0b:d6", "network": {"id": "5f1aee90-5c93-4fe5-a140-7e3ac136489f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1100115541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42fe649aa7cd43678bd4f2cb24f45e18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap477e93e2-c6", "ovs_interfaceid": "477e93e2-c6aa-47e7-bed7-62b4bb29a9ea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 15:22:17 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-43064d7d-afca-4d1b-a704-4b98454e8ffb tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:46:0b:d6,bridge_name='br-int',has_traffic_filtering=True,id=477e93e2-c6aa-47e7-bed7-62b4bb29a9ea,network=Network(5f1aee90-5c93-4fe5-a140-7e3ac136489f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap477e93e2-c6') {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 15:22:17 user nova-compute[72382]: DEBUG os_vif [None req-43064d7d-afca-4d1b-a704-4b98454e8ffb tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:46:0b:d6,bridge_name='br-int',has_traffic_filtering=True,id=477e93e2-c6aa-47e7-bed7-62b4bb29a9ea,network=Network(5f1aee90-5c93-4fe5-a140-7e3ac136489f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap477e93e2-c6') {{(pid=72382) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 15:22:17 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:22:17 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap477e93e2-c6, bridge=br-int, if_exists=True) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:22:17 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:22:17 user nova-compute[72382]: INFO nova.virt.libvirt.driver [-] [instance: 83ebfda8-235d-4404-a973-991d75ae2bf6] Instance destroyed successfully.
Aug 09 15:22:17 user nova-compute[72382]: DEBUG nova.virt.libvirt.vif [None req-a96be5d9-2d97-44e6-b7d7-982c25f85e5b tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T15:20:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1408291636',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1037132086',id=18,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK/8JZBAyiCRHjLU+07gy/t2h+p3lkIQbl96NVsR2p9wGaw/Fvc6SNhI+niTOYcEyNFmbQHRmczVv3rBDNqLPSp2H/dP3kVtyEs6hP+i37003AjknP2hCvSl6DqRbqcyoQ==',key_name='tempest-keypair-1733291193',keypairs=<?>,launch_index=0,launched_at=2023-08-09T15:20:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='06b73f81b4814b6f86017c2c27f8762c',ramdisk_id='',reservation_id='r-ndge7mr0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1877173112',owner_user_name='tempest-ServerActionsV293TestJSON-1877173112-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T15:22:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='73fe18c52fef46869d80a266455681f8',uuid=83ebfda8-235d-4404-a973-991d75ae2bf6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b2646c3a-cc2a-4782-a312-0582f2d377b1", "address": "fa:16:3e:01:06:06", "network": {"id": "2d5fadd3-a58b-4e71-971d-fa94edf0897d", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-6415310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06b73f81b4814b6f86017c2c27f8762c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2646c3a-cc", "ovs_interfaceid": "b2646c3a-cc2a-4782-a312-0582f2d377b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 15:22:17 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-a96be5d9-2d97-44e6-b7d7-982c25f85e5b tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] Converting VIF {"id": "b2646c3a-cc2a-4782-a312-0582f2d377b1", "address": "fa:16:3e:01:06:06", "network": {"id": "2d5fadd3-a58b-4e71-971d-fa94edf0897d", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-6415310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06b73f81b4814b6f86017c2c27f8762c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2646c3a-cc", "ovs_interfaceid": "b2646c3a-cc2a-4782-a312-0582f2d377b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 15:22:17 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-a96be5d9-2d97-44e6-b7d7-982c25f85e5b tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:01:06:06,bridge_name='br-int',has_traffic_filtering=True,id=b2646c3a-cc2a-4782-a312-0582f2d377b1,network=Network(2d5fadd3-a58b-4e71-971d-fa94edf0897d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2646c3a-cc') {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 15:22:17 user nova-compute[72382]: DEBUG os_vif [None req-a96be5d9-2d97-44e6-b7d7-982c25f85e5b tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:01:06:06,bridge_name='br-int',has_traffic_filtering=True,id=b2646c3a-cc2a-4782-a312-0582f2d377b1,network=Network(2d5fadd3-a58b-4e71-971d-fa94edf0897d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2646c3a-cc') {{(pid=72382) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 15:22:17 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:22:17 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:22:17 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb2646c3a-cc, bridge=br-int, if_exists=True) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:22:17 user nova-compute[72382]: INFO os_vif [None req-43064d7d-afca-4d1b-a704-4b98454e8ffb tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:46:0b:d6,bridge_name='br-int',has_traffic_filtering=True,id=477e93e2-c6aa-47e7-bed7-62b4bb29a9ea,network=Network(5f1aee90-5c93-4fe5-a140-7e3ac136489f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap477e93e2-c6')
Aug 09 15:22:17 user nova-compute[72382]: DEBUG nova.virt.libvirt.vif [None req-43064d7d-afca-4d1b-a704-4b98454e8ffb tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T15:20:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-169397074',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-169397074',id=17,image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNRMrYzvK3pYJ1FJMjc+V1i2P1GCZ7pr4peXof/MmhII+4Xmj4q6cN16NSsZ2VBvvUMajqTcHDJ4oijFZtGUhO6P/PbviQhdpIFcs92gxfNJp5GkGgqfjd5oki77f6xzQw==',key_name='tempest-keypair-889744656',keypairs=<?>,launch_index=0,launched_at=2023-08-09T15:21:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='42fe649aa7cd43678bd4f2cb24f45e18',ramdisk_id='',reservation_id='r-z007s7m7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1511835318',owner_user_name='tempest-TaggedBootDevicesTest_v242-1511835318-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T15:21:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='551eba2d528148b4b3b266f3dfb4a190',uuid=cff2fb57-7d0b-4278-89ed-10a8ec5128ea,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "55cf98ab-8cd2-4704-971f-ee4ceebca331", "address": "fa:16:3e:8c:34:e0", "network": {"id": "dc656a4e-c46c-4821-b492-2376b82b26ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-2053726028", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "42fe649aa7cd43678bd4f2cb24f45e18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55cf98ab-8c", "ovs_interfaceid": "55cf98ab-8cd2-4704-971f-ee4ceebca331", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72382) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 15:22:17 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-43064d7d-afca-4d1b-a704-4b98454e8ffb tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] Converting VIF {"id": "55cf98ab-8cd2-4704-971f-ee4ceebca331", "address": "fa:16:3e:8c:34:e0", "network": {"id": "dc656a4e-c46c-4821-b492-2376b82b26ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-2053726028", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "42fe649aa7cd43678bd4f2cb24f45e18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55cf98ab-8c", "ovs_interfaceid": "55cf98ab-8cd2-4704-971f-ee4ceebca331", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 15:22:17 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-43064d7d-afca-4d1b-a704-4b98454e8ffb tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8c:34:e0,bridge_name='br-int',has_traffic_filtering=True,id=55cf98ab-8cd2-4704-971f-ee4ceebca331,network=Network(dc656a4e-c46c-4821-b492-2376b82b26ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap55cf98ab-8c') {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 15:22:17 user nova-compute[72382]: DEBUG os_vif [None req-43064d7d-afca-4d1b-a704-4b98454e8ffb tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:34:e0,bridge_name='br-int',has_traffic_filtering=True,id=55cf98ab-8cd2-4704-971f-ee4ceebca331,network=Network(dc656a4e-c46c-4821-b492-2376b82b26ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap55cf98ab-8c') {{(pid=72382) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 15:22:17 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:22:17 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:22:17 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:22:17 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap55cf98ab-8c, bridge=br-int, if_exists=True) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:22:17 user nova-compute[72382]: INFO os_vif [None req-a96be5d9-2d97-44e6-b7d7-982c25f85e5b tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:01:06:06,bridge_name='br-int',has_traffic_filtering=True,id=b2646c3a-cc2a-4782-a312-0582f2d377b1,network=Network(2d5fadd3-a58b-4e71-971d-fa94edf0897d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2646c3a-cc')
Aug 09 15:22:17 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:22:17 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a96be5d9-2d97-44e6-b7d7-982c25f85e5b tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] [instance: 83ebfda8-235d-4404-a973-991d75ae2bf6] calling os-brick to detach iSCSI Volume {{(pid=72382) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 15:22:17 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-a96be5d9-2d97-44e6-b7d7-982c25f85e5b tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2a0c768340>, {'target_iqns': ['iqn.2010-10.org.openstack:1cd86701-a303-4744-bf0c-31b5314bb87d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DtKCGmgQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 15:22:17 user nova-compute[72382]: WARNING os_brick.initiator.connectors.base [None req-a96be5d9-2d97-44e6-b7d7-982c25f85e5b tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 09 15:22:17 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-a96be5d9-2d97-44e6-b7d7-982c25f85e5b tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 15:22:17 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-a96be5d9-2d97-44e6-b7d7-982c25f85e5b tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 15:22:17 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-a96be5d9-2d97-44e6-b7d7-982c25f85e5b tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1cd86701-a303-4744-bf0c-31b5314bb87d', 0)] {{(pid=72382) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 15:22:17 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:22:17 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:22:17 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d740b0d-b14c-4095-a440-d73738a97371]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:184b0159-3cae-4d79-86b3-26a58437eb09\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1c6be653-7ab8-4b40-9e28-43c1eca5e016\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1cd86701-a303-4744-bf0c-31b5314bb87d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e8bad821-ddd1-4287-806d-78ffdc34fa68\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fb47e85c-aaa9-4165-8be3-125572b68a87\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:22:17 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:22:17 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:22:17 user nova-compute[72382]: INFO os_vif [None req-43064d7d-afca-4d1b-a704-4b98454e8ffb tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:34:e0,bridge_name='br-int',has_traffic_filtering=True,id=55cf98ab-8cd2-4704-971f-ee4ceebca331,network=Network(dc656a4e-c46c-4821-b492-2376b82b26ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap55cf98ab-8c')
Aug 09 15:22:17 user nova-compute[72382]: DEBUG nova.virt.libvirt.vif [None req-43064d7d-afca-4d1b-a704-4b98454e8ffb tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T15:20:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-169397074',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-169397074',id=17,image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNRMrYzvK3pYJ1FJMjc+V1i2P1GCZ7pr4peXof/MmhII+4Xmj4q6cN16NSsZ2VBvvUMajqTcHDJ4oijFZtGUhO6P/PbviQhdpIFcs92gxfNJp5GkGgqfjd5oki77f6xzQw==',key_name='tempest-keypair-889744656',keypairs=<?>,launch_index=0,launched_at=2023-08-09T15:21:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='42fe649aa7cd43678bd4f2cb24f45e18',ramdisk_id='',reservation_id='r-z007s7m7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1511835318',owner_user_name='tempest-TaggedBootDevicesTest_v242-1511835318-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T15:21:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='551eba2d528148b4b3b266f3dfb4a190',uuid=cff2fb57-7d0b-4278-89ed-10a8ec5128ea,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "baeec4fc-3670-49f3-b42c-aab5ea116f45", "address": "fa:16:3e:72:b4:02", "network": {"id": "dc656a4e-c46c-4821-b492-2376b82b26ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-2053726028", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.135", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "42fe649aa7cd43678bd4f2cb24f45e18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbaeec4fc-36", "ovs_interfaceid": "baeec4fc-3670-49f3-b42c-aab5ea116f45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72382) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 15:22:17 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-43064d7d-afca-4d1b-a704-4b98454e8ffb tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] Converting VIF {"id": "baeec4fc-3670-49f3-b42c-aab5ea116f45", "address": "fa:16:3e:72:b4:02", "network": {"id": "dc656a4e-c46c-4821-b492-2376b82b26ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-2053726028", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.135", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "42fe649aa7cd43678bd4f2cb24f45e18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbaeec4fc-36", "ovs_interfaceid": "baeec4fc-3670-49f3-b42c-aab5ea116f45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 15:22:17 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-43064d7d-afca-4d1b-a704-4b98454e8ffb tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:72:b4:02,bridge_name='br-int',has_traffic_filtering=True,id=baeec4fc-3670-49f3-b42c-aab5ea116f45,network=Network(dc656a4e-c46c-4821-b492-2376b82b26ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapbaeec4fc-36') {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 15:22:17 user nova-compute[72382]: DEBUG os_vif [None req-43064d7d-afca-4d1b-a704-4b98454e8ffb tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:b4:02,bridge_name='br-int',has_traffic_filtering=True,id=baeec4fc-3670-49f3-b42c-aab5ea116f45,network=Network(dc656a4e-c46c-4821-b492-2376b82b26ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapbaeec4fc-36') {{(pid=72382) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 15:22:17 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:22:17 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbaeec4fc-36, bridge=br-int, if_exists=True) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:22:17 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:22:17 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[75fa41bc-0efb-4c8f-9118-25a2e7f97c97]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cd86701-a303-4744-bf0c-31b5314bb87d (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8bad821-ddd1-4287-806d-78ffdc34fa68 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:184b0159-3cae-4d79-86b3-26a58437eb09 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c6be653-7ab8-4b40-9e28-43c1eca5e016 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb47e85c-aaa9-4165-8be3-125572b68a87 (non-flash)\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:22:17 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-a96be5d9-2d97-44e6-b7d7-982c25f85e5b tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)
Aug 09 15:22:17 user nova-compute[72382]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cd86701-a303-4744-bf0c-31b5314bb87d (non-flash)
Aug 09 15:22:17 user nova-compute[72382]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8bad821-ddd1-4287-806d-78ffdc34fa68 (non-flash)
Aug 09 15:22:17 user nova-compute[72382]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:184b0159-3cae-4d79-86b3-26a58437eb09 (non-flash)
Aug 09 15:22:17 user nova-compute[72382]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c6be653-7ab8-4b40-9e28-43c1eca5e016 (non-flash)
Aug 09 15:22:17 user nova-compute[72382]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb47e85c-aaa9-4165-8be3-125572b68a87 (non-flash)
Aug 09 15:22:17 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 15:22:17 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-a96be5d9-2d97-44e6-b7d7-982c25f85e5b tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)
Aug 09 15:22:17 user nova-compute[72382]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cd86701-a303-4744-bf0c-31b5314bb87d (non-flash)
Aug 09 15:22:17 user nova-compute[72382]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8bad821-ddd1-4287-806d-78ffdc34fa68 (non-flash)
Aug 09 15:22:17 user nova-compute[72382]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:184b0159-3cae-4d79-86b3-26a58437eb09 (non-flash)
Aug 09 15:22:17 user nova-compute[72382]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c6be653-7ab8-4b40-9e28-43c1eca5e016 (non-flash)
Aug 09 15:22:17 user nova-compute[72382]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb47e85c-aaa9-4165-8be3-125572b68a87 (non-flash)
Aug 09 15:22:17 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 15:22:17 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-a96be5d9-2d97-44e6-b7d7-982c25f85e5b tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2a0c737490>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1cd86701-a303-4744-bf0c-31b5314bb87d'): ({'sdc'}, set())}) {{(pid=72382) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 15:22:17 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-a96be5d9-2d97-44e6-b7d7-982c25f85e5b tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] Removing single pathed devices sdc {{(pid=72382) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 15:22:17 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:22:17 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:22:17 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:22:17 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:22:17 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7600d31-bf79-465e-bcca-2f815cf58016]: (4, ('path checker states:\nup                  5\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:22:17 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:22:17 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:22:17 user nova-compute[72382]: INFO os_vif [None req-43064d7d-afca-4d1b-a704-4b98454e8ffb tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:b4:02,bridge_name='br-int',has_traffic_filtering=True,id=baeec4fc-3670-49f3-b42c-aab5ea116f45,network=Network(dc656a4e-c46c-4821-b492-2376b82b26ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapbaeec4fc-36')
Aug 09 15:22:17 user nova-compute[72382]: DEBUG nova.virt.libvirt.vif [None req-43064d7d-afca-4d1b-a704-4b98454e8ffb tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T15:20:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-169397074',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-169397074',id=17,image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNRMrYzvK3pYJ1FJMjc+V1i2P1GCZ7pr4peXof/MmhII+4Xmj4q6cN16NSsZ2VBvvUMajqTcHDJ4oijFZtGUhO6P/PbviQhdpIFcs92gxfNJp5GkGgqfjd5oki77f6xzQw==',key_name='tempest-keypair-889744656',keypairs=<?>,launch_index=0,launched_at=2023-08-09T15:21:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='42fe649aa7cd43678bd4f2cb24f45e18',ramdisk_id='',reservation_id='r-z007s7m7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1511835318',owner_user_name='tempest-TaggedBootDevicesTest_v242-1511835318-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T15:21:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='551eba2d528148b4b3b266f3dfb4a190',uuid=cff2fb57-7d0b-4278-89ed-10a8ec5128ea,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "17d8899d-82c0-4a46-97de-31253f7d1b82", "address": "fa:16:3e:7b:f5:ee", "network": {"id": "dc656a4e-c46c-4821-b492-2376b82b26ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-2053726028", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.153", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "42fe649aa7cd43678bd4f2cb24f45e18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17d8899d-82", "ovs_interfaceid": "17d8899d-82c0-4a46-97de-31253f7d1b82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 15:22:17 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-43064d7d-afca-4d1b-a704-4b98454e8ffb tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] Converting VIF {"id": "17d8899d-82c0-4a46-97de-31253f7d1b82", "address": "fa:16:3e:7b:f5:ee", "network": {"id": "dc656a4e-c46c-4821-b492-2376b82b26ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-2053726028", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.153", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "42fe649aa7cd43678bd4f2cb24f45e18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17d8899d-82", "ovs_interfaceid": "17d8899d-82c0-4a46-97de-31253f7d1b82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 15:22:17 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-43064d7d-afca-4d1b-a704-4b98454e8ffb tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7b:f5:ee,bridge_name='br-int',has_traffic_filtering=True,id=17d8899d-82c0-4a46-97de-31253f7d1b82,network=Network(dc656a4e-c46c-4821-b492-2376b82b26ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap17d8899d-82') {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 15:22:17 user nova-compute[72382]: DEBUG os_vif [None req-43064d7d-afca-4d1b-a704-4b98454e8ffb tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:f5:ee,bridge_name='br-int',has_traffic_filtering=True,id=17d8899d-82c0-4a46-97de-31253f7d1b82,network=Network(dc656a4e-c46c-4821-b492-2376b82b26ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap17d8899d-82') {{(pid=72382) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 15:22:17 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.024s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:22:17 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0fa0232-94bb-4f5e-85df-6b1df5390e82]: (4, ('ok\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:22:17 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-a96be5d9-2d97-44e6-b7d7-982c25f85e5b tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] Flushing IO for device /dev/sdc {{(pid=72382) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 15:22:17 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:22:17 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap17d8899d-82, bridge=br-int, if_exists=True) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:22:17 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:22:17 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:22:17 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:22:17 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:22:17 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[65c247e5-b2a8-4274-89ed-4be00ed30ed1]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:22:17 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-a96be5d9-2d97-44e6-b7d7-982c25f85e5b tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72382) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 15:22:17 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:22:17 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:22:17 user nova-compute[72382]: INFO os_vif [None req-43064d7d-afca-4d1b-a704-4b98454e8ffb tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:f5:ee,bridge_name='br-int',has_traffic_filtering=True,id=17d8899d-82c0-4a46-97de-31253f7d1b82,network=Network(dc656a4e-c46c-4821-b492-2376b82b26ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap17d8899d-82')
Aug 09 15:22:17 user nova-compute[72382]: DEBUG nova.virt.libvirt.vif [None req-43064d7d-afca-4d1b-a704-4b98454e8ffb tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T15:20:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-169397074',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-169397074',id=17,image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNRMrYzvK3pYJ1FJMjc+V1i2P1GCZ7pr4peXof/MmhII+4Xmj4q6cN16NSsZ2VBvvUMajqTcHDJ4oijFZtGUhO6P/PbviQhdpIFcs92gxfNJp5GkGgqfjd5oki77f6xzQw==',key_name='tempest-keypair-889744656',keypairs=<?>,launch_index=0,launched_at=2023-08-09T15:21:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='42fe649aa7cd43678bd4f2cb24f45e18',ramdisk_id='',reservation_id='r-z007s7m7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1511835318',owner_user_name='tempest-TaggedBootDevicesTest_v242-1511835318-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T15:21:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='551eba2d528148b4b3b266f3dfb4a190',uuid=cff2fb57-7d0b-4278-89ed-10a8ec5128ea,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ce3acf5c-2e65-4650-aade-158b96a7d349", "address": "fa:16:3e:ff:b7:1e", "network": {"id": "dc656a4e-c46c-4821-b492-2376b82b26ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-2053726028", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.132", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "42fe649aa7cd43678bd4f2cb24f45e18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce3acf5c-2e", "ovs_interfaceid": "ce3acf5c-2e65-4650-aade-158b96a7d349", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 15:22:17 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-43064d7d-afca-4d1b-a704-4b98454e8ffb tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] Converting VIF {"id": "ce3acf5c-2e65-4650-aade-158b96a7d349", "address": "fa:16:3e:ff:b7:1e", "network": {"id": "dc656a4e-c46c-4821-b492-2376b82b26ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-2053726028", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.132", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "42fe649aa7cd43678bd4f2cb24f45e18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce3acf5c-2e", "ovs_interfaceid": "ce3acf5c-2e65-4650-aade-158b96a7d349", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 15:22:17 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-43064d7d-afca-4d1b-a704-4b98454e8ffb tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ff:b7:1e,bridge_name='br-int',has_traffic_filtering=True,id=ce3acf5c-2e65-4650-aade-158b96a7d349,network=Network(dc656a4e-c46c-4821-b492-2376b82b26ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce3acf5c-2e') {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 15:22:17 user nova-compute[72382]: DEBUG os_vif [None req-43064d7d-afca-4d1b-a704-4b98454e8ffb tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:b7:1e,bridge_name='br-int',has_traffic_filtering=True,id=ce3acf5c-2e65-4650-aade-158b96a7d349,network=Network(dc656a4e-c46c-4821-b492-2376b82b26ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce3acf5c-2e') {{(pid=72382) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 15:22:17 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:22:17 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapce3acf5c-2e, bridge=br-int, if_exists=True) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:22:17 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:22:17 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:22:17 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.044s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:22:17 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[452e43ba-2c21-40cb-a6f0-32f86a90b2e2]: (4, ('1', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:22:17 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-a96be5d9-2d97-44e6-b7d7-982c25f85e5b tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72382) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 15:22:17 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-a96be5d9-2d97-44e6-b7d7-982c25f85e5b tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] SCSI volumes sdc have been removed. {{(pid=72382) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 15:22:17 user nova-compute[72382]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-26164646461303364', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_a8a77ed2', '/dev/disk/by-id/scsi-1SCST_BIOa8a77ed2-addda03d90b009b3') {{(pid=83725) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Aug 09 15:22:17 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[f839f435-7556-43a3-833f-467055dc0821]: (4, None) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:22:17 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-a96be5d9-2d97-44e6-b7d7-982c25f85e5b tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1cd86701-a303-4744-bf0c-31b5314bb87d')] {{(pid=72382) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 15:22:17 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:22:17 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1cd86701-a303-4744-bf0c-31b5314bb87d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:22:17 user nova-compute[72382]: INFO os_vif [None req-43064d7d-afca-4d1b-a704-4b98454e8ffb tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:b7:1e,bridge_name='br-int',has_traffic_filtering=True,id=ce3acf5c-2e65-4650-aade-158b96a7d349,network=Network(dc656a4e-c46c-4821-b492-2376b82b26ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce3acf5c-2e')
Aug 09 15:22:17 user nova-compute[72382]: DEBUG nova.virt.libvirt.vif [None req-43064d7d-afca-4d1b-a704-4b98454e8ffb tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T15:20:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-169397074',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-169397074',id=17,image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNRMrYzvK3pYJ1FJMjc+V1i2P1GCZ7pr4peXof/MmhII+4Xmj4q6cN16NSsZ2VBvvUMajqTcHDJ4oijFZtGUhO6P/PbviQhdpIFcs92gxfNJp5GkGgqfjd5oki77f6xzQw==',key_name='tempest-keypair-889744656',keypairs=<?>,launch_index=0,launched_at=2023-08-09T15:21:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='42fe649aa7cd43678bd4f2cb24f45e18',ramdisk_id='',reservation_id='r-z007s7m7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1511835318',owner_user_name='tempest-TaggedBootDevicesTest_v242-1511835318-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T15:21:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='551eba2d528148b4b3b266f3dfb4a190',uuid=cff2fb57-7d0b-4278-89ed-10a8ec5128ea,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "802211f2-fc95-4940-87bf-eb0658b56ff1", "address": "fa:16:3e:dd:68:92", "network": {"id": "c8d9a670-b921-4ea7-bc32-64ef779aa86c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1431242330", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "42fe649aa7cd43678bd4f2cb24f45e18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap802211f2-fc", "ovs_interfaceid": "802211f2-fc95-4940-87bf-eb0658b56ff1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 15:22:17 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-43064d7d-afca-4d1b-a704-4b98454e8ffb tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] Converting VIF {"id": "802211f2-fc95-4940-87bf-eb0658b56ff1", "address": "fa:16:3e:dd:68:92", "network": {"id": "c8d9a670-b921-4ea7-bc32-64ef779aa86c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1431242330", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "42fe649aa7cd43678bd4f2cb24f45e18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap802211f2-fc", "ovs_interfaceid": "802211f2-fc95-4940-87bf-eb0658b56ff1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 15:22:17 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-43064d7d-afca-4d1b-a704-4b98454e8ffb tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dd:68:92,bridge_name='br-int',has_traffic_filtering=True,id=802211f2-fc95-4940-87bf-eb0658b56ff1,network=Network(c8d9a670-b921-4ea7-bc32-64ef779aa86c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap802211f2-fc') {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 15:22:17 user nova-compute[72382]: DEBUG os_vif [None req-43064d7d-afca-4d1b-a704-4b98454e8ffb tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:68:92,bridge_name='br-int',has_traffic_filtering=True,id=802211f2-fc95-4940-87bf-eb0658b56ff1,network=Network(c8d9a670-b921-4ea7-bc32-64ef779aa86c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap802211f2-fc') {{(pid=72382) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 15:22:17 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:22:17 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap802211f2-fc, bridge=br-int, if_exists=True) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:22:17 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:22:17 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:22:17 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1cd86701-a303-4744-bf0c-31b5314bb87d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:22:17 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cee9093-7b1f-4ae3-a23c-5a1e7a581cfb]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:22:17 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-a96be5d9-2d97-44e6-b7d7-982c25f85e5b tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:22:17 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1cd86701-a303-4744-bf0c-31b5314bb87d -p 172.16.0.220:3260 --logout {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:22:17 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:22:17 user nova-compute[72382]: INFO os_vif [None req-43064d7d-afca-4d1b-a704-4b98454e8ffb tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:68:92,bridge_name='br-int',has_traffic_filtering=True,id=802211f2-fc95-4940-87bf-eb0658b56ff1,network=Network(c8d9a670-b921-4ea7-bc32-64ef779aa86c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap802211f2-fc')
Aug 09 15:22:17 user nova-compute[72382]: DEBUG nova.virt.libvirt.vif [None req-43064d7d-afca-4d1b-a704-4b98454e8ffb tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T15:20:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-169397074',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-169397074',id=17,image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNRMrYzvK3pYJ1FJMjc+V1i2P1GCZ7pr4peXof/MmhII+4Xmj4q6cN16NSsZ2VBvvUMajqTcHDJ4oijFZtGUhO6P/PbviQhdpIFcs92gxfNJp5GkGgqfjd5oki77f6xzQw==',key_name='tempest-keypair-889744656',keypairs=<?>,launch_index=0,launched_at=2023-08-09T15:21:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='42fe649aa7cd43678bd4f2cb24f45e18',ramdisk_id='',reservation_id='r-z007s7m7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1511835318',owner_user_name='tempest-TaggedBootDevicesTest_v242-1511835318-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T15:21:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='551eba2d528148b4b3b266f3dfb4a190',uuid=cff2fb57-7d0b-4278-89ed-10a8ec5128ea,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bcf9d83a-a145-4d83-9df6-02eba42f64bf", "address": "fa:16:3e:98:67:3f", "network": {"id": "c8d9a670-b921-4ea7-bc32-64ef779aa86c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1431242330", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "42fe649aa7cd43678bd4f2cb24f45e18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcf9d83a-a1", "ovs_interfaceid": "bcf9d83a-a145-4d83-9df6-02eba42f64bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 15:22:17 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-43064d7d-afca-4d1b-a704-4b98454e8ffb tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] Converting VIF {"id": "bcf9d83a-a145-4d83-9df6-02eba42f64bf", "address": "fa:16:3e:98:67:3f", "network": {"id": "c8d9a670-b921-4ea7-bc32-64ef779aa86c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1431242330", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "42fe649aa7cd43678bd4f2cb24f45e18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcf9d83a-a1", "ovs_interfaceid": "bcf9d83a-a145-4d83-9df6-02eba42f64bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 15:22:17 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-43064d7d-afca-4d1b-a704-4b98454e8ffb tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:98:67:3f,bridge_name='br-int',has_traffic_filtering=True,id=bcf9d83a-a145-4d83-9df6-02eba42f64bf,network=Network(c8d9a670-b921-4ea7-bc32-64ef779aa86c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbcf9d83a-a1') {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 15:22:17 user nova-compute[72382]: DEBUG os_vif [None req-43064d7d-afca-4d1b-a704-4b98454e8ffb tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:67:3f,bridge_name='br-int',has_traffic_filtering=True,id=bcf9d83a-a145-4d83-9df6-02eba42f64bf,network=Network(c8d9a670-b921-4ea7-bc32-64ef779aa86c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbcf9d83a-a1') {{(pid=72382) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 15:22:17 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:22:17 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbcf9d83a-a1, bridge=br-int, if_exists=True) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:22:17 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:22:17 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:22:17 user nova-compute[72382]: DEBUG nova.compute.manager [req-d4fe59b1-5b30-4c1a-aa78-d929fac0cdff req-3269421f-6b0b-4499-b7af-46a8e8e7ee40 service nova] [instance: cff2fb57-7d0b-4278-89ed-10a8ec5128ea] Received event network-vif-plugged-477e93e2-c6aa-47e7-bed7-62b4bb29a9ea {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:22:17 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-d4fe59b1-5b30-4c1a-aa78-d929fac0cdff req-3269421f-6b0b-4499-b7af-46a8e8e7ee40 service nova] Acquiring lock "cff2fb57-7d0b-4278-89ed-10a8ec5128ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:22:17 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-d4fe59b1-5b30-4c1a-aa78-d929fac0cdff req-3269421f-6b0b-4499-b7af-46a8e8e7ee40 service nova] Lock "cff2fb57-7d0b-4278-89ed-10a8ec5128ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:22:17 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-d4fe59b1-5b30-4c1a-aa78-d929fac0cdff req-3269421f-6b0b-4499-b7af-46a8e8e7ee40 service nova] Lock "cff2fb57-7d0b-4278-89ed-10a8ec5128ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:22:17 user nova-compute[72382]: DEBUG nova.compute.manager [req-d4fe59b1-5b30-4c1a-aa78-d929fac0cdff req-3269421f-6b0b-4499-b7af-46a8e8e7ee40 service nova] [instance: cff2fb57-7d0b-4278-89ed-10a8ec5128ea] No waiting events found dispatching network-vif-plugged-477e93e2-c6aa-47e7-bed7-62b4bb29a9ea {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:22:17 user nova-compute[72382]: WARNING nova.compute.manager [req-d4fe59b1-5b30-4c1a-aa78-d929fac0cdff req-3269421f-6b0b-4499-b7af-46a8e8e7ee40 service nova] [instance: cff2fb57-7d0b-4278-89ed-10a8ec5128ea] Received unexpected event network-vif-plugged-477e93e2-c6aa-47e7-bed7-62b4bb29a9ea for instance with vm_state active and task_state deleting.
Aug 09 15:22:17 user nova-compute[72382]: DEBUG nova.compute.manager [req-d4fe59b1-5b30-4c1a-aa78-d929fac0cdff req-3269421f-6b0b-4499-b7af-46a8e8e7ee40 service nova] [instance: cff2fb57-7d0b-4278-89ed-10a8ec5128ea] Received event network-vif-unplugged-baeec4fc-3670-49f3-b42c-aab5ea116f45 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:22:17 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-d4fe59b1-5b30-4c1a-aa78-d929fac0cdff req-3269421f-6b0b-4499-b7af-46a8e8e7ee40 service nova] Acquiring lock "cff2fb57-7d0b-4278-89ed-10a8ec5128ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:22:17 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-d4fe59b1-5b30-4c1a-aa78-d929fac0cdff req-3269421f-6b0b-4499-b7af-46a8e8e7ee40 service nova] Lock "cff2fb57-7d0b-4278-89ed-10a8ec5128ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:22:17 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-d4fe59b1-5b30-4c1a-aa78-d929fac0cdff req-3269421f-6b0b-4499-b7af-46a8e8e7ee40 service nova] Lock "cff2fb57-7d0b-4278-89ed-10a8ec5128ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:22:17 user nova-compute[72382]: DEBUG nova.compute.manager [req-d4fe59b1-5b30-4c1a-aa78-d929fac0cdff req-3269421f-6b0b-4499-b7af-46a8e8e7ee40 service nova] [instance: cff2fb57-7d0b-4278-89ed-10a8ec5128ea] No waiting events found dispatching network-vif-unplugged-baeec4fc-3670-49f3-b42c-aab5ea116f45 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:22:17 user nova-compute[72382]: DEBUG nova.compute.manager [req-d4fe59b1-5b30-4c1a-aa78-d929fac0cdff req-3269421f-6b0b-4499-b7af-46a8e8e7ee40 service nova] [instance: cff2fb57-7d0b-4278-89ed-10a8ec5128ea] Received event network-vif-unplugged-baeec4fc-3670-49f3-b42c-aab5ea116f45 for instance with task_state deleting. {{(pid=72382) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 15:22:17 user nova-compute[72382]: DEBUG nova.compute.manager [req-d4fe59b1-5b30-4c1a-aa78-d929fac0cdff req-3269421f-6b0b-4499-b7af-46a8e8e7ee40 service nova] [instance: cff2fb57-7d0b-4278-89ed-10a8ec5128ea] Received event network-vif-plugged-baeec4fc-3670-49f3-b42c-aab5ea116f45 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:22:17 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-d4fe59b1-5b30-4c1a-aa78-d929fac0cdff req-3269421f-6b0b-4499-b7af-46a8e8e7ee40 service nova] Acquiring lock "cff2fb57-7d0b-4278-89ed-10a8ec5128ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:22:17 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-d4fe59b1-5b30-4c1a-aa78-d929fac0cdff req-3269421f-6b0b-4499-b7af-46a8e8e7ee40 service nova] Lock "cff2fb57-7d0b-4278-89ed-10a8ec5128ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:22:17 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-d4fe59b1-5b30-4c1a-aa78-d929fac0cdff req-3269421f-6b0b-4499-b7af-46a8e8e7ee40 service nova] Lock "cff2fb57-7d0b-4278-89ed-10a8ec5128ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:22:17 user nova-compute[72382]: DEBUG nova.compute.manager [req-d4fe59b1-5b30-4c1a-aa78-d929fac0cdff req-3269421f-6b0b-4499-b7af-46a8e8e7ee40 service nova] [instance: cff2fb57-7d0b-4278-89ed-10a8ec5128ea] No waiting events found dispatching network-vif-plugged-baeec4fc-3670-49f3-b42c-aab5ea116f45 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:22:17 user nova-compute[72382]: WARNING nova.compute.manager [req-d4fe59b1-5b30-4c1a-aa78-d929fac0cdff req-3269421f-6b0b-4499-b7af-46a8e8e7ee40 service nova] [instance: cff2fb57-7d0b-4278-89ed-10a8ec5128ea] Received unexpected event network-vif-plugged-baeec4fc-3670-49f3-b42c-aab5ea116f45 for instance with vm_state active and task_state deleting.
Aug 09 15:22:17 user nova-compute[72382]: DEBUG nova.compute.manager [req-d4fe59b1-5b30-4c1a-aa78-d929fac0cdff req-3269421f-6b0b-4499-b7af-46a8e8e7ee40 service nova] [instance: cff2fb57-7d0b-4278-89ed-10a8ec5128ea] Received event network-vif-unplugged-ce3acf5c-2e65-4650-aade-158b96a7d349 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:22:17 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-d4fe59b1-5b30-4c1a-aa78-d929fac0cdff req-3269421f-6b0b-4499-b7af-46a8e8e7ee40 service nova] Acquiring lock "cff2fb57-7d0b-4278-89ed-10a8ec5128ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:22:17 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-d4fe59b1-5b30-4c1a-aa78-d929fac0cdff req-3269421f-6b0b-4499-b7af-46a8e8e7ee40 service nova] Lock "cff2fb57-7d0b-4278-89ed-10a8ec5128ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:22:17 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-d4fe59b1-5b30-4c1a-aa78-d929fac0cdff req-3269421f-6b0b-4499-b7af-46a8e8e7ee40 service nova] Lock "cff2fb57-7d0b-4278-89ed-10a8ec5128ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:22:17 user nova-compute[72382]: DEBUG nova.compute.manager [req-d4fe59b1-5b30-4c1a-aa78-d929fac0cdff req-3269421f-6b0b-4499-b7af-46a8e8e7ee40 service nova] [instance: cff2fb57-7d0b-4278-89ed-10a8ec5128ea] No waiting events found dispatching network-vif-unplugged-ce3acf5c-2e65-4650-aade-158b96a7d349 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:22:17 user nova-compute[72382]: DEBUG nova.compute.manager [req-d4fe59b1-5b30-4c1a-aa78-d929fac0cdff req-3269421f-6b0b-4499-b7af-46a8e8e7ee40 service nova] [instance: cff2fb57-7d0b-4278-89ed-10a8ec5128ea] Received event network-vif-unplugged-ce3acf5c-2e65-4650-aade-158b96a7d349 for instance with task_state deleting. {{(pid=72382) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 15:22:17 user nova-compute[72382]: DEBUG nova.compute.manager [req-d4fe59b1-5b30-4c1a-aa78-d929fac0cdff req-3269421f-6b0b-4499-b7af-46a8e8e7ee40 service nova] [instance: cff2fb57-7d0b-4278-89ed-10a8ec5128ea] Received event network-vif-plugged-ce3acf5c-2e65-4650-aade-158b96a7d349 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:22:17 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-d4fe59b1-5b30-4c1a-aa78-d929fac0cdff req-3269421f-6b0b-4499-b7af-46a8e8e7ee40 service nova] Acquiring lock "cff2fb57-7d0b-4278-89ed-10a8ec5128ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:22:17 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-d4fe59b1-5b30-4c1a-aa78-d929fac0cdff req-3269421f-6b0b-4499-b7af-46a8e8e7ee40 service nova] Lock "cff2fb57-7d0b-4278-89ed-10a8ec5128ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:22:17 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-d4fe59b1-5b30-4c1a-aa78-d929fac0cdff req-3269421f-6b0b-4499-b7af-46a8e8e7ee40 service nova] Lock "cff2fb57-7d0b-4278-89ed-10a8ec5128ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:22:17 user nova-compute[72382]: DEBUG nova.compute.manager [req-d4fe59b1-5b30-4c1a-aa78-d929fac0cdff req-3269421f-6b0b-4499-b7af-46a8e8e7ee40 service nova] [instance: cff2fb57-7d0b-4278-89ed-10a8ec5128ea] No waiting events found dispatching network-vif-plugged-ce3acf5c-2e65-4650-aade-158b96a7d349 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:22:17 user nova-compute[72382]: WARNING nova.compute.manager [req-d4fe59b1-5b30-4c1a-aa78-d929fac0cdff req-3269421f-6b0b-4499-b7af-46a8e8e7ee40 service nova] [instance: cff2fb57-7d0b-4278-89ed-10a8ec5128ea] Received unexpected event network-vif-plugged-ce3acf5c-2e65-4650-aade-158b96a7d349 for instance with vm_state active and task_state deleting.
Aug 09 15:22:17 user nova-compute[72382]: DEBUG nova.compute.manager [req-d4fe59b1-5b30-4c1a-aa78-d929fac0cdff req-3269421f-6b0b-4499-b7af-46a8e8e7ee40 service nova] [instance: cff2fb57-7d0b-4278-89ed-10a8ec5128ea] Received event network-vif-unplugged-802211f2-fc95-4940-87bf-eb0658b56ff1 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:22:17 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-d4fe59b1-5b30-4c1a-aa78-d929fac0cdff req-3269421f-6b0b-4499-b7af-46a8e8e7ee40 service nova] Acquiring lock "cff2fb57-7d0b-4278-89ed-10a8ec5128ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:22:17 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-d4fe59b1-5b30-4c1a-aa78-d929fac0cdff req-3269421f-6b0b-4499-b7af-46a8e8e7ee40 service nova] Lock "cff2fb57-7d0b-4278-89ed-10a8ec5128ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:22:17 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-d4fe59b1-5b30-4c1a-aa78-d929fac0cdff req-3269421f-6b0b-4499-b7af-46a8e8e7ee40 service nova] Lock "cff2fb57-7d0b-4278-89ed-10a8ec5128ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:22:17 user nova-compute[72382]: DEBUG nova.compute.manager [req-d4fe59b1-5b30-4c1a-aa78-d929fac0cdff req-3269421f-6b0b-4499-b7af-46a8e8e7ee40 service nova] [instance: cff2fb57-7d0b-4278-89ed-10a8ec5128ea] No waiting events found dispatching network-vif-unplugged-802211f2-fc95-4940-87bf-eb0658b56ff1 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:22:17 user nova-compute[72382]: DEBUG nova.compute.manager [req-d4fe59b1-5b30-4c1a-aa78-d929fac0cdff req-3269421f-6b0b-4499-b7af-46a8e8e7ee40 service nova] [instance: cff2fb57-7d0b-4278-89ed-10a8ec5128ea] Received event network-vif-unplugged-802211f2-fc95-4940-87bf-eb0658b56ff1 for instance with task_state deleting. {{(pid=72382) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 15:22:17 user nova-compute[72382]: INFO os_vif [None req-43064d7d-afca-4d1b-a704-4b98454e8ffb tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:67:3f,bridge_name='br-int',has_traffic_filtering=True,id=bcf9d83a-a145-4d83-9df6-02eba42f64bf,network=Network(c8d9a670-b921-4ea7-bc32-64ef779aa86c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbcf9d83a-a1')
Aug 09 15:22:17 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-43064d7d-afca-4d1b-a704-4b98454e8ffb tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] [instance: cff2fb57-7d0b-4278-89ed-10a8ec5128ea] calling os-brick to detach iSCSI Volume {{(pid=72382) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 15:22:17 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-43064d7d-afca-4d1b-a704-4b98454e8ffb tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2a0c768340>, {'target_iqns': ['iqn.2010-10.org.openstack:e8bad821-ddd1-4287-806d-78ffdc34fa68'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nTJNhKOi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 15:22:17 user nova-compute[72382]: WARNING os_brick.initiator.connectors.base [None req-43064d7d-afca-4d1b-a704-4b98454e8ffb tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 15:22:17 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-43064d7d-afca-4d1b-a704-4b98454e8ffb tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 15:22:17 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1cd86701-a303-4744-bf0c-31b5314bb87d -p 172.16.0.220:3260 --logout" returned: 0 in 0.077s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:22:17 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[26a99e97-7642-42a6-9a72-7b39a242844f]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:1cd86701-a303-4744-bf0c-31b5314bb87d, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:1cd86701-a303-4744-bf0c-31b5314bb87d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:22:17 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-a96be5d9-2d97-44e6-b7d7-982c25f85e5b tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:1cd86701-a303-4744-bf0c-31b5314bb87d, portal: 172.16.0.220,3260]
Aug 09 15:22:17 user nova-compute[72382]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:1cd86701-a303-4744-bf0c-31b5314bb87d, portal: 172.16.0.220,3260] successful.
Aug 09 15:22:17 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:22:17 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1cd86701-a303-4744-bf0c-31b5314bb87d -p 172.16.0.220:3260 --op delete {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:22:17 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1cd86701-a303-4744-bf0c-31b5314bb87d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:22:17 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f48bc3b-58de-4051-9a55-b07d11c5612e]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:22:17 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-a96be5d9-2d97-44e6-b7d7-982c25f85e5b tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:22:17 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-a96be5d9-2d97-44e6-b7d7-982c25f85e5b tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.351s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 15:22:17 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-a96be5d9-2d97-44e6-b7d7-982c25f85e5b tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] <== disconnect_volume: return (354ms) None {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 15:22:17 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a96be5d9-2d97-44e6-b7d7-982c25f85e5b tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] [instance: 83ebfda8-235d-4404-a973-991d75ae2bf6] Disconnected iSCSI Volume {{(pid=72382) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 15:22:17 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-a96be5d9-2d97-44e6-b7d7-982c25f85e5b tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] [instance: 83ebfda8-235d-4404-a973-991d75ae2bf6] Deleting instance files /opt/stack/data/nova/instances/83ebfda8-235d-4404-a973-991d75ae2bf6_del
Aug 09 15:22:17 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-a96be5d9-2d97-44e6-b7d7-982c25f85e5b tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] [instance: 83ebfda8-235d-4404-a973-991d75ae2bf6] Deletion of /opt/stack/data/nova/instances/83ebfda8-235d-4404-a973-991d75ae2bf6_del complete
Aug 09 15:22:18 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-43064d7d-afca-4d1b-a704-4b98454e8ffb tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.078s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 15:22:18 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-43064d7d-afca-4d1b-a704-4b98454e8ffb tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e8bad821-ddd1-4287-806d-78ffdc34fa68', 0)] {{(pid=72382) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 15:22:18 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:22:18 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:22:18 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[f382c53b-d5a8-4424-b379-8282f408c2fd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:184b0159-3cae-4d79-86b3-26a58437eb09\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1c6be653-7ab8-4b40-9e28-43c1eca5e016\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e8bad821-ddd1-4287-806d-78ffdc34fa68\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fb47e85c-aaa9-4165-8be3-125572b68a87\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:22:18 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:22:18 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:22:18 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[e15c5d0b-c3ba-487f-af7c-58de591ee7ef]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8bad821-ddd1-4287-806d-78ffdc34fa68 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:184b0159-3cae-4d79-86b3-26a58437eb09 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c6be653-7ab8-4b40-9e28-43c1eca5e016 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb47e85c-aaa9-4165-8be3-125572b68a87 (non-flash)\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:22:18 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-43064d7d-afca-4d1b-a704-4b98454e8ffb tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)
Aug 09 15:22:18 user nova-compute[72382]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8bad821-ddd1-4287-806d-78ffdc34fa68 (non-flash)
Aug 09 15:22:18 user nova-compute[72382]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:184b0159-3cae-4d79-86b3-26a58437eb09 (non-flash)
Aug 09 15:22:18 user nova-compute[72382]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c6be653-7ab8-4b40-9e28-43c1eca5e016 (non-flash)
Aug 09 15:22:18 user nova-compute[72382]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb47e85c-aaa9-4165-8be3-125572b68a87 (non-flash)
Aug 09 15:22:18 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 15:22:18 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-43064d7d-afca-4d1b-a704-4b98454e8ffb tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)
Aug 09 15:22:18 user nova-compute[72382]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8bad821-ddd1-4287-806d-78ffdc34fa68 (non-flash)
Aug 09 15:22:18 user nova-compute[72382]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:184b0159-3cae-4d79-86b3-26a58437eb09 (non-flash)
Aug 09 15:22:18 user nova-compute[72382]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c6be653-7ab8-4b40-9e28-43c1eca5e016 (non-flash)
Aug 09 15:22:18 user nova-compute[72382]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb47e85c-aaa9-4165-8be3-125572b68a87 (non-flash)
Aug 09 15:22:18 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 15:22:18 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-43064d7d-afca-4d1b-a704-4b98454e8ffb tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2a0c37bb50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e8bad821-ddd1-4287-806d-78ffdc34fa68'): ({'sde'}, set())}) {{(pid=72382) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 15:22:18 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-43064d7d-afca-4d1b-a704-4b98454e8ffb tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] Removing single pathed devices sde {{(pid=72382) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 15:22:18 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:22:18 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:22:18 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bc2f2c4-b001-46df-b968-9b572a31f699]: (4, ('path checker states:\nup                  4\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:22:18 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:22:18 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.022s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:22:18 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[018514ca-c93f-4a50-9091-047be20ec1b9]: (4, ('ok\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:22:18 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-43064d7d-afca-4d1b-a704-4b98454e8ffb tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] Flushing IO for device /dev/sde {{(pid=72382) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 15:22:18 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:22:18 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.019s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:22:18 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa6114f4-1a92-446e-95cd-c50001f11355]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:22:18 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-43064d7d-afca-4d1b-a704-4b98454e8ffb tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72382) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 15:22:18 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:22:18 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.071s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:22:18 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[2afefb1e-3deb-49d4-82f2-2409ffd84312]: (4, ('1', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:22:18 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-43064d7d-afca-4d1b-a704-4b98454e8ffb tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72382) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 15:22:18 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-43064d7d-afca-4d1b-a704-4b98454e8ffb tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] SCSI volumes sde have been removed. {{(pid=72382) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 15:22:18 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-43064d7d-afca-4d1b-a704-4b98454e8ffb tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e8bad821-ddd1-4287-806d-78ffdc34fa68')] {{(pid=72382) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 15:22:18 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8bad821-ddd1-4287-806d-78ffdc34fa68 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:22:18 user nova-compute[72382]: WARNING nova.virt.libvirt.driver [None req-a96be5d9-2d97-44e6-b7d7-982c25f85e5b tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] [instance: 83ebfda8-235d-4404-a973-991d75ae2bf6] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance 83ebfda8-235d-4404-a973-991d75ae2bf6 could not be found.
Aug 09 15:22:18 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a96be5d9-2d97-44e6-b7d7-982c25f85e5b tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] [instance: 83ebfda8-235d-4404-a973-991d75ae2bf6] calling os-brick to detach iSCSI Volume {{(pid=72382) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 15:22:18 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-a96be5d9-2d97-44e6-b7d7-982c25f85e5b tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2a0c768340>, {'target_iqns': ['iqn.2010-10.org.openstack:1cd86701-a303-4744-bf0c-31b5314bb87d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DtKCGmgQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 15:22:18 user nova-compute[72382]: WARNING os_brick.initiator.connectors.base [None req-a96be5d9-2d97-44e6-b7d7-982c25f85e5b tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 09 15:22:18 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-a96be5d9-2d97-44e6-b7d7-982c25f85e5b tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 15:22:18 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8bad821-ddd1-4287-806d-78ffdc34fa68 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:22:18 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[28d053e5-c670-46c0-83db-8ec0a686ae43]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:22:18 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-43064d7d-afca-4d1b-a704-4b98454e8ffb tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:22:18 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8bad821-ddd1-4287-806d-78ffdc34fa68 -p 172.16.0.220:3260 --logout {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:22:18 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8bad821-ddd1-4287-806d-78ffdc34fa68 -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:22:18 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9e5e7e6-cf67-4077-9a78-6082613e2a71]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:e8bad821-ddd1-4287-806d-78ffdc34fa68, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:e8bad821-ddd1-4287-806d-78ffdc34fa68, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:22:18 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-43064d7d-afca-4d1b-a704-4b98454e8ffb tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:e8bad821-ddd1-4287-806d-78ffdc34fa68, portal: 172.16.0.220,3260]
Aug 09 15:22:18 user nova-compute[72382]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:e8bad821-ddd1-4287-806d-78ffdc34fa68, portal: 172.16.0.220,3260] successful.
Aug 09 15:22:18 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:22:18 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8bad821-ddd1-4287-806d-78ffdc34fa68 -p 172.16.0.220:3260 --op delete {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:22:18 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8bad821-ddd1-4287-806d-78ffdc34fa68 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:22:18 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b85d0e2-efa6-4d16-a685-e75b13e492e7]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:22:18 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-43064d7d-afca-4d1b-a704-4b98454e8ffb tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:22:18 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-43064d7d-afca-4d1b-a704-4b98454e8ffb tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.351s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 15:22:18 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-43064d7d-afca-4d1b-a704-4b98454e8ffb tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] <== disconnect_volume: return (429ms) None {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 15:22:18 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-43064d7d-afca-4d1b-a704-4b98454e8ffb tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] [instance: cff2fb57-7d0b-4278-89ed-10a8ec5128ea] Disconnected iSCSI Volume {{(pid=72382) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 15:22:18 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-a96be5d9-2d97-44e6-b7d7-982c25f85e5b tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.106s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 15:22:18 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-a96be5d9-2d97-44e6-b7d7-982c25f85e5b tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1cd86701-a303-4744-bf0c-31b5314bb87d', 0)] {{(pid=72382) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 15:22:18 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:22:18 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-43064d7d-afca-4d1b-a704-4b98454e8ffb tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] [instance: cff2fb57-7d0b-4278-89ed-10a8ec5128ea] calling os-brick to detach iSCSI Volume {{(pid=72382) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 15:22:18 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-43064d7d-afca-4d1b-a704-4b98454e8ffb tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2a0c768340>, {'target_iqns': ['iqn.2010-10.org.openstack:184b0159-3cae-4d79-86b3-26a58437eb09'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oyhkXTmn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 15:22:18 user nova-compute[72382]: WARNING os_brick.initiator.connectors.base [None req-43064d7d-afca-4d1b-a704-4b98454e8ffb tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 15:22:18 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-43064d7d-afca-4d1b-a704-4b98454e8ffb tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 15:22:18 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:22:18 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e3b5b1d-db27-484b-ac9c-58ebbeb9a455]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:184b0159-3cae-4d79-86b3-26a58437eb09\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1c6be653-7ab8-4b40-9e28-43c1eca5e016\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fb47e85c-aaa9-4165-8be3-125572b68a87\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:22:18 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:22:18 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:22:18 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a83ad3a-792e-4d3d-92a4-515ae9bc04ff]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:184b0159-3cae-4d79-86b3-26a58437eb09 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c6be653-7ab8-4b40-9e28-43c1eca5e016 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb47e85c-aaa9-4165-8be3-125572b68a87 (non-flash)\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:22:18 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-a96be5d9-2d97-44e6-b7d7-982c25f85e5b tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)
Aug 09 15:22:18 user nova-compute[72382]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:184b0159-3cae-4d79-86b3-26a58437eb09 (non-flash)
Aug 09 15:22:18 user nova-compute[72382]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c6be653-7ab8-4b40-9e28-43c1eca5e016 (non-flash)
Aug 09 15:22:18 user nova-compute[72382]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb47e85c-aaa9-4165-8be3-125572b68a87 (non-flash)
Aug 09 15:22:18 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 15:22:18 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-a96be5d9-2d97-44e6-b7d7-982c25f85e5b tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)
Aug 09 15:22:18 user nova-compute[72382]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:184b0159-3cae-4d79-86b3-26a58437eb09 (non-flash)
Aug 09 15:22:18 user nova-compute[72382]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c6be653-7ab8-4b40-9e28-43c1eca5e016 (non-flash)
Aug 09 15:22:18 user nova-compute[72382]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb47e85c-aaa9-4165-8be3-125572b68a87 (non-flash)
Aug 09 15:22:18 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 15:22:18 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-a96be5d9-2d97-44e6-b7d7-982c25f85e5b tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2a0c37bb50>, {}) {{(pid=72382) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 15:22:18 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-a96be5d9-2d97-44e6-b7d7-982c25f85e5b tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] Disconnecting from: [] {{(pid=72382) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 15:22:18 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-a96be5d9-2d97-44e6-b7d7-982c25f85e5b tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.058s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 15:22:18 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-a96be5d9-2d97-44e6-b7d7-982c25f85e5b tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] <== disconnect_volume: return (164ms) None {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 15:22:18 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a96be5d9-2d97-44e6-b7d7-982c25f85e5b tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] [instance: 83ebfda8-235d-4404-a973-991d75ae2bf6] Disconnected iSCSI Volume {{(pid=72382) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 15:22:18 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-43064d7d-afca-4d1b-a704-4b98454e8ffb tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.057s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 15:22:18 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-43064d7d-afca-4d1b-a704-4b98454e8ffb tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:184b0159-3cae-4d79-86b3-26a58437eb09', 0)] {{(pid=72382) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 15:22:18 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:22:18 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:22:18 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae115f5b-df57-4834-81cf-ec301c18c20b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:184b0159-3cae-4d79-86b3-26a58437eb09\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1c6be653-7ab8-4b40-9e28-43c1eca5e016\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fb47e85c-aaa9-4165-8be3-125572b68a87\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:22:18 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:22:18 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:22:18 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[df0ec652-1448-40ca-a740-b2ce10dc5d8c]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:184b0159-3cae-4d79-86b3-26a58437eb09 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c6be653-7ab8-4b40-9e28-43c1eca5e016 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb47e85c-aaa9-4165-8be3-125572b68a87 (non-flash)\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:22:18 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-43064d7d-afca-4d1b-a704-4b98454e8ffb tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)
Aug 09 15:22:18 user nova-compute[72382]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:184b0159-3cae-4d79-86b3-26a58437eb09 (non-flash)
Aug 09 15:22:18 user nova-compute[72382]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c6be653-7ab8-4b40-9e28-43c1eca5e016 (non-flash)
Aug 09 15:22:18 user nova-compute[72382]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb47e85c-aaa9-4165-8be3-125572b68a87 (non-flash)
Aug 09 15:22:18 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 15:22:18 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-43064d7d-afca-4d1b-a704-4b98454e8ffb tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)
Aug 09 15:22:18 user nova-compute[72382]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:184b0159-3cae-4d79-86b3-26a58437eb09 (non-flash)
Aug 09 15:22:18 user nova-compute[72382]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c6be653-7ab8-4b40-9e28-43c1eca5e016 (non-flash)
Aug 09 15:22:18 user nova-compute[72382]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb47e85c-aaa9-4165-8be3-125572b68a87 (non-flash)
Aug 09 15:22:18 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 15:22:18 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-43064d7d-afca-4d1b-a704-4b98454e8ffb tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2a0c3d4af0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:184b0159-3cae-4d79-86b3-26a58437eb09'): ({'sdf'}, set())}) {{(pid=72382) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 15:22:18 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-43064d7d-afca-4d1b-a704-4b98454e8ffb tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] Removing single pathed devices sdf {{(pid=72382) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 15:22:18 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:22:18 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:22:18 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[58af7d6c-3c18-431f-996b-f8974111d32c]: (4, ('path checker states:\nup                  3\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:22:18 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:22:18 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:22:18 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[35db420a-1e5c-4eb1-bb97-af17756999e1]: (4, ('ok\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:22:18 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-43064d7d-afca-4d1b-a704-4b98454e8ffb tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] Flushing IO for device /dev/sdf {{(pid=72382) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 15:22:18 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:22:18 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.017s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:22:18 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a6ae7c6-9f1f-472b-b0f0-745ddebc5e58]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:22:18 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-43064d7d-afca-4d1b-a704-4b98454e8ffb tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=72382) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 15:22:18 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:22:18 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.051s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:22:18 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[97fbcf32-9902-4bf2-bf64-97ae22291a16]: (4, ('1', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:22:18 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-43064d7d-afca-4d1b-a704-4b98454e8ffb tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=72382) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 15:22:18 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-43064d7d-afca-4d1b-a704-4b98454e8ffb tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] SCSI volumes sdf have been removed. {{(pid=72382) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 15:22:18 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-43064d7d-afca-4d1b-a704-4b98454e8ffb tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:184b0159-3cae-4d79-86b3-26a58437eb09')] {{(pid=72382) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 15:22:18 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:184b0159-3cae-4d79-86b3-26a58437eb09 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:22:18 user nova-compute[72382]: DEBUG nova.compute.manager [req-fe5cf09b-3204-4cc7-a1d3-643a22fd72a9 req-ee6fa512-190f-4134-aafe-dcb46174988b service nova] [instance: cff2fb57-7d0b-4278-89ed-10a8ec5128ea] Received event network-vif-plugged-55cf98ab-8cd2-4704-971f-ee4ceebca331 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:22:18 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-fe5cf09b-3204-4cc7-a1d3-643a22fd72a9 req-ee6fa512-190f-4134-aafe-dcb46174988b service nova] Acquiring lock "cff2fb57-7d0b-4278-89ed-10a8ec5128ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:22:18 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-fe5cf09b-3204-4cc7-a1d3-643a22fd72a9 req-ee6fa512-190f-4134-aafe-dcb46174988b service nova] Lock "cff2fb57-7d0b-4278-89ed-10a8ec5128ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:22:18 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-fe5cf09b-3204-4cc7-a1d3-643a22fd72a9 req-ee6fa512-190f-4134-aafe-dcb46174988b service nova] Lock "cff2fb57-7d0b-4278-89ed-10a8ec5128ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.005s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:22:18 user nova-compute[72382]: DEBUG nova.compute.manager [req-fe5cf09b-3204-4cc7-a1d3-643a22fd72a9 req-ee6fa512-190f-4134-aafe-dcb46174988b service nova] [instance: cff2fb57-7d0b-4278-89ed-10a8ec5128ea] No waiting events found dispatching network-vif-plugged-55cf98ab-8cd2-4704-971f-ee4ceebca331 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:22:18 user nova-compute[72382]: WARNING nova.compute.manager [req-fe5cf09b-3204-4cc7-a1d3-643a22fd72a9 req-ee6fa512-190f-4134-aafe-dcb46174988b service nova] [instance: cff2fb57-7d0b-4278-89ed-10a8ec5128ea] Received unexpected event network-vif-plugged-55cf98ab-8cd2-4704-971f-ee4ceebca331 for instance with vm_state active and task_state deleting.
Aug 09 15:22:18 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:184b0159-3cae-4d79-86b3-26a58437eb09 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:22:18 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a6a8492-b94c-4ea7-a541-ec816b0dd647]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:22:18 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-43064d7d-afca-4d1b-a704-4b98454e8ffb tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:22:18 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:184b0159-3cae-4d79-86b3-26a58437eb09 -p 172.16.0.220:3260 --logout {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:22:18 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:184b0159-3cae-4d79-86b3-26a58437eb09 -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:22:18 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[993d4226-b1f1-4fec-9cc4-73ee6e1fed86]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:184b0159-3cae-4d79-86b3-26a58437eb09, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:184b0159-3cae-4d79-86b3-26a58437eb09, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:22:18 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-43064d7d-afca-4d1b-a704-4b98454e8ffb tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:184b0159-3cae-4d79-86b3-26a58437eb09, portal: 172.16.0.220,3260]
Aug 09 15:22:18 user nova-compute[72382]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:184b0159-3cae-4d79-86b3-26a58437eb09, portal: 172.16.0.220,3260] successful.
Aug 09 15:22:18 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:22:18 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:184b0159-3cae-4d79-86b3-26a58437eb09 -p 172.16.0.220:3260 --op delete {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:22:18 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:184b0159-3cae-4d79-86b3-26a58437eb09 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:22:18 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[523bc805-4907-45eb-950a-e34ecf0dee1b]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:22:18 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-43064d7d-afca-4d1b-a704-4b98454e8ffb tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:22:18 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-43064d7d-afca-4d1b-a704-4b98454e8ffb tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.336s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 15:22:18 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-43064d7d-afca-4d1b-a704-4b98454e8ffb tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] <== disconnect_volume: return (393ms) None {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 15:22:18 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-43064d7d-afca-4d1b-a704-4b98454e8ffb tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] [instance: cff2fb57-7d0b-4278-89ed-10a8ec5128ea] Disconnected iSCSI Volume {{(pid=72382) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 15:22:18 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-43064d7d-afca-4d1b-a704-4b98454e8ffb tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] [instance: cff2fb57-7d0b-4278-89ed-10a8ec5128ea] calling os-brick to detach iSCSI Volume {{(pid=72382) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 15:22:18 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-43064d7d-afca-4d1b-a704-4b98454e8ffb tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2a0c768340>, {'target_iqns': ['iqn.2010-10.org.openstack:1c6be653-7ab8-4b40-9e28-43c1eca5e016'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lHczEwXN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 15:22:18 user nova-compute[72382]: WARNING os_brick.initiator.connectors.base [None req-43064d7d-afca-4d1b-a704-4b98454e8ffb tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 15:22:18 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-43064d7d-afca-4d1b-a704-4b98454e8ffb tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 15:22:18 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-43064d7d-afca-4d1b-a704-4b98454e8ffb tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 15:22:18 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-43064d7d-afca-4d1b-a704-4b98454e8ffb tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1c6be653-7ab8-4b40-9e28-43c1eca5e016', 0)] {{(pid=72382) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 15:22:18 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:22:18 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:22:18 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6dc5b40-04e9-47e6-9b1f-3a622b94bd59]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1c6be653-7ab8-4b40-9e28-43c1eca5e016\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fb47e85c-aaa9-4165-8be3-125572b68a87\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:22:18 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:22:18 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:22:18 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c64bbf7-53a7-45cd-8ea7-c14f1465fcb0]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c6be653-7ab8-4b40-9e28-43c1eca5e016 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb47e85c-aaa9-4165-8be3-125572b68a87 (non-flash)\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:22:18 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-43064d7d-afca-4d1b-a704-4b98454e8ffb tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)
Aug 09 15:22:18 user nova-compute[72382]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c6be653-7ab8-4b40-9e28-43c1eca5e016 (non-flash)
Aug 09 15:22:18 user nova-compute[72382]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb47e85c-aaa9-4165-8be3-125572b68a87 (non-flash)
Aug 09 15:22:18 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 15:22:18 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-43064d7d-afca-4d1b-a704-4b98454e8ffb tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)
Aug 09 15:22:18 user nova-compute[72382]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c6be653-7ab8-4b40-9e28-43c1eca5e016 (non-flash)
Aug 09 15:22:18 user nova-compute[72382]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb47e85c-aaa9-4165-8be3-125572b68a87 (non-flash)
Aug 09 15:22:18 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 15:22:18 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-43064d7d-afca-4d1b-a704-4b98454e8ffb tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2a0c37b5b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1c6be653-7ab8-4b40-9e28-43c1eca5e016'): ({'sdg'}, set())}) {{(pid=72382) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 15:22:18 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-43064d7d-afca-4d1b-a704-4b98454e8ffb tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] Removing single pathed devices sdg {{(pid=72382) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 15:22:18 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:22:18 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:22:18 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[728b534c-b63c-41d0-99eb-d846e0c35665]: (4, ('path checker states:\nup                  2\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:22:18 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:22:18 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.018s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:22:18 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[f419cb90-3a66-45d9-8d58-a5e3b806a740]: (4, ('ok\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:22:18 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-43064d7d-afca-4d1b-a704-4b98454e8ffb tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] Flushing IO for device /dev/sdg {{(pid=72382) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 15:22:18 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:22:18 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.018s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:22:18 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a40757a-99e7-4144-bec7-b28e3d0c0080]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:22:18 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-43064d7d-afca-4d1b-a704-4b98454e8ffb tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=72382) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 15:22:18 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:22:18 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.041s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:22:18 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[ced31d15-edcc-483c-9522-80a27c6cec2d]: (4, ('1', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:22:18 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-43064d7d-afca-4d1b-a704-4b98454e8ffb tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=72382) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 15:22:18 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-43064d7d-afca-4d1b-a704-4b98454e8ffb tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] SCSI volumes sdg have been removed. {{(pid=72382) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 15:22:18 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-43064d7d-afca-4d1b-a704-4b98454e8ffb tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1c6be653-7ab8-4b40-9e28-43c1eca5e016')] {{(pid=72382) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 15:22:18 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c6be653-7ab8-4b40-9e28-43c1eca5e016 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:22:18 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c6be653-7ab8-4b40-9e28-43c1eca5e016 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:22:18 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fcf8622-b774-49dd-8177-d226b648595e]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:22:18 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-43064d7d-afca-4d1b-a704-4b98454e8ffb tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:22:18 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c6be653-7ab8-4b40-9e28-43c1eca5e016 -p 172.16.0.220:3260 --logout {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:22:19 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c6be653-7ab8-4b40-9e28-43c1eca5e016 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:22:19 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc637fb7-6c19-4bda-b85f-7eb5f98de468]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:1c6be653-7ab8-4b40-9e28-43c1eca5e016, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:1c6be653-7ab8-4b40-9e28-43c1eca5e016, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:22:19 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-43064d7d-afca-4d1b-a704-4b98454e8ffb tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:1c6be653-7ab8-4b40-9e28-43c1eca5e016, portal: 172.16.0.220,3260]
Aug 09 15:22:19 user nova-compute[72382]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:1c6be653-7ab8-4b40-9e28-43c1eca5e016, portal: 172.16.0.220,3260] successful.
Aug 09 15:22:19 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:22:19 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c6be653-7ab8-4b40-9e28-43c1eca5e016 -p 172.16.0.220:3260 --op delete {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:22:19 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c6be653-7ab8-4b40-9e28-43c1eca5e016 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:22:19 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a98752f-bf0f-4d3a-bae2-b178e026b346]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:22:19 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-43064d7d-afca-4d1b-a704-4b98454e8ffb tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:22:19 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-43064d7d-afca-4d1b-a704-4b98454e8ffb tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.288s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 15:22:19 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-43064d7d-afca-4d1b-a704-4b98454e8ffb tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] <== disconnect_volume: return (289ms) None {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 15:22:19 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-43064d7d-afca-4d1b-a704-4b98454e8ffb tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] [instance: cff2fb57-7d0b-4278-89ed-10a8ec5128ea] Disconnected iSCSI Volume {{(pid=72382) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 15:22:19 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-43064d7d-afca-4d1b-a704-4b98454e8ffb tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] [instance: cff2fb57-7d0b-4278-89ed-10a8ec5128ea] Deleting instance files /opt/stack/data/nova/instances/cff2fb57-7d0b-4278-89ed-10a8ec5128ea_del
Aug 09 15:22:19 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-43064d7d-afca-4d1b-a704-4b98454e8ffb tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] [instance: cff2fb57-7d0b-4278-89ed-10a8ec5128ea] Deletion of /opt/stack/data/nova/instances/cff2fb57-7d0b-4278-89ed-10a8ec5128ea_del complete
Aug 09 15:22:19 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:22:19 user nova-compute[72382]: INFO nova.compute.manager [None req-43064d7d-afca-4d1b-a704-4b98454e8ffb tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] [instance: cff2fb57-7d0b-4278-89ed-10a8ec5128ea] Took 3.75 seconds to destroy the instance on the hypervisor.
Aug 09 15:22:19 user nova-compute[72382]: DEBUG oslo.service.loopingcall [None req-43064d7d-afca-4d1b-a704-4b98454e8ffb tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72382) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 15:22:19 user nova-compute[72382]: DEBUG nova.compute.manager [-] [instance: cff2fb57-7d0b-4278-89ed-10a8ec5128ea] Deallocating network for instance {{(pid=72382) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 15:22:19 user nova-compute[72382]: DEBUG nova.network.neutron [-] [instance: cff2fb57-7d0b-4278-89ed-10a8ec5128ea] deallocate_for_instance() {{(pid=72382) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 15:22:19 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:22:19 user nova-compute[72382]: DEBUG nova.compute.manager [None req-a96be5d9-2d97-44e6-b7d7-982c25f85e5b tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] [instance: 83ebfda8-235d-4404-a973-991d75ae2bf6] Preparing to wait for external event volume-reimaged-1cd86701-a303-4744-bf0c-31b5314bb87d {{(pid=72382) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Aug 09 15:22:19 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-a96be5d9-2d97-44e6-b7d7-982c25f85e5b tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] Acquiring lock "83ebfda8-235d-4404-a973-991d75ae2bf6-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:22:19 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-a96be5d9-2d97-44e6-b7d7-982c25f85e5b tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] Lock "83ebfda8-235d-4404-a973-991d75ae2bf6-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:22:19 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-a96be5d9-2d97-44e6-b7d7-982c25f85e5b tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] Lock "83ebfda8-235d-4404-a973-991d75ae2bf6-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:22:19 user nova-compute[72382]: DEBUG nova.compute.manager [req-007dca85-f823-440b-b167-66b2d66726a8 req-e813041f-567e-4b8e-83f6-916ae725bd3f service nova] [instance: cff2fb57-7d0b-4278-89ed-10a8ec5128ea] Received event network-vif-plugged-802211f2-fc95-4940-87bf-eb0658b56ff1 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:22:19 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-007dca85-f823-440b-b167-66b2d66726a8 req-e813041f-567e-4b8e-83f6-916ae725bd3f service nova] Acquiring lock "cff2fb57-7d0b-4278-89ed-10a8ec5128ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:22:19 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-007dca85-f823-440b-b167-66b2d66726a8 req-e813041f-567e-4b8e-83f6-916ae725bd3f service nova] Lock "cff2fb57-7d0b-4278-89ed-10a8ec5128ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:22:19 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-007dca85-f823-440b-b167-66b2d66726a8 req-e813041f-567e-4b8e-83f6-916ae725bd3f service nova] Lock "cff2fb57-7d0b-4278-89ed-10a8ec5128ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:22:19 user nova-compute[72382]: DEBUG nova.compute.manager [req-007dca85-f823-440b-b167-66b2d66726a8 req-e813041f-567e-4b8e-83f6-916ae725bd3f service nova] [instance: cff2fb57-7d0b-4278-89ed-10a8ec5128ea] No waiting events found dispatching network-vif-plugged-802211f2-fc95-4940-87bf-eb0658b56ff1 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:22:19 user nova-compute[72382]: WARNING nova.compute.manager [req-007dca85-f823-440b-b167-66b2d66726a8 req-e813041f-567e-4b8e-83f6-916ae725bd3f service nova] [instance: cff2fb57-7d0b-4278-89ed-10a8ec5128ea] Received unexpected event network-vif-plugged-802211f2-fc95-4940-87bf-eb0658b56ff1 for instance with vm_state active and task_state deleting.
Aug 09 15:22:19 user nova-compute[72382]: DEBUG nova.compute.manager [req-007dca85-f823-440b-b167-66b2d66726a8 req-e813041f-567e-4b8e-83f6-916ae725bd3f service nova] [instance: cff2fb57-7d0b-4278-89ed-10a8ec5128ea] Received event network-vif-unplugged-bcf9d83a-a145-4d83-9df6-02eba42f64bf {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:22:19 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-007dca85-f823-440b-b167-66b2d66726a8 req-e813041f-567e-4b8e-83f6-916ae725bd3f service nova] Acquiring lock "cff2fb57-7d0b-4278-89ed-10a8ec5128ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:22:19 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-007dca85-f823-440b-b167-66b2d66726a8 req-e813041f-567e-4b8e-83f6-916ae725bd3f service nova] Lock "cff2fb57-7d0b-4278-89ed-10a8ec5128ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:22:19 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-007dca85-f823-440b-b167-66b2d66726a8 req-e813041f-567e-4b8e-83f6-916ae725bd3f service nova] Lock "cff2fb57-7d0b-4278-89ed-10a8ec5128ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:22:19 user nova-compute[72382]: DEBUG nova.compute.manager [req-007dca85-f823-440b-b167-66b2d66726a8 req-e813041f-567e-4b8e-83f6-916ae725bd3f service nova] [instance: cff2fb57-7d0b-4278-89ed-10a8ec5128ea] No waiting events found dispatching network-vif-unplugged-bcf9d83a-a145-4d83-9df6-02eba42f64bf {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:22:19 user nova-compute[72382]: DEBUG nova.compute.manager [req-007dca85-f823-440b-b167-66b2d66726a8 req-e813041f-567e-4b8e-83f6-916ae725bd3f service nova] [instance: cff2fb57-7d0b-4278-89ed-10a8ec5128ea] Received event network-vif-unplugged-bcf9d83a-a145-4d83-9df6-02eba42f64bf for instance with task_state deleting. {{(pid=72382) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 15:22:19 user nova-compute[72382]: DEBUG nova.compute.manager [req-007dca85-f823-440b-b167-66b2d66726a8 req-e813041f-567e-4b8e-83f6-916ae725bd3f service nova] [instance: cff2fb57-7d0b-4278-89ed-10a8ec5128ea] Received event network-vif-plugged-bcf9d83a-a145-4d83-9df6-02eba42f64bf {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:22:19 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-007dca85-f823-440b-b167-66b2d66726a8 req-e813041f-567e-4b8e-83f6-916ae725bd3f service nova] Acquiring lock "cff2fb57-7d0b-4278-89ed-10a8ec5128ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:22:19 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-007dca85-f823-440b-b167-66b2d66726a8 req-e813041f-567e-4b8e-83f6-916ae725bd3f service nova] Lock "cff2fb57-7d0b-4278-89ed-10a8ec5128ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:22:19 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-007dca85-f823-440b-b167-66b2d66726a8 req-e813041f-567e-4b8e-83f6-916ae725bd3f service nova] Lock "cff2fb57-7d0b-4278-89ed-10a8ec5128ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:22:19 user nova-compute[72382]: DEBUG nova.compute.manager [req-007dca85-f823-440b-b167-66b2d66726a8 req-e813041f-567e-4b8e-83f6-916ae725bd3f service nova] [instance: cff2fb57-7d0b-4278-89ed-10a8ec5128ea] No waiting events found dispatching network-vif-plugged-bcf9d83a-a145-4d83-9df6-02eba42f64bf {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:22:20 user nova-compute[72382]: WARNING nova.compute.manager [req-007dca85-f823-440b-b167-66b2d66726a8 req-e813041f-567e-4b8e-83f6-916ae725bd3f service nova] [instance: cff2fb57-7d0b-4278-89ed-10a8ec5128ea] Received unexpected event network-vif-plugged-bcf9d83a-a145-4d83-9df6-02eba42f64bf for instance with vm_state active and task_state deleting.
Aug 09 15:22:20 user nova-compute[72382]: DEBUG nova.compute.manager [req-007dca85-f823-440b-b167-66b2d66726a8 req-e813041f-567e-4b8e-83f6-916ae725bd3f service nova] [instance: 83ebfda8-235d-4404-a973-991d75ae2bf6] Received event network-vif-unplugged-b2646c3a-cc2a-4782-a312-0582f2d377b1 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:22:20 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-007dca85-f823-440b-b167-66b2d66726a8 req-e813041f-567e-4b8e-83f6-916ae725bd3f service nova] Acquiring lock "83ebfda8-235d-4404-a973-991d75ae2bf6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:22:20 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-007dca85-f823-440b-b167-66b2d66726a8 req-e813041f-567e-4b8e-83f6-916ae725bd3f service nova] Lock "83ebfda8-235d-4404-a973-991d75ae2bf6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:22:20 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-007dca85-f823-440b-b167-66b2d66726a8 req-e813041f-567e-4b8e-83f6-916ae725bd3f service nova] Lock "83ebfda8-235d-4404-a973-991d75ae2bf6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:22:20 user nova-compute[72382]: DEBUG nova.compute.manager [req-007dca85-f823-440b-b167-66b2d66726a8 req-e813041f-567e-4b8e-83f6-916ae725bd3f service nova] [instance: 83ebfda8-235d-4404-a973-991d75ae2bf6] No event matching network-vif-unplugged-b2646c3a-cc2a-4782-a312-0582f2d377b1 in dict_keys([('volume-reimaged', '1cd86701-a303-4744-bf0c-31b5314bb87d')]) {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:325}}
Aug 09 15:22:20 user nova-compute[72382]: WARNING nova.compute.manager [req-007dca85-f823-440b-b167-66b2d66726a8 req-e813041f-567e-4b8e-83f6-916ae725bd3f service nova] [instance: 83ebfda8-235d-4404-a973-991d75ae2bf6] Received unexpected event network-vif-unplugged-b2646c3a-cc2a-4782-a312-0582f2d377b1 for instance with vm_state active and task_state rebuilding.
Aug 09 15:22:20 user nova-compute[72382]: DEBUG nova.compute.manager [req-007dca85-f823-440b-b167-66b2d66726a8 req-e813041f-567e-4b8e-83f6-916ae725bd3f service nova] [instance: 83ebfda8-235d-4404-a973-991d75ae2bf6] Received event network-vif-plugged-b2646c3a-cc2a-4782-a312-0582f2d377b1 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:22:20 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-007dca85-f823-440b-b167-66b2d66726a8 req-e813041f-567e-4b8e-83f6-916ae725bd3f service nova] Acquiring lock "83ebfda8-235d-4404-a973-991d75ae2bf6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:22:20 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-007dca85-f823-440b-b167-66b2d66726a8 req-e813041f-567e-4b8e-83f6-916ae725bd3f service nova] Lock "83ebfda8-235d-4404-a973-991d75ae2bf6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:22:20 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-007dca85-f823-440b-b167-66b2d66726a8 req-e813041f-567e-4b8e-83f6-916ae725bd3f service nova] Lock "83ebfda8-235d-4404-a973-991d75ae2bf6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:22:20 user nova-compute[72382]: DEBUG nova.compute.manager [req-007dca85-f823-440b-b167-66b2d66726a8 req-e813041f-567e-4b8e-83f6-916ae725bd3f service nova] [instance: 83ebfda8-235d-4404-a973-991d75ae2bf6] No event matching network-vif-plugged-b2646c3a-cc2a-4782-a312-0582f2d377b1 in dict_keys([('volume-reimaged', '1cd86701-a303-4744-bf0c-31b5314bb87d')]) {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:325}}
Aug 09 15:22:20 user nova-compute[72382]: WARNING nova.compute.manager [req-007dca85-f823-440b-b167-66b2d66726a8 req-e813041f-567e-4b8e-83f6-916ae725bd3f service nova] [instance: 83ebfda8-235d-4404-a973-991d75ae2bf6] Received unexpected event network-vif-plugged-b2646c3a-cc2a-4782-a312-0582f2d377b1 for instance with vm_state active and task_state rebuilding.
Aug 09 15:22:21 user nova-compute[72382]: DEBUG nova.compute.manager [req-804d55d4-c64b-46ea-9a2e-66cc7927fc47 req-546bf11e-7f13-4cc2-98fe-457fe79c99d9 service nova] [instance: cff2fb57-7d0b-4278-89ed-10a8ec5128ea] Received event network-vif-deleted-ce3acf5c-2e65-4650-aade-158b96a7d349 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:22:21 user nova-compute[72382]: INFO nova.compute.manager [req-804d55d4-c64b-46ea-9a2e-66cc7927fc47 req-546bf11e-7f13-4cc2-98fe-457fe79c99d9 service nova] [instance: cff2fb57-7d0b-4278-89ed-10a8ec5128ea] Neutron deleted interface ce3acf5c-2e65-4650-aade-158b96a7d349; detaching it from the instance and deleting it from the info cache
Aug 09 15:22:21 user nova-compute[72382]: DEBUG nova.network.neutron [req-804d55d4-c64b-46ea-9a2e-66cc7927fc47 req-546bf11e-7f13-4cc2-98fe-457fe79c99d9 service nova] [instance: cff2fb57-7d0b-4278-89ed-10a8ec5128ea] Updating instance_info_cache with network_info: [{"id": "477e93e2-c6aa-47e7-bed7-62b4bb29a9ea", "address": "fa:16:3e:46:0b:d6", "network": {"id": "5f1aee90-5c93-4fe5-a140-7e3ac136489f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1100115541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42fe649aa7cd43678bd4f2cb24f45e18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap477e93e2-c6", "ovs_interfaceid": "477e93e2-c6aa-47e7-bed7-62b4bb29a9ea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "55cf98ab-8cd2-4704-971f-ee4ceebca331", "address": "fa:16:3e:8c:34:e0", "network": {"id": "dc656a4e-c46c-4821-b492-2376b82b26ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-2053726028", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "42fe649aa7cd43678bd4f2cb24f45e18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55cf98ab-8c", "ovs_interfaceid": "55cf98ab-8cd2-4704-971f-ee4ceebca331", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "baeec4fc-3670-49f3-b42c-aab5ea116f45", "address": "fa:16:3e:72:b4:02", "network": {"id": "dc656a4e-c46c-4821-b492-2376b82b26ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-2053726028", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.135", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "42fe649aa7cd43678bd4f2cb24f45e18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbaeec4fc-36", "ovs_interfaceid": "baeec4fc-3670-49f3-b42c-aab5ea116f45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "17d8899d-82c0-4a46-97de-31253f7d1b82", "address": "fa:16:3e:7b:f5:ee", "network": {"id": "dc656a4e-c46c-4821-b492-2376b82b26ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-2053726028", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.153", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "42fe649aa7cd43678bd4f2cb24f45e18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17d8899d-82", "ovs_interfaceid": "17d8899d-82c0-4a46-97de-31253f7d1b82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "802211f2-fc95-4940-87bf-eb0658b56ff1", "address": "fa:16:3e:dd:68:92", "network": {"id": "c8d9a670-b921-4ea7-bc32-64ef779aa86c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1431242330", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "42fe649aa7cd43678bd4f2cb24f45e18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap802211f2-fc", "ovs_interfaceid": "802211f2-fc95-4940-87bf-eb0658b56ff1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bcf9d83a-a145-4d83-9df6-02eba42f64bf", "address": "fa:16:3e:98:67:3f", "network": {"id": "c8d9a670-b921-4ea7-bc32-64ef779aa86c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1431242330", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "42fe649aa7cd43678bd4f2cb24f45e18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcf9d83a-a1", "ovs_interfaceid": "bcf9d83a-a145-4d83-9df6-02eba42f64bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:22:22 user nova-compute[72382]: DEBUG nova.compute.manager [req-804d55d4-c64b-46ea-9a2e-66cc7927fc47 req-546bf11e-7f13-4cc2-98fe-457fe79c99d9 service nova] [instance: cff2fb57-7d0b-4278-89ed-10a8ec5128ea] Detach interface failed, port_id=ce3acf5c-2e65-4650-aade-158b96a7d349, reason: Instance cff2fb57-7d0b-4278-89ed-10a8ec5128ea could not be found. {{(pid=72382) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 09 15:22:22 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:22:22 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:22:24 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:22:24 user nova-compute[72382]: DEBUG nova.compute.manager [req-d5e00cd3-3718-4f7d-9353-eb051f11790a req-9ad861be-80eb-4d07-9abf-9d7f6a5eadf1 service nova] [instance: cff2fb57-7d0b-4278-89ed-10a8ec5128ea] Received event network-vif-deleted-bcf9d83a-a145-4d83-9df6-02eba42f64bf {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:22:24 user nova-compute[72382]: INFO nova.compute.manager [req-d5e00cd3-3718-4f7d-9353-eb051f11790a req-9ad861be-80eb-4d07-9abf-9d7f6a5eadf1 service nova] [instance: cff2fb57-7d0b-4278-89ed-10a8ec5128ea] Neutron deleted interface bcf9d83a-a145-4d83-9df6-02eba42f64bf; detaching it from the instance and deleting it from the info cache
Aug 09 15:22:24 user nova-compute[72382]: DEBUG nova.network.neutron [req-d5e00cd3-3718-4f7d-9353-eb051f11790a req-9ad861be-80eb-4d07-9abf-9d7f6a5eadf1 service nova] [instance: cff2fb57-7d0b-4278-89ed-10a8ec5128ea] Updating instance_info_cache with network_info: [{"id": "477e93e2-c6aa-47e7-bed7-62b4bb29a9ea", "address": "fa:16:3e:46:0b:d6", "network": {"id": "5f1aee90-5c93-4fe5-a140-7e3ac136489f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1100115541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42fe649aa7cd43678bd4f2cb24f45e18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap477e93e2-c6", "ovs_interfaceid": "477e93e2-c6aa-47e7-bed7-62b4bb29a9ea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "55cf98ab-8cd2-4704-971f-ee4ceebca331", "address": "fa:16:3e:8c:34:e0", "network": {"id": "dc656a4e-c46c-4821-b492-2376b82b26ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-2053726028", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "42fe649aa7cd43678bd4f2cb24f45e18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55cf98ab-8c", "ovs_interfaceid": "55cf98ab-8cd2-4704-971f-ee4ceebca331", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "baeec4fc-3670-49f3-b42c-aab5ea116f45", "address": "fa:16:3e:72:b4:02", "network": {"id": "dc656a4e-c46c-4821-b492-2376b82b26ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-2053726028", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.135", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "42fe649aa7cd43678bd4f2cb24f45e18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbaeec4fc-36", "ovs_interfaceid": "baeec4fc-3670-49f3-b42c-aab5ea116f45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "17d8899d-82c0-4a46-97de-31253f7d1b82", "address": "fa:16:3e:7b:f5:ee", "network": {"id": "dc656a4e-c46c-4821-b492-2376b82b26ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-2053726028", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.153", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "42fe649aa7cd43678bd4f2cb24f45e18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17d8899d-82", "ovs_interfaceid": "17d8899d-82c0-4a46-97de-31253f7d1b82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "802211f2-fc95-4940-87bf-eb0658b56ff1", "address": "fa:16:3e:dd:68:92", "network": {"id": "c8d9a670-b921-4ea7-bc32-64ef779aa86c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1431242330", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "42fe649aa7cd43678bd4f2cb24f45e18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap802211f2-fc", "ovs_interfaceid": "802211f2-fc95-4940-87bf-eb0658b56ff1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:22:24 user nova-compute[72382]: DEBUG nova.compute.manager [req-d5e00cd3-3718-4f7d-9353-eb051f11790a req-9ad861be-80eb-4d07-9abf-9d7f6a5eadf1 service nova] [instance: cff2fb57-7d0b-4278-89ed-10a8ec5128ea] Detach interface failed, port_id=bcf9d83a-a145-4d83-9df6-02eba42f64bf, reason: Instance cff2fb57-7d0b-4278-89ed-10a8ec5128ea could not be found. {{(pid=72382) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 09 15:22:24 user nova-compute[72382]: DEBUG nova.compute.manager [req-d5e00cd3-3718-4f7d-9353-eb051f11790a req-9ad861be-80eb-4d07-9abf-9d7f6a5eadf1 service nova] [instance: cff2fb57-7d0b-4278-89ed-10a8ec5128ea] Received event network-vif-deleted-17d8899d-82c0-4a46-97de-31253f7d1b82 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:22:24 user nova-compute[72382]: INFO nova.compute.manager [req-d5e00cd3-3718-4f7d-9353-eb051f11790a req-9ad861be-80eb-4d07-9abf-9d7f6a5eadf1 service nova] [instance: cff2fb57-7d0b-4278-89ed-10a8ec5128ea] Neutron deleted interface 17d8899d-82c0-4a46-97de-31253f7d1b82; detaching it from the instance and deleting it from the info cache
Aug 09 15:22:24 user nova-compute[72382]: DEBUG nova.network.neutron [req-d5e00cd3-3718-4f7d-9353-eb051f11790a req-9ad861be-80eb-4d07-9abf-9d7f6a5eadf1 service nova] [instance: cff2fb57-7d0b-4278-89ed-10a8ec5128ea] Updating instance_info_cache with network_info: [{"id": "477e93e2-c6aa-47e7-bed7-62b4bb29a9ea", "address": "fa:16:3e:46:0b:d6", "network": {"id": "5f1aee90-5c93-4fe5-a140-7e3ac136489f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1100115541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42fe649aa7cd43678bd4f2cb24f45e18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap477e93e2-c6", "ovs_interfaceid": "477e93e2-c6aa-47e7-bed7-62b4bb29a9ea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "55cf98ab-8cd2-4704-971f-ee4ceebca331", "address": "fa:16:3e:8c:34:e0", "network": {"id": "dc656a4e-c46c-4821-b492-2376b82b26ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-2053726028", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "42fe649aa7cd43678bd4f2cb24f45e18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55cf98ab-8c", "ovs_interfaceid": "55cf98ab-8cd2-4704-971f-ee4ceebca331", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "baeec4fc-3670-49f3-b42c-aab5ea116f45", "address": "fa:16:3e:72:b4:02", "network": {"id": "dc656a4e-c46c-4821-b492-2376b82b26ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-2053726028", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.135", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "42fe649aa7cd43678bd4f2cb24f45e18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbaeec4fc-36", "ovs_interfaceid": "baeec4fc-3670-49f3-b42c-aab5ea116f45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "802211f2-fc95-4940-87bf-eb0658b56ff1", "address": "fa:16:3e:dd:68:92", "network": {"id": "c8d9a670-b921-4ea7-bc32-64ef779aa86c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1431242330", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "42fe649aa7cd43678bd4f2cb24f45e18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap802211f2-fc", "ovs_interfaceid": "802211f2-fc95-4940-87bf-eb0658b56ff1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:22:24 user nova-compute[72382]: DEBUG nova.compute.manager [req-d5e00cd3-3718-4f7d-9353-eb051f11790a req-9ad861be-80eb-4d07-9abf-9d7f6a5eadf1 service nova] [instance: cff2fb57-7d0b-4278-89ed-10a8ec5128ea] Detach interface failed, port_id=17d8899d-82c0-4a46-97de-31253f7d1b82, reason: Instance cff2fb57-7d0b-4278-89ed-10a8ec5128ea could not be found. {{(pid=72382) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 09 15:22:24 user nova-compute[72382]: DEBUG nova.compute.manager [req-d5e00cd3-3718-4f7d-9353-eb051f11790a req-9ad861be-80eb-4d07-9abf-9d7f6a5eadf1 service nova] [instance: cff2fb57-7d0b-4278-89ed-10a8ec5128ea] Received event network-vif-deleted-802211f2-fc95-4940-87bf-eb0658b56ff1 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:22:24 user nova-compute[72382]: INFO nova.compute.manager [req-d5e00cd3-3718-4f7d-9353-eb051f11790a req-9ad861be-80eb-4d07-9abf-9d7f6a5eadf1 service nova] [instance: cff2fb57-7d0b-4278-89ed-10a8ec5128ea] Neutron deleted interface 802211f2-fc95-4940-87bf-eb0658b56ff1; detaching it from the instance and deleting it from the info cache
Aug 09 15:22:24 user nova-compute[72382]: DEBUG nova.network.neutron [req-d5e00cd3-3718-4f7d-9353-eb051f11790a req-9ad861be-80eb-4d07-9abf-9d7f6a5eadf1 service nova] [instance: cff2fb57-7d0b-4278-89ed-10a8ec5128ea] Updating instance_info_cache with network_info: [{"id": "477e93e2-c6aa-47e7-bed7-62b4bb29a9ea", "address": "fa:16:3e:46:0b:d6", "network": {"id": "5f1aee90-5c93-4fe5-a140-7e3ac136489f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1100115541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42fe649aa7cd43678bd4f2cb24f45e18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap477e93e2-c6", "ovs_interfaceid": "477e93e2-c6aa-47e7-bed7-62b4bb29a9ea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "55cf98ab-8cd2-4704-971f-ee4ceebca331", "address": "fa:16:3e:8c:34:e0", "network": {"id": "dc656a4e-c46c-4821-b492-2376b82b26ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-2053726028", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "42fe649aa7cd43678bd4f2cb24f45e18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55cf98ab-8c", "ovs_interfaceid": "55cf98ab-8cd2-4704-971f-ee4ceebca331", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "baeec4fc-3670-49f3-b42c-aab5ea116f45", "address": "fa:16:3e:72:b4:02", "network": {"id": "dc656a4e-c46c-4821-b492-2376b82b26ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-2053726028", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.135", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "42fe649aa7cd43678bd4f2cb24f45e18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbaeec4fc-36", "ovs_interfaceid": "baeec4fc-3670-49f3-b42c-aab5ea116f45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:22:24 user nova-compute[72382]: DEBUG nova.network.neutron [-] [instance: cff2fb57-7d0b-4278-89ed-10a8ec5128ea] Updating instance_info_cache with network_info: [] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:22:24 user nova-compute[72382]: DEBUG nova.compute.manager [req-d5e00cd3-3718-4f7d-9353-eb051f11790a req-9ad861be-80eb-4d07-9abf-9d7f6a5eadf1 service nova] [instance: cff2fb57-7d0b-4278-89ed-10a8ec5128ea] Detach interface failed, port_id=802211f2-fc95-4940-87bf-eb0658b56ff1, reason: Instance cff2fb57-7d0b-4278-89ed-10a8ec5128ea could not be found. {{(pid=72382) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 09 15:22:24 user nova-compute[72382]: INFO nova.compute.manager [-] [instance: cff2fb57-7d0b-4278-89ed-10a8ec5128ea] Took 5.12 seconds to deallocate network for instance.
Aug 09 15:22:26 user nova-compute[72382]: DEBUG nova.compute.manager [req-7fd30828-9776-4b79-99fe-d827998a7f10 req-49703841-8dfd-47de-8b3e-3d79a30870a1 service nova] [instance: cff2fb57-7d0b-4278-89ed-10a8ec5128ea] Received event network-vif-deleted-477e93e2-c6aa-47e7-bed7-62b4bb29a9ea {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:22:26 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:22:27 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:22:29 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:22:29 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:22:29 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:22:31 user nova-compute[72382]: INFO nova.compute.manager [None req-43064d7d-afca-4d1b-a704-4b98454e8ffb tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] [instance: cff2fb57-7d0b-4278-89ed-10a8ec5128ea] Took 6.86 seconds to detach 3 volumes for instance.
Aug 09 15:22:31 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-43064d7d-afca-4d1b-a704-4b98454e8ffb tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:22:31 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-43064d7d-afca-4d1b-a704-4b98454e8ffb tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:22:31 user nova-compute[72382]: DEBUG nova.compute.provider_tree [None req-43064d7d-afca-4d1b-a704-4b98454e8ffb tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] Inventory has not changed in ProviderTree for provider: 7b15b0e5-df4d-49db-833b-2855d21d10ae {{(pid=72382) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 15:22:31 user nova-compute[72382]: DEBUG nova.scheduler.client.report [None req-43064d7d-afca-4d1b-a704-4b98454e8ffb tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] Inventory has not changed for provider 7b15b0e5-df4d-49db-833b-2855d21d10ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72382) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 15:22:31 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-43064d7d-afca-4d1b-a704-4b98454e8ffb tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.345s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:22:31 user nova-compute[72382]: INFO nova.scheduler.client.report [None req-43064d7d-afca-4d1b-a704-4b98454e8ffb tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] Deleted allocations for instance cff2fb57-7d0b-4278-89ed-10a8ec5128ea
Aug 09 15:22:31 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-43064d7d-afca-4d1b-a704-4b98454e8ffb tempest-TaggedBootDevicesTest_v242-1511835318 tempest-TaggedBootDevicesTest_v242-1511835318-project-member] Lock "cff2fb57-7d0b-4278-89ed-10a8ec5128ea" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 16.289s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:22:32 user nova-compute[72382]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691594537.3823395, cff2fb57-7d0b-4278-89ed-10a8ec5128ea => Stopped> {{(pid=72382) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 15:22:32 user nova-compute[72382]: INFO nova.compute.manager [-] [instance: cff2fb57-7d0b-4278-89ed-10a8ec5128ea] VM Stopped (Lifecycle Event)
Aug 09 15:22:32 user nova-compute[72382]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691594537.3856168, 83ebfda8-235d-4404-a973-991d75ae2bf6 => Stopped> {{(pid=72382) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 15:22:32 user nova-compute[72382]: INFO nova.compute.manager [-] [instance: 83ebfda8-235d-4404-a973-991d75ae2bf6] VM Stopped (Lifecycle Event)
Aug 09 15:22:32 user nova-compute[72382]: DEBUG nova.compute.manager [None req-fdbf030b-83ab-4496-a6f4-6a8fa5d2c9b6 None None] [instance: cff2fb57-7d0b-4278-89ed-10a8ec5128ea] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:22:32 user nova-compute[72382]: DEBUG nova.compute.manager [None req-4138815a-b049-4ec4-8ca3-77c3e733c847 None None] [instance: 83ebfda8-235d-4404-a973-991d75ae2bf6] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:22:32 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:22:33 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-a42da0a7-de33-4342-b78b-58a8343d9485 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] Acquiring lock "6296ba5d-bcc6-405a-a635-0e9aa6114f7b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:22:33 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-a42da0a7-de33-4342-b78b-58a8343d9485 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] Lock "6296ba5d-bcc6-405a-a635-0e9aa6114f7b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:22:33 user nova-compute[72382]: DEBUG nova.compute.manager [None req-a42da0a7-de33-4342-b78b-58a8343d9485 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] [instance: 6296ba5d-bcc6-405a-a635-0e9aa6114f7b] Starting instance... {{(pid=72382) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 15:22:33 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-a42da0a7-de33-4342-b78b-58a8343d9485 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:22:33 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-a42da0a7-de33-4342-b78b-58a8343d9485 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:22:33 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-a42da0a7-de33-4342-b78b-58a8343d9485 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72382) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 15:22:33 user nova-compute[72382]: INFO nova.compute.claims [None req-a42da0a7-de33-4342-b78b-58a8343d9485 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] [instance: 6296ba5d-bcc6-405a-a635-0e9aa6114f7b] Claim successful on node user
Aug 09 15:22:34 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:22:34 user nova-compute[72382]: DEBUG nova.compute.provider_tree [None req-a42da0a7-de33-4342-b78b-58a8343d9485 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] Inventory has not changed in ProviderTree for provider: 7b15b0e5-df4d-49db-833b-2855d21d10ae {{(pid=72382) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 15:22:34 user nova-compute[72382]: DEBUG nova.scheduler.client.report [None req-a42da0a7-de33-4342-b78b-58a8343d9485 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] Inventory has not changed for provider 7b15b0e5-df4d-49db-833b-2855d21d10ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72382) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 15:22:34 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-a42da0a7-de33-4342-b78b-58a8343d9485 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.447s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:22:34 user nova-compute[72382]: DEBUG nova.compute.manager [None req-a42da0a7-de33-4342-b78b-58a8343d9485 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] [instance: 6296ba5d-bcc6-405a-a635-0e9aa6114f7b] Start building networks asynchronously for instance. {{(pid=72382) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 15:22:34 user nova-compute[72382]: DEBUG nova.compute.manager [None req-a42da0a7-de33-4342-b78b-58a8343d9485 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] [instance: 6296ba5d-bcc6-405a-a635-0e9aa6114f7b] Allocating IP information in the background. {{(pid=72382) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 15:22:34 user nova-compute[72382]: DEBUG nova.network.neutron [None req-a42da0a7-de33-4342-b78b-58a8343d9485 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] [instance: 6296ba5d-bcc6-405a-a635-0e9aa6114f7b] allocate_for_instance() {{(pid=72382) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 15:22:34 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-a42da0a7-de33-4342-b78b-58a8343d9485 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] [instance: 6296ba5d-bcc6-405a-a635-0e9aa6114f7b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 15:22:34 user nova-compute[72382]: DEBUG nova.compute.manager [None req-a42da0a7-de33-4342-b78b-58a8343d9485 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] [instance: 6296ba5d-bcc6-405a-a635-0e9aa6114f7b] Start building block device mappings for instance. {{(pid=72382) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 15:22:34 user nova-compute[72382]: DEBUG nova.policy [None req-a42da0a7-de33-4342-b78b-58a8343d9485 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e5a4e350207e43ea99f5f828990ff999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3091c1fc764326b65d9db6f1de9746', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72382) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 15:22:34 user nova-compute[72382]: DEBUG nova.compute.manager [None req-a42da0a7-de33-4342-b78b-58a8343d9485 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] [instance: 6296ba5d-bcc6-405a-a635-0e9aa6114f7b] Start spawning the instance on the hypervisor. {{(pid=72382) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 15:22:34 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-a42da0a7-de33-4342-b78b-58a8343d9485 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] [instance: 6296ba5d-bcc6-405a-a635-0e9aa6114f7b] Creating instance directory {{(pid=72382) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 15:22:34 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-a42da0a7-de33-4342-b78b-58a8343d9485 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] [instance: 6296ba5d-bcc6-405a-a635-0e9aa6114f7b] Creating image(s)
Aug 09 15:22:34 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-a42da0a7-de33-4342-b78b-58a8343d9485 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] Acquiring lock "/opt/stack/data/nova/instances/6296ba5d-bcc6-405a-a635-0e9aa6114f7b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:22:34 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-a42da0a7-de33-4342-b78b-58a8343d9485 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] Lock "/opt/stack/data/nova/instances/6296ba5d-bcc6-405a-a635-0e9aa6114f7b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:22:34 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-a42da0a7-de33-4342-b78b-58a8343d9485 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] Lock "/opt/stack/data/nova/instances/6296ba5d-bcc6-405a-a635-0e9aa6114f7b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:22:34 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-a42da0a7-de33-4342-b78b-58a8343d9485 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:22:34 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-a42da0a7-de33-4342-b78b-58a8343d9485 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b --force-share --output=json" returned: 0 in 0.149s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:22:34 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-a42da0a7-de33-4342-b78b-58a8343d9485 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] Acquiring lock "383812ff437283e0191ed5b9ecc04c27f1162b0b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:22:34 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-a42da0a7-de33-4342-b78b-58a8343d9485 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] Lock "383812ff437283e0191ed5b9ecc04c27f1162b0b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:22:34 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-a42da0a7-de33-4342-b78b-58a8343d9485 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:22:34 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-a42da0a7-de33-4342-b78b-58a8343d9485 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b --force-share --output=json" returned: 0 in 0.136s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:22:34 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-a42da0a7-de33-4342-b78b-58a8343d9485 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b,backing_fmt=raw /opt/stack/data/nova/instances/6296ba5d-bcc6-405a-a635-0e9aa6114f7b/disk 1073741824 {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:22:35 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-a42da0a7-de33-4342-b78b-58a8343d9485 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b,backing_fmt=raw /opt/stack/data/nova/instances/6296ba5d-bcc6-405a-a635-0e9aa6114f7b/disk 1073741824" returned: 0 in 0.054s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:22:35 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-a42da0a7-de33-4342-b78b-58a8343d9485 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] Lock "383812ff437283e0191ed5b9ecc04c27f1162b0b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.197s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:22:35 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-a42da0a7-de33-4342-b78b-58a8343d9485 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:22:35 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-a42da0a7-de33-4342-b78b-58a8343d9485 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b --force-share --output=json" returned: 0 in 0.153s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:22:35 user nova-compute[72382]: DEBUG nova.virt.disk.api [None req-a42da0a7-de33-4342-b78b-58a8343d9485 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6296ba5d-bcc6-405a-a635-0e9aa6114f7b/disk. size=1073741824 {{(pid=72382) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 15:22:35 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-a42da0a7-de33-4342-b78b-58a8343d9485 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6296ba5d-bcc6-405a-a635-0e9aa6114f7b/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:22:35 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-a42da0a7-de33-4342-b78b-58a8343d9485 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6296ba5d-bcc6-405a-a635-0e9aa6114f7b/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:22:35 user nova-compute[72382]: DEBUG nova.virt.disk.api [None req-a42da0a7-de33-4342-b78b-58a8343d9485 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] Cannot resize image /opt/stack/data/nova/instances/6296ba5d-bcc6-405a-a635-0e9aa6114f7b/disk to a smaller size. {{(pid=72382) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 15:22:35 user nova-compute[72382]: DEBUG nova.objects.instance [None req-a42da0a7-de33-4342-b78b-58a8343d9485 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] Lazy-loading 'migration_context' on Instance uuid 6296ba5d-bcc6-405a-a635-0e9aa6114f7b {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:22:35 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-a42da0a7-de33-4342-b78b-58a8343d9485 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] [instance: 6296ba5d-bcc6-405a-a635-0e9aa6114f7b] Created local disks {{(pid=72382) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 15:22:35 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-a42da0a7-de33-4342-b78b-58a8343d9485 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] [instance: 6296ba5d-bcc6-405a-a635-0e9aa6114f7b] Ensure instance console log exists: /opt/stack/data/nova/instances/6296ba5d-bcc6-405a-a635-0e9aa6114f7b/console.log {{(pid=72382) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 15:22:35 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-a42da0a7-de33-4342-b78b-58a8343d9485 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:22:35 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-a42da0a7-de33-4342-b78b-58a8343d9485 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:22:35 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-a42da0a7-de33-4342-b78b-58a8343d9485 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:22:35 user nova-compute[72382]: DEBUG nova.network.neutron [None req-a42da0a7-de33-4342-b78b-58a8343d9485 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] [instance: 6296ba5d-bcc6-405a-a635-0e9aa6114f7b] Successfully created port: dc2f667c-53dc-44b5-bd9d-55b4e9a4c86b {{(pid=72382) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 15:22:36 user nova-compute[72382]: DEBUG nova.network.neutron [None req-a42da0a7-de33-4342-b78b-58a8343d9485 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] [instance: 6296ba5d-bcc6-405a-a635-0e9aa6114f7b] Successfully updated port: dc2f667c-53dc-44b5-bd9d-55b4e9a4c86b {{(pid=72382) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 15:22:36 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-a42da0a7-de33-4342-b78b-58a8343d9485 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] Acquiring lock "refresh_cache-6296ba5d-bcc6-405a-a635-0e9aa6114f7b" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 15:22:36 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-a42da0a7-de33-4342-b78b-58a8343d9485 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] Acquired lock "refresh_cache-6296ba5d-bcc6-405a-a635-0e9aa6114f7b" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 15:22:36 user nova-compute[72382]: DEBUG nova.network.neutron [None req-a42da0a7-de33-4342-b78b-58a8343d9485 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] [instance: 6296ba5d-bcc6-405a-a635-0e9aa6114f7b] Building network info cache for instance {{(pid=72382) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 15:22:36 user nova-compute[72382]: DEBUG nova.compute.manager [req-66bcaf59-6cbf-4174-93fa-3f81907304fa req-18b608ab-9a52-48f3-92e1-9a79ea71d66f service nova] [instance: 6296ba5d-bcc6-405a-a635-0e9aa6114f7b] Received event network-changed-dc2f667c-53dc-44b5-bd9d-55b4e9a4c86b {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:22:36 user nova-compute[72382]: DEBUG nova.compute.manager [req-66bcaf59-6cbf-4174-93fa-3f81907304fa req-18b608ab-9a52-48f3-92e1-9a79ea71d66f service nova] [instance: 6296ba5d-bcc6-405a-a635-0e9aa6114f7b] Refreshing instance network info cache due to event network-changed-dc2f667c-53dc-44b5-bd9d-55b4e9a4c86b. {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 15:22:36 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-66bcaf59-6cbf-4174-93fa-3f81907304fa req-18b608ab-9a52-48f3-92e1-9a79ea71d66f service nova] Acquiring lock "refresh_cache-6296ba5d-bcc6-405a-a635-0e9aa6114f7b" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 15:22:36 user nova-compute[72382]: DEBUG nova.network.neutron [None req-a42da0a7-de33-4342-b78b-58a8343d9485 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] [instance: 6296ba5d-bcc6-405a-a635-0e9aa6114f7b] Instance cache missing network info. {{(pid=72382) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 15:22:36 user nova-compute[72382]: DEBUG nova.network.neutron [None req-a42da0a7-de33-4342-b78b-58a8343d9485 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] [instance: 6296ba5d-bcc6-405a-a635-0e9aa6114f7b] Updating instance_info_cache with network_info: [{"id": "dc2f667c-53dc-44b5-bd9d-55b4e9a4c86b", "address": "fa:16:3e:0b:83:7d", "network": {"id": "db8ab944-48c5-49d7-8f11-1216b54c6ea6", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1491766949-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca3091c1fc764326b65d9db6f1de9746", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc2f667c-53", "ovs_interfaceid": "dc2f667c-53dc-44b5-bd9d-55b4e9a4c86b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:22:36 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-a42da0a7-de33-4342-b78b-58a8343d9485 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] Releasing lock "refresh_cache-6296ba5d-bcc6-405a-a635-0e9aa6114f7b" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 15:22:36 user nova-compute[72382]: DEBUG nova.compute.manager [None req-a42da0a7-de33-4342-b78b-58a8343d9485 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] [instance: 6296ba5d-bcc6-405a-a635-0e9aa6114f7b] Instance network_info: |[{"id": "dc2f667c-53dc-44b5-bd9d-55b4e9a4c86b", "address": "fa:16:3e:0b:83:7d", "network": {"id": "db8ab944-48c5-49d7-8f11-1216b54c6ea6", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1491766949-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca3091c1fc764326b65d9db6f1de9746", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc2f667c-53", "ovs_interfaceid": "dc2f667c-53dc-44b5-bd9d-55b4e9a4c86b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72382) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 15:22:36 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-66bcaf59-6cbf-4174-93fa-3f81907304fa req-18b608ab-9a52-48f3-92e1-9a79ea71d66f service nova] Acquired lock "refresh_cache-6296ba5d-bcc6-405a-a635-0e9aa6114f7b" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 15:22:36 user nova-compute[72382]: DEBUG nova.network.neutron [req-66bcaf59-6cbf-4174-93fa-3f81907304fa req-18b608ab-9a52-48f3-92e1-9a79ea71d66f service nova] [instance: 6296ba5d-bcc6-405a-a635-0e9aa6114f7b] Refreshing network info cache for port dc2f667c-53dc-44b5-bd9d-55b4e9a4c86b {{(pid=72382) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 15:22:36 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-a42da0a7-de33-4342-b78b-58a8343d9485 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] [instance: 6296ba5d-bcc6-405a-a635-0e9aa6114f7b] Start _get_guest_xml network_info=[{"id": "dc2f667c-53dc-44b5-bd9d-55b4e9a4c86b", "address": "fa:16:3e:0b:83:7d", "network": {"id": "db8ab944-48c5-49d7-8f11-1216b54c6ea6", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1491766949-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca3091c1fc764326b65d9db6f1de9746", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc2f667c-53", "ovs_interfaceid": "dc2f667c-53dc-44b5-bd9d-55b4e9a4c86b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T15:11:25Z,direct_url=<?>,disk_format='qcow2',id=a79f2cea-eb27-4631-aaf3-05e7d9e411b4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a638990e12cc4d6eabb6d55e13be6bdf',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T15:11:27Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'a79f2cea-eb27-4631-aaf3-05e7d9e411b4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72382) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 15:22:36 user nova-compute[72382]: WARNING nova.virt.libvirt.driver [None req-a42da0a7-de33-4342-b78b-58a8343d9485 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 15:22:36 user nova-compute[72382]: WARNING nova.virt.libvirt.driver [None req-a42da0a7-de33-4342-b78b-58a8343d9485 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 15:22:36 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-a42da0a7-de33-4342-b78b-58a8343d9485 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72382) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 15:22:36 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-a42da0a7-de33-4342-b78b-58a8343d9485 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] CPU controller missing on host. {{(pid=72382) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 15:22:36 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-a42da0a7-de33-4342-b78b-58a8343d9485 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72382) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 15:22:36 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-a42da0a7-de33-4342-b78b-58a8343d9485 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] CPU controller found on host. {{(pid=72382) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 15:22:36 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-a42da0a7-de33-4342-b78b-58a8343d9485 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72382) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 15:22:36 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-a42da0a7-de33-4342-b78b-58a8343d9485 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T15:11:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T15:11:25Z,direct_url=<?>,disk_format='qcow2',id=a79f2cea-eb27-4631-aaf3-05e7d9e411b4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a638990e12cc4d6eabb6d55e13be6bdf',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T15:11:27Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 15:22:36 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-a42da0a7-de33-4342-b78b-58a8343d9485 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] Flavor limits 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 15:22:36 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-a42da0a7-de33-4342-b78b-58a8343d9485 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] Image limits 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 15:22:36 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-a42da0a7-de33-4342-b78b-58a8343d9485 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] Flavor pref 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 15:22:36 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-a42da0a7-de33-4342-b78b-58a8343d9485 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] Image pref 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 15:22:36 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-a42da0a7-de33-4342-b78b-58a8343d9485 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 15:22:36 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-a42da0a7-de33-4342-b78b-58a8343d9485 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 15:22:36 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-a42da0a7-de33-4342-b78b-58a8343d9485 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72382) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 15:22:36 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-a42da0a7-de33-4342-b78b-58a8343d9485 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] Got 1 possible topologies {{(pid=72382) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 15:22:36 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-a42da0a7-de33-4342-b78b-58a8343d9485 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 15:22:36 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-a42da0a7-de33-4342-b78b-58a8343d9485 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 15:22:36 user nova-compute[72382]: DEBUG nova.virt.libvirt.vif [None req-a42da0a7-de33-4342-b78b-58a8343d9485 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T15:22:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1382530191',display_name='tempest-SnapshotDataIntegrityTests-server-1382530191',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1382530191',id=20,image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAXrscAaQcP3TCPtMhZcwlkpYpDdX2ol+VJV7W2igYvedoFqYg+omg+CmJgtJvVz3nDO0ndBHXFEZrZn3ajiQurnkuFoLiOJw8LqTEUj237zSInajxY6YTrv7lsn1pr7IA==',key_name='tempest-keypair-877982537',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ca3091c1fc764326b65d9db6f1de9746',ramdisk_id='',reservation_id='r-5mw0syiv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-407285757',owner_user_name='tempest-SnapshotDataIntegrityTests-407285757-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T15:22:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e5a4e350207e43ea99f5f828990ff999',uuid=6296ba5d-bcc6-405a-a635-0e9aa6114f7b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dc2f667c-53dc-44b5-bd9d-55b4e9a4c86b", "address": "fa:16:3e:0b:83:7d", "network": {"id": "db8ab944-48c5-49d7-8f11-1216b54c6ea6", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1491766949-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca3091c1fc764326b65d9db6f1de9746", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc2f667c-53", "ovs_interfaceid": "dc2f667c-53dc-44b5-bd9d-55b4e9a4c86b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72382) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 15:22:36 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-a42da0a7-de33-4342-b78b-58a8343d9485 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] Converting VIF {"id": "dc2f667c-53dc-44b5-bd9d-55b4e9a4c86b", "address": "fa:16:3e:0b:83:7d", "network": {"id": "db8ab944-48c5-49d7-8f11-1216b54c6ea6", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1491766949-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca3091c1fc764326b65d9db6f1de9746", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc2f667c-53", "ovs_interfaceid": "dc2f667c-53dc-44b5-bd9d-55b4e9a4c86b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 15:22:36 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-a42da0a7-de33-4342-b78b-58a8343d9485 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0b:83:7d,bridge_name='br-int',has_traffic_filtering=True,id=dc2f667c-53dc-44b5-bd9d-55b4e9a4c86b,network=Network(db8ab944-48c5-49d7-8f11-1216b54c6ea6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc2f667c-53') {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 15:22:36 user nova-compute[72382]: DEBUG nova.objects.instance [None req-a42da0a7-de33-4342-b78b-58a8343d9485 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] Lazy-loading 'pci_devices' on Instance uuid 6296ba5d-bcc6-405a-a635-0e9aa6114f7b {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:22:36 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-a42da0a7-de33-4342-b78b-58a8343d9485 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] [instance: 6296ba5d-bcc6-405a-a635-0e9aa6114f7b] End _get_guest_xml xml=<domain type="kvm">
Aug 09 15:22:36 user nova-compute[72382]:   <uuid>6296ba5d-bcc6-405a-a635-0e9aa6114f7b</uuid>
Aug 09 15:22:36 user nova-compute[72382]:   <name>instance-00000014</name>
Aug 09 15:22:36 user nova-compute[72382]:   <memory>524288</memory>
Aug 09 15:22:36 user nova-compute[72382]:   <vcpu>1</vcpu>
Aug 09 15:22:36 user nova-compute[72382]:   <metadata>
Aug 09 15:22:36 user nova-compute[72382]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 15:22:36 user nova-compute[72382]:       <nova:package version="0.0.0"/>
Aug 09 15:22:36 user nova-compute[72382]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-1382530191</nova:name>
Aug 09 15:22:36 user nova-compute[72382]:       <nova:creationTime>2023-08-09 15:22:36</nova:creationTime>
Aug 09 15:22:36 user nova-compute[72382]:       <nova:flavor name="m1.tiny">
Aug 09 15:22:36 user nova-compute[72382]:         <nova:memory>512</nova:memory>
Aug 09 15:22:36 user nova-compute[72382]:         <nova:disk>1</nova:disk>
Aug 09 15:22:36 user nova-compute[72382]:         <nova:swap>0</nova:swap>
Aug 09 15:22:36 user nova-compute[72382]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 15:22:36 user nova-compute[72382]:         <nova:vcpus>1</nova:vcpus>
Aug 09 15:22:36 user nova-compute[72382]:       </nova:flavor>
Aug 09 15:22:36 user nova-compute[72382]:       <nova:owner>
Aug 09 15:22:36 user nova-compute[72382]:         <nova:user uuid="e5a4e350207e43ea99f5f828990ff999">tempest-SnapshotDataIntegrityTests-407285757-project-member</nova:user>
Aug 09 15:22:36 user nova-compute[72382]:         <nova:project uuid="ca3091c1fc764326b65d9db6f1de9746">tempest-SnapshotDataIntegrityTests-407285757</nova:project>
Aug 09 15:22:36 user nova-compute[72382]:       </nova:owner>
Aug 09 15:22:36 user nova-compute[72382]:       <nova:root type="image" uuid="a79f2cea-eb27-4631-aaf3-05e7d9e411b4"/>
Aug 09 15:22:36 user nova-compute[72382]:       <nova:ports>
Aug 09 15:22:36 user nova-compute[72382]:         <nova:port uuid="dc2f667c-53dc-44b5-bd9d-55b4e9a4c86b">
Aug 09 15:22:36 user nova-compute[72382]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 09 15:22:36 user nova-compute[72382]:         </nova:port>
Aug 09 15:22:36 user nova-compute[72382]:       </nova:ports>
Aug 09 15:22:36 user nova-compute[72382]:     </nova:instance>
Aug 09 15:22:36 user nova-compute[72382]:   </metadata>
Aug 09 15:22:36 user nova-compute[72382]:   <sysinfo type="smbios">
Aug 09 15:22:36 user nova-compute[72382]:     <system>
Aug 09 15:22:36 user nova-compute[72382]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 15:22:36 user nova-compute[72382]:       <entry name="product">OpenStack Nova</entry>
Aug 09 15:22:36 user nova-compute[72382]:       <entry name="version">0.0.0</entry>
Aug 09 15:22:36 user nova-compute[72382]:       <entry name="serial">6296ba5d-bcc6-405a-a635-0e9aa6114f7b</entry>
Aug 09 15:22:36 user nova-compute[72382]:       <entry name="uuid">6296ba5d-bcc6-405a-a635-0e9aa6114f7b</entry>
Aug 09 15:22:36 user nova-compute[72382]:       <entry name="family">Virtual Machine</entry>
Aug 09 15:22:36 user nova-compute[72382]:     </system>
Aug 09 15:22:36 user nova-compute[72382]:   </sysinfo>
Aug 09 15:22:36 user nova-compute[72382]:   <os>
Aug 09 15:22:36 user nova-compute[72382]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 15:22:36 user nova-compute[72382]:     <boot dev="hd"/>
Aug 09 15:22:36 user nova-compute[72382]:     <smbios mode="sysinfo"/>
Aug 09 15:22:36 user nova-compute[72382]:   </os>
Aug 09 15:22:36 user nova-compute[72382]:   <features>
Aug 09 15:22:36 user nova-compute[72382]:     <acpi/>
Aug 09 15:22:36 user nova-compute[72382]:     <apic/>
Aug 09 15:22:36 user nova-compute[72382]:     <vmcoreinfo/>
Aug 09 15:22:36 user nova-compute[72382]:   </features>
Aug 09 15:22:36 user nova-compute[72382]:   <clock offset="utc">
Aug 09 15:22:36 user nova-compute[72382]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 15:22:36 user nova-compute[72382]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 15:22:36 user nova-compute[72382]:     <timer name="hpet" present="no"/>
Aug 09 15:22:36 user nova-compute[72382]:   </clock>
Aug 09 15:22:36 user nova-compute[72382]:   <cpu mode="custom" match="exact">
Aug 09 15:22:36 user nova-compute[72382]:     <model>Nehalem</model>
Aug 09 15:22:36 user nova-compute[72382]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 15:22:36 user nova-compute[72382]:   </cpu>
Aug 09 15:22:36 user nova-compute[72382]:   <devices>
Aug 09 15:22:36 user nova-compute[72382]:     <disk type="file" device="disk">
Aug 09 15:22:36 user nova-compute[72382]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 15:22:36 user nova-compute[72382]:       <source file="/opt/stack/data/nova/instances/6296ba5d-bcc6-405a-a635-0e9aa6114f7b/disk"/>
Aug 09 15:22:36 user nova-compute[72382]:       <target dev="vda" bus="virtio"/>
Aug 09 15:22:36 user nova-compute[72382]:     </disk>
Aug 09 15:22:36 user nova-compute[72382]:     <interface type="ethernet">
Aug 09 15:22:36 user nova-compute[72382]:       <mac address="fa:16:3e:0b:83:7d"/>
Aug 09 15:22:36 user nova-compute[72382]:       <model type="virtio"/>
Aug 09 15:22:36 user nova-compute[72382]:       <mtu size="1442"/>
Aug 09 15:22:36 user nova-compute[72382]:       <target dev="tapdc2f667c-53"/>
Aug 09 15:22:36 user nova-compute[72382]:     </interface>
Aug 09 15:22:36 user nova-compute[72382]:     <serial type="pty">
Aug 09 15:22:36 user nova-compute[72382]:       <log file="/opt/stack/data/nova/instances/6296ba5d-bcc6-405a-a635-0e9aa6114f7b/console.log" append="off"/>
Aug 09 15:22:36 user nova-compute[72382]:     </serial>
Aug 09 15:22:36 user nova-compute[72382]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 15:22:36 user nova-compute[72382]:     <video>
Aug 09 15:22:36 user nova-compute[72382]:       <model type="virtio"/>
Aug 09 15:22:36 user nova-compute[72382]:     </video>
Aug 09 15:22:36 user nova-compute[72382]:     <rng model="virtio">
Aug 09 15:22:36 user nova-compute[72382]:       <backend model="random">/dev/urandom</backend>
Aug 09 15:22:36 user nova-compute[72382]:     </rng>
Aug 09 15:22:36 user nova-compute[72382]:     <controller type="usb" index="0" model="none"/>
Aug 09 15:22:36 user nova-compute[72382]:     <memballoon model="virtio">
Aug 09 15:22:36 user nova-compute[72382]:       <stats period="10"/>
Aug 09 15:22:36 user nova-compute[72382]:     </memballoon>
Aug 09 15:22:36 user nova-compute[72382]:   </devices>
Aug 09 15:22:36 user nova-compute[72382]: </domain>
Aug 09 15:22:36 user nova-compute[72382]:  {{(pid=72382) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 15:22:36 user nova-compute[72382]: DEBUG nova.virt.libvirt.vif [None req-a42da0a7-de33-4342-b78b-58a8343d9485 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T15:22:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1382530191',display_name='tempest-SnapshotDataIntegrityTests-server-1382530191',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1382530191',id=20,image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAXrscAaQcP3TCPtMhZcwlkpYpDdX2ol+VJV7W2igYvedoFqYg+omg+CmJgtJvVz3nDO0ndBHXFEZrZn3ajiQurnkuFoLiOJw8LqTEUj237zSInajxY6YTrv7lsn1pr7IA==',key_name='tempest-keypair-877982537',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ca3091c1fc764326b65d9db6f1de9746',ramdisk_id='',reservation_id='r-5mw0syiv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-407285757',owner_user_name='tempest-SnapshotDataIntegrityTests-407285757-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T15:22:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e5a4e350207e43ea99f5f828990ff999',uuid=6296ba5d-bcc6-405a-a635-0e9aa6114f7b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dc2f667c-53dc-44b5-bd9d-55b4e9a4c86b", "address": "fa:16:3e:0b:83:7d", "network": {"id": "db8ab944-48c5-49d7-8f11-1216b54c6ea6", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1491766949-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca3091c1fc764326b65d9db6f1de9746", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc2f667c-53", "ovs_interfaceid": "dc2f667c-53dc-44b5-bd9d-55b4e9a4c86b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 15:22:36 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-a42da0a7-de33-4342-b78b-58a8343d9485 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] Converting VIF {"id": "dc2f667c-53dc-44b5-bd9d-55b4e9a4c86b", "address": "fa:16:3e:0b:83:7d", "network": {"id": "db8ab944-48c5-49d7-8f11-1216b54c6ea6", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1491766949-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca3091c1fc764326b65d9db6f1de9746", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc2f667c-53", "ovs_interfaceid": "dc2f667c-53dc-44b5-bd9d-55b4e9a4c86b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 15:22:36 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-a42da0a7-de33-4342-b78b-58a8343d9485 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0b:83:7d,bridge_name='br-int',has_traffic_filtering=True,id=dc2f667c-53dc-44b5-bd9d-55b4e9a4c86b,network=Network(db8ab944-48c5-49d7-8f11-1216b54c6ea6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc2f667c-53') {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 15:22:36 user nova-compute[72382]: DEBUG os_vif [None req-a42da0a7-de33-4342-b78b-58a8343d9485 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0b:83:7d,bridge_name='br-int',has_traffic_filtering=True,id=dc2f667c-53dc-44b5-bd9d-55b4e9a4c86b,network=Network(db8ab944-48c5-49d7-8f11-1216b54c6ea6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc2f667c-53') {{(pid=72382) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 15:22:36 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:22:36 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:22:36 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 15:22:36 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:22:36 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdc2f667c-53, may_exist=True, interface_attrs={}) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:22:36 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapdc2f667c-53, col_values=(('external_ids', {'iface-id': 'dc2f667c-53dc-44b5-bd9d-55b4e9a4c86b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0b:83:7d', 'vm-uuid': '6296ba5d-bcc6-405a-a635-0e9aa6114f7b'}),), if_exists=True) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:22:36 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:22:36 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:22:36 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:22:36 user nova-compute[72382]: INFO os_vif [None req-a42da0a7-de33-4342-b78b-58a8343d9485 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0b:83:7d,bridge_name='br-int',has_traffic_filtering=True,id=dc2f667c-53dc-44b5-bd9d-55b4e9a4c86b,network=Network(db8ab944-48c5-49d7-8f11-1216b54c6ea6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc2f667c-53')
Aug 09 15:22:36 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-a42da0a7-de33-4342-b78b-58a8343d9485 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] No BDM found with device name vda, not building metadata. {{(pid=72382) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 15:22:36 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-a42da0a7-de33-4342-b78b-58a8343d9485 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] No VIF found with MAC fa:16:3e:0b:83:7d, not building metadata {{(pid=72382) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 15:22:37 user nova-compute[72382]: DEBUG nova.compute.manager [req-a96be5d9-2d97-44e6-b7d7-982c25f85e5b req-0f3bd376-b136-4923-a94c-49a564dd015d service nova] [instance: 83ebfda8-235d-4404-a973-991d75ae2bf6] Received event volume-reimaged-1cd86701-a303-4744-bf0c-31b5314bb87d {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:22:37 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-a96be5d9-2d97-44e6-b7d7-982c25f85e5b req-0f3bd376-b136-4923-a94c-49a564dd015d service nova] Acquiring lock "83ebfda8-235d-4404-a973-991d75ae2bf6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:22:37 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-a96be5d9-2d97-44e6-b7d7-982c25f85e5b req-0f3bd376-b136-4923-a94c-49a564dd015d service nova] Lock "83ebfda8-235d-4404-a973-991d75ae2bf6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:22:37 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-a96be5d9-2d97-44e6-b7d7-982c25f85e5b req-0f3bd376-b136-4923-a94c-49a564dd015d service nova] Lock "83ebfda8-235d-4404-a973-991d75ae2bf6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:22:37 user nova-compute[72382]: DEBUG nova.compute.manager [req-a96be5d9-2d97-44e6-b7d7-982c25f85e5b req-0f3bd376-b136-4923-a94c-49a564dd015d service nova] [instance: 83ebfda8-235d-4404-a973-991d75ae2bf6] Processing event volume-reimaged-1cd86701-a303-4744-bf0c-31b5314bb87d {{(pid=72382) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10792}}
Aug 09 15:22:37 user nova-compute[72382]: DEBUG nova.compute.manager [None req-a96be5d9-2d97-44e6-b7d7-982c25f85e5b tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] [instance: 83ebfda8-235d-4404-a973-991d75ae2bf6] Instance event wait completed in 17 seconds for volume-reimaged {{(pid=72382) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 15:22:37 user nova-compute[72382]: DEBUG nova.network.neutron [req-66bcaf59-6cbf-4174-93fa-3f81907304fa req-18b608ab-9a52-48f3-92e1-9a79ea71d66f service nova] [instance: 6296ba5d-bcc6-405a-a635-0e9aa6114f7b] Updated VIF entry in instance network info cache for port dc2f667c-53dc-44b5-bd9d-55b4e9a4c86b. {{(pid=72382) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 15:22:37 user nova-compute[72382]: DEBUG nova.network.neutron [req-66bcaf59-6cbf-4174-93fa-3f81907304fa req-18b608ab-9a52-48f3-92e1-9a79ea71d66f service nova] [instance: 6296ba5d-bcc6-405a-a635-0e9aa6114f7b] Updating instance_info_cache with network_info: [{"id": "dc2f667c-53dc-44b5-bd9d-55b4e9a4c86b", "address": "fa:16:3e:0b:83:7d", "network": {"id": "db8ab944-48c5-49d7-8f11-1216b54c6ea6", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1491766949-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca3091c1fc764326b65d9db6f1de9746", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc2f667c-53", "ovs_interfaceid": "dc2f667c-53dc-44b5-bd9d-55b4e9a4c86b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:22:37 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-66bcaf59-6cbf-4174-93fa-3f81907304fa req-18b608ab-9a52-48f3-92e1-9a79ea71d66f service nova] Releasing lock "refresh_cache-6296ba5d-bcc6-405a-a635-0e9aa6114f7b" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 15:22:37 user nova-compute[72382]: INFO nova.virt.block_device [None req-a96be5d9-2d97-44e6-b7d7-982c25f85e5b tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] [instance: 83ebfda8-235d-4404-a973-991d75ae2bf6] Booting with volume 1cd86701-a303-4744-bf0c-31b5314bb87d at /dev/vda
Aug 09 15:22:37 user nova-compute[72382]: DEBUG os_brick.utils [None req-a96be5d9-2d97-44e6-b7d7-982c25f85e5b tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 15:22:37 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:22:37 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:22:37 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[502c65ac-9dbf-49cb-a041-f7c50b18e473]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d2cfa7015fe\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:22:37 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:22:37 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:22:37 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba1df0a3-0a21-4491-9f82-16472e15997f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:22:37 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:22:37 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:22:37 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[9902f170-79a5-49bc-94de-7a11ee10c3d0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:22:37 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[a54260c4-2333-45e7-840b-5dfd95824caf]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:22:37 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-a96be5d9-2d97-44e6-b7d7-982c25f85e5b tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] Running cmd (subprocess): nvme version {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:22:37 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-a96be5d9-2d97-44e6-b7d7-982c25f85e5b tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] 'nvme version' failed. Not Retrying. {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 15:22:37 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a96be5d9-2d97-44e6-b7d7-982c25f85e5b tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] nvme not present on system {{(pid=72382) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 15:22:37 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:22:37 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 15:22:37 user nova-compute[72382]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 15:22:37 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c60d1e9-dd75-4653-8802-b5860982472e]: (4, '') {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:22:37 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.lightos [None req-a96be5d9-2d97-44e6-b7d7-982c25f85e5b tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72382) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 15:22:37 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.lightos [None req-a96be5d9-2d97-44e6-b7d7-982c25f85e5b tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72382) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 15:22:37 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.lightos [None req-a96be5d9-2d97-44e6-b7d7-982c25f85e5b tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] LIGHTOS: no hostnqn found. {{(pid=72382) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 15:22:37 user nova-compute[72382]: DEBUG os_brick.utils [None req-a96be5d9-2d97-44e6-b7d7-982c25f85e5b tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d2cfa7015fe', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 15:22:37 user nova-compute[72382]: DEBUG nova.virt.block_device [None req-a96be5d9-2d97-44e6-b7d7-982c25f85e5b tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] [instance: 83ebfda8-235d-4404-a973-991d75ae2bf6] Updating existing volume attachment record: 72eea149-6189-49cf-b62c-9fbad5da3123 {{(pid=72382) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 15:22:38 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:22:38 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:22:38 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:22:38 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:22:38 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:22:38 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:22:38 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:22:38 user nova-compute[72382]: DEBUG nova.compute.manager [req-4e2c3154-7928-4e0a-86c6-a45536c6c719 req-c39d9ecf-8816-473b-8467-fc531434353f service nova] [instance: 6296ba5d-bcc6-405a-a635-0e9aa6114f7b] Received event network-vif-plugged-dc2f667c-53dc-44b5-bd9d-55b4e9a4c86b {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:22:38 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-4e2c3154-7928-4e0a-86c6-a45536c6c719 req-c39d9ecf-8816-473b-8467-fc531434353f service nova] Acquiring lock "6296ba5d-bcc6-405a-a635-0e9aa6114f7b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:22:38 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-4e2c3154-7928-4e0a-86c6-a45536c6c719 req-c39d9ecf-8816-473b-8467-fc531434353f service nova] Lock "6296ba5d-bcc6-405a-a635-0e9aa6114f7b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:22:38 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-4e2c3154-7928-4e0a-86c6-a45536c6c719 req-c39d9ecf-8816-473b-8467-fc531434353f service nova] Lock "6296ba5d-bcc6-405a-a635-0e9aa6114f7b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:22:38 user nova-compute[72382]: DEBUG nova.compute.manager [req-4e2c3154-7928-4e0a-86c6-a45536c6c719 req-c39d9ecf-8816-473b-8467-fc531434353f service nova] [instance: 6296ba5d-bcc6-405a-a635-0e9aa6114f7b] No waiting events found dispatching network-vif-plugged-dc2f667c-53dc-44b5-bd9d-55b4e9a4c86b {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:22:38 user nova-compute[72382]: WARNING nova.compute.manager [req-4e2c3154-7928-4e0a-86c6-a45536c6c719 req-c39d9ecf-8816-473b-8467-fc531434353f service nova] [instance: 6296ba5d-bcc6-405a-a635-0e9aa6114f7b] Received unexpected event network-vif-plugged-dc2f667c-53dc-44b5-bd9d-55b4e9a4c86b for instance with vm_state building and task_state spawning.
Aug 09 15:22:39 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:22:40 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:22:40 user nova-compute[72382]: DEBUG nova.virt.driver [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Emitting event <LifecycleEvent: 1691594560.8247008, 6296ba5d-bcc6-405a-a635-0e9aa6114f7b => Resumed> {{(pid=72382) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 15:22:40 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 6296ba5d-bcc6-405a-a635-0e9aa6114f7b] VM Resumed (Lifecycle Event)
Aug 09 15:22:40 user nova-compute[72382]: DEBUG nova.compute.manager [None req-a42da0a7-de33-4342-b78b-58a8343d9485 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] [instance: 6296ba5d-bcc6-405a-a635-0e9aa6114f7b] Instance event wait completed in 0 seconds for  {{(pid=72382) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 15:22:40 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-a42da0a7-de33-4342-b78b-58a8343d9485 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] [instance: 6296ba5d-bcc6-405a-a635-0e9aa6114f7b] Guest created on hypervisor {{(pid=72382) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 15:22:40 user nova-compute[72382]: INFO nova.virt.libvirt.driver [-] [instance: 6296ba5d-bcc6-405a-a635-0e9aa6114f7b] Instance spawned successfully.
Aug 09 15:22:40 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-a42da0a7-de33-4342-b78b-58a8343d9485 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] [instance: 6296ba5d-bcc6-405a-a635-0e9aa6114f7b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 15:22:40 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 6296ba5d-bcc6-405a-a635-0e9aa6114f7b] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:22:40 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 6296ba5d-bcc6-405a-a635-0e9aa6114f7b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72382) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 15:22:40 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-a42da0a7-de33-4342-b78b-58a8343d9485 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] [instance: 6296ba5d-bcc6-405a-a635-0e9aa6114f7b] Found default for hw_cdrom_bus of ide {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:22:40 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-a42da0a7-de33-4342-b78b-58a8343d9485 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] [instance: 6296ba5d-bcc6-405a-a635-0e9aa6114f7b] Found default for hw_disk_bus of virtio {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:22:40 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-a42da0a7-de33-4342-b78b-58a8343d9485 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] [instance: 6296ba5d-bcc6-405a-a635-0e9aa6114f7b] Found default for hw_input_bus of None {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:22:40 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-a42da0a7-de33-4342-b78b-58a8343d9485 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] [instance: 6296ba5d-bcc6-405a-a635-0e9aa6114f7b] Found default for hw_pointer_model of None {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:22:40 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-a42da0a7-de33-4342-b78b-58a8343d9485 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] [instance: 6296ba5d-bcc6-405a-a635-0e9aa6114f7b] Found default for hw_video_model of virtio {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:22:40 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-a42da0a7-de33-4342-b78b-58a8343d9485 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] [instance: 6296ba5d-bcc6-405a-a635-0e9aa6114f7b] Found default for hw_vif_model of virtio {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:22:40 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 6296ba5d-bcc6-405a-a635-0e9aa6114f7b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 15:22:40 user nova-compute[72382]: DEBUG nova.virt.driver [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Emitting event <LifecycleEvent: 1691594560.8280709, 6296ba5d-bcc6-405a-a635-0e9aa6114f7b => Started> {{(pid=72382) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 15:22:40 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 6296ba5d-bcc6-405a-a635-0e9aa6114f7b] VM Started (Lifecycle Event)
Aug 09 15:22:40 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 6296ba5d-bcc6-405a-a635-0e9aa6114f7b] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:22:40 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 6296ba5d-bcc6-405a-a635-0e9aa6114f7b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72382) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 15:22:41 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 6296ba5d-bcc6-405a-a635-0e9aa6114f7b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 15:22:41 user nova-compute[72382]: INFO nova.compute.manager [None req-a42da0a7-de33-4342-b78b-58a8343d9485 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] [instance: 6296ba5d-bcc6-405a-a635-0e9aa6114f7b] Took 6.38 seconds to spawn the instance on the hypervisor.
Aug 09 15:22:41 user nova-compute[72382]: DEBUG nova.compute.manager [None req-a42da0a7-de33-4342-b78b-58a8343d9485 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] [instance: 6296ba5d-bcc6-405a-a635-0e9aa6114f7b] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:22:41 user nova-compute[72382]: DEBUG nova.compute.manager [req-dfc334ab-5f0d-4de4-a677-7cb8c994ac58 req-e1e7c412-22a9-4391-9d81-ea67c4799f20 service nova] [instance: 6296ba5d-bcc6-405a-a635-0e9aa6114f7b] Received event network-vif-plugged-dc2f667c-53dc-44b5-bd9d-55b4e9a4c86b {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:22:41 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-dfc334ab-5f0d-4de4-a677-7cb8c994ac58 req-e1e7c412-22a9-4391-9d81-ea67c4799f20 service nova] Acquiring lock "6296ba5d-bcc6-405a-a635-0e9aa6114f7b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:22:41 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-dfc334ab-5f0d-4de4-a677-7cb8c994ac58 req-e1e7c412-22a9-4391-9d81-ea67c4799f20 service nova] Lock "6296ba5d-bcc6-405a-a635-0e9aa6114f7b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:22:41 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-dfc334ab-5f0d-4de4-a677-7cb8c994ac58 req-e1e7c412-22a9-4391-9d81-ea67c4799f20 service nova] Lock "6296ba5d-bcc6-405a-a635-0e9aa6114f7b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:22:41 user nova-compute[72382]: DEBUG nova.compute.manager [req-dfc334ab-5f0d-4de4-a677-7cb8c994ac58 req-e1e7c412-22a9-4391-9d81-ea67c4799f20 service nova] [instance: 6296ba5d-bcc6-405a-a635-0e9aa6114f7b] No waiting events found dispatching network-vif-plugged-dc2f667c-53dc-44b5-bd9d-55b4e9a4c86b {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:22:41 user nova-compute[72382]: WARNING nova.compute.manager [req-dfc334ab-5f0d-4de4-a677-7cb8c994ac58 req-e1e7c412-22a9-4391-9d81-ea67c4799f20 service nova] [instance: 6296ba5d-bcc6-405a-a635-0e9aa6114f7b] Received unexpected event network-vif-plugged-dc2f667c-53dc-44b5-bd9d-55b4e9a4c86b for instance with vm_state building and task_state spawning.
Aug 09 15:22:41 user nova-compute[72382]: INFO nova.compute.manager [None req-a42da0a7-de33-4342-b78b-58a8343d9485 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] [instance: 6296ba5d-bcc6-405a-a635-0e9aa6114f7b] Took 7.19 seconds to build instance.
Aug 09 15:22:41 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-a42da0a7-de33-4342-b78b-58a8343d9485 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] Lock "6296ba5d-bcc6-405a-a635-0e9aa6114f7b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.303s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:22:41 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:22:44 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:22:45 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:22:46 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-da01acda-22cb-42d5-b44b-acd447013986 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] Acquiring lock "8aa35482-60b8-4185-b14d-a2667fd3b5b7" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:22:46 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-da01acda-22cb-42d5-b44b-acd447013986 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] Lock "8aa35482-60b8-4185-b14d-a2667fd3b5b7" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:22:46 user nova-compute[72382]: DEBUG nova.objects.instance [None req-da01acda-22cb-42d5-b44b-acd447013986 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] Lazy-loading 'flavor' on Instance uuid 8aa35482-60b8-4185-b14d-a2667fd3b5b7 {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:22:46 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-da01acda-22cb-42d5-b44b-acd447013986 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] Lock "8aa35482-60b8-4185-b14d-a2667fd3b5b7" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.070s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:22:46 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-da01acda-22cb-42d5-b44b-acd447013986 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] Acquiring lock "8aa35482-60b8-4185-b14d-a2667fd3b5b7" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:22:46 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-da01acda-22cb-42d5-b44b-acd447013986 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] Lock "8aa35482-60b8-4185-b14d-a2667fd3b5b7" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:22:46 user nova-compute[72382]: INFO nova.compute.manager [None req-da01acda-22cb-42d5-b44b-acd447013986 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] [instance: 8aa35482-60b8-4185-b14d-a2667fd3b5b7] Attaching volume 0052e86d-16a7-4cbe-a802-ff770c0e20ba to /dev/vdb
Aug 09 15:22:46 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:22:46 user nova-compute[72382]: DEBUG os_brick.utils [None req-da01acda-22cb-42d5-b44b-acd447013986 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 15:22:46 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:22:46 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:22:46 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[784d575b-b54d-4617-9f39-34b69c42fb30]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d2cfa7015fe\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:22:46 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:22:46 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:22:46 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[d98b9be8-6981-4de5-8db1-3a4996c142bf]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:22:46 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:22:46 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:22:46 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[cab640ea-e8ab-428d-9113-41139556d00f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:22:46 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[76536e33-2c93-46a5-8e48-1b0f203cafc2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:22:46 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-da01acda-22cb-42d5-b44b-acd447013986 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] Running cmd (subprocess): nvme version {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:22:47 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-da01acda-22cb-42d5-b44b-acd447013986 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] 'nvme version' failed. Not Retrying. {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 15:22:47 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.nvmeof [None req-da01acda-22cb-42d5-b44b-acd447013986 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] nvme not present on system {{(pid=72382) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 15:22:47 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:22:47 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 15:22:47 user nova-compute[72382]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 15:22:47 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b4bfcac-9a1f-4b07-859f-b0ea95e651df]: (4, '') {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:22:47 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.lightos [None req-da01acda-22cb-42d5-b44b-acd447013986 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72382) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 15:22:47 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.lightos [None req-da01acda-22cb-42d5-b44b-acd447013986 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72382) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 15:22:47 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.lightos [None req-da01acda-22cb-42d5-b44b-acd447013986 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] LIGHTOS: no hostnqn found. {{(pid=72382) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 15:22:47 user nova-compute[72382]: DEBUG os_brick.utils [None req-da01acda-22cb-42d5-b44b-acd447013986 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] <== get_connector_properties: return (153ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d2cfa7015fe', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 15:22:47 user nova-compute[72382]: DEBUG nova.virt.block_device [None req-da01acda-22cb-42d5-b44b-acd447013986 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] [instance: 8aa35482-60b8-4185-b14d-a2667fd3b5b7] Updating existing volume attachment record: e5ea88fd-d833-4b91-bebc-44222f704900 {{(pid=72382) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 15:22:47 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-a96be5d9-2d97-44e6-b7d7-982c25f85e5b tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] [instance: 83ebfda8-235d-4404-a973-991d75ae2bf6] Creating instance directory {{(pid=72382) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 15:22:47 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-a96be5d9-2d97-44e6-b7d7-982c25f85e5b tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] [instance: 83ebfda8-235d-4404-a973-991d75ae2bf6] Creating image(s)
Aug 09 15:22:47 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-a96be5d9-2d97-44e6-b7d7-982c25f85e5b tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] [instance: 83ebfda8-235d-4404-a973-991d75ae2bf6] Did not create local disks {{(pid=72382) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 09 15:22:47 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-a96be5d9-2d97-44e6-b7d7-982c25f85e5b tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] [instance: 83ebfda8-235d-4404-a973-991d75ae2bf6] Ensure instance console log exists: /opt/stack/data/nova/instances/83ebfda8-235d-4404-a973-991d75ae2bf6/console.log {{(pid=72382) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 15:22:47 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-a96be5d9-2d97-44e6-b7d7-982c25f85e5b tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:22:47 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-a96be5d9-2d97-44e6-b7d7-982c25f85e5b tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:22:47 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-a96be5d9-2d97-44e6-b7d7-982c25f85e5b tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:22:47 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-a96be5d9-2d97-44e6-b7d7-982c25f85e5b tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] [instance: 83ebfda8-235d-4404-a973-991d75ae2bf6] Start _get_guest_xml network_info=[{"id": "b2646c3a-cc2a-4782-a312-0582f2d377b1", "address": "fa:16:3e:01:06:06", "network": {"id": "2d5fadd3-a58b-4e71-971d-fa94edf0897d", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-6415310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06b73f81b4814b6f86017c2c27f8762c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2646c3a-cc", "ovs_interfaceid": "b2646c3a-cc2a-4782-a312-0582f2d377b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T15:11:25Z,direct_url=<?>,disk_format='qcow2',id=a79f2cea-eb27-4631-aaf3-05e7d9e411b4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a638990e12cc4d6eabb6d55e13be6bdf',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T15:11:27Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:1cd86701-a303-4744-bf0c-31b5314bb87d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DtKCGmgQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '83ebfda8-235d-4404-a973-991d75ae2bf6', 'attached_at': '', 'detached_at': '', 'volume_id': '1cd86701-a303-4744-bf0c-31b5314bb87d', 'serial': '1cd86701-a303-4744-bf0c-31b5314bb87d'}, 'disk_bus': 'virtio', 'attachment_id': '72eea149-6189-49cf-b62c-9fbad5da3123', 'delete_on_termination': True, 'volume_type': None} {{(pid=72382) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 15:22:47 user nova-compute[72382]: WARNING nova.virt.libvirt.driver [None req-a96be5d9-2d97-44e6-b7d7-982c25f85e5b tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 09 15:22:47 user nova-compute[72382]: WARNING nova.virt.libvirt.driver [None req-a96be5d9-2d97-44e6-b7d7-982c25f85e5b tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 09 15:22:47 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-a96be5d9-2d97-44e6-b7d7-982c25f85e5b tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72382) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 15:22:47 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-a96be5d9-2d97-44e6-b7d7-982c25f85e5b tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] CPU controller missing on host. {{(pid=72382) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 15:22:47 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-a96be5d9-2d97-44e6-b7d7-982c25f85e5b tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72382) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 15:22:47 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-a96be5d9-2d97-44e6-b7d7-982c25f85e5b tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] CPU controller found on host. {{(pid=72382) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 15:22:47 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-a96be5d9-2d97-44e6-b7d7-982c25f85e5b tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72382) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 15:22:47 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-a96be5d9-2d97-44e6-b7d7-982c25f85e5b tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T15:11:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T15:11:25Z,direct_url=<?>,disk_format='qcow2',id=a79f2cea-eb27-4631-aaf3-05e7d9e411b4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a638990e12cc4d6eabb6d55e13be6bdf',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T15:11:27Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 15:22:47 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-a96be5d9-2d97-44e6-b7d7-982c25f85e5b tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] Flavor limits 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 15:22:47 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-a96be5d9-2d97-44e6-b7d7-982c25f85e5b tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] Image limits 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 15:22:47 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-a96be5d9-2d97-44e6-b7d7-982c25f85e5b tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] Flavor pref 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 15:22:47 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-a96be5d9-2d97-44e6-b7d7-982c25f85e5b tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] Image pref 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 15:22:47 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-a96be5d9-2d97-44e6-b7d7-982c25f85e5b tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 15:22:47 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-a96be5d9-2d97-44e6-b7d7-982c25f85e5b tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 15:22:47 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-a96be5d9-2d97-44e6-b7d7-982c25f85e5b tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72382) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 15:22:47 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-a96be5d9-2d97-44e6-b7d7-982c25f85e5b tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] Got 1 possible topologies {{(pid=72382) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 15:22:47 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-a96be5d9-2d97-44e6-b7d7-982c25f85e5b tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 15:22:47 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-a96be5d9-2d97-44e6-b7d7-982c25f85e5b tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 15:22:47 user nova-compute[72382]: DEBUG nova.objects.instance [None req-a96be5d9-2d97-44e6-b7d7-982c25f85e5b tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] Lazy-loading 'vcpu_model' on Instance uuid 83ebfda8-235d-4404-a973-991d75ae2bf6 {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:22:47 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a96be5d9-2d97-44e6-b7d7-982c25f85e5b tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] [instance: 83ebfda8-235d-4404-a973-991d75ae2bf6] Calling os-brick to attach iSCSI Volume {{(pid=72382) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 15:22:47 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-a96be5d9-2d97-44e6-b7d7-982c25f85e5b tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2a0c768340>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:1cd86701-a303-4744-bf0c-31b5314bb87d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DtKCGmgQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 15:22:47 user nova-compute[72382]: WARNING os_brick.initiator.connectors.base [None req-a96be5d9-2d97-44e6-b7d7-982c25f85e5b tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 09 15:22:47 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-a96be5d9-2d97-44e6-b7d7-982c25f85e5b tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 15:22:47 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-a96be5d9-2d97-44e6-b7d7-982c25f85e5b tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 15:22:47 user nova-compute[72382]: WARNING os_brick.initiator.connectors.base [None req-a96be5d9-2d97-44e6-b7d7-982c25f85e5b tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 09 15:22:47 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-a96be5d9-2d97-44e6-b7d7-982c25f85e5b tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1cd86701-a303-4744-bf0c-31b5314bb87d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 15:22:47 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-a96be5d9-2d97-44e6-b7d7-982c25f85e5b tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1cd86701-a303-4744-bf0c-31b5314bb87d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 15:22:47 user nova-compute[72382]: INFO os_brick.initiator.connectors.iscsi [None req-a96be5d9-2d97-44e6-b7d7-982c25f85e5b tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 15:22:47 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1cd86701-a303-4744-bf0c-31b5314bb87d -p 172.16.0.220:3260 {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:22:47 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1cd86701-a303-4744-bf0c-31b5314bb87d -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:22:47 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae0bc45a-63a2-45fc-b3da-e1b91cf89abd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:22:47 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-a96be5d9-2d97-44e6-b7d7-982c25f85e5b tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 15:22:47 user nova-compute[72382]:  {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:22:47 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1cd86701-a303-4744-bf0c-31b5314bb87d -p 172.16.0.220:3260 --interface default --op new {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:22:47 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1cd86701-a303-4744-bf0c-31b5314bb87d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:22:47 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[751e21b1-072b-4862-96db-2cea0e63d44a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1cd86701-a303-4744-bf0c-31b5314bb87d] added\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:22:47 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-a96be5d9-2d97-44e6-b7d7-982c25f85e5b tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1cd86701-a303-4744-bf0c-31b5314bb87d] added
Aug 09 15:22:47 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:22:47 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1cd86701-a303-4744-bf0c-31b5314bb87d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:22:47 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1cd86701-a303-4744-bf0c-31b5314bb87d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:22:47 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[9030cc83-58b8-4fe3-9204-22eb053c228b]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:22:47 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-a96be5d9-2d97-44e6-b7d7-982c25f85e5b tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:22:47 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1cd86701-a303-4744-bf0c-31b5314bb87d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:22:47 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1cd86701-a303-4744-bf0c-31b5314bb87d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:22:47 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[495ddca8-27df-46f6-80cc-49dd3fbfd15a]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:22:47 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-a96be5d9-2d97-44e6-b7d7-982c25f85e5b tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:22:47 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1cd86701-a303-4744-bf0c-31b5314bb87d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DtKCGmgQ {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:22:47 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1cd86701-a303-4744-bf0c-31b5314bb87d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DtKCGmgQ" returned: 0 in 0.023s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:22:47 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[0219203c-7915-494a-a587-336c2fa3795b]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:22:47 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-a96be5d9-2d97-44e6-b7d7-982c25f85e5b tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DtKCGmgQ'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:22:47 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1cd86701-a303-4744-bf0c-31b5314bb87d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:22:47 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1cd86701-a303-4744-bf0c-31b5314bb87d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.028s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:22:47 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[de2c65af-5ae2-4240-808e-dba5d23dcca9]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:22:47 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-a96be5d9-2d97-44e6-b7d7-982c25f85e5b tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:22:47 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:22:47 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:22:47 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[60de56cf-e9e3-48eb-8cfe-fd75c14f5a88]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb47e85c-aaa9-4165-8be3-125572b68a87 (non-flash)\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:22:47 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-a96be5d9-2d97-44e6-b7d7-982c25f85e5b tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)
Aug 09 15:22:47 user nova-compute[72382]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb47e85c-aaa9-4165-8be3-125572b68a87 (non-flash)
Aug 09 15:22:47 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 15:22:47 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-a96be5d9-2d97-44e6-b7d7-982c25f85e5b tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)
Aug 09 15:22:47 user nova-compute[72382]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb47e85c-aaa9-4165-8be3-125572b68a87 (non-flash)
Aug 09 15:22:47 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 15:22:47 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1cd86701-a303-4744-bf0c-31b5314bb87d -p 172.16.0.220:3260 --login {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:22:47 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1cd86701-a303-4744-bf0c-31b5314bb87d -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:22:47 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[5614168f-33d1-4b61-9a38-66832e384000]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1cd86701-a303-4744-bf0c-31b5314bb87d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1cd86701-a303-4744-bf0c-31b5314bb87d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:22:47 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-a96be5d9-2d97-44e6-b7d7-982c25f85e5b tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1cd86701-a303-4744-bf0c-31b5314bb87d, portal: 172.16.0.220,3260]
Aug 09 15:22:47 user nova-compute[72382]: Login to [iface: default, target: iqn.2010-10.org.openstack:1cd86701-a303-4744-bf0c-31b5314bb87d, portal: 172.16.0.220,3260] successful.
Aug 09 15:22:47 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:22:47 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1cd86701-a303-4744-bf0c-31b5314bb87d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:22:47 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1cd86701-a303-4744-bf0c-31b5314bb87d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:22:47 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab28ddd6-e4bd-4d52-8cee-2aef8f03c642]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:22:47 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-a96be5d9-2d97-44e6-b7d7-982c25f85e5b tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:22:48 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:22:48 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:22:48 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[209e86ea-7a17-40fe-8c8b-ae6a3cd1a846]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb47e85c-aaa9-4165-8be3-125572b68a87 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cd86701-a303-4744-bf0c-31b5314bb87d (non-flash)\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:22:48 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-a96be5d9-2d97-44e6-b7d7-982c25f85e5b tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)
Aug 09 15:22:48 user nova-compute[72382]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb47e85c-aaa9-4165-8be3-125572b68a87 (non-flash)
Aug 09 15:22:48 user nova-compute[72382]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cd86701-a303-4744-bf0c-31b5314bb87d (non-flash)
Aug 09 15:22:48 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 15:22:48 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-a96be5d9-2d97-44e6-b7d7-982c25f85e5b tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)
Aug 09 15:22:48 user nova-compute[72382]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb47e85c-aaa9-4165-8be3-125572b68a87 (non-flash)
Aug 09 15:22:48 user nova-compute[72382]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cd86701-a303-4744-bf0c-31b5314bb87d (non-flash)
Aug 09 15:22:48 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 15:22:48 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-a96be5d9-2d97-44e6-b7d7-982c25f85e5b tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1cd86701-a303-4744-bf0c-31b5314bb87d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.326s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 15:22:48 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-a96be5d9-2d97-44e6-b7d7-982c25f85e5b tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] Connected to 172.16.0.220:3260 {{(pid=72382) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 15:22:48 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-a96be5d9-2d97-44e6-b7d7-982c25f85e5b tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] HCTL ('34', '-', '-', 0) found on session 24 with lun 0 {{(pid=72382) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 15:22:48 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-a96be5d9-2d97-44e6-b7d7-982c25f85e5b tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72382) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 15:22:48 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:22:48 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.028s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:22:48 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[87062e20-e297-494c-b2dd-58fe6bbae4fb]: (4, ('- - 0', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:22:48 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-a96be5d9-2d97-44e6-b7d7-982c25f85e5b tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] Searching for a device in session 24 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72382) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 15:22:48 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-a96be5d9-2d97-44e6-b7d7-982c25f85e5b tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DtKCGmgQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72382) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 15:22:49 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-a96be5d9-2d97-44e6-b7d7-982c25f85e5b tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.372s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 15:22:49 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-a96be5d9-2d97-44e6-b7d7-982c25f85e5b tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] <== connect_volume: return (1374ms) {'type': 'block', 'scsi_wwn': '26164646461303364', 'path': '/dev/sdc'} {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 15:22:49 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a96be5d9-2d97-44e6-b7d7-982c25f85e5b tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] [instance: 83ebfda8-235d-4404-a973-991d75ae2bf6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26164646461303364', 'path': '/dev/sdc'} {{(pid=72382) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 15:22:49 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:22:49 user nova-compute[72382]: DEBUG nova.virt.libvirt.vif [None req-a96be5d9-2d97-44e6-b7d7-982c25f85e5b tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-09T15:20:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1408291636',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1037132086',id=18,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK/8JZBAyiCRHjLU+07gy/t2h+p3lkIQbl96NVsR2p9wGaw/Fvc6SNhI+niTOYcEyNFmbQHRmczVv3rBDNqLPSp2H/dP3kVtyEs6hP+i37003AjknP2hCvSl6DqRbqcyoQ==',key_name='tempest-keypair-1733291193',keypairs=<?>,launch_index=0,launched_at=2023-08-09T15:20:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='06b73f81b4814b6f86017c2c27f8762c',ramdisk_id='',reservation_id='r-ndge7mr0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1877173112',owner_user_name='tempest-ServerActionsV293TestJSON-1877173112-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T15:22:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='73fe18c52fef46869d80a266455681f8',uuid=83ebfda8-235d-4404-a973-991d75ae2bf6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b2646c3a-cc2a-4782-a312-0582f2d377b1", "address": "fa:16:3e:01:06:06", "network": {"id": "2d5fadd3-a58b-4e71-971d-fa94edf0897d", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-6415310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06b73f81b4814b6f86017c2c27f8762c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2646c3a-cc", "ovs_interfaceid": "b2646c3a-cc2a-4782-a312-0582f2d377b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72382) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 15:22:49 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-a96be5d9-2d97-44e6-b7d7-982c25f85e5b tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] Converting VIF {"id": "b2646c3a-cc2a-4782-a312-0582f2d377b1", "address": "fa:16:3e:01:06:06", "network": {"id": "2d5fadd3-a58b-4e71-971d-fa94edf0897d", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-6415310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06b73f81b4814b6f86017c2c27f8762c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2646c3a-cc", "ovs_interfaceid": "b2646c3a-cc2a-4782-a312-0582f2d377b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 15:22:49 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-a96be5d9-2d97-44e6-b7d7-982c25f85e5b tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:01:06:06,bridge_name='br-int',has_traffic_filtering=True,id=b2646c3a-cc2a-4782-a312-0582f2d377b1,network=Network(2d5fadd3-a58b-4e71-971d-fa94edf0897d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2646c3a-cc') {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 15:22:49 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-a96be5d9-2d97-44e6-b7d7-982c25f85e5b tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] [instance: 83ebfda8-235d-4404-a973-991d75ae2bf6] End _get_guest_xml xml=<domain type="kvm">
Aug 09 15:22:49 user nova-compute[72382]:   <uuid>83ebfda8-235d-4404-a973-991d75ae2bf6</uuid>
Aug 09 15:22:49 user nova-compute[72382]:   <name>instance-00000012</name>
Aug 09 15:22:49 user nova-compute[72382]:   <memory>524288</memory>
Aug 09 15:22:49 user nova-compute[72382]:   <vcpu>1</vcpu>
Aug 09 15:22:49 user nova-compute[72382]:   <metadata>
Aug 09 15:22:49 user nova-compute[72382]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 15:22:49 user nova-compute[72382]:       <nova:package version="0.0.0"/>
Aug 09 15:22:49 user nova-compute[72382]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1408291636</nova:name>
Aug 09 15:22:49 user nova-compute[72382]:       <nova:creationTime>2023-08-09 15:22:47</nova:creationTime>
Aug 09 15:22:49 user nova-compute[72382]:       <nova:flavor name="m1.tiny">
Aug 09 15:22:49 user nova-compute[72382]:         <nova:memory>512</nova:memory>
Aug 09 15:22:49 user nova-compute[72382]:         <nova:disk>1</nova:disk>
Aug 09 15:22:49 user nova-compute[72382]:         <nova:swap>0</nova:swap>
Aug 09 15:22:49 user nova-compute[72382]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 15:22:49 user nova-compute[72382]:         <nova:vcpus>1</nova:vcpus>
Aug 09 15:22:49 user nova-compute[72382]:       </nova:flavor>
Aug 09 15:22:49 user nova-compute[72382]:       <nova:owner>
Aug 09 15:22:49 user nova-compute[72382]:         <nova:user uuid="73fe18c52fef46869d80a266455681f8">tempest-ServerActionsV293TestJSON-1877173112-project-member</nova:user>
Aug 09 15:22:49 user nova-compute[72382]:         <nova:project uuid="06b73f81b4814b6f86017c2c27f8762c">tempest-ServerActionsV293TestJSON-1877173112</nova:project>
Aug 09 15:22:49 user nova-compute[72382]:       </nova:owner>
Aug 09 15:22:49 user nova-compute[72382]:       <nova:ports>
Aug 09 15:22:49 user nova-compute[72382]:         <nova:port uuid="b2646c3a-cc2a-4782-a312-0582f2d377b1">
Aug 09 15:22:49 user nova-compute[72382]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 09 15:22:49 user nova-compute[72382]:         </nova:port>
Aug 09 15:22:49 user nova-compute[72382]:       </nova:ports>
Aug 09 15:22:49 user nova-compute[72382]:     </nova:instance>
Aug 09 15:22:49 user nova-compute[72382]:   </metadata>
Aug 09 15:22:49 user nova-compute[72382]:   <sysinfo type="smbios">
Aug 09 15:22:49 user nova-compute[72382]:     <system>
Aug 09 15:22:49 user nova-compute[72382]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 15:22:49 user nova-compute[72382]:       <entry name="product">OpenStack Nova</entry>
Aug 09 15:22:49 user nova-compute[72382]:       <entry name="version">0.0.0</entry>
Aug 09 15:22:49 user nova-compute[72382]:       <entry name="serial">83ebfda8-235d-4404-a973-991d75ae2bf6</entry>
Aug 09 15:22:49 user nova-compute[72382]:       <entry name="uuid">83ebfda8-235d-4404-a973-991d75ae2bf6</entry>
Aug 09 15:22:49 user nova-compute[72382]:       <entry name="family">Virtual Machine</entry>
Aug 09 15:22:49 user nova-compute[72382]:     </system>
Aug 09 15:22:49 user nova-compute[72382]:   </sysinfo>
Aug 09 15:22:49 user nova-compute[72382]:   <os>
Aug 09 15:22:49 user nova-compute[72382]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 15:22:49 user nova-compute[72382]:     <boot dev="hd"/>
Aug 09 15:22:49 user nova-compute[72382]:     <smbios mode="sysinfo"/>
Aug 09 15:22:49 user nova-compute[72382]:   </os>
Aug 09 15:22:49 user nova-compute[72382]:   <features>
Aug 09 15:22:49 user nova-compute[72382]:     <acpi/>
Aug 09 15:22:49 user nova-compute[72382]:     <apic/>
Aug 09 15:22:49 user nova-compute[72382]:     <vmcoreinfo/>
Aug 09 15:22:49 user nova-compute[72382]:   </features>
Aug 09 15:22:49 user nova-compute[72382]:   <clock offset="utc">
Aug 09 15:22:49 user nova-compute[72382]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 15:22:49 user nova-compute[72382]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 15:22:49 user nova-compute[72382]:     <timer name="hpet" present="no"/>
Aug 09 15:22:49 user nova-compute[72382]:   </clock>
Aug 09 15:22:49 user nova-compute[72382]:   <cpu mode="custom" match="exact">
Aug 09 15:22:49 user nova-compute[72382]:     <model>Nehalem</model>
Aug 09 15:22:49 user nova-compute[72382]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 15:22:49 user nova-compute[72382]:   </cpu>
Aug 09 15:22:49 user nova-compute[72382]:   <devices>
Aug 09 15:22:49 user nova-compute[72382]:     <disk type="block" device="disk">
Aug 09 15:22:49 user nova-compute[72382]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 15:22:49 user nova-compute[72382]:       <source dev="/dev/sdc"/>
Aug 09 15:22:49 user nova-compute[72382]:       <target dev="vda" bus="virtio"/>
Aug 09 15:22:49 user nova-compute[72382]:       <serial>1cd86701-a303-4744-bf0c-31b5314bb87d</serial>
Aug 09 15:22:49 user nova-compute[72382]:     </disk>
Aug 09 15:22:49 user nova-compute[72382]:     <interface type="ethernet">
Aug 09 15:22:49 user nova-compute[72382]:       <mac address="fa:16:3e:01:06:06"/>
Aug 09 15:22:49 user nova-compute[72382]:       <model type="virtio"/>
Aug 09 15:22:49 user nova-compute[72382]:       <mtu size="1442"/>
Aug 09 15:22:49 user nova-compute[72382]:       <target dev="tapb2646c3a-cc"/>
Aug 09 15:22:49 user nova-compute[72382]:     </interface>
Aug 09 15:22:49 user nova-compute[72382]:     <serial type="pty">
Aug 09 15:22:49 user nova-compute[72382]:       <log file="/opt/stack/data/nova/instances/83ebfda8-235d-4404-a973-991d75ae2bf6/console.log" append="off"/>
Aug 09 15:22:49 user nova-compute[72382]:     </serial>
Aug 09 15:22:49 user nova-compute[72382]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 15:22:49 user nova-compute[72382]:     <video>
Aug 09 15:22:49 user nova-compute[72382]:       <model type="virtio"/>
Aug 09 15:22:49 user nova-compute[72382]:     </video>
Aug 09 15:22:49 user nova-compute[72382]:     <rng model="virtio">
Aug 09 15:22:49 user nova-compute[72382]:       <backend model="random">/dev/urandom</backend>
Aug 09 15:22:49 user nova-compute[72382]:     </rng>
Aug 09 15:22:49 user nova-compute[72382]:     <controller type="usb" index="0" model="none"/>
Aug 09 15:22:49 user nova-compute[72382]:     <memballoon model="virtio">
Aug 09 15:22:49 user nova-compute[72382]:       <stats period="10"/>
Aug 09 15:22:49 user nova-compute[72382]:     </memballoon>
Aug 09 15:22:49 user nova-compute[72382]:   </devices>
Aug 09 15:22:49 user nova-compute[72382]: </domain>
Aug 09 15:22:49 user nova-compute[72382]:  {{(pid=72382) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 15:22:49 user nova-compute[72382]: DEBUG nova.virt.libvirt.vif [None req-a96be5d9-2d97-44e6-b7d7-982c25f85e5b tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-09T15:20:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1408291636',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1037132086',id=18,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK/8JZBAyiCRHjLU+07gy/t2h+p3lkIQbl96NVsR2p9wGaw/Fvc6SNhI+niTOYcEyNFmbQHRmczVv3rBDNqLPSp2H/dP3kVtyEs6hP+i37003AjknP2hCvSl6DqRbqcyoQ==',key_name='tempest-keypair-1733291193',keypairs=<?>,launch_index=0,launched_at=2023-08-09T15:20:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='06b73f81b4814b6f86017c2c27f8762c',ramdisk_id='',reservation_id='r-ndge7mr0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1877173112',owner_user_name='tempest-ServerActionsV293TestJSON-1877173112-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T15:22:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='73fe18c52fef46869d80a266455681f8',uuid=83ebfda8-235d-4404-a973-991d75ae2bf6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b2646c3a-cc2a-4782-a312-0582f2d377b1", "address": "fa:16:3e:01:06:06", "network": {"id": "2d5fadd3-a58b-4e71-971d-fa94edf0897d", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-6415310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06b73f81b4814b6f86017c2c27f8762c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2646c3a-cc", "ovs_interfaceid": "b2646c3a-cc2a-4782-a312-0582f2d377b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 15:22:49 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-a96be5d9-2d97-44e6-b7d7-982c25f85e5b tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] Converting VIF {"id": "b2646c3a-cc2a-4782-a312-0582f2d377b1", "address": "fa:16:3e:01:06:06", "network": {"id": "2d5fadd3-a58b-4e71-971d-fa94edf0897d", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-6415310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06b73f81b4814b6f86017c2c27f8762c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2646c3a-cc", "ovs_interfaceid": "b2646c3a-cc2a-4782-a312-0582f2d377b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 15:22:49 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-a96be5d9-2d97-44e6-b7d7-982c25f85e5b tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:01:06:06,bridge_name='br-int',has_traffic_filtering=True,id=b2646c3a-cc2a-4782-a312-0582f2d377b1,network=Network(2d5fadd3-a58b-4e71-971d-fa94edf0897d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2646c3a-cc') {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 15:22:49 user nova-compute[72382]: DEBUG os_vif [None req-a96be5d9-2d97-44e6-b7d7-982c25f85e5b tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:01:06:06,bridge_name='br-int',has_traffic_filtering=True,id=b2646c3a-cc2a-4782-a312-0582f2d377b1,network=Network(2d5fadd3-a58b-4e71-971d-fa94edf0897d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2646c3a-cc') {{(pid=72382) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 15:22:49 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:22:49 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:22:49 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 15:22:49 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:22:49 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb2646c3a-cc, may_exist=True, interface_attrs={}) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:22:49 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb2646c3a-cc, col_values=(('external_ids', {'iface-id': 'b2646c3a-cc2a-4782-a312-0582f2d377b1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:01:06:06', 'vm-uuid': '83ebfda8-235d-4404-a973-991d75ae2bf6'}),), if_exists=True) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:22:49 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:22:49 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:22:49 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:22:49 user nova-compute[72382]: INFO os_vif [None req-a96be5d9-2d97-44e6-b7d7-982c25f85e5b tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:01:06:06,bridge_name='br-int',has_traffic_filtering=True,id=b2646c3a-cc2a-4782-a312-0582f2d377b1,network=Network(2d5fadd3-a58b-4e71-971d-fa94edf0897d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2646c3a-cc')
Aug 09 15:22:49 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-a96be5d9-2d97-44e6-b7d7-982c25f85e5b tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] No BDM found with device name vda, not building metadata. {{(pid=72382) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 15:22:49 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-a96be5d9-2d97-44e6-b7d7-982c25f85e5b tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] No VIF found with MAC fa:16:3e:01:06:06, not building metadata {{(pid=72382) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 15:22:50 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:22:50 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:22:50 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:22:50 user nova-compute[72382]: DEBUG nova.compute.manager [req-bfacc025-0982-4308-a3ee-d19fc5436e47 req-4fd789e2-ef35-427c-b956-11f762d69085 service nova] [instance: 83ebfda8-235d-4404-a973-991d75ae2bf6] Received event network-vif-plugged-b2646c3a-cc2a-4782-a312-0582f2d377b1 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:22:50 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-bfacc025-0982-4308-a3ee-d19fc5436e47 req-4fd789e2-ef35-427c-b956-11f762d69085 service nova] Acquiring lock "83ebfda8-235d-4404-a973-991d75ae2bf6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:22:50 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-bfacc025-0982-4308-a3ee-d19fc5436e47 req-4fd789e2-ef35-427c-b956-11f762d69085 service nova] Lock "83ebfda8-235d-4404-a973-991d75ae2bf6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:22:50 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-bfacc025-0982-4308-a3ee-d19fc5436e47 req-4fd789e2-ef35-427c-b956-11f762d69085 service nova] Lock "83ebfda8-235d-4404-a973-991d75ae2bf6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:22:50 user nova-compute[72382]: DEBUG nova.compute.manager [req-bfacc025-0982-4308-a3ee-d19fc5436e47 req-4fd789e2-ef35-427c-b956-11f762d69085 service nova] [instance: 83ebfda8-235d-4404-a973-991d75ae2bf6] No waiting events found dispatching network-vif-plugged-b2646c3a-cc2a-4782-a312-0582f2d377b1 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:22:50 user nova-compute[72382]: WARNING nova.compute.manager [req-bfacc025-0982-4308-a3ee-d19fc5436e47 req-4fd789e2-ef35-427c-b956-11f762d69085 service nova] [instance: 83ebfda8-235d-4404-a973-991d75ae2bf6] Received unexpected event network-vif-plugged-b2646c3a-cc2a-4782-a312-0582f2d377b1 for instance with vm_state active and task_state rebuild_spawning.
Aug 09 15:22:51 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:22:51 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:22:51 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-390d9817-2726-45cc-b0b3-dccc8ce1cbbc tempest-VolumesActionsTest-536484564 tempest-VolumesActionsTest-536484564-project-member] Acquiring lock "d061ee79-0755-44a7-9929-086c274c9064" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:22:51 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-390d9817-2726-45cc-b0b3-dccc8ce1cbbc tempest-VolumesActionsTest-536484564 tempest-VolumesActionsTest-536484564-project-member] Lock "d061ee79-0755-44a7-9929-086c274c9064" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:22:51 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-390d9817-2726-45cc-b0b3-dccc8ce1cbbc tempest-VolumesActionsTest-536484564 tempest-VolumesActionsTest-536484564-project-member] Acquiring lock "d061ee79-0755-44a7-9929-086c274c9064-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:22:51 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-390d9817-2726-45cc-b0b3-dccc8ce1cbbc tempest-VolumesActionsTest-536484564 tempest-VolumesActionsTest-536484564-project-member] Lock "d061ee79-0755-44a7-9929-086c274c9064-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:22:51 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-390d9817-2726-45cc-b0b3-dccc8ce1cbbc tempest-VolumesActionsTest-536484564 tempest-VolumesActionsTest-536484564-project-member] Lock "d061ee79-0755-44a7-9929-086c274c9064-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:22:51 user nova-compute[72382]: INFO nova.compute.manager [None req-390d9817-2726-45cc-b0b3-dccc8ce1cbbc tempest-VolumesActionsTest-536484564 tempest-VolumesActionsTest-536484564-project-member] [instance: d061ee79-0755-44a7-9929-086c274c9064] Terminating instance
Aug 09 15:22:51 user nova-compute[72382]: DEBUG nova.compute.manager [None req-390d9817-2726-45cc-b0b3-dccc8ce1cbbc tempest-VolumesActionsTest-536484564 tempest-VolumesActionsTest-536484564-project-member] [instance: d061ee79-0755-44a7-9929-086c274c9064] Start destroying the instance on the hypervisor. {{(pid=72382) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 15:22:51 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:22:51 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:22:51 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:22:51 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:22:51 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:22:52 user nova-compute[72382]: INFO nova.virt.libvirt.driver [-] [instance: d061ee79-0755-44a7-9929-086c274c9064] Instance destroyed successfully.
Aug 09 15:22:52 user nova-compute[72382]: DEBUG nova.objects.instance [None req-390d9817-2726-45cc-b0b3-dccc8ce1cbbc tempest-VolumesActionsTest-536484564 tempest-VolumesActionsTest-536484564-project-member] Lazy-loading 'resources' on Instance uuid d061ee79-0755-44a7-9929-086c274c9064 {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:22:52 user nova-compute[72382]: DEBUG nova.virt.libvirt.vif [None req-390d9817-2726-45cc-b0b3-dccc8ce1cbbc tempest-VolumesActionsTest-536484564 tempest-VolumesActionsTest-536484564-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T15:20:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-676114299',display_name='tempest-VolumesActionsTest-instance-676114299',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-676114299',id=19,image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-09T15:20:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bb5b667ffa644ac1afe75bd518b86a4d',ramdisk_id='',reservation_id='r-smlwahhz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-536484564',owner_user_name='tempest-VolumesActionsTest-536484564-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T15:20:58Z,user_data=None,user_id='be6ec6133b0e451691ffeb5b710fde32',uuid=d061ee79-0755-44a7-9929-086c274c9064,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b88483f9-249f-473e-a1eb-fee83c57a89b", "address": "fa:16:3e:28:6f:53", "network": {"id": "8cff6610-5196-4dc5-8213-fd83c40bf2b9", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2098434591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb5b667ffa644ac1afe75bd518b86a4d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb88483f9-24", "ovs_interfaceid": "b88483f9-249f-473e-a1eb-fee83c57a89b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 15:22:52 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-390d9817-2726-45cc-b0b3-dccc8ce1cbbc tempest-VolumesActionsTest-536484564 tempest-VolumesActionsTest-536484564-project-member] Converting VIF {"id": "b88483f9-249f-473e-a1eb-fee83c57a89b", "address": "fa:16:3e:28:6f:53", "network": {"id": "8cff6610-5196-4dc5-8213-fd83c40bf2b9", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2098434591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb5b667ffa644ac1afe75bd518b86a4d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb88483f9-24", "ovs_interfaceid": "b88483f9-249f-473e-a1eb-fee83c57a89b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 15:22:52 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-390d9817-2726-45cc-b0b3-dccc8ce1cbbc tempest-VolumesActionsTest-536484564 tempest-VolumesActionsTest-536484564-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:6f:53,bridge_name='br-int',has_traffic_filtering=True,id=b88483f9-249f-473e-a1eb-fee83c57a89b,network=Network(8cff6610-5196-4dc5-8213-fd83c40bf2b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb88483f9-24') {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 15:22:52 user nova-compute[72382]: DEBUG os_vif [None req-390d9817-2726-45cc-b0b3-dccc8ce1cbbc tempest-VolumesActionsTest-536484564 tempest-VolumesActionsTest-536484564-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:6f:53,bridge_name='br-int',has_traffic_filtering=True,id=b88483f9-249f-473e-a1eb-fee83c57a89b,network=Network(8cff6610-5196-4dc5-8213-fd83c40bf2b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb88483f9-24') {{(pid=72382) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 15:22:52 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:22:52 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb88483f9-24, bridge=br-int, if_exists=True) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:22:52 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:22:52 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:22:52 user nova-compute[72382]: INFO os_vif [None req-390d9817-2726-45cc-b0b3-dccc8ce1cbbc tempest-VolumesActionsTest-536484564 tempest-VolumesActionsTest-536484564-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:6f:53,bridge_name='br-int',has_traffic_filtering=True,id=b88483f9-249f-473e-a1eb-fee83c57a89b,network=Network(8cff6610-5196-4dc5-8213-fd83c40bf2b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb88483f9-24')
Aug 09 15:22:52 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-390d9817-2726-45cc-b0b3-dccc8ce1cbbc tempest-VolumesActionsTest-536484564 tempest-VolumesActionsTest-536484564-project-member] [instance: d061ee79-0755-44a7-9929-086c274c9064] Deleting instance files /opt/stack/data/nova/instances/d061ee79-0755-44a7-9929-086c274c9064_del
Aug 09 15:22:52 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-390d9817-2726-45cc-b0b3-dccc8ce1cbbc tempest-VolumesActionsTest-536484564 tempest-VolumesActionsTest-536484564-project-member] [instance: d061ee79-0755-44a7-9929-086c274c9064] Deletion of /opt/stack/data/nova/instances/d061ee79-0755-44a7-9929-086c274c9064_del complete
Aug 09 15:22:52 user nova-compute[72382]: INFO nova.compute.manager [None req-390d9817-2726-45cc-b0b3-dccc8ce1cbbc tempest-VolumesActionsTest-536484564 tempest-VolumesActionsTest-536484564-project-member] [instance: d061ee79-0755-44a7-9929-086c274c9064] Took 0.91 seconds to destroy the instance on the hypervisor.
Aug 09 15:22:52 user nova-compute[72382]: DEBUG oslo.service.loopingcall [None req-390d9817-2726-45cc-b0b3-dccc8ce1cbbc tempest-VolumesActionsTest-536484564 tempest-VolumesActionsTest-536484564-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72382) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 15:22:52 user nova-compute[72382]: DEBUG nova.compute.manager [-] [instance: d061ee79-0755-44a7-9929-086c274c9064] Deallocating network for instance {{(pid=72382) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 15:22:52 user nova-compute[72382]: DEBUG nova.network.neutron [-] [instance: d061ee79-0755-44a7-9929-086c274c9064] deallocate_for_instance() {{(pid=72382) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 15:22:53 user nova-compute[72382]: DEBUG nova.compute.manager [req-d8d9c5e2-f6ed-4356-935a-e34f67327365 req-30de36bf-757c-4f84-874f-68b894483f24 service nova] [instance: 83ebfda8-235d-4404-a973-991d75ae2bf6] Received event network-vif-plugged-b2646c3a-cc2a-4782-a312-0582f2d377b1 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:22:53 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-d8d9c5e2-f6ed-4356-935a-e34f67327365 req-30de36bf-757c-4f84-874f-68b894483f24 service nova] Acquiring lock "83ebfda8-235d-4404-a973-991d75ae2bf6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:22:53 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-d8d9c5e2-f6ed-4356-935a-e34f67327365 req-30de36bf-757c-4f84-874f-68b894483f24 service nova] Lock "83ebfda8-235d-4404-a973-991d75ae2bf6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:22:53 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-d8d9c5e2-f6ed-4356-935a-e34f67327365 req-30de36bf-757c-4f84-874f-68b894483f24 service nova] Lock "83ebfda8-235d-4404-a973-991d75ae2bf6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:22:53 user nova-compute[72382]: DEBUG nova.compute.manager [req-d8d9c5e2-f6ed-4356-935a-e34f67327365 req-30de36bf-757c-4f84-874f-68b894483f24 service nova] [instance: 83ebfda8-235d-4404-a973-991d75ae2bf6] No waiting events found dispatching network-vif-plugged-b2646c3a-cc2a-4782-a312-0582f2d377b1 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:22:53 user nova-compute[72382]: WARNING nova.compute.manager [req-d8d9c5e2-f6ed-4356-935a-e34f67327365 req-30de36bf-757c-4f84-874f-68b894483f24 service nova] [instance: 83ebfda8-235d-4404-a973-991d75ae2bf6] Received unexpected event network-vif-plugged-b2646c3a-cc2a-4782-a312-0582f2d377b1 for instance with vm_state active and task_state rebuild_spawning.
Aug 09 15:22:53 user nova-compute[72382]: DEBUG nova.compute.manager [req-d8d9c5e2-f6ed-4356-935a-e34f67327365 req-30de36bf-757c-4f84-874f-68b894483f24 service nova] [instance: d061ee79-0755-44a7-9929-086c274c9064] Received event network-vif-unplugged-b88483f9-249f-473e-a1eb-fee83c57a89b {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:22:53 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-d8d9c5e2-f6ed-4356-935a-e34f67327365 req-30de36bf-757c-4f84-874f-68b894483f24 service nova] Acquiring lock "d061ee79-0755-44a7-9929-086c274c9064-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:22:53 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-d8d9c5e2-f6ed-4356-935a-e34f67327365 req-30de36bf-757c-4f84-874f-68b894483f24 service nova] Lock "d061ee79-0755-44a7-9929-086c274c9064-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:22:53 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-d8d9c5e2-f6ed-4356-935a-e34f67327365 req-30de36bf-757c-4f84-874f-68b894483f24 service nova] Lock "d061ee79-0755-44a7-9929-086c274c9064-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:22:53 user nova-compute[72382]: DEBUG nova.compute.manager [req-d8d9c5e2-f6ed-4356-935a-e34f67327365 req-30de36bf-757c-4f84-874f-68b894483f24 service nova] [instance: d061ee79-0755-44a7-9929-086c274c9064] No waiting events found dispatching network-vif-unplugged-b88483f9-249f-473e-a1eb-fee83c57a89b {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:22:53 user nova-compute[72382]: DEBUG nova.compute.manager [req-d8d9c5e2-f6ed-4356-935a-e34f67327365 req-30de36bf-757c-4f84-874f-68b894483f24 service nova] [instance: d061ee79-0755-44a7-9929-086c274c9064] Received event network-vif-unplugged-b88483f9-249f-473e-a1eb-fee83c57a89b for instance with task_state deleting. {{(pid=72382) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 15:22:53 user nova-compute[72382]: DEBUG nova.compute.manager [req-d8d9c5e2-f6ed-4356-935a-e34f67327365 req-30de36bf-757c-4f84-874f-68b894483f24 service nova] [instance: d061ee79-0755-44a7-9929-086c274c9064] Received event network-vif-plugged-b88483f9-249f-473e-a1eb-fee83c57a89b {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:22:53 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-d8d9c5e2-f6ed-4356-935a-e34f67327365 req-30de36bf-757c-4f84-874f-68b894483f24 service nova] Acquiring lock "d061ee79-0755-44a7-9929-086c274c9064-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:22:53 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-d8d9c5e2-f6ed-4356-935a-e34f67327365 req-30de36bf-757c-4f84-874f-68b894483f24 service nova] Lock "d061ee79-0755-44a7-9929-086c274c9064-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:22:53 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-d8d9c5e2-f6ed-4356-935a-e34f67327365 req-30de36bf-757c-4f84-874f-68b894483f24 service nova] Lock "d061ee79-0755-44a7-9929-086c274c9064-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:22:53 user nova-compute[72382]: DEBUG nova.compute.manager [req-d8d9c5e2-f6ed-4356-935a-e34f67327365 req-30de36bf-757c-4f84-874f-68b894483f24 service nova] [instance: d061ee79-0755-44a7-9929-086c274c9064] No waiting events found dispatching network-vif-plugged-b88483f9-249f-473e-a1eb-fee83c57a89b {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:22:53 user nova-compute[72382]: WARNING nova.compute.manager [req-d8d9c5e2-f6ed-4356-935a-e34f67327365 req-30de36bf-757c-4f84-874f-68b894483f24 service nova] [instance: d061ee79-0755-44a7-9929-086c274c9064] Received unexpected event network-vif-plugged-b88483f9-249f-473e-a1eb-fee83c57a89b for instance with vm_state active and task_state deleting.
Aug 09 15:22:53 user nova-compute[72382]: DEBUG nova.virt.driver [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Emitting event <LifecycleEvent: 1691594573.1740737, 83ebfda8-235d-4404-a973-991d75ae2bf6 => Resumed> {{(pid=72382) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 15:22:53 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 83ebfda8-235d-4404-a973-991d75ae2bf6] VM Resumed (Lifecycle Event)
Aug 09 15:22:53 user nova-compute[72382]: DEBUG nova.compute.manager [None req-a96be5d9-2d97-44e6-b7d7-982c25f85e5b tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] [instance: 83ebfda8-235d-4404-a973-991d75ae2bf6] Instance event wait completed in 0 seconds for  {{(pid=72382) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 15:22:53 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-a96be5d9-2d97-44e6-b7d7-982c25f85e5b tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] [instance: 83ebfda8-235d-4404-a973-991d75ae2bf6] Guest created on hypervisor {{(pid=72382) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 15:22:53 user nova-compute[72382]: INFO nova.virt.libvirt.driver [-] [instance: 83ebfda8-235d-4404-a973-991d75ae2bf6] Instance spawned successfully.
Aug 09 15:22:53 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-a96be5d9-2d97-44e6-b7d7-982c25f85e5b tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] [instance: 83ebfda8-235d-4404-a973-991d75ae2bf6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 15:22:53 user nova-compute[72382]: DEBUG nova.network.neutron [-] [instance: d061ee79-0755-44a7-9929-086c274c9064] Updating instance_info_cache with network_info: [] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:22:53 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 83ebfda8-235d-4404-a973-991d75ae2bf6] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:22:53 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 83ebfda8-235d-4404-a973-991d75ae2bf6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=72382) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 15:22:53 user nova-compute[72382]: INFO nova.compute.manager [-] [instance: d061ee79-0755-44a7-9929-086c274c9064] Took 0.87 seconds to deallocate network for instance.
Aug 09 15:22:53 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-a96be5d9-2d97-44e6-b7d7-982c25f85e5b tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] [instance: 83ebfda8-235d-4404-a973-991d75ae2bf6] Found default for hw_cdrom_bus of ide {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:22:53 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-a96be5d9-2d97-44e6-b7d7-982c25f85e5b tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] [instance: 83ebfda8-235d-4404-a973-991d75ae2bf6] Found default for hw_disk_bus of virtio {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:22:53 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-a96be5d9-2d97-44e6-b7d7-982c25f85e5b tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] [instance: 83ebfda8-235d-4404-a973-991d75ae2bf6] Found default for hw_input_bus of None {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:22:53 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-a96be5d9-2d97-44e6-b7d7-982c25f85e5b tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] [instance: 83ebfda8-235d-4404-a973-991d75ae2bf6] Found default for hw_pointer_model of None {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:22:53 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-a96be5d9-2d97-44e6-b7d7-982c25f85e5b tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] [instance: 83ebfda8-235d-4404-a973-991d75ae2bf6] Found default for hw_video_model of virtio {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:22:53 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-a96be5d9-2d97-44e6-b7d7-982c25f85e5b tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] [instance: 83ebfda8-235d-4404-a973-991d75ae2bf6] Found default for hw_vif_model of virtio {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:22:53 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 83ebfda8-235d-4404-a973-991d75ae2bf6] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 09 15:22:53 user nova-compute[72382]: DEBUG nova.virt.driver [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Emitting event <LifecycleEvent: 1691594573.1750593, 83ebfda8-235d-4404-a973-991d75ae2bf6 => Started> {{(pid=72382) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 15:22:53 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 83ebfda8-235d-4404-a973-991d75ae2bf6] VM Started (Lifecycle Event)
Aug 09 15:22:53 user nova-compute[72382]: DEBUG nova.compute.manager [req-ab327596-9d3f-42b8-9ade-a90260748c66 req-42ac81ea-c253-4b42-94cc-afacd7cd656c service nova] [instance: d061ee79-0755-44a7-9929-086c274c9064] Received event network-vif-deleted-b88483f9-249f-473e-a1eb-fee83c57a89b {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:22:53 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 83ebfda8-235d-4404-a973-991d75ae2bf6] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:22:53 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 83ebfda8-235d-4404-a973-991d75ae2bf6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=72382) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 15:22:53 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 83ebfda8-235d-4404-a973-991d75ae2bf6] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 09 15:22:53 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-390d9817-2726-45cc-b0b3-dccc8ce1cbbc tempest-VolumesActionsTest-536484564 tempest-VolumesActionsTest-536484564-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:22:53 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-390d9817-2726-45cc-b0b3-dccc8ce1cbbc tempest-VolumesActionsTest-536484564 tempest-VolumesActionsTest-536484564-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:22:53 user nova-compute[72382]: DEBUG nova.compute.manager [None req-a96be5d9-2d97-44e6-b7d7-982c25f85e5b tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] [instance: 83ebfda8-235d-4404-a973-991d75ae2bf6] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:22:53 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-a96be5d9-2d97-44e6-b7d7-982c25f85e5b tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:22:53 user nova-compute[72382]: DEBUG nova.compute.provider_tree [None req-390d9817-2726-45cc-b0b3-dccc8ce1cbbc tempest-VolumesActionsTest-536484564 tempest-VolumesActionsTest-536484564-project-member] Inventory has not changed in ProviderTree for provider: 7b15b0e5-df4d-49db-833b-2855d21d10ae {{(pid=72382) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 15:22:53 user nova-compute[72382]: DEBUG nova.scheduler.client.report [None req-390d9817-2726-45cc-b0b3-dccc8ce1cbbc tempest-VolumesActionsTest-536484564 tempest-VolumesActionsTest-536484564-project-member] Inventory has not changed for provider 7b15b0e5-df4d-49db-833b-2855d21d10ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72382) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 15:22:53 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-390d9817-2726-45cc-b0b3-dccc8ce1cbbc tempest-VolumesActionsTest-536484564 tempest-VolumesActionsTest-536484564-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.418s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:22:53 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-a96be5d9-2d97-44e6-b7d7-982c25f85e5b tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.323s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:22:53 user nova-compute[72382]: DEBUG nova.objects.instance [None req-a96be5d9-2d97-44e6-b7d7-982c25f85e5b tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] [instance: 83ebfda8-235d-4404-a973-991d75ae2bf6] Trying to apply a migration context that does not seem to be set for this instance {{(pid=72382) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Aug 09 15:22:53 user nova-compute[72382]: INFO nova.scheduler.client.report [None req-390d9817-2726-45cc-b0b3-dccc8ce1cbbc tempest-VolumesActionsTest-536484564 tempest-VolumesActionsTest-536484564-project-member] Deleted allocations for instance d061ee79-0755-44a7-9929-086c274c9064
Aug 09 15:22:53 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-a96be5d9-2d97-44e6-b7d7-982c25f85e5b tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.109s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:22:53 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-390d9817-2726-45cc-b0b3-dccc8ce1cbbc tempest-VolumesActionsTest-536484564 tempest-VolumesActionsTest-536484564-project-member] Lock "d061ee79-0755-44a7-9929-086c274c9064" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.489s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:22:54 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:22:54 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:22:57 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:22:58 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:22:59 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:22:59 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-b480224f-4b79-41db-821f-eaf92930c802 tempest-DeleteServersTestJSON-520676128 tempest-DeleteServersTestJSON-520676128-project-member] Acquiring lock "0f4908de-d65d-4d17-ad36-6124a5e64a19" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:22:59 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-b480224f-4b79-41db-821f-eaf92930c802 tempest-DeleteServersTestJSON-520676128 tempest-DeleteServersTestJSON-520676128-project-member] Lock "0f4908de-d65d-4d17-ad36-6124a5e64a19" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:22:59 user nova-compute[72382]: DEBUG nova.compute.manager [None req-b480224f-4b79-41db-821f-eaf92930c802 tempest-DeleteServersTestJSON-520676128 tempest-DeleteServersTestJSON-520676128-project-member] [instance: 0f4908de-d65d-4d17-ad36-6124a5e64a19] Starting instance... {{(pid=72382) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 15:22:59 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-b480224f-4b79-41db-821f-eaf92930c802 tempest-DeleteServersTestJSON-520676128 tempest-DeleteServersTestJSON-520676128-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:22:59 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-b480224f-4b79-41db-821f-eaf92930c802 tempest-DeleteServersTestJSON-520676128 tempest-DeleteServersTestJSON-520676128-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:22:59 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-b480224f-4b79-41db-821f-eaf92930c802 tempest-DeleteServersTestJSON-520676128 tempest-DeleteServersTestJSON-520676128-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72382) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 15:22:59 user nova-compute[72382]: INFO nova.compute.claims [None req-b480224f-4b79-41db-821f-eaf92930c802 tempest-DeleteServersTestJSON-520676128 tempest-DeleteServersTestJSON-520676128-project-member] [instance: 0f4908de-d65d-4d17-ad36-6124a5e64a19] Claim successful on node user
Aug 09 15:23:00 user nova-compute[72382]: DEBUG nova.compute.provider_tree [None req-b480224f-4b79-41db-821f-eaf92930c802 tempest-DeleteServersTestJSON-520676128 tempest-DeleteServersTestJSON-520676128-project-member] Inventory has not changed in ProviderTree for provider: 7b15b0e5-df4d-49db-833b-2855d21d10ae {{(pid=72382) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 15:23:00 user nova-compute[72382]: DEBUG nova.scheduler.client.report [None req-b480224f-4b79-41db-821f-eaf92930c802 tempest-DeleteServersTestJSON-520676128 tempest-DeleteServersTestJSON-520676128-project-member] Inventory has not changed for provider 7b15b0e5-df4d-49db-833b-2855d21d10ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72382) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 15:23:00 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-b480224f-4b79-41db-821f-eaf92930c802 tempest-DeleteServersTestJSON-520676128 tempest-DeleteServersTestJSON-520676128-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.401s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:23:00 user nova-compute[72382]: DEBUG nova.compute.manager [None req-b480224f-4b79-41db-821f-eaf92930c802 tempest-DeleteServersTestJSON-520676128 tempest-DeleteServersTestJSON-520676128-project-member] [instance: 0f4908de-d65d-4d17-ad36-6124a5e64a19] Start building networks asynchronously for instance. {{(pid=72382) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 15:23:00 user nova-compute[72382]: DEBUG nova.compute.manager [None req-b480224f-4b79-41db-821f-eaf92930c802 tempest-DeleteServersTestJSON-520676128 tempest-DeleteServersTestJSON-520676128-project-member] [instance: 0f4908de-d65d-4d17-ad36-6124a5e64a19] Allocating IP information in the background. {{(pid=72382) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 15:23:00 user nova-compute[72382]: DEBUG nova.network.neutron [None req-b480224f-4b79-41db-821f-eaf92930c802 tempest-DeleteServersTestJSON-520676128 tempest-DeleteServersTestJSON-520676128-project-member] [instance: 0f4908de-d65d-4d17-ad36-6124a5e64a19] allocate_for_instance() {{(pid=72382) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 15:23:00 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-b480224f-4b79-41db-821f-eaf92930c802 tempest-DeleteServersTestJSON-520676128 tempest-DeleteServersTestJSON-520676128-project-member] [instance: 0f4908de-d65d-4d17-ad36-6124a5e64a19] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 15:23:00 user nova-compute[72382]: DEBUG nova.compute.manager [None req-b480224f-4b79-41db-821f-eaf92930c802 tempest-DeleteServersTestJSON-520676128 tempest-DeleteServersTestJSON-520676128-project-member] [instance: 0f4908de-d65d-4d17-ad36-6124a5e64a19] Start building block device mappings for instance. {{(pid=72382) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 15:23:00 user nova-compute[72382]: DEBUG nova.policy [None req-b480224f-4b79-41db-821f-eaf92930c802 tempest-DeleteServersTestJSON-520676128 tempest-DeleteServersTestJSON-520676128-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7fbcd129370d45bdb96162fbf065cb83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f05958ff44e4545bdfaac89613b0e09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72382) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 15:23:00 user nova-compute[72382]: DEBUG nova.compute.manager [None req-b480224f-4b79-41db-821f-eaf92930c802 tempest-DeleteServersTestJSON-520676128 tempest-DeleteServersTestJSON-520676128-project-member] [instance: 0f4908de-d65d-4d17-ad36-6124a5e64a19] Start spawning the instance on the hypervisor. {{(pid=72382) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 15:23:00 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-b480224f-4b79-41db-821f-eaf92930c802 tempest-DeleteServersTestJSON-520676128 tempest-DeleteServersTestJSON-520676128-project-member] [instance: 0f4908de-d65d-4d17-ad36-6124a5e64a19] Creating instance directory {{(pid=72382) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 15:23:00 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-b480224f-4b79-41db-821f-eaf92930c802 tempest-DeleteServersTestJSON-520676128 tempest-DeleteServersTestJSON-520676128-project-member] [instance: 0f4908de-d65d-4d17-ad36-6124a5e64a19] Creating image(s)
Aug 09 15:23:00 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-b480224f-4b79-41db-821f-eaf92930c802 tempest-DeleteServersTestJSON-520676128 tempest-DeleteServersTestJSON-520676128-project-member] Acquiring lock "/opt/stack/data/nova/instances/0f4908de-d65d-4d17-ad36-6124a5e64a19/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:23:00 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-b480224f-4b79-41db-821f-eaf92930c802 tempest-DeleteServersTestJSON-520676128 tempest-DeleteServersTestJSON-520676128-project-member] Lock "/opt/stack/data/nova/instances/0f4908de-d65d-4d17-ad36-6124a5e64a19/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:23:00 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-b480224f-4b79-41db-821f-eaf92930c802 tempest-DeleteServersTestJSON-520676128 tempest-DeleteServersTestJSON-520676128-project-member] Lock "/opt/stack/data/nova/instances/0f4908de-d65d-4d17-ad36-6124a5e64a19/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:23:00 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-b480224f-4b79-41db-821f-eaf92930c802 tempest-DeleteServersTestJSON-520676128 tempest-DeleteServersTestJSON-520676128-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:23:00 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-b480224f-4b79-41db-821f-eaf92930c802 tempest-DeleteServersTestJSON-520676128 tempest-DeleteServersTestJSON-520676128-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b --force-share --output=json" returned: 0 in 0.141s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:23:00 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-b480224f-4b79-41db-821f-eaf92930c802 tempest-DeleteServersTestJSON-520676128 tempest-DeleteServersTestJSON-520676128-project-member] Acquiring lock "383812ff437283e0191ed5b9ecc04c27f1162b0b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:23:00 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-b480224f-4b79-41db-821f-eaf92930c802 tempest-DeleteServersTestJSON-520676128 tempest-DeleteServersTestJSON-520676128-project-member] Lock "383812ff437283e0191ed5b9ecc04c27f1162b0b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:23:00 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-b480224f-4b79-41db-821f-eaf92930c802 tempest-DeleteServersTestJSON-520676128 tempest-DeleteServersTestJSON-520676128-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:23:00 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-b480224f-4b79-41db-821f-eaf92930c802 tempest-DeleteServersTestJSON-520676128 tempest-DeleteServersTestJSON-520676128-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b --force-share --output=json" returned: 0 in 0.146s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:23:00 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-b480224f-4b79-41db-821f-eaf92930c802 tempest-DeleteServersTestJSON-520676128 tempest-DeleteServersTestJSON-520676128-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b,backing_fmt=raw /opt/stack/data/nova/instances/0f4908de-d65d-4d17-ad36-6124a5e64a19/disk 1073741824 {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:23:00 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-b480224f-4b79-41db-821f-eaf92930c802 tempest-DeleteServersTestJSON-520676128 tempest-DeleteServersTestJSON-520676128-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b,backing_fmt=raw /opt/stack/data/nova/instances/0f4908de-d65d-4d17-ad36-6124a5e64a19/disk 1073741824" returned: 0 in 0.057s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:23:00 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-b480224f-4b79-41db-821f-eaf92930c802 tempest-DeleteServersTestJSON-520676128 tempest-DeleteServersTestJSON-520676128-project-member] Lock "383812ff437283e0191ed5b9ecc04c27f1162b0b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.210s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:23:00 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-b480224f-4b79-41db-821f-eaf92930c802 tempest-DeleteServersTestJSON-520676128 tempest-DeleteServersTestJSON-520676128-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:23:00 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-b480224f-4b79-41db-821f-eaf92930c802 tempest-DeleteServersTestJSON-520676128 tempest-DeleteServersTestJSON-520676128-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b --force-share --output=json" returned: 0 in 0.132s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:23:00 user nova-compute[72382]: DEBUG nova.virt.disk.api [None req-b480224f-4b79-41db-821f-eaf92930c802 tempest-DeleteServersTestJSON-520676128 tempest-DeleteServersTestJSON-520676128-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0f4908de-d65d-4d17-ad36-6124a5e64a19/disk. size=1073741824 {{(pid=72382) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 15:23:00 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-b480224f-4b79-41db-821f-eaf92930c802 tempest-DeleteServersTestJSON-520676128 tempest-DeleteServersTestJSON-520676128-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f4908de-d65d-4d17-ad36-6124a5e64a19/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:23:01 user nova-compute[72382]: DEBUG nova.network.neutron [None req-b480224f-4b79-41db-821f-eaf92930c802 tempest-DeleteServersTestJSON-520676128 tempest-DeleteServersTestJSON-520676128-project-member] [instance: 0f4908de-d65d-4d17-ad36-6124a5e64a19] Successfully created port: c6dc07b5-9e80-43a1-a3a1-bb0db357fc94 {{(pid=72382) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 15:23:01 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-b480224f-4b79-41db-821f-eaf92930c802 tempest-DeleteServersTestJSON-520676128 tempest-DeleteServersTestJSON-520676128-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f4908de-d65d-4d17-ad36-6124a5e64a19/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:23:01 user nova-compute[72382]: DEBUG nova.virt.disk.api [None req-b480224f-4b79-41db-821f-eaf92930c802 tempest-DeleteServersTestJSON-520676128 tempest-DeleteServersTestJSON-520676128-project-member] Cannot resize image /opt/stack/data/nova/instances/0f4908de-d65d-4d17-ad36-6124a5e64a19/disk to a smaller size. {{(pid=72382) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 15:23:01 user nova-compute[72382]: DEBUG nova.objects.instance [None req-b480224f-4b79-41db-821f-eaf92930c802 tempest-DeleteServersTestJSON-520676128 tempest-DeleteServersTestJSON-520676128-project-member] Lazy-loading 'migration_context' on Instance uuid 0f4908de-d65d-4d17-ad36-6124a5e64a19 {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:23:01 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-b480224f-4b79-41db-821f-eaf92930c802 tempest-DeleteServersTestJSON-520676128 tempest-DeleteServersTestJSON-520676128-project-member] [instance: 0f4908de-d65d-4d17-ad36-6124a5e64a19] Created local disks {{(pid=72382) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 15:23:01 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-b480224f-4b79-41db-821f-eaf92930c802 tempest-DeleteServersTestJSON-520676128 tempest-DeleteServersTestJSON-520676128-project-member] [instance: 0f4908de-d65d-4d17-ad36-6124a5e64a19] Ensure instance console log exists: /opt/stack/data/nova/instances/0f4908de-d65d-4d17-ad36-6124a5e64a19/console.log {{(pid=72382) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 15:23:01 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-b480224f-4b79-41db-821f-eaf92930c802 tempest-DeleteServersTestJSON-520676128 tempest-DeleteServersTestJSON-520676128-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:23:01 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-b480224f-4b79-41db-821f-eaf92930c802 tempest-DeleteServersTestJSON-520676128 tempest-DeleteServersTestJSON-520676128-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:23:01 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-b480224f-4b79-41db-821f-eaf92930c802 tempest-DeleteServersTestJSON-520676128 tempest-DeleteServersTestJSON-520676128-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:23:01 user nova-compute[72382]: DEBUG nova.network.neutron [None req-b480224f-4b79-41db-821f-eaf92930c802 tempest-DeleteServersTestJSON-520676128 tempest-DeleteServersTestJSON-520676128-project-member] [instance: 0f4908de-d65d-4d17-ad36-6124a5e64a19] Successfully updated port: c6dc07b5-9e80-43a1-a3a1-bb0db357fc94 {{(pid=72382) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 15:23:01 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-b480224f-4b79-41db-821f-eaf92930c802 tempest-DeleteServersTestJSON-520676128 tempest-DeleteServersTestJSON-520676128-project-member] Acquiring lock "refresh_cache-0f4908de-d65d-4d17-ad36-6124a5e64a19" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 15:23:01 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-b480224f-4b79-41db-821f-eaf92930c802 tempest-DeleteServersTestJSON-520676128 tempest-DeleteServersTestJSON-520676128-project-member] Acquired lock "refresh_cache-0f4908de-d65d-4d17-ad36-6124a5e64a19" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 15:23:01 user nova-compute[72382]: DEBUG nova.network.neutron [None req-b480224f-4b79-41db-821f-eaf92930c802 tempest-DeleteServersTestJSON-520676128 tempest-DeleteServersTestJSON-520676128-project-member] [instance: 0f4908de-d65d-4d17-ad36-6124a5e64a19] Building network info cache for instance {{(pid=72382) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 15:23:01 user nova-compute[72382]: DEBUG nova.compute.manager [req-585ad07a-78a9-4a22-b71b-030cda40ebf5 req-0e83ed8b-44b0-4b57-b939-8ae171d8b974 service nova] [instance: 0f4908de-d65d-4d17-ad36-6124a5e64a19] Received event network-changed-c6dc07b5-9e80-43a1-a3a1-bb0db357fc94 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:23:01 user nova-compute[72382]: DEBUG nova.compute.manager [req-585ad07a-78a9-4a22-b71b-030cda40ebf5 req-0e83ed8b-44b0-4b57-b939-8ae171d8b974 service nova] [instance: 0f4908de-d65d-4d17-ad36-6124a5e64a19] Refreshing instance network info cache due to event network-changed-c6dc07b5-9e80-43a1-a3a1-bb0db357fc94. {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 15:23:01 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-585ad07a-78a9-4a22-b71b-030cda40ebf5 req-0e83ed8b-44b0-4b57-b939-8ae171d8b974 service nova] Acquiring lock "refresh_cache-0f4908de-d65d-4d17-ad36-6124a5e64a19" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 15:23:01 user nova-compute[72382]: DEBUG nova.network.neutron [None req-b480224f-4b79-41db-821f-eaf92930c802 tempest-DeleteServersTestJSON-520676128 tempest-DeleteServersTestJSON-520676128-project-member] [instance: 0f4908de-d65d-4d17-ad36-6124a5e64a19] Instance cache missing network info. {{(pid=72382) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 15:23:02 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:23:02 user nova-compute[72382]: DEBUG nova.network.neutron [None req-b480224f-4b79-41db-821f-eaf92930c802 tempest-DeleteServersTestJSON-520676128 tempest-DeleteServersTestJSON-520676128-project-member] [instance: 0f4908de-d65d-4d17-ad36-6124a5e64a19] Updating instance_info_cache with network_info: [{"id": "c6dc07b5-9e80-43a1-a3a1-bb0db357fc94", "address": "fa:16:3e:03:f5:7d", "network": {"id": "6c9c326e-15d5-4342-b8c7-b1a27e14a34e", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-786712907-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f05958ff44e4545bdfaac89613b0e09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6dc07b5-9e", "ovs_interfaceid": "c6dc07b5-9e80-43a1-a3a1-bb0db357fc94", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:23:02 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-b480224f-4b79-41db-821f-eaf92930c802 tempest-DeleteServersTestJSON-520676128 tempest-DeleteServersTestJSON-520676128-project-member] Releasing lock "refresh_cache-0f4908de-d65d-4d17-ad36-6124a5e64a19" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 15:23:02 user nova-compute[72382]: DEBUG nova.compute.manager [None req-b480224f-4b79-41db-821f-eaf92930c802 tempest-DeleteServersTestJSON-520676128 tempest-DeleteServersTestJSON-520676128-project-member] [instance: 0f4908de-d65d-4d17-ad36-6124a5e64a19] Instance network_info: |[{"id": "c6dc07b5-9e80-43a1-a3a1-bb0db357fc94", "address": "fa:16:3e:03:f5:7d", "network": {"id": "6c9c326e-15d5-4342-b8c7-b1a27e14a34e", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-786712907-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f05958ff44e4545bdfaac89613b0e09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6dc07b5-9e", "ovs_interfaceid": "c6dc07b5-9e80-43a1-a3a1-bb0db357fc94", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72382) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 15:23:02 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-585ad07a-78a9-4a22-b71b-030cda40ebf5 req-0e83ed8b-44b0-4b57-b939-8ae171d8b974 service nova] Acquired lock "refresh_cache-0f4908de-d65d-4d17-ad36-6124a5e64a19" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 15:23:02 user nova-compute[72382]: DEBUG nova.network.neutron [req-585ad07a-78a9-4a22-b71b-030cda40ebf5 req-0e83ed8b-44b0-4b57-b939-8ae171d8b974 service nova] [instance: 0f4908de-d65d-4d17-ad36-6124a5e64a19] Refreshing network info cache for port c6dc07b5-9e80-43a1-a3a1-bb0db357fc94 {{(pid=72382) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 15:23:02 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-b480224f-4b79-41db-821f-eaf92930c802 tempest-DeleteServersTestJSON-520676128 tempest-DeleteServersTestJSON-520676128-project-member] [instance: 0f4908de-d65d-4d17-ad36-6124a5e64a19] Start _get_guest_xml network_info=[{"id": "c6dc07b5-9e80-43a1-a3a1-bb0db357fc94", "address": "fa:16:3e:03:f5:7d", "network": {"id": "6c9c326e-15d5-4342-b8c7-b1a27e14a34e", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-786712907-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f05958ff44e4545bdfaac89613b0e09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6dc07b5-9e", "ovs_interfaceid": "c6dc07b5-9e80-43a1-a3a1-bb0db357fc94", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T15:11:25Z,direct_url=<?>,disk_format='qcow2',id=a79f2cea-eb27-4631-aaf3-05e7d9e411b4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a638990e12cc4d6eabb6d55e13be6bdf',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T15:11:27Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'a79f2cea-eb27-4631-aaf3-05e7d9e411b4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72382) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 15:23:02 user nova-compute[72382]: WARNING nova.virt.libvirt.driver [None req-b480224f-4b79-41db-821f-eaf92930c802 tempest-DeleteServersTestJSON-520676128 tempest-DeleteServersTestJSON-520676128-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 15:23:02 user nova-compute[72382]: WARNING nova.virt.libvirt.driver [None req-b480224f-4b79-41db-821f-eaf92930c802 tempest-DeleteServersTestJSON-520676128 tempest-DeleteServersTestJSON-520676128-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 15:23:02 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-b480224f-4b79-41db-821f-eaf92930c802 tempest-DeleteServersTestJSON-520676128 tempest-DeleteServersTestJSON-520676128-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72382) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 15:23:02 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-b480224f-4b79-41db-821f-eaf92930c802 tempest-DeleteServersTestJSON-520676128 tempest-DeleteServersTestJSON-520676128-project-member] CPU controller missing on host. {{(pid=72382) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 15:23:02 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-b480224f-4b79-41db-821f-eaf92930c802 tempest-DeleteServersTestJSON-520676128 tempest-DeleteServersTestJSON-520676128-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72382) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 15:23:02 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-b480224f-4b79-41db-821f-eaf92930c802 tempest-DeleteServersTestJSON-520676128 tempest-DeleteServersTestJSON-520676128-project-member] CPU controller found on host. {{(pid=72382) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 15:23:02 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-b480224f-4b79-41db-821f-eaf92930c802 tempest-DeleteServersTestJSON-520676128 tempest-DeleteServersTestJSON-520676128-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72382) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 15:23:02 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-b480224f-4b79-41db-821f-eaf92930c802 tempest-DeleteServersTestJSON-520676128 tempest-DeleteServersTestJSON-520676128-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T15:11:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T15:11:25Z,direct_url=<?>,disk_format='qcow2',id=a79f2cea-eb27-4631-aaf3-05e7d9e411b4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a638990e12cc4d6eabb6d55e13be6bdf',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T15:11:27Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 15:23:02 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-b480224f-4b79-41db-821f-eaf92930c802 tempest-DeleteServersTestJSON-520676128 tempest-DeleteServersTestJSON-520676128-project-member] Flavor limits 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 15:23:02 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-b480224f-4b79-41db-821f-eaf92930c802 tempest-DeleteServersTestJSON-520676128 tempest-DeleteServersTestJSON-520676128-project-member] Image limits 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 15:23:02 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-b480224f-4b79-41db-821f-eaf92930c802 tempest-DeleteServersTestJSON-520676128 tempest-DeleteServersTestJSON-520676128-project-member] Flavor pref 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 15:23:02 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-b480224f-4b79-41db-821f-eaf92930c802 tempest-DeleteServersTestJSON-520676128 tempest-DeleteServersTestJSON-520676128-project-member] Image pref 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 15:23:02 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-b480224f-4b79-41db-821f-eaf92930c802 tempest-DeleteServersTestJSON-520676128 tempest-DeleteServersTestJSON-520676128-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 15:23:02 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-b480224f-4b79-41db-821f-eaf92930c802 tempest-DeleteServersTestJSON-520676128 tempest-DeleteServersTestJSON-520676128-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 15:23:02 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-b480224f-4b79-41db-821f-eaf92930c802 tempest-DeleteServersTestJSON-520676128 tempest-DeleteServersTestJSON-520676128-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72382) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 15:23:02 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-b480224f-4b79-41db-821f-eaf92930c802 tempest-DeleteServersTestJSON-520676128 tempest-DeleteServersTestJSON-520676128-project-member] Got 1 possible topologies {{(pid=72382) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 15:23:02 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-b480224f-4b79-41db-821f-eaf92930c802 tempest-DeleteServersTestJSON-520676128 tempest-DeleteServersTestJSON-520676128-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 15:23:02 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-b480224f-4b79-41db-821f-eaf92930c802 tempest-DeleteServersTestJSON-520676128 tempest-DeleteServersTestJSON-520676128-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 15:23:02 user nova-compute[72382]: DEBUG nova.virt.libvirt.vif [None req-b480224f-4b79-41db-821f-eaf92930c802 tempest-DeleteServersTestJSON-520676128 tempest-DeleteServersTestJSON-520676128-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T15:22:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1021649166',display_name='tempest-DeleteServersTestJSON-server-1021649166',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1021649166',id=21,image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1f05958ff44e4545bdfaac89613b0e09',ramdisk_id='',reservation_id='r-s7bid1ll',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-520676128',owner_user_name='tempest-DeleteServersTestJSON-520676128-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T15:23:00Z,user_data=None,user_id='7fbcd129370d45bdb96162fbf065cb83',uuid=0f4908de-d65d-4d17-ad36-6124a5e64a19,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c6dc07b5-9e80-43a1-a3a1-bb0db357fc94", "address": "fa:16:3e:03:f5:7d", "network": {"id": "6c9c326e-15d5-4342-b8c7-b1a27e14a34e", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-786712907-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f05958ff44e4545bdfaac89613b0e09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6dc07b5-9e", "ovs_interfaceid": "c6dc07b5-9e80-43a1-a3a1-bb0db357fc94", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72382) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 15:23:02 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-b480224f-4b79-41db-821f-eaf92930c802 tempest-DeleteServersTestJSON-520676128 tempest-DeleteServersTestJSON-520676128-project-member] Converting VIF {"id": "c6dc07b5-9e80-43a1-a3a1-bb0db357fc94", "address": "fa:16:3e:03:f5:7d", "network": {"id": "6c9c326e-15d5-4342-b8c7-b1a27e14a34e", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-786712907-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f05958ff44e4545bdfaac89613b0e09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6dc07b5-9e", "ovs_interfaceid": "c6dc07b5-9e80-43a1-a3a1-bb0db357fc94", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 15:23:02 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-b480224f-4b79-41db-821f-eaf92930c802 tempest-DeleteServersTestJSON-520676128 tempest-DeleteServersTestJSON-520676128-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:03:f5:7d,bridge_name='br-int',has_traffic_filtering=True,id=c6dc07b5-9e80-43a1-a3a1-bb0db357fc94,network=Network(6c9c326e-15d5-4342-b8c7-b1a27e14a34e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc6dc07b5-9e') {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 15:23:02 user nova-compute[72382]: DEBUG nova.objects.instance [None req-b480224f-4b79-41db-821f-eaf92930c802 tempest-DeleteServersTestJSON-520676128 tempest-DeleteServersTestJSON-520676128-project-member] Lazy-loading 'pci_devices' on Instance uuid 0f4908de-d65d-4d17-ad36-6124a5e64a19 {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:23:02 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-b480224f-4b79-41db-821f-eaf92930c802 tempest-DeleteServersTestJSON-520676128 tempest-DeleteServersTestJSON-520676128-project-member] [instance: 0f4908de-d65d-4d17-ad36-6124a5e64a19] End _get_guest_xml xml=<domain type="kvm">
Aug 09 15:23:02 user nova-compute[72382]:   <uuid>0f4908de-d65d-4d17-ad36-6124a5e64a19</uuid>
Aug 09 15:23:02 user nova-compute[72382]:   <name>instance-00000015</name>
Aug 09 15:23:02 user nova-compute[72382]:   <memory>524288</memory>
Aug 09 15:23:02 user nova-compute[72382]:   <vcpu>1</vcpu>
Aug 09 15:23:02 user nova-compute[72382]:   <metadata>
Aug 09 15:23:02 user nova-compute[72382]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 15:23:02 user nova-compute[72382]:       <nova:package version="0.0.0"/>
Aug 09 15:23:02 user nova-compute[72382]:       <nova:name>tempest-DeleteServersTestJSON-server-1021649166</nova:name>
Aug 09 15:23:02 user nova-compute[72382]:       <nova:creationTime>2023-08-09 15:23:02</nova:creationTime>
Aug 09 15:23:02 user nova-compute[72382]:       <nova:flavor name="m1.tiny">
Aug 09 15:23:02 user nova-compute[72382]:         <nova:memory>512</nova:memory>
Aug 09 15:23:02 user nova-compute[72382]:         <nova:disk>1</nova:disk>
Aug 09 15:23:02 user nova-compute[72382]:         <nova:swap>0</nova:swap>
Aug 09 15:23:02 user nova-compute[72382]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 15:23:02 user nova-compute[72382]:         <nova:vcpus>1</nova:vcpus>
Aug 09 15:23:02 user nova-compute[72382]:       </nova:flavor>
Aug 09 15:23:02 user nova-compute[72382]:       <nova:owner>
Aug 09 15:23:02 user nova-compute[72382]:         <nova:user uuid="7fbcd129370d45bdb96162fbf065cb83">tempest-DeleteServersTestJSON-520676128-project-member</nova:user>
Aug 09 15:23:02 user nova-compute[72382]:         <nova:project uuid="1f05958ff44e4545bdfaac89613b0e09">tempest-DeleteServersTestJSON-520676128</nova:project>
Aug 09 15:23:02 user nova-compute[72382]:       </nova:owner>
Aug 09 15:23:02 user nova-compute[72382]:       <nova:root type="image" uuid="a79f2cea-eb27-4631-aaf3-05e7d9e411b4"/>
Aug 09 15:23:02 user nova-compute[72382]:       <nova:ports>
Aug 09 15:23:02 user nova-compute[72382]:         <nova:port uuid="c6dc07b5-9e80-43a1-a3a1-bb0db357fc94">
Aug 09 15:23:02 user nova-compute[72382]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 09 15:23:02 user nova-compute[72382]:         </nova:port>
Aug 09 15:23:02 user nova-compute[72382]:       </nova:ports>
Aug 09 15:23:02 user nova-compute[72382]:     </nova:instance>
Aug 09 15:23:02 user nova-compute[72382]:   </metadata>
Aug 09 15:23:02 user nova-compute[72382]:   <sysinfo type="smbios">
Aug 09 15:23:02 user nova-compute[72382]:     <system>
Aug 09 15:23:02 user nova-compute[72382]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 15:23:02 user nova-compute[72382]:       <entry name="product">OpenStack Nova</entry>
Aug 09 15:23:02 user nova-compute[72382]:       <entry name="version">0.0.0</entry>
Aug 09 15:23:02 user nova-compute[72382]:       <entry name="serial">0f4908de-d65d-4d17-ad36-6124a5e64a19</entry>
Aug 09 15:23:02 user nova-compute[72382]:       <entry name="uuid">0f4908de-d65d-4d17-ad36-6124a5e64a19</entry>
Aug 09 15:23:02 user nova-compute[72382]:       <entry name="family">Virtual Machine</entry>
Aug 09 15:23:02 user nova-compute[72382]:     </system>
Aug 09 15:23:02 user nova-compute[72382]:   </sysinfo>
Aug 09 15:23:02 user nova-compute[72382]:   <os>
Aug 09 15:23:02 user nova-compute[72382]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 15:23:02 user nova-compute[72382]:     <boot dev="hd"/>
Aug 09 15:23:02 user nova-compute[72382]:     <smbios mode="sysinfo"/>
Aug 09 15:23:02 user nova-compute[72382]:   </os>
Aug 09 15:23:02 user nova-compute[72382]:   <features>
Aug 09 15:23:02 user nova-compute[72382]:     <acpi/>
Aug 09 15:23:02 user nova-compute[72382]:     <apic/>
Aug 09 15:23:02 user nova-compute[72382]:     <vmcoreinfo/>
Aug 09 15:23:02 user nova-compute[72382]:   </features>
Aug 09 15:23:02 user nova-compute[72382]:   <clock offset="utc">
Aug 09 15:23:02 user nova-compute[72382]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 15:23:02 user nova-compute[72382]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 15:23:02 user nova-compute[72382]:     <timer name="hpet" present="no"/>
Aug 09 15:23:02 user nova-compute[72382]:   </clock>
Aug 09 15:23:02 user nova-compute[72382]:   <cpu mode="custom" match="exact">
Aug 09 15:23:02 user nova-compute[72382]:     <model>Nehalem</model>
Aug 09 15:23:02 user nova-compute[72382]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 15:23:02 user nova-compute[72382]:   </cpu>
Aug 09 15:23:02 user nova-compute[72382]:   <devices>
Aug 09 15:23:02 user nova-compute[72382]:     <disk type="file" device="disk">
Aug 09 15:23:02 user nova-compute[72382]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 15:23:02 user nova-compute[72382]:       <source file="/opt/stack/data/nova/instances/0f4908de-d65d-4d17-ad36-6124a5e64a19/disk"/>
Aug 09 15:23:02 user nova-compute[72382]:       <target dev="vda" bus="virtio"/>
Aug 09 15:23:02 user nova-compute[72382]:     </disk>
Aug 09 15:23:02 user nova-compute[72382]:     <interface type="ethernet">
Aug 09 15:23:02 user nova-compute[72382]:       <mac address="fa:16:3e:03:f5:7d"/>
Aug 09 15:23:02 user nova-compute[72382]:       <model type="virtio"/>
Aug 09 15:23:02 user nova-compute[72382]:       <mtu size="1442"/>
Aug 09 15:23:02 user nova-compute[72382]:       <target dev="tapc6dc07b5-9e"/>
Aug 09 15:23:02 user nova-compute[72382]:     </interface>
Aug 09 15:23:02 user nova-compute[72382]:     <serial type="pty">
Aug 09 15:23:02 user nova-compute[72382]:       <log file="/opt/stack/data/nova/instances/0f4908de-d65d-4d17-ad36-6124a5e64a19/console.log" append="off"/>
Aug 09 15:23:02 user nova-compute[72382]:     </serial>
Aug 09 15:23:02 user nova-compute[72382]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 15:23:02 user nova-compute[72382]:     <video>
Aug 09 15:23:02 user nova-compute[72382]:       <model type="virtio"/>
Aug 09 15:23:02 user nova-compute[72382]:     </video>
Aug 09 15:23:02 user nova-compute[72382]:     <rng model="virtio">
Aug 09 15:23:02 user nova-compute[72382]:       <backend model="random">/dev/urandom</backend>
Aug 09 15:23:02 user nova-compute[72382]:     </rng>
Aug 09 15:23:02 user nova-compute[72382]:     <controller type="usb" index="0" model="none"/>
Aug 09 15:23:02 user nova-compute[72382]:     <memballoon model="virtio">
Aug 09 15:23:02 user nova-compute[72382]:       <stats period="10"/>
Aug 09 15:23:02 user nova-compute[72382]:     </memballoon>
Aug 09 15:23:02 user nova-compute[72382]:   </devices>
Aug 09 15:23:02 user nova-compute[72382]: </domain>
Aug 09 15:23:02 user nova-compute[72382]:  {{(pid=72382) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 15:23:02 user nova-compute[72382]: DEBUG nova.virt.libvirt.vif [None req-b480224f-4b79-41db-821f-eaf92930c802 tempest-DeleteServersTestJSON-520676128 tempest-DeleteServersTestJSON-520676128-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T15:22:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1021649166',display_name='tempest-DeleteServersTestJSON-server-1021649166',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1021649166',id=21,image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1f05958ff44e4545bdfaac89613b0e09',ramdisk_id='',reservation_id='r-s7bid1ll',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-520676128',owner_user_name='tempest-DeleteServersTestJSON-520676128-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T15:23:00Z,user_data=None,user_id='7fbcd129370d45bdb96162fbf065cb83',uuid=0f4908de-d65d-4d17-ad36-6124a5e64a19,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c6dc07b5-9e80-43a1-a3a1-bb0db357fc94", "address": "fa:16:3e:03:f5:7d", "network": {"id": "6c9c326e-15d5-4342-b8c7-b1a27e14a34e", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-786712907-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f05958ff44e4545bdfaac89613b0e09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6dc07b5-9e", "ovs_interfaceid": "c6dc07b5-9e80-43a1-a3a1-bb0db357fc94", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 15:23:02 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-b480224f-4b79-41db-821f-eaf92930c802 tempest-DeleteServersTestJSON-520676128 tempest-DeleteServersTestJSON-520676128-project-member] Converting VIF {"id": "c6dc07b5-9e80-43a1-a3a1-bb0db357fc94", "address": "fa:16:3e:03:f5:7d", "network": {"id": "6c9c326e-15d5-4342-b8c7-b1a27e14a34e", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-786712907-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f05958ff44e4545bdfaac89613b0e09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6dc07b5-9e", "ovs_interfaceid": "c6dc07b5-9e80-43a1-a3a1-bb0db357fc94", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 15:23:02 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-b480224f-4b79-41db-821f-eaf92930c802 tempest-DeleteServersTestJSON-520676128 tempest-DeleteServersTestJSON-520676128-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:03:f5:7d,bridge_name='br-int',has_traffic_filtering=True,id=c6dc07b5-9e80-43a1-a3a1-bb0db357fc94,network=Network(6c9c326e-15d5-4342-b8c7-b1a27e14a34e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc6dc07b5-9e') {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 15:23:02 user nova-compute[72382]: DEBUG os_vif [None req-b480224f-4b79-41db-821f-eaf92930c802 tempest-DeleteServersTestJSON-520676128 tempest-DeleteServersTestJSON-520676128-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:f5:7d,bridge_name='br-int',has_traffic_filtering=True,id=c6dc07b5-9e80-43a1-a3a1-bb0db357fc94,network=Network(6c9c326e-15d5-4342-b8c7-b1a27e14a34e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc6dc07b5-9e') {{(pid=72382) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 15:23:02 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:23:02 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:23:02 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 15:23:02 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:23:02 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc6dc07b5-9e, may_exist=True, interface_attrs={}) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:23:02 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc6dc07b5-9e, col_values=(('external_ids', {'iface-id': 'c6dc07b5-9e80-43a1-a3a1-bb0db357fc94', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:03:f5:7d', 'vm-uuid': '0f4908de-d65d-4d17-ad36-6124a5e64a19'}),), if_exists=True) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:23:02 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:23:02 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:23:02 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:23:02 user nova-compute[72382]: INFO os_vif [None req-b480224f-4b79-41db-821f-eaf92930c802 tempest-DeleteServersTestJSON-520676128 tempest-DeleteServersTestJSON-520676128-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:f5:7d,bridge_name='br-int',has_traffic_filtering=True,id=c6dc07b5-9e80-43a1-a3a1-bb0db357fc94,network=Network(6c9c326e-15d5-4342-b8c7-b1a27e14a34e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc6dc07b5-9e')
Aug 09 15:23:02 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-b480224f-4b79-41db-821f-eaf92930c802 tempest-DeleteServersTestJSON-520676128 tempest-DeleteServersTestJSON-520676128-project-member] No BDM found with device name vda, not building metadata. {{(pid=72382) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 15:23:02 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-b480224f-4b79-41db-821f-eaf92930c802 tempest-DeleteServersTestJSON-520676128 tempest-DeleteServersTestJSON-520676128-project-member] No VIF found with MAC fa:16:3e:03:f5:7d, not building metadata {{(pid=72382) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 15:23:02 user nova-compute[72382]: DEBUG nova.network.neutron [req-585ad07a-78a9-4a22-b71b-030cda40ebf5 req-0e83ed8b-44b0-4b57-b939-8ae171d8b974 service nova] [instance: 0f4908de-d65d-4d17-ad36-6124a5e64a19] Updated VIF entry in instance network info cache for port c6dc07b5-9e80-43a1-a3a1-bb0db357fc94. {{(pid=72382) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 15:23:02 user nova-compute[72382]: DEBUG nova.network.neutron [req-585ad07a-78a9-4a22-b71b-030cda40ebf5 req-0e83ed8b-44b0-4b57-b939-8ae171d8b974 service nova] [instance: 0f4908de-d65d-4d17-ad36-6124a5e64a19] Updating instance_info_cache with network_info: [{"id": "c6dc07b5-9e80-43a1-a3a1-bb0db357fc94", "address": "fa:16:3e:03:f5:7d", "network": {"id": "6c9c326e-15d5-4342-b8c7-b1a27e14a34e", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-786712907-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f05958ff44e4545bdfaac89613b0e09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6dc07b5-9e", "ovs_interfaceid": "c6dc07b5-9e80-43a1-a3a1-bb0db357fc94", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:23:02 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-585ad07a-78a9-4a22-b71b-030cda40ebf5 req-0e83ed8b-44b0-4b57-b939-8ae171d8b974 service nova] Releasing lock "refresh_cache-0f4908de-d65d-4d17-ad36-6124a5e64a19" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 15:23:03 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:23:03 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:23:03 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:23:04 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:23:04 user nova-compute[72382]: DEBUG nova.compute.manager [req-b40c7a10-eb95-4194-8d2f-3f01e3ffc3e2 req-fc5d2d72-eb08-4e10-8d15-c7b2f21c2845 service nova] [instance: 0f4908de-d65d-4d17-ad36-6124a5e64a19] Received event network-vif-plugged-c6dc07b5-9e80-43a1-a3a1-bb0db357fc94 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:23:04 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-b40c7a10-eb95-4194-8d2f-3f01e3ffc3e2 req-fc5d2d72-eb08-4e10-8d15-c7b2f21c2845 service nova] Acquiring lock "0f4908de-d65d-4d17-ad36-6124a5e64a19-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:23:04 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-b40c7a10-eb95-4194-8d2f-3f01e3ffc3e2 req-fc5d2d72-eb08-4e10-8d15-c7b2f21c2845 service nova] Lock "0f4908de-d65d-4d17-ad36-6124a5e64a19-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:23:04 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-b40c7a10-eb95-4194-8d2f-3f01e3ffc3e2 req-fc5d2d72-eb08-4e10-8d15-c7b2f21c2845 service nova] Lock "0f4908de-d65d-4d17-ad36-6124a5e64a19-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:23:04 user nova-compute[72382]: DEBUG nova.compute.manager [req-b40c7a10-eb95-4194-8d2f-3f01e3ffc3e2 req-fc5d2d72-eb08-4e10-8d15-c7b2f21c2845 service nova] [instance: 0f4908de-d65d-4d17-ad36-6124a5e64a19] No waiting events found dispatching network-vif-plugged-c6dc07b5-9e80-43a1-a3a1-bb0db357fc94 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:23:04 user nova-compute[72382]: WARNING nova.compute.manager [req-b40c7a10-eb95-4194-8d2f-3f01e3ffc3e2 req-fc5d2d72-eb08-4e10-8d15-c7b2f21c2845 service nova] [instance: 0f4908de-d65d-4d17-ad36-6124a5e64a19] Received unexpected event network-vif-plugged-c6dc07b5-9e80-43a1-a3a1-bb0db357fc94 for instance with vm_state building and task_state spawning.
Aug 09 15:23:04 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:23:04 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:23:04 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:23:05 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-da01acda-22cb-42d5-b44b-acd447013986 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] [instance: 8aa35482-60b8-4185-b14d-a2667fd3b5b7] Calling os-brick to attach iSCSI Volume {{(pid=72382) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 15:23:05 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-da01acda-22cb-42d5-b44b-acd447013986 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2a0c768340>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:0052e86d-16a7-4cbe-a802-ff770c0e20ba'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TMwGDLsY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 15:23:05 user nova-compute[72382]: WARNING os_brick.initiator.connectors.base [None req-da01acda-22cb-42d5-b44b-acd447013986 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 15:23:05 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-da01acda-22cb-42d5-b44b-acd447013986 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 15:23:05 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-da01acda-22cb-42d5-b44b-acd447013986 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 15:23:05 user nova-compute[72382]: WARNING os_brick.initiator.connectors.base [None req-da01acda-22cb-42d5-b44b-acd447013986 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 15:23:05 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-da01acda-22cb-42d5-b44b-acd447013986 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0052e86d-16a7-4cbe-a802-ff770c0e20ba" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 15:23:05 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-da01acda-22cb-42d5-b44b-acd447013986 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0052e86d-16a7-4cbe-a802-ff770c0e20ba" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 15:23:05 user nova-compute[72382]: INFO os_brick.initiator.connectors.iscsi [None req-da01acda-22cb-42d5-b44b-acd447013986 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 15:23:05 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0052e86d-16a7-4cbe-a802-ff770c0e20ba -p 172.16.0.220:3260 {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:23:05 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0052e86d-16a7-4cbe-a802-ff770c0e20ba -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:23:05 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[335572db-e87a-42a6-a3a2-6e4ca011f135]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:23:05 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-da01acda-22cb-42d5-b44b-acd447013986 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 15:23:05 user nova-compute[72382]:  {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:23:05 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0052e86d-16a7-4cbe-a802-ff770c0e20ba -p 172.16.0.220:3260 --interface default --op new {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:23:05 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0052e86d-16a7-4cbe-a802-ff770c0e20ba -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:23:05 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a248e2c-da89-4dfd-ae20-6e30ab3879d5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0052e86d-16a7-4cbe-a802-ff770c0e20ba] added\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:23:05 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-da01acda-22cb-42d5-b44b-acd447013986 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0052e86d-16a7-4cbe-a802-ff770c0e20ba] added
Aug 09 15:23:05 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:23:05 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0052e86d-16a7-4cbe-a802-ff770c0e20ba -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:23:05 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0052e86d-16a7-4cbe-a802-ff770c0e20ba -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:23:05 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c230bd5-1b7a-441c-8aca-70db66f6269e]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:23:05 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-da01acda-22cb-42d5-b44b-acd447013986 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:23:05 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0052e86d-16a7-4cbe-a802-ff770c0e20ba -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:23:05 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0052e86d-16a7-4cbe-a802-ff770c0e20ba -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:23:05 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e0cf1d8-7dbb-4e61-8e17-1087b56ddfe1]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:23:05 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-da01acda-22cb-42d5-b44b-acd447013986 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:23:05 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0052e86d-16a7-4cbe-a802-ff770c0e20ba -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TMwGDLsY {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:23:05 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0052e86d-16a7-4cbe-a802-ff770c0e20ba -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TMwGDLsY" returned: 0 in 0.017s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:23:05 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac0af11e-943a-41d4-8d8b-7cb113fb0063]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:23:05 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-da01acda-22cb-42d5-b44b-acd447013986 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TMwGDLsY'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:23:05 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0052e86d-16a7-4cbe-a802-ff770c0e20ba -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:23:05 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0052e86d-16a7-4cbe-a802-ff770c0e20ba -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:23:05 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[3887a6c9-f2e3-4105-ac35-fc5cedf99548]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:23:05 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-da01acda-22cb-42d5-b44b-acd447013986 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:23:05 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:23:05 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:23:05 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[9164baf1-05c3-44ef-943d-9de2bbfd817d]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb47e85c-aaa9-4165-8be3-125572b68a87 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cd86701-a303-4744-bf0c-31b5314bb87d (non-flash)\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:23:05 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-da01acda-22cb-42d5-b44b-acd447013986 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)
Aug 09 15:23:05 user nova-compute[72382]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb47e85c-aaa9-4165-8be3-125572b68a87 (non-flash)
Aug 09 15:23:05 user nova-compute[72382]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cd86701-a303-4744-bf0c-31b5314bb87d (non-flash)
Aug 09 15:23:05 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 15:23:05 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-da01acda-22cb-42d5-b44b-acd447013986 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)
Aug 09 15:23:05 user nova-compute[72382]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb47e85c-aaa9-4165-8be3-125572b68a87 (non-flash)
Aug 09 15:23:05 user nova-compute[72382]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cd86701-a303-4744-bf0c-31b5314bb87d (non-flash)
Aug 09 15:23:05 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 15:23:05 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0052e86d-16a7-4cbe-a802-ff770c0e20ba -p 172.16.0.220:3260 --login {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:23:05 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0052e86d-16a7-4cbe-a802-ff770c0e20ba -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:23:05 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d9d7727-9eca-4645-9713-e9bfc914306b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0052e86d-16a7-4cbe-a802-ff770c0e20ba, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0052e86d-16a7-4cbe-a802-ff770c0e20ba, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:23:05 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-da01acda-22cb-42d5-b44b-acd447013986 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0052e86d-16a7-4cbe-a802-ff770c0e20ba, portal: 172.16.0.220,3260]
Aug 09 15:23:05 user nova-compute[72382]: Login to [iface: default, target: iqn.2010-10.org.openstack:0052e86d-16a7-4cbe-a802-ff770c0e20ba, portal: 172.16.0.220,3260] successful.
Aug 09 15:23:05 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:23:05 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0052e86d-16a7-4cbe-a802-ff770c0e20ba -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:23:05 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0052e86d-16a7-4cbe-a802-ff770c0e20ba -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:23:05 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc5304a5-f699-4d2b-b489-c4a8929e1f88]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:23:05 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-da01acda-22cb-42d5-b44b-acd447013986 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:23:05 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:23:05 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:23:05 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[54e43206-2694-4fca-8bc6-1e1080a12f50]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb47e85c-aaa9-4165-8be3-125572b68a87 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cd86701-a303-4744-bf0c-31b5314bb87d (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0052e86d-16a7-4cbe-a802-ff770c0e20ba (non-flash)\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:23:05 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-da01acda-22cb-42d5-b44b-acd447013986 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)
Aug 09 15:23:05 user nova-compute[72382]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb47e85c-aaa9-4165-8be3-125572b68a87 (non-flash)
Aug 09 15:23:05 user nova-compute[72382]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cd86701-a303-4744-bf0c-31b5314bb87d (non-flash)
Aug 09 15:23:05 user nova-compute[72382]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0052e86d-16a7-4cbe-a802-ff770c0e20ba (non-flash)
Aug 09 15:23:05 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 15:23:05 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-da01acda-22cb-42d5-b44b-acd447013986 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)
Aug 09 15:23:05 user nova-compute[72382]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb47e85c-aaa9-4165-8be3-125572b68a87 (non-flash)
Aug 09 15:23:05 user nova-compute[72382]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cd86701-a303-4744-bf0c-31b5314bb87d (non-flash)
Aug 09 15:23:05 user nova-compute[72382]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0052e86d-16a7-4cbe-a802-ff770c0e20ba (non-flash)
Aug 09 15:23:05 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 15:23:05 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-da01acda-22cb-42d5-b44b-acd447013986 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0052e86d-16a7-4cbe-a802-ff770c0e20ba" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.291s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 15:23:05 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-da01acda-22cb-42d5-b44b-acd447013986 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] Connected to 172.16.0.220:3260 {{(pid=72382) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 15:23:05 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-da01acda-22cb-42d5-b44b-acd447013986 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] HCTL ('36', '-', '-', 0) found on session 25 with lun 0 {{(pid=72382) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 15:23:05 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-da01acda-22cb-42d5-b44b-acd447013986 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72382) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 15:23:05 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:23:05 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:23:05 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba645ed9-f35f-4a2a-8f75-c919ebb436da]: (4, ('- - 0', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:23:05 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-da01acda-22cb-42d5-b44b-acd447013986 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] Searching for a device in session 25 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72382) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 15:23:05 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-da01acda-22cb-42d5-b44b-acd447013986 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TMwGDLsY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72382) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 15:23:06 user nova-compute[72382]: DEBUG nova.virt.driver [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Emitting event <LifecycleEvent: 1691594586.0852354, 0f4908de-d65d-4d17-ad36-6124a5e64a19 => Resumed> {{(pid=72382) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 15:23:06 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 0f4908de-d65d-4d17-ad36-6124a5e64a19] VM Resumed (Lifecycle Event)
Aug 09 15:23:06 user nova-compute[72382]: DEBUG nova.compute.manager [None req-b480224f-4b79-41db-821f-eaf92930c802 tempest-DeleteServersTestJSON-520676128 tempest-DeleteServersTestJSON-520676128-project-member] [instance: 0f4908de-d65d-4d17-ad36-6124a5e64a19] Instance event wait completed in 0 seconds for  {{(pid=72382) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 15:23:06 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-b480224f-4b79-41db-821f-eaf92930c802 tempest-DeleteServersTestJSON-520676128 tempest-DeleteServersTestJSON-520676128-project-member] [instance: 0f4908de-d65d-4d17-ad36-6124a5e64a19] Guest created on hypervisor {{(pid=72382) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 15:23:06 user nova-compute[72382]: INFO nova.virt.libvirt.driver [-] [instance: 0f4908de-d65d-4d17-ad36-6124a5e64a19] Instance spawned successfully.
Aug 09 15:23:06 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-b480224f-4b79-41db-821f-eaf92930c802 tempest-DeleteServersTestJSON-520676128 tempest-DeleteServersTestJSON-520676128-project-member] [instance: 0f4908de-d65d-4d17-ad36-6124a5e64a19] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 15:23:06 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 0f4908de-d65d-4d17-ad36-6124a5e64a19] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:23:06 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-b480224f-4b79-41db-821f-eaf92930c802 tempest-DeleteServersTestJSON-520676128 tempest-DeleteServersTestJSON-520676128-project-member] [instance: 0f4908de-d65d-4d17-ad36-6124a5e64a19] Found default for hw_cdrom_bus of ide {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:23:06 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-b480224f-4b79-41db-821f-eaf92930c802 tempest-DeleteServersTestJSON-520676128 tempest-DeleteServersTestJSON-520676128-project-member] [instance: 0f4908de-d65d-4d17-ad36-6124a5e64a19] Found default for hw_disk_bus of virtio {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:23:06 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-b480224f-4b79-41db-821f-eaf92930c802 tempest-DeleteServersTestJSON-520676128 tempest-DeleteServersTestJSON-520676128-project-member] [instance: 0f4908de-d65d-4d17-ad36-6124a5e64a19] Found default for hw_input_bus of None {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:23:06 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-b480224f-4b79-41db-821f-eaf92930c802 tempest-DeleteServersTestJSON-520676128 tempest-DeleteServersTestJSON-520676128-project-member] [instance: 0f4908de-d65d-4d17-ad36-6124a5e64a19] Found default for hw_pointer_model of None {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:23:06 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-b480224f-4b79-41db-821f-eaf92930c802 tempest-DeleteServersTestJSON-520676128 tempest-DeleteServersTestJSON-520676128-project-member] [instance: 0f4908de-d65d-4d17-ad36-6124a5e64a19] Found default for hw_video_model of virtio {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:23:06 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-b480224f-4b79-41db-821f-eaf92930c802 tempest-DeleteServersTestJSON-520676128 tempest-DeleteServersTestJSON-520676128-project-member] [instance: 0f4908de-d65d-4d17-ad36-6124a5e64a19] Found default for hw_vif_model of virtio {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:23:06 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 0f4908de-d65d-4d17-ad36-6124a5e64a19] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72382) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 15:23:06 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 0f4908de-d65d-4d17-ad36-6124a5e64a19] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 15:23:06 user nova-compute[72382]: DEBUG nova.virt.driver [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Emitting event <LifecycleEvent: 1691594586.086966, 0f4908de-d65d-4d17-ad36-6124a5e64a19 => Started> {{(pid=72382) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 15:23:06 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 0f4908de-d65d-4d17-ad36-6124a5e64a19] VM Started (Lifecycle Event)
Aug 09 15:23:06 user nova-compute[72382]: DEBUG nova.compute.manager [req-072232aa-2f91-4b54-8821-a859115aaad7 req-39b5b46d-edd2-4b27-8e37-5d4f14c28626 service nova] [instance: 0f4908de-d65d-4d17-ad36-6124a5e64a19] Received event network-vif-plugged-c6dc07b5-9e80-43a1-a3a1-bb0db357fc94 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:23:06 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-072232aa-2f91-4b54-8821-a859115aaad7 req-39b5b46d-edd2-4b27-8e37-5d4f14c28626 service nova] Acquiring lock "0f4908de-d65d-4d17-ad36-6124a5e64a19-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:23:06 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-072232aa-2f91-4b54-8821-a859115aaad7 req-39b5b46d-edd2-4b27-8e37-5d4f14c28626 service nova] Lock "0f4908de-d65d-4d17-ad36-6124a5e64a19-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:23:06 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-072232aa-2f91-4b54-8821-a859115aaad7 req-39b5b46d-edd2-4b27-8e37-5d4f14c28626 service nova] Lock "0f4908de-d65d-4d17-ad36-6124a5e64a19-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:23:06 user nova-compute[72382]: DEBUG nova.compute.manager [req-072232aa-2f91-4b54-8821-a859115aaad7 req-39b5b46d-edd2-4b27-8e37-5d4f14c28626 service nova] [instance: 0f4908de-d65d-4d17-ad36-6124a5e64a19] No waiting events found dispatching network-vif-plugged-c6dc07b5-9e80-43a1-a3a1-bb0db357fc94 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:23:06 user nova-compute[72382]: WARNING nova.compute.manager [req-072232aa-2f91-4b54-8821-a859115aaad7 req-39b5b46d-edd2-4b27-8e37-5d4f14c28626 service nova] [instance: 0f4908de-d65d-4d17-ad36-6124a5e64a19] Received unexpected event network-vif-plugged-c6dc07b5-9e80-43a1-a3a1-bb0db357fc94 for instance with vm_state building and task_state spawning.
Aug 09 15:23:06 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 0f4908de-d65d-4d17-ad36-6124a5e64a19] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:23:06 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 0f4908de-d65d-4d17-ad36-6124a5e64a19] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72382) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 15:23:06 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 0f4908de-d65d-4d17-ad36-6124a5e64a19] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 15:23:06 user nova-compute[72382]: INFO nova.compute.manager [None req-b480224f-4b79-41db-821f-eaf92930c802 tempest-DeleteServersTestJSON-520676128 tempest-DeleteServersTestJSON-520676128-project-member] [instance: 0f4908de-d65d-4d17-ad36-6124a5e64a19] Took 5.99 seconds to spawn the instance on the hypervisor.
Aug 09 15:23:06 user nova-compute[72382]: DEBUG nova.compute.manager [None req-b480224f-4b79-41db-821f-eaf92930c802 tempest-DeleteServersTestJSON-520676128 tempest-DeleteServersTestJSON-520676128-project-member] [instance: 0f4908de-d65d-4d17-ad36-6124a5e64a19] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:23:06 user nova-compute[72382]: INFO nova.compute.manager [None req-b480224f-4b79-41db-821f-eaf92930c802 tempest-DeleteServersTestJSON-520676128 tempest-DeleteServersTestJSON-520676128-project-member] [instance: 0f4908de-d65d-4d17-ad36-6124a5e64a19] Took 6.83 seconds to build instance.
Aug 09 15:23:06 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-b480224f-4b79-41db-821f-eaf92930c802 tempest-DeleteServersTestJSON-520676128 tempest-DeleteServersTestJSON-520676128-project-member] Lock "0f4908de-d65d-4d17-ad36-6124a5e64a19" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.915s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:23:06 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-da01acda-22cb-42d5-b44b-acd447013986 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.332s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 15:23:06 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-da01acda-22cb-42d5-b44b-acd447013986 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] <== connect_volume: return (1334ms) {'type': 'block', 'scsi_wwn': '23830336261323338', 'path': '/dev/sde'} {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 15:23:06 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-da01acda-22cb-42d5-b44b-acd447013986 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] [instance: 8aa35482-60b8-4185-b14d-a2667fd3b5b7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23830336261323338', 'path': '/dev/sde'} {{(pid=72382) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 15:23:06 user nova-compute[72382]: DEBUG nova.objects.instance [None req-da01acda-22cb-42d5-b44b-acd447013986 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] Lazy-loading 'flavor' on Instance uuid 8aa35482-60b8-4185-b14d-a2667fd3b5b7 {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:23:06 user nova-compute[72382]: DEBUG nova.virt.libvirt.guest [None req-da01acda-22cb-42d5-b44b-acd447013986 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 15:23:06 user nova-compute[72382]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 15:23:06 user nova-compute[72382]:   <source dev="/dev/sde"/>
Aug 09 15:23:06 user nova-compute[72382]:   <target dev="vdb" bus="virtio"/>
Aug 09 15:23:06 user nova-compute[72382]:   <serial>0052e86d-16a7-4cbe-a802-ff770c0e20ba</serial>
Aug 09 15:23:06 user nova-compute[72382]: </disk>
Aug 09 15:23:06 user nova-compute[72382]:  {{(pid=72382) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 15:23:06 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:23:06 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:23:06 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:23:06 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:23:06 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:23:06 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:23:06 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Auditing locally available compute resources for user (node: user) {{(pid=72382) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 15:23:07 user nova-compute[72382]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691594572.2275596, d061ee79-0755-44a7-9929-086c274c9064 => Stopped> {{(pid=72382) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 15:23:07 user nova-compute[72382]: INFO nova.compute.manager [-] [instance: d061ee79-0755-44a7-9929-086c274c9064] VM Stopped (Lifecycle Event)
Aug 09 15:23:07 user nova-compute[72382]: DEBUG nova.compute.manager [None req-e2bb9675-73be-44fb-87b2-ad6149d79fea None None] [instance: d061ee79-0755-44a7-9929-086c274c9064] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:23:07 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-da01acda-22cb-42d5-b44b-acd447013986 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] No BDM found with device name vda, not building metadata. {{(pid=72382) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 15:23:07 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-da01acda-22cb-42d5-b44b-acd447013986 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72382) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 15:23:07 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-da01acda-22cb-42d5-b44b-acd447013986 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] No VIF found with MAC fa:16:3e:d9:46:4b, not building metadata {{(pid=72382) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 15:23:07 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f780040f-b789-4b72-8986-813c7b9fe4a6/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:23:07 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-da01acda-22cb-42d5-b44b-acd447013986 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] Lock "8aa35482-60b8-4185-b14d-a2667fd3b5b7" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 20.771s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:23:07 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:23:07 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f780040f-b789-4b72-8986-813c7b9fe4a6/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:23:07 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f780040f-b789-4b72-8986-813c7b9fe4a6/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:23:07 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f780040f-b789-4b72-8986-813c7b9fe4a6/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:23:07 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/266be814-4a2b-4f8e-a0f6-e8821fdeb95d/disk.rescue --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:23:07 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/266be814-4a2b-4f8e-a0f6-e8821fdeb95d/disk.rescue --force-share --output=json" returned: 0 in 0.157s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:23:07 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/266be814-4a2b-4f8e-a0f6-e8821fdeb95d/disk.rescue --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:23:07 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/266be814-4a2b-4f8e-a0f6-e8821fdeb95d/disk.rescue --force-share --output=json" returned: 0 in 0.134s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:23:08 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/266be814-4a2b-4f8e-a0f6-e8821fdeb95d/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:23:08 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/266be814-4a2b-4f8e-a0f6-e8821fdeb95d/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:23:08 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/266be814-4a2b-4f8e-a0f6-e8821fdeb95d/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:23:08 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/266be814-4a2b-4f8e-a0f6-e8821fdeb95d/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:23:08 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f4908de-d65d-4d17-ad36-6124a5e64a19/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:23:08 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f4908de-d65d-4d17-ad36-6124a5e64a19/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:23:08 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f4908de-d65d-4d17-ad36-6124a5e64a19/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:23:08 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f4908de-d65d-4d17-ad36-6124a5e64a19/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:23:08 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/777e49ea-b674-4c3f-9cdd-ac2113032632/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:23:08 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/777e49ea-b674-4c3f-9cdd-ac2113032632/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:23:08 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/777e49ea-b674-4c3f-9cdd-ac2113032632/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:23:08 user nova-compute[72382]: INFO nova.compute.manager [None req-3667ff9b-bbe3-4906-b8cd-57ac936d4917 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] [instance: 8aa35482-60b8-4185-b14d-a2667fd3b5b7] Rescuing
Aug 09 15:23:08 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-3667ff9b-bbe3-4906-b8cd-57ac936d4917 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] Acquiring lock "refresh_cache-8aa35482-60b8-4185-b14d-a2667fd3b5b7" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 15:23:08 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-3667ff9b-bbe3-4906-b8cd-57ac936d4917 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] Acquired lock "refresh_cache-8aa35482-60b8-4185-b14d-a2667fd3b5b7" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 15:23:08 user nova-compute[72382]: DEBUG nova.network.neutron [None req-3667ff9b-bbe3-4906-b8cd-57ac936d4917 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] [instance: 8aa35482-60b8-4185-b14d-a2667fd3b5b7] Building network info cache for instance {{(pid=72382) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 15:23:09 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/777e49ea-b674-4c3f-9cdd-ac2113032632/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:23:09 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44afd1bf-fa5c-4b3e-8752-b16853fef54e/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:23:09 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:23:09 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44afd1bf-fa5c-4b3e-8752-b16853fef54e/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:23:09 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44afd1bf-fa5c-4b3e-8752-b16853fef54e/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:23:09 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44afd1bf-fa5c-4b3e-8752-b16853fef54e/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:23:09 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72382) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 15:23:09 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6296ba5d-bcc6-405a-a635-0e9aa6114f7b/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:23:09 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6296ba5d-bcc6-405a-a635-0e9aa6114f7b/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:23:09 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6296ba5d-bcc6-405a-a635-0e9aa6114f7b/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:23:09 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6296ba5d-bcc6-405a-a635-0e9aa6114f7b/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:23:09 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72382) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 15:23:09 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8aa35482-60b8-4185-b14d-a2667fd3b5b7/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:23:09 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8aa35482-60b8-4185-b14d-a2667fd3b5b7/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:23:09 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8aa35482-60b8-4185-b14d-a2667fd3b5b7/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:23:10 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8aa35482-60b8-4185-b14d-a2667fd3b5b7/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:23:10 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=72382) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 15:23:10 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9766433-4c5a-40ed-a212-715a24f42b91/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:23:10 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9766433-4c5a-40ed-a212-715a24f42b91/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:23:10 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9766433-4c5a-40ed-a212-715a24f42b91/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:23:10 user nova-compute[72382]: DEBUG nova.network.neutron [None req-3667ff9b-bbe3-4906-b8cd-57ac936d4917 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] [instance: 8aa35482-60b8-4185-b14d-a2667fd3b5b7] Updating instance_info_cache with network_info: [{"id": "b4902494-07bb-48a3-b0f8-26115f2b04d6", "address": "fa:16:3e:d9:46:4b", "network": {"id": "effdc019-a66a-4e9b-a99c-4a7c5b715201", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-414399276-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.250", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bab7a1ba67749ba85f0785846ce0338", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4902494-07", "ovs_interfaceid": "b4902494-07bb-48a3-b0f8-26115f2b04d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:23:10 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-3667ff9b-bbe3-4906-b8cd-57ac936d4917 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] Releasing lock "refresh_cache-8aa35482-60b8-4185-b14d-a2667fd3b5b7" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 15:23:10 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9766433-4c5a-40ed-a212-715a24f42b91/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:23:10 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72382) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 15:23:10 user nova-compute[72382]: WARNING nova.virt.libvirt.driver [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 15:23:10 user nova-compute[72382]: WARNING nova.virt.libvirt.driver [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 15:23:10 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Hypervisor/Node resource view: name=user free_ram=7453MB free_disk=25.55205535888672GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72382) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 15:23:10 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:23:10 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:23:10 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:23:11 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:23:11 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance f780040f-b789-4b72-8986-813c7b9fe4a6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:23:11 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance 777e49ea-b674-4c3f-9cdd-ac2113032632 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:23:11 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance 44afd1bf-fa5c-4b3e-8752-b16853fef54e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:23:11 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance 266be814-4a2b-4f8e-a0f6-e8821fdeb95d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:23:11 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance 0f510d75-5d1e-4a5c-b38f-731c299f0f5a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:23:11 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance 8aa35482-60b8-4185-b14d-a2667fd3b5b7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:23:11 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance c9766433-4c5a-40ed-a212-715a24f42b91 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:23:11 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance 83ebfda8-235d-4404-a973-991d75ae2bf6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:23:11 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance 6296ba5d-bcc6-405a-a635-0e9aa6114f7b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:23:11 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance 0f4908de-d65d-4d17-ad36-6124a5e64a19 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:23:11 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=72382) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 15:23:11 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=72382) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 15:23:11 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:23:11 user nova-compute[72382]: DEBUG nova.compute.manager [req-2bb05954-dd77-4076-abdc-6784201f2aad req-937d43e8-cafc-4444-9a12-589a8f3a716b service nova] [instance: 8aa35482-60b8-4185-b14d-a2667fd3b5b7] Received event network-vif-unplugged-b4902494-07bb-48a3-b0f8-26115f2b04d6 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:23:11 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-2bb05954-dd77-4076-abdc-6784201f2aad req-937d43e8-cafc-4444-9a12-589a8f3a716b service nova] Acquiring lock "8aa35482-60b8-4185-b14d-a2667fd3b5b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:23:11 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-2bb05954-dd77-4076-abdc-6784201f2aad req-937d43e8-cafc-4444-9a12-589a8f3a716b service nova] Lock "8aa35482-60b8-4185-b14d-a2667fd3b5b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:23:11 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-2bb05954-dd77-4076-abdc-6784201f2aad req-937d43e8-cafc-4444-9a12-589a8f3a716b service nova] Lock "8aa35482-60b8-4185-b14d-a2667fd3b5b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:23:11 user nova-compute[72382]: DEBUG nova.compute.manager [req-2bb05954-dd77-4076-abdc-6784201f2aad req-937d43e8-cafc-4444-9a12-589a8f3a716b service nova] [instance: 8aa35482-60b8-4185-b14d-a2667fd3b5b7] No waiting events found dispatching network-vif-unplugged-b4902494-07bb-48a3-b0f8-26115f2b04d6 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:23:11 user nova-compute[72382]: WARNING nova.compute.manager [req-2bb05954-dd77-4076-abdc-6784201f2aad req-937d43e8-cafc-4444-9a12-589a8f3a716b service nova] [instance: 8aa35482-60b8-4185-b14d-a2667fd3b5b7] Received unexpected event network-vif-unplugged-b4902494-07bb-48a3-b0f8-26115f2b04d6 for instance with vm_state active and task_state rescuing.
Aug 09 15:23:11 user nova-compute[72382]: DEBUG nova.compute.provider_tree [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Inventory has not changed in ProviderTree for provider: 7b15b0e5-df4d-49db-833b-2855d21d10ae {{(pid=72382) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 15:23:11 user nova-compute[72382]: DEBUG nova.scheduler.client.report [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Inventory has not changed for provider 7b15b0e5-df4d-49db-833b-2855d21d10ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72382) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 15:23:11 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Compute_service record updated for user:user {{(pid=72382) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 15:23:11 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.585s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:23:11 user nova-compute[72382]: INFO nova.virt.libvirt.driver [-] [instance: 8aa35482-60b8-4185-b14d-a2667fd3b5b7] Instance destroyed successfully.
Aug 09 15:23:11 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-3667ff9b-bbe3-4906-b8cd-57ac936d4917 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] [instance: 8aa35482-60b8-4185-b14d-a2667fd3b5b7] Attempting a stable device rescue
Aug 09 15:23:11 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-3667ff9b-bbe3-4906-b8cd-57ac936d4917 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=72382) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 09 15:23:11 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-3667ff9b-bbe3-4906-b8cd-57ac936d4917 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] [instance: 8aa35482-60b8-4185-b14d-a2667fd3b5b7] Instance directory exists: not creating {{(pid=72382) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 09 15:23:11 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-3667ff9b-bbe3-4906-b8cd-57ac936d4917 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] [instance: 8aa35482-60b8-4185-b14d-a2667fd3b5b7] Creating image(s)
Aug 09 15:23:11 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-3667ff9b-bbe3-4906-b8cd-57ac936d4917 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] Acquiring lock "/opt/stack/data/nova/instances/8aa35482-60b8-4185-b14d-a2667fd3b5b7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:23:11 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-3667ff9b-bbe3-4906-b8cd-57ac936d4917 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] Lock "/opt/stack/data/nova/instances/8aa35482-60b8-4185-b14d-a2667fd3b5b7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:23:11 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-3667ff9b-bbe3-4906-b8cd-57ac936d4917 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] Lock "/opt/stack/data/nova/instances/8aa35482-60b8-4185-b14d-a2667fd3b5b7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:23:11 user nova-compute[72382]: DEBUG nova.objects.instance [None req-3667ff9b-bbe3-4906-b8cd-57ac936d4917 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] Lazy-loading 'trusted_certs' on Instance uuid 8aa35482-60b8-4185-b14d-a2667fd3b5b7 {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:23:11 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-3667ff9b-bbe3-4906-b8cd-57ac936d4917 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] Acquiring lock "6d4a387337d71e926fbfd3dd254a25e005bc7820" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:23:11 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-3667ff9b-bbe3-4906-b8cd-57ac936d4917 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] Lock "6d4a387337d71e926fbfd3dd254a25e005bc7820" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:23:12 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-3667ff9b-bbe3-4906-b8cd-57ac936d4917 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d4a387337d71e926fbfd3dd254a25e005bc7820.part --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:23:13 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:23:13 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:23:13 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:23:13 user nova-compute[72382]: DEBUG nova.compute.manager [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Starting heal instance info cache {{(pid=72382) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 15:23:13 user nova-compute[72382]: DEBUG nova.compute.manager [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Rebuilding the list of instances to heal {{(pid=72382) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 09 15:23:13 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Acquiring lock "refresh_cache-f780040f-b789-4b72-8986-813c7b9fe4a6" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 15:23:13 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Acquired lock "refresh_cache-f780040f-b789-4b72-8986-813c7b9fe4a6" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 15:23:13 user nova-compute[72382]: DEBUG nova.network.neutron [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] [instance: f780040f-b789-4b72-8986-813c7b9fe4a6] Forcefully refreshing network info cache for instance {{(pid=72382) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 15:23:13 user nova-compute[72382]: DEBUG nova.objects.instance [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lazy-loading 'info_cache' on Instance uuid f780040f-b789-4b72-8986-813c7b9fe4a6 {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:23:13 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-3667ff9b-bbe3-4906-b8cd-57ac936d4917 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d4a387337d71e926fbfd3dd254a25e005bc7820.part --force-share --output=json" returned: 0 in 0.146s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:23:13 user nova-compute[72382]: DEBUG nova.virt.images [None req-3667ff9b-bbe3-4906-b8cd-57ac936d4917 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] b22991de-4421-4362-b564-9c7755d26fa0 was qcow2, converting to raw {{(pid=72382) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 09 15:23:13 user nova-compute[72382]: DEBUG nova.privsep.utils [None req-3667ff9b-bbe3-4906-b8cd-57ac936d4917 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72382) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 09 15:23:13 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-3667ff9b-bbe3-4906-b8cd-57ac936d4917 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/6d4a387337d71e926fbfd3dd254a25e005bc7820.part /opt/stack/data/nova/instances/_base/6d4a387337d71e926fbfd3dd254a25e005bc7820.converted {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:23:13 user nova-compute[72382]: DEBUG nova.compute.manager [req-9293515e-1a48-4b16-92bf-e27352c52885 req-2d895ae4-f97b-459c-9712-df88c428fb12 service nova] [instance: 8aa35482-60b8-4185-b14d-a2667fd3b5b7] Received event network-vif-plugged-b4902494-07bb-48a3-b0f8-26115f2b04d6 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:23:13 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-9293515e-1a48-4b16-92bf-e27352c52885 req-2d895ae4-f97b-459c-9712-df88c428fb12 service nova] Acquiring lock "8aa35482-60b8-4185-b14d-a2667fd3b5b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:23:13 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-9293515e-1a48-4b16-92bf-e27352c52885 req-2d895ae4-f97b-459c-9712-df88c428fb12 service nova] Lock "8aa35482-60b8-4185-b14d-a2667fd3b5b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:23:13 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-9293515e-1a48-4b16-92bf-e27352c52885 req-2d895ae4-f97b-459c-9712-df88c428fb12 service nova] Lock "8aa35482-60b8-4185-b14d-a2667fd3b5b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:23:13 user nova-compute[72382]: DEBUG nova.compute.manager [req-9293515e-1a48-4b16-92bf-e27352c52885 req-2d895ae4-f97b-459c-9712-df88c428fb12 service nova] [instance: 8aa35482-60b8-4185-b14d-a2667fd3b5b7] No waiting events found dispatching network-vif-plugged-b4902494-07bb-48a3-b0f8-26115f2b04d6 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:23:13 user nova-compute[72382]: WARNING nova.compute.manager [req-9293515e-1a48-4b16-92bf-e27352c52885 req-2d895ae4-f97b-459c-9712-df88c428fb12 service nova] [instance: 8aa35482-60b8-4185-b14d-a2667fd3b5b7] Received unexpected event network-vif-plugged-b4902494-07bb-48a3-b0f8-26115f2b04d6 for instance with vm_state active and task_state rescuing.
Aug 09 15:23:13 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-3667ff9b-bbe3-4906-b8cd-57ac936d4917 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/6d4a387337d71e926fbfd3dd254a25e005bc7820.part /opt/stack/data/nova/instances/_base/6d4a387337d71e926fbfd3dd254a25e005bc7820.converted" returned: 0 in 0.393s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:23:13 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-3667ff9b-bbe3-4906-b8cd-57ac936d4917 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d4a387337d71e926fbfd3dd254a25e005bc7820.converted --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:23:13 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-3667ff9b-bbe3-4906-b8cd-57ac936d4917 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d4a387337d71e926fbfd3dd254a25e005bc7820.converted --force-share --output=json" returned: 0 in 0.134s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:23:13 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-3667ff9b-bbe3-4906-b8cd-57ac936d4917 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] Lock "6d4a387337d71e926fbfd3dd254a25e005bc7820" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.806s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:23:13 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-3667ff9b-bbe3-4906-b8cd-57ac936d4917 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] Acquiring lock "6d4a387337d71e926fbfd3dd254a25e005bc7820" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:23:13 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-3667ff9b-bbe3-4906-b8cd-57ac936d4917 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] Lock "6d4a387337d71e926fbfd3dd254a25e005bc7820" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:23:13 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-3667ff9b-bbe3-4906-b8cd-57ac936d4917 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d4a387337d71e926fbfd3dd254a25e005bc7820 --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:23:13 user nova-compute[72382]: DEBUG nova.network.neutron [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] [instance: f780040f-b789-4b72-8986-813c7b9fe4a6] Updating instance_info_cache with network_info: [{"id": "3c9b6983-5682-4eaa-866c-1baf9f2ede26", "address": "fa:16:3e:20:d4:ea", "network": {"id": "d47e3749-fdff-4112-bd72-69ca584efe1f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-302967634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "080d1ded4cd94e5083ee0b7e691b7363", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c9b6983-56", "ovs_interfaceid": "3c9b6983-5682-4eaa-866c-1baf9f2ede26", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:23:13 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-3667ff9b-bbe3-4906-b8cd-57ac936d4917 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d4a387337d71e926fbfd3dd254a25e005bc7820 --force-share --output=json" returned: 0 in 0.143s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:23:13 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-3667ff9b-bbe3-4906-b8cd-57ac936d4917 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d4a387337d71e926fbfd3dd254a25e005bc7820,backing_fmt=raw /opt/stack/data/nova/instances/8aa35482-60b8-4185-b14d-a2667fd3b5b7/disk.rescue {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:23:13 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Releasing lock "refresh_cache-f780040f-b789-4b72-8986-813c7b9fe4a6" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 15:23:13 user nova-compute[72382]: DEBUG nova.compute.manager [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] [instance: f780040f-b789-4b72-8986-813c7b9fe4a6] Updated the network info_cache for instance {{(pid=72382) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 15:23:13 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:23:13 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:23:13 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:23:13 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:23:13 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:23:13 user nova-compute[72382]: DEBUG nova.compute.manager [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72382) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 15:23:13 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-3667ff9b-bbe3-4906-b8cd-57ac936d4917 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d4a387337d71e926fbfd3dd254a25e005bc7820,backing_fmt=raw /opt/stack/data/nova/instances/8aa35482-60b8-4185-b14d-a2667fd3b5b7/disk.rescue" returned: 0 in 0.052s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:23:13 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-3667ff9b-bbe3-4906-b8cd-57ac936d4917 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] Lock "6d4a387337d71e926fbfd3dd254a25e005bc7820" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.199s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:23:13 user nova-compute[72382]: DEBUG nova.objects.instance [None req-3667ff9b-bbe3-4906-b8cd-57ac936d4917 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] Lazy-loading 'migration_context' on Instance uuid 8aa35482-60b8-4185-b14d-a2667fd3b5b7 {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:23:13 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-3667ff9b-bbe3-4906-b8cd-57ac936d4917 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] [instance: 8aa35482-60b8-4185-b14d-a2667fd3b5b7] Created local disks {{(pid=72382) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 15:23:13 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-3667ff9b-bbe3-4906-b8cd-57ac936d4917 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] [instance: 8aa35482-60b8-4185-b14d-a2667fd3b5b7] Start _get_guest_xml network_info=[{"id": "b4902494-07bb-48a3-b0f8-26115f2b04d6", "address": "fa:16:3e:d9:46:4b", "network": {"id": "effdc019-a66a-4e9b-a99c-4a7c5b715201", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-414399276-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.250", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-414399276-network", "vif_mac": "fa:16:3e:d9:46:4b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bab7a1ba67749ba85f0785846ce0338", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4902494-07", "ovs_interfaceid": "b4902494-07bb-48a3-b0f8-26115f2b04d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T15:11:25Z,direct_url=<?>,disk_format='qcow2',id=a79f2cea-eb27-4631-aaf3-05e7d9e411b4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a638990e12cc4d6eabb6d55e13be6bdf',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T15:11:27Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'b22991de-4421-4362-b564-9c7755d26fa0', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'a79f2cea-eb27-4631-aaf3-05e7d9e411b4'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'boot_index': None, 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:0052e86d-16a7-4cbe-a802-ff770c0e20ba'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TMwGDLsY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': '8aa35482-60b8-4185-b14d-a2667fd3b5b7', 'attached_at': '', 'detached_at': '', 'volume_id': '0052e86d-16a7-4cbe-a802-ff770c0e20ba', 'serial': '0052e86d-16a7-4cbe-a802-ff770c0e20ba'}, 'disk_bus': 'virtio', 'attachment_id': 'e5ea88fd-d833-4b91-bebc-44222f704900', 'delete_on_termination': False, 'volume_type': None} {{(pid=72382) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 15:23:13 user nova-compute[72382]: DEBUG nova.objects.instance [None req-3667ff9b-bbe3-4906-b8cd-57ac936d4917 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] Lazy-loading 'resources' on Instance uuid 8aa35482-60b8-4185-b14d-a2667fd3b5b7 {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:23:13 user nova-compute[72382]: DEBUG nova.objects.instance [None req-3667ff9b-bbe3-4906-b8cd-57ac936d4917 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] Lazy-loading 'numa_topology' on Instance uuid 8aa35482-60b8-4185-b14d-a2667fd3b5b7 {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:23:13 user nova-compute[72382]: WARNING nova.virt.libvirt.driver [None req-3667ff9b-bbe3-4906-b8cd-57ac936d4917 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 15:23:13 user nova-compute[72382]: WARNING nova.virt.libvirt.driver [None req-3667ff9b-bbe3-4906-b8cd-57ac936d4917 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 15:23:13 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-3667ff9b-bbe3-4906-b8cd-57ac936d4917 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72382) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 15:23:13 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-3667ff9b-bbe3-4906-b8cd-57ac936d4917 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] CPU controller missing on host. {{(pid=72382) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 15:23:13 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-3667ff9b-bbe3-4906-b8cd-57ac936d4917 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72382) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 15:23:13 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-3667ff9b-bbe3-4906-b8cd-57ac936d4917 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] CPU controller found on host. {{(pid=72382) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 15:23:13 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-3667ff9b-bbe3-4906-b8cd-57ac936d4917 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72382) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 15:23:13 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-3667ff9b-bbe3-4906-b8cd-57ac936d4917 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T15:11:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T15:11:25Z,direct_url=<?>,disk_format='qcow2',id=a79f2cea-eb27-4631-aaf3-05e7d9e411b4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a638990e12cc4d6eabb6d55e13be6bdf',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T15:11:27Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 15:23:13 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-3667ff9b-bbe3-4906-b8cd-57ac936d4917 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] Flavor limits 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 15:23:13 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-3667ff9b-bbe3-4906-b8cd-57ac936d4917 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] Image limits 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 15:23:13 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-3667ff9b-bbe3-4906-b8cd-57ac936d4917 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] Flavor pref 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 15:23:13 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-3667ff9b-bbe3-4906-b8cd-57ac936d4917 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] Image pref 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 15:23:13 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-3667ff9b-bbe3-4906-b8cd-57ac936d4917 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 15:23:13 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-3667ff9b-bbe3-4906-b8cd-57ac936d4917 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 15:23:13 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-3667ff9b-bbe3-4906-b8cd-57ac936d4917 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72382) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 15:23:13 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-3667ff9b-bbe3-4906-b8cd-57ac936d4917 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] Got 1 possible topologies {{(pid=72382) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 15:23:13 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-3667ff9b-bbe3-4906-b8cd-57ac936d4917 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 15:23:13 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-3667ff9b-bbe3-4906-b8cd-57ac936d4917 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 15:23:13 user nova-compute[72382]: DEBUG nova.objects.instance [None req-3667ff9b-bbe3-4906-b8cd-57ac936d4917 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] Lazy-loading 'vcpu_model' on Instance uuid 8aa35482-60b8-4185-b14d-a2667fd3b5b7 {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:23:13 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3667ff9b-bbe3-4906-b8cd-57ac936d4917 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] [instance: 8aa35482-60b8-4185-b14d-a2667fd3b5b7] Calling os-brick to attach iSCSI Volume {{(pid=72382) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 15:23:13 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-3667ff9b-bbe3-4906-b8cd-57ac936d4917 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2a0c768340>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:0052e86d-16a7-4cbe-a802-ff770c0e20ba'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TMwGDLsY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 15:23:13 user nova-compute[72382]: WARNING os_brick.initiator.connectors.base [None req-3667ff9b-bbe3-4906-b8cd-57ac936d4917 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 15:23:13 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-3667ff9b-bbe3-4906-b8cd-57ac936d4917 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 15:23:13 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-3667ff9b-bbe3-4906-b8cd-57ac936d4917 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 15:23:13 user nova-compute[72382]: WARNING os_brick.initiator.connectors.base [None req-3667ff9b-bbe3-4906-b8cd-57ac936d4917 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 15:23:13 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-3667ff9b-bbe3-4906-b8cd-57ac936d4917 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0052e86d-16a7-4cbe-a802-ff770c0e20ba" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 15:23:13 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-3667ff9b-bbe3-4906-b8cd-57ac936d4917 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0052e86d-16a7-4cbe-a802-ff770c0e20ba" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 15:23:13 user nova-compute[72382]: INFO os_brick.initiator.connectors.iscsi [None req-3667ff9b-bbe3-4906-b8cd-57ac936d4917 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 15:23:13 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0052e86d-16a7-4cbe-a802-ff770c0e20ba -p 172.16.0.220:3260 {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:23:14 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0052e86d-16a7-4cbe-a802-ff770c0e20ba -p 172.16.0.220:3260" returned: 0 in 0.018s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:23:14 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0471ca1-9273-4490-81ce-d3ce53017910]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:0052e86d-16a7-4cbe-a802-ff770c0e20ba\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = TMwGDLsY\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:23:14 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-3667ff9b-bbe3-4906-b8cd-57ac936d4917 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Aug 09 15:23:14 user nova-compute[72382]: node.name = iqn.2010-10.org.openstack:0052e86d-16a7-4cbe-a802-ff770c0e20ba
Aug 09 15:23:14 user nova-compute[72382]: node.tpgt = -1
Aug 09 15:23:14 user nova-compute[72382]: node.startup = automatic
Aug 09 15:23:14 user nova-compute[72382]: node.leading_login = No
Aug 09 15:23:14 user nova-compute[72382]: iface.iscsi_ifacename = default
Aug 09 15:23:14 user nova-compute[72382]: iface.net_ifacename = <empty>
Aug 09 15:23:14 user nova-compute[72382]: iface.ipaddress = <empty>
Aug 09 15:23:14 user nova-compute[72382]: iface.prefix_len = 0
Aug 09 15:23:14 user nova-compute[72382]: iface.hwaddress = <empty>
Aug 09 15:23:14 user nova-compute[72382]: iface.transport_name = tcp
Aug 09 15:23:14 user nova-compute[72382]: iface.initiatorname = <empty>
Aug 09 15:23:14 user nova-compute[72382]: iface.state = <empty>
Aug 09 15:23:14 user nova-compute[72382]: iface.vlan_id = 0
Aug 09 15:23:14 user nova-compute[72382]: iface.vlan_priority = 0
Aug 09 15:23:14 user nova-compute[72382]: iface.vlan_state = <empty>
Aug 09 15:23:14 user nova-compute[72382]: iface.iface_num = 0
Aug 09 15:23:14 user nova-compute[72382]: iface.mtu = 0
Aug 09 15:23:14 user nova-compute[72382]: iface.port = 0
Aug 09 15:23:14 user nova-compute[72382]: iface.bootproto = <empty>
Aug 09 15:23:14 user nova-compute[72382]: iface.subnet_mask = <empty>
Aug 09 15:23:14 user nova-compute[72382]: iface.gateway = <empty>
Aug 09 15:23:14 user nova-compute[72382]: iface.dhcp_alt_client_id_state = <empty>
Aug 09 15:23:14 user nova-compute[72382]: iface.dhcp_alt_client_id = <empty>
Aug 09 15:23:14 user nova-compute[72382]: iface.dhcp_dns = <empty>
Aug 09 15:23:14 user nova-compute[72382]: iface.dhcp_learn_iqn = <empty>
Aug 09 15:23:14 user nova-compute[72382]: iface.dhcp_req_vendor_id_state = <empty>
Aug 09 15:23:14 user nova-compute[72382]: iface.dhcp_vendor_id_state = <empty>
Aug 09 15:23:14 user nova-compute[72382]: iface.dhcp_vendor_id = <empty>
Aug 09 15:23:14 user nova-compute[72382]: iface.dhcp_slp_da = <empty>
Aug 09 15:23:14 user nova-compute[72382]: iface.fragmentation = <empty>
Aug 09 15:23:14 user nova-compute[72382]: iface.gratuitous_arp = <empty>
Aug 09 15:23:14 user nova-compute[72382]: iface.incoming_forwarding = <empty>
Aug 09 15:23:14 user nova-compute[72382]: iface.tos_state = <empty>
Aug 09 15:23:14 user nova-compute[72382]: iface.tos = 0
Aug 09 15:23:14 user nova-compute[72382]: iface.ttl = 0
Aug 09 15:23:14 user nova-compute[72382]: iface.delayed_ack = <empty>
Aug 09 15:23:14 user nova-compute[72382]: iface.tcp_nagle = <empty>
Aug 09 15:23:14 user nova-compute[72382]: iface.tcp_wsf_state = <empty>
Aug 09 15:23:14 user nova-compute[72382]: iface.tcp_wsf = 0
Aug 09 15:23:14 user nova-compute[72382]: iface.tcp_timer_scale = 0
Aug 09 15:23:14 user nova-compute[72382]: iface.tcp_timestamp = <empty>
Aug 09 15:23:14 user nova-compute[72382]: iface.redirect = <empty>
Aug 09 15:23:14 user nova-compute[72382]: iface.def_task_mgmt_timeout = 0
Aug 09 15:23:14 user nova-compute[72382]: iface.header_digest = <empty>
Aug 09 15:23:14 user nova-compute[72382]: iface.data_digest = <empty>
Aug 09 15:23:14 user nova-compute[72382]: iface.immediate_data = <empty>
Aug 09 15:23:14 user nova-compute[72382]: iface.initial_r2t = <empty>
Aug 09 15:23:14 user nova-compute[72382]: iface.data_seq_inorder = <empty>
Aug 09 15:23:14 user nova-compute[72382]: iface.data_pdu_inorder = <empty>
Aug 09 15:23:14 user nova-compute[72382]: iface.erl = 0
Aug 09 15:23:14 user nova-compute[72382]: iface.max_receive_data_len = 0
Aug 09 15:23:14 user nova-compute[72382]: iface.first_burst_len = 0
Aug 09 15:23:14 user nova-compute[72382]: iface.max_outstanding_r2t = 0
Aug 09 15:23:14 user nova-compute[72382]: iface.max_burst_len = 0
Aug 09 15:23:14 user nova-compute[72382]: iface.chap_auth = <empty>
Aug 09 15:23:14 user nova-compute[72382]: iface.bidi_chap = <empty>
Aug 09 15:23:14 user nova-compute[72382]: iface.strict_login_compliance = <empty>
Aug 09 15:23:14 user nova-compute[72382]: iface.discovery_auth = <empty>
Aug 09 15:23:14 user nova-compute[72382]: iface.discovery_logout = <empty>
Aug 09 15:23:14 user nova-compute[72382]: node.discovery_address = <empty>
Aug 09 15:23:14 user nova-compute[72382]: node.discovery_port = 0
Aug 09 15:23:14 user nova-compute[72382]: node.discovery_type = static
Aug 09 15:23:14 user nova-compute[72382]: node.session.initial_cmdsn = 0
Aug 09 15:23:14 user nova-compute[72382]: node.session.initial_login_retry_max = 8
Aug 09 15:23:14 user nova-compute[72382]: node.session.xmit_thread_priority = -20
Aug 09 15:23:14 user nova-compute[72382]: node.session.cmds_max = 128
Aug 09 15:23:14 user nova-compute[72382]: node.session.queue_depth = 32
Aug 09 15:23:14 user nova-compute[72382]: node.session.nr_sessions = 1
Aug 09 15:23:14 user nova-compute[72382]: node.session.auth.authmethod = CHAP
Aug 09 15:23:14 user nova-compute[72382]: node.session.auth.username = TMwGDLsY
Aug 09 15:23:14 user nova-compute[72382]: node.session.auth.password = ***
Aug 09 15:23:14 user nova-compute[72382]: node.session.auth.username_in = <empty>
Aug 09 15:23:14 user nova-compute[72382]: node.session.auth.password_in = <empty>
Aug 09 15:23:14 user nova-compute[72382]: node.session.auth.chap_algs = MD5
Aug 09 15:23:14 user nova-compute[72382]: node.session.timeo.replacement_timeout = 120
Aug 09 15:23:14 user nova-compute[72382]: node.session.err_timeo.abort_timeout = 15
Aug 09 15:23:14 user nova-compute[72382]: node.session.err_timeo.lu_reset_timeout = 30
Aug 09 15:23:14 user nova-compute[72382]: node.session.err_timeo.tgt_reset_timeout = 30
Aug 09 15:23:14 user nova-compute[72382]: node.session.err_timeo.host_reset_timeout = 60
Aug 09 15:23:14 user nova-compute[72382]: node.session.iscsi.FastAbort = Yes
Aug 09 15:23:14 user nova-compute[72382]: node.session.iscsi.InitialR2T = No
Aug 09 15:23:14 user nova-compute[72382]: node.session.iscsi.ImmediateData = Yes
Aug 09 15:23:14 user nova-compute[72382]: node.session.iscsi.FirstBurstLength = 262144
Aug 09 15:23:14 user nova-compute[72382]: node.session.iscsi.MaxBurstLength = 16776192
Aug 09 15:23:14 user nova-compute[72382]: node.session.iscsi.DefaultTime2Retain = 0
Aug 09 15:23:14 user nova-compute[72382]: node.session.iscsi.DefaultTime2Wait = 2
Aug 09 15:23:14 user nova-compute[72382]: node.session.iscsi.MaxConnections = 1
Aug 09 15:23:14 user nova-compute[72382]: node.session.iscsi.MaxOutstandingR2T = 1
Aug 09 15:23:14 user nova-compute[72382]: node.session.iscsi.ERL = 0
Aug 09 15:23:14 user nova-compute[72382]: node.session.scan = manual
Aug 09 15:23:14 user nova-compute[72382]: node.session.reopen_max = 0
Aug 09 15:23:14 user nova-compute[72382]: node.conn[0].address = 172.16.0.220
Aug 09 15:23:14 user nova-compute[72382]: node.conn[0].port = 3260
Aug 09 15:23:14 user nova-compute[72382]: node.conn[0].startup = manual
Aug 09 15:23:14 user nova-compute[72382]: node.conn[0].tcp.window_size = 524288
Aug 09 15:23:14 user nova-compute[72382]: node.conn[0].tcp.type_of_service = 0
Aug 09 15:23:14 user nova-compute[72382]: node.conn[0].timeo.logout_timeout = 15
Aug 09 15:23:14 user nova-compute[72382]: node.conn[0].timeo.login_timeout = 15
Aug 09 15:23:14 user nova-compute[72382]: node.conn[0].timeo.auth_timeout = 45
Aug 09 15:23:14 user nova-compute[72382]: node.conn[0].timeo.noop_out_interval = 5
Aug 09 15:23:14 user nova-compute[72382]: node.conn[0].timeo.noop_out_timeout = 5
Aug 09 15:23:14 user nova-compute[72382]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Aug 09 15:23:14 user nova-compute[72382]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Aug 09 15:23:14 user nova-compute[72382]: node.conn[0].iscsi.HeaderDigest = None
Aug 09 15:23:14 user nova-compute[72382]: node.conn[0].iscsi.DataDigest = None
Aug 09 15:23:14 user nova-compute[72382]: node.conn[0].iscsi.IFMarker = No
Aug 09 15:23:14 user nova-compute[72382]: node.conn[0].iscsi.OFMarker = No
Aug 09 15:23:14 user nova-compute[72382]: # END RECORD
Aug 09 15:23:14 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:23:14 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0052e86d-16a7-4cbe-a802-ff770c0e20ba -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:23:14 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0052e86d-16a7-4cbe-a802-ff770c0e20ba -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:23:14 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8381d28-dda8-4005-bc98-95a0d7a48a01]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:23:14 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-3667ff9b-bbe3-4906-b8cd-57ac936d4917 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:23:14 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0052e86d-16a7-4cbe-a802-ff770c0e20ba -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:23:14 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0052e86d-16a7-4cbe-a802-ff770c0e20ba -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:23:14 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[115b1491-eeef-4fd3-a9f1-f587ac9e3ddd]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:23:14 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-3667ff9b-bbe3-4906-b8cd-57ac936d4917 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:23:14 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0052e86d-16a7-4cbe-a802-ff770c0e20ba -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TMwGDLsY {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:23:14 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0052e86d-16a7-4cbe-a802-ff770c0e20ba -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TMwGDLsY" returned: 0 in 0.020s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:23:14 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[777e8617-51f8-4faf-97dd-521f392ad168]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:23:14 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-3667ff9b-bbe3-4906-b8cd-57ac936d4917 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TMwGDLsY'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:23:14 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0052e86d-16a7-4cbe-a802-ff770c0e20ba -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:23:14 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0052e86d-16a7-4cbe-a802-ff770c0e20ba -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:23:14 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[88d89248-8b41-4ee6-91d6-f963e8292c49]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:23:14 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:23:14 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-3667ff9b-bbe3-4906-b8cd-57ac936d4917 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:23:14 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:23:14 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:23:14 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7b01a74-437a-42d5-a9a7-defbd7278292]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb47e85c-aaa9-4165-8be3-125572b68a87 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cd86701-a303-4744-bf0c-31b5314bb87d (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0052e86d-16a7-4cbe-a802-ff770c0e20ba (non-flash)\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:23:14 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-3667ff9b-bbe3-4906-b8cd-57ac936d4917 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)
Aug 09 15:23:14 user nova-compute[72382]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb47e85c-aaa9-4165-8be3-125572b68a87 (non-flash)
Aug 09 15:23:14 user nova-compute[72382]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cd86701-a303-4744-bf0c-31b5314bb87d (non-flash)
Aug 09 15:23:14 user nova-compute[72382]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0052e86d-16a7-4cbe-a802-ff770c0e20ba (non-flash)
Aug 09 15:23:14 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 15:23:14 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-3667ff9b-bbe3-4906-b8cd-57ac936d4917 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)
Aug 09 15:23:14 user nova-compute[72382]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb47e85c-aaa9-4165-8be3-125572b68a87 (non-flash)
Aug 09 15:23:14 user nova-compute[72382]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cd86701-a303-4744-bf0c-31b5314bb87d (non-flash)
Aug 09 15:23:14 user nova-compute[72382]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0052e86d-16a7-4cbe-a802-ff770c0e20ba (non-flash)
Aug 09 15:23:14 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 15:23:14 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-3667ff9b-bbe3-4906-b8cd-57ac936d4917 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0052e86d-16a7-4cbe-a802-ff770c0e20ba" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.163s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 15:23:14 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-3667ff9b-bbe3-4906-b8cd-57ac936d4917 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] Connected to 172.16.0.220:3260 {{(pid=72382) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 15:23:14 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-3667ff9b-bbe3-4906-b8cd-57ac936d4917 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] HCTL ('36', '0', '0', 0) found on session 25 with lun 0 {{(pid=72382) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 15:23:14 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-3667ff9b-bbe3-4906-b8cd-57ac936d4917 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] Scanning host 36 c: 0, t: 0, l: 0) {{(pid=72382) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 15:23:14 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:23:14 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:23:14 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cf98b2f-ed39-476b-ae73-08a32fb76d4b]: (4, ('0 0 0', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:23:14 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-3667ff9b-bbe3-4906-b8cd-57ac936d4917 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] Searching for a device in session 25 and hctl ('36', '0', '0', 0) yield: sde {{(pid=72382) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 15:23:14 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-3667ff9b-bbe3-4906-b8cd-57ac936d4917 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TMwGDLsY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72382) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 15:23:14 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-3667ff9b-bbe3-4906-b8cd-57ac936d4917 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.192s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 15:23:14 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-3667ff9b-bbe3-4906-b8cd-57ac936d4917 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] <== connect_volume: return (193ms) {'type': 'block', 'scsi_wwn': '23830336261323338', 'path': '/dev/sde'} {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 15:23:14 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3667ff9b-bbe3-4906-b8cd-57ac936d4917 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] [instance: 8aa35482-60b8-4185-b14d-a2667fd3b5b7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23830336261323338', 'path': '/dev/sde'} {{(pid=72382) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 15:23:14 user nova-compute[72382]: DEBUG nova.virt.libvirt.vif [None req-3667ff9b-bbe3-4906-b8cd-57ac936d4917 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T15:19:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-341294476',display_name='tempest-ServerStableDeviceRescueTest-server-341294476',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-341294476',id=16,image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDSwCFKsEbYMyjyYEiifVNDRpUL+wgKrUr4wDsDSzZ9nQKSlq2Zyg/uMkgTj+Tetif7Q1/gEDWhIfZI9BKPsna9q628aX9WOBAayqzqMu/VUfXUdxiIc/aNSYqSeGLq3Rw==',key_name='tempest-keypair-1083668026',keypairs=<?>,launch_index=0,launched_at=2023-08-09T15:19:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9bab7a1ba67749ba85f0785846ce0338',ramdisk_id='',reservation_id='r-uxqtsogm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1490271161',owner_user_name='tempest-ServerStableDeviceRescueTest-1490271161-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T15:21:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1afcb1b9c1b04eecbc085bce97556046',uuid=8aa35482-60b8-4185-b14d-a2667fd3b5b7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b4902494-07bb-48a3-b0f8-26115f2b04d6", "address": "fa:16:3e:d9:46:4b", "network": {"id": "effdc019-a66a-4e9b-a99c-4a7c5b715201", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-414399276-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.250", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-414399276-network", "vif_mac": "fa:16:3e:d9:46:4b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bab7a1ba67749ba85f0785846ce0338", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4902494-07", "ovs_interfaceid": "b4902494-07bb-48a3-b0f8-26115f2b04d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72382) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 15:23:14 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-3667ff9b-bbe3-4906-b8cd-57ac936d4917 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] Converting VIF {"id": "b4902494-07bb-48a3-b0f8-26115f2b04d6", "address": "fa:16:3e:d9:46:4b", "network": {"id": "effdc019-a66a-4e9b-a99c-4a7c5b715201", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-414399276-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.250", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-414399276-network", "vif_mac": "fa:16:3e:d9:46:4b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bab7a1ba67749ba85f0785846ce0338", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4902494-07", "ovs_interfaceid": "b4902494-07bb-48a3-b0f8-26115f2b04d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 15:23:14 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-3667ff9b-bbe3-4906-b8cd-57ac936d4917 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d9:46:4b,bridge_name='br-int',has_traffic_filtering=True,id=b4902494-07bb-48a3-b0f8-26115f2b04d6,network=Network(effdc019-a66a-4e9b-a99c-4a7c5b715201),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4902494-07') {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 15:23:14 user nova-compute[72382]: DEBUG nova.objects.instance [None req-3667ff9b-bbe3-4906-b8cd-57ac936d4917 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] Lazy-loading 'pci_devices' on Instance uuid 8aa35482-60b8-4185-b14d-a2667fd3b5b7 {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:23:14 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-3667ff9b-bbe3-4906-b8cd-57ac936d4917 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] [instance: 8aa35482-60b8-4185-b14d-a2667fd3b5b7] End _get_guest_xml xml=<domain type="kvm">
Aug 09 15:23:14 user nova-compute[72382]:   <uuid>8aa35482-60b8-4185-b14d-a2667fd3b5b7</uuid>
Aug 09 15:23:14 user nova-compute[72382]:   <name>instance-00000010</name>
Aug 09 15:23:14 user nova-compute[72382]:   <memory>524288</memory>
Aug 09 15:23:14 user nova-compute[72382]:   <vcpu>1</vcpu>
Aug 09 15:23:14 user nova-compute[72382]:   <metadata>
Aug 09 15:23:14 user nova-compute[72382]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 15:23:14 user nova-compute[72382]:       <nova:package version="0.0.0"/>
Aug 09 15:23:14 user nova-compute[72382]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-341294476</nova:name>
Aug 09 15:23:14 user nova-compute[72382]:       <nova:creationTime>2023-08-09 15:23:13</nova:creationTime>
Aug 09 15:23:14 user nova-compute[72382]:       <nova:flavor name="m1.tiny">
Aug 09 15:23:14 user nova-compute[72382]:         <nova:memory>512</nova:memory>
Aug 09 15:23:14 user nova-compute[72382]:         <nova:disk>1</nova:disk>
Aug 09 15:23:14 user nova-compute[72382]:         <nova:swap>0</nova:swap>
Aug 09 15:23:14 user nova-compute[72382]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 15:23:14 user nova-compute[72382]:         <nova:vcpus>1</nova:vcpus>
Aug 09 15:23:14 user nova-compute[72382]:       </nova:flavor>
Aug 09 15:23:14 user nova-compute[72382]:       <nova:owner>
Aug 09 15:23:14 user nova-compute[72382]:         <nova:user uuid="1afcb1b9c1b04eecbc085bce97556046">tempest-ServerStableDeviceRescueTest-1490271161-project-member</nova:user>
Aug 09 15:23:14 user nova-compute[72382]:         <nova:project uuid="9bab7a1ba67749ba85f0785846ce0338">tempest-ServerStableDeviceRescueTest-1490271161</nova:project>
Aug 09 15:23:14 user nova-compute[72382]:       </nova:owner>
Aug 09 15:23:14 user nova-compute[72382]:       <nova:root type="image" uuid="a79f2cea-eb27-4631-aaf3-05e7d9e411b4"/>
Aug 09 15:23:14 user nova-compute[72382]:       <nova:ports>
Aug 09 15:23:14 user nova-compute[72382]:         <nova:port uuid="b4902494-07bb-48a3-b0f8-26115f2b04d6">
Aug 09 15:23:14 user nova-compute[72382]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 09 15:23:14 user nova-compute[72382]:         </nova:port>
Aug 09 15:23:14 user nova-compute[72382]:       </nova:ports>
Aug 09 15:23:14 user nova-compute[72382]:     </nova:instance>
Aug 09 15:23:14 user nova-compute[72382]:   </metadata>
Aug 09 15:23:14 user nova-compute[72382]:   <sysinfo type="smbios">
Aug 09 15:23:14 user nova-compute[72382]:     <system>
Aug 09 15:23:14 user nova-compute[72382]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 15:23:14 user nova-compute[72382]:       <entry name="product">OpenStack Nova</entry>
Aug 09 15:23:14 user nova-compute[72382]:       <entry name="version">0.0.0</entry>
Aug 09 15:23:14 user nova-compute[72382]:       <entry name="serial">8aa35482-60b8-4185-b14d-a2667fd3b5b7</entry>
Aug 09 15:23:14 user nova-compute[72382]:       <entry name="uuid">8aa35482-60b8-4185-b14d-a2667fd3b5b7</entry>
Aug 09 15:23:14 user nova-compute[72382]:       <entry name="family">Virtual Machine</entry>
Aug 09 15:23:14 user nova-compute[72382]:     </system>
Aug 09 15:23:14 user nova-compute[72382]:   </sysinfo>
Aug 09 15:23:14 user nova-compute[72382]:   <os>
Aug 09 15:23:14 user nova-compute[72382]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 15:23:14 user nova-compute[72382]:     <smbios mode="sysinfo"/>
Aug 09 15:23:14 user nova-compute[72382]:   </os>
Aug 09 15:23:14 user nova-compute[72382]:   <features>
Aug 09 15:23:14 user nova-compute[72382]:     <acpi/>
Aug 09 15:23:14 user nova-compute[72382]:     <apic/>
Aug 09 15:23:14 user nova-compute[72382]:     <vmcoreinfo/>
Aug 09 15:23:14 user nova-compute[72382]:   </features>
Aug 09 15:23:14 user nova-compute[72382]:   <clock offset="utc">
Aug 09 15:23:14 user nova-compute[72382]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 15:23:14 user nova-compute[72382]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 15:23:14 user nova-compute[72382]:     <timer name="hpet" present="no"/>
Aug 09 15:23:14 user nova-compute[72382]:   </clock>
Aug 09 15:23:14 user nova-compute[72382]:   <cpu mode="custom" match="exact">
Aug 09 15:23:14 user nova-compute[72382]:     <model>Nehalem</model>
Aug 09 15:23:14 user nova-compute[72382]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 15:23:14 user nova-compute[72382]:   </cpu>
Aug 09 15:23:14 user nova-compute[72382]:   <devices>
Aug 09 15:23:14 user nova-compute[72382]:     <disk type="file" device="disk">
Aug 09 15:23:14 user nova-compute[72382]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 15:23:14 user nova-compute[72382]:       <source file="/opt/stack/data/nova/instances/8aa35482-60b8-4185-b14d-a2667fd3b5b7/disk"/>
Aug 09 15:23:14 user nova-compute[72382]:       <target dev="vda" bus="virtio"/>
Aug 09 15:23:14 user nova-compute[72382]:     </disk>
Aug 09 15:23:14 user nova-compute[72382]:     <disk type="block" device="disk">
Aug 09 15:23:14 user nova-compute[72382]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 15:23:14 user nova-compute[72382]:       <source dev="/dev/sde"/>
Aug 09 15:23:14 user nova-compute[72382]:       <target dev="vdb" bus="virtio"/>
Aug 09 15:23:14 user nova-compute[72382]:       <serial>0052e86d-16a7-4cbe-a802-ff770c0e20ba</serial>
Aug 09 15:23:14 user nova-compute[72382]:     </disk>
Aug 09 15:23:14 user nova-compute[72382]:     <disk type="file" device="disk">
Aug 09 15:23:14 user nova-compute[72382]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 15:23:14 user nova-compute[72382]:       <source file="/opt/stack/data/nova/instances/8aa35482-60b8-4185-b14d-a2667fd3b5b7/disk.rescue"/>
Aug 09 15:23:14 user nova-compute[72382]:       <target dev="vdc" bus="virtio"/>
Aug 09 15:23:14 user nova-compute[72382]:       <boot order="1"/>
Aug 09 15:23:14 user nova-compute[72382]:     </disk>
Aug 09 15:23:14 user nova-compute[72382]:     <interface type="ethernet">
Aug 09 15:23:14 user nova-compute[72382]:       <mac address="fa:16:3e:d9:46:4b"/>
Aug 09 15:23:14 user nova-compute[72382]:       <model type="virtio"/>
Aug 09 15:23:14 user nova-compute[72382]:       <mtu size="1442"/>
Aug 09 15:23:14 user nova-compute[72382]:       <target dev="tapb4902494-07"/>
Aug 09 15:23:14 user nova-compute[72382]:     </interface>
Aug 09 15:23:14 user nova-compute[72382]:     <serial type="pty">
Aug 09 15:23:14 user nova-compute[72382]:       <log file="/opt/stack/data/nova/instances/8aa35482-60b8-4185-b14d-a2667fd3b5b7/console.log" append="off"/>
Aug 09 15:23:14 user nova-compute[72382]:     </serial>
Aug 09 15:23:14 user nova-compute[72382]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 15:23:14 user nova-compute[72382]:     <video>
Aug 09 15:23:14 user nova-compute[72382]:       <model type="virtio"/>
Aug 09 15:23:14 user nova-compute[72382]:     </video>
Aug 09 15:23:14 user nova-compute[72382]:     <rng model="virtio">
Aug 09 15:23:14 user nova-compute[72382]:       <backend model="random">/dev/urandom</backend>
Aug 09 15:23:14 user nova-compute[72382]:     </rng>
Aug 09 15:23:14 user nova-compute[72382]:     <controller type="usb" index="0" model="none"/>
Aug 09 15:23:14 user nova-compute[72382]:     <memballoon model="virtio">
Aug 09 15:23:14 user nova-compute[72382]:       <stats period="10"/>
Aug 09 15:23:14 user nova-compute[72382]:     </memballoon>
Aug 09 15:23:14 user nova-compute[72382]:   </devices>
Aug 09 15:23:14 user nova-compute[72382]: </domain>
Aug 09 15:23:14 user nova-compute[72382]:  {{(pid=72382) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 15:23:14 user nova-compute[72382]: INFO nova.virt.libvirt.driver [-] [instance: 8aa35482-60b8-4185-b14d-a2667fd3b5b7] Instance destroyed successfully.
Aug 09 15:23:14 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-3667ff9b-bbe3-4906-b8cd-57ac936d4917 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] No BDM found with device name vda, not building metadata. {{(pid=72382) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 15:23:14 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-3667ff9b-bbe3-4906-b8cd-57ac936d4917 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72382) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 15:23:14 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-3667ff9b-bbe3-4906-b8cd-57ac936d4917 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72382) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 15:23:14 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-3667ff9b-bbe3-4906-b8cd-57ac936d4917 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] No VIF found with MAC fa:16:3e:d9:46:4b, not building metadata {{(pid=72382) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 15:23:15 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:23:15 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:23:15 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:23:15 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:23:15 user nova-compute[72382]: DEBUG nova.compute.manager [req-b7fb4e7b-c730-40cb-bfd2-e1567712e681 req-13736cea-9aeb-40c0-9c66-df7509b2ebbe service nova] [instance: 8aa35482-60b8-4185-b14d-a2667fd3b5b7] Received event network-vif-plugged-b4902494-07bb-48a3-b0f8-26115f2b04d6 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:23:15 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-b7fb4e7b-c730-40cb-bfd2-e1567712e681 req-13736cea-9aeb-40c0-9c66-df7509b2ebbe service nova] Acquiring lock "8aa35482-60b8-4185-b14d-a2667fd3b5b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:23:15 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-b7fb4e7b-c730-40cb-bfd2-e1567712e681 req-13736cea-9aeb-40c0-9c66-df7509b2ebbe service nova] Lock "8aa35482-60b8-4185-b14d-a2667fd3b5b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:23:15 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-b7fb4e7b-c730-40cb-bfd2-e1567712e681 req-13736cea-9aeb-40c0-9c66-df7509b2ebbe service nova] Lock "8aa35482-60b8-4185-b14d-a2667fd3b5b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:23:15 user nova-compute[72382]: DEBUG nova.compute.manager [req-b7fb4e7b-c730-40cb-bfd2-e1567712e681 req-13736cea-9aeb-40c0-9c66-df7509b2ebbe service nova] [instance: 8aa35482-60b8-4185-b14d-a2667fd3b5b7] No waiting events found dispatching network-vif-plugged-b4902494-07bb-48a3-b0f8-26115f2b04d6 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:23:15 user nova-compute[72382]: WARNING nova.compute.manager [req-b7fb4e7b-c730-40cb-bfd2-e1567712e681 req-13736cea-9aeb-40c0-9c66-df7509b2ebbe service nova] [instance: 8aa35482-60b8-4185-b14d-a2667fd3b5b7] Received unexpected event network-vif-plugged-b4902494-07bb-48a3-b0f8-26115f2b04d6 for instance with vm_state active and task_state rescuing.
Aug 09 15:23:16 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:23:16 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:23:16 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:23:17 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Removed pending event for 8aa35482-60b8-4185-b14d-a2667fd3b5b7 due to event {{(pid=72382) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 09 15:23:17 user nova-compute[72382]: DEBUG nova.virt.driver [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Emitting event <LifecycleEvent: 1691594597.9628034, 8aa35482-60b8-4185-b14d-a2667fd3b5b7 => Resumed> {{(pid=72382) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 15:23:17 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 8aa35482-60b8-4185-b14d-a2667fd3b5b7] VM Resumed (Lifecycle Event)
Aug 09 15:23:17 user nova-compute[72382]: DEBUG nova.compute.manager [req-053cf7c7-5cde-4b8c-ab7d-336b9934ca9e req-066c2456-3329-425d-9210-6f16e9874d02 service nova] [instance: 8aa35482-60b8-4185-b14d-a2667fd3b5b7] Received event network-vif-plugged-b4902494-07bb-48a3-b0f8-26115f2b04d6 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:23:17 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-053cf7c7-5cde-4b8c-ab7d-336b9934ca9e req-066c2456-3329-425d-9210-6f16e9874d02 service nova] Acquiring lock "8aa35482-60b8-4185-b14d-a2667fd3b5b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:23:17 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-053cf7c7-5cde-4b8c-ab7d-336b9934ca9e req-066c2456-3329-425d-9210-6f16e9874d02 service nova] Lock "8aa35482-60b8-4185-b14d-a2667fd3b5b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:23:17 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-053cf7c7-5cde-4b8c-ab7d-336b9934ca9e req-066c2456-3329-425d-9210-6f16e9874d02 service nova] Lock "8aa35482-60b8-4185-b14d-a2667fd3b5b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:23:17 user nova-compute[72382]: DEBUG nova.compute.manager [req-053cf7c7-5cde-4b8c-ab7d-336b9934ca9e req-066c2456-3329-425d-9210-6f16e9874d02 service nova] [instance: 8aa35482-60b8-4185-b14d-a2667fd3b5b7] No waiting events found dispatching network-vif-plugged-b4902494-07bb-48a3-b0f8-26115f2b04d6 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:23:17 user nova-compute[72382]: WARNING nova.compute.manager [req-053cf7c7-5cde-4b8c-ab7d-336b9934ca9e req-066c2456-3329-425d-9210-6f16e9874d02 service nova] [instance: 8aa35482-60b8-4185-b14d-a2667fd3b5b7] Received unexpected event network-vif-plugged-b4902494-07bb-48a3-b0f8-26115f2b04d6 for instance with vm_state active and task_state rescuing.
Aug 09 15:23:17 user nova-compute[72382]: DEBUG nova.compute.manager [None req-3667ff9b-bbe3-4906-b8cd-57ac936d4917 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] [instance: 8aa35482-60b8-4185-b14d-a2667fd3b5b7] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:23:17 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 8aa35482-60b8-4185-b14d-a2667fd3b5b7] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:23:18 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 8aa35482-60b8-4185-b14d-a2667fd3b5b7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72382) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 15:23:18 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:23:18 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 8aa35482-60b8-4185-b14d-a2667fd3b5b7] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 09 15:23:18 user nova-compute[72382]: DEBUG nova.virt.driver [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Emitting event <LifecycleEvent: 1691594597.9646528, 8aa35482-60b8-4185-b14d-a2667fd3b5b7 => Started> {{(pid=72382) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 15:23:18 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 8aa35482-60b8-4185-b14d-a2667fd3b5b7] VM Started (Lifecycle Event)
Aug 09 15:23:18 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 8aa35482-60b8-4185-b14d-a2667fd3b5b7] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:23:18 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 8aa35482-60b8-4185-b14d-a2667fd3b5b7] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72382) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 15:23:19 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:23:23 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:23:24 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:23:28 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:23:29 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:23:31 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:23:32 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:23:33 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:23:34 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:23:35 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:23:38 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:23:39 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:23:42 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:23:43 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:23:43 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-1fe0124b-cdb3-48c8-a8d2-658580ff9f6c tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Acquiring lock "6ea8f68c-3dc1-45ac-a7f3-bca32f929add" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:23:43 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-1fe0124b-cdb3-48c8-a8d2-658580ff9f6c tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Lock "6ea8f68c-3dc1-45ac-a7f3-bca32f929add" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:23:43 user nova-compute[72382]: DEBUG nova.compute.manager [None req-1fe0124b-cdb3-48c8-a8d2-658580ff9f6c tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] [instance: 6ea8f68c-3dc1-45ac-a7f3-bca32f929add] Starting instance... {{(pid=72382) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 15:23:43 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-1fe0124b-cdb3-48c8-a8d2-658580ff9f6c tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:23:43 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-1fe0124b-cdb3-48c8-a8d2-658580ff9f6c tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:23:43 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-1fe0124b-cdb3-48c8-a8d2-658580ff9f6c tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72382) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 15:23:43 user nova-compute[72382]: INFO nova.compute.claims [None req-1fe0124b-cdb3-48c8-a8d2-658580ff9f6c tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] [instance: 6ea8f68c-3dc1-45ac-a7f3-bca32f929add] Claim successful on node user
Aug 09 15:23:44 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:23:44 user nova-compute[72382]: DEBUG nova.compute.provider_tree [None req-1fe0124b-cdb3-48c8-a8d2-658580ff9f6c tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Inventory has not changed in ProviderTree for provider: 7b15b0e5-df4d-49db-833b-2855d21d10ae {{(pid=72382) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 15:23:44 user nova-compute[72382]: DEBUG nova.scheduler.client.report [None req-1fe0124b-cdb3-48c8-a8d2-658580ff9f6c tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Inventory has not changed for provider 7b15b0e5-df4d-49db-833b-2855d21d10ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72382) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 15:23:44 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-1fe0124b-cdb3-48c8-a8d2-658580ff9f6c tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.506s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:23:44 user nova-compute[72382]: DEBUG nova.compute.manager [None req-1fe0124b-cdb3-48c8-a8d2-658580ff9f6c tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] [instance: 6ea8f68c-3dc1-45ac-a7f3-bca32f929add] Start building networks asynchronously for instance. {{(pid=72382) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 15:23:44 user nova-compute[72382]: DEBUG nova.compute.manager [None req-1fe0124b-cdb3-48c8-a8d2-658580ff9f6c tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] [instance: 6ea8f68c-3dc1-45ac-a7f3-bca32f929add] Allocating IP information in the background. {{(pid=72382) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 15:23:44 user nova-compute[72382]: DEBUG nova.network.neutron [None req-1fe0124b-cdb3-48c8-a8d2-658580ff9f6c tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] [instance: 6ea8f68c-3dc1-45ac-a7f3-bca32f929add] allocate_for_instance() {{(pid=72382) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 15:23:44 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-1fe0124b-cdb3-48c8-a8d2-658580ff9f6c tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] [instance: 6ea8f68c-3dc1-45ac-a7f3-bca32f929add] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 15:23:44 user nova-compute[72382]: DEBUG nova.compute.manager [None req-1fe0124b-cdb3-48c8-a8d2-658580ff9f6c tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] [instance: 6ea8f68c-3dc1-45ac-a7f3-bca32f929add] Start building block device mappings for instance. {{(pid=72382) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 15:23:44 user nova-compute[72382]: DEBUG nova.compute.manager [None req-1fe0124b-cdb3-48c8-a8d2-658580ff9f6c tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] [instance: 6ea8f68c-3dc1-45ac-a7f3-bca32f929add] Start spawning the instance on the hypervisor. {{(pid=72382) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 15:23:44 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-1fe0124b-cdb3-48c8-a8d2-658580ff9f6c tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] [instance: 6ea8f68c-3dc1-45ac-a7f3-bca32f929add] Creating instance directory {{(pid=72382) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 15:23:44 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-1fe0124b-cdb3-48c8-a8d2-658580ff9f6c tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] [instance: 6ea8f68c-3dc1-45ac-a7f3-bca32f929add] Creating image(s)
Aug 09 15:23:44 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-1fe0124b-cdb3-48c8-a8d2-658580ff9f6c tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Acquiring lock "/opt/stack/data/nova/instances/6ea8f68c-3dc1-45ac-a7f3-bca32f929add/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:23:44 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-1fe0124b-cdb3-48c8-a8d2-658580ff9f6c tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Lock "/opt/stack/data/nova/instances/6ea8f68c-3dc1-45ac-a7f3-bca32f929add/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:23:44 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-1fe0124b-cdb3-48c8-a8d2-658580ff9f6c tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Lock "/opt/stack/data/nova/instances/6ea8f68c-3dc1-45ac-a7f3-bca32f929add/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:23:44 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-1fe0124b-cdb3-48c8-a8d2-658580ff9f6c tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:23:44 user nova-compute[72382]: DEBUG nova.policy [None req-1fe0124b-cdb3-48c8-a8d2-658580ff9f6c tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e71af7a4912147cd9fab070cb77b275c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080d1ded4cd94e5083ee0b7e691b7363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72382) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 15:23:44 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-1fe0124b-cdb3-48c8-a8d2-658580ff9f6c tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b --force-share --output=json" returned: 0 in 0.145s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:23:44 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-1fe0124b-cdb3-48c8-a8d2-658580ff9f6c tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Acquiring lock "383812ff437283e0191ed5b9ecc04c27f1162b0b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:23:44 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-1fe0124b-cdb3-48c8-a8d2-658580ff9f6c tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Lock "383812ff437283e0191ed5b9ecc04c27f1162b0b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:23:44 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-1fe0124b-cdb3-48c8-a8d2-658580ff9f6c tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:23:45 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:23:45 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-1fe0124b-cdb3-48c8-a8d2-658580ff9f6c tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b --force-share --output=json" returned: 0 in 0.153s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:23:45 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-1fe0124b-cdb3-48c8-a8d2-658580ff9f6c tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b,backing_fmt=raw /opt/stack/data/nova/instances/6ea8f68c-3dc1-45ac-a7f3-bca32f929add/disk 1073741824 {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:23:45 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-1fe0124b-cdb3-48c8-a8d2-658580ff9f6c tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b,backing_fmt=raw /opt/stack/data/nova/instances/6ea8f68c-3dc1-45ac-a7f3-bca32f929add/disk 1073741824" returned: 0 in 0.057s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:23:45 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-1fe0124b-cdb3-48c8-a8d2-658580ff9f6c tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Lock "383812ff437283e0191ed5b9ecc04c27f1162b0b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.215s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:23:45 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-1fe0124b-cdb3-48c8-a8d2-658580ff9f6c tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:23:45 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-1fe0124b-cdb3-48c8-a8d2-658580ff9f6c tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b --force-share --output=json" returned: 0 in 0.149s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:23:45 user nova-compute[72382]: DEBUG nova.virt.disk.api [None req-1fe0124b-cdb3-48c8-a8d2-658580ff9f6c tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6ea8f68c-3dc1-45ac-a7f3-bca32f929add/disk. size=1073741824 {{(pid=72382) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 15:23:45 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-1fe0124b-cdb3-48c8-a8d2-658580ff9f6c tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ea8f68c-3dc1-45ac-a7f3-bca32f929add/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:23:45 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-1fe0124b-cdb3-48c8-a8d2-658580ff9f6c tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ea8f68c-3dc1-45ac-a7f3-bca32f929add/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:23:45 user nova-compute[72382]: DEBUG nova.virt.disk.api [None req-1fe0124b-cdb3-48c8-a8d2-658580ff9f6c tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Cannot resize image /opt/stack/data/nova/instances/6ea8f68c-3dc1-45ac-a7f3-bca32f929add/disk to a smaller size. {{(pid=72382) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 15:23:45 user nova-compute[72382]: DEBUG nova.objects.instance [None req-1fe0124b-cdb3-48c8-a8d2-658580ff9f6c tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Lazy-loading 'migration_context' on Instance uuid 6ea8f68c-3dc1-45ac-a7f3-bca32f929add {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:23:45 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-1fe0124b-cdb3-48c8-a8d2-658580ff9f6c tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] [instance: 6ea8f68c-3dc1-45ac-a7f3-bca32f929add] Created local disks {{(pid=72382) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 15:23:45 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-1fe0124b-cdb3-48c8-a8d2-658580ff9f6c tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] [instance: 6ea8f68c-3dc1-45ac-a7f3-bca32f929add] Ensure instance console log exists: /opt/stack/data/nova/instances/6ea8f68c-3dc1-45ac-a7f3-bca32f929add/console.log {{(pid=72382) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 15:23:45 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-1fe0124b-cdb3-48c8-a8d2-658580ff9f6c tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:23:45 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-1fe0124b-cdb3-48c8-a8d2-658580ff9f6c tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:23:45 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-1fe0124b-cdb3-48c8-a8d2-658580ff9f6c tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:23:45 user nova-compute[72382]: DEBUG nova.network.neutron [None req-1fe0124b-cdb3-48c8-a8d2-658580ff9f6c tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] [instance: 6ea8f68c-3dc1-45ac-a7f3-bca32f929add] Successfully created port: 360a451a-7760-4c79-99b0-7b2b04618443 {{(pid=72382) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 15:23:46 user nova-compute[72382]: DEBUG nova.network.neutron [None req-1fe0124b-cdb3-48c8-a8d2-658580ff9f6c tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] [instance: 6ea8f68c-3dc1-45ac-a7f3-bca32f929add] Successfully updated port: 360a451a-7760-4c79-99b0-7b2b04618443 {{(pid=72382) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 15:23:46 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-1fe0124b-cdb3-48c8-a8d2-658580ff9f6c tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Acquiring lock "refresh_cache-6ea8f68c-3dc1-45ac-a7f3-bca32f929add" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 15:23:46 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-1fe0124b-cdb3-48c8-a8d2-658580ff9f6c tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Acquired lock "refresh_cache-6ea8f68c-3dc1-45ac-a7f3-bca32f929add" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 15:23:46 user nova-compute[72382]: DEBUG nova.network.neutron [None req-1fe0124b-cdb3-48c8-a8d2-658580ff9f6c tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] [instance: 6ea8f68c-3dc1-45ac-a7f3-bca32f929add] Building network info cache for instance {{(pid=72382) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 15:23:47 user nova-compute[72382]: DEBUG nova.network.neutron [None req-1fe0124b-cdb3-48c8-a8d2-658580ff9f6c tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] [instance: 6ea8f68c-3dc1-45ac-a7f3-bca32f929add] Instance cache missing network info. {{(pid=72382) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 15:23:47 user nova-compute[72382]: DEBUG nova.compute.manager [req-8003efe6-9f32-4290-9e13-ae044d147366 req-c9a8e43f-ad29-4eb3-9ab0-2e12411aec65 service nova] [instance: 6ea8f68c-3dc1-45ac-a7f3-bca32f929add] Received event network-changed-360a451a-7760-4c79-99b0-7b2b04618443 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:23:47 user nova-compute[72382]: DEBUG nova.compute.manager [req-8003efe6-9f32-4290-9e13-ae044d147366 req-c9a8e43f-ad29-4eb3-9ab0-2e12411aec65 service nova] [instance: 6ea8f68c-3dc1-45ac-a7f3-bca32f929add] Refreshing instance network info cache due to event network-changed-360a451a-7760-4c79-99b0-7b2b04618443. {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 15:23:47 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-8003efe6-9f32-4290-9e13-ae044d147366 req-c9a8e43f-ad29-4eb3-9ab0-2e12411aec65 service nova] Acquiring lock "refresh_cache-6ea8f68c-3dc1-45ac-a7f3-bca32f929add" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 15:23:47 user nova-compute[72382]: DEBUG nova.network.neutron [None req-1fe0124b-cdb3-48c8-a8d2-658580ff9f6c tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] [instance: 6ea8f68c-3dc1-45ac-a7f3-bca32f929add] Updating instance_info_cache with network_info: [{"id": "360a451a-7760-4c79-99b0-7b2b04618443", "address": "fa:16:3e:84:ac:d8", "network": {"id": "d47e3749-fdff-4112-bd72-69ca584efe1f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-302967634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "080d1ded4cd94e5083ee0b7e691b7363", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap360a451a-77", "ovs_interfaceid": "360a451a-7760-4c79-99b0-7b2b04618443", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:23:47 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-1fe0124b-cdb3-48c8-a8d2-658580ff9f6c tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Releasing lock "refresh_cache-6ea8f68c-3dc1-45ac-a7f3-bca32f929add" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 15:23:47 user nova-compute[72382]: DEBUG nova.compute.manager [None req-1fe0124b-cdb3-48c8-a8d2-658580ff9f6c tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] [instance: 6ea8f68c-3dc1-45ac-a7f3-bca32f929add] Instance network_info: |[{"id": "360a451a-7760-4c79-99b0-7b2b04618443", "address": "fa:16:3e:84:ac:d8", "network": {"id": "d47e3749-fdff-4112-bd72-69ca584efe1f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-302967634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "080d1ded4cd94e5083ee0b7e691b7363", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap360a451a-77", "ovs_interfaceid": "360a451a-7760-4c79-99b0-7b2b04618443", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72382) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 15:23:47 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-8003efe6-9f32-4290-9e13-ae044d147366 req-c9a8e43f-ad29-4eb3-9ab0-2e12411aec65 service nova] Acquired lock "refresh_cache-6ea8f68c-3dc1-45ac-a7f3-bca32f929add" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 15:23:47 user nova-compute[72382]: DEBUG nova.network.neutron [req-8003efe6-9f32-4290-9e13-ae044d147366 req-c9a8e43f-ad29-4eb3-9ab0-2e12411aec65 service nova] [instance: 6ea8f68c-3dc1-45ac-a7f3-bca32f929add] Refreshing network info cache for port 360a451a-7760-4c79-99b0-7b2b04618443 {{(pid=72382) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 15:23:47 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-1fe0124b-cdb3-48c8-a8d2-658580ff9f6c tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] [instance: 6ea8f68c-3dc1-45ac-a7f3-bca32f929add] Start _get_guest_xml network_info=[{"id": "360a451a-7760-4c79-99b0-7b2b04618443", "address": "fa:16:3e:84:ac:d8", "network": {"id": "d47e3749-fdff-4112-bd72-69ca584efe1f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-302967634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "080d1ded4cd94e5083ee0b7e691b7363", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap360a451a-77", "ovs_interfaceid": "360a451a-7760-4c79-99b0-7b2b04618443", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T15:11:25Z,direct_url=<?>,disk_format='qcow2',id=a79f2cea-eb27-4631-aaf3-05e7d9e411b4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a638990e12cc4d6eabb6d55e13be6bdf',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T15:11:27Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'a79f2cea-eb27-4631-aaf3-05e7d9e411b4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72382) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 15:23:47 user nova-compute[72382]: WARNING nova.virt.libvirt.driver [None req-1fe0124b-cdb3-48c8-a8d2-658580ff9f6c tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 15:23:47 user nova-compute[72382]: WARNING nova.virt.libvirt.driver [None req-1fe0124b-cdb3-48c8-a8d2-658580ff9f6c tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 15:23:47 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-1fe0124b-cdb3-48c8-a8d2-658580ff9f6c tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72382) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 15:23:47 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-1fe0124b-cdb3-48c8-a8d2-658580ff9f6c tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] CPU controller missing on host. {{(pid=72382) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 15:23:47 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-1fe0124b-cdb3-48c8-a8d2-658580ff9f6c tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72382) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 15:23:47 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-1fe0124b-cdb3-48c8-a8d2-658580ff9f6c tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] CPU controller found on host. {{(pid=72382) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 15:23:47 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-1fe0124b-cdb3-48c8-a8d2-658580ff9f6c tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72382) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 15:23:47 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-1fe0124b-cdb3-48c8-a8d2-658580ff9f6c tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T15:11:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T15:11:25Z,direct_url=<?>,disk_format='qcow2',id=a79f2cea-eb27-4631-aaf3-05e7d9e411b4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a638990e12cc4d6eabb6d55e13be6bdf',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T15:11:27Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 15:23:47 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-1fe0124b-cdb3-48c8-a8d2-658580ff9f6c tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Flavor limits 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 15:23:47 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-1fe0124b-cdb3-48c8-a8d2-658580ff9f6c tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Image limits 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 15:23:47 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-1fe0124b-cdb3-48c8-a8d2-658580ff9f6c tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Flavor pref 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 15:23:47 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-1fe0124b-cdb3-48c8-a8d2-658580ff9f6c tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Image pref 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 15:23:47 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-1fe0124b-cdb3-48c8-a8d2-658580ff9f6c tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 15:23:47 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-1fe0124b-cdb3-48c8-a8d2-658580ff9f6c tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 15:23:47 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-1fe0124b-cdb3-48c8-a8d2-658580ff9f6c tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72382) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 15:23:47 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-1fe0124b-cdb3-48c8-a8d2-658580ff9f6c tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Got 1 possible topologies {{(pid=72382) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 15:23:47 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-1fe0124b-cdb3-48c8-a8d2-658580ff9f6c tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 15:23:47 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-1fe0124b-cdb3-48c8-a8d2-658580ff9f6c tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 15:23:47 user nova-compute[72382]: DEBUG nova.virt.libvirt.vif [None req-1fe0124b-cdb3-48c8-a8d2-658580ff9f6c tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T15:23:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-914657746',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-914657746',id=22,image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='080d1ded4cd94e5083ee0b7e691b7363',ramdisk_id='',reservation_id='r-cbl54nkn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1187177274',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T15:23:45Z,user_data=None,user_id='e71af7a4912147cd9fab070cb77b275c',uuid=6ea8f68c-3dc1-45ac-a7f3-bca32f929add,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "360a451a-7760-4c79-99b0-7b2b04618443", "address": "fa:16:3e:84:ac:d8", "network": {"id": "d47e3749-fdff-4112-bd72-69ca584efe1f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-302967634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "080d1ded4cd94e5083ee0b7e691b7363", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap360a451a-77", "ovs_interfaceid": "360a451a-7760-4c79-99b0-7b2b04618443", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72382) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 15:23:47 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-1fe0124b-cdb3-48c8-a8d2-658580ff9f6c tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Converting VIF {"id": "360a451a-7760-4c79-99b0-7b2b04618443", "address": "fa:16:3e:84:ac:d8", "network": {"id": "d47e3749-fdff-4112-bd72-69ca584efe1f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-302967634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "080d1ded4cd94e5083ee0b7e691b7363", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap360a451a-77", "ovs_interfaceid": "360a451a-7760-4c79-99b0-7b2b04618443", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 15:23:47 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-1fe0124b-cdb3-48c8-a8d2-658580ff9f6c tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:84:ac:d8,bridge_name='br-int',has_traffic_filtering=True,id=360a451a-7760-4c79-99b0-7b2b04618443,network=Network(d47e3749-fdff-4112-bd72-69ca584efe1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap360a451a-77') {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 15:23:47 user nova-compute[72382]: DEBUG nova.objects.instance [None req-1fe0124b-cdb3-48c8-a8d2-658580ff9f6c tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Lazy-loading 'pci_devices' on Instance uuid 6ea8f68c-3dc1-45ac-a7f3-bca32f929add {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:23:47 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-1fe0124b-cdb3-48c8-a8d2-658580ff9f6c tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] [instance: 6ea8f68c-3dc1-45ac-a7f3-bca32f929add] End _get_guest_xml xml=<domain type="kvm">
Aug 09 15:23:47 user nova-compute[72382]:   <uuid>6ea8f68c-3dc1-45ac-a7f3-bca32f929add</uuid>
Aug 09 15:23:47 user nova-compute[72382]:   <name>instance-00000016</name>
Aug 09 15:23:47 user nova-compute[72382]:   <memory>524288</memory>
Aug 09 15:23:47 user nova-compute[72382]:   <vcpu>1</vcpu>
Aug 09 15:23:47 user nova-compute[72382]:   <metadata>
Aug 09 15:23:47 user nova-compute[72382]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 15:23:47 user nova-compute[72382]:       <nova:package version="0.0.0"/>
Aug 09 15:23:47 user nova-compute[72382]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-914657746</nova:name>
Aug 09 15:23:47 user nova-compute[72382]:       <nova:creationTime>2023-08-09 15:23:47</nova:creationTime>
Aug 09 15:23:47 user nova-compute[72382]:       <nova:flavor name="m1.tiny">
Aug 09 15:23:47 user nova-compute[72382]:         <nova:memory>512</nova:memory>
Aug 09 15:23:47 user nova-compute[72382]:         <nova:disk>1</nova:disk>
Aug 09 15:23:47 user nova-compute[72382]:         <nova:swap>0</nova:swap>
Aug 09 15:23:47 user nova-compute[72382]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 15:23:47 user nova-compute[72382]:         <nova:vcpus>1</nova:vcpus>
Aug 09 15:23:47 user nova-compute[72382]:       </nova:flavor>
Aug 09 15:23:47 user nova-compute[72382]:       <nova:owner>
Aug 09 15:23:47 user nova-compute[72382]:         <nova:user uuid="e71af7a4912147cd9fab070cb77b275c">tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member</nova:user>
Aug 09 15:23:47 user nova-compute[72382]:         <nova:project uuid="080d1ded4cd94e5083ee0b7e691b7363">tempest-ServerBootFromVolumeStableRescueTest-1187177274</nova:project>
Aug 09 15:23:47 user nova-compute[72382]:       </nova:owner>
Aug 09 15:23:47 user nova-compute[72382]:       <nova:root type="image" uuid="a79f2cea-eb27-4631-aaf3-05e7d9e411b4"/>
Aug 09 15:23:47 user nova-compute[72382]:       <nova:ports>
Aug 09 15:23:47 user nova-compute[72382]:         <nova:port uuid="360a451a-7760-4c79-99b0-7b2b04618443">
Aug 09 15:23:47 user nova-compute[72382]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 09 15:23:47 user nova-compute[72382]:         </nova:port>
Aug 09 15:23:47 user nova-compute[72382]:       </nova:ports>
Aug 09 15:23:47 user nova-compute[72382]:     </nova:instance>
Aug 09 15:23:47 user nova-compute[72382]:   </metadata>
Aug 09 15:23:47 user nova-compute[72382]:   <sysinfo type="smbios">
Aug 09 15:23:47 user nova-compute[72382]:     <system>
Aug 09 15:23:47 user nova-compute[72382]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 15:23:47 user nova-compute[72382]:       <entry name="product">OpenStack Nova</entry>
Aug 09 15:23:47 user nova-compute[72382]:       <entry name="version">0.0.0</entry>
Aug 09 15:23:47 user nova-compute[72382]:       <entry name="serial">6ea8f68c-3dc1-45ac-a7f3-bca32f929add</entry>
Aug 09 15:23:47 user nova-compute[72382]:       <entry name="uuid">6ea8f68c-3dc1-45ac-a7f3-bca32f929add</entry>
Aug 09 15:23:47 user nova-compute[72382]:       <entry name="family">Virtual Machine</entry>
Aug 09 15:23:47 user nova-compute[72382]:     </system>
Aug 09 15:23:47 user nova-compute[72382]:   </sysinfo>
Aug 09 15:23:47 user nova-compute[72382]:   <os>
Aug 09 15:23:47 user nova-compute[72382]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 15:23:47 user nova-compute[72382]:     <boot dev="hd"/>
Aug 09 15:23:47 user nova-compute[72382]:     <smbios mode="sysinfo"/>
Aug 09 15:23:47 user nova-compute[72382]:   </os>
Aug 09 15:23:47 user nova-compute[72382]:   <features>
Aug 09 15:23:47 user nova-compute[72382]:     <acpi/>
Aug 09 15:23:47 user nova-compute[72382]:     <apic/>
Aug 09 15:23:47 user nova-compute[72382]:     <vmcoreinfo/>
Aug 09 15:23:47 user nova-compute[72382]:   </features>
Aug 09 15:23:47 user nova-compute[72382]:   <clock offset="utc">
Aug 09 15:23:47 user nova-compute[72382]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 15:23:47 user nova-compute[72382]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 15:23:47 user nova-compute[72382]:     <timer name="hpet" present="no"/>
Aug 09 15:23:47 user nova-compute[72382]:   </clock>
Aug 09 15:23:47 user nova-compute[72382]:   <cpu mode="custom" match="exact">
Aug 09 15:23:47 user nova-compute[72382]:     <model>Nehalem</model>
Aug 09 15:23:47 user nova-compute[72382]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 15:23:47 user nova-compute[72382]:   </cpu>
Aug 09 15:23:47 user nova-compute[72382]:   <devices>
Aug 09 15:23:47 user nova-compute[72382]:     <disk type="file" device="disk">
Aug 09 15:23:47 user nova-compute[72382]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 15:23:47 user nova-compute[72382]:       <source file="/opt/stack/data/nova/instances/6ea8f68c-3dc1-45ac-a7f3-bca32f929add/disk"/>
Aug 09 15:23:47 user nova-compute[72382]:       <target dev="vda" bus="virtio"/>
Aug 09 15:23:47 user nova-compute[72382]:     </disk>
Aug 09 15:23:47 user nova-compute[72382]:     <interface type="ethernet">
Aug 09 15:23:47 user nova-compute[72382]:       <mac address="fa:16:3e:84:ac:d8"/>
Aug 09 15:23:47 user nova-compute[72382]:       <model type="virtio"/>
Aug 09 15:23:47 user nova-compute[72382]:       <mtu size="1442"/>
Aug 09 15:23:47 user nova-compute[72382]:       <target dev="tap360a451a-77"/>
Aug 09 15:23:47 user nova-compute[72382]:     </interface>
Aug 09 15:23:47 user nova-compute[72382]:     <serial type="pty">
Aug 09 15:23:47 user nova-compute[72382]:       <log file="/opt/stack/data/nova/instances/6ea8f68c-3dc1-45ac-a7f3-bca32f929add/console.log" append="off"/>
Aug 09 15:23:47 user nova-compute[72382]:     </serial>
Aug 09 15:23:47 user nova-compute[72382]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 15:23:47 user nova-compute[72382]:     <video>
Aug 09 15:23:47 user nova-compute[72382]:       <model type="virtio"/>
Aug 09 15:23:47 user nova-compute[72382]:     </video>
Aug 09 15:23:47 user nova-compute[72382]:     <rng model="virtio">
Aug 09 15:23:47 user nova-compute[72382]:       <backend model="random">/dev/urandom</backend>
Aug 09 15:23:47 user nova-compute[72382]:     </rng>
Aug 09 15:23:47 user nova-compute[72382]:     <controller type="usb" index="0" model="none"/>
Aug 09 15:23:47 user nova-compute[72382]:     <memballoon model="virtio">
Aug 09 15:23:47 user nova-compute[72382]:       <stats period="10"/>
Aug 09 15:23:47 user nova-compute[72382]:     </memballoon>
Aug 09 15:23:47 user nova-compute[72382]:   </devices>
Aug 09 15:23:47 user nova-compute[72382]: </domain>
Aug 09 15:23:47 user nova-compute[72382]:  {{(pid=72382) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 15:23:47 user nova-compute[72382]: DEBUG nova.virt.libvirt.vif [None req-1fe0124b-cdb3-48c8-a8d2-658580ff9f6c tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T15:23:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-914657746',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-914657746',id=22,image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='080d1ded4cd94e5083ee0b7e691b7363',ramdisk_id='',reservation_id='r-cbl54nkn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1187177274',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T15:23:45Z,user_data=None,user_id='e71af7a4912147cd9fab070cb77b275c',uuid=6ea8f68c-3dc1-45ac-a7f3-bca32f929add,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "360a451a-7760-4c79-99b0-7b2b04618443", "address": "fa:16:3e:84:ac:d8", "network": {"id": "d47e3749-fdff-4112-bd72-69ca584efe1f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-302967634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "080d1ded4cd94e5083ee0b7e691b7363", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap360a451a-77", "ovs_interfaceid": "360a451a-7760-4c79-99b0-7b2b04618443", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 15:23:47 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-1fe0124b-cdb3-48c8-a8d2-658580ff9f6c tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Converting VIF {"id": "360a451a-7760-4c79-99b0-7b2b04618443", "address": "fa:16:3e:84:ac:d8", "network": {"id": "d47e3749-fdff-4112-bd72-69ca584efe1f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-302967634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "080d1ded4cd94e5083ee0b7e691b7363", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap360a451a-77", "ovs_interfaceid": "360a451a-7760-4c79-99b0-7b2b04618443", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 15:23:47 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-1fe0124b-cdb3-48c8-a8d2-658580ff9f6c tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:84:ac:d8,bridge_name='br-int',has_traffic_filtering=True,id=360a451a-7760-4c79-99b0-7b2b04618443,network=Network(d47e3749-fdff-4112-bd72-69ca584efe1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap360a451a-77') {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 15:23:47 user nova-compute[72382]: DEBUG os_vif [None req-1fe0124b-cdb3-48c8-a8d2-658580ff9f6c tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:84:ac:d8,bridge_name='br-int',has_traffic_filtering=True,id=360a451a-7760-4c79-99b0-7b2b04618443,network=Network(d47e3749-fdff-4112-bd72-69ca584efe1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap360a451a-77') {{(pid=72382) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 15:23:47 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:23:47 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:23:47 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 15:23:47 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:23:47 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap360a451a-77, may_exist=True, interface_attrs={}) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:23:47 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap360a451a-77, col_values=(('external_ids', {'iface-id': '360a451a-7760-4c79-99b0-7b2b04618443', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:84:ac:d8', 'vm-uuid': '6ea8f68c-3dc1-45ac-a7f3-bca32f929add'}),), if_exists=True) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:23:47 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:23:47 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:23:47 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:23:47 user nova-compute[72382]: INFO os_vif [None req-1fe0124b-cdb3-48c8-a8d2-658580ff9f6c tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:84:ac:d8,bridge_name='br-int',has_traffic_filtering=True,id=360a451a-7760-4c79-99b0-7b2b04618443,network=Network(d47e3749-fdff-4112-bd72-69ca584efe1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap360a451a-77')
Aug 09 15:23:47 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-1fe0124b-cdb3-48c8-a8d2-658580ff9f6c tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] No BDM found with device name vda, not building metadata. {{(pid=72382) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 15:23:47 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-1fe0124b-cdb3-48c8-a8d2-658580ff9f6c tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] No VIF found with MAC fa:16:3e:84:ac:d8, not building metadata {{(pid=72382) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 15:23:48 user nova-compute[72382]: DEBUG nova.network.neutron [req-8003efe6-9f32-4290-9e13-ae044d147366 req-c9a8e43f-ad29-4eb3-9ab0-2e12411aec65 service nova] [instance: 6ea8f68c-3dc1-45ac-a7f3-bca32f929add] Updated VIF entry in instance network info cache for port 360a451a-7760-4c79-99b0-7b2b04618443. {{(pid=72382) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 15:23:48 user nova-compute[72382]: DEBUG nova.network.neutron [req-8003efe6-9f32-4290-9e13-ae044d147366 req-c9a8e43f-ad29-4eb3-9ab0-2e12411aec65 service nova] [instance: 6ea8f68c-3dc1-45ac-a7f3-bca32f929add] Updating instance_info_cache with network_info: [{"id": "360a451a-7760-4c79-99b0-7b2b04618443", "address": "fa:16:3e:84:ac:d8", "network": {"id": "d47e3749-fdff-4112-bd72-69ca584efe1f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-302967634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "080d1ded4cd94e5083ee0b7e691b7363", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap360a451a-77", "ovs_interfaceid": "360a451a-7760-4c79-99b0-7b2b04618443", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:23:48 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-8003efe6-9f32-4290-9e13-ae044d147366 req-c9a8e43f-ad29-4eb3-9ab0-2e12411aec65 service nova] Releasing lock "refresh_cache-6ea8f68c-3dc1-45ac-a7f3-bca32f929add" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 15:23:48 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-04479af1-da06-4ff2-a866-5b53e0bca655 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Acquiring lock "61976531-76ae-4a1c-8950-0af784be376e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:23:48 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-04479af1-da06-4ff2-a866-5b53e0bca655 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Lock "61976531-76ae-4a1c-8950-0af784be376e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:23:48 user nova-compute[72382]: DEBUG nova.compute.manager [None req-04479af1-da06-4ff2-a866-5b53e0bca655 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] [instance: 61976531-76ae-4a1c-8950-0af784be376e] Starting instance... {{(pid=72382) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 15:23:48 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-04479af1-da06-4ff2-a866-5b53e0bca655 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:23:48 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-04479af1-da06-4ff2-a866-5b53e0bca655 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:23:48 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-04479af1-da06-4ff2-a866-5b53e0bca655 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72382) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 15:23:48 user nova-compute[72382]: INFO nova.compute.claims [None req-04479af1-da06-4ff2-a866-5b53e0bca655 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] [instance: 61976531-76ae-4a1c-8950-0af784be376e] Claim successful on node user
Aug 09 15:23:48 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:23:48 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:23:49 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:23:49 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:23:49 user nova-compute[72382]: DEBUG nova.compute.manager [req-b4f798ba-dc86-4a7a-a7a8-d69d37ec2edc req-17e465b4-0591-4be5-a97f-533c23a78f7f service nova] [instance: 6ea8f68c-3dc1-45ac-a7f3-bca32f929add] Received event network-vif-plugged-360a451a-7760-4c79-99b0-7b2b04618443 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:23:49 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-b4f798ba-dc86-4a7a-a7a8-d69d37ec2edc req-17e465b4-0591-4be5-a97f-533c23a78f7f service nova] Acquiring lock "6ea8f68c-3dc1-45ac-a7f3-bca32f929add-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:23:49 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-b4f798ba-dc86-4a7a-a7a8-d69d37ec2edc req-17e465b4-0591-4be5-a97f-533c23a78f7f service nova] Lock "6ea8f68c-3dc1-45ac-a7f3-bca32f929add-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:23:49 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-b4f798ba-dc86-4a7a-a7a8-d69d37ec2edc req-17e465b4-0591-4be5-a97f-533c23a78f7f service nova] Lock "6ea8f68c-3dc1-45ac-a7f3-bca32f929add-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:23:49 user nova-compute[72382]: DEBUG nova.compute.manager [req-b4f798ba-dc86-4a7a-a7a8-d69d37ec2edc req-17e465b4-0591-4be5-a97f-533c23a78f7f service nova] [instance: 6ea8f68c-3dc1-45ac-a7f3-bca32f929add] No waiting events found dispatching network-vif-plugged-360a451a-7760-4c79-99b0-7b2b04618443 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:23:49 user nova-compute[72382]: WARNING nova.compute.manager [req-b4f798ba-dc86-4a7a-a7a8-d69d37ec2edc req-17e465b4-0591-4be5-a97f-533c23a78f7f service nova] [instance: 6ea8f68c-3dc1-45ac-a7f3-bca32f929add] Received unexpected event network-vif-plugged-360a451a-7760-4c79-99b0-7b2b04618443 for instance with vm_state building and task_state spawning.
Aug 09 15:23:49 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:23:49 user nova-compute[72382]: DEBUG nova.compute.provider_tree [None req-04479af1-da06-4ff2-a866-5b53e0bca655 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Inventory has not changed in ProviderTree for provider: 7b15b0e5-df4d-49db-833b-2855d21d10ae {{(pid=72382) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 15:23:49 user nova-compute[72382]: DEBUG nova.scheduler.client.report [None req-04479af1-da06-4ff2-a866-5b53e0bca655 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Inventory has not changed for provider 7b15b0e5-df4d-49db-833b-2855d21d10ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72382) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 15:23:49 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-04479af1-da06-4ff2-a866-5b53e0bca655 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.783s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:23:49 user nova-compute[72382]: DEBUG nova.compute.manager [None req-04479af1-da06-4ff2-a866-5b53e0bca655 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] [instance: 61976531-76ae-4a1c-8950-0af784be376e] Start building networks asynchronously for instance. {{(pid=72382) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 15:23:49 user nova-compute[72382]: DEBUG nova.compute.manager [None req-04479af1-da06-4ff2-a866-5b53e0bca655 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] [instance: 61976531-76ae-4a1c-8950-0af784be376e] Allocating IP information in the background. {{(pid=72382) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 15:23:49 user nova-compute[72382]: DEBUG nova.network.neutron [None req-04479af1-da06-4ff2-a866-5b53e0bca655 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] [instance: 61976531-76ae-4a1c-8950-0af784be376e] allocate_for_instance() {{(pid=72382) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 15:23:49 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-04479af1-da06-4ff2-a866-5b53e0bca655 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] [instance: 61976531-76ae-4a1c-8950-0af784be376e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 15:23:49 user nova-compute[72382]: DEBUG nova.compute.manager [None req-04479af1-da06-4ff2-a866-5b53e0bca655 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] [instance: 61976531-76ae-4a1c-8950-0af784be376e] Start building block device mappings for instance. {{(pid=72382) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 15:23:49 user nova-compute[72382]: DEBUG nova.policy [None req-04479af1-da06-4ff2-a866-5b53e0bca655 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '401c9df41f284c88a86557485d7d9537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98009994d9c74eb9b4fc6321e82440de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72382) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 15:23:49 user nova-compute[72382]: DEBUG nova.compute.manager [None req-04479af1-da06-4ff2-a866-5b53e0bca655 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] [instance: 61976531-76ae-4a1c-8950-0af784be376e] Start spawning the instance on the hypervisor. {{(pid=72382) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 15:23:49 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-04479af1-da06-4ff2-a866-5b53e0bca655 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] [instance: 61976531-76ae-4a1c-8950-0af784be376e] Creating instance directory {{(pid=72382) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 15:23:49 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-04479af1-da06-4ff2-a866-5b53e0bca655 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] [instance: 61976531-76ae-4a1c-8950-0af784be376e] Creating image(s)
Aug 09 15:23:49 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-04479af1-da06-4ff2-a866-5b53e0bca655 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Acquiring lock "/opt/stack/data/nova/instances/61976531-76ae-4a1c-8950-0af784be376e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:23:49 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-04479af1-da06-4ff2-a866-5b53e0bca655 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Lock "/opt/stack/data/nova/instances/61976531-76ae-4a1c-8950-0af784be376e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:23:49 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-04479af1-da06-4ff2-a866-5b53e0bca655 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Lock "/opt/stack/data/nova/instances/61976531-76ae-4a1c-8950-0af784be376e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:23:49 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-04479af1-da06-4ff2-a866-5b53e0bca655 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:23:49 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-04479af1-da06-4ff2-a866-5b53e0bca655 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b --force-share --output=json" returned: 0 in 0.152s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:23:49 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-04479af1-da06-4ff2-a866-5b53e0bca655 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Acquiring lock "383812ff437283e0191ed5b9ecc04c27f1162b0b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:23:49 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-04479af1-da06-4ff2-a866-5b53e0bca655 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Lock "383812ff437283e0191ed5b9ecc04c27f1162b0b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:23:49 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-04479af1-da06-4ff2-a866-5b53e0bca655 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:23:50 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-04479af1-da06-4ff2-a866-5b53e0bca655 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b --force-share --output=json" returned: 0 in 0.134s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:23:50 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-04479af1-da06-4ff2-a866-5b53e0bca655 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b,backing_fmt=raw /opt/stack/data/nova/instances/61976531-76ae-4a1c-8950-0af784be376e/disk 1073741824 {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:23:50 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-04479af1-da06-4ff2-a866-5b53e0bca655 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b,backing_fmt=raw /opt/stack/data/nova/instances/61976531-76ae-4a1c-8950-0af784be376e/disk 1073741824" returned: 0 in 0.055s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:23:50 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-04479af1-da06-4ff2-a866-5b53e0bca655 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Lock "383812ff437283e0191ed5b9ecc04c27f1162b0b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.196s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:23:50 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-04479af1-da06-4ff2-a866-5b53e0bca655 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:23:50 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-04479af1-da06-4ff2-a866-5b53e0bca655 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b --force-share --output=json" returned: 0 in 0.139s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:23:50 user nova-compute[72382]: DEBUG nova.virt.disk.api [None req-04479af1-da06-4ff2-a866-5b53e0bca655 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Checking if we can resize image /opt/stack/data/nova/instances/61976531-76ae-4a1c-8950-0af784be376e/disk. size=1073741824 {{(pid=72382) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 15:23:50 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-04479af1-da06-4ff2-a866-5b53e0bca655 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61976531-76ae-4a1c-8950-0af784be376e/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:23:50 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-04479af1-da06-4ff2-a866-5b53e0bca655 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61976531-76ae-4a1c-8950-0af784be376e/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:23:50 user nova-compute[72382]: DEBUG nova.virt.disk.api [None req-04479af1-da06-4ff2-a866-5b53e0bca655 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Cannot resize image /opt/stack/data/nova/instances/61976531-76ae-4a1c-8950-0af784be376e/disk to a smaller size. {{(pid=72382) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 15:23:50 user nova-compute[72382]: DEBUG nova.objects.instance [None req-04479af1-da06-4ff2-a866-5b53e0bca655 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Lazy-loading 'migration_context' on Instance uuid 61976531-76ae-4a1c-8950-0af784be376e {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:23:50 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-04479af1-da06-4ff2-a866-5b53e0bca655 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] [instance: 61976531-76ae-4a1c-8950-0af784be376e] Created local disks {{(pid=72382) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 15:23:50 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-04479af1-da06-4ff2-a866-5b53e0bca655 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] [instance: 61976531-76ae-4a1c-8950-0af784be376e] Ensure instance console log exists: /opt/stack/data/nova/instances/61976531-76ae-4a1c-8950-0af784be376e/console.log {{(pid=72382) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 15:23:50 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-04479af1-da06-4ff2-a866-5b53e0bca655 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:23:50 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-04479af1-da06-4ff2-a866-5b53e0bca655 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:23:50 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-04479af1-da06-4ff2-a866-5b53e0bca655 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:23:50 user nova-compute[72382]: DEBUG nova.network.neutron [None req-04479af1-da06-4ff2-a866-5b53e0bca655 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] [instance: 61976531-76ae-4a1c-8950-0af784be376e] Successfully created port: adf7f33a-6792-47f7-b8e6-4d0775b01f9d {{(pid=72382) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 15:23:51 user nova-compute[72382]: DEBUG nova.virt.driver [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Emitting event <LifecycleEvent: 1691594631.2465491, 6ea8f68c-3dc1-45ac-a7f3-bca32f929add => Resumed> {{(pid=72382) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 15:23:51 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 6ea8f68c-3dc1-45ac-a7f3-bca32f929add] VM Resumed (Lifecycle Event)
Aug 09 15:23:51 user nova-compute[72382]: DEBUG nova.compute.manager [None req-1fe0124b-cdb3-48c8-a8d2-658580ff9f6c tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] [instance: 6ea8f68c-3dc1-45ac-a7f3-bca32f929add] Instance event wait completed in 0 seconds for  {{(pid=72382) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 15:23:51 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-1fe0124b-cdb3-48c8-a8d2-658580ff9f6c tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] [instance: 6ea8f68c-3dc1-45ac-a7f3-bca32f929add] Guest created on hypervisor {{(pid=72382) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 15:23:51 user nova-compute[72382]: INFO nova.virt.libvirt.driver [-] [instance: 6ea8f68c-3dc1-45ac-a7f3-bca32f929add] Instance spawned successfully.
Aug 09 15:23:51 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-1fe0124b-cdb3-48c8-a8d2-658580ff9f6c tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] [instance: 6ea8f68c-3dc1-45ac-a7f3-bca32f929add] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 15:23:51 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 6ea8f68c-3dc1-45ac-a7f3-bca32f929add] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:23:51 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 6ea8f68c-3dc1-45ac-a7f3-bca32f929add] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72382) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 15:23:51 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-1fe0124b-cdb3-48c8-a8d2-658580ff9f6c tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] [instance: 6ea8f68c-3dc1-45ac-a7f3-bca32f929add] Found default for hw_cdrom_bus of ide {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:23:51 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-1fe0124b-cdb3-48c8-a8d2-658580ff9f6c tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] [instance: 6ea8f68c-3dc1-45ac-a7f3-bca32f929add] Found default for hw_disk_bus of virtio {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:23:51 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-1fe0124b-cdb3-48c8-a8d2-658580ff9f6c tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] [instance: 6ea8f68c-3dc1-45ac-a7f3-bca32f929add] Found default for hw_input_bus of None {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:23:51 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-1fe0124b-cdb3-48c8-a8d2-658580ff9f6c tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] [instance: 6ea8f68c-3dc1-45ac-a7f3-bca32f929add] Found default for hw_pointer_model of None {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:23:51 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-1fe0124b-cdb3-48c8-a8d2-658580ff9f6c tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] [instance: 6ea8f68c-3dc1-45ac-a7f3-bca32f929add] Found default for hw_video_model of virtio {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:23:51 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-1fe0124b-cdb3-48c8-a8d2-658580ff9f6c tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] [instance: 6ea8f68c-3dc1-45ac-a7f3-bca32f929add] Found default for hw_vif_model of virtio {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:23:51 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 6ea8f68c-3dc1-45ac-a7f3-bca32f929add] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 15:23:51 user nova-compute[72382]: DEBUG nova.virt.driver [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Emitting event <LifecycleEvent: 1691594631.2470572, 6ea8f68c-3dc1-45ac-a7f3-bca32f929add => Started> {{(pid=72382) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 15:23:51 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 6ea8f68c-3dc1-45ac-a7f3-bca32f929add] VM Started (Lifecycle Event)
Aug 09 15:23:51 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 6ea8f68c-3dc1-45ac-a7f3-bca32f929add] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:23:51 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 6ea8f68c-3dc1-45ac-a7f3-bca32f929add] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72382) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 15:23:51 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 6ea8f68c-3dc1-45ac-a7f3-bca32f929add] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 15:23:51 user nova-compute[72382]: DEBUG nova.compute.manager [req-ab128e9b-8e87-4763-9803-b0a4f01e7ec4 req-a0433cb7-c2d7-4b0f-a7cf-aeda4a8bf76e service nova] [instance: 6ea8f68c-3dc1-45ac-a7f3-bca32f929add] Received event network-vif-plugged-360a451a-7760-4c79-99b0-7b2b04618443 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:23:51 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-ab128e9b-8e87-4763-9803-b0a4f01e7ec4 req-a0433cb7-c2d7-4b0f-a7cf-aeda4a8bf76e service nova] Acquiring lock "6ea8f68c-3dc1-45ac-a7f3-bca32f929add-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:23:51 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-ab128e9b-8e87-4763-9803-b0a4f01e7ec4 req-a0433cb7-c2d7-4b0f-a7cf-aeda4a8bf76e service nova] Lock "6ea8f68c-3dc1-45ac-a7f3-bca32f929add-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:23:51 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-ab128e9b-8e87-4763-9803-b0a4f01e7ec4 req-a0433cb7-c2d7-4b0f-a7cf-aeda4a8bf76e service nova] Lock "6ea8f68c-3dc1-45ac-a7f3-bca32f929add-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:23:51 user nova-compute[72382]: DEBUG nova.compute.manager [req-ab128e9b-8e87-4763-9803-b0a4f01e7ec4 req-a0433cb7-c2d7-4b0f-a7cf-aeda4a8bf76e service nova] [instance: 6ea8f68c-3dc1-45ac-a7f3-bca32f929add] No waiting events found dispatching network-vif-plugged-360a451a-7760-4c79-99b0-7b2b04618443 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:23:51 user nova-compute[72382]: WARNING nova.compute.manager [req-ab128e9b-8e87-4763-9803-b0a4f01e7ec4 req-a0433cb7-c2d7-4b0f-a7cf-aeda4a8bf76e service nova] [instance: 6ea8f68c-3dc1-45ac-a7f3-bca32f929add] Received unexpected event network-vif-plugged-360a451a-7760-4c79-99b0-7b2b04618443 for instance with vm_state building and task_state spawning.
Aug 09 15:23:51 user nova-compute[72382]: INFO nova.compute.manager [None req-1fe0124b-cdb3-48c8-a8d2-658580ff9f6c tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] [instance: 6ea8f68c-3dc1-45ac-a7f3-bca32f929add] Took 6.68 seconds to spawn the instance on the hypervisor.
Aug 09 15:23:51 user nova-compute[72382]: DEBUG nova.compute.manager [None req-1fe0124b-cdb3-48c8-a8d2-658580ff9f6c tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] [instance: 6ea8f68c-3dc1-45ac-a7f3-bca32f929add] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:23:51 user nova-compute[72382]: INFO nova.compute.manager [None req-1fe0124b-cdb3-48c8-a8d2-658580ff9f6c tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] [instance: 6ea8f68c-3dc1-45ac-a7f3-bca32f929add] Took 7.56 seconds to build instance.
Aug 09 15:23:51 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-1fe0124b-cdb3-48c8-a8d2-658580ff9f6c tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Lock "6ea8f68c-3dc1-45ac-a7f3-bca32f929add" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.693s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:23:52 user nova-compute[72382]: DEBUG nova.network.neutron [None req-04479af1-da06-4ff2-a866-5b53e0bca655 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] [instance: 61976531-76ae-4a1c-8950-0af784be376e] Successfully updated port: adf7f33a-6792-47f7-b8e6-4d0775b01f9d {{(pid=72382) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 15:23:52 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-04479af1-da06-4ff2-a866-5b53e0bca655 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Acquiring lock "refresh_cache-61976531-76ae-4a1c-8950-0af784be376e" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 15:23:52 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-04479af1-da06-4ff2-a866-5b53e0bca655 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Acquired lock "refresh_cache-61976531-76ae-4a1c-8950-0af784be376e" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 15:23:52 user nova-compute[72382]: DEBUG nova.network.neutron [None req-04479af1-da06-4ff2-a866-5b53e0bca655 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] [instance: 61976531-76ae-4a1c-8950-0af784be376e] Building network info cache for instance {{(pid=72382) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 15:23:52 user nova-compute[72382]: DEBUG nova.compute.manager [req-7017b4dc-2a93-4fff-b20a-63d06f462074 req-1e183fe8-3380-4bd6-9c3c-a2d4128a5d02 service nova] [instance: 61976531-76ae-4a1c-8950-0af784be376e] Received event network-changed-adf7f33a-6792-47f7-b8e6-4d0775b01f9d {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:23:52 user nova-compute[72382]: DEBUG nova.compute.manager [req-7017b4dc-2a93-4fff-b20a-63d06f462074 req-1e183fe8-3380-4bd6-9c3c-a2d4128a5d02 service nova] [instance: 61976531-76ae-4a1c-8950-0af784be376e] Refreshing instance network info cache due to event network-changed-adf7f33a-6792-47f7-b8e6-4d0775b01f9d. {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 15:23:52 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-7017b4dc-2a93-4fff-b20a-63d06f462074 req-1e183fe8-3380-4bd6-9c3c-a2d4128a5d02 service nova] Acquiring lock "refresh_cache-61976531-76ae-4a1c-8950-0af784be376e" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 15:23:52 user nova-compute[72382]: DEBUG nova.network.neutron [None req-04479af1-da06-4ff2-a866-5b53e0bca655 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] [instance: 61976531-76ae-4a1c-8950-0af784be376e] Instance cache missing network info. {{(pid=72382) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 15:23:52 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:23:52 user nova-compute[72382]: DEBUG nova.network.neutron [None req-04479af1-da06-4ff2-a866-5b53e0bca655 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] [instance: 61976531-76ae-4a1c-8950-0af784be376e] Updating instance_info_cache with network_info: [{"id": "adf7f33a-6792-47f7-b8e6-4d0775b01f9d", "address": "fa:16:3e:d5:b3:b9", "network": {"id": "46eb5f03-e04d-43d1-96d6-0792bc7a94b1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1842512309-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98009994d9c74eb9b4fc6321e82440de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadf7f33a-67", "ovs_interfaceid": "adf7f33a-6792-47f7-b8e6-4d0775b01f9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:23:52 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-04479af1-da06-4ff2-a866-5b53e0bca655 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Releasing lock "refresh_cache-61976531-76ae-4a1c-8950-0af784be376e" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 15:23:52 user nova-compute[72382]: DEBUG nova.compute.manager [None req-04479af1-da06-4ff2-a866-5b53e0bca655 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] [instance: 61976531-76ae-4a1c-8950-0af784be376e] Instance network_info: |[{"id": "adf7f33a-6792-47f7-b8e6-4d0775b01f9d", "address": "fa:16:3e:d5:b3:b9", "network": {"id": "46eb5f03-e04d-43d1-96d6-0792bc7a94b1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1842512309-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98009994d9c74eb9b4fc6321e82440de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadf7f33a-67", "ovs_interfaceid": "adf7f33a-6792-47f7-b8e6-4d0775b01f9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72382) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 15:23:52 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-7017b4dc-2a93-4fff-b20a-63d06f462074 req-1e183fe8-3380-4bd6-9c3c-a2d4128a5d02 service nova] Acquired lock "refresh_cache-61976531-76ae-4a1c-8950-0af784be376e" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 15:23:52 user nova-compute[72382]: DEBUG nova.network.neutron [req-7017b4dc-2a93-4fff-b20a-63d06f462074 req-1e183fe8-3380-4bd6-9c3c-a2d4128a5d02 service nova] [instance: 61976531-76ae-4a1c-8950-0af784be376e] Refreshing network info cache for port adf7f33a-6792-47f7-b8e6-4d0775b01f9d {{(pid=72382) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 15:23:52 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-04479af1-da06-4ff2-a866-5b53e0bca655 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] [instance: 61976531-76ae-4a1c-8950-0af784be376e] Start _get_guest_xml network_info=[{"id": "adf7f33a-6792-47f7-b8e6-4d0775b01f9d", "address": "fa:16:3e:d5:b3:b9", "network": {"id": "46eb5f03-e04d-43d1-96d6-0792bc7a94b1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1842512309-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98009994d9c74eb9b4fc6321e82440de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadf7f33a-67", "ovs_interfaceid": "adf7f33a-6792-47f7-b8e6-4d0775b01f9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T15:11:25Z,direct_url=<?>,disk_format='qcow2',id=a79f2cea-eb27-4631-aaf3-05e7d9e411b4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a638990e12cc4d6eabb6d55e13be6bdf',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T15:11:27Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'a79f2cea-eb27-4631-aaf3-05e7d9e411b4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72382) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 15:23:52 user nova-compute[72382]: WARNING nova.virt.libvirt.driver [None req-04479af1-da06-4ff2-a866-5b53e0bca655 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 15:23:52 user nova-compute[72382]: WARNING nova.virt.libvirt.driver [None req-04479af1-da06-4ff2-a866-5b53e0bca655 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 15:23:52 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-04479af1-da06-4ff2-a866-5b53e0bca655 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72382) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 15:23:52 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-04479af1-da06-4ff2-a866-5b53e0bca655 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] CPU controller missing on host. {{(pid=72382) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 15:23:52 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-04479af1-da06-4ff2-a866-5b53e0bca655 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72382) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 15:23:52 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-04479af1-da06-4ff2-a866-5b53e0bca655 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] CPU controller found on host. {{(pid=72382) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 15:23:52 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-04479af1-da06-4ff2-a866-5b53e0bca655 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72382) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 15:23:52 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-04479af1-da06-4ff2-a866-5b53e0bca655 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T15:11:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T15:11:25Z,direct_url=<?>,disk_format='qcow2',id=a79f2cea-eb27-4631-aaf3-05e7d9e411b4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a638990e12cc4d6eabb6d55e13be6bdf',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T15:11:27Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 15:23:52 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-04479af1-da06-4ff2-a866-5b53e0bca655 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Flavor limits 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 15:23:52 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-04479af1-da06-4ff2-a866-5b53e0bca655 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Image limits 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 15:23:52 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-04479af1-da06-4ff2-a866-5b53e0bca655 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Flavor pref 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 15:23:52 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-04479af1-da06-4ff2-a866-5b53e0bca655 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Image pref 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 15:23:52 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-04479af1-da06-4ff2-a866-5b53e0bca655 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 15:23:52 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-04479af1-da06-4ff2-a866-5b53e0bca655 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 15:23:52 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-04479af1-da06-4ff2-a866-5b53e0bca655 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72382) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 15:23:52 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-04479af1-da06-4ff2-a866-5b53e0bca655 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Got 1 possible topologies {{(pid=72382) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 15:23:52 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-04479af1-da06-4ff2-a866-5b53e0bca655 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 15:23:52 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-04479af1-da06-4ff2-a866-5b53e0bca655 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 15:23:52 user nova-compute[72382]: DEBUG nova.virt.libvirt.vif [None req-04479af1-da06-4ff2-a866-5b53e0bca655 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T15:23:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-581682554',display_name='tempest-AttachVolumeNegativeTest-server-581682554',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-581682554',id=23,image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCqzpgLe26+CO+iEWWZ6fk6b+sUSRBvrenyu9mxDg1V0hePyoVSSYOmkUervplRS05uiKk4LEhF0Jcm/wYq10j0UUXVE/okdH6n9YbPdapLvC1RbEJslOhj1iAjy+5zzFw==',key_name='tempest-keypair-278200558',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='98009994d9c74eb9b4fc6321e82440de',ramdisk_id='',reservation_id='r-s488sgc7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1325594356',owner_user_name='tempest-AttachVolumeNegativeTest-1325594356-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T15:23:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='401c9df41f284c88a86557485d7d9537',uuid=61976531-76ae-4a1c-8950-0af784be376e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "adf7f33a-6792-47f7-b8e6-4d0775b01f9d", "address": "fa:16:3e:d5:b3:b9", "network": {"id": "46eb5f03-e04d-43d1-96d6-0792bc7a94b1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1842512309-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98009994d9c74eb9b4fc6321e82440de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadf7f33a-67", "ovs_interfaceid": "adf7f33a-6792-47f7-b8e6-4d0775b01f9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72382) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 15:23:52 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-04479af1-da06-4ff2-a866-5b53e0bca655 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Converting VIF {"id": "adf7f33a-6792-47f7-b8e6-4d0775b01f9d", "address": "fa:16:3e:d5:b3:b9", "network": {"id": "46eb5f03-e04d-43d1-96d6-0792bc7a94b1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1842512309-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98009994d9c74eb9b4fc6321e82440de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadf7f33a-67", "ovs_interfaceid": "adf7f33a-6792-47f7-b8e6-4d0775b01f9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 15:23:52 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-04479af1-da06-4ff2-a866-5b53e0bca655 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:b3:b9,bridge_name='br-int',has_traffic_filtering=True,id=adf7f33a-6792-47f7-b8e6-4d0775b01f9d,network=Network(46eb5f03-e04d-43d1-96d6-0792bc7a94b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapadf7f33a-67') {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 15:23:52 user nova-compute[72382]: DEBUG nova.objects.instance [None req-04479af1-da06-4ff2-a866-5b53e0bca655 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Lazy-loading 'pci_devices' on Instance uuid 61976531-76ae-4a1c-8950-0af784be376e {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:23:52 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-04479af1-da06-4ff2-a866-5b53e0bca655 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] [instance: 61976531-76ae-4a1c-8950-0af784be376e] End _get_guest_xml xml=<domain type="kvm">
Aug 09 15:23:52 user nova-compute[72382]:   <uuid>61976531-76ae-4a1c-8950-0af784be376e</uuid>
Aug 09 15:23:52 user nova-compute[72382]:   <name>instance-00000017</name>
Aug 09 15:23:52 user nova-compute[72382]:   <memory>524288</memory>
Aug 09 15:23:52 user nova-compute[72382]:   <vcpu>1</vcpu>
Aug 09 15:23:52 user nova-compute[72382]:   <metadata>
Aug 09 15:23:52 user nova-compute[72382]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 15:23:52 user nova-compute[72382]:       <nova:package version="0.0.0"/>
Aug 09 15:23:52 user nova-compute[72382]:       <nova:name>tempest-AttachVolumeNegativeTest-server-581682554</nova:name>
Aug 09 15:23:52 user nova-compute[72382]:       <nova:creationTime>2023-08-09 15:23:52</nova:creationTime>
Aug 09 15:23:52 user nova-compute[72382]:       <nova:flavor name="m1.tiny">
Aug 09 15:23:52 user nova-compute[72382]:         <nova:memory>512</nova:memory>
Aug 09 15:23:52 user nova-compute[72382]:         <nova:disk>1</nova:disk>
Aug 09 15:23:52 user nova-compute[72382]:         <nova:swap>0</nova:swap>
Aug 09 15:23:52 user nova-compute[72382]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 15:23:52 user nova-compute[72382]:         <nova:vcpus>1</nova:vcpus>
Aug 09 15:23:52 user nova-compute[72382]:       </nova:flavor>
Aug 09 15:23:52 user nova-compute[72382]:       <nova:owner>
Aug 09 15:23:52 user nova-compute[72382]:         <nova:user uuid="401c9df41f284c88a86557485d7d9537">tempest-AttachVolumeNegativeTest-1325594356-project-member</nova:user>
Aug 09 15:23:52 user nova-compute[72382]:         <nova:project uuid="98009994d9c74eb9b4fc6321e82440de">tempest-AttachVolumeNegativeTest-1325594356</nova:project>
Aug 09 15:23:52 user nova-compute[72382]:       </nova:owner>
Aug 09 15:23:52 user nova-compute[72382]:       <nova:root type="image" uuid="a79f2cea-eb27-4631-aaf3-05e7d9e411b4"/>
Aug 09 15:23:52 user nova-compute[72382]:       <nova:ports>
Aug 09 15:23:52 user nova-compute[72382]:         <nova:port uuid="adf7f33a-6792-47f7-b8e6-4d0775b01f9d">
Aug 09 15:23:52 user nova-compute[72382]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 09 15:23:52 user nova-compute[72382]:         </nova:port>
Aug 09 15:23:52 user nova-compute[72382]:       </nova:ports>
Aug 09 15:23:52 user nova-compute[72382]:     </nova:instance>
Aug 09 15:23:52 user nova-compute[72382]:   </metadata>
Aug 09 15:23:52 user nova-compute[72382]:   <sysinfo type="smbios">
Aug 09 15:23:52 user nova-compute[72382]:     <system>
Aug 09 15:23:52 user nova-compute[72382]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 15:23:52 user nova-compute[72382]:       <entry name="product">OpenStack Nova</entry>
Aug 09 15:23:52 user nova-compute[72382]:       <entry name="version">0.0.0</entry>
Aug 09 15:23:52 user nova-compute[72382]:       <entry name="serial">61976531-76ae-4a1c-8950-0af784be376e</entry>
Aug 09 15:23:52 user nova-compute[72382]:       <entry name="uuid">61976531-76ae-4a1c-8950-0af784be376e</entry>
Aug 09 15:23:52 user nova-compute[72382]:       <entry name="family">Virtual Machine</entry>
Aug 09 15:23:52 user nova-compute[72382]:     </system>
Aug 09 15:23:52 user nova-compute[72382]:   </sysinfo>
Aug 09 15:23:52 user nova-compute[72382]:   <os>
Aug 09 15:23:52 user nova-compute[72382]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 15:23:52 user nova-compute[72382]:     <boot dev="hd"/>
Aug 09 15:23:52 user nova-compute[72382]:     <smbios mode="sysinfo"/>
Aug 09 15:23:52 user nova-compute[72382]:   </os>
Aug 09 15:23:52 user nova-compute[72382]:   <features>
Aug 09 15:23:52 user nova-compute[72382]:     <acpi/>
Aug 09 15:23:52 user nova-compute[72382]:     <apic/>
Aug 09 15:23:52 user nova-compute[72382]:     <vmcoreinfo/>
Aug 09 15:23:52 user nova-compute[72382]:   </features>
Aug 09 15:23:52 user nova-compute[72382]:   <clock offset="utc">
Aug 09 15:23:52 user nova-compute[72382]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 15:23:52 user nova-compute[72382]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 15:23:52 user nova-compute[72382]:     <timer name="hpet" present="no"/>
Aug 09 15:23:52 user nova-compute[72382]:   </clock>
Aug 09 15:23:52 user nova-compute[72382]:   <cpu mode="custom" match="exact">
Aug 09 15:23:52 user nova-compute[72382]:     <model>Nehalem</model>
Aug 09 15:23:52 user nova-compute[72382]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 15:23:52 user nova-compute[72382]:   </cpu>
Aug 09 15:23:52 user nova-compute[72382]:   <devices>
Aug 09 15:23:52 user nova-compute[72382]:     <disk type="file" device="disk">
Aug 09 15:23:52 user nova-compute[72382]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 15:23:52 user nova-compute[72382]:       <source file="/opt/stack/data/nova/instances/61976531-76ae-4a1c-8950-0af784be376e/disk"/>
Aug 09 15:23:52 user nova-compute[72382]:       <target dev="vda" bus="virtio"/>
Aug 09 15:23:52 user nova-compute[72382]:     </disk>
Aug 09 15:23:52 user nova-compute[72382]:     <interface type="ethernet">
Aug 09 15:23:52 user nova-compute[72382]:       <mac address="fa:16:3e:d5:b3:b9"/>
Aug 09 15:23:52 user nova-compute[72382]:       <model type="virtio"/>
Aug 09 15:23:52 user nova-compute[72382]:       <mtu size="1442"/>
Aug 09 15:23:52 user nova-compute[72382]:       <target dev="tapadf7f33a-67"/>
Aug 09 15:23:52 user nova-compute[72382]:     </interface>
Aug 09 15:23:52 user nova-compute[72382]:     <serial type="pty">
Aug 09 15:23:52 user nova-compute[72382]:       <log file="/opt/stack/data/nova/instances/61976531-76ae-4a1c-8950-0af784be376e/console.log" append="off"/>
Aug 09 15:23:52 user nova-compute[72382]:     </serial>
Aug 09 15:23:52 user nova-compute[72382]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 15:23:52 user nova-compute[72382]:     <video>
Aug 09 15:23:52 user nova-compute[72382]:       <model type="virtio"/>
Aug 09 15:23:52 user nova-compute[72382]:     </video>
Aug 09 15:23:52 user nova-compute[72382]:     <rng model="virtio">
Aug 09 15:23:52 user nova-compute[72382]:       <backend model="random">/dev/urandom</backend>
Aug 09 15:23:52 user nova-compute[72382]:     </rng>
Aug 09 15:23:52 user nova-compute[72382]:     <controller type="usb" index="0" model="none"/>
Aug 09 15:23:52 user nova-compute[72382]:     <memballoon model="virtio">
Aug 09 15:23:52 user nova-compute[72382]:       <stats period="10"/>
Aug 09 15:23:52 user nova-compute[72382]:     </memballoon>
Aug 09 15:23:52 user nova-compute[72382]:   </devices>
Aug 09 15:23:52 user nova-compute[72382]: </domain>
Aug 09 15:23:52 user nova-compute[72382]:  {{(pid=72382) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 15:23:52 user nova-compute[72382]: DEBUG nova.virt.libvirt.vif [None req-04479af1-da06-4ff2-a866-5b53e0bca655 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T15:23:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-581682554',display_name='tempest-AttachVolumeNegativeTest-server-581682554',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-581682554',id=23,image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCqzpgLe26+CO+iEWWZ6fk6b+sUSRBvrenyu9mxDg1V0hePyoVSSYOmkUervplRS05uiKk4LEhF0Jcm/wYq10j0UUXVE/okdH6n9YbPdapLvC1RbEJslOhj1iAjy+5zzFw==',key_name='tempest-keypair-278200558',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='98009994d9c74eb9b4fc6321e82440de',ramdisk_id='',reservation_id='r-s488sgc7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1325594356',owner_user_name='tempest-AttachVolumeNegativeTest-1325594356-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T15:23:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='401c9df41f284c88a86557485d7d9537',uuid=61976531-76ae-4a1c-8950-0af784be376e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "adf7f33a-6792-47f7-b8e6-4d0775b01f9d", "address": "fa:16:3e:d5:b3:b9", "network": {"id": "46eb5f03-e04d-43d1-96d6-0792bc7a94b1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1842512309-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98009994d9c74eb9b4fc6321e82440de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadf7f33a-67", "ovs_interfaceid": "adf7f33a-6792-47f7-b8e6-4d0775b01f9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 15:23:52 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-04479af1-da06-4ff2-a866-5b53e0bca655 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Converting VIF {"id": "adf7f33a-6792-47f7-b8e6-4d0775b01f9d", "address": "fa:16:3e:d5:b3:b9", "network": {"id": "46eb5f03-e04d-43d1-96d6-0792bc7a94b1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1842512309-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98009994d9c74eb9b4fc6321e82440de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadf7f33a-67", "ovs_interfaceid": "adf7f33a-6792-47f7-b8e6-4d0775b01f9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 15:23:52 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-04479af1-da06-4ff2-a866-5b53e0bca655 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:b3:b9,bridge_name='br-int',has_traffic_filtering=True,id=adf7f33a-6792-47f7-b8e6-4d0775b01f9d,network=Network(46eb5f03-e04d-43d1-96d6-0792bc7a94b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapadf7f33a-67') {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 15:23:52 user nova-compute[72382]: DEBUG os_vif [None req-04479af1-da06-4ff2-a866-5b53e0bca655 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:b3:b9,bridge_name='br-int',has_traffic_filtering=True,id=adf7f33a-6792-47f7-b8e6-4d0775b01f9d,network=Network(46eb5f03-e04d-43d1-96d6-0792bc7a94b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapadf7f33a-67') {{(pid=72382) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 15:23:52 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:23:52 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:23:52 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 15:23:52 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:23:52 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapadf7f33a-67, may_exist=True, interface_attrs={}) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:23:52 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapadf7f33a-67, col_values=(('external_ids', {'iface-id': 'adf7f33a-6792-47f7-b8e6-4d0775b01f9d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d5:b3:b9', 'vm-uuid': '61976531-76ae-4a1c-8950-0af784be376e'}),), if_exists=True) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:23:52 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:23:52 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:23:52 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:23:52 user nova-compute[72382]: INFO os_vif [None req-04479af1-da06-4ff2-a866-5b53e0bca655 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:b3:b9,bridge_name='br-int',has_traffic_filtering=True,id=adf7f33a-6792-47f7-b8e6-4d0775b01f9d,network=Network(46eb5f03-e04d-43d1-96d6-0792bc7a94b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapadf7f33a-67')
Aug 09 15:23:52 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-7c0d0260-2376-46a5-942e-36d4a40f42bf tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Acquiring lock "e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:23:52 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-7c0d0260-2376-46a5-942e-36d4a40f42bf tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Lock "e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:23:52 user nova-compute[72382]: DEBUG nova.compute.manager [None req-7c0d0260-2376-46a5-942e-36d4a40f42bf tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] [instance: e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0] Starting instance... {{(pid=72382) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 15:23:52 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-04479af1-da06-4ff2-a866-5b53e0bca655 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] No BDM found with device name vda, not building metadata. {{(pid=72382) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 15:23:52 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-04479af1-da06-4ff2-a866-5b53e0bca655 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] No VIF found with MAC fa:16:3e:d5:b3:b9, not building metadata {{(pid=72382) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 15:23:52 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-7c0d0260-2376-46a5-942e-36d4a40f42bf tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:23:52 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-7c0d0260-2376-46a5-942e-36d4a40f42bf tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:23:52 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-7c0d0260-2376-46a5-942e-36d4a40f42bf tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72382) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 15:23:52 user nova-compute[72382]: INFO nova.compute.claims [None req-7c0d0260-2376-46a5-942e-36d4a40f42bf tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] [instance: e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0] Claim successful on node user
Aug 09 15:23:53 user nova-compute[72382]: DEBUG nova.network.neutron [req-7017b4dc-2a93-4fff-b20a-63d06f462074 req-1e183fe8-3380-4bd6-9c3c-a2d4128a5d02 service nova] [instance: 61976531-76ae-4a1c-8950-0af784be376e] Updated VIF entry in instance network info cache for port adf7f33a-6792-47f7-b8e6-4d0775b01f9d. {{(pid=72382) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 15:23:53 user nova-compute[72382]: DEBUG nova.network.neutron [req-7017b4dc-2a93-4fff-b20a-63d06f462074 req-1e183fe8-3380-4bd6-9c3c-a2d4128a5d02 service nova] [instance: 61976531-76ae-4a1c-8950-0af784be376e] Updating instance_info_cache with network_info: [{"id": "adf7f33a-6792-47f7-b8e6-4d0775b01f9d", "address": "fa:16:3e:d5:b3:b9", "network": {"id": "46eb5f03-e04d-43d1-96d6-0792bc7a94b1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1842512309-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98009994d9c74eb9b4fc6321e82440de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadf7f33a-67", "ovs_interfaceid": "adf7f33a-6792-47f7-b8e6-4d0775b01f9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:23:53 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-7017b4dc-2a93-4fff-b20a-63d06f462074 req-1e183fe8-3380-4bd6-9c3c-a2d4128a5d02 service nova] Releasing lock "refresh_cache-61976531-76ae-4a1c-8950-0af784be376e" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 15:23:53 user nova-compute[72382]: DEBUG nova.compute.provider_tree [None req-7c0d0260-2376-46a5-942e-36d4a40f42bf tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Inventory has not changed in ProviderTree for provider: 7b15b0e5-df4d-49db-833b-2855d21d10ae {{(pid=72382) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 15:23:53 user nova-compute[72382]: DEBUG nova.scheduler.client.report [None req-7c0d0260-2376-46a5-942e-36d4a40f42bf tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Inventory has not changed for provider 7b15b0e5-df4d-49db-833b-2855d21d10ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72382) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 15:23:53 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-7c0d0260-2376-46a5-942e-36d4a40f42bf tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.637s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:23:53 user nova-compute[72382]: DEBUG nova.compute.manager [None req-7c0d0260-2376-46a5-942e-36d4a40f42bf tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] [instance: e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0] Start building networks asynchronously for instance. {{(pid=72382) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 15:23:53 user nova-compute[72382]: DEBUG nova.compute.manager [None req-7c0d0260-2376-46a5-942e-36d4a40f42bf tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] [instance: e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0] Allocating IP information in the background. {{(pid=72382) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 15:23:53 user nova-compute[72382]: DEBUG nova.network.neutron [None req-7c0d0260-2376-46a5-942e-36d4a40f42bf tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] [instance: e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0] allocate_for_instance() {{(pid=72382) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 15:23:53 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-7c0d0260-2376-46a5-942e-36d4a40f42bf tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] [instance: e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 15:23:53 user nova-compute[72382]: DEBUG nova.compute.manager [None req-7c0d0260-2376-46a5-942e-36d4a40f42bf tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] [instance: e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0] Start building block device mappings for instance. {{(pid=72382) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 15:23:53 user nova-compute[72382]: DEBUG nova.policy [None req-7c0d0260-2376-46a5-942e-36d4a40f42bf tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f94ca386a2be42cfbc2407bb7520cd25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990ba791030940d38360af5879c853c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72382) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 15:23:53 user nova-compute[72382]: DEBUG nova.compute.manager [None req-7c0d0260-2376-46a5-942e-36d4a40f42bf tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] [instance: e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0] Start spawning the instance on the hypervisor. {{(pid=72382) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 15:23:53 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-7c0d0260-2376-46a5-942e-36d4a40f42bf tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] [instance: e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0] Creating instance directory {{(pid=72382) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 15:23:53 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-7c0d0260-2376-46a5-942e-36d4a40f42bf tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] [instance: e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0] Creating image(s)
Aug 09 15:23:53 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-7c0d0260-2376-46a5-942e-36d4a40f42bf tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Acquiring lock "/opt/stack/data/nova/instances/e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:23:53 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-7c0d0260-2376-46a5-942e-36d4a40f42bf tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Lock "/opt/stack/data/nova/instances/e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:23:53 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-7c0d0260-2376-46a5-942e-36d4a40f42bf tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Lock "/opt/stack/data/nova/instances/e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:23:53 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-7c0d0260-2376-46a5-942e-36d4a40f42bf tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:23:53 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-7c0d0260-2376-46a5-942e-36d4a40f42bf tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b --force-share --output=json" returned: 0 in 0.150s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:23:53 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-7c0d0260-2376-46a5-942e-36d4a40f42bf tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Acquiring lock "383812ff437283e0191ed5b9ecc04c27f1162b0b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:23:53 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-7c0d0260-2376-46a5-942e-36d4a40f42bf tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Lock "383812ff437283e0191ed5b9ecc04c27f1162b0b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:23:53 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-7c0d0260-2376-46a5-942e-36d4a40f42bf tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:23:54 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-7c0d0260-2376-46a5-942e-36d4a40f42bf tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b --force-share --output=json" returned: 0 in 0.158s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:23:54 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-7c0d0260-2376-46a5-942e-36d4a40f42bf tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b,backing_fmt=raw /opt/stack/data/nova/instances/e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0/disk 1073741824 {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:23:54 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:23:54 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-7c0d0260-2376-46a5-942e-36d4a40f42bf tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b,backing_fmt=raw /opt/stack/data/nova/instances/e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0/disk 1073741824" returned: 0 in 0.060s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:23:54 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-7c0d0260-2376-46a5-942e-36d4a40f42bf tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Lock "383812ff437283e0191ed5b9ecc04c27f1162b0b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.226s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:23:54 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-7c0d0260-2376-46a5-942e-36d4a40f42bf tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:23:54 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-7c0d0260-2376-46a5-942e-36d4a40f42bf tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b --force-share --output=json" returned: 0 in 0.138s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:23:54 user nova-compute[72382]: DEBUG nova.virt.disk.api [None req-7c0d0260-2376-46a5-942e-36d4a40f42bf tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0/disk. size=1073741824 {{(pid=72382) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 15:23:54 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-7c0d0260-2376-46a5-942e-36d4a40f42bf tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:23:54 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:23:54 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-7c0d0260-2376-46a5-942e-36d4a40f42bf tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:23:54 user nova-compute[72382]: DEBUG nova.virt.disk.api [None req-7c0d0260-2376-46a5-942e-36d4a40f42bf tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Cannot resize image /opt/stack/data/nova/instances/e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0/disk to a smaller size. {{(pid=72382) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 15:23:54 user nova-compute[72382]: DEBUG nova.objects.instance [None req-7c0d0260-2376-46a5-942e-36d4a40f42bf tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Lazy-loading 'migration_context' on Instance uuid e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0 {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:23:54 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-7c0d0260-2376-46a5-942e-36d4a40f42bf tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] [instance: e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0] Created local disks {{(pid=72382) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 15:23:54 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-7c0d0260-2376-46a5-942e-36d4a40f42bf tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] [instance: e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0] Ensure instance console log exists: /opt/stack/data/nova/instances/e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0/console.log {{(pid=72382) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 15:23:54 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-7c0d0260-2376-46a5-942e-36d4a40f42bf tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:23:54 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-7c0d0260-2376-46a5-942e-36d4a40f42bf tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:23:54 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-7c0d0260-2376-46a5-942e-36d4a40f42bf tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:23:54 user nova-compute[72382]: DEBUG nova.compute.manager [req-4593eb1c-c6df-4df2-b617-4b48ce028c9f req-dc095551-4899-4a73-bcc6-accf26256e7a service nova] [instance: 61976531-76ae-4a1c-8950-0af784be376e] Received event network-vif-plugged-adf7f33a-6792-47f7-b8e6-4d0775b01f9d {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:23:54 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-4593eb1c-c6df-4df2-b617-4b48ce028c9f req-dc095551-4899-4a73-bcc6-accf26256e7a service nova] Acquiring lock "61976531-76ae-4a1c-8950-0af784be376e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:23:54 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-4593eb1c-c6df-4df2-b617-4b48ce028c9f req-dc095551-4899-4a73-bcc6-accf26256e7a service nova] Lock "61976531-76ae-4a1c-8950-0af784be376e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:23:54 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-4593eb1c-c6df-4df2-b617-4b48ce028c9f req-dc095551-4899-4a73-bcc6-accf26256e7a service nova] Lock "61976531-76ae-4a1c-8950-0af784be376e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:23:54 user nova-compute[72382]: DEBUG nova.compute.manager [req-4593eb1c-c6df-4df2-b617-4b48ce028c9f req-dc095551-4899-4a73-bcc6-accf26256e7a service nova] [instance: 61976531-76ae-4a1c-8950-0af784be376e] No waiting events found dispatching network-vif-plugged-adf7f33a-6792-47f7-b8e6-4d0775b01f9d {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:23:54 user nova-compute[72382]: WARNING nova.compute.manager [req-4593eb1c-c6df-4df2-b617-4b48ce028c9f req-dc095551-4899-4a73-bcc6-accf26256e7a service nova] [instance: 61976531-76ae-4a1c-8950-0af784be376e] Received unexpected event network-vif-plugged-adf7f33a-6792-47f7-b8e6-4d0775b01f9d for instance with vm_state building and task_state spawning.
Aug 09 15:23:54 user nova-compute[72382]: DEBUG nova.network.neutron [None req-7c0d0260-2376-46a5-942e-36d4a40f42bf tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] [instance: e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0] Successfully created port: 9513dc1d-79d5-482b-baaa-81f525e99de7 {{(pid=72382) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 15:23:55 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:23:55 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:23:55 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:23:55 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:23:55 user nova-compute[72382]: DEBUG nova.network.neutron [None req-7c0d0260-2376-46a5-942e-36d4a40f42bf tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] [instance: e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0] Successfully updated port: 9513dc1d-79d5-482b-baaa-81f525e99de7 {{(pid=72382) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 15:23:55 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-7c0d0260-2376-46a5-942e-36d4a40f42bf tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Acquiring lock "refresh_cache-e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 15:23:55 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-7c0d0260-2376-46a5-942e-36d4a40f42bf tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Acquired lock "refresh_cache-e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 15:23:55 user nova-compute[72382]: DEBUG nova.network.neutron [None req-7c0d0260-2376-46a5-942e-36d4a40f42bf tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] [instance: e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0] Building network info cache for instance {{(pid=72382) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 15:23:56 user nova-compute[72382]: DEBUG nova.network.neutron [None req-7c0d0260-2376-46a5-942e-36d4a40f42bf tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] [instance: e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0] Instance cache missing network info. {{(pid=72382) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 15:23:56 user nova-compute[72382]: DEBUG nova.network.neutron [None req-7c0d0260-2376-46a5-942e-36d4a40f42bf tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] [instance: e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0] Updating instance_info_cache with network_info: [{"id": "9513dc1d-79d5-482b-baaa-81f525e99de7", "address": "fa:16:3e:6f:6b:41", "network": {"id": "46ef00c7-17ee-4e45-ba1d-dcc0a417ea85", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1360012261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "990ba791030940d38360af5879c853c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9513dc1d-79", "ovs_interfaceid": "9513dc1d-79d5-482b-baaa-81f525e99de7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:23:56 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-7c0d0260-2376-46a5-942e-36d4a40f42bf tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Releasing lock "refresh_cache-e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 15:23:56 user nova-compute[72382]: DEBUG nova.compute.manager [None req-7c0d0260-2376-46a5-942e-36d4a40f42bf tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] [instance: e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0] Instance network_info: |[{"id": "9513dc1d-79d5-482b-baaa-81f525e99de7", "address": "fa:16:3e:6f:6b:41", "network": {"id": "46ef00c7-17ee-4e45-ba1d-dcc0a417ea85", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1360012261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "990ba791030940d38360af5879c853c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9513dc1d-79", "ovs_interfaceid": "9513dc1d-79d5-482b-baaa-81f525e99de7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72382) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 15:23:56 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-7c0d0260-2376-46a5-942e-36d4a40f42bf tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] [instance: e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0] Start _get_guest_xml network_info=[{"id": "9513dc1d-79d5-482b-baaa-81f525e99de7", "address": "fa:16:3e:6f:6b:41", "network": {"id": "46ef00c7-17ee-4e45-ba1d-dcc0a417ea85", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1360012261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "990ba791030940d38360af5879c853c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9513dc1d-79", "ovs_interfaceid": "9513dc1d-79d5-482b-baaa-81f525e99de7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T15:11:25Z,direct_url=<?>,disk_format='qcow2',id=a79f2cea-eb27-4631-aaf3-05e7d9e411b4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a638990e12cc4d6eabb6d55e13be6bdf',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T15:11:27Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'a79f2cea-eb27-4631-aaf3-05e7d9e411b4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72382) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 15:23:56 user nova-compute[72382]: WARNING nova.virt.libvirt.driver [None req-7c0d0260-2376-46a5-942e-36d4a40f42bf tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 15:23:56 user nova-compute[72382]: WARNING nova.virt.libvirt.driver [None req-7c0d0260-2376-46a5-942e-36d4a40f42bf tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 15:23:56 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-7c0d0260-2376-46a5-942e-36d4a40f42bf tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72382) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 15:23:56 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-7c0d0260-2376-46a5-942e-36d4a40f42bf tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] CPU controller missing on host. {{(pid=72382) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 15:23:56 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-7c0d0260-2376-46a5-942e-36d4a40f42bf tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72382) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 15:23:56 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-7c0d0260-2376-46a5-942e-36d4a40f42bf tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] CPU controller found on host. {{(pid=72382) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 15:23:56 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-7c0d0260-2376-46a5-942e-36d4a40f42bf tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72382) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 15:23:56 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-7c0d0260-2376-46a5-942e-36d4a40f42bf tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T15:11:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T15:11:25Z,direct_url=<?>,disk_format='qcow2',id=a79f2cea-eb27-4631-aaf3-05e7d9e411b4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a638990e12cc4d6eabb6d55e13be6bdf',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T15:11:27Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 15:23:56 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-7c0d0260-2376-46a5-942e-36d4a40f42bf tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Flavor limits 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 15:23:56 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-7c0d0260-2376-46a5-942e-36d4a40f42bf tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Image limits 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 15:23:56 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-7c0d0260-2376-46a5-942e-36d4a40f42bf tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Flavor pref 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 15:23:56 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-7c0d0260-2376-46a5-942e-36d4a40f42bf tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Image pref 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 15:23:56 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-7c0d0260-2376-46a5-942e-36d4a40f42bf tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 15:23:56 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-7c0d0260-2376-46a5-942e-36d4a40f42bf tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 15:23:56 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-7c0d0260-2376-46a5-942e-36d4a40f42bf tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72382) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 15:23:56 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-7c0d0260-2376-46a5-942e-36d4a40f42bf tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Got 1 possible topologies {{(pid=72382) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 15:23:56 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-7c0d0260-2376-46a5-942e-36d4a40f42bf tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 15:23:56 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-7c0d0260-2376-46a5-942e-36d4a40f42bf tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 15:23:56 user nova-compute[72382]: DEBUG nova.virt.libvirt.vif [None req-7c0d0260-2376-46a5-942e-36d4a40f42bf tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T15:23:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-254167293',display_name='tempest-ServerRescueNegativeTestJSON-server-254167293',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-254167293',id=24,image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAaMCyNBQb3ylRgcQrIdw3Y84mRNrknOzJTzHyXWYqKGNSX5MBMhw93vJCCFehVKV4spG2iiG6YuL+cWRa1bzzVUXWVZYbOxKXYJ/onpVtDMdN4JhVqCK0JO3eF4bmbVSg==',key_name='tempest-keypair-1084909994',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='990ba791030940d38360af5879c853c5',ramdisk_id='',reservation_id='r-tk8hunpk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-867522113',owner_user_name='tempest-ServerRescueNegativeTestJSON-867522113-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T15:23:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f94ca386a2be42cfbc2407bb7520cd25',uuid=e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9513dc1d-79d5-482b-baaa-81f525e99de7", "address": "fa:16:3e:6f:6b:41", "network": {"id": "46ef00c7-17ee-4e45-ba1d-dcc0a417ea85", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1360012261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "990ba791030940d38360af5879c853c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9513dc1d-79", "ovs_interfaceid": "9513dc1d-79d5-482b-baaa-81f525e99de7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72382) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 15:23:56 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-7c0d0260-2376-46a5-942e-36d4a40f42bf tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Converting VIF {"id": "9513dc1d-79d5-482b-baaa-81f525e99de7", "address": "fa:16:3e:6f:6b:41", "network": {"id": "46ef00c7-17ee-4e45-ba1d-dcc0a417ea85", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1360012261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "990ba791030940d38360af5879c853c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9513dc1d-79", "ovs_interfaceid": "9513dc1d-79d5-482b-baaa-81f525e99de7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 15:23:56 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-7c0d0260-2376-46a5-942e-36d4a40f42bf tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6f:6b:41,bridge_name='br-int',has_traffic_filtering=True,id=9513dc1d-79d5-482b-baaa-81f525e99de7,network=Network(46ef00c7-17ee-4e45-ba1d-dcc0a417ea85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9513dc1d-79') {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 15:23:56 user nova-compute[72382]: DEBUG nova.objects.instance [None req-7c0d0260-2376-46a5-942e-36d4a40f42bf tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Lazy-loading 'pci_devices' on Instance uuid e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0 {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:23:56 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-7c0d0260-2376-46a5-942e-36d4a40f42bf tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] [instance: e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0] End _get_guest_xml xml=<domain type="kvm">
Aug 09 15:23:56 user nova-compute[72382]:   <uuid>e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0</uuid>
Aug 09 15:23:56 user nova-compute[72382]:   <name>instance-00000018</name>
Aug 09 15:23:56 user nova-compute[72382]:   <memory>524288</memory>
Aug 09 15:23:56 user nova-compute[72382]:   <vcpu>1</vcpu>
Aug 09 15:23:56 user nova-compute[72382]:   <metadata>
Aug 09 15:23:56 user nova-compute[72382]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 15:23:56 user nova-compute[72382]:       <nova:package version="0.0.0"/>
Aug 09 15:23:56 user nova-compute[72382]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-254167293</nova:name>
Aug 09 15:23:56 user nova-compute[72382]:       <nova:creationTime>2023-08-09 15:23:56</nova:creationTime>
Aug 09 15:23:56 user nova-compute[72382]:       <nova:flavor name="m1.tiny">
Aug 09 15:23:56 user nova-compute[72382]:         <nova:memory>512</nova:memory>
Aug 09 15:23:56 user nova-compute[72382]:         <nova:disk>1</nova:disk>
Aug 09 15:23:56 user nova-compute[72382]:         <nova:swap>0</nova:swap>
Aug 09 15:23:56 user nova-compute[72382]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 15:23:56 user nova-compute[72382]:         <nova:vcpus>1</nova:vcpus>
Aug 09 15:23:56 user nova-compute[72382]:       </nova:flavor>
Aug 09 15:23:56 user nova-compute[72382]:       <nova:owner>
Aug 09 15:23:56 user nova-compute[72382]:         <nova:user uuid="f94ca386a2be42cfbc2407bb7520cd25">tempest-ServerRescueNegativeTestJSON-867522113-project-member</nova:user>
Aug 09 15:23:56 user nova-compute[72382]:         <nova:project uuid="990ba791030940d38360af5879c853c5">tempest-ServerRescueNegativeTestJSON-867522113</nova:project>
Aug 09 15:23:56 user nova-compute[72382]:       </nova:owner>
Aug 09 15:23:56 user nova-compute[72382]:       <nova:root type="image" uuid="a79f2cea-eb27-4631-aaf3-05e7d9e411b4"/>
Aug 09 15:23:56 user nova-compute[72382]:       <nova:ports>
Aug 09 15:23:56 user nova-compute[72382]:         <nova:port uuid="9513dc1d-79d5-482b-baaa-81f525e99de7">
Aug 09 15:23:56 user nova-compute[72382]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 09 15:23:56 user nova-compute[72382]:         </nova:port>
Aug 09 15:23:56 user nova-compute[72382]:       </nova:ports>
Aug 09 15:23:56 user nova-compute[72382]:     </nova:instance>
Aug 09 15:23:56 user nova-compute[72382]:   </metadata>
Aug 09 15:23:56 user nova-compute[72382]:   <sysinfo type="smbios">
Aug 09 15:23:56 user nova-compute[72382]:     <system>
Aug 09 15:23:56 user nova-compute[72382]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 15:23:56 user nova-compute[72382]:       <entry name="product">OpenStack Nova</entry>
Aug 09 15:23:56 user nova-compute[72382]:       <entry name="version">0.0.0</entry>
Aug 09 15:23:56 user nova-compute[72382]:       <entry name="serial">e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0</entry>
Aug 09 15:23:56 user nova-compute[72382]:       <entry name="uuid">e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0</entry>
Aug 09 15:23:56 user nova-compute[72382]:       <entry name="family">Virtual Machine</entry>
Aug 09 15:23:56 user nova-compute[72382]:     </system>
Aug 09 15:23:56 user nova-compute[72382]:   </sysinfo>
Aug 09 15:23:56 user nova-compute[72382]:   <os>
Aug 09 15:23:56 user nova-compute[72382]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 15:23:56 user nova-compute[72382]:     <boot dev="hd"/>
Aug 09 15:23:56 user nova-compute[72382]:     <smbios mode="sysinfo"/>
Aug 09 15:23:56 user nova-compute[72382]:   </os>
Aug 09 15:23:56 user nova-compute[72382]:   <features>
Aug 09 15:23:56 user nova-compute[72382]:     <acpi/>
Aug 09 15:23:56 user nova-compute[72382]:     <apic/>
Aug 09 15:23:56 user nova-compute[72382]:     <vmcoreinfo/>
Aug 09 15:23:56 user nova-compute[72382]:   </features>
Aug 09 15:23:56 user nova-compute[72382]:   <clock offset="utc">
Aug 09 15:23:56 user nova-compute[72382]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 15:23:56 user nova-compute[72382]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 15:23:56 user nova-compute[72382]:     <timer name="hpet" present="no"/>
Aug 09 15:23:56 user nova-compute[72382]:   </clock>
Aug 09 15:23:56 user nova-compute[72382]:   <cpu mode="custom" match="exact">
Aug 09 15:23:56 user nova-compute[72382]:     <model>Nehalem</model>
Aug 09 15:23:56 user nova-compute[72382]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 15:23:56 user nova-compute[72382]:   </cpu>
Aug 09 15:23:56 user nova-compute[72382]:   <devices>
Aug 09 15:23:56 user nova-compute[72382]:     <disk type="file" device="disk">
Aug 09 15:23:56 user nova-compute[72382]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 15:23:56 user nova-compute[72382]:       <source file="/opt/stack/data/nova/instances/e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0/disk"/>
Aug 09 15:23:56 user nova-compute[72382]:       <target dev="vda" bus="virtio"/>
Aug 09 15:23:56 user nova-compute[72382]:     </disk>
Aug 09 15:23:56 user nova-compute[72382]:     <interface type="ethernet">
Aug 09 15:23:56 user nova-compute[72382]:       <mac address="fa:16:3e:6f:6b:41"/>
Aug 09 15:23:56 user nova-compute[72382]:       <model type="virtio"/>
Aug 09 15:23:56 user nova-compute[72382]:       <mtu size="1442"/>
Aug 09 15:23:56 user nova-compute[72382]:       <target dev="tap9513dc1d-79"/>
Aug 09 15:23:56 user nova-compute[72382]:     </interface>
Aug 09 15:23:56 user nova-compute[72382]:     <serial type="pty">
Aug 09 15:23:56 user nova-compute[72382]:       <log file="/opt/stack/data/nova/instances/e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0/console.log" append="off"/>
Aug 09 15:23:56 user nova-compute[72382]:     </serial>
Aug 09 15:23:56 user nova-compute[72382]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 15:23:56 user nova-compute[72382]:     <video>
Aug 09 15:23:56 user nova-compute[72382]:       <model type="virtio"/>
Aug 09 15:23:56 user nova-compute[72382]:     </video>
Aug 09 15:23:56 user nova-compute[72382]:     <rng model="virtio">
Aug 09 15:23:56 user nova-compute[72382]:       <backend model="random">/dev/urandom</backend>
Aug 09 15:23:56 user nova-compute[72382]:     </rng>
Aug 09 15:23:56 user nova-compute[72382]:     <controller type="usb" index="0" model="none"/>
Aug 09 15:23:56 user nova-compute[72382]:     <memballoon model="virtio">
Aug 09 15:23:56 user nova-compute[72382]:       <stats period="10"/>
Aug 09 15:23:56 user nova-compute[72382]:     </memballoon>
Aug 09 15:23:56 user nova-compute[72382]:   </devices>
Aug 09 15:23:56 user nova-compute[72382]: </domain>
Aug 09 15:23:56 user nova-compute[72382]:  {{(pid=72382) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 15:23:56 user nova-compute[72382]: DEBUG nova.virt.libvirt.vif [None req-7c0d0260-2376-46a5-942e-36d4a40f42bf tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T15:23:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-254167293',display_name='tempest-ServerRescueNegativeTestJSON-server-254167293',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-254167293',id=24,image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAaMCyNBQb3ylRgcQrIdw3Y84mRNrknOzJTzHyXWYqKGNSX5MBMhw93vJCCFehVKV4spG2iiG6YuL+cWRa1bzzVUXWVZYbOxKXYJ/onpVtDMdN4JhVqCK0JO3eF4bmbVSg==',key_name='tempest-keypair-1084909994',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='990ba791030940d38360af5879c853c5',ramdisk_id='',reservation_id='r-tk8hunpk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-867522113',owner_user_name='tempest-ServerRescueNegativeTestJSON-867522113-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T15:23:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f94ca386a2be42cfbc2407bb7520cd25',uuid=e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9513dc1d-79d5-482b-baaa-81f525e99de7", "address": "fa:16:3e:6f:6b:41", "network": {"id": "46ef00c7-17ee-4e45-ba1d-dcc0a417ea85", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1360012261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "990ba791030940d38360af5879c853c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9513dc1d-79", "ovs_interfaceid": "9513dc1d-79d5-482b-baaa-81f525e99de7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 15:23:56 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-7c0d0260-2376-46a5-942e-36d4a40f42bf tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Converting VIF {"id": "9513dc1d-79d5-482b-baaa-81f525e99de7", "address": "fa:16:3e:6f:6b:41", "network": {"id": "46ef00c7-17ee-4e45-ba1d-dcc0a417ea85", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1360012261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "990ba791030940d38360af5879c853c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9513dc1d-79", "ovs_interfaceid": "9513dc1d-79d5-482b-baaa-81f525e99de7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 15:23:56 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-7c0d0260-2376-46a5-942e-36d4a40f42bf tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6f:6b:41,bridge_name='br-int',has_traffic_filtering=True,id=9513dc1d-79d5-482b-baaa-81f525e99de7,network=Network(46ef00c7-17ee-4e45-ba1d-dcc0a417ea85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9513dc1d-79') {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 15:23:56 user nova-compute[72382]: DEBUG os_vif [None req-7c0d0260-2376-46a5-942e-36d4a40f42bf tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6f:6b:41,bridge_name='br-int',has_traffic_filtering=True,id=9513dc1d-79d5-482b-baaa-81f525e99de7,network=Network(46ef00c7-17ee-4e45-ba1d-dcc0a417ea85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9513dc1d-79') {{(pid=72382) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 15:23:56 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:23:56 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:23:56 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 15:23:56 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:23:56 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9513dc1d-79, may_exist=True, interface_attrs={}) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:23:56 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9513dc1d-79, col_values=(('external_ids', {'iface-id': '9513dc1d-79d5-482b-baaa-81f525e99de7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6f:6b:41', 'vm-uuid': 'e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0'}),), if_exists=True) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:23:56 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:23:56 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:23:56 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:23:56 user nova-compute[72382]: INFO os_vif [None req-7c0d0260-2376-46a5-942e-36d4a40f42bf tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6f:6b:41,bridge_name='br-int',has_traffic_filtering=True,id=9513dc1d-79d5-482b-baaa-81f525e99de7,network=Network(46ef00c7-17ee-4e45-ba1d-dcc0a417ea85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9513dc1d-79')
Aug 09 15:23:56 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-7c0d0260-2376-46a5-942e-36d4a40f42bf tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] No BDM found with device name vda, not building metadata. {{(pid=72382) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 15:23:56 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-7c0d0260-2376-46a5-942e-36d4a40f42bf tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] No VIF found with MAC fa:16:3e:6f:6b:41, not building metadata {{(pid=72382) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 15:23:56 user nova-compute[72382]: DEBUG nova.virt.driver [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Emitting event <LifecycleEvent: 1691594636.6934566, 61976531-76ae-4a1c-8950-0af784be376e => Resumed> {{(pid=72382) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 15:23:56 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 61976531-76ae-4a1c-8950-0af784be376e] VM Resumed (Lifecycle Event)
Aug 09 15:23:56 user nova-compute[72382]: DEBUG nova.compute.manager [None req-04479af1-da06-4ff2-a866-5b53e0bca655 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] [instance: 61976531-76ae-4a1c-8950-0af784be376e] Instance event wait completed in 0 seconds for  {{(pid=72382) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 15:23:56 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-04479af1-da06-4ff2-a866-5b53e0bca655 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] [instance: 61976531-76ae-4a1c-8950-0af784be376e] Guest created on hypervisor {{(pid=72382) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 15:23:56 user nova-compute[72382]: INFO nova.virt.libvirt.driver [-] [instance: 61976531-76ae-4a1c-8950-0af784be376e] Instance spawned successfully.
Aug 09 15:23:56 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-04479af1-da06-4ff2-a866-5b53e0bca655 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] [instance: 61976531-76ae-4a1c-8950-0af784be376e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 15:23:56 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 61976531-76ae-4a1c-8950-0af784be376e] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:23:56 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 61976531-76ae-4a1c-8950-0af784be376e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72382) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 15:23:56 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-04479af1-da06-4ff2-a866-5b53e0bca655 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] [instance: 61976531-76ae-4a1c-8950-0af784be376e] Found default for hw_cdrom_bus of ide {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:23:56 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-04479af1-da06-4ff2-a866-5b53e0bca655 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] [instance: 61976531-76ae-4a1c-8950-0af784be376e] Found default for hw_disk_bus of virtio {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:23:56 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-04479af1-da06-4ff2-a866-5b53e0bca655 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] [instance: 61976531-76ae-4a1c-8950-0af784be376e] Found default for hw_input_bus of None {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:23:56 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-04479af1-da06-4ff2-a866-5b53e0bca655 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] [instance: 61976531-76ae-4a1c-8950-0af784be376e] Found default for hw_pointer_model of None {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:23:56 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-04479af1-da06-4ff2-a866-5b53e0bca655 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] [instance: 61976531-76ae-4a1c-8950-0af784be376e] Found default for hw_video_model of virtio {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:23:56 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-04479af1-da06-4ff2-a866-5b53e0bca655 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] [instance: 61976531-76ae-4a1c-8950-0af784be376e] Found default for hw_vif_model of virtio {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:23:56 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 61976531-76ae-4a1c-8950-0af784be376e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 15:23:56 user nova-compute[72382]: DEBUG nova.virt.driver [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Emitting event <LifecycleEvent: 1691594636.6969135, 61976531-76ae-4a1c-8950-0af784be376e => Started> {{(pid=72382) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 15:23:56 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 61976531-76ae-4a1c-8950-0af784be376e] VM Started (Lifecycle Event)
Aug 09 15:23:56 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 61976531-76ae-4a1c-8950-0af784be376e] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:23:56 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 61976531-76ae-4a1c-8950-0af784be376e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72382) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 15:23:56 user nova-compute[72382]: DEBUG nova.compute.manager [req-d7678568-a8f7-49b4-9893-6519bf951a96 req-d7364f3b-adce-4fb5-a79e-37c5bc41170b service nova] [instance: 61976531-76ae-4a1c-8950-0af784be376e] Received event network-vif-plugged-adf7f33a-6792-47f7-b8e6-4d0775b01f9d {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:23:56 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-d7678568-a8f7-49b4-9893-6519bf951a96 req-d7364f3b-adce-4fb5-a79e-37c5bc41170b service nova] Acquiring lock "61976531-76ae-4a1c-8950-0af784be376e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:23:56 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-d7678568-a8f7-49b4-9893-6519bf951a96 req-d7364f3b-adce-4fb5-a79e-37c5bc41170b service nova] Lock "61976531-76ae-4a1c-8950-0af784be376e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:23:56 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-d7678568-a8f7-49b4-9893-6519bf951a96 req-d7364f3b-adce-4fb5-a79e-37c5bc41170b service nova] Lock "61976531-76ae-4a1c-8950-0af784be376e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:23:56 user nova-compute[72382]: DEBUG nova.compute.manager [req-d7678568-a8f7-49b4-9893-6519bf951a96 req-d7364f3b-adce-4fb5-a79e-37c5bc41170b service nova] [instance: 61976531-76ae-4a1c-8950-0af784be376e] No waiting events found dispatching network-vif-plugged-adf7f33a-6792-47f7-b8e6-4d0775b01f9d {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:23:56 user nova-compute[72382]: WARNING nova.compute.manager [req-d7678568-a8f7-49b4-9893-6519bf951a96 req-d7364f3b-adce-4fb5-a79e-37c5bc41170b service nova] [instance: 61976531-76ae-4a1c-8950-0af784be376e] Received unexpected event network-vif-plugged-adf7f33a-6792-47f7-b8e6-4d0775b01f9d for instance with vm_state building and task_state spawning.
Aug 09 15:23:56 user nova-compute[72382]: DEBUG nova.compute.manager [req-d7678568-a8f7-49b4-9893-6519bf951a96 req-d7364f3b-adce-4fb5-a79e-37c5bc41170b service nova] [instance: e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0] Received event network-changed-9513dc1d-79d5-482b-baaa-81f525e99de7 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:23:56 user nova-compute[72382]: DEBUG nova.compute.manager [req-d7678568-a8f7-49b4-9893-6519bf951a96 req-d7364f3b-adce-4fb5-a79e-37c5bc41170b service nova] [instance: e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0] Refreshing instance network info cache due to event network-changed-9513dc1d-79d5-482b-baaa-81f525e99de7. {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 15:23:56 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-d7678568-a8f7-49b4-9893-6519bf951a96 req-d7364f3b-adce-4fb5-a79e-37c5bc41170b service nova] Acquiring lock "refresh_cache-e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 15:23:56 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-d7678568-a8f7-49b4-9893-6519bf951a96 req-d7364f3b-adce-4fb5-a79e-37c5bc41170b service nova] Acquired lock "refresh_cache-e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 15:23:56 user nova-compute[72382]: DEBUG nova.network.neutron [req-d7678568-a8f7-49b4-9893-6519bf951a96 req-d7364f3b-adce-4fb5-a79e-37c5bc41170b service nova] [instance: e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0] Refreshing network info cache for port 9513dc1d-79d5-482b-baaa-81f525e99de7 {{(pid=72382) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 15:23:56 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 61976531-76ae-4a1c-8950-0af784be376e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 15:23:56 user nova-compute[72382]: INFO nova.compute.manager [None req-04479af1-da06-4ff2-a866-5b53e0bca655 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] [instance: 61976531-76ae-4a1c-8950-0af784be376e] Took 7.09 seconds to spawn the instance on the hypervisor.
Aug 09 15:23:56 user nova-compute[72382]: DEBUG nova.compute.manager [None req-04479af1-da06-4ff2-a866-5b53e0bca655 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] [instance: 61976531-76ae-4a1c-8950-0af784be376e] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:23:56 user nova-compute[72382]: INFO nova.compute.manager [None req-04479af1-da06-4ff2-a866-5b53e0bca655 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] [instance: 61976531-76ae-4a1c-8950-0af784be376e] Took 8.25 seconds to build instance.
Aug 09 15:23:56 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-04479af1-da06-4ff2-a866-5b53e0bca655 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Lock "61976531-76ae-4a1c-8950-0af784be376e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.351s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:23:57 user nova-compute[72382]: DEBUG nova.network.neutron [req-d7678568-a8f7-49b4-9893-6519bf951a96 req-d7364f3b-adce-4fb5-a79e-37c5bc41170b service nova] [instance: e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0] Updated VIF entry in instance network info cache for port 9513dc1d-79d5-482b-baaa-81f525e99de7. {{(pid=72382) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 15:23:57 user nova-compute[72382]: DEBUG nova.network.neutron [req-d7678568-a8f7-49b4-9893-6519bf951a96 req-d7364f3b-adce-4fb5-a79e-37c5bc41170b service nova] [instance: e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0] Updating instance_info_cache with network_info: [{"id": "9513dc1d-79d5-482b-baaa-81f525e99de7", "address": "fa:16:3e:6f:6b:41", "network": {"id": "46ef00c7-17ee-4e45-ba1d-dcc0a417ea85", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1360012261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "990ba791030940d38360af5879c853c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9513dc1d-79", "ovs_interfaceid": "9513dc1d-79d5-482b-baaa-81f525e99de7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:23:57 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-d7678568-a8f7-49b4-9893-6519bf951a96 req-d7364f3b-adce-4fb5-a79e-37c5bc41170b service nova] Releasing lock "refresh_cache-e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 15:23:57 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:23:58 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:23:58 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:23:58 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:23:58 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:23:58 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:23:58 user nova-compute[72382]: DEBUG nova.compute.manager [req-f88d0ca7-af62-4951-a581-059d71eb3465 req-8fc6a490-49d4-4e5b-a4d1-d380f1ca8f9b service nova] [instance: e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0] Received event network-vif-plugged-9513dc1d-79d5-482b-baaa-81f525e99de7 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:23:58 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-f88d0ca7-af62-4951-a581-059d71eb3465 req-8fc6a490-49d4-4e5b-a4d1-d380f1ca8f9b service nova] Acquiring lock "e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:23:58 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-f88d0ca7-af62-4951-a581-059d71eb3465 req-8fc6a490-49d4-4e5b-a4d1-d380f1ca8f9b service nova] Lock "e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:23:58 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-f88d0ca7-af62-4951-a581-059d71eb3465 req-8fc6a490-49d4-4e5b-a4d1-d380f1ca8f9b service nova] Lock "e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:23:58 user nova-compute[72382]: DEBUG nova.compute.manager [req-f88d0ca7-af62-4951-a581-059d71eb3465 req-8fc6a490-49d4-4e5b-a4d1-d380f1ca8f9b service nova] [instance: e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0] No waiting events found dispatching network-vif-plugged-9513dc1d-79d5-482b-baaa-81f525e99de7 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:23:58 user nova-compute[72382]: WARNING nova.compute.manager [req-f88d0ca7-af62-4951-a581-059d71eb3465 req-8fc6a490-49d4-4e5b-a4d1-d380f1ca8f9b service nova] [instance: e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0] Received unexpected event network-vif-plugged-9513dc1d-79d5-482b-baaa-81f525e99de7 for instance with vm_state building and task_state spawning.
Aug 09 15:23:58 user nova-compute[72382]: DEBUG nova.compute.manager [req-f88d0ca7-af62-4951-a581-059d71eb3465 req-8fc6a490-49d4-4e5b-a4d1-d380f1ca8f9b service nova] [instance: e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0] Received event network-vif-plugged-9513dc1d-79d5-482b-baaa-81f525e99de7 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:23:58 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-f88d0ca7-af62-4951-a581-059d71eb3465 req-8fc6a490-49d4-4e5b-a4d1-d380f1ca8f9b service nova] Acquiring lock "e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:23:58 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-f88d0ca7-af62-4951-a581-059d71eb3465 req-8fc6a490-49d4-4e5b-a4d1-d380f1ca8f9b service nova] Lock "e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:23:58 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-f88d0ca7-af62-4951-a581-059d71eb3465 req-8fc6a490-49d4-4e5b-a4d1-d380f1ca8f9b service nova] Lock "e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:23:58 user nova-compute[72382]: DEBUG nova.compute.manager [req-f88d0ca7-af62-4951-a581-059d71eb3465 req-8fc6a490-49d4-4e5b-a4d1-d380f1ca8f9b service nova] [instance: e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0] No waiting events found dispatching network-vif-plugged-9513dc1d-79d5-482b-baaa-81f525e99de7 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:23:58 user nova-compute[72382]: WARNING nova.compute.manager [req-f88d0ca7-af62-4951-a581-059d71eb3465 req-8fc6a490-49d4-4e5b-a4d1-d380f1ca8f9b service nova] [instance: e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0] Received unexpected event network-vif-plugged-9513dc1d-79d5-482b-baaa-81f525e99de7 for instance with vm_state building and task_state spawning.
Aug 09 15:23:59 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:24:00 user nova-compute[72382]: DEBUG nova.virt.driver [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Emitting event <LifecycleEvent: 1691594640.4614573, e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0 => Resumed> {{(pid=72382) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 15:24:00 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0] VM Resumed (Lifecycle Event)
Aug 09 15:24:00 user nova-compute[72382]: DEBUG nova.compute.manager [None req-7c0d0260-2376-46a5-942e-36d4a40f42bf tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] [instance: e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0] Instance event wait completed in 0 seconds for  {{(pid=72382) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 15:24:00 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-7c0d0260-2376-46a5-942e-36d4a40f42bf tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] [instance: e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0] Guest created on hypervisor {{(pid=72382) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 15:24:00 user nova-compute[72382]: INFO nova.virt.libvirt.driver [-] [instance: e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0] Instance spawned successfully.
Aug 09 15:24:00 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-7c0d0260-2376-46a5-942e-36d4a40f42bf tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] [instance: e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 15:24:00 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:24:00 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-7c0d0260-2376-46a5-942e-36d4a40f42bf tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] [instance: e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0] Found default for hw_cdrom_bus of ide {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:24:00 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-7c0d0260-2376-46a5-942e-36d4a40f42bf tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] [instance: e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0] Found default for hw_disk_bus of virtio {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:24:00 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-7c0d0260-2376-46a5-942e-36d4a40f42bf tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] [instance: e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0] Found default for hw_input_bus of None {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:24:00 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-7c0d0260-2376-46a5-942e-36d4a40f42bf tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] [instance: e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0] Found default for hw_pointer_model of None {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:24:00 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-7c0d0260-2376-46a5-942e-36d4a40f42bf tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] [instance: e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0] Found default for hw_video_model of virtio {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:24:00 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-7c0d0260-2376-46a5-942e-36d4a40f42bf tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] [instance: e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0] Found default for hw_vif_model of virtio {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:24:00 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72382) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 15:24:00 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 15:24:00 user nova-compute[72382]: DEBUG nova.virt.driver [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Emitting event <LifecycleEvent: 1691594640.465945, e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0 => Started> {{(pid=72382) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 15:24:00 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0] VM Started (Lifecycle Event)
Aug 09 15:24:00 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:24:00 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72382) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 15:24:00 user nova-compute[72382]: INFO nova.compute.manager [None req-7c0d0260-2376-46a5-942e-36d4a40f42bf tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] [instance: e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0] Took 6.91 seconds to spawn the instance on the hypervisor.
Aug 09 15:24:00 user nova-compute[72382]: DEBUG nova.compute.manager [None req-7c0d0260-2376-46a5-942e-36d4a40f42bf tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] [instance: e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:24:00 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 15:24:00 user nova-compute[72382]: INFO nova.compute.manager [None req-7c0d0260-2376-46a5-942e-36d4a40f42bf tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] [instance: e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0] Took 7.92 seconds to build instance.
Aug 09 15:24:00 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-7c0d0260-2376-46a5-942e-36d4a40f42bf tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Lock "e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.036s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:24:01 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:24:03 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-f824475b-af66-424d-bd90-d50150917453 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Acquiring lock "c9766433-4c5a-40ed-a212-715a24f42b91" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:24:03 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-f824475b-af66-424d-bd90-d50150917453 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Lock "c9766433-4c5a-40ed-a212-715a24f42b91" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:24:03 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-f824475b-af66-424d-bd90-d50150917453 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Acquiring lock "c9766433-4c5a-40ed-a212-715a24f42b91-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:24:03 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-f824475b-af66-424d-bd90-d50150917453 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Lock "c9766433-4c5a-40ed-a212-715a24f42b91-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:24:03 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-f824475b-af66-424d-bd90-d50150917453 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Lock "c9766433-4c5a-40ed-a212-715a24f42b91-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:24:03 user nova-compute[72382]: INFO nova.compute.manager [None req-f824475b-af66-424d-bd90-d50150917453 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] [instance: c9766433-4c5a-40ed-a212-715a24f42b91] Terminating instance
Aug 09 15:24:03 user nova-compute[72382]: DEBUG nova.compute.manager [None req-f824475b-af66-424d-bd90-d50150917453 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] [instance: c9766433-4c5a-40ed-a212-715a24f42b91] Start destroying the instance on the hypervisor. {{(pid=72382) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 15:24:03 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:24:03 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:24:03 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:24:03 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:24:03 user nova-compute[72382]: DEBUG nova.compute.manager [req-8a8e8b9f-11b0-45f9-a550-0e8dc0022841 req-78bf5004-35cf-48b5-b137-303af0daad04 service nova] [instance: c9766433-4c5a-40ed-a212-715a24f42b91] Received event network-vif-unplugged-599dae3b-13bb-47af-b889-0037e03d5e31 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:24:03 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-8a8e8b9f-11b0-45f9-a550-0e8dc0022841 req-78bf5004-35cf-48b5-b137-303af0daad04 service nova] Acquiring lock "c9766433-4c5a-40ed-a212-715a24f42b91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:24:03 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-8a8e8b9f-11b0-45f9-a550-0e8dc0022841 req-78bf5004-35cf-48b5-b137-303af0daad04 service nova] Lock "c9766433-4c5a-40ed-a212-715a24f42b91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:24:03 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-8a8e8b9f-11b0-45f9-a550-0e8dc0022841 req-78bf5004-35cf-48b5-b137-303af0daad04 service nova] Lock "c9766433-4c5a-40ed-a212-715a24f42b91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:24:03 user nova-compute[72382]: DEBUG nova.compute.manager [req-8a8e8b9f-11b0-45f9-a550-0e8dc0022841 req-78bf5004-35cf-48b5-b137-303af0daad04 service nova] [instance: c9766433-4c5a-40ed-a212-715a24f42b91] No waiting events found dispatching network-vif-unplugged-599dae3b-13bb-47af-b889-0037e03d5e31 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:24:03 user nova-compute[72382]: DEBUG nova.compute.manager [req-8a8e8b9f-11b0-45f9-a550-0e8dc0022841 req-78bf5004-35cf-48b5-b137-303af0daad04 service nova] [instance: c9766433-4c5a-40ed-a212-715a24f42b91] Received event network-vif-unplugged-599dae3b-13bb-47af-b889-0037e03d5e31 for instance with task_state deleting. {{(pid=72382) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 15:24:03 user nova-compute[72382]: INFO nova.virt.libvirt.driver [-] [instance: c9766433-4c5a-40ed-a212-715a24f42b91] Instance destroyed successfully.
Aug 09 15:24:03 user nova-compute[72382]: DEBUG nova.objects.instance [None req-f824475b-af66-424d-bd90-d50150917453 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Lazy-loading 'resources' on Instance uuid c9766433-4c5a-40ed-a212-715a24f42b91 {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:24:03 user nova-compute[72382]: DEBUG nova.virt.libvirt.vif [None req-f824475b-af66-424d-bd90-d50150917453 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T15:15:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-2120220558',display_name='tempest-ServerActionsTestOtherB-server-2120220558',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-2120220558',id=5,image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOdAPO5nl2/3VDHoi/8yD5s8l1+mDVit5A+n/HDnoxJgZMgOR9rAXiFsYVLEG+MsUeEQU8np4/pg88xwFSbi1vuFZkvV9b5532CTazhkqSlb4YuAKF8mo8fSFbyD8FwytA==',key_name='tempest-keypair-1399201542',keypairs=<?>,launch_index=0,launched_at=2023-08-09T15:21:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9f45d010dd474c92a6b24bf977564ad1',ramdisk_id='',reservation_id='r-rng7ms7j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-250545160',owner_user_name='tempest-ServerActionsTestOtherB-250545160-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T15:21:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='232fbbd15fea4894be7cebb13ea45cf9',uuid=c9766433-4c5a-40ed-a212-715a24f42b91,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "599dae3b-13bb-47af-b889-0037e03d5e31", "address": "fa:16:3e:66:9f:0b", "network": {"id": "63303ac8-d370-4386-a6bc-576677b64740", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1379220233-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f45d010dd474c92a6b24bf977564ad1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap599dae3b-13", "ovs_interfaceid": "599dae3b-13bb-47af-b889-0037e03d5e31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 15:24:03 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-f824475b-af66-424d-bd90-d50150917453 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Converting VIF {"id": "599dae3b-13bb-47af-b889-0037e03d5e31", "address": "fa:16:3e:66:9f:0b", "network": {"id": "63303ac8-d370-4386-a6bc-576677b64740", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1379220233-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f45d010dd474c92a6b24bf977564ad1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap599dae3b-13", "ovs_interfaceid": "599dae3b-13bb-47af-b889-0037e03d5e31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 15:24:03 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-f824475b-af66-424d-bd90-d50150917453 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:66:9f:0b,bridge_name='br-int',has_traffic_filtering=True,id=599dae3b-13bb-47af-b889-0037e03d5e31,network=Network(63303ac8-d370-4386-a6bc-576677b64740),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap599dae3b-13') {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 15:24:03 user nova-compute[72382]: DEBUG os_vif [None req-f824475b-af66-424d-bd90-d50150917453 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:9f:0b,bridge_name='br-int',has_traffic_filtering=True,id=599dae3b-13bb-47af-b889-0037e03d5e31,network=Network(63303ac8-d370-4386-a6bc-576677b64740),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap599dae3b-13') {{(pid=72382) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 15:24:03 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:24:03 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap599dae3b-13, bridge=br-int, if_exists=True) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:24:03 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:24:03 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:24:04 user nova-compute[72382]: INFO os_vif [None req-f824475b-af66-424d-bd90-d50150917453 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:9f:0b,bridge_name='br-int',has_traffic_filtering=True,id=599dae3b-13bb-47af-b889-0037e03d5e31,network=Network(63303ac8-d370-4386-a6bc-576677b64740),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap599dae3b-13')
Aug 09 15:24:04 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f824475b-af66-424d-bd90-d50150917453 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] [instance: c9766433-4c5a-40ed-a212-715a24f42b91] calling os-brick to detach iSCSI Volume {{(pid=72382) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 15:24:04 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-f824475b-af66-424d-bd90-d50150917453 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2a0c768340>, {'target_iqns': ['iqn.2010-10.org.openstack:fb47e85c-aaa9-4165-8be3-125572b68a87'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mtLoQzKG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 15:24:04 user nova-compute[72382]: WARNING os_brick.initiator.connectors.base [None req-f824475b-af66-424d-bd90-d50150917453 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 15:24:04 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-f824475b-af66-424d-bd90-d50150917453 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 15:24:04 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-f824475b-af66-424d-bd90-d50150917453 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 15:24:04 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-f824475b-af66-424d-bd90-d50150917453 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fb47e85c-aaa9-4165-8be3-125572b68a87', 0)] {{(pid=72382) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 15:24:04 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:24:04 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:24:04 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb2cb331-b7cc-4317-8f55-2c8776f9eb5b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0052e86d-16a7-4cbe-a802-ff770c0e20ba\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1cd86701-a303-4744-bf0c-31b5314bb87d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fb47e85c-aaa9-4165-8be3-125572b68a87\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:24:04 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:24:04 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:24:04 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4e06610-e5e7-44e3-9da9-96133e088d1e]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb47e85c-aaa9-4165-8be3-125572b68a87 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cd86701-a303-4744-bf0c-31b5314bb87d (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0052e86d-16a7-4cbe-a802-ff770c0e20ba (non-flash)\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:24:04 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-f824475b-af66-424d-bd90-d50150917453 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)
Aug 09 15:24:04 user nova-compute[72382]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb47e85c-aaa9-4165-8be3-125572b68a87 (non-flash)
Aug 09 15:24:04 user nova-compute[72382]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cd86701-a303-4744-bf0c-31b5314bb87d (non-flash)
Aug 09 15:24:04 user nova-compute[72382]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0052e86d-16a7-4cbe-a802-ff770c0e20ba (non-flash)
Aug 09 15:24:04 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 15:24:04 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-f824475b-af66-424d-bd90-d50150917453 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)
Aug 09 15:24:04 user nova-compute[72382]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb47e85c-aaa9-4165-8be3-125572b68a87 (non-flash)
Aug 09 15:24:04 user nova-compute[72382]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cd86701-a303-4744-bf0c-31b5314bb87d (non-flash)
Aug 09 15:24:04 user nova-compute[72382]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0052e86d-16a7-4cbe-a802-ff770c0e20ba (non-flash)
Aug 09 15:24:04 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 15:24:04 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-f824475b-af66-424d-bd90-d50150917453 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2a0c3d5510>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fb47e85c-aaa9-4165-8be3-125572b68a87'): ({'sdb'}, set())}) {{(pid=72382) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 15:24:04 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-f824475b-af66-424d-bd90-d50150917453 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Removing single pathed devices sdb {{(pid=72382) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 15:24:04 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:24:04 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:24:04 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[081b72ec-06b9-4e7d-86f2-37aa1bb91df1]: (4, ('path checker states:\nup                  3\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:24:04 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:24:04 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:24:04 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0c5a5fd-1979-452e-ba36-b442fac7df23]: (4, ('ok\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:24:04 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-f824475b-af66-424d-bd90-d50150917453 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Flushing IO for device /dev/sdb {{(pid=72382) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 15:24:04 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:24:04 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:24:04 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[6edcb8cc-ce3a-4b29-9d41-32dc2fad49b1]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:24:04 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-f824475b-af66-424d-bd90-d50150917453 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72382) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 15:24:04 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:24:04 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:24:04 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[748fcd8b-d7d6-42c4-9824-5369d0eb0073]: (4, ('1', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:24:04 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-f824475b-af66-424d-bd90-d50150917453 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72382) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 15:24:04 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-f824475b-af66-424d-bd90-d50150917453 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] SCSI volumes sdb have been removed. {{(pid=72382) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 15:24:04 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-f824475b-af66-424d-bd90-d50150917453 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fb47e85c-aaa9-4165-8be3-125572b68a87')] {{(pid=72382) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 15:24:04 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb47e85c-aaa9-4165-8be3-125572b68a87 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:24:04 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb47e85c-aaa9-4165-8be3-125572b68a87 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:24:04 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[2030a6c9-013a-4a43-9d42-5355b961e30c]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:24:04 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-f824475b-af66-424d-bd90-d50150917453 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:24:04 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb47e85c-aaa9-4165-8be3-125572b68a87 -p 172.16.0.220:3260 --logout {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:24:04 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb47e85c-aaa9-4165-8be3-125572b68a87 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:24:04 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[134cd744-d717-4a0c-bd2a-aa973301dfff]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:fb47e85c-aaa9-4165-8be3-125572b68a87, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:fb47e85c-aaa9-4165-8be3-125572b68a87, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:24:04 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-f824475b-af66-424d-bd90-d50150917453 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:fb47e85c-aaa9-4165-8be3-125572b68a87, portal: 172.16.0.220,3260]
Aug 09 15:24:04 user nova-compute[72382]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:fb47e85c-aaa9-4165-8be3-125572b68a87, portal: 172.16.0.220,3260] successful.
Aug 09 15:24:04 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:24:04 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb47e85c-aaa9-4165-8be3-125572b68a87 -p 172.16.0.220:3260 --op delete {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:24:04 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb47e85c-aaa9-4165-8be3-125572b68a87 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:24:04 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[14c025d8-be41-471c-aa0f-8a0c31766dfe]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:24:04 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-f824475b-af66-424d-bd90-d50150917453 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:24:04 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-f824475b-af66-424d-bd90-d50150917453 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.301s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 15:24:04 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-f824475b-af66-424d-bd90-d50150917453 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] <== disconnect_volume: return (303ms) None {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 15:24:04 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f824475b-af66-424d-bd90-d50150917453 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] [instance: c9766433-4c5a-40ed-a212-715a24f42b91] Disconnected iSCSI Volume {{(pid=72382) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 15:24:04 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-f824475b-af66-424d-bd90-d50150917453 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] [instance: c9766433-4c5a-40ed-a212-715a24f42b91] Deleting instance files /opt/stack/data/nova/instances/c9766433-4c5a-40ed-a212-715a24f42b91_del
Aug 09 15:24:04 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-f824475b-af66-424d-bd90-d50150917453 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] [instance: c9766433-4c5a-40ed-a212-715a24f42b91] Deletion of /opt/stack/data/nova/instances/c9766433-4c5a-40ed-a212-715a24f42b91_del complete
Aug 09 15:24:04 user nova-compute[72382]: INFO nova.compute.manager [None req-f824475b-af66-424d-bd90-d50150917453 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] [instance: c9766433-4c5a-40ed-a212-715a24f42b91] Took 1.31 seconds to destroy the instance on the hypervisor.
Aug 09 15:24:04 user nova-compute[72382]: DEBUG oslo.service.loopingcall [None req-f824475b-af66-424d-bd90-d50150917453 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72382) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 15:24:04 user nova-compute[72382]: DEBUG nova.compute.manager [-] [instance: c9766433-4c5a-40ed-a212-715a24f42b91] Deallocating network for instance {{(pid=72382) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 15:24:04 user nova-compute[72382]: DEBUG nova.network.neutron [-] [instance: c9766433-4c5a-40ed-a212-715a24f42b91] deallocate_for_instance() {{(pid=72382) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 15:24:05 user nova-compute[72382]: DEBUG nova.compute.manager [req-c1963c58-fc33-4b5b-896f-19af09f14370 req-8c790d1d-8153-4c06-a37b-4acf8181f759 service nova] [instance: c9766433-4c5a-40ed-a212-715a24f42b91] Received event network-vif-plugged-599dae3b-13bb-47af-b889-0037e03d5e31 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:24:05 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-c1963c58-fc33-4b5b-896f-19af09f14370 req-8c790d1d-8153-4c06-a37b-4acf8181f759 service nova] Acquiring lock "c9766433-4c5a-40ed-a212-715a24f42b91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:24:05 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-c1963c58-fc33-4b5b-896f-19af09f14370 req-8c790d1d-8153-4c06-a37b-4acf8181f759 service nova] Lock "c9766433-4c5a-40ed-a212-715a24f42b91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:24:05 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-c1963c58-fc33-4b5b-896f-19af09f14370 req-8c790d1d-8153-4c06-a37b-4acf8181f759 service nova] Lock "c9766433-4c5a-40ed-a212-715a24f42b91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:24:05 user nova-compute[72382]: DEBUG nova.compute.manager [req-c1963c58-fc33-4b5b-896f-19af09f14370 req-8c790d1d-8153-4c06-a37b-4acf8181f759 service nova] [instance: c9766433-4c5a-40ed-a212-715a24f42b91] No waiting events found dispatching network-vif-plugged-599dae3b-13bb-47af-b889-0037e03d5e31 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:24:05 user nova-compute[72382]: WARNING nova.compute.manager [req-c1963c58-fc33-4b5b-896f-19af09f14370 req-8c790d1d-8153-4c06-a37b-4acf8181f759 service nova] [instance: c9766433-4c5a-40ed-a212-715a24f42b91] Received unexpected event network-vif-plugged-599dae3b-13bb-47af-b889-0037e03d5e31 for instance with vm_state active and task_state deleting.
Aug 09 15:24:06 user nova-compute[72382]: DEBUG nova.network.neutron [-] [instance: c9766433-4c5a-40ed-a212-715a24f42b91] Updating instance_info_cache with network_info: [] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:24:06 user nova-compute[72382]: INFO nova.compute.manager [-] [instance: c9766433-4c5a-40ed-a212-715a24f42b91] Took 1.60 seconds to deallocate network for instance.
Aug 09 15:24:06 user nova-compute[72382]: DEBUG nova.compute.manager [req-208df222-34f1-445d-8cec-0256baa0eadb req-2bca7e1f-5179-4817-9d33-f3e7939d6080 service nova] [instance: c9766433-4c5a-40ed-a212-715a24f42b91] Received event network-vif-deleted-599dae3b-13bb-47af-b889-0037e03d5e31 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:24:06 user nova-compute[72382]: INFO nova.compute.manager [None req-f824475b-af66-424d-bd90-d50150917453 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] [instance: c9766433-4c5a-40ed-a212-715a24f42b91] Took 0.84 seconds to detach 1 volumes for instance.
Aug 09 15:24:06 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:24:06 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:24:06 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:24:06 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:24:06 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:24:06 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Auditing locally available compute resources for user (node: user) {{(pid=72382) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 15:24:06 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-f824475b-af66-424d-bd90-d50150917453 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:24:06 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-f824475b-af66-424d-bd90-d50150917453 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:24:07 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:24:07 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:24:07 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:24:07 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:24:07 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ea8f68c-3dc1-45ac-a7f3-bca32f929add/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:24:07 user nova-compute[72382]: DEBUG nova.compute.provider_tree [None req-f824475b-af66-424d-bd90-d50150917453 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Inventory has not changed in ProviderTree for provider: 7b15b0e5-df4d-49db-833b-2855d21d10ae {{(pid=72382) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 15:24:07 user nova-compute[72382]: DEBUG nova.scheduler.client.report [None req-f824475b-af66-424d-bd90-d50150917453 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Inventory has not changed for provider 7b15b0e5-df4d-49db-833b-2855d21d10ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72382) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 15:24:07 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-f824475b-af66-424d-bd90-d50150917453 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.636s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:24:07 user nova-compute[72382]: INFO nova.scheduler.client.report [None req-f824475b-af66-424d-bd90-d50150917453 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Deleted allocations for instance c9766433-4c5a-40ed-a212-715a24f42b91
Aug 09 15:24:07 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ea8f68c-3dc1-45ac-a7f3-bca32f929add/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:24:07 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ea8f68c-3dc1-45ac-a7f3-bca32f929add/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:24:07 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-f824475b-af66-424d-bd90-d50150917453 tempest-ServerActionsTestOtherB-250545160 tempest-ServerActionsTestOtherB-250545160-project-member] Lock "c9766433-4c5a-40ed-a212-715a24f42b91" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.641s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:24:07 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ea8f68c-3dc1-45ac-a7f3-bca32f929add/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:24:07 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f780040f-b789-4b72-8986-813c7b9fe4a6/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:24:08 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f780040f-b789-4b72-8986-813c7b9fe4a6/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:24:08 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f780040f-b789-4b72-8986-813c7b9fe4a6/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:24:08 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f780040f-b789-4b72-8986-813c7b9fe4a6/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:24:08 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/266be814-4a2b-4f8e-a0f6-e8821fdeb95d/disk.rescue --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:24:08 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/266be814-4a2b-4f8e-a0f6-e8821fdeb95d/disk.rescue --force-share --output=json" returned: 0 in 0.168s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:24:08 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/266be814-4a2b-4f8e-a0f6-e8821fdeb95d/disk.rescue --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:24:08 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-c146d421-ccfb-4ab2-b6a4-c08dcd99cca4 tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] Acquiring lock "83ebfda8-235d-4404-a973-991d75ae2bf6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:24:08 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-c146d421-ccfb-4ab2-b6a4-c08dcd99cca4 tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] Lock "83ebfda8-235d-4404-a973-991d75ae2bf6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.003s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:24:08 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-c146d421-ccfb-4ab2-b6a4-c08dcd99cca4 tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] Acquiring lock "83ebfda8-235d-4404-a973-991d75ae2bf6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:24:08 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-c146d421-ccfb-4ab2-b6a4-c08dcd99cca4 tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] Lock "83ebfda8-235d-4404-a973-991d75ae2bf6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:24:08 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-c146d421-ccfb-4ab2-b6a4-c08dcd99cca4 tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] Lock "83ebfda8-235d-4404-a973-991d75ae2bf6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:24:08 user nova-compute[72382]: INFO nova.compute.manager [None req-c146d421-ccfb-4ab2-b6a4-c08dcd99cca4 tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] [instance: 83ebfda8-235d-4404-a973-991d75ae2bf6] Terminating instance
Aug 09 15:24:08 user nova-compute[72382]: DEBUG nova.compute.manager [None req-c146d421-ccfb-4ab2-b6a4-c08dcd99cca4 tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] [instance: 83ebfda8-235d-4404-a973-991d75ae2bf6] Start destroying the instance on the hypervisor. {{(pid=72382) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 15:24:08 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/266be814-4a2b-4f8e-a0f6-e8821fdeb95d/disk.rescue --force-share --output=json" returned: 0 in 0.149s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:24:08 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/266be814-4a2b-4f8e-a0f6-e8821fdeb95d/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:24:08 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:24:08 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:24:08 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/266be814-4a2b-4f8e-a0f6-e8821fdeb95d/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:24:08 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/266be814-4a2b-4f8e-a0f6-e8821fdeb95d/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:24:08 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:24:08 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:24:08 user nova-compute[72382]: DEBUG nova.compute.manager [req-20d8ffbb-2b5b-4e67-aefb-ba1ff5e5a803 req-361a0e1c-d81c-40ab-ab3e-be3498204795 service nova] [instance: 83ebfda8-235d-4404-a973-991d75ae2bf6] Received event network-vif-unplugged-b2646c3a-cc2a-4782-a312-0582f2d377b1 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:24:08 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-20d8ffbb-2b5b-4e67-aefb-ba1ff5e5a803 req-361a0e1c-d81c-40ab-ab3e-be3498204795 service nova] Acquiring lock "83ebfda8-235d-4404-a973-991d75ae2bf6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:24:08 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-20d8ffbb-2b5b-4e67-aefb-ba1ff5e5a803 req-361a0e1c-d81c-40ab-ab3e-be3498204795 service nova] Lock "83ebfda8-235d-4404-a973-991d75ae2bf6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:24:08 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-20d8ffbb-2b5b-4e67-aefb-ba1ff5e5a803 req-361a0e1c-d81c-40ab-ab3e-be3498204795 service nova] Lock "83ebfda8-235d-4404-a973-991d75ae2bf6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:24:08 user nova-compute[72382]: DEBUG nova.compute.manager [req-20d8ffbb-2b5b-4e67-aefb-ba1ff5e5a803 req-361a0e1c-d81c-40ab-ab3e-be3498204795 service nova] [instance: 83ebfda8-235d-4404-a973-991d75ae2bf6] No waiting events found dispatching network-vif-unplugged-b2646c3a-cc2a-4782-a312-0582f2d377b1 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:24:08 user nova-compute[72382]: DEBUG nova.compute.manager [req-20d8ffbb-2b5b-4e67-aefb-ba1ff5e5a803 req-361a0e1c-d81c-40ab-ab3e-be3498204795 service nova] [instance: 83ebfda8-235d-4404-a973-991d75ae2bf6] Received event network-vif-unplugged-b2646c3a-cc2a-4782-a312-0582f2d377b1 for instance with task_state deleting. {{(pid=72382) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 15:24:08 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/266be814-4a2b-4f8e-a0f6-e8821fdeb95d/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:24:08 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f4908de-d65d-4d17-ad36-6124a5e64a19/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:24:08 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f4908de-d65d-4d17-ad36-6124a5e64a19/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:24:08 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f4908de-d65d-4d17-ad36-6124a5e64a19/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:24:09 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:24:09 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f4908de-d65d-4d17-ad36-6124a5e64a19/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:24:09 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:24:09 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/777e49ea-b674-4c3f-9cdd-ac2113032632/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:24:09 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:24:09 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:24:09 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:24:09 user nova-compute[72382]: INFO nova.virt.libvirt.driver [-] [instance: 83ebfda8-235d-4404-a973-991d75ae2bf6] Instance destroyed successfully.
Aug 09 15:24:09 user nova-compute[72382]: DEBUG nova.objects.instance [None req-c146d421-ccfb-4ab2-b6a4-c08dcd99cca4 tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] Lazy-loading 'resources' on Instance uuid 83ebfda8-235d-4404-a973-991d75ae2bf6 {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:24:09 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:24:09 user nova-compute[72382]: DEBUG nova.virt.libvirt.vif [None req-c146d421-ccfb-4ab2-b6a4-c08dcd99cca4 tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-09T15:20:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1408291636',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1037132086',id=18,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK/8JZBAyiCRHjLU+07gy/t2h+p3lkIQbl96NVsR2p9wGaw/Fvc6SNhI+niTOYcEyNFmbQHRmczVv3rBDNqLPSp2H/dP3kVtyEs6hP+i37003AjknP2hCvSl6DqRbqcyoQ==',key_name='tempest-keypair-1733291193',keypairs=<?>,launch_index=0,launched_at=2023-08-09T15:22:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='06b73f81b4814b6f86017c2c27f8762c',ramdisk_id='',reservation_id='r-ndge7mr0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1877173112',owner_user_name='tempest-ServerActionsV293TestJSON-1877173112-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T15:22:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='73fe18c52fef46869d80a266455681f8',uuid=83ebfda8-235d-4404-a973-991d75ae2bf6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b2646c3a-cc2a-4782-a312-0582f2d377b1", "address": "fa:16:3e:01:06:06", "network": {"id": "2d5fadd3-a58b-4e71-971d-fa94edf0897d", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-6415310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.176", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06b73f81b4814b6f86017c2c27f8762c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2646c3a-cc", "ovs_interfaceid": "b2646c3a-cc2a-4782-a312-0582f2d377b1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 15:24:09 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-c146d421-ccfb-4ab2-b6a4-c08dcd99cca4 tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] Converting VIF {"id": "b2646c3a-cc2a-4782-a312-0582f2d377b1", "address": "fa:16:3e:01:06:06", "network": {"id": "2d5fadd3-a58b-4e71-971d-fa94edf0897d", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-6415310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.176", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06b73f81b4814b6f86017c2c27f8762c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2646c3a-cc", "ovs_interfaceid": "b2646c3a-cc2a-4782-a312-0582f2d377b1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 15:24:09 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-c146d421-ccfb-4ab2-b6a4-c08dcd99cca4 tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:01:06:06,bridge_name='br-int',has_traffic_filtering=True,id=b2646c3a-cc2a-4782-a312-0582f2d377b1,network=Network(2d5fadd3-a58b-4e71-971d-fa94edf0897d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2646c3a-cc') {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 15:24:09 user nova-compute[72382]: DEBUG os_vif [None req-c146d421-ccfb-4ab2-b6a4-c08dcd99cca4 tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:01:06:06,bridge_name='br-int',has_traffic_filtering=True,id=b2646c3a-cc2a-4782-a312-0582f2d377b1,network=Network(2d5fadd3-a58b-4e71-971d-fa94edf0897d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2646c3a-cc') {{(pid=72382) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 15:24:09 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:24:09 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb2646c3a-cc, bridge=br-int, if_exists=True) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:24:09 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:24:09 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:24:09 user nova-compute[72382]: INFO os_vif [None req-c146d421-ccfb-4ab2-b6a4-c08dcd99cca4 tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:01:06:06,bridge_name='br-int',has_traffic_filtering=True,id=b2646c3a-cc2a-4782-a312-0582f2d377b1,network=Network(2d5fadd3-a58b-4e71-971d-fa94edf0897d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2646c3a-cc')
Aug 09 15:24:09 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c146d421-ccfb-4ab2-b6a4-c08dcd99cca4 tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] [instance: 83ebfda8-235d-4404-a973-991d75ae2bf6] calling os-brick to detach iSCSI Volume {{(pid=72382) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 15:24:09 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-c146d421-ccfb-4ab2-b6a4-c08dcd99cca4 tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2a0c768340>, {'target_iqns': ['iqn.2010-10.org.openstack:1cd86701-a303-4744-bf0c-31b5314bb87d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DtKCGmgQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 15:24:09 user nova-compute[72382]: WARNING os_brick.initiator.connectors.base [None req-c146d421-ccfb-4ab2-b6a4-c08dcd99cca4 tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 15:24:09 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-c146d421-ccfb-4ab2-b6a4-c08dcd99cca4 tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 15:24:09 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-c146d421-ccfb-4ab2-b6a4-c08dcd99cca4 tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.004s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 15:24:09 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-c146d421-ccfb-4ab2-b6a4-c08dcd99cca4 tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1cd86701-a303-4744-bf0c-31b5314bb87d', 0)] {{(pid=72382) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 15:24:09 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:24:09 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/777e49ea-b674-4c3f-9cdd-ac2113032632/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:24:09 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/777e49ea-b674-4c3f-9cdd-ac2113032632/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:24:09 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:24:09 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[757359c2-413b-42d5-b71d-6946f650ef42]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0052e86d-16a7-4cbe-a802-ff770c0e20ba\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1cd86701-a303-4744-bf0c-31b5314bb87d\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:24:09 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:24:09 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:24:09 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f2f1648-7064-4a2f-8b22-123ab1be015b]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cd86701-a303-4744-bf0c-31b5314bb87d (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0052e86d-16a7-4cbe-a802-ff770c0e20ba (non-flash)\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:24:09 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-c146d421-ccfb-4ab2-b6a4-c08dcd99cca4 tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)
Aug 09 15:24:09 user nova-compute[72382]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cd86701-a303-4744-bf0c-31b5314bb87d (non-flash)
Aug 09 15:24:09 user nova-compute[72382]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0052e86d-16a7-4cbe-a802-ff770c0e20ba (non-flash)
Aug 09 15:24:09 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 15:24:09 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-c146d421-ccfb-4ab2-b6a4-c08dcd99cca4 tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)
Aug 09 15:24:09 user nova-compute[72382]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cd86701-a303-4744-bf0c-31b5314bb87d (non-flash)
Aug 09 15:24:09 user nova-compute[72382]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0052e86d-16a7-4cbe-a802-ff770c0e20ba (non-flash)
Aug 09 15:24:09 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 15:24:09 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-c146d421-ccfb-4ab2-b6a4-c08dcd99cca4 tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2a0c735f30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1cd86701-a303-4744-bf0c-31b5314bb87d'): ({'sdc'}, set())}) {{(pid=72382) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 15:24:09 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-c146d421-ccfb-4ab2-b6a4-c08dcd99cca4 tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] Removing single pathed devices sdc {{(pid=72382) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 15:24:09 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:24:09 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:24:09 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[56aaca2b-3866-4d5a-a421-d2f531e190e2]: (4, ('path checker states:\nup                  2\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:24:09 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/777e49ea-b674-4c3f-9cdd-ac2113032632/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:24:09 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:24:09 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44afd1bf-fa5c-4b3e-8752-b16853fef54e/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:24:09 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.028s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:24:09 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a28b0ec-e24c-42a7-9476-825916525cb1]: (4, ('ok\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:24:09 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-c146d421-ccfb-4ab2-b6a4-c08dcd99cca4 tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] Flushing IO for device /dev/sdc {{(pid=72382) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 15:24:09 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:24:09 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:24:09 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[98a63612-fe63-49d4-baf9-44ca565a9d62]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:24:09 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-c146d421-ccfb-4ab2-b6a4-c08dcd99cca4 tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72382) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 15:24:09 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:24:09 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.068s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:24:09 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb3691a3-e9ff-42c8-9912-8437b567577d]: (4, ('1', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:24:09 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-c146d421-ccfb-4ab2-b6a4-c08dcd99cca4 tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72382) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 15:24:09 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-c146d421-ccfb-4ab2-b6a4-c08dcd99cca4 tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] SCSI volumes sdc have been removed. {{(pid=72382) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 15:24:09 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-c146d421-ccfb-4ab2-b6a4-c08dcd99cca4 tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1cd86701-a303-4744-bf0c-31b5314bb87d')] {{(pid=72382) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 15:24:09 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44afd1bf-fa5c-4b3e-8752-b16853fef54e/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:24:09 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44afd1bf-fa5c-4b3e-8752-b16853fef54e/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:24:09 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1cd86701-a303-4744-bf0c-31b5314bb87d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:24:09 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1cd86701-a303-4744-bf0c-31b5314bb87d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:24:09 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[66e59ca0-44cc-43f9-a62e-9833f6637ca0]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:24:09 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-c146d421-ccfb-4ab2-b6a4-c08dcd99cca4 tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:24:09 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1cd86701-a303-4744-bf0c-31b5314bb87d -p 172.16.0.220:3260 --logout {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:24:09 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1cd86701-a303-4744-bf0c-31b5314bb87d -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:24:09 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7645dd6-abfe-4779-857f-615b26e9d14e]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:1cd86701-a303-4744-bf0c-31b5314bb87d, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:1cd86701-a303-4744-bf0c-31b5314bb87d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:24:09 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-c146d421-ccfb-4ab2-b6a4-c08dcd99cca4 tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:1cd86701-a303-4744-bf0c-31b5314bb87d, portal: 172.16.0.220,3260]
Aug 09 15:24:09 user nova-compute[72382]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:1cd86701-a303-4744-bf0c-31b5314bb87d, portal: 172.16.0.220,3260] successful.
Aug 09 15:24:09 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:24:09 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1cd86701-a303-4744-bf0c-31b5314bb87d -p 172.16.0.220:3260 --op delete {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:24:09 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1cd86701-a303-4744-bf0c-31b5314bb87d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:24:09 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b76562b-2c28-488d-88aa-1d0e533f0102]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:24:09 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-c146d421-ccfb-4ab2-b6a4-c08dcd99cca4 tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:24:09 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-c146d421-ccfb-4ab2-b6a4-c08dcd99cca4 tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.473s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 15:24:09 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-c146d421-ccfb-4ab2-b6a4-c08dcd99cca4 tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] <== disconnect_volume: return (476ms) None {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 15:24:09 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c146d421-ccfb-4ab2-b6a4-c08dcd99cca4 tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] [instance: 83ebfda8-235d-4404-a973-991d75ae2bf6] Disconnected iSCSI Volume {{(pid=72382) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 15:24:09 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-c146d421-ccfb-4ab2-b6a4-c08dcd99cca4 tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] [instance: 83ebfda8-235d-4404-a973-991d75ae2bf6] Deleting instance files /opt/stack/data/nova/instances/83ebfda8-235d-4404-a973-991d75ae2bf6_del
Aug 09 15:24:09 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-c146d421-ccfb-4ab2-b6a4-c08dcd99cca4 tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] [instance: 83ebfda8-235d-4404-a973-991d75ae2bf6] Deletion of /opt/stack/data/nova/instances/83ebfda8-235d-4404-a973-991d75ae2bf6_del complete
Aug 09 15:24:09 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44afd1bf-fa5c-4b3e-8752-b16853fef54e/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:24:09 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72382) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 15:24:09 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6296ba5d-bcc6-405a-a635-0e9aa6114f7b/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:24:09 user nova-compute[72382]: INFO nova.compute.manager [None req-c146d421-ccfb-4ab2-b6a4-c08dcd99cca4 tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] [instance: 83ebfda8-235d-4404-a973-991d75ae2bf6] Took 1.48 seconds to destroy the instance on the hypervisor.
Aug 09 15:24:09 user nova-compute[72382]: DEBUG oslo.service.loopingcall [None req-c146d421-ccfb-4ab2-b6a4-c08dcd99cca4 tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72382) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 15:24:09 user nova-compute[72382]: DEBUG nova.compute.manager [-] [instance: 83ebfda8-235d-4404-a973-991d75ae2bf6] Deallocating network for instance {{(pid=72382) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 15:24:09 user nova-compute[72382]: DEBUG nova.network.neutron [-] [instance: 83ebfda8-235d-4404-a973-991d75ae2bf6] deallocate_for_instance() {{(pid=72382) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 15:24:09 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:24:09 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:24:09 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:24:10 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6296ba5d-bcc6-405a-a635-0e9aa6114f7b/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:24:10 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6296ba5d-bcc6-405a-a635-0e9aa6114f7b/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:24:10 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:24:10 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:24:10 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6296ba5d-bcc6-405a-a635-0e9aa6114f7b/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:24:10 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61976531-76ae-4a1c-8950-0af784be376e/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:24:10 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61976531-76ae-4a1c-8950-0af784be376e/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:24:10 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61976531-76ae-4a1c-8950-0af784be376e/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:24:10 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61976531-76ae-4a1c-8950-0af784be376e/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:24:10 user nova-compute[72382]: WARNING nova.virt.libvirt.driver [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Error from libvirt while getting description of instance-00000012: [Error Code 42] Domain not found: no domain with matching uuid '83ebfda8-235d-4404-a973-991d75ae2bf6' (instance-00000012): libvirt.libvirtError: Domain not found: no domain with matching uuid '83ebfda8-235d-4404-a973-991d75ae2bf6' (instance-00000012)
Aug 09 15:24:10 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8aa35482-60b8-4185-b14d-a2667fd3b5b7/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:24:10 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8aa35482-60b8-4185-b14d-a2667fd3b5b7/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:24:10 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8aa35482-60b8-4185-b14d-a2667fd3b5b7/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:24:10 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8aa35482-60b8-4185-b14d-a2667fd3b5b7/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:24:10 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=72382) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 15:24:10 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8aa35482-60b8-4185-b14d-a2667fd3b5b7/disk.rescue --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:24:10 user nova-compute[72382]: DEBUG nova.compute.manager [req-d9259d00-aeb1-4165-beb9-bece34407ae6 req-0ccf6ab1-c6ba-4965-9620-0806c4d0d056 service nova] [instance: 83ebfda8-235d-4404-a973-991d75ae2bf6] Received event network-vif-plugged-b2646c3a-cc2a-4782-a312-0582f2d377b1 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:24:10 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-d9259d00-aeb1-4165-beb9-bece34407ae6 req-0ccf6ab1-c6ba-4965-9620-0806c4d0d056 service nova] Acquiring lock "83ebfda8-235d-4404-a973-991d75ae2bf6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:24:10 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-d9259d00-aeb1-4165-beb9-bece34407ae6 req-0ccf6ab1-c6ba-4965-9620-0806c4d0d056 service nova] Lock "83ebfda8-235d-4404-a973-991d75ae2bf6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:24:10 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-d9259d00-aeb1-4165-beb9-bece34407ae6 req-0ccf6ab1-c6ba-4965-9620-0806c4d0d056 service nova] Lock "83ebfda8-235d-4404-a973-991d75ae2bf6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:24:10 user nova-compute[72382]: DEBUG nova.compute.manager [req-d9259d00-aeb1-4165-beb9-bece34407ae6 req-0ccf6ab1-c6ba-4965-9620-0806c4d0d056 service nova] [instance: 83ebfda8-235d-4404-a973-991d75ae2bf6] No waiting events found dispatching network-vif-plugged-b2646c3a-cc2a-4782-a312-0582f2d377b1 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:24:10 user nova-compute[72382]: WARNING nova.compute.manager [req-d9259d00-aeb1-4165-beb9-bece34407ae6 req-0ccf6ab1-c6ba-4965-9620-0806c4d0d056 service nova] [instance: 83ebfda8-235d-4404-a973-991d75ae2bf6] Received unexpected event network-vif-plugged-b2646c3a-cc2a-4782-a312-0582f2d377b1 for instance with vm_state active and task_state deleting.
Aug 09 15:24:10 user nova-compute[72382]: DEBUG nova.network.neutron [-] [instance: 83ebfda8-235d-4404-a973-991d75ae2bf6] Updating instance_info_cache with network_info: [] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:24:10 user nova-compute[72382]: INFO nova.compute.manager [-] [instance: 83ebfda8-235d-4404-a973-991d75ae2bf6] Took 1.01 seconds to deallocate network for instance.
Aug 09 15:24:10 user nova-compute[72382]: DEBUG nova.compute.manager [req-d22a7e92-6c9c-46be-ae4a-ab1ef976900b req-8b78f192-30e8-4865-ae16-2267dc0097d3 service nova] [instance: 83ebfda8-235d-4404-a973-991d75ae2bf6] Received event network-vif-deleted-b2646c3a-cc2a-4782-a312-0582f2d377b1 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:24:10 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8aa35482-60b8-4185-b14d-a2667fd3b5b7/disk.rescue --force-share --output=json" returned: 0 in 0.155s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:24:10 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8aa35482-60b8-4185-b14d-a2667fd3b5b7/disk.rescue --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:24:11 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8aa35482-60b8-4185-b14d-a2667fd3b5b7/disk.rescue --force-share --output=json" returned: 0 in 0.153s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:24:11 user nova-compute[72382]: WARNING nova.virt.libvirt.driver [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 15:24:11 user nova-compute[72382]: WARNING nova.virt.libvirt.driver [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 15:24:11 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Hypervisor/Node resource view: name=user free_ram=7100MB free_disk=25.422882080078125GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72382) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 15:24:11 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:24:11 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:24:11 user nova-compute[72382]: INFO nova.compute.manager [None req-c146d421-ccfb-4ab2-b6a4-c08dcd99cca4 tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] [instance: 83ebfda8-235d-4404-a973-991d75ae2bf6] Took 0.85 seconds to detach 1 volumes for instance.
Aug 09 15:24:11 user nova-compute[72382]: DEBUG nova.compute.manager [None req-c146d421-ccfb-4ab2-b6a4-c08dcd99cca4 tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] [instance: 83ebfda8-235d-4404-a973-991d75ae2bf6] Deleting volume: 1cd86701-a303-4744-bf0c-31b5314bb87d {{(pid=72382) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 09 15:24:11 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-62cecdb5-3a7a-429d-ac20-124f787dfbbb tempest-ServersNegativeTestJSON-1671359082 tempest-ServersNegativeTestJSON-1671359082-project-member] Acquiring lock "777e49ea-b674-4c3f-9cdd-ac2113032632" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:24:11 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-62cecdb5-3a7a-429d-ac20-124f787dfbbb tempest-ServersNegativeTestJSON-1671359082 tempest-ServersNegativeTestJSON-1671359082-project-member] Lock "777e49ea-b674-4c3f-9cdd-ac2113032632" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:24:11 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-62cecdb5-3a7a-429d-ac20-124f787dfbbb tempest-ServersNegativeTestJSON-1671359082 tempest-ServersNegativeTestJSON-1671359082-project-member] Acquiring lock "777e49ea-b674-4c3f-9cdd-ac2113032632-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:24:11 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-62cecdb5-3a7a-429d-ac20-124f787dfbbb tempest-ServersNegativeTestJSON-1671359082 tempest-ServersNegativeTestJSON-1671359082-project-member] Lock "777e49ea-b674-4c3f-9cdd-ac2113032632-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:24:11 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-62cecdb5-3a7a-429d-ac20-124f787dfbbb tempest-ServersNegativeTestJSON-1671359082 tempest-ServersNegativeTestJSON-1671359082-project-member] Lock "777e49ea-b674-4c3f-9cdd-ac2113032632-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:24:11 user nova-compute[72382]: INFO nova.compute.manager [None req-62cecdb5-3a7a-429d-ac20-124f787dfbbb tempest-ServersNegativeTestJSON-1671359082 tempest-ServersNegativeTestJSON-1671359082-project-member] [instance: 777e49ea-b674-4c3f-9cdd-ac2113032632] Terminating instance
Aug 09 15:24:11 user nova-compute[72382]: DEBUG nova.compute.manager [None req-62cecdb5-3a7a-429d-ac20-124f787dfbbb tempest-ServersNegativeTestJSON-1671359082 tempest-ServersNegativeTestJSON-1671359082-project-member] [instance: 777e49ea-b674-4c3f-9cdd-ac2113032632] Start destroying the instance on the hypervisor. {{(pid=72382) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 15:24:11 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance f780040f-b789-4b72-8986-813c7b9fe4a6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:24:11 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance 777e49ea-b674-4c3f-9cdd-ac2113032632 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:24:11 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance 44afd1bf-fa5c-4b3e-8752-b16853fef54e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:24:11 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance 266be814-4a2b-4f8e-a0f6-e8821fdeb95d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:24:11 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance 0f510d75-5d1e-4a5c-b38f-731c299f0f5a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:24:11 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance 8aa35482-60b8-4185-b14d-a2667fd3b5b7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:24:11 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance 83ebfda8-235d-4404-a973-991d75ae2bf6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:24:11 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance 6296ba5d-bcc6-405a-a635-0e9aa6114f7b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:24:11 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance 0f4908de-d65d-4d17-ad36-6124a5e64a19 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:24:11 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance 6ea8f68c-3dc1-45ac-a7f3-bca32f929add actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:24:11 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance 61976531-76ae-4a1c-8950-0af784be376e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:24:11 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:24:11 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=72382) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 15:24:11 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=72382) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 15:24:11 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-c146d421-ccfb-4ab2-b6a4-c08dcd99cca4 tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:24:11 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:24:11 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:24:12 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:24:12 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:24:12 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:24:12 user nova-compute[72382]: INFO nova.virt.libvirt.driver [-] [instance: 777e49ea-b674-4c3f-9cdd-ac2113032632] Instance destroyed successfully.
Aug 09 15:24:12 user nova-compute[72382]: DEBUG nova.objects.instance [None req-62cecdb5-3a7a-429d-ac20-124f787dfbbb tempest-ServersNegativeTestJSON-1671359082 tempest-ServersNegativeTestJSON-1671359082-project-member] Lazy-loading 'resources' on Instance uuid 777e49ea-b674-4c3f-9cdd-ac2113032632 {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:24:12 user nova-compute[72382]: DEBUG nova.virt.libvirt.vif [None req-62cecdb5-3a7a-429d-ac20-124f787dfbbb tempest-ServersNegativeTestJSON-1671359082 tempest-ServersNegativeTestJSON-1671359082-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T15:15:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1344356585',display_name='tempest-ServersNegativeTestJSON-server-1344356585',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1344356585',id=2,image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-09T15:15:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8995b21c93c24ab19fcfad5c4939509f',ramdisk_id='',reservation_id='r-6l53mf74',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1671359082',owner_user_name='tempest-ServersNegativeTestJSON-1671359082-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T15:15:34Z,user_data=None,user_id='5e4b3ed6be8f4c99ba979398388bf12d',uuid=777e49ea-b674-4c3f-9cdd-ac2113032632,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "80b78279-76f9-46c8-a54d-413116bc37c6", "address": "fa:16:3e:37:26:34", "network": {"id": "32d8bb03-1dc6-499b-8b79-48938664dd3b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1565950502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8995b21c93c24ab19fcfad5c4939509f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80b78279-76", "ovs_interfaceid": "80b78279-76f9-46c8-a54d-413116bc37c6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 15:24:12 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-62cecdb5-3a7a-429d-ac20-124f787dfbbb tempest-ServersNegativeTestJSON-1671359082 tempest-ServersNegativeTestJSON-1671359082-project-member] Converting VIF {"id": "80b78279-76f9-46c8-a54d-413116bc37c6", "address": "fa:16:3e:37:26:34", "network": {"id": "32d8bb03-1dc6-499b-8b79-48938664dd3b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1565950502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8995b21c93c24ab19fcfad5c4939509f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80b78279-76", "ovs_interfaceid": "80b78279-76f9-46c8-a54d-413116bc37c6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 15:24:12 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-62cecdb5-3a7a-429d-ac20-124f787dfbbb tempest-ServersNegativeTestJSON-1671359082 tempest-ServersNegativeTestJSON-1671359082-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:37:26:34,bridge_name='br-int',has_traffic_filtering=True,id=80b78279-76f9-46c8-a54d-413116bc37c6,network=Network(32d8bb03-1dc6-499b-8b79-48938664dd3b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80b78279-76') {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 15:24:12 user nova-compute[72382]: DEBUG os_vif [None req-62cecdb5-3a7a-429d-ac20-124f787dfbbb tempest-ServersNegativeTestJSON-1671359082 tempest-ServersNegativeTestJSON-1671359082-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:37:26:34,bridge_name='br-int',has_traffic_filtering=True,id=80b78279-76f9-46c8-a54d-413116bc37c6,network=Network(32d8bb03-1dc6-499b-8b79-48938664dd3b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80b78279-76') {{(pid=72382) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 15:24:12 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:24:12 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap80b78279-76, bridge=br-int, if_exists=True) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:24:12 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:24:12 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:24:12 user nova-compute[72382]: INFO os_vif [None req-62cecdb5-3a7a-429d-ac20-124f787dfbbb tempest-ServersNegativeTestJSON-1671359082 tempest-ServersNegativeTestJSON-1671359082-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:37:26:34,bridge_name='br-int',has_traffic_filtering=True,id=80b78279-76f9-46c8-a54d-413116bc37c6,network=Network(32d8bb03-1dc6-499b-8b79-48938664dd3b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80b78279-76')
Aug 09 15:24:12 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-62cecdb5-3a7a-429d-ac20-124f787dfbbb tempest-ServersNegativeTestJSON-1671359082 tempest-ServersNegativeTestJSON-1671359082-project-member] [instance: 777e49ea-b674-4c3f-9cdd-ac2113032632] Deleting instance files /opt/stack/data/nova/instances/777e49ea-b674-4c3f-9cdd-ac2113032632_del
Aug 09 15:24:12 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-62cecdb5-3a7a-429d-ac20-124f787dfbbb tempest-ServersNegativeTestJSON-1671359082 tempest-ServersNegativeTestJSON-1671359082-project-member] [instance: 777e49ea-b674-4c3f-9cdd-ac2113032632] Deletion of /opt/stack/data/nova/instances/777e49ea-b674-4c3f-9cdd-ac2113032632_del complete
Aug 09 15:24:12 user nova-compute[72382]: DEBUG nova.compute.provider_tree [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Inventory has not changed in ProviderTree for provider: 7b15b0e5-df4d-49db-833b-2855d21d10ae {{(pid=72382) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 15:24:12 user nova-compute[72382]: DEBUG nova.scheduler.client.report [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Inventory has not changed for provider 7b15b0e5-df4d-49db-833b-2855d21d10ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72382) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 15:24:12 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Compute_service record updated for user:user {{(pid=72382) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 15:24:12 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.906s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:24:12 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-c146d421-ccfb-4ab2-b6a4-c08dcd99cca4 tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.688s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:24:12 user nova-compute[72382]: INFO nova.compute.manager [None req-62cecdb5-3a7a-429d-ac20-124f787dfbbb tempest-ServersNegativeTestJSON-1671359082 tempest-ServersNegativeTestJSON-1671359082-project-member] [instance: 777e49ea-b674-4c3f-9cdd-ac2113032632] Took 0.77 seconds to destroy the instance on the hypervisor.
Aug 09 15:24:12 user nova-compute[72382]: DEBUG oslo.service.loopingcall [None req-62cecdb5-3a7a-429d-ac20-124f787dfbbb tempest-ServersNegativeTestJSON-1671359082 tempest-ServersNegativeTestJSON-1671359082-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72382) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 15:24:12 user nova-compute[72382]: DEBUG nova.compute.manager [-] [instance: 777e49ea-b674-4c3f-9cdd-ac2113032632] Deallocating network for instance {{(pid=72382) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 15:24:12 user nova-compute[72382]: DEBUG nova.network.neutron [-] [instance: 777e49ea-b674-4c3f-9cdd-ac2113032632] deallocate_for_instance() {{(pid=72382) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 15:24:12 user nova-compute[72382]: DEBUG nova.compute.manager [req-daf3e546-bf92-411a-b84c-a49bd6c9c9fc req-07b4a349-7a2d-4c81-9c2c-6cf749938050 service nova] [instance: 777e49ea-b674-4c3f-9cdd-ac2113032632] Received event network-vif-unplugged-80b78279-76f9-46c8-a54d-413116bc37c6 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:24:12 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-daf3e546-bf92-411a-b84c-a49bd6c9c9fc req-07b4a349-7a2d-4c81-9c2c-6cf749938050 service nova] Acquiring lock "777e49ea-b674-4c3f-9cdd-ac2113032632-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:24:12 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-daf3e546-bf92-411a-b84c-a49bd6c9c9fc req-07b4a349-7a2d-4c81-9c2c-6cf749938050 service nova] Lock "777e49ea-b674-4c3f-9cdd-ac2113032632-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:24:12 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-daf3e546-bf92-411a-b84c-a49bd6c9c9fc req-07b4a349-7a2d-4c81-9c2c-6cf749938050 service nova] Lock "777e49ea-b674-4c3f-9cdd-ac2113032632-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:24:12 user nova-compute[72382]: DEBUG nova.compute.manager [req-daf3e546-bf92-411a-b84c-a49bd6c9c9fc req-07b4a349-7a2d-4c81-9c2c-6cf749938050 service nova] [instance: 777e49ea-b674-4c3f-9cdd-ac2113032632] No waiting events found dispatching network-vif-unplugged-80b78279-76f9-46c8-a54d-413116bc37c6 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:24:12 user nova-compute[72382]: DEBUG nova.compute.manager [req-daf3e546-bf92-411a-b84c-a49bd6c9c9fc req-07b4a349-7a2d-4c81-9c2c-6cf749938050 service nova] [instance: 777e49ea-b674-4c3f-9cdd-ac2113032632] Received event network-vif-unplugged-80b78279-76f9-46c8-a54d-413116bc37c6 for instance with task_state deleting. {{(pid=72382) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 15:24:12 user nova-compute[72382]: DEBUG nova.compute.manager [req-daf3e546-bf92-411a-b84c-a49bd6c9c9fc req-07b4a349-7a2d-4c81-9c2c-6cf749938050 service nova] [instance: 777e49ea-b674-4c3f-9cdd-ac2113032632] Received event network-vif-plugged-80b78279-76f9-46c8-a54d-413116bc37c6 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:24:12 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-daf3e546-bf92-411a-b84c-a49bd6c9c9fc req-07b4a349-7a2d-4c81-9c2c-6cf749938050 service nova] Acquiring lock "777e49ea-b674-4c3f-9cdd-ac2113032632-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:24:12 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-daf3e546-bf92-411a-b84c-a49bd6c9c9fc req-07b4a349-7a2d-4c81-9c2c-6cf749938050 service nova] Lock "777e49ea-b674-4c3f-9cdd-ac2113032632-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:24:12 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-daf3e546-bf92-411a-b84c-a49bd6c9c9fc req-07b4a349-7a2d-4c81-9c2c-6cf749938050 service nova] Lock "777e49ea-b674-4c3f-9cdd-ac2113032632-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:24:12 user nova-compute[72382]: DEBUG nova.compute.manager [req-daf3e546-bf92-411a-b84c-a49bd6c9c9fc req-07b4a349-7a2d-4c81-9c2c-6cf749938050 service nova] [instance: 777e49ea-b674-4c3f-9cdd-ac2113032632] No waiting events found dispatching network-vif-plugged-80b78279-76f9-46c8-a54d-413116bc37c6 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:24:12 user nova-compute[72382]: WARNING nova.compute.manager [req-daf3e546-bf92-411a-b84c-a49bd6c9c9fc req-07b4a349-7a2d-4c81-9c2c-6cf749938050 service nova] [instance: 777e49ea-b674-4c3f-9cdd-ac2113032632] Received unexpected event network-vif-plugged-80b78279-76f9-46c8-a54d-413116bc37c6 for instance with vm_state active and task_state deleting.
Aug 09 15:24:12 user nova-compute[72382]: DEBUG nova.compute.provider_tree [None req-c146d421-ccfb-4ab2-b6a4-c08dcd99cca4 tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] Inventory has not changed in ProviderTree for provider: 7b15b0e5-df4d-49db-833b-2855d21d10ae {{(pid=72382) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 15:24:13 user nova-compute[72382]: DEBUG nova.scheduler.client.report [None req-c146d421-ccfb-4ab2-b6a4-c08dcd99cca4 tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] Inventory has not changed for provider 7b15b0e5-df4d-49db-833b-2855d21d10ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72382) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 15:24:13 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-c146d421-ccfb-4ab2-b6a4-c08dcd99cca4 tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.423s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:24:13 user nova-compute[72382]: INFO nova.scheduler.client.report [None req-c146d421-ccfb-4ab2-b6a4-c08dcd99cca4 tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] Deleted allocations for instance 83ebfda8-235d-4404-a973-991d75ae2bf6
Aug 09 15:24:13 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-c146d421-ccfb-4ab2-b6a4-c08dcd99cca4 tempest-ServerActionsV293TestJSON-1877173112 tempest-ServerActionsV293TestJSON-1877173112-project-member] Lock "83ebfda8-235d-4404-a973-991d75ae2bf6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.803s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:24:13 user nova-compute[72382]: DEBUG nova.network.neutron [-] [instance: 777e49ea-b674-4c3f-9cdd-ac2113032632] Updating instance_info_cache with network_info: [] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:24:13 user nova-compute[72382]: INFO nova.compute.manager [-] [instance: 777e49ea-b674-4c3f-9cdd-ac2113032632] Took 0.69 seconds to deallocate network for instance.
Aug 09 15:24:13 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-62cecdb5-3a7a-429d-ac20-124f787dfbbb tempest-ServersNegativeTestJSON-1671359082 tempest-ServersNegativeTestJSON-1671359082-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:24:13 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-62cecdb5-3a7a-429d-ac20-124f787dfbbb tempest-ServersNegativeTestJSON-1671359082 tempest-ServersNegativeTestJSON-1671359082-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:24:13 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:24:13 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:24:13 user nova-compute[72382]: DEBUG nova.compute.manager [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Starting heal instance info cache {{(pid=72382) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 15:24:13 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Acquiring lock "refresh_cache-777e49ea-b674-4c3f-9cdd-ac2113032632" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 15:24:13 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Acquired lock "refresh_cache-777e49ea-b674-4c3f-9cdd-ac2113032632" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 15:24:13 user nova-compute[72382]: DEBUG nova.network.neutron [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] [instance: 777e49ea-b674-4c3f-9cdd-ac2113032632] Forcefully refreshing network info cache for instance {{(pid=72382) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 15:24:13 user nova-compute[72382]: DEBUG nova.compute.provider_tree [None req-62cecdb5-3a7a-429d-ac20-124f787dfbbb tempest-ServersNegativeTestJSON-1671359082 tempest-ServersNegativeTestJSON-1671359082-project-member] Inventory has not changed in ProviderTree for provider: 7b15b0e5-df4d-49db-833b-2855d21d10ae {{(pid=72382) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 15:24:13 user nova-compute[72382]: DEBUG nova.scheduler.client.report [None req-62cecdb5-3a7a-429d-ac20-124f787dfbbb tempest-ServersNegativeTestJSON-1671359082 tempest-ServersNegativeTestJSON-1671359082-project-member] Inventory has not changed for provider 7b15b0e5-df4d-49db-833b-2855d21d10ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72382) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 15:24:13 user nova-compute[72382]: DEBUG nova.network.neutron [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] [instance: 777e49ea-b674-4c3f-9cdd-ac2113032632] Instance cache missing network info. {{(pid=72382) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 15:24:13 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-62cecdb5-3a7a-429d-ac20-124f787dfbbb tempest-ServersNegativeTestJSON-1671359082 tempest-ServersNegativeTestJSON-1671359082-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.384s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:24:13 user nova-compute[72382]: INFO nova.scheduler.client.report [None req-62cecdb5-3a7a-429d-ac20-124f787dfbbb tempest-ServersNegativeTestJSON-1671359082 tempest-ServersNegativeTestJSON-1671359082-project-member] Deleted allocations for instance 777e49ea-b674-4c3f-9cdd-ac2113032632
Aug 09 15:24:13 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-62cecdb5-3a7a-429d-ac20-124f787dfbbb tempest-ServersNegativeTestJSON-1671359082 tempest-ServersNegativeTestJSON-1671359082-project-member] Lock "777e49ea-b674-4c3f-9cdd-ac2113032632" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.048s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:24:13 user nova-compute[72382]: DEBUG nova.network.neutron [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] [instance: 777e49ea-b674-4c3f-9cdd-ac2113032632] Updating instance_info_cache with network_info: [] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:24:13 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Releasing lock "refresh_cache-777e49ea-b674-4c3f-9cdd-ac2113032632" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 15:24:13 user nova-compute[72382]: DEBUG nova.compute.manager [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] [instance: 777e49ea-b674-4c3f-9cdd-ac2113032632] Updated the network info_cache for instance {{(pid=72382) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 15:24:13 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:24:13 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:24:13 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:24:13 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:24:13 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:24:13 user nova-compute[72382]: DEBUG nova.compute.manager [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72382) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 15:24:14 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:24:15 user nova-compute[72382]: DEBUG nova.compute.manager [req-3807ec30-39d2-436e-9928-a8a62d1faa77 req-a33b4318-433d-4f08-a9e5-f185d5dac5e5 service nova] [instance: 777e49ea-b674-4c3f-9cdd-ac2113032632] Received event network-vif-deleted-80b78279-76f9-46c8-a54d-413116bc37c6 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:24:17 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:24:18 user nova-compute[72382]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691594643.9467456, c9766433-4c5a-40ed-a212-715a24f42b91 => Stopped> {{(pid=72382) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 15:24:18 user nova-compute[72382]: INFO nova.compute.manager [-] [instance: c9766433-4c5a-40ed-a212-715a24f42b91] VM Stopped (Lifecycle Event)
Aug 09 15:24:18 user nova-compute[72382]: DEBUG nova.compute.manager [None req-38bb728c-7b67-414b-b94c-0da0d85e9074 None None] [instance: c9766433-4c5a-40ed-a212-715a24f42b91] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:24:19 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:24:22 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:24:24 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:24:24 user nova-compute[72382]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691594649.2160466, 83ebfda8-235d-4404-a973-991d75ae2bf6 => Stopped> {{(pid=72382) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 15:24:24 user nova-compute[72382]: INFO nova.compute.manager [-] [instance: 83ebfda8-235d-4404-a973-991d75ae2bf6] VM Stopped (Lifecycle Event)
Aug 09 15:24:24 user nova-compute[72382]: DEBUG nova.compute.manager [None req-e4635161-ef2d-4637-97f2-374c7f349a02 None None] [instance: 83ebfda8-235d-4404-a973-991d75ae2bf6] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:24:25 user nova-compute[72382]: DEBUG nova.compute.manager [req-2852bcae-94f1-4a33-82ce-4ddc1ae915d3 req-e8cc8443-0840-4002-83fc-25304157c98b service nova] [instance: 6296ba5d-bcc6-405a-a635-0e9aa6114f7b] Received event network-changed-dc2f667c-53dc-44b5-bd9d-55b4e9a4c86b {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:24:25 user nova-compute[72382]: DEBUG nova.compute.manager [req-2852bcae-94f1-4a33-82ce-4ddc1ae915d3 req-e8cc8443-0840-4002-83fc-25304157c98b service nova] [instance: 6296ba5d-bcc6-405a-a635-0e9aa6114f7b] Refreshing instance network info cache due to event network-changed-dc2f667c-53dc-44b5-bd9d-55b4e9a4c86b. {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 15:24:25 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-2852bcae-94f1-4a33-82ce-4ddc1ae915d3 req-e8cc8443-0840-4002-83fc-25304157c98b service nova] Acquiring lock "refresh_cache-6296ba5d-bcc6-405a-a635-0e9aa6114f7b" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 15:24:25 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-2852bcae-94f1-4a33-82ce-4ddc1ae915d3 req-e8cc8443-0840-4002-83fc-25304157c98b service nova] Acquired lock "refresh_cache-6296ba5d-bcc6-405a-a635-0e9aa6114f7b" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 15:24:25 user nova-compute[72382]: DEBUG nova.network.neutron [req-2852bcae-94f1-4a33-82ce-4ddc1ae915d3 req-e8cc8443-0840-4002-83fc-25304157c98b service nova] [instance: 6296ba5d-bcc6-405a-a635-0e9aa6114f7b] Refreshing network info cache for port dc2f667c-53dc-44b5-bd9d-55b4e9a4c86b {{(pid=72382) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 15:24:25 user nova-compute[72382]: DEBUG nova.network.neutron [req-2852bcae-94f1-4a33-82ce-4ddc1ae915d3 req-e8cc8443-0840-4002-83fc-25304157c98b service nova] [instance: 6296ba5d-bcc6-405a-a635-0e9aa6114f7b] Updated VIF entry in instance network info cache for port dc2f667c-53dc-44b5-bd9d-55b4e9a4c86b. {{(pid=72382) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 15:24:25 user nova-compute[72382]: DEBUG nova.network.neutron [req-2852bcae-94f1-4a33-82ce-4ddc1ae915d3 req-e8cc8443-0840-4002-83fc-25304157c98b service nova] [instance: 6296ba5d-bcc6-405a-a635-0e9aa6114f7b] Updating instance_info_cache with network_info: [{"id": "dc2f667c-53dc-44b5-bd9d-55b4e9a4c86b", "address": "fa:16:3e:0b:83:7d", "network": {"id": "db8ab944-48c5-49d7-8f11-1216b54c6ea6", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1491766949-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca3091c1fc764326b65d9db6f1de9746", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc2f667c-53", "ovs_interfaceid": "dc2f667c-53dc-44b5-bd9d-55b4e9a4c86b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:24:25 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-2852bcae-94f1-4a33-82ce-4ddc1ae915d3 req-e8cc8443-0840-4002-83fc-25304157c98b service nova] Releasing lock "refresh_cache-6296ba5d-bcc6-405a-a635-0e9aa6114f7b" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 15:24:27 user nova-compute[72382]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691594652.4551358, 777e49ea-b674-4c3f-9cdd-ac2113032632 => Stopped> {{(pid=72382) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 15:24:27 user nova-compute[72382]: INFO nova.compute.manager [-] [instance: 777e49ea-b674-4c3f-9cdd-ac2113032632] VM Stopped (Lifecycle Event)
Aug 09 15:24:27 user nova-compute[72382]: DEBUG nova.compute.manager [None req-a16dfe73-b3c4-4c8c-91a1-8b39c66981a1 None None] [instance: 777e49ea-b674-4c3f-9cdd-ac2113032632] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:24:27 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:24:29 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:24:29 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-1c6fc057-5f65-456f-9e81-5244ac670e11 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] Acquiring lock "6296ba5d-bcc6-405a-a635-0e9aa6114f7b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:24:29 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-1c6fc057-5f65-456f-9e81-5244ac670e11 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] Lock "6296ba5d-bcc6-405a-a635-0e9aa6114f7b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:24:29 user nova-compute[72382]: DEBUG nova.objects.instance [None req-1c6fc057-5f65-456f-9e81-5244ac670e11 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] Lazy-loading 'flavor' on Instance uuid 6296ba5d-bcc6-405a-a635-0e9aa6114f7b {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:24:29 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-1c6fc057-5f65-456f-9e81-5244ac670e11 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] Lock "6296ba5d-bcc6-405a-a635-0e9aa6114f7b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.048s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:24:29 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-1c6fc057-5f65-456f-9e81-5244ac670e11 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] Acquiring lock "6296ba5d-bcc6-405a-a635-0e9aa6114f7b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:24:29 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-1c6fc057-5f65-456f-9e81-5244ac670e11 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] Lock "6296ba5d-bcc6-405a-a635-0e9aa6114f7b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:24:29 user nova-compute[72382]: INFO nova.compute.manager [None req-1c6fc057-5f65-456f-9e81-5244ac670e11 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] [instance: 6296ba5d-bcc6-405a-a635-0e9aa6114f7b] Attaching volume 438204eb-d445-4273-ba10-445288db31dd to /dev/vdb
Aug 09 15:24:29 user nova-compute[72382]: DEBUG os_brick.utils [None req-1c6fc057-5f65-456f-9e81-5244ac670e11 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 15:24:29 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:24:29 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:24:29 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[df01e0f2-3a89-474d-8c87-0e39c257782b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d2cfa7015fe\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:24:29 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:24:30 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:24:30 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[894d4cff-6f97-42af-9076-123408a97aa8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:24:30 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:24:30 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:24:30 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[93c14fd9-f478-4457-a90f-0430118653a6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:24:30 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[da82d5ca-7130-4ff4-b138-59794edcf906]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:24:30 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-1c6fc057-5f65-456f-9e81-5244ac670e11 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] Running cmd (subprocess): nvme version {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:24:30 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-1c6fc057-5f65-456f-9e81-5244ac670e11 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] 'nvme version' failed. Not Retrying. {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 15:24:30 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1c6fc057-5f65-456f-9e81-5244ac670e11 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] nvme not present on system {{(pid=72382) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 15:24:30 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:24:30 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 15:24:30 user nova-compute[72382]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 15:24:30 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[72d73c4d-9688-4812-a46a-14f6b20d0cc2]: (4, '') {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:24:30 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.lightos [None req-1c6fc057-5f65-456f-9e81-5244ac670e11 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72382) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 15:24:30 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.lightos [None req-1c6fc057-5f65-456f-9e81-5244ac670e11 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72382) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 15:24:30 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.lightos [None req-1c6fc057-5f65-456f-9e81-5244ac670e11 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] LIGHTOS: no hostnqn found. {{(pid=72382) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 15:24:30 user nova-compute[72382]: DEBUG os_brick.utils [None req-1c6fc057-5f65-456f-9e81-5244ac670e11 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d2cfa7015fe', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 15:24:30 user nova-compute[72382]: DEBUG nova.virt.block_device [None req-1c6fc057-5f65-456f-9e81-5244ac670e11 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] [instance: 6296ba5d-bcc6-405a-a635-0e9aa6114f7b] Updating existing volume attachment record: 011d0aed-68c6-4014-acce-87d7a52f1fc9 {{(pid=72382) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 15:24:32 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:24:33 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:24:33 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:24:34 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:24:37 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:24:37 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:24:38 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1c6fc057-5f65-456f-9e81-5244ac670e11 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] [instance: 6296ba5d-bcc6-405a-a635-0e9aa6114f7b] Calling os-brick to attach iSCSI Volume {{(pid=72382) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 15:24:38 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c6fc057-5f65-456f-9e81-5244ac670e11 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2a0c768340>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:438204eb-d445-4273-ba10-445288db31dd'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lkYcPtgv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 15:24:38 user nova-compute[72382]: WARNING os_brick.initiator.connectors.base [None req-1c6fc057-5f65-456f-9e81-5244ac670e11 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 15:24:38 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-1c6fc057-5f65-456f-9e81-5244ac670e11 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 15:24:38 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-1c6fc057-5f65-456f-9e81-5244ac670e11 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 15:24:38 user nova-compute[72382]: WARNING os_brick.initiator.connectors.base [None req-1c6fc057-5f65-456f-9e81-5244ac670e11 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 15:24:38 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-1c6fc057-5f65-456f-9e81-5244ac670e11 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:438204eb-d445-4273-ba10-445288db31dd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 15:24:38 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-1c6fc057-5f65-456f-9e81-5244ac670e11 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:438204eb-d445-4273-ba10-445288db31dd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 15:24:38 user nova-compute[72382]: INFO os_brick.initiator.connectors.iscsi [None req-1c6fc057-5f65-456f-9e81-5244ac670e11 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 15:24:38 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:438204eb-d445-4273-ba10-445288db31dd -p 172.16.0.220:3260 {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:24:38 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:438204eb-d445-4273-ba10-445288db31dd -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:24:38 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[0670b0e0-01a8-4795-a7c8-d7bb1204e7f8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:24:38 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c6fc057-5f65-456f-9e81-5244ac670e11 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 15:24:38 user nova-compute[72382]:  {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:24:38 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:438204eb-d445-4273-ba10-445288db31dd -p 172.16.0.220:3260 --interface default --op new {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:24:38 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:438204eb-d445-4273-ba10-445288db31dd -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:24:38 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[28346c74-bd62-42e5-8578-b4018a49147c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:438204eb-d445-4273-ba10-445288db31dd] added\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:24:38 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c6fc057-5f65-456f-9e81-5244ac670e11 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:438204eb-d445-4273-ba10-445288db31dd] added
Aug 09 15:24:38 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:24:38 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:438204eb-d445-4273-ba10-445288db31dd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:24:38 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:438204eb-d445-4273-ba10-445288db31dd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:24:38 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7de4a97-eddf-4676-88af-dc490e9d0d4c]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:24:38 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c6fc057-5f65-456f-9e81-5244ac670e11 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:24:38 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:438204eb-d445-4273-ba10-445288db31dd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:24:38 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:438204eb-d445-4273-ba10-445288db31dd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:24:38 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[5263d239-653d-420d-9e19-d7926b5cf488]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:24:38 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c6fc057-5f65-456f-9e81-5244ac670e11 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:24:38 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:438204eb-d445-4273-ba10-445288db31dd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lkYcPtgv {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:24:38 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:438204eb-d445-4273-ba10-445288db31dd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lkYcPtgv" returned: 0 in 0.019s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:24:38 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1c50fa1-94ef-4058-9996-e7a920ea46db]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:24:38 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c6fc057-5f65-456f-9e81-5244ac670e11 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lkYcPtgv'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:24:38 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:438204eb-d445-4273-ba10-445288db31dd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:24:38 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:438204eb-d445-4273-ba10-445288db31dd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:24:38 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9f86808-60d3-488c-9e24-92737db19cfa]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:24:38 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c6fc057-5f65-456f-9e81-5244ac670e11 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:24:38 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:24:38 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:24:38 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[da6afdf4-56ed-460f-ae62-63069cbf1762]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0052e86d-16a7-4cbe-a802-ff770c0e20ba (non-flash)\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:24:38 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c6fc057-5f65-456f-9e81-5244ac670e11 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)
Aug 09 15:24:38 user nova-compute[72382]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0052e86d-16a7-4cbe-a802-ff770c0e20ba (non-flash)
Aug 09 15:24:38 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 15:24:38 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c6fc057-5f65-456f-9e81-5244ac670e11 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)
Aug 09 15:24:38 user nova-compute[72382]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0052e86d-16a7-4cbe-a802-ff770c0e20ba (non-flash)
Aug 09 15:24:38 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 15:24:38 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:438204eb-d445-4273-ba10-445288db31dd -p 172.16.0.220:3260 --login {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:24:38 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:438204eb-d445-4273-ba10-445288db31dd -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:24:38 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[5de5763c-8a4e-4833-9ebf-bdcf6f098aa4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:438204eb-d445-4273-ba10-445288db31dd, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:438204eb-d445-4273-ba10-445288db31dd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:24:38 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c6fc057-5f65-456f-9e81-5244ac670e11 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:438204eb-d445-4273-ba10-445288db31dd, portal: 172.16.0.220,3260]
Aug 09 15:24:38 user nova-compute[72382]: Login to [iface: default, target: iqn.2010-10.org.openstack:438204eb-d445-4273-ba10-445288db31dd, portal: 172.16.0.220,3260] successful.
Aug 09 15:24:38 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:24:38 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:438204eb-d445-4273-ba10-445288db31dd -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:24:38 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:438204eb-d445-4273-ba10-445288db31dd -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:24:38 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[44c3f2bc-e912-4da6-8daf-7c9125fdfd88]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:24:38 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c6fc057-5f65-456f-9e81-5244ac670e11 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:24:38 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:24:38 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:24:38 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[956c7b23-1830-4aaf-83c6-6d0c0f09478b]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0052e86d-16a7-4cbe-a802-ff770c0e20ba (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:438204eb-d445-4273-ba10-445288db31dd (non-flash)\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:24:38 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c6fc057-5f65-456f-9e81-5244ac670e11 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)
Aug 09 15:24:38 user nova-compute[72382]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0052e86d-16a7-4cbe-a802-ff770c0e20ba (non-flash)
Aug 09 15:24:38 user nova-compute[72382]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:438204eb-d445-4273-ba10-445288db31dd (non-flash)
Aug 09 15:24:38 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 15:24:38 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c6fc057-5f65-456f-9e81-5244ac670e11 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)
Aug 09 15:24:38 user nova-compute[72382]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0052e86d-16a7-4cbe-a802-ff770c0e20ba (non-flash)
Aug 09 15:24:38 user nova-compute[72382]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:438204eb-d445-4273-ba10-445288db31dd (non-flash)
Aug 09 15:24:38 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 15:24:38 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-1c6fc057-5f65-456f-9e81-5244ac670e11 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:438204eb-d445-4273-ba10-445288db31dd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.291s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 15:24:38 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c6fc057-5f65-456f-9e81-5244ac670e11 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] Connected to 172.16.0.220:3260 {{(pid=72382) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 15:24:38 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-1c6fc057-5f65-456f-9e81-5244ac670e11 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] HCTL ('33', '-', '-', 0) found on session 26 with lun 0 {{(pid=72382) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 15:24:38 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-1c6fc057-5f65-456f-9e81-5244ac670e11 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72382) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 15:24:38 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:24:38 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:24:38 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cb121f1-00bb-4cb0-8545-dc014f2bbbcd]: (4, ('- - 0', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:24:38 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-1c6fc057-5f65-456f-9e81-5244ac670e11 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] Searching for a device in session 26 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72382) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 15:24:38 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c6fc057-5f65-456f-9e81-5244ac670e11 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lkYcPtgv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72382) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 15:24:39 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-1c6fc057-5f65-456f-9e81-5244ac670e11 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.328s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 15:24:39 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c6fc057-5f65-456f-9e81-5244ac670e11 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] <== connect_volume: return (1330ms) {'type': 'block', 'scsi_wwn': '23931643065383935', 'path': '/dev/sdb'} {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 15:24:39 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1c6fc057-5f65-456f-9e81-5244ac670e11 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] [instance: 6296ba5d-bcc6-405a-a635-0e9aa6114f7b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23931643065383935', 'path': '/dev/sdb'} {{(pid=72382) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 15:24:39 user nova-compute[72382]: DEBUG nova.objects.instance [None req-1c6fc057-5f65-456f-9e81-5244ac670e11 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] Lazy-loading 'flavor' on Instance uuid 6296ba5d-bcc6-405a-a635-0e9aa6114f7b {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:24:39 user nova-compute[72382]: DEBUG nova.virt.libvirt.guest [None req-1c6fc057-5f65-456f-9e81-5244ac670e11 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 15:24:39 user nova-compute[72382]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 15:24:39 user nova-compute[72382]:   <source dev="/dev/sdb"/>
Aug 09 15:24:39 user nova-compute[72382]:   <target dev="vdb" bus="virtio"/>
Aug 09 15:24:39 user nova-compute[72382]:   <serial>438204eb-d445-4273-ba10-445288db31dd</serial>
Aug 09 15:24:39 user nova-compute[72382]: </disk>
Aug 09 15:24:39 user nova-compute[72382]:  {{(pid=72382) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 15:24:40 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-1c6fc057-5f65-456f-9e81-5244ac670e11 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] No BDM found with device name vda, not building metadata. {{(pid=72382) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 15:24:40 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-1c6fc057-5f65-456f-9e81-5244ac670e11 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72382) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 15:24:40 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-1c6fc057-5f65-456f-9e81-5244ac670e11 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] No VIF found with MAC fa:16:3e:0b:83:7d, not building metadata {{(pid=72382) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 15:24:40 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-1c6fc057-5f65-456f-9e81-5244ac670e11 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] Lock "6296ba5d-bcc6-405a-a635-0e9aa6114f7b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.467s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:24:42 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:24:42 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:24:42 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72382) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 15:24:42 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72382) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 15:24:42 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72382) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 15:24:42 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:24:44 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:24:47 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:24:49 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:24:52 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:24:53 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-a62d0473-d414-4ba6-982c-094ed418c0d0 tempest-DeleteServersTestJSON-520676128 tempest-DeleteServersTestJSON-520676128-project-member] Acquiring lock "0f4908de-d65d-4d17-ad36-6124a5e64a19" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:24:53 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-a62d0473-d414-4ba6-982c-094ed418c0d0 tempest-DeleteServersTestJSON-520676128 tempest-DeleteServersTestJSON-520676128-project-member] Lock "0f4908de-d65d-4d17-ad36-6124a5e64a19" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:24:53 user nova-compute[72382]: DEBUG nova.objects.instance [None req-a62d0473-d414-4ba6-982c-094ed418c0d0 tempest-DeleteServersTestJSON-520676128 tempest-DeleteServersTestJSON-520676128-project-member] Lazy-loading 'flavor' on Instance uuid 0f4908de-d65d-4d17-ad36-6124a5e64a19 {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:24:53 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-a62d0473-d414-4ba6-982c-094ed418c0d0 tempest-DeleteServersTestJSON-520676128 tempest-DeleteServersTestJSON-520676128-project-member] Lock "0f4908de-d65d-4d17-ad36-6124a5e64a19" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:24:53 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-a62d0473-d414-4ba6-982c-094ed418c0d0 tempest-DeleteServersTestJSON-520676128 tempest-DeleteServersTestJSON-520676128-project-member] Acquiring lock "0f4908de-d65d-4d17-ad36-6124a5e64a19" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:24:53 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-a62d0473-d414-4ba6-982c-094ed418c0d0 tempest-DeleteServersTestJSON-520676128 tempest-DeleteServersTestJSON-520676128-project-member] Lock "0f4908de-d65d-4d17-ad36-6124a5e64a19" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:24:53 user nova-compute[72382]: INFO nova.compute.manager [None req-a62d0473-d414-4ba6-982c-094ed418c0d0 tempest-DeleteServersTestJSON-520676128 tempest-DeleteServersTestJSON-520676128-project-member] [instance: 0f4908de-d65d-4d17-ad36-6124a5e64a19] Attaching volume 2dd20257-3fec-41ef-b6e8-d8bd62011a8d to /dev/vdb
Aug 09 15:24:53 user nova-compute[72382]: DEBUG os_brick.utils [None req-a62d0473-d414-4ba6-982c-094ed418c0d0 tempest-DeleteServersTestJSON-520676128 tempest-DeleteServersTestJSON-520676128-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 15:24:53 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:24:53 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:24:53 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9356053-29e2-472d-9c40-53ed6f6524f1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d2cfa7015fe\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:24:53 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:24:53 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.023s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:24:53 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[294f5a66-c0bb-4ed4-b10c-b977d2052d28]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:24:53 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:24:53 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:24:53 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[8673f23c-fed7-4932-a382-a6c7f9ae3935]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:24:53 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[cafb9ea2-6fe5-42d0-840a-8876aa515310]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:24:53 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-a62d0473-d414-4ba6-982c-094ed418c0d0 tempest-DeleteServersTestJSON-520676128 tempest-DeleteServersTestJSON-520676128-project-member] Running cmd (subprocess): nvme version {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:24:53 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-a62d0473-d414-4ba6-982c-094ed418c0d0 tempest-DeleteServersTestJSON-520676128 tempest-DeleteServersTestJSON-520676128-project-member] 'nvme version' failed. Not Retrying. {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 15:24:53 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a62d0473-d414-4ba6-982c-094ed418c0d0 tempest-DeleteServersTestJSON-520676128 tempest-DeleteServersTestJSON-520676128-project-member] nvme not present on system {{(pid=72382) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 15:24:53 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:24:53 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 15:24:53 user nova-compute[72382]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 15:24:53 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ec55440-5534-4bac-91d9-f40cf858cae2]: (4, '') {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:24:53 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.lightos [None req-a62d0473-d414-4ba6-982c-094ed418c0d0 tempest-DeleteServersTestJSON-520676128 tempest-DeleteServersTestJSON-520676128-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72382) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 15:24:53 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.lightos [None req-a62d0473-d414-4ba6-982c-094ed418c0d0 tempest-DeleteServersTestJSON-520676128 tempest-DeleteServersTestJSON-520676128-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72382) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 15:24:53 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.lightos [None req-a62d0473-d414-4ba6-982c-094ed418c0d0 tempest-DeleteServersTestJSON-520676128 tempest-DeleteServersTestJSON-520676128-project-member] LIGHTOS: no hostnqn found. {{(pid=72382) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 15:24:53 user nova-compute[72382]: DEBUG os_brick.utils [None req-a62d0473-d414-4ba6-982c-094ed418c0d0 tempest-DeleteServersTestJSON-520676128 tempest-DeleteServersTestJSON-520676128-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d2cfa7015fe', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 15:24:53 user nova-compute[72382]: DEBUG nova.virt.block_device [None req-a62d0473-d414-4ba6-982c-094ed418c0d0 tempest-DeleteServersTestJSON-520676128 tempest-DeleteServersTestJSON-520676128-project-member] [instance: 0f4908de-d65d-4d17-ad36-6124a5e64a19] Updating existing volume attachment record: 1f040d96-074d-49d6-a39c-93e7975a4e98 {{(pid=72382) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 15:24:54 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:24:57 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:24:59 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:24:59 user nova-compute[72382]: INFO nova.compute.manager [None req-6dfd24d1-3bea-4ae9-922d-369faf992d94 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] [instance: 8aa35482-60b8-4185-b14d-a2667fd3b5b7] Unrescuing
Aug 09 15:24:59 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-6dfd24d1-3bea-4ae9-922d-369faf992d94 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] Acquiring lock "refresh_cache-8aa35482-60b8-4185-b14d-a2667fd3b5b7" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 15:24:59 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-6dfd24d1-3bea-4ae9-922d-369faf992d94 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] Acquired lock "refresh_cache-8aa35482-60b8-4185-b14d-a2667fd3b5b7" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 15:24:59 user nova-compute[72382]: DEBUG nova.network.neutron [None req-6dfd24d1-3bea-4ae9-922d-369faf992d94 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] [instance: 8aa35482-60b8-4185-b14d-a2667fd3b5b7] Building network info cache for instance {{(pid=72382) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 15:25:00 user nova-compute[72382]: DEBUG nova.network.neutron [None req-6dfd24d1-3bea-4ae9-922d-369faf992d94 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] [instance: 8aa35482-60b8-4185-b14d-a2667fd3b5b7] Updating instance_info_cache with network_info: [{"id": "b4902494-07bb-48a3-b0f8-26115f2b04d6", "address": "fa:16:3e:d9:46:4b", "network": {"id": "effdc019-a66a-4e9b-a99c-4a7c5b715201", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-414399276-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.250", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bab7a1ba67749ba85f0785846ce0338", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4902494-07", "ovs_interfaceid": "b4902494-07bb-48a3-b0f8-26115f2b04d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:25:00 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-6dfd24d1-3bea-4ae9-922d-369faf992d94 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] Releasing lock "refresh_cache-8aa35482-60b8-4185-b14d-a2667fd3b5b7" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 15:25:00 user nova-compute[72382]: DEBUG nova.objects.instance [None req-6dfd24d1-3bea-4ae9-922d-369faf992d94 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] Lazy-loading 'flavor' on Instance uuid 8aa35482-60b8-4185-b14d-a2667fd3b5b7 {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:25:01 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:25:01 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:25:01 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:25:01 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:25:01 user nova-compute[72382]: DEBUG nova.compute.manager [req-cb983157-b2d8-475e-b354-19a33d1980cd req-f752bf21-fab4-47a1-9a76-bb1a222b99aa service nova] [instance: 8aa35482-60b8-4185-b14d-a2667fd3b5b7] Received event network-vif-unplugged-b4902494-07bb-48a3-b0f8-26115f2b04d6 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:25:01 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-cb983157-b2d8-475e-b354-19a33d1980cd req-f752bf21-fab4-47a1-9a76-bb1a222b99aa service nova] Acquiring lock "8aa35482-60b8-4185-b14d-a2667fd3b5b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:25:01 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-cb983157-b2d8-475e-b354-19a33d1980cd req-f752bf21-fab4-47a1-9a76-bb1a222b99aa service nova] Lock "8aa35482-60b8-4185-b14d-a2667fd3b5b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:25:01 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-cb983157-b2d8-475e-b354-19a33d1980cd req-f752bf21-fab4-47a1-9a76-bb1a222b99aa service nova] Lock "8aa35482-60b8-4185-b14d-a2667fd3b5b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:25:01 user nova-compute[72382]: DEBUG nova.compute.manager [req-cb983157-b2d8-475e-b354-19a33d1980cd req-f752bf21-fab4-47a1-9a76-bb1a222b99aa service nova] [instance: 8aa35482-60b8-4185-b14d-a2667fd3b5b7] No waiting events found dispatching network-vif-unplugged-b4902494-07bb-48a3-b0f8-26115f2b04d6 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:25:01 user nova-compute[72382]: WARNING nova.compute.manager [req-cb983157-b2d8-475e-b354-19a33d1980cd req-f752bf21-fab4-47a1-9a76-bb1a222b99aa service nova] [instance: 8aa35482-60b8-4185-b14d-a2667fd3b5b7] Received unexpected event network-vif-unplugged-b4902494-07bb-48a3-b0f8-26115f2b04d6 for instance with vm_state rescued and task_state unrescuing.
Aug 09 15:25:01 user nova-compute[72382]: INFO nova.virt.libvirt.driver [-] [instance: 8aa35482-60b8-4185-b14d-a2667fd3b5b7] Instance destroyed successfully.
Aug 09 15:25:02 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:25:03 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:25:03 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:25:03 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:25:03 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:25:03 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a62d0473-d414-4ba6-982c-094ed418c0d0 tempest-DeleteServersTestJSON-520676128 tempest-DeleteServersTestJSON-520676128-project-member] [instance: 0f4908de-d65d-4d17-ad36-6124a5e64a19] Calling os-brick to attach iSCSI Volume {{(pid=72382) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 15:25:03 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-a62d0473-d414-4ba6-982c-094ed418c0d0 tempest-DeleteServersTestJSON-520676128 tempest-DeleteServersTestJSON-520676128-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2a0c768340>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:2dd20257-3fec-41ef-b6e8-d8bd62011a8d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ahyutOsI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 15:25:03 user nova-compute[72382]: WARNING os_brick.initiator.connectors.base [None req-a62d0473-d414-4ba6-982c-094ed418c0d0 tempest-DeleteServersTestJSON-520676128 tempest-DeleteServersTestJSON-520676128-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 15:25:03 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-a62d0473-d414-4ba6-982c-094ed418c0d0 tempest-DeleteServersTestJSON-520676128 tempest-DeleteServersTestJSON-520676128-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 15:25:03 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-a62d0473-d414-4ba6-982c-094ed418c0d0 tempest-DeleteServersTestJSON-520676128 tempest-DeleteServersTestJSON-520676128-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 15:25:03 user nova-compute[72382]: WARNING os_brick.initiator.connectors.base [None req-a62d0473-d414-4ba6-982c-094ed418c0d0 tempest-DeleteServersTestJSON-520676128 tempest-DeleteServersTestJSON-520676128-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 15:25:03 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-a62d0473-d414-4ba6-982c-094ed418c0d0 tempest-DeleteServersTestJSON-520676128 tempest-DeleteServersTestJSON-520676128-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2dd20257-3fec-41ef-b6e8-d8bd62011a8d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 15:25:03 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-a62d0473-d414-4ba6-982c-094ed418c0d0 tempest-DeleteServersTestJSON-520676128 tempest-DeleteServersTestJSON-520676128-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2dd20257-3fec-41ef-b6e8-d8bd62011a8d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 15:25:03 user nova-compute[72382]: INFO os_brick.initiator.connectors.iscsi [None req-a62d0473-d414-4ba6-982c-094ed418c0d0 tempest-DeleteServersTestJSON-520676128 tempest-DeleteServersTestJSON-520676128-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 15:25:03 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2dd20257-3fec-41ef-b6e8-d8bd62011a8d -p 172.16.0.220:3260 {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:25:03 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2dd20257-3fec-41ef-b6e8-d8bd62011a8d -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:25:03 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[79fa3de0-9da6-4494-bcfc-0666ef960bcd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:25:03 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-a62d0473-d414-4ba6-982c-094ed418c0d0 tempest-DeleteServersTestJSON-520676128 tempest-DeleteServersTestJSON-520676128-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 15:25:03 user nova-compute[72382]:  {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:25:03 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2dd20257-3fec-41ef-b6e8-d8bd62011a8d -p 172.16.0.220:3260 --interface default --op new {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:25:03 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2dd20257-3fec-41ef-b6e8-d8bd62011a8d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:25:03 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e57a728-d2fc-41e4-b216-b274808b6c50]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2dd20257-3fec-41ef-b6e8-d8bd62011a8d] added\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:25:03 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-a62d0473-d414-4ba6-982c-094ed418c0d0 tempest-DeleteServersTestJSON-520676128 tempest-DeleteServersTestJSON-520676128-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2dd20257-3fec-41ef-b6e8-d8bd62011a8d] added
Aug 09 15:25:03 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:25:03 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2dd20257-3fec-41ef-b6e8-d8bd62011a8d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:25:03 user nova-compute[72382]: DEBUG nova.compute.manager [req-4f2e068b-ef4f-4181-89bc-84b7d7d07c13 req-c8af00a5-23c8-4008-b957-e544822e41ef service nova] [instance: 8aa35482-60b8-4185-b14d-a2667fd3b5b7] Received event network-vif-plugged-b4902494-07bb-48a3-b0f8-26115f2b04d6 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:25:03 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-4f2e068b-ef4f-4181-89bc-84b7d7d07c13 req-c8af00a5-23c8-4008-b957-e544822e41ef service nova] Acquiring lock "8aa35482-60b8-4185-b14d-a2667fd3b5b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:25:03 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-4f2e068b-ef4f-4181-89bc-84b7d7d07c13 req-c8af00a5-23c8-4008-b957-e544822e41ef service nova] Lock "8aa35482-60b8-4185-b14d-a2667fd3b5b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:25:03 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-4f2e068b-ef4f-4181-89bc-84b7d7d07c13 req-c8af00a5-23c8-4008-b957-e544822e41ef service nova] Lock "8aa35482-60b8-4185-b14d-a2667fd3b5b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:25:03 user nova-compute[72382]: DEBUG nova.compute.manager [req-4f2e068b-ef4f-4181-89bc-84b7d7d07c13 req-c8af00a5-23c8-4008-b957-e544822e41ef service nova] [instance: 8aa35482-60b8-4185-b14d-a2667fd3b5b7] No waiting events found dispatching network-vif-plugged-b4902494-07bb-48a3-b0f8-26115f2b04d6 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:25:03 user nova-compute[72382]: WARNING nova.compute.manager [req-4f2e068b-ef4f-4181-89bc-84b7d7d07c13 req-c8af00a5-23c8-4008-b957-e544822e41ef service nova] [instance: 8aa35482-60b8-4185-b14d-a2667fd3b5b7] Received unexpected event network-vif-plugged-b4902494-07bb-48a3-b0f8-26115f2b04d6 for instance with vm_state rescued and task_state unrescuing.
Aug 09 15:25:03 user nova-compute[72382]: DEBUG nova.compute.manager [req-4f2e068b-ef4f-4181-89bc-84b7d7d07c13 req-c8af00a5-23c8-4008-b957-e544822e41ef service nova] [instance: 8aa35482-60b8-4185-b14d-a2667fd3b5b7] Received event network-changed-b4902494-07bb-48a3-b0f8-26115f2b04d6 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:25:03 user nova-compute[72382]: DEBUG nova.compute.manager [req-4f2e068b-ef4f-4181-89bc-84b7d7d07c13 req-c8af00a5-23c8-4008-b957-e544822e41ef service nova] [instance: 8aa35482-60b8-4185-b14d-a2667fd3b5b7] Refreshing instance network info cache due to event network-changed-b4902494-07bb-48a3-b0f8-26115f2b04d6. {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 15:25:03 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-4f2e068b-ef4f-4181-89bc-84b7d7d07c13 req-c8af00a5-23c8-4008-b957-e544822e41ef service nova] Acquiring lock "refresh_cache-8aa35482-60b8-4185-b14d-a2667fd3b5b7" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 15:25:03 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-4f2e068b-ef4f-4181-89bc-84b7d7d07c13 req-c8af00a5-23c8-4008-b957-e544822e41ef service nova] Acquired lock "refresh_cache-8aa35482-60b8-4185-b14d-a2667fd3b5b7" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 15:25:03 user nova-compute[72382]: DEBUG nova.network.neutron [req-4f2e068b-ef4f-4181-89bc-84b7d7d07c13 req-c8af00a5-23c8-4008-b957-e544822e41ef service nova] [instance: 8aa35482-60b8-4185-b14d-a2667fd3b5b7] Refreshing network info cache for port b4902494-07bb-48a3-b0f8-26115f2b04d6 {{(pid=72382) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 15:25:03 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2dd20257-3fec-41ef-b6e8-d8bd62011a8d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:25:03 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d941255-6079-4c43-a903-11303f880128]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:25:03 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-a62d0473-d414-4ba6-982c-094ed418c0d0 tempest-DeleteServersTestJSON-520676128 tempest-DeleteServersTestJSON-520676128-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:25:03 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2dd20257-3fec-41ef-b6e8-d8bd62011a8d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:25:03 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2dd20257-3fec-41ef-b6e8-d8bd62011a8d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:25:03 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e9a9a35-fac6-4695-88f3-dc055a5dbfb3]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:25:03 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-a62d0473-d414-4ba6-982c-094ed418c0d0 tempest-DeleteServersTestJSON-520676128 tempest-DeleteServersTestJSON-520676128-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:25:03 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2dd20257-3fec-41ef-b6e8-d8bd62011a8d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ahyutOsI {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:25:03 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2dd20257-3fec-41ef-b6e8-d8bd62011a8d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ahyutOsI" returned: 0 in 0.024s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:25:03 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e5f5ff4-ddff-418b-aa69-2f638f6ec094]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:25:03 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-a62d0473-d414-4ba6-982c-094ed418c0d0 tempest-DeleteServersTestJSON-520676128 tempest-DeleteServersTestJSON-520676128-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ahyutOsI'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:25:03 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2dd20257-3fec-41ef-b6e8-d8bd62011a8d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:25:03 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2dd20257-3fec-41ef-b6e8-d8bd62011a8d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:25:03 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9ea01b6-76de-4436-b249-6c97e2eb28bd]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:25:03 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-a62d0473-d414-4ba6-982c-094ed418c0d0 tempest-DeleteServersTestJSON-520676128 tempest-DeleteServersTestJSON-520676128-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:25:03 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:25:03 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:25:03 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f1f5b78-970a-4c13-917c-f87f4206968c]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0052e86d-16a7-4cbe-a802-ff770c0e20ba (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:438204eb-d445-4273-ba10-445288db31dd (non-flash)\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:25:03 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-a62d0473-d414-4ba6-982c-094ed418c0d0 tempest-DeleteServersTestJSON-520676128 tempest-DeleteServersTestJSON-520676128-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)
Aug 09 15:25:03 user nova-compute[72382]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0052e86d-16a7-4cbe-a802-ff770c0e20ba (non-flash)
Aug 09 15:25:03 user nova-compute[72382]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:438204eb-d445-4273-ba10-445288db31dd (non-flash)
Aug 09 15:25:03 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 15:25:03 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-a62d0473-d414-4ba6-982c-094ed418c0d0 tempest-DeleteServersTestJSON-520676128 tempest-DeleteServersTestJSON-520676128-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)
Aug 09 15:25:03 user nova-compute[72382]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0052e86d-16a7-4cbe-a802-ff770c0e20ba (non-flash)
Aug 09 15:25:03 user nova-compute[72382]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:438204eb-d445-4273-ba10-445288db31dd (non-flash)
Aug 09 15:25:03 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 15:25:03 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2dd20257-3fec-41ef-b6e8-d8bd62011a8d -p 172.16.0.220:3260 --login {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:25:03 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:25:04 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2dd20257-3fec-41ef-b6e8-d8bd62011a8d -p 172.16.0.220:3260 --login" returned: 0 in 0.085s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:25:04 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[c90b0941-a1ac-411f-b60f-7c1a40991842]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2dd20257-3fec-41ef-b6e8-d8bd62011a8d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2dd20257-3fec-41ef-b6e8-d8bd62011a8d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:25:04 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-a62d0473-d414-4ba6-982c-094ed418c0d0 tempest-DeleteServersTestJSON-520676128 tempest-DeleteServersTestJSON-520676128-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2dd20257-3fec-41ef-b6e8-d8bd62011a8d, portal: 172.16.0.220,3260]
Aug 09 15:25:04 user nova-compute[72382]: Login to [iface: default, target: iqn.2010-10.org.openstack:2dd20257-3fec-41ef-b6e8-d8bd62011a8d, portal: 172.16.0.220,3260] successful.
Aug 09 15:25:04 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:25:04 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2dd20257-3fec-41ef-b6e8-d8bd62011a8d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:25:04 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:25:04 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:25:04 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:25:04 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2dd20257-3fec-41ef-b6e8-d8bd62011a8d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:25:04 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[82432964-6a7a-42cf-aac9-8a96adca484e]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:25:04 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-a62d0473-d414-4ba6-982c-094ed418c0d0 tempest-DeleteServersTestJSON-520676128 tempest-DeleteServersTestJSON-520676128-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:25:04 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:25:04 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:25:04 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:25:04 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e4c138e-df8d-4fa6-a28f-dc0731df29e7]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0052e86d-16a7-4cbe-a802-ff770c0e20ba (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:438204eb-d445-4273-ba10-445288db31dd (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dd20257-3fec-41ef-b6e8-d8bd62011a8d (non-flash)\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:25:04 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-a62d0473-d414-4ba6-982c-094ed418c0d0 tempest-DeleteServersTestJSON-520676128 tempest-DeleteServersTestJSON-520676128-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)
Aug 09 15:25:04 user nova-compute[72382]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0052e86d-16a7-4cbe-a802-ff770c0e20ba (non-flash)
Aug 09 15:25:04 user nova-compute[72382]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:438204eb-d445-4273-ba10-445288db31dd (non-flash)
Aug 09 15:25:04 user nova-compute[72382]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dd20257-3fec-41ef-b6e8-d8bd62011a8d (non-flash)
Aug 09 15:25:04 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 15:25:04 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-a62d0473-d414-4ba6-982c-094ed418c0d0 tempest-DeleteServersTestJSON-520676128 tempest-DeleteServersTestJSON-520676128-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)
Aug 09 15:25:04 user nova-compute[72382]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0052e86d-16a7-4cbe-a802-ff770c0e20ba (non-flash)
Aug 09 15:25:04 user nova-compute[72382]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:438204eb-d445-4273-ba10-445288db31dd (non-flash)
Aug 09 15:25:04 user nova-compute[72382]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dd20257-3fec-41ef-b6e8-d8bd62011a8d (non-flash)
Aug 09 15:25:04 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 15:25:04 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-a62d0473-d414-4ba6-982c-094ed418c0d0 tempest-DeleteServersTestJSON-520676128 tempest-DeleteServersTestJSON-520676128-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2dd20257-3fec-41ef-b6e8-d8bd62011a8d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.404s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 15:25:04 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-a62d0473-d414-4ba6-982c-094ed418c0d0 tempest-DeleteServersTestJSON-520676128 tempest-DeleteServersTestJSON-520676128-project-member] Connected to 172.16.0.220:3260 {{(pid=72382) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 15:25:04 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-a62d0473-d414-4ba6-982c-094ed418c0d0 tempest-DeleteServersTestJSON-520676128 tempest-DeleteServersTestJSON-520676128-project-member] HCTL ('34', '-', '-', 0) found on session 27 with lun 0 {{(pid=72382) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 15:25:04 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-a62d0473-d414-4ba6-982c-094ed418c0d0 tempest-DeleteServersTestJSON-520676128 tempest-DeleteServersTestJSON-520676128-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72382) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 15:25:04 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:25:04 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:25:04 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[44c22295-3119-40bd-95b2-5886d4905cf1]: (4, ('- - 0', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:25:04 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-a62d0473-d414-4ba6-982c-094ed418c0d0 tempest-DeleteServersTestJSON-520676128 tempest-DeleteServersTestJSON-520676128-project-member] Searching for a device in session 27 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72382) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 15:25:04 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-a62d0473-d414-4ba6-982c-094ed418c0d0 tempest-DeleteServersTestJSON-520676128 tempest-DeleteServersTestJSON-520676128-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ahyutOsI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72382) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 15:25:04 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:25:04 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-ccc203df-641c-400b-9438-a2eedada5513 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] Acquiring lock "6296ba5d-bcc6-405a-a635-0e9aa6114f7b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:25:04 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-ccc203df-641c-400b-9438-a2eedada5513 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] Lock "6296ba5d-bcc6-405a-a635-0e9aa6114f7b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:25:04 user nova-compute[72382]: INFO nova.compute.manager [None req-ccc203df-641c-400b-9438-a2eedada5513 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] [instance: 6296ba5d-bcc6-405a-a635-0e9aa6114f7b] Detaching volume 438204eb-d445-4273-ba10-445288db31dd
Aug 09 15:25:04 user nova-compute[72382]: DEBUG nova.network.neutron [req-4f2e068b-ef4f-4181-89bc-84b7d7d07c13 req-c8af00a5-23c8-4008-b957-e544822e41ef service nova] [instance: 8aa35482-60b8-4185-b14d-a2667fd3b5b7] Updated VIF entry in instance network info cache for port b4902494-07bb-48a3-b0f8-26115f2b04d6. {{(pid=72382) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 15:25:04 user nova-compute[72382]: DEBUG nova.network.neutron [req-4f2e068b-ef4f-4181-89bc-84b7d7d07c13 req-c8af00a5-23c8-4008-b957-e544822e41ef service nova] [instance: 8aa35482-60b8-4185-b14d-a2667fd3b5b7] Updating instance_info_cache with network_info: [{"id": "b4902494-07bb-48a3-b0f8-26115f2b04d6", "address": "fa:16:3e:d9:46:4b", "network": {"id": "effdc019-a66a-4e9b-a99c-4a7c5b715201", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-414399276-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.250", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bab7a1ba67749ba85f0785846ce0338", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4902494-07", "ovs_interfaceid": "b4902494-07bb-48a3-b0f8-26115f2b04d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:25:04 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-4f2e068b-ef4f-4181-89bc-84b7d7d07c13 req-c8af00a5-23c8-4008-b957-e544822e41ef service nova] Releasing lock "refresh_cache-8aa35482-60b8-4185-b14d-a2667fd3b5b7" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 15:25:04 user nova-compute[72382]: DEBUG nova.compute.manager [req-4f2e068b-ef4f-4181-89bc-84b7d7d07c13 req-c8af00a5-23c8-4008-b957-e544822e41ef service nova] [instance: 8aa35482-60b8-4185-b14d-a2667fd3b5b7] Received event network-changed-b4902494-07bb-48a3-b0f8-26115f2b04d6 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:25:04 user nova-compute[72382]: DEBUG nova.compute.manager [req-4f2e068b-ef4f-4181-89bc-84b7d7d07c13 req-c8af00a5-23c8-4008-b957-e544822e41ef service nova] [instance: 8aa35482-60b8-4185-b14d-a2667fd3b5b7] Refreshing instance network info cache due to event network-changed-b4902494-07bb-48a3-b0f8-26115f2b04d6. {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 15:25:04 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-4f2e068b-ef4f-4181-89bc-84b7d7d07c13 req-c8af00a5-23c8-4008-b957-e544822e41ef service nova] Acquiring lock "refresh_cache-8aa35482-60b8-4185-b14d-a2667fd3b5b7" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 15:25:04 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-4f2e068b-ef4f-4181-89bc-84b7d7d07c13 req-c8af00a5-23c8-4008-b957-e544822e41ef service nova] Acquired lock "refresh_cache-8aa35482-60b8-4185-b14d-a2667fd3b5b7" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 15:25:04 user nova-compute[72382]: DEBUG nova.network.neutron [req-4f2e068b-ef4f-4181-89bc-84b7d7d07c13 req-c8af00a5-23c8-4008-b957-e544822e41ef service nova] [instance: 8aa35482-60b8-4185-b14d-a2667fd3b5b7] Refreshing network info cache for port b4902494-07bb-48a3-b0f8-26115f2b04d6 {{(pid=72382) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 15:25:04 user nova-compute[72382]: INFO nova.virt.block_device [None req-ccc203df-641c-400b-9438-a2eedada5513 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] [instance: 6296ba5d-bcc6-405a-a635-0e9aa6114f7b] Attempting to driver detach volume 438204eb-d445-4273-ba10-445288db31dd from mountpoint /dev/vdb
Aug 09 15:25:04 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-ccc203df-641c-400b-9438-a2eedada5513 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] Attempting to detach device vdb from instance 6296ba5d-bcc6-405a-a635-0e9aa6114f7b from the persistent domain config. {{(pid=72382) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 15:25:04 user nova-compute[72382]: DEBUG nova.virt.libvirt.guest [None req-ccc203df-641c-400b-9438-a2eedada5513 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 15:25:04 user nova-compute[72382]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 15:25:04 user nova-compute[72382]:   <source dev="/dev/sdb"/>
Aug 09 15:25:04 user nova-compute[72382]:   <target dev="vdb" bus="virtio"/>
Aug 09 15:25:04 user nova-compute[72382]:   <serial>438204eb-d445-4273-ba10-445288db31dd</serial>
Aug 09 15:25:04 user nova-compute[72382]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 15:25:04 user nova-compute[72382]: </disk>
Aug 09 15:25:04 user nova-compute[72382]:  {{(pid=72382) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 15:25:04 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-ccc203df-641c-400b-9438-a2eedada5513 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] Successfully detached device vdb from instance 6296ba5d-bcc6-405a-a635-0e9aa6114f7b from the persistent domain config.
Aug 09 15:25:04 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-ccc203df-641c-400b-9438-a2eedada5513 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 6296ba5d-bcc6-405a-a635-0e9aa6114f7b from the live domain config. {{(pid=72382) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 15:25:04 user nova-compute[72382]: DEBUG nova.virt.libvirt.guest [None req-ccc203df-641c-400b-9438-a2eedada5513 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 15:25:04 user nova-compute[72382]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 15:25:04 user nova-compute[72382]:   <source dev="/dev/sdb"/>
Aug 09 15:25:04 user nova-compute[72382]:   <target dev="vdb" bus="virtio"/>
Aug 09 15:25:04 user nova-compute[72382]:   <serial>438204eb-d445-4273-ba10-445288db31dd</serial>
Aug 09 15:25:04 user nova-compute[72382]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 15:25:04 user nova-compute[72382]: </disk>
Aug 09 15:25:04 user nova-compute[72382]:  {{(pid=72382) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 15:25:05 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Received event <DeviceRemovedEvent: 1691594705.0832212, 6296ba5d-bcc6-405a-a635-0e9aa6114f7b => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72382) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 15:25:05 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-ccc203df-641c-400b-9438-a2eedada5513 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 6296ba5d-bcc6-405a-a635-0e9aa6114f7b {{(pid=72382) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 15:25:05 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-ccc203df-641c-400b-9438-a2eedada5513 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] Successfully detached device vdb from instance 6296ba5d-bcc6-405a-a635-0e9aa6114f7b from the live domain config.
Aug 09 15:25:05 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ccc203df-641c-400b-9438-a2eedada5513 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] [instance: 6296ba5d-bcc6-405a-a635-0e9aa6114f7b] calling os-brick to detach iSCSI Volume {{(pid=72382) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 15:25:05 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccc203df-641c-400b-9438-a2eedada5513 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2a0c768340>, {'target_iqns': ['iqn.2010-10.org.openstack:438204eb-d445-4273-ba10-445288db31dd'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lkYcPtgv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 15:25:05 user nova-compute[72382]: WARNING os_brick.initiator.connectors.base [None req-ccc203df-641c-400b-9438-a2eedada5513 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 15:25:05 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-ccc203df-641c-400b-9438-a2eedada5513 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 15:25:05 user nova-compute[72382]: DEBUG nova.network.neutron [req-4f2e068b-ef4f-4181-89bc-84b7d7d07c13 req-c8af00a5-23c8-4008-b957-e544822e41ef service nova] [instance: 8aa35482-60b8-4185-b14d-a2667fd3b5b7] Updated VIF entry in instance network info cache for port b4902494-07bb-48a3-b0f8-26115f2b04d6. {{(pid=72382) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 15:25:05 user nova-compute[72382]: DEBUG nova.network.neutron [req-4f2e068b-ef4f-4181-89bc-84b7d7d07c13 req-c8af00a5-23c8-4008-b957-e544822e41ef service nova] [instance: 8aa35482-60b8-4185-b14d-a2667fd3b5b7] Updating instance_info_cache with network_info: [{"id": "b4902494-07bb-48a3-b0f8-26115f2b04d6", "address": "fa:16:3e:d9:46:4b", "network": {"id": "effdc019-a66a-4e9b-a99c-4a7c5b715201", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-414399276-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.250", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bab7a1ba67749ba85f0785846ce0338", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4902494-07", "ovs_interfaceid": "b4902494-07bb-48a3-b0f8-26115f2b04d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:25:05 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-a62d0473-d414-4ba6-982c-094ed418c0d0 tempest-DeleteServersTestJSON-520676128 tempest-DeleteServersTestJSON-520676128-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.444s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 15:25:05 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-a62d0473-d414-4ba6-982c-094ed418c0d0 tempest-DeleteServersTestJSON-520676128 tempest-DeleteServersTestJSON-520676128-project-member] <== connect_volume: return (1446ms) {'type': 'block', 'scsi_wwn': '23933646239306232', 'path': '/dev/sdc'} {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 15:25:05 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a62d0473-d414-4ba6-982c-094ed418c0d0 tempest-DeleteServersTestJSON-520676128 tempest-DeleteServersTestJSON-520676128-project-member] [instance: 0f4908de-d65d-4d17-ad36-6124a5e64a19] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23933646239306232', 'path': '/dev/sdc'} {{(pid=72382) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 15:25:05 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-ccc203df-641c-400b-9438-a2eedada5513 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.012s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 15:25:05 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccc203df-641c-400b-9438-a2eedada5513 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:438204eb-d445-4273-ba10-445288db31dd', 0)] {{(pid=72382) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 15:25:05 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:25:05 user nova-compute[72382]: DEBUG nova.objects.instance [None req-a62d0473-d414-4ba6-982c-094ed418c0d0 tempest-DeleteServersTestJSON-520676128 tempest-DeleteServersTestJSON-520676128-project-member] Lazy-loading 'flavor' on Instance uuid 0f4908de-d65d-4d17-ad36-6124a5e64a19 {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:25:05 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-4f2e068b-ef4f-4181-89bc-84b7d7d07c13 req-c8af00a5-23c8-4008-b957-e544822e41ef service nova] Releasing lock "refresh_cache-8aa35482-60b8-4185-b14d-a2667fd3b5b7" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 15:25:05 user nova-compute[72382]: DEBUG nova.compute.manager [req-4f2e068b-ef4f-4181-89bc-84b7d7d07c13 req-c8af00a5-23c8-4008-b957-e544822e41ef service nova] [instance: 8aa35482-60b8-4185-b14d-a2667fd3b5b7] Received event network-vif-plugged-b4902494-07bb-48a3-b0f8-26115f2b04d6 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:25:05 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-4f2e068b-ef4f-4181-89bc-84b7d7d07c13 req-c8af00a5-23c8-4008-b957-e544822e41ef service nova] Acquiring lock "8aa35482-60b8-4185-b14d-a2667fd3b5b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:25:05 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-4f2e068b-ef4f-4181-89bc-84b7d7d07c13 req-c8af00a5-23c8-4008-b957-e544822e41ef service nova] Lock "8aa35482-60b8-4185-b14d-a2667fd3b5b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:25:05 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-4f2e068b-ef4f-4181-89bc-84b7d7d07c13 req-c8af00a5-23c8-4008-b957-e544822e41ef service nova] Lock "8aa35482-60b8-4185-b14d-a2667fd3b5b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:25:05 user nova-compute[72382]: DEBUG nova.compute.manager [req-4f2e068b-ef4f-4181-89bc-84b7d7d07c13 req-c8af00a5-23c8-4008-b957-e544822e41ef service nova] [instance: 8aa35482-60b8-4185-b14d-a2667fd3b5b7] No waiting events found dispatching network-vif-plugged-b4902494-07bb-48a3-b0f8-26115f2b04d6 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:25:05 user nova-compute[72382]: WARNING nova.compute.manager [req-4f2e068b-ef4f-4181-89bc-84b7d7d07c13 req-c8af00a5-23c8-4008-b957-e544822e41ef service nova] [instance: 8aa35482-60b8-4185-b14d-a2667fd3b5b7] Received unexpected event network-vif-plugged-b4902494-07bb-48a3-b0f8-26115f2b04d6 for instance with vm_state rescued and task_state unrescuing.
Aug 09 15:25:05 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:25:05 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[901f9f21-1e4d-4ae3-939e-90ad58c70aff]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0052e86d-16a7-4cbe-a802-ff770c0e20ba\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2dd20257-3fec-41ef-b6e8-d8bd62011a8d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:438204eb-d445-4273-ba10-445288db31dd\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:25:05 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:25:05 user nova-compute[72382]: DEBUG nova.virt.libvirt.guest [None req-a62d0473-d414-4ba6-982c-094ed418c0d0 tempest-DeleteServersTestJSON-520676128 tempest-DeleteServersTestJSON-520676128-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 15:25:05 user nova-compute[72382]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 15:25:05 user nova-compute[72382]:   <source dev="/dev/sdc"/>
Aug 09 15:25:05 user nova-compute[72382]:   <target dev="vdb" bus="virtio"/>
Aug 09 15:25:05 user nova-compute[72382]:   <serial>2dd20257-3fec-41ef-b6e8-d8bd62011a8d</serial>
Aug 09 15:25:05 user nova-compute[72382]: </disk>
Aug 09 15:25:05 user nova-compute[72382]:  {{(pid=72382) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 15:25:05 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:25:05 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[345ef7cb-8b97-4cb7-beda-fae2896693c9]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0052e86d-16a7-4cbe-a802-ff770c0e20ba (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:438204eb-d445-4273-ba10-445288db31dd (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dd20257-3fec-41ef-b6e8-d8bd62011a8d (non-flash)\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:25:05 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccc203df-641c-400b-9438-a2eedada5513 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)
Aug 09 15:25:05 user nova-compute[72382]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0052e86d-16a7-4cbe-a802-ff770c0e20ba (non-flash)
Aug 09 15:25:05 user nova-compute[72382]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:438204eb-d445-4273-ba10-445288db31dd (non-flash)
Aug 09 15:25:05 user nova-compute[72382]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dd20257-3fec-41ef-b6e8-d8bd62011a8d (non-flash)
Aug 09 15:25:05 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 15:25:05 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccc203df-641c-400b-9438-a2eedada5513 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)
Aug 09 15:25:05 user nova-compute[72382]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0052e86d-16a7-4cbe-a802-ff770c0e20ba (non-flash)
Aug 09 15:25:05 user nova-compute[72382]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:438204eb-d445-4273-ba10-445288db31dd (non-flash)
Aug 09 15:25:05 user nova-compute[72382]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dd20257-3fec-41ef-b6e8-d8bd62011a8d (non-flash)
Aug 09 15:25:05 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 15:25:05 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccc203df-641c-400b-9438-a2eedada5513 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2a2439e5f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:438204eb-d445-4273-ba10-445288db31dd'): ({'sdb'}, set())}) {{(pid=72382) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 15:25:05 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-ccc203df-641c-400b-9438-a2eedada5513 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] Removing single pathed devices sdb {{(pid=72382) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 15:25:05 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:25:05 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:25:05 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[27c6fc91-193e-4f57-b556-27f035206e00]: (4, ('path checker states:\nup                  3\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:25:05 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:25:05 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.026s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:25:05 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c43296f-2642-4322-ba76-8618898e5e22]: (4, ('ok\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:25:05 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-ccc203df-641c-400b-9438-a2eedada5513 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] Flushing IO for device /dev/sdb {{(pid=72382) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 15:25:05 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:25:05 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.018s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:25:05 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9efb882-3c2b-4d74-952b-2181ba9ffb36]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:25:05 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-ccc203df-641c-400b-9438-a2eedada5513 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72382) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 15:25:05 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:25:05 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:25:05 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[f498599d-e988-46d4-b751-528c775d4e8a]: (4, ('1', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:25:05 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-ccc203df-641c-400b-9438-a2eedada5513 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72382) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 15:25:05 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-ccc203df-641c-400b-9438-a2eedada5513 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] SCSI volumes sdb have been removed. {{(pid=72382) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 15:25:05 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccc203df-641c-400b-9438-a2eedada5513 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:438204eb-d445-4273-ba10-445288db31dd')] {{(pid=72382) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 15:25:05 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:438204eb-d445-4273-ba10-445288db31dd -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:25:05 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:438204eb-d445-4273-ba10-445288db31dd -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:25:05 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[15c8f386-6ff3-42e5-a3ce-8fc1025f5f66]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:25:05 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccc203df-641c-400b-9438-a2eedada5513 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:25:05 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:438204eb-d445-4273-ba10-445288db31dd -p 172.16.0.220:3260 --logout {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:25:05 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:438204eb-d445-4273-ba10-445288db31dd -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:25:05 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[e71afdbb-ad15-4172-b5c8-79b98ad67bf4]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:438204eb-d445-4273-ba10-445288db31dd, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:438204eb-d445-4273-ba10-445288db31dd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:25:05 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccc203df-641c-400b-9438-a2eedada5513 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:438204eb-d445-4273-ba10-445288db31dd, portal: 172.16.0.220,3260]
Aug 09 15:25:05 user nova-compute[72382]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:438204eb-d445-4273-ba10-445288db31dd, portal: 172.16.0.220,3260] successful.
Aug 09 15:25:05 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:25:05 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:438204eb-d445-4273-ba10-445288db31dd -p 172.16.0.220:3260 --op delete {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:25:05 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:25:05 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:438204eb-d445-4273-ba10-445288db31dd -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:25:05 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[088946bd-490f-43a7-9357-810b589318e9]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:25:05 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccc203df-641c-400b-9438-a2eedada5513 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:25:05 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-ccc203df-641c-400b-9438-a2eedada5513 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.376s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 15:25:05 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccc203df-641c-400b-9438-a2eedada5513 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] <== disconnect_volume: return (388ms) None {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 15:25:05 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ccc203df-641c-400b-9438-a2eedada5513 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] [instance: 6296ba5d-bcc6-405a-a635-0e9aa6114f7b] Disconnected iSCSI Volume {{(pid=72382) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 15:25:05 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-a62d0473-d414-4ba6-982c-094ed418c0d0 tempest-DeleteServersTestJSON-520676128 tempest-DeleteServersTestJSON-520676128-project-member] No BDM found with device name vda, not building metadata. {{(pid=72382) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 15:25:05 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-a62d0473-d414-4ba6-982c-094ed418c0d0 tempest-DeleteServersTestJSON-520676128 tempest-DeleteServersTestJSON-520676128-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72382) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 15:25:05 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-a62d0473-d414-4ba6-982c-094ed418c0d0 tempest-DeleteServersTestJSON-520676128 tempest-DeleteServersTestJSON-520676128-project-member] No VIF found with MAC fa:16:3e:03:f5:7d, not building metadata {{(pid=72382) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 15:25:05 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Removed pending event for 8aa35482-60b8-4185-b14d-a2667fd3b5b7 due to event {{(pid=72382) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 09 15:25:05 user nova-compute[72382]: DEBUG nova.virt.driver [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Emitting event <LifecycleEvent: 1691594705.8163054, 8aa35482-60b8-4185-b14d-a2667fd3b5b7 => Resumed> {{(pid=72382) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 15:25:05 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 8aa35482-60b8-4185-b14d-a2667fd3b5b7] VM Resumed (Lifecycle Event)
Aug 09 15:25:05 user nova-compute[72382]: DEBUG nova.compute.manager [None req-6dfd24d1-3bea-4ae9-922d-369faf992d94 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] [instance: 8aa35482-60b8-4185-b14d-a2667fd3b5b7] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:25:05 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 8aa35482-60b8-4185-b14d-a2667fd3b5b7] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:25:05 user nova-compute[72382]: DEBUG nova.compute.manager [req-4605dfdf-b460-43f9-907b-a20dc03a66ad req-1b8db332-dc0b-4063-a3cd-e2b8811e4c71 service nova] [instance: 8aa35482-60b8-4185-b14d-a2667fd3b5b7] Received event network-vif-plugged-b4902494-07bb-48a3-b0f8-26115f2b04d6 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:25:05 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-4605dfdf-b460-43f9-907b-a20dc03a66ad req-1b8db332-dc0b-4063-a3cd-e2b8811e4c71 service nova] Acquiring lock "8aa35482-60b8-4185-b14d-a2667fd3b5b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:25:05 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-4605dfdf-b460-43f9-907b-a20dc03a66ad req-1b8db332-dc0b-4063-a3cd-e2b8811e4c71 service nova] Lock "8aa35482-60b8-4185-b14d-a2667fd3b5b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:25:05 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-4605dfdf-b460-43f9-907b-a20dc03a66ad req-1b8db332-dc0b-4063-a3cd-e2b8811e4c71 service nova] Lock "8aa35482-60b8-4185-b14d-a2667fd3b5b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:25:05 user nova-compute[72382]: DEBUG nova.compute.manager [req-4605dfdf-b460-43f9-907b-a20dc03a66ad req-1b8db332-dc0b-4063-a3cd-e2b8811e4c71 service nova] [instance: 8aa35482-60b8-4185-b14d-a2667fd3b5b7] No waiting events found dispatching network-vif-plugged-b4902494-07bb-48a3-b0f8-26115f2b04d6 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:25:05 user nova-compute[72382]: WARNING nova.compute.manager [req-4605dfdf-b460-43f9-907b-a20dc03a66ad req-1b8db332-dc0b-4063-a3cd-e2b8811e4c71 service nova] [instance: 8aa35482-60b8-4185-b14d-a2667fd3b5b7] Received unexpected event network-vif-plugged-b4902494-07bb-48a3-b0f8-26115f2b04d6 for instance with vm_state rescued and task_state unrescuing.
Aug 09 15:25:05 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-a62d0473-d414-4ba6-982c-094ed418c0d0 tempest-DeleteServersTestJSON-520676128 tempest-DeleteServersTestJSON-520676128-project-member] Lock "0f4908de-d65d-4d17-ad36-6124a5e64a19" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.205s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:25:05 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 8aa35482-60b8-4185-b14d-a2667fd3b5b7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72382) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 15:25:05 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 8aa35482-60b8-4185-b14d-a2667fd3b5b7] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 09 15:25:05 user nova-compute[72382]: DEBUG nova.virt.driver [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Emitting event <LifecycleEvent: 1691594705.8187685, 8aa35482-60b8-4185-b14d-a2667fd3b5b7 => Started> {{(pid=72382) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 15:25:05 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 8aa35482-60b8-4185-b14d-a2667fd3b5b7] VM Started (Lifecycle Event)
Aug 09 15:25:05 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 8aa35482-60b8-4185-b14d-a2667fd3b5b7] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:25:05 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 8aa35482-60b8-4185-b14d-a2667fd3b5b7] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72382) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 15:25:06 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:25:06 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-250fc22d-65b9-4b09-94bf-a03f36d44598 tempest-DeleteServersTestJSON-520676128 tempest-DeleteServersTestJSON-520676128-project-member] Acquiring lock "0f4908de-d65d-4d17-ad36-6124a5e64a19" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:25:06 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-250fc22d-65b9-4b09-94bf-a03f36d44598 tempest-DeleteServersTestJSON-520676128 tempest-DeleteServersTestJSON-520676128-project-member] Lock "0f4908de-d65d-4d17-ad36-6124a5e64a19" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:25:06 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-250fc22d-65b9-4b09-94bf-a03f36d44598 tempest-DeleteServersTestJSON-520676128 tempest-DeleteServersTestJSON-520676128-project-member] Acquiring lock "0f4908de-d65d-4d17-ad36-6124a5e64a19-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:25:07 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-250fc22d-65b9-4b09-94bf-a03f36d44598 tempest-DeleteServersTestJSON-520676128 tempest-DeleteServersTestJSON-520676128-project-member] Lock "0f4908de-d65d-4d17-ad36-6124a5e64a19-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:25:07 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-250fc22d-65b9-4b09-94bf-a03f36d44598 tempest-DeleteServersTestJSON-520676128 tempest-DeleteServersTestJSON-520676128-project-member] Lock "0f4908de-d65d-4d17-ad36-6124a5e64a19-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:25:07 user nova-compute[72382]: INFO nova.compute.manager [None req-250fc22d-65b9-4b09-94bf-a03f36d44598 tempest-DeleteServersTestJSON-520676128 tempest-DeleteServersTestJSON-520676128-project-member] [instance: 0f4908de-d65d-4d17-ad36-6124a5e64a19] Terminating instance
Aug 09 15:25:07 user nova-compute[72382]: DEBUG nova.compute.manager [None req-250fc22d-65b9-4b09-94bf-a03f36d44598 tempest-DeleteServersTestJSON-520676128 tempest-DeleteServersTestJSON-520676128-project-member] [instance: 0f4908de-d65d-4d17-ad36-6124a5e64a19] Start destroying the instance on the hypervisor. {{(pid=72382) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 15:25:07 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:25:07 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:25:07 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:25:07 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:25:07 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:25:07 user nova-compute[72382]: DEBUG nova.compute.manager [req-d7de5382-a185-424b-af85-c19375a39731 req-b0c178ac-db15-40fc-ba59-f8f6d6f37329 service nova] [instance: 0f4908de-d65d-4d17-ad36-6124a5e64a19] Received event network-vif-unplugged-c6dc07b5-9e80-43a1-a3a1-bb0db357fc94 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:25:07 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-d7de5382-a185-424b-af85-c19375a39731 req-b0c178ac-db15-40fc-ba59-f8f6d6f37329 service nova] Acquiring lock "0f4908de-d65d-4d17-ad36-6124a5e64a19-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:25:07 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-d7de5382-a185-424b-af85-c19375a39731 req-b0c178ac-db15-40fc-ba59-f8f6d6f37329 service nova] Lock "0f4908de-d65d-4d17-ad36-6124a5e64a19-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:25:07 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-d7de5382-a185-424b-af85-c19375a39731 req-b0c178ac-db15-40fc-ba59-f8f6d6f37329 service nova] Lock "0f4908de-d65d-4d17-ad36-6124a5e64a19-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:25:07 user nova-compute[72382]: DEBUG nova.compute.manager [req-d7de5382-a185-424b-af85-c19375a39731 req-b0c178ac-db15-40fc-ba59-f8f6d6f37329 service nova] [instance: 0f4908de-d65d-4d17-ad36-6124a5e64a19] No waiting events found dispatching network-vif-unplugged-c6dc07b5-9e80-43a1-a3a1-bb0db357fc94 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:25:07 user nova-compute[72382]: DEBUG nova.compute.manager [req-d7de5382-a185-424b-af85-c19375a39731 req-b0c178ac-db15-40fc-ba59-f8f6d6f37329 service nova] [instance: 0f4908de-d65d-4d17-ad36-6124a5e64a19] Received event network-vif-unplugged-c6dc07b5-9e80-43a1-a3a1-bb0db357fc94 for instance with task_state deleting. {{(pid=72382) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 15:25:07 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:25:07 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:25:07 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.003s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:25:07 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:25:07 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Auditing locally available compute resources for user (node: user) {{(pid=72382) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 15:25:08 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:25:08 user nova-compute[72382]: INFO nova.virt.libvirt.driver [-] [instance: 0f4908de-d65d-4d17-ad36-6124a5e64a19] Instance destroyed successfully.
Aug 09 15:25:08 user nova-compute[72382]: DEBUG nova.objects.instance [None req-250fc22d-65b9-4b09-94bf-a03f36d44598 tempest-DeleteServersTestJSON-520676128 tempest-DeleteServersTestJSON-520676128-project-member] Lazy-loading 'resources' on Instance uuid 0f4908de-d65d-4d17-ad36-6124a5e64a19 {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:25:08 user nova-compute[72382]: DEBUG nova.virt.libvirt.vif [None req-250fc22d-65b9-4b09-94bf-a03f36d44598 tempest-DeleteServersTestJSON-520676128 tempest-DeleteServersTestJSON-520676128-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T15:22:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1021649166',display_name='tempest-DeleteServersTestJSON-server-1021649166',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1021649166',id=21,image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-09T15:23:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1f05958ff44e4545bdfaac89613b0e09',ramdisk_id='',reservation_id='r-s7bid1ll',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-520676128',owner_user_name='tempest-DeleteServersTestJSON-520676128-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T15:23:06Z,user_data=None,user_id='7fbcd129370d45bdb96162fbf065cb83',uuid=0f4908de-d65d-4d17-ad36-6124a5e64a19,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c6dc07b5-9e80-43a1-a3a1-bb0db357fc94", "address": "fa:16:3e:03:f5:7d", "network": {"id": "6c9c326e-15d5-4342-b8c7-b1a27e14a34e", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-786712907-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f05958ff44e4545bdfaac89613b0e09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6dc07b5-9e", "ovs_interfaceid": "c6dc07b5-9e80-43a1-a3a1-bb0db357fc94", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 15:25:08 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-250fc22d-65b9-4b09-94bf-a03f36d44598 tempest-DeleteServersTestJSON-520676128 tempest-DeleteServersTestJSON-520676128-project-member] Converting VIF {"id": "c6dc07b5-9e80-43a1-a3a1-bb0db357fc94", "address": "fa:16:3e:03:f5:7d", "network": {"id": "6c9c326e-15d5-4342-b8c7-b1a27e14a34e", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-786712907-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f05958ff44e4545bdfaac89613b0e09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6dc07b5-9e", "ovs_interfaceid": "c6dc07b5-9e80-43a1-a3a1-bb0db357fc94", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 15:25:08 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-250fc22d-65b9-4b09-94bf-a03f36d44598 tempest-DeleteServersTestJSON-520676128 tempest-DeleteServersTestJSON-520676128-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:03:f5:7d,bridge_name='br-int',has_traffic_filtering=True,id=c6dc07b5-9e80-43a1-a3a1-bb0db357fc94,network=Network(6c9c326e-15d5-4342-b8c7-b1a27e14a34e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc6dc07b5-9e') {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 15:25:08 user nova-compute[72382]: DEBUG os_vif [None req-250fc22d-65b9-4b09-94bf-a03f36d44598 tempest-DeleteServersTestJSON-520676128 tempest-DeleteServersTestJSON-520676128-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:f5:7d,bridge_name='br-int',has_traffic_filtering=True,id=c6dc07b5-9e80-43a1-a3a1-bb0db357fc94,network=Network(6c9c326e-15d5-4342-b8c7-b1a27e14a34e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc6dc07b5-9e') {{(pid=72382) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 15:25:08 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:25:08 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc6dc07b5-9e, bridge=br-int, if_exists=True) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:25:08 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:25:08 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:25:08 user nova-compute[72382]: INFO os_vif [None req-250fc22d-65b9-4b09-94bf-a03f36d44598 tempest-DeleteServersTestJSON-520676128 tempest-DeleteServersTestJSON-520676128-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:f5:7d,bridge_name='br-int',has_traffic_filtering=True,id=c6dc07b5-9e80-43a1-a3a1-bb0db357fc94,network=Network(6c9c326e-15d5-4342-b8c7-b1a27e14a34e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc6dc07b5-9e')
Aug 09 15:25:08 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-250fc22d-65b9-4b09-94bf-a03f36d44598 tempest-DeleteServersTestJSON-520676128 tempest-DeleteServersTestJSON-520676128-project-member] [instance: 0f4908de-d65d-4d17-ad36-6124a5e64a19] calling os-brick to detach iSCSI Volume {{(pid=72382) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 15:25:08 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-250fc22d-65b9-4b09-94bf-a03f36d44598 tempest-DeleteServersTestJSON-520676128 tempest-DeleteServersTestJSON-520676128-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2a0c768340>, {'target_iqns': ['iqn.2010-10.org.openstack:2dd20257-3fec-41ef-b6e8-d8bd62011a8d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ahyutOsI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 15:25:08 user nova-compute[72382]: WARNING os_brick.initiator.connectors.base [None req-250fc22d-65b9-4b09-94bf-a03f36d44598 tempest-DeleteServersTestJSON-520676128 tempest-DeleteServersTestJSON-520676128-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 15:25:08 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-250fc22d-65b9-4b09-94bf-a03f36d44598 tempest-DeleteServersTestJSON-520676128 tempest-DeleteServersTestJSON-520676128-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 15:25:08 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-250fc22d-65b9-4b09-94bf-a03f36d44598 tempest-DeleteServersTestJSON-520676128 tempest-DeleteServersTestJSON-520676128-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 15:25:08 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-250fc22d-65b9-4b09-94bf-a03f36d44598 tempest-DeleteServersTestJSON-520676128 tempest-DeleteServersTestJSON-520676128-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2dd20257-3fec-41ef-b6e8-d8bd62011a8d', 0)] {{(pid=72382) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 15:25:08 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:25:08 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:25:08 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[fabd0ce0-f046-467f-9bdb-2eca0e087d26]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0052e86d-16a7-4cbe-a802-ff770c0e20ba\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2dd20257-3fec-41ef-b6e8-d8bd62011a8d\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:25:08 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:25:08 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:25:08 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[f99506c0-d1e6-4ed3-beec-03936c8f6712]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0052e86d-16a7-4cbe-a802-ff770c0e20ba (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dd20257-3fec-41ef-b6e8-d8bd62011a8d (non-flash)\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:25:08 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-250fc22d-65b9-4b09-94bf-a03f36d44598 tempest-DeleteServersTestJSON-520676128 tempest-DeleteServersTestJSON-520676128-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)
Aug 09 15:25:08 user nova-compute[72382]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0052e86d-16a7-4cbe-a802-ff770c0e20ba (non-flash)
Aug 09 15:25:08 user nova-compute[72382]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dd20257-3fec-41ef-b6e8-d8bd62011a8d (non-flash)
Aug 09 15:25:08 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 15:25:08 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-250fc22d-65b9-4b09-94bf-a03f36d44598 tempest-DeleteServersTestJSON-520676128 tempest-DeleteServersTestJSON-520676128-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)
Aug 09 15:25:08 user nova-compute[72382]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0052e86d-16a7-4cbe-a802-ff770c0e20ba (non-flash)
Aug 09 15:25:08 user nova-compute[72382]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dd20257-3fec-41ef-b6e8-d8bd62011a8d (non-flash)
Aug 09 15:25:08 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 15:25:08 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-250fc22d-65b9-4b09-94bf-a03f36d44598 tempest-DeleteServersTestJSON-520676128 tempest-DeleteServersTestJSON-520676128-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2a0c351c60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2dd20257-3fec-41ef-b6e8-d8bd62011a8d'): ({'sdc'}, set())}) {{(pid=72382) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 15:25:08 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-250fc22d-65b9-4b09-94bf-a03f36d44598 tempest-DeleteServersTestJSON-520676128 tempest-DeleteServersTestJSON-520676128-project-member] Removing single pathed devices sdc {{(pid=72382) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 15:25:08 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:25:08 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:25:08 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dfaa40c-94e4-4ef4-a4e4-b3fa621db632]: (4, ('path checker states:\nup                  2\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:25:08 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:25:08 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:25:08 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[63a1a3ab-8828-41ac-bee3-2cce7018d9dc]: (4, ('ok\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:25:08 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-250fc22d-65b9-4b09-94bf-a03f36d44598 tempest-DeleteServersTestJSON-520676128 tempest-DeleteServersTestJSON-520676128-project-member] Flushing IO for device /dev/sdc {{(pid=72382) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 15:25:08 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:25:08 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:25:08 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[f903cf55-be7d-4f50-8fcc-ec7ca4848e2e]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:25:08 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-250fc22d-65b9-4b09-94bf-a03f36d44598 tempest-DeleteServersTestJSON-520676128 tempest-DeleteServersTestJSON-520676128-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72382) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 15:25:08 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:25:08 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.054s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:25:08 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e0f3f9a-dfae-46e3-b17d-7d842a73a1d6]: (4, ('1', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:25:08 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-250fc22d-65b9-4b09-94bf-a03f36d44598 tempest-DeleteServersTestJSON-520676128 tempest-DeleteServersTestJSON-520676128-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72382) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 15:25:08 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-250fc22d-65b9-4b09-94bf-a03f36d44598 tempest-DeleteServersTestJSON-520676128 tempest-DeleteServersTestJSON-520676128-project-member] SCSI volumes sdc have been removed. {{(pid=72382) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 15:25:08 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-250fc22d-65b9-4b09-94bf-a03f36d44598 tempest-DeleteServersTestJSON-520676128 tempest-DeleteServersTestJSON-520676128-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2dd20257-3fec-41ef-b6e8-d8bd62011a8d')] {{(pid=72382) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 15:25:08 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2dd20257-3fec-41ef-b6e8-d8bd62011a8d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:25:08 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:25:08 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2dd20257-3fec-41ef-b6e8-d8bd62011a8d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:25:08 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[240ada3f-caa4-45bd-b555-267924912baf]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:25:08 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-250fc22d-65b9-4b09-94bf-a03f36d44598 tempest-DeleteServersTestJSON-520676128 tempest-DeleteServersTestJSON-520676128-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:25:08 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2dd20257-3fec-41ef-b6e8-d8bd62011a8d -p 172.16.0.220:3260 --logout {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:25:08 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2dd20257-3fec-41ef-b6e8-d8bd62011a8d -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:25:08 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ee1977a-8562-40b7-b27e-97613073249d]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:2dd20257-3fec-41ef-b6e8-d8bd62011a8d, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:2dd20257-3fec-41ef-b6e8-d8bd62011a8d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:25:08 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-250fc22d-65b9-4b09-94bf-a03f36d44598 tempest-DeleteServersTestJSON-520676128 tempest-DeleteServersTestJSON-520676128-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:2dd20257-3fec-41ef-b6e8-d8bd62011a8d, portal: 172.16.0.220,3260]
Aug 09 15:25:08 user nova-compute[72382]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:2dd20257-3fec-41ef-b6e8-d8bd62011a8d, portal: 172.16.0.220,3260] successful.
Aug 09 15:25:08 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:25:08 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2dd20257-3fec-41ef-b6e8-d8bd62011a8d -p 172.16.0.220:3260 --op delete {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:25:08 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2dd20257-3fec-41ef-b6e8-d8bd62011a8d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:25:08 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8188f03-9930-423a-abf6-2410b4b6c04f]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:25:08 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-250fc22d-65b9-4b09-94bf-a03f36d44598 tempest-DeleteServersTestJSON-520676128 tempest-DeleteServersTestJSON-520676128-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:25:08 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-250fc22d-65b9-4b09-94bf-a03f36d44598 tempest-DeleteServersTestJSON-520676128 tempest-DeleteServersTestJSON-520676128-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.387s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 15:25:08 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-250fc22d-65b9-4b09-94bf-a03f36d44598 tempest-DeleteServersTestJSON-520676128 tempest-DeleteServersTestJSON-520676128-project-member] <== disconnect_volume: return (389ms) None {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 15:25:08 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-250fc22d-65b9-4b09-94bf-a03f36d44598 tempest-DeleteServersTestJSON-520676128 tempest-DeleteServersTestJSON-520676128-project-member] [instance: 0f4908de-d65d-4d17-ad36-6124a5e64a19] Disconnected iSCSI Volume {{(pid=72382) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 15:25:08 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-250fc22d-65b9-4b09-94bf-a03f36d44598 tempest-DeleteServersTestJSON-520676128 tempest-DeleteServersTestJSON-520676128-project-member] [instance: 0f4908de-d65d-4d17-ad36-6124a5e64a19] Deleting instance files /opt/stack/data/nova/instances/0f4908de-d65d-4d17-ad36-6124a5e64a19_del
Aug 09 15:25:08 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-250fc22d-65b9-4b09-94bf-a03f36d44598 tempest-DeleteServersTestJSON-520676128 tempest-DeleteServersTestJSON-520676128-project-member] [instance: 0f4908de-d65d-4d17-ad36-6124a5e64a19] Deletion of /opt/stack/data/nova/instances/0f4908de-d65d-4d17-ad36-6124a5e64a19_del complete
Aug 09 15:25:08 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:25:08 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:25:08 user nova-compute[72382]: INFO nova.compute.manager [None req-250fc22d-65b9-4b09-94bf-a03f36d44598 tempest-DeleteServersTestJSON-520676128 tempest-DeleteServersTestJSON-520676128-project-member] [instance: 0f4908de-d65d-4d17-ad36-6124a5e64a19] Took 1.65 seconds to destroy the instance on the hypervisor.
Aug 09 15:25:08 user nova-compute[72382]: DEBUG oslo.service.loopingcall [None req-250fc22d-65b9-4b09-94bf-a03f36d44598 tempest-DeleteServersTestJSON-520676128 tempest-DeleteServersTestJSON-520676128-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72382) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 15:25:08 user nova-compute[72382]: DEBUG nova.compute.manager [-] [instance: 0f4908de-d65d-4d17-ad36-6124a5e64a19] Deallocating network for instance {{(pid=72382) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 15:25:08 user nova-compute[72382]: DEBUG nova.network.neutron [-] [instance: 0f4908de-d65d-4d17-ad36-6124a5e64a19] deallocate_for_instance() {{(pid=72382) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 15:25:08 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:25:08 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ea8f68c-3dc1-45ac-a7f3-bca32f929add/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:25:08 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ea8f68c-3dc1-45ac-a7f3-bca32f929add/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:25:08 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ea8f68c-3dc1-45ac-a7f3-bca32f929add/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:25:09 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ea8f68c-3dc1-45ac-a7f3-bca32f929add/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:25:09 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f780040f-b789-4b72-8986-813c7b9fe4a6/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:25:09 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:25:09 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f780040f-b789-4b72-8986-813c7b9fe4a6/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:25:09 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f780040f-b789-4b72-8986-813c7b9fe4a6/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:25:09 user nova-compute[72382]: DEBUG nova.network.neutron [-] [instance: 0f4908de-d65d-4d17-ad36-6124a5e64a19] Updating instance_info_cache with network_info: [] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:25:09 user nova-compute[72382]: INFO nova.compute.manager [-] [instance: 0f4908de-d65d-4d17-ad36-6124a5e64a19] Took 0.72 seconds to deallocate network for instance.
Aug 09 15:25:09 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f780040f-b789-4b72-8986-813c7b9fe4a6/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:25:09 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/266be814-4a2b-4f8e-a0f6-e8821fdeb95d/disk.rescue --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:25:09 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/266be814-4a2b-4f8e-a0f6-e8821fdeb95d/disk.rescue --force-share --output=json" returned: 0 in 0.144s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:25:09 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/266be814-4a2b-4f8e-a0f6-e8821fdeb95d/disk.rescue --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:25:09 user nova-compute[72382]: DEBUG nova.compute.manager [req-455741a6-24b2-4f2f-bf44-32a1c88635ef req-4fdd060f-61e7-40ef-9a5e-c984c78037ea service nova] [instance: 0f4908de-d65d-4d17-ad36-6124a5e64a19] Received event network-vif-plugged-c6dc07b5-9e80-43a1-a3a1-bb0db357fc94 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:25:09 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-455741a6-24b2-4f2f-bf44-32a1c88635ef req-4fdd060f-61e7-40ef-9a5e-c984c78037ea service nova] Acquiring lock "0f4908de-d65d-4d17-ad36-6124a5e64a19-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:25:09 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-455741a6-24b2-4f2f-bf44-32a1c88635ef req-4fdd060f-61e7-40ef-9a5e-c984c78037ea service nova] Lock "0f4908de-d65d-4d17-ad36-6124a5e64a19-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:25:09 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-455741a6-24b2-4f2f-bf44-32a1c88635ef req-4fdd060f-61e7-40ef-9a5e-c984c78037ea service nova] Lock "0f4908de-d65d-4d17-ad36-6124a5e64a19-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:25:09 user nova-compute[72382]: DEBUG nova.compute.manager [req-455741a6-24b2-4f2f-bf44-32a1c88635ef req-4fdd060f-61e7-40ef-9a5e-c984c78037ea service nova] [instance: 0f4908de-d65d-4d17-ad36-6124a5e64a19] No waiting events found dispatching network-vif-plugged-c6dc07b5-9e80-43a1-a3a1-bb0db357fc94 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:25:09 user nova-compute[72382]: WARNING nova.compute.manager [req-455741a6-24b2-4f2f-bf44-32a1c88635ef req-4fdd060f-61e7-40ef-9a5e-c984c78037ea service nova] [instance: 0f4908de-d65d-4d17-ad36-6124a5e64a19] Received unexpected event network-vif-plugged-c6dc07b5-9e80-43a1-a3a1-bb0db357fc94 for instance with vm_state active and task_state deleting.
Aug 09 15:25:09 user nova-compute[72382]: DEBUG nova.compute.manager [req-455741a6-24b2-4f2f-bf44-32a1c88635ef req-4fdd060f-61e7-40ef-9a5e-c984c78037ea service nova] [instance: 0f4908de-d65d-4d17-ad36-6124a5e64a19] Received event network-vif-deleted-c6dc07b5-9e80-43a1-a3a1-bb0db357fc94 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:25:09 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/266be814-4a2b-4f8e-a0f6-e8821fdeb95d/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:25:09 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/266be814-4a2b-4f8e-a0f6-e8821fdeb95d/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:25:09 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/266be814-4a2b-4f8e-a0f6-e8821fdeb95d/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:25:09 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/266be814-4a2b-4f8e-a0f6-e8821fdeb95d/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:25:10 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/266be814-4a2b-4f8e-a0f6-e8821fdeb95d/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:25:10 user nova-compute[72382]: WARNING nova.virt.libvirt.driver [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Error from libvirt while getting description of instance-00000015: [Error Code 42] Domain not found: no domain with matching uuid '0f4908de-d65d-4d17-ad36-6124a5e64a19' (instance-00000015): libvirt.libvirtError: Domain not found: no domain with matching uuid '0f4908de-d65d-4d17-ad36-6124a5e64a19' (instance-00000015)
Aug 09 15:25:10 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44afd1bf-fa5c-4b3e-8752-b16853fef54e/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:25:10 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44afd1bf-fa5c-4b3e-8752-b16853fef54e/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:25:10 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44afd1bf-fa5c-4b3e-8752-b16853fef54e/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:25:10 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44afd1bf-fa5c-4b3e-8752-b16853fef54e/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:25:10 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72382) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 15:25:10 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6296ba5d-bcc6-405a-a635-0e9aa6114f7b/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:25:10 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6296ba5d-bcc6-405a-a635-0e9aa6114f7b/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:25:10 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6296ba5d-bcc6-405a-a635-0e9aa6114f7b/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:25:10 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6296ba5d-bcc6-405a-a635-0e9aa6114f7b/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:25:10 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61976531-76ae-4a1c-8950-0af784be376e/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:25:11 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61976531-76ae-4a1c-8950-0af784be376e/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:25:11 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61976531-76ae-4a1c-8950-0af784be376e/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:25:11 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61976531-76ae-4a1c-8950-0af784be376e/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:25:11 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8aa35482-60b8-4185-b14d-a2667fd3b5b7/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:25:11 user nova-compute[72382]: DEBUG nova.objects.instance [None req-ccc203df-641c-400b-9438-a2eedada5513 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] Lazy-loading 'flavor' on Instance uuid 6296ba5d-bcc6-405a-a635-0e9aa6114f7b {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:25:11 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8aa35482-60b8-4185-b14d-a2667fd3b5b7/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:25:11 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8aa35482-60b8-4185-b14d-a2667fd3b5b7/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:25:11 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-ccc203df-641c-400b-9438-a2eedada5513 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] Lock "6296ba5d-bcc6-405a-a635-0e9aa6114f7b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 7.058s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:25:11 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8aa35482-60b8-4185-b14d-a2667fd3b5b7/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:25:11 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=72382) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 15:25:12 user nova-compute[72382]: WARNING nova.virt.libvirt.driver [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 15:25:12 user nova-compute[72382]: WARNING nova.virt.libvirt.driver [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 15:25:12 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Hypervisor/Node resource view: name=user free_ram=7521MB free_disk=25.373600006103516GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72382) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 15:25:12 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:25:12 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:25:12 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:25:12 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance f780040f-b789-4b72-8986-813c7b9fe4a6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:25:12 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance 44afd1bf-fa5c-4b3e-8752-b16853fef54e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:25:12 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance 266be814-4a2b-4f8e-a0f6-e8821fdeb95d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:25:12 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance 0f510d75-5d1e-4a5c-b38f-731c299f0f5a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:25:12 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance 8aa35482-60b8-4185-b14d-a2667fd3b5b7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:25:12 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance 6296ba5d-bcc6-405a-a635-0e9aa6114f7b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:25:12 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance 0f4908de-d65d-4d17-ad36-6124a5e64a19 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:25:12 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance 6ea8f68c-3dc1-45ac-a7f3-bca32f929add actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:25:12 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance 61976531-76ae-4a1c-8950-0af784be376e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:25:12 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:25:12 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=72382) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 15:25:12 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=72382) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 15:25:12 user nova-compute[72382]: DEBUG nova.compute.provider_tree [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Inventory has not changed in ProviderTree for provider: 7b15b0e5-df4d-49db-833b-2855d21d10ae {{(pid=72382) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 15:25:12 user nova-compute[72382]: DEBUG nova.scheduler.client.report [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Inventory has not changed for provider 7b15b0e5-df4d-49db-833b-2855d21d10ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72382) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 15:25:12 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Compute_service record updated for user:user {{(pid=72382) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 15:25:12 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.621s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:25:13 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:25:13 user nova-compute[72382]: INFO nova.compute.manager [None req-250fc22d-65b9-4b09-94bf-a03f36d44598 tempest-DeleteServersTestJSON-520676128 tempest-DeleteServersTestJSON-520676128-project-member] [instance: 0f4908de-d65d-4d17-ad36-6124a5e64a19] Took 3.86 seconds to detach 1 volumes for instance.
Aug 09 15:25:13 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-250fc22d-65b9-4b09-94bf-a03f36d44598 tempest-DeleteServersTestJSON-520676128 tempest-DeleteServersTestJSON-520676128-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:25:13 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-250fc22d-65b9-4b09-94bf-a03f36d44598 tempest-DeleteServersTestJSON-520676128 tempest-DeleteServersTestJSON-520676128-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:25:13 user nova-compute[72382]: DEBUG nova.compute.provider_tree [None req-250fc22d-65b9-4b09-94bf-a03f36d44598 tempest-DeleteServersTestJSON-520676128 tempest-DeleteServersTestJSON-520676128-project-member] Inventory has not changed in ProviderTree for provider: 7b15b0e5-df4d-49db-833b-2855d21d10ae {{(pid=72382) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 15:25:13 user nova-compute[72382]: DEBUG nova.scheduler.client.report [None req-250fc22d-65b9-4b09-94bf-a03f36d44598 tempest-DeleteServersTestJSON-520676128 tempest-DeleteServersTestJSON-520676128-project-member] Inventory has not changed for provider 7b15b0e5-df4d-49db-833b-2855d21d10ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72382) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 15:25:13 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-250fc22d-65b9-4b09-94bf-a03f36d44598 tempest-DeleteServersTestJSON-520676128 tempest-DeleteServersTestJSON-520676128-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.410s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:25:13 user nova-compute[72382]: INFO nova.scheduler.client.report [None req-250fc22d-65b9-4b09-94bf-a03f36d44598 tempest-DeleteServersTestJSON-520676128 tempest-DeleteServersTestJSON-520676128-project-member] Deleted allocations for instance 0f4908de-d65d-4d17-ad36-6124a5e64a19
Aug 09 15:25:13 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:25:13 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:25:13 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:25:13 user nova-compute[72382]: DEBUG nova.compute.manager [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Starting heal instance info cache {{(pid=72382) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 15:25:13 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-250fc22d-65b9-4b09-94bf-a03f36d44598 tempest-DeleteServersTestJSON-520676128 tempest-DeleteServersTestJSON-520676128-project-member] Lock "0f4908de-d65d-4d17-ad36-6124a5e64a19" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.894s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:25:14 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Acquiring lock "refresh_cache-44afd1bf-fa5c-4b3e-8752-b16853fef54e" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 15:25:14 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Acquired lock "refresh_cache-44afd1bf-fa5c-4b3e-8752-b16853fef54e" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 15:25:14 user nova-compute[72382]: DEBUG nova.network.neutron [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] [instance: 44afd1bf-fa5c-4b3e-8752-b16853fef54e] Forcefully refreshing network info cache for instance {{(pid=72382) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 15:25:14 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:25:15 user nova-compute[72382]: DEBUG nova.network.neutron [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] [instance: 44afd1bf-fa5c-4b3e-8752-b16853fef54e] Updating instance_info_cache with network_info: [{"id": "2a1d4c60-bc2a-4530-b3bd-2a12ae2d2098", "address": "fa:16:3e:6c:50:29", "network": {"id": "46ef00c7-17ee-4e45-ba1d-dcc0a417ea85", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1360012261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "990ba791030940d38360af5879c853c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a1d4c60-bc", "ovs_interfaceid": "2a1d4c60-bc2a-4530-b3bd-2a12ae2d2098", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:25:15 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:25:15 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Releasing lock "refresh_cache-44afd1bf-fa5c-4b3e-8752-b16853fef54e" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 15:25:15 user nova-compute[72382]: DEBUG nova.compute.manager [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] [instance: 44afd1bf-fa5c-4b3e-8752-b16853fef54e] Updated the network info_cache for instance {{(pid=72382) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 15:25:15 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:25:15 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:25:15 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:25:15 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:25:15 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:25:15 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:25:15 user nova-compute[72382]: DEBUG nova.compute.manager [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72382) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 15:25:18 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-f551d69b-1fb8-424a-bffa-992464cc76b8 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Acquiring lock "14c97840-88c0-4a8e-96e8-2e7da318ad07" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:25:18 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-f551d69b-1fb8-424a-bffa-992464cc76b8 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Lock "14c97840-88c0-4a8e-96e8-2e7da318ad07" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:25:18 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:25:18 user nova-compute[72382]: DEBUG nova.compute.manager [None req-f551d69b-1fb8-424a-bffa-992464cc76b8 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] [instance: 14c97840-88c0-4a8e-96e8-2e7da318ad07] Starting instance... {{(pid=72382) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 15:25:18 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-f551d69b-1fb8-424a-bffa-992464cc76b8 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:25:18 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-f551d69b-1fb8-424a-bffa-992464cc76b8 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:25:18 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-f551d69b-1fb8-424a-bffa-992464cc76b8 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72382) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 15:25:18 user nova-compute[72382]: INFO nova.compute.claims [None req-f551d69b-1fb8-424a-bffa-992464cc76b8 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] [instance: 14c97840-88c0-4a8e-96e8-2e7da318ad07] Claim successful on node user
Aug 09 15:25:18 user nova-compute[72382]: DEBUG nova.compute.provider_tree [None req-f551d69b-1fb8-424a-bffa-992464cc76b8 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Inventory has not changed in ProviderTree for provider: 7b15b0e5-df4d-49db-833b-2855d21d10ae {{(pid=72382) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 15:25:18 user nova-compute[72382]: DEBUG nova.scheduler.client.report [None req-f551d69b-1fb8-424a-bffa-992464cc76b8 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Inventory has not changed for provider 7b15b0e5-df4d-49db-833b-2855d21d10ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72382) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 15:25:18 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-f551d69b-1fb8-424a-bffa-992464cc76b8 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.410s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:25:18 user nova-compute[72382]: DEBUG nova.compute.manager [None req-f551d69b-1fb8-424a-bffa-992464cc76b8 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] [instance: 14c97840-88c0-4a8e-96e8-2e7da318ad07] Start building networks asynchronously for instance. {{(pid=72382) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 15:25:18 user nova-compute[72382]: DEBUG nova.compute.manager [None req-f551d69b-1fb8-424a-bffa-992464cc76b8 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] [instance: 14c97840-88c0-4a8e-96e8-2e7da318ad07] Allocating IP information in the background. {{(pid=72382) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 15:25:18 user nova-compute[72382]: DEBUG nova.network.neutron [None req-f551d69b-1fb8-424a-bffa-992464cc76b8 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] [instance: 14c97840-88c0-4a8e-96e8-2e7da318ad07] allocate_for_instance() {{(pid=72382) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 15:25:18 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-f551d69b-1fb8-424a-bffa-992464cc76b8 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] [instance: 14c97840-88c0-4a8e-96e8-2e7da318ad07] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 15:25:18 user nova-compute[72382]: DEBUG nova.compute.manager [None req-f551d69b-1fb8-424a-bffa-992464cc76b8 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] [instance: 14c97840-88c0-4a8e-96e8-2e7da318ad07] Start building block device mappings for instance. {{(pid=72382) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 15:25:18 user nova-compute[72382]: DEBUG nova.policy [None req-f551d69b-1fb8-424a-bffa-992464cc76b8 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '13c67153e9ec44029e8d80c09d405175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1a50eacfd0414bbc13e3fd4087e998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72382) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 15:25:18 user nova-compute[72382]: DEBUG nova.compute.manager [None req-f551d69b-1fb8-424a-bffa-992464cc76b8 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] [instance: 14c97840-88c0-4a8e-96e8-2e7da318ad07] Start spawning the instance on the hypervisor. {{(pid=72382) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 15:25:18 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-f551d69b-1fb8-424a-bffa-992464cc76b8 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] [instance: 14c97840-88c0-4a8e-96e8-2e7da318ad07] Creating instance directory {{(pid=72382) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 15:25:18 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-f551d69b-1fb8-424a-bffa-992464cc76b8 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] [instance: 14c97840-88c0-4a8e-96e8-2e7da318ad07] Creating image(s)
Aug 09 15:25:18 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-f551d69b-1fb8-424a-bffa-992464cc76b8 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Acquiring lock "/opt/stack/data/nova/instances/14c97840-88c0-4a8e-96e8-2e7da318ad07/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:25:18 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-f551d69b-1fb8-424a-bffa-992464cc76b8 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Lock "/opt/stack/data/nova/instances/14c97840-88c0-4a8e-96e8-2e7da318ad07/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:25:18 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-f551d69b-1fb8-424a-bffa-992464cc76b8 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Lock "/opt/stack/data/nova/instances/14c97840-88c0-4a8e-96e8-2e7da318ad07/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:25:18 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-f551d69b-1fb8-424a-bffa-992464cc76b8 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:25:19 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-f551d69b-1fb8-424a-bffa-992464cc76b8 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b --force-share --output=json" returned: 0 in 0.165s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:25:19 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-f551d69b-1fb8-424a-bffa-992464cc76b8 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Acquiring lock "383812ff437283e0191ed5b9ecc04c27f1162b0b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:25:19 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-f551d69b-1fb8-424a-bffa-992464cc76b8 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Lock "383812ff437283e0191ed5b9ecc04c27f1162b0b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:25:19 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-f551d69b-1fb8-424a-bffa-992464cc76b8 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:25:19 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:25:19 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-f551d69b-1fb8-424a-bffa-992464cc76b8 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b --force-share --output=json" returned: 0 in 0.161s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:25:19 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-f551d69b-1fb8-424a-bffa-992464cc76b8 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b,backing_fmt=raw /opt/stack/data/nova/instances/14c97840-88c0-4a8e-96e8-2e7da318ad07/disk 1073741824 {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:25:19 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-f551d69b-1fb8-424a-bffa-992464cc76b8 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b,backing_fmt=raw /opt/stack/data/nova/instances/14c97840-88c0-4a8e-96e8-2e7da318ad07/disk 1073741824" returned: 0 in 0.075s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:25:19 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-f551d69b-1fb8-424a-bffa-992464cc76b8 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Lock "383812ff437283e0191ed5b9ecc04c27f1162b0b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.242s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:25:19 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-f551d69b-1fb8-424a-bffa-992464cc76b8 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:25:19 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-f551d69b-1fb8-424a-bffa-992464cc76b8 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b --force-share --output=json" returned: 0 in 0.135s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:25:19 user nova-compute[72382]: DEBUG nova.virt.disk.api [None req-f551d69b-1fb8-424a-bffa-992464cc76b8 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Checking if we can resize image /opt/stack/data/nova/instances/14c97840-88c0-4a8e-96e8-2e7da318ad07/disk. size=1073741824 {{(pid=72382) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 15:25:19 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-f551d69b-1fb8-424a-bffa-992464cc76b8 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14c97840-88c0-4a8e-96e8-2e7da318ad07/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:25:19 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-f551d69b-1fb8-424a-bffa-992464cc76b8 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14c97840-88c0-4a8e-96e8-2e7da318ad07/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:25:19 user nova-compute[72382]: DEBUG nova.virt.disk.api [None req-f551d69b-1fb8-424a-bffa-992464cc76b8 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Cannot resize image /opt/stack/data/nova/instances/14c97840-88c0-4a8e-96e8-2e7da318ad07/disk to a smaller size. {{(pid=72382) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 15:25:19 user nova-compute[72382]: DEBUG nova.objects.instance [None req-f551d69b-1fb8-424a-bffa-992464cc76b8 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Lazy-loading 'migration_context' on Instance uuid 14c97840-88c0-4a8e-96e8-2e7da318ad07 {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:25:19 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-f551d69b-1fb8-424a-bffa-992464cc76b8 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] [instance: 14c97840-88c0-4a8e-96e8-2e7da318ad07] Created local disks {{(pid=72382) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 15:25:19 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-f551d69b-1fb8-424a-bffa-992464cc76b8 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] [instance: 14c97840-88c0-4a8e-96e8-2e7da318ad07] Ensure instance console log exists: /opt/stack/data/nova/instances/14c97840-88c0-4a8e-96e8-2e7da318ad07/console.log {{(pid=72382) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 15:25:19 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-f551d69b-1fb8-424a-bffa-992464cc76b8 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:25:19 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-f551d69b-1fb8-424a-bffa-992464cc76b8 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:25:19 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-f551d69b-1fb8-424a-bffa-992464cc76b8 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:25:19 user nova-compute[72382]: DEBUG nova.network.neutron [None req-f551d69b-1fb8-424a-bffa-992464cc76b8 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] [instance: 14c97840-88c0-4a8e-96e8-2e7da318ad07] Successfully created port: f22c0d53-f0da-4bc9-bf7b-c10fe61e2e1f {{(pid=72382) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 15:25:20 user nova-compute[72382]: DEBUG nova.network.neutron [None req-f551d69b-1fb8-424a-bffa-992464cc76b8 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] [instance: 14c97840-88c0-4a8e-96e8-2e7da318ad07] Successfully updated port: f22c0d53-f0da-4bc9-bf7b-c10fe61e2e1f {{(pid=72382) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 15:25:20 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-f551d69b-1fb8-424a-bffa-992464cc76b8 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Acquiring lock "refresh_cache-14c97840-88c0-4a8e-96e8-2e7da318ad07" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 15:25:20 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-f551d69b-1fb8-424a-bffa-992464cc76b8 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Acquired lock "refresh_cache-14c97840-88c0-4a8e-96e8-2e7da318ad07" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 15:25:20 user nova-compute[72382]: DEBUG nova.network.neutron [None req-f551d69b-1fb8-424a-bffa-992464cc76b8 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] [instance: 14c97840-88c0-4a8e-96e8-2e7da318ad07] Building network info cache for instance {{(pid=72382) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 15:25:20 user nova-compute[72382]: DEBUG nova.compute.manager [req-dfd85c15-9941-4e0f-a849-4500e93683c3 req-0d9fb754-933b-42c2-9227-40170d3bf3e7 service nova] [instance: 14c97840-88c0-4a8e-96e8-2e7da318ad07] Received event network-changed-f22c0d53-f0da-4bc9-bf7b-c10fe61e2e1f {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:25:20 user nova-compute[72382]: DEBUG nova.compute.manager [req-dfd85c15-9941-4e0f-a849-4500e93683c3 req-0d9fb754-933b-42c2-9227-40170d3bf3e7 service nova] [instance: 14c97840-88c0-4a8e-96e8-2e7da318ad07] Refreshing instance network info cache due to event network-changed-f22c0d53-f0da-4bc9-bf7b-c10fe61e2e1f. {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 15:25:20 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-dfd85c15-9941-4e0f-a849-4500e93683c3 req-0d9fb754-933b-42c2-9227-40170d3bf3e7 service nova] Acquiring lock "refresh_cache-14c97840-88c0-4a8e-96e8-2e7da318ad07" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 15:25:20 user nova-compute[72382]: DEBUG nova.network.neutron [None req-f551d69b-1fb8-424a-bffa-992464cc76b8 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] [instance: 14c97840-88c0-4a8e-96e8-2e7da318ad07] Instance cache missing network info. {{(pid=72382) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 15:25:21 user nova-compute[72382]: DEBUG nova.network.neutron [None req-f551d69b-1fb8-424a-bffa-992464cc76b8 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] [instance: 14c97840-88c0-4a8e-96e8-2e7da318ad07] Updating instance_info_cache with network_info: [{"id": "f22c0d53-f0da-4bc9-bf7b-c10fe61e2e1f", "address": "fa:16:3e:72:44:b1", "network": {"id": "a85a6e1f-20f5-4719-90d2-0dc23ce525cd", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-780716970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c1a50eacfd0414bbc13e3fd4087e998", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf22c0d53-f0", "ovs_interfaceid": "f22c0d53-f0da-4bc9-bf7b-c10fe61e2e1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:25:21 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-f551d69b-1fb8-424a-bffa-992464cc76b8 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Releasing lock "refresh_cache-14c97840-88c0-4a8e-96e8-2e7da318ad07" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 15:25:21 user nova-compute[72382]: DEBUG nova.compute.manager [None req-f551d69b-1fb8-424a-bffa-992464cc76b8 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] [instance: 14c97840-88c0-4a8e-96e8-2e7da318ad07] Instance network_info: |[{"id": "f22c0d53-f0da-4bc9-bf7b-c10fe61e2e1f", "address": "fa:16:3e:72:44:b1", "network": {"id": "a85a6e1f-20f5-4719-90d2-0dc23ce525cd", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-780716970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c1a50eacfd0414bbc13e3fd4087e998", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf22c0d53-f0", "ovs_interfaceid": "f22c0d53-f0da-4bc9-bf7b-c10fe61e2e1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72382) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 15:25:21 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-dfd85c15-9941-4e0f-a849-4500e93683c3 req-0d9fb754-933b-42c2-9227-40170d3bf3e7 service nova] Acquired lock "refresh_cache-14c97840-88c0-4a8e-96e8-2e7da318ad07" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 15:25:21 user nova-compute[72382]: DEBUG nova.network.neutron [req-dfd85c15-9941-4e0f-a849-4500e93683c3 req-0d9fb754-933b-42c2-9227-40170d3bf3e7 service nova] [instance: 14c97840-88c0-4a8e-96e8-2e7da318ad07] Refreshing network info cache for port f22c0d53-f0da-4bc9-bf7b-c10fe61e2e1f {{(pid=72382) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 15:25:21 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-f551d69b-1fb8-424a-bffa-992464cc76b8 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] [instance: 14c97840-88c0-4a8e-96e8-2e7da318ad07] Start _get_guest_xml network_info=[{"id": "f22c0d53-f0da-4bc9-bf7b-c10fe61e2e1f", "address": "fa:16:3e:72:44:b1", "network": {"id": "a85a6e1f-20f5-4719-90d2-0dc23ce525cd", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-780716970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c1a50eacfd0414bbc13e3fd4087e998", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf22c0d53-f0", "ovs_interfaceid": "f22c0d53-f0da-4bc9-bf7b-c10fe61e2e1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T15:11:25Z,direct_url=<?>,disk_format='qcow2',id=a79f2cea-eb27-4631-aaf3-05e7d9e411b4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a638990e12cc4d6eabb6d55e13be6bdf',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T15:11:27Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'a79f2cea-eb27-4631-aaf3-05e7d9e411b4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72382) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 15:25:21 user nova-compute[72382]: WARNING nova.virt.libvirt.driver [None req-f551d69b-1fb8-424a-bffa-992464cc76b8 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 15:25:21 user nova-compute[72382]: WARNING nova.virt.libvirt.driver [None req-f551d69b-1fb8-424a-bffa-992464cc76b8 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 15:25:21 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-f551d69b-1fb8-424a-bffa-992464cc76b8 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72382) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 15:25:21 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-f551d69b-1fb8-424a-bffa-992464cc76b8 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] CPU controller missing on host. {{(pid=72382) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 15:25:21 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-f551d69b-1fb8-424a-bffa-992464cc76b8 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72382) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 15:25:21 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-f551d69b-1fb8-424a-bffa-992464cc76b8 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] CPU controller found on host. {{(pid=72382) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 15:25:21 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-f551d69b-1fb8-424a-bffa-992464cc76b8 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72382) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 15:25:21 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-f551d69b-1fb8-424a-bffa-992464cc76b8 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T15:11:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T15:11:25Z,direct_url=<?>,disk_format='qcow2',id=a79f2cea-eb27-4631-aaf3-05e7d9e411b4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a638990e12cc4d6eabb6d55e13be6bdf',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T15:11:27Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 15:25:21 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-f551d69b-1fb8-424a-bffa-992464cc76b8 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Flavor limits 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 15:25:21 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-f551d69b-1fb8-424a-bffa-992464cc76b8 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Image limits 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 15:25:21 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-f551d69b-1fb8-424a-bffa-992464cc76b8 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Flavor pref 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 15:25:21 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-f551d69b-1fb8-424a-bffa-992464cc76b8 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Image pref 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 15:25:21 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-f551d69b-1fb8-424a-bffa-992464cc76b8 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 15:25:21 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-f551d69b-1fb8-424a-bffa-992464cc76b8 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 15:25:21 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-f551d69b-1fb8-424a-bffa-992464cc76b8 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72382) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 15:25:21 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-f551d69b-1fb8-424a-bffa-992464cc76b8 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Got 1 possible topologies {{(pid=72382) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 15:25:21 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-f551d69b-1fb8-424a-bffa-992464cc76b8 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 15:25:21 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-f551d69b-1fb8-424a-bffa-992464cc76b8 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 15:25:21 user nova-compute[72382]: DEBUG nova.virt.libvirt.vif [None req-f551d69b-1fb8-424a-bffa-992464cc76b8 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T15:25:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1065057662',display_name='tempest-AttachVolumeTestJSON-server-1065057662',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1065057662',id=25,image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDpgWhLPGWY2ElRglFQBqLuKZWglAfFVsofJemv1+kc4sKM1iZJZQ3Zp8fFAbw72Xaat0sVYwxhfDdHsZAI0ReSI/gfbVL6O5P/l5QvCIWZ9WBMY/UBAwONL1kUKiqSY5Q==',key_name='tempest-keypair-138739448',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8c1a50eacfd0414bbc13e3fd4087e998',ramdisk_id='',reservation_id='r-p2h4ne70',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-502043064',owner_user_name='tempest-AttachVolumeTestJSON-502043064-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T15:25:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='13c67153e9ec44029e8d80c09d405175',uuid=14c97840-88c0-4a8e-96e8-2e7da318ad07,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f22c0d53-f0da-4bc9-bf7b-c10fe61e2e1f", "address": "fa:16:3e:72:44:b1", "network": {"id": "a85a6e1f-20f5-4719-90d2-0dc23ce525cd", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-780716970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c1a50eacfd0414bbc13e3fd4087e998", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf22c0d53-f0", "ovs_interfaceid": "f22c0d53-f0da-4bc9-bf7b-c10fe61e2e1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72382) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 15:25:21 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-f551d69b-1fb8-424a-bffa-992464cc76b8 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Converting VIF {"id": "f22c0d53-f0da-4bc9-bf7b-c10fe61e2e1f", "address": "fa:16:3e:72:44:b1", "network": {"id": "a85a6e1f-20f5-4719-90d2-0dc23ce525cd", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-780716970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c1a50eacfd0414bbc13e3fd4087e998", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf22c0d53-f0", "ovs_interfaceid": "f22c0d53-f0da-4bc9-bf7b-c10fe61e2e1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 15:25:21 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-f551d69b-1fb8-424a-bffa-992464cc76b8 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:72:44:b1,bridge_name='br-int',has_traffic_filtering=True,id=f22c0d53-f0da-4bc9-bf7b-c10fe61e2e1f,network=Network(a85a6e1f-20f5-4719-90d2-0dc23ce525cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf22c0d53-f0') {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 15:25:21 user nova-compute[72382]: DEBUG nova.objects.instance [None req-f551d69b-1fb8-424a-bffa-992464cc76b8 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Lazy-loading 'pci_devices' on Instance uuid 14c97840-88c0-4a8e-96e8-2e7da318ad07 {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:25:21 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-f551d69b-1fb8-424a-bffa-992464cc76b8 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] [instance: 14c97840-88c0-4a8e-96e8-2e7da318ad07] End _get_guest_xml xml=<domain type="kvm">
Aug 09 15:25:21 user nova-compute[72382]:   <uuid>14c97840-88c0-4a8e-96e8-2e7da318ad07</uuid>
Aug 09 15:25:21 user nova-compute[72382]:   <name>instance-00000019</name>
Aug 09 15:25:21 user nova-compute[72382]:   <memory>524288</memory>
Aug 09 15:25:21 user nova-compute[72382]:   <vcpu>1</vcpu>
Aug 09 15:25:21 user nova-compute[72382]:   <metadata>
Aug 09 15:25:21 user nova-compute[72382]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 15:25:21 user nova-compute[72382]:       <nova:package version="0.0.0"/>
Aug 09 15:25:21 user nova-compute[72382]:       <nova:name>tempest-AttachVolumeTestJSON-server-1065057662</nova:name>
Aug 09 15:25:21 user nova-compute[72382]:       <nova:creationTime>2023-08-09 15:25:21</nova:creationTime>
Aug 09 15:25:21 user nova-compute[72382]:       <nova:flavor name="m1.tiny">
Aug 09 15:25:21 user nova-compute[72382]:         <nova:memory>512</nova:memory>
Aug 09 15:25:21 user nova-compute[72382]:         <nova:disk>1</nova:disk>
Aug 09 15:25:21 user nova-compute[72382]:         <nova:swap>0</nova:swap>
Aug 09 15:25:21 user nova-compute[72382]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 15:25:21 user nova-compute[72382]:         <nova:vcpus>1</nova:vcpus>
Aug 09 15:25:21 user nova-compute[72382]:       </nova:flavor>
Aug 09 15:25:21 user nova-compute[72382]:       <nova:owner>
Aug 09 15:25:21 user nova-compute[72382]:         <nova:user uuid="13c67153e9ec44029e8d80c09d405175">tempest-AttachVolumeTestJSON-502043064-project-member</nova:user>
Aug 09 15:25:21 user nova-compute[72382]:         <nova:project uuid="8c1a50eacfd0414bbc13e3fd4087e998">tempest-AttachVolumeTestJSON-502043064</nova:project>
Aug 09 15:25:21 user nova-compute[72382]:       </nova:owner>
Aug 09 15:25:21 user nova-compute[72382]:       <nova:root type="image" uuid="a79f2cea-eb27-4631-aaf3-05e7d9e411b4"/>
Aug 09 15:25:21 user nova-compute[72382]:       <nova:ports>
Aug 09 15:25:21 user nova-compute[72382]:         <nova:port uuid="f22c0d53-f0da-4bc9-bf7b-c10fe61e2e1f">
Aug 09 15:25:21 user nova-compute[72382]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 09 15:25:21 user nova-compute[72382]:         </nova:port>
Aug 09 15:25:21 user nova-compute[72382]:       </nova:ports>
Aug 09 15:25:21 user nova-compute[72382]:     </nova:instance>
Aug 09 15:25:21 user nova-compute[72382]:   </metadata>
Aug 09 15:25:21 user nova-compute[72382]:   <sysinfo type="smbios">
Aug 09 15:25:21 user nova-compute[72382]:     <system>
Aug 09 15:25:21 user nova-compute[72382]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 15:25:21 user nova-compute[72382]:       <entry name="product">OpenStack Nova</entry>
Aug 09 15:25:21 user nova-compute[72382]:       <entry name="version">0.0.0</entry>
Aug 09 15:25:21 user nova-compute[72382]:       <entry name="serial">14c97840-88c0-4a8e-96e8-2e7da318ad07</entry>
Aug 09 15:25:21 user nova-compute[72382]:       <entry name="uuid">14c97840-88c0-4a8e-96e8-2e7da318ad07</entry>
Aug 09 15:25:21 user nova-compute[72382]:       <entry name="family">Virtual Machine</entry>
Aug 09 15:25:21 user nova-compute[72382]:     </system>
Aug 09 15:25:21 user nova-compute[72382]:   </sysinfo>
Aug 09 15:25:21 user nova-compute[72382]:   <os>
Aug 09 15:25:21 user nova-compute[72382]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 15:25:21 user nova-compute[72382]:     <boot dev="hd"/>
Aug 09 15:25:21 user nova-compute[72382]:     <smbios mode="sysinfo"/>
Aug 09 15:25:21 user nova-compute[72382]:   </os>
Aug 09 15:25:21 user nova-compute[72382]:   <features>
Aug 09 15:25:21 user nova-compute[72382]:     <acpi/>
Aug 09 15:25:21 user nova-compute[72382]:     <apic/>
Aug 09 15:25:21 user nova-compute[72382]:     <vmcoreinfo/>
Aug 09 15:25:21 user nova-compute[72382]:   </features>
Aug 09 15:25:21 user nova-compute[72382]:   <clock offset="utc">
Aug 09 15:25:21 user nova-compute[72382]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 15:25:21 user nova-compute[72382]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 15:25:21 user nova-compute[72382]:     <timer name="hpet" present="no"/>
Aug 09 15:25:21 user nova-compute[72382]:   </clock>
Aug 09 15:25:21 user nova-compute[72382]:   <cpu mode="custom" match="exact">
Aug 09 15:25:21 user nova-compute[72382]:     <model>Nehalem</model>
Aug 09 15:25:21 user nova-compute[72382]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 15:25:21 user nova-compute[72382]:   </cpu>
Aug 09 15:25:21 user nova-compute[72382]:   <devices>
Aug 09 15:25:21 user nova-compute[72382]:     <disk type="file" device="disk">
Aug 09 15:25:21 user nova-compute[72382]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 15:25:21 user nova-compute[72382]:       <source file="/opt/stack/data/nova/instances/14c97840-88c0-4a8e-96e8-2e7da318ad07/disk"/>
Aug 09 15:25:21 user nova-compute[72382]:       <target dev="vda" bus="virtio"/>
Aug 09 15:25:21 user nova-compute[72382]:     </disk>
Aug 09 15:25:21 user nova-compute[72382]:     <interface type="ethernet">
Aug 09 15:25:21 user nova-compute[72382]:       <mac address="fa:16:3e:72:44:b1"/>
Aug 09 15:25:21 user nova-compute[72382]:       <model type="virtio"/>
Aug 09 15:25:21 user nova-compute[72382]:       <mtu size="1442"/>
Aug 09 15:25:21 user nova-compute[72382]:       <target dev="tapf22c0d53-f0"/>
Aug 09 15:25:21 user nova-compute[72382]:     </interface>
Aug 09 15:25:21 user nova-compute[72382]:     <serial type="pty">
Aug 09 15:25:21 user nova-compute[72382]:       <log file="/opt/stack/data/nova/instances/14c97840-88c0-4a8e-96e8-2e7da318ad07/console.log" append="off"/>
Aug 09 15:25:21 user nova-compute[72382]:     </serial>
Aug 09 15:25:21 user nova-compute[72382]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 15:25:21 user nova-compute[72382]:     <video>
Aug 09 15:25:21 user nova-compute[72382]:       <model type="virtio"/>
Aug 09 15:25:21 user nova-compute[72382]:     </video>
Aug 09 15:25:21 user nova-compute[72382]:     <rng model="virtio">
Aug 09 15:25:21 user nova-compute[72382]:       <backend model="random">/dev/urandom</backend>
Aug 09 15:25:21 user nova-compute[72382]:     </rng>
Aug 09 15:25:21 user nova-compute[72382]:     <controller type="usb" index="0" model="none"/>
Aug 09 15:25:21 user nova-compute[72382]:     <memballoon model="virtio">
Aug 09 15:25:21 user nova-compute[72382]:       <stats period="10"/>
Aug 09 15:25:21 user nova-compute[72382]:     </memballoon>
Aug 09 15:25:21 user nova-compute[72382]:   </devices>
Aug 09 15:25:21 user nova-compute[72382]: </domain>
Aug 09 15:25:21 user nova-compute[72382]:  {{(pid=72382) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 15:25:21 user nova-compute[72382]: DEBUG nova.virt.libvirt.vif [None req-f551d69b-1fb8-424a-bffa-992464cc76b8 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T15:25:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1065057662',display_name='tempest-AttachVolumeTestJSON-server-1065057662',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1065057662',id=25,image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDpgWhLPGWY2ElRglFQBqLuKZWglAfFVsofJemv1+kc4sKM1iZJZQ3Zp8fFAbw72Xaat0sVYwxhfDdHsZAI0ReSI/gfbVL6O5P/l5QvCIWZ9WBMY/UBAwONL1kUKiqSY5Q==',key_name='tempest-keypair-138739448',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8c1a50eacfd0414bbc13e3fd4087e998',ramdisk_id='',reservation_id='r-p2h4ne70',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-502043064',owner_user_name='tempest-AttachVolumeTestJSON-502043064-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T15:25:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='13c67153e9ec44029e8d80c09d405175',uuid=14c97840-88c0-4a8e-96e8-2e7da318ad07,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f22c0d53-f0da-4bc9-bf7b-c10fe61e2e1f", "address": "fa:16:3e:72:44:b1", "network": {"id": "a85a6e1f-20f5-4719-90d2-0dc23ce525cd", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-780716970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c1a50eacfd0414bbc13e3fd4087e998", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf22c0d53-f0", "ovs_interfaceid": "f22c0d53-f0da-4bc9-bf7b-c10fe61e2e1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 15:25:21 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-f551d69b-1fb8-424a-bffa-992464cc76b8 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Converting VIF {"id": "f22c0d53-f0da-4bc9-bf7b-c10fe61e2e1f", "address": "fa:16:3e:72:44:b1", "network": {"id": "a85a6e1f-20f5-4719-90d2-0dc23ce525cd", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-780716970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c1a50eacfd0414bbc13e3fd4087e998", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf22c0d53-f0", "ovs_interfaceid": "f22c0d53-f0da-4bc9-bf7b-c10fe61e2e1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 15:25:21 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-f551d69b-1fb8-424a-bffa-992464cc76b8 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:72:44:b1,bridge_name='br-int',has_traffic_filtering=True,id=f22c0d53-f0da-4bc9-bf7b-c10fe61e2e1f,network=Network(a85a6e1f-20f5-4719-90d2-0dc23ce525cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf22c0d53-f0') {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 15:25:21 user nova-compute[72382]: DEBUG os_vif [None req-f551d69b-1fb8-424a-bffa-992464cc76b8 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:44:b1,bridge_name='br-int',has_traffic_filtering=True,id=f22c0d53-f0da-4bc9-bf7b-c10fe61e2e1f,network=Network(a85a6e1f-20f5-4719-90d2-0dc23ce525cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf22c0d53-f0') {{(pid=72382) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 15:25:21 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:25:21 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:25:21 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 15:25:21 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:25:21 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf22c0d53-f0, may_exist=True, interface_attrs={}) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:25:21 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf22c0d53-f0, col_values=(('external_ids', {'iface-id': 'f22c0d53-f0da-4bc9-bf7b-c10fe61e2e1f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:72:44:b1', 'vm-uuid': '14c97840-88c0-4a8e-96e8-2e7da318ad07'}),), if_exists=True) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:25:21 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:25:21 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:25:21 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:25:21 user nova-compute[72382]: INFO os_vif [None req-f551d69b-1fb8-424a-bffa-992464cc76b8 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:44:b1,bridge_name='br-int',has_traffic_filtering=True,id=f22c0d53-f0da-4bc9-bf7b-c10fe61e2e1f,network=Network(a85a6e1f-20f5-4719-90d2-0dc23ce525cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf22c0d53-f0')
Aug 09 15:25:21 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-f551d69b-1fb8-424a-bffa-992464cc76b8 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] No BDM found with device name vda, not building metadata. {{(pid=72382) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 15:25:21 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-f551d69b-1fb8-424a-bffa-992464cc76b8 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] No VIF found with MAC fa:16:3e:72:44:b1, not building metadata {{(pid=72382) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 15:25:21 user nova-compute[72382]: DEBUG nova.network.neutron [req-dfd85c15-9941-4e0f-a849-4500e93683c3 req-0d9fb754-933b-42c2-9227-40170d3bf3e7 service nova] [instance: 14c97840-88c0-4a8e-96e8-2e7da318ad07] Updated VIF entry in instance network info cache for port f22c0d53-f0da-4bc9-bf7b-c10fe61e2e1f. {{(pid=72382) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 15:25:21 user nova-compute[72382]: DEBUG nova.network.neutron [req-dfd85c15-9941-4e0f-a849-4500e93683c3 req-0d9fb754-933b-42c2-9227-40170d3bf3e7 service nova] [instance: 14c97840-88c0-4a8e-96e8-2e7da318ad07] Updating instance_info_cache with network_info: [{"id": "f22c0d53-f0da-4bc9-bf7b-c10fe61e2e1f", "address": "fa:16:3e:72:44:b1", "network": {"id": "a85a6e1f-20f5-4719-90d2-0dc23ce525cd", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-780716970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c1a50eacfd0414bbc13e3fd4087e998", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf22c0d53-f0", "ovs_interfaceid": "f22c0d53-f0da-4bc9-bf7b-c10fe61e2e1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:25:21 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-dfd85c15-9941-4e0f-a849-4500e93683c3 req-0d9fb754-933b-42c2-9227-40170d3bf3e7 service nova] Releasing lock "refresh_cache-14c97840-88c0-4a8e-96e8-2e7da318ad07" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 15:25:22 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:25:22 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:25:22 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:25:23 user nova-compute[72382]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691594708.1055636, 0f4908de-d65d-4d17-ad36-6124a5e64a19 => Stopped> {{(pid=72382) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 15:25:23 user nova-compute[72382]: INFO nova.compute.manager [-] [instance: 0f4908de-d65d-4d17-ad36-6124a5e64a19] VM Stopped (Lifecycle Event)
Aug 09 15:25:23 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8f8dffa1-2ad5-45d5-8773-1bd601554578 None None] [instance: 0f4908de-d65d-4d17-ad36-6124a5e64a19] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:25:23 user nova-compute[72382]: DEBUG nova.compute.manager [req-e8089a20-a0ef-461f-8301-e88324a90812 req-e90d7442-670f-48f7-8cd2-ecf84d38d5a9 service nova] [instance: 14c97840-88c0-4a8e-96e8-2e7da318ad07] Received event network-vif-plugged-f22c0d53-f0da-4bc9-bf7b-c10fe61e2e1f {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:25:23 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-e8089a20-a0ef-461f-8301-e88324a90812 req-e90d7442-670f-48f7-8cd2-ecf84d38d5a9 service nova] Acquiring lock "14c97840-88c0-4a8e-96e8-2e7da318ad07-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:25:23 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-e8089a20-a0ef-461f-8301-e88324a90812 req-e90d7442-670f-48f7-8cd2-ecf84d38d5a9 service nova] Lock "14c97840-88c0-4a8e-96e8-2e7da318ad07-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:25:23 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-e8089a20-a0ef-461f-8301-e88324a90812 req-e90d7442-670f-48f7-8cd2-ecf84d38d5a9 service nova] Lock "14c97840-88c0-4a8e-96e8-2e7da318ad07-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:25:23 user nova-compute[72382]: DEBUG nova.compute.manager [req-e8089a20-a0ef-461f-8301-e88324a90812 req-e90d7442-670f-48f7-8cd2-ecf84d38d5a9 service nova] [instance: 14c97840-88c0-4a8e-96e8-2e7da318ad07] No waiting events found dispatching network-vif-plugged-f22c0d53-f0da-4bc9-bf7b-c10fe61e2e1f {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:25:23 user nova-compute[72382]: WARNING nova.compute.manager [req-e8089a20-a0ef-461f-8301-e88324a90812 req-e90d7442-670f-48f7-8cd2-ecf84d38d5a9 service nova] [instance: 14c97840-88c0-4a8e-96e8-2e7da318ad07] Received unexpected event network-vif-plugged-f22c0d53-f0da-4bc9-bf7b-c10fe61e2e1f for instance with vm_state building and task_state spawning.
Aug 09 15:25:23 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:25:23 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:25:23 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:25:24 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:25:25 user nova-compute[72382]: DEBUG nova.virt.driver [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Emitting event <LifecycleEvent: 1691594725.1612213, 14c97840-88c0-4a8e-96e8-2e7da318ad07 => Resumed> {{(pid=72382) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 15:25:25 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 14c97840-88c0-4a8e-96e8-2e7da318ad07] VM Resumed (Lifecycle Event)
Aug 09 15:25:25 user nova-compute[72382]: DEBUG nova.compute.manager [None req-f551d69b-1fb8-424a-bffa-992464cc76b8 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] [instance: 14c97840-88c0-4a8e-96e8-2e7da318ad07] Instance event wait completed in 0 seconds for  {{(pid=72382) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 15:25:25 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-f551d69b-1fb8-424a-bffa-992464cc76b8 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] [instance: 14c97840-88c0-4a8e-96e8-2e7da318ad07] Guest created on hypervisor {{(pid=72382) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 15:25:25 user nova-compute[72382]: INFO nova.virt.libvirt.driver [-] [instance: 14c97840-88c0-4a8e-96e8-2e7da318ad07] Instance spawned successfully.
Aug 09 15:25:25 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-f551d69b-1fb8-424a-bffa-992464cc76b8 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] [instance: 14c97840-88c0-4a8e-96e8-2e7da318ad07] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 15:25:25 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 14c97840-88c0-4a8e-96e8-2e7da318ad07] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:25:25 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 14c97840-88c0-4a8e-96e8-2e7da318ad07] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72382) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 15:25:25 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-f551d69b-1fb8-424a-bffa-992464cc76b8 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] [instance: 14c97840-88c0-4a8e-96e8-2e7da318ad07] Found default for hw_cdrom_bus of ide {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:25:25 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-f551d69b-1fb8-424a-bffa-992464cc76b8 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] [instance: 14c97840-88c0-4a8e-96e8-2e7da318ad07] Found default for hw_disk_bus of virtio {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:25:25 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-f551d69b-1fb8-424a-bffa-992464cc76b8 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] [instance: 14c97840-88c0-4a8e-96e8-2e7da318ad07] Found default for hw_input_bus of None {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:25:25 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-f551d69b-1fb8-424a-bffa-992464cc76b8 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] [instance: 14c97840-88c0-4a8e-96e8-2e7da318ad07] Found default for hw_pointer_model of None {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:25:25 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-f551d69b-1fb8-424a-bffa-992464cc76b8 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] [instance: 14c97840-88c0-4a8e-96e8-2e7da318ad07] Found default for hw_video_model of virtio {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:25:25 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-f551d69b-1fb8-424a-bffa-992464cc76b8 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] [instance: 14c97840-88c0-4a8e-96e8-2e7da318ad07] Found default for hw_vif_model of virtio {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:25:25 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 14c97840-88c0-4a8e-96e8-2e7da318ad07] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 15:25:25 user nova-compute[72382]: DEBUG nova.virt.driver [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Emitting event <LifecycleEvent: 1691594725.162258, 14c97840-88c0-4a8e-96e8-2e7da318ad07 => Started> {{(pid=72382) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 15:25:25 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 14c97840-88c0-4a8e-96e8-2e7da318ad07] VM Started (Lifecycle Event)
Aug 09 15:25:25 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 14c97840-88c0-4a8e-96e8-2e7da318ad07] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:25:25 user nova-compute[72382]: DEBUG nova.compute.manager [req-b98aabef-8642-4fb4-9afa-dfe34d3efa25 req-13120155-8c4f-405b-aaf9-c97b145c2aa7 service nova] [instance: 14c97840-88c0-4a8e-96e8-2e7da318ad07] Received event network-vif-plugged-f22c0d53-f0da-4bc9-bf7b-c10fe61e2e1f {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:25:25 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-b98aabef-8642-4fb4-9afa-dfe34d3efa25 req-13120155-8c4f-405b-aaf9-c97b145c2aa7 service nova] Acquiring lock "14c97840-88c0-4a8e-96e8-2e7da318ad07-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:25:25 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-b98aabef-8642-4fb4-9afa-dfe34d3efa25 req-13120155-8c4f-405b-aaf9-c97b145c2aa7 service nova] Lock "14c97840-88c0-4a8e-96e8-2e7da318ad07-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:25:25 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-b98aabef-8642-4fb4-9afa-dfe34d3efa25 req-13120155-8c4f-405b-aaf9-c97b145c2aa7 service nova] Lock "14c97840-88c0-4a8e-96e8-2e7da318ad07-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:25:25 user nova-compute[72382]: DEBUG nova.compute.manager [req-b98aabef-8642-4fb4-9afa-dfe34d3efa25 req-13120155-8c4f-405b-aaf9-c97b145c2aa7 service nova] [instance: 14c97840-88c0-4a8e-96e8-2e7da318ad07] No waiting events found dispatching network-vif-plugged-f22c0d53-f0da-4bc9-bf7b-c10fe61e2e1f {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:25:25 user nova-compute[72382]: WARNING nova.compute.manager [req-b98aabef-8642-4fb4-9afa-dfe34d3efa25 req-13120155-8c4f-405b-aaf9-c97b145c2aa7 service nova] [instance: 14c97840-88c0-4a8e-96e8-2e7da318ad07] Received unexpected event network-vif-plugged-f22c0d53-f0da-4bc9-bf7b-c10fe61e2e1f for instance with vm_state building and task_state spawning.
Aug 09 15:25:25 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 14c97840-88c0-4a8e-96e8-2e7da318ad07] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72382) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 15:25:25 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 14c97840-88c0-4a8e-96e8-2e7da318ad07] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 15:25:25 user nova-compute[72382]: INFO nova.compute.manager [None req-f551d69b-1fb8-424a-bffa-992464cc76b8 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] [instance: 14c97840-88c0-4a8e-96e8-2e7da318ad07] Took 6.33 seconds to spawn the instance on the hypervisor.
Aug 09 15:25:25 user nova-compute[72382]: DEBUG nova.compute.manager [None req-f551d69b-1fb8-424a-bffa-992464cc76b8 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] [instance: 14c97840-88c0-4a8e-96e8-2e7da318ad07] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:25:25 user nova-compute[72382]: INFO nova.compute.manager [None req-f551d69b-1fb8-424a-bffa-992464cc76b8 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] [instance: 14c97840-88c0-4a8e-96e8-2e7da318ad07] Took 7.13 seconds to build instance.
Aug 09 15:25:25 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-f551d69b-1fb8-424a-bffa-992464cc76b8 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Lock "14c97840-88c0-4a8e-96e8-2e7da318ad07" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.252s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:25:26 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:25:29 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:25:31 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:25:34 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:25:34 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-3d227ae8-8882-461a-aab9-85e02a74a452 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] Acquiring lock "8aa35482-60b8-4185-b14d-a2667fd3b5b7" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:25:34 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-3d227ae8-8882-461a-aab9-85e02a74a452 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] Lock "8aa35482-60b8-4185-b14d-a2667fd3b5b7" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:25:34 user nova-compute[72382]: INFO nova.compute.manager [None req-3d227ae8-8882-461a-aab9-85e02a74a452 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] [instance: 8aa35482-60b8-4185-b14d-a2667fd3b5b7] Detaching volume 0052e86d-16a7-4cbe-a802-ff770c0e20ba
Aug 09 15:25:34 user nova-compute[72382]: INFO nova.virt.block_device [None req-3d227ae8-8882-461a-aab9-85e02a74a452 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] [instance: 8aa35482-60b8-4185-b14d-a2667fd3b5b7] Attempting to driver detach volume 0052e86d-16a7-4cbe-a802-ff770c0e20ba from mountpoint /dev/vdb
Aug 09 15:25:34 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-3d227ae8-8882-461a-aab9-85e02a74a452 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] Attempting to detach device vdb from instance 8aa35482-60b8-4185-b14d-a2667fd3b5b7 from the persistent domain config. {{(pid=72382) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 15:25:34 user nova-compute[72382]: DEBUG nova.virt.libvirt.guest [None req-3d227ae8-8882-461a-aab9-85e02a74a452 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 15:25:34 user nova-compute[72382]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 15:25:34 user nova-compute[72382]:   <source dev="/dev/sde"/>
Aug 09 15:25:34 user nova-compute[72382]:   <target dev="vdb" bus="virtio"/>
Aug 09 15:25:34 user nova-compute[72382]:   <serial>0052e86d-16a7-4cbe-a802-ff770c0e20ba</serial>
Aug 09 15:25:34 user nova-compute[72382]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 15:25:34 user nova-compute[72382]: </disk>
Aug 09 15:25:34 user nova-compute[72382]:  {{(pid=72382) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 15:25:34 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-3d227ae8-8882-461a-aab9-85e02a74a452 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] Successfully detached device vdb from instance 8aa35482-60b8-4185-b14d-a2667fd3b5b7 from the persistent domain config.
Aug 09 15:25:34 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-3d227ae8-8882-461a-aab9-85e02a74a452 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 8aa35482-60b8-4185-b14d-a2667fd3b5b7 from the live domain config. {{(pid=72382) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 15:25:34 user nova-compute[72382]: DEBUG nova.virt.libvirt.guest [None req-3d227ae8-8882-461a-aab9-85e02a74a452 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 15:25:34 user nova-compute[72382]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 15:25:34 user nova-compute[72382]:   <source dev="/dev/sde"/>
Aug 09 15:25:34 user nova-compute[72382]:   <target dev="vdb" bus="virtio"/>
Aug 09 15:25:34 user nova-compute[72382]:   <serial>0052e86d-16a7-4cbe-a802-ff770c0e20ba</serial>
Aug 09 15:25:34 user nova-compute[72382]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 15:25:34 user nova-compute[72382]: </disk>
Aug 09 15:25:34 user nova-compute[72382]:  {{(pid=72382) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 15:25:35 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Received event <DeviceRemovedEvent: 1691594735.4858854, 8aa35482-60b8-4185-b14d-a2667fd3b5b7 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72382) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 15:25:35 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-3d227ae8-8882-461a-aab9-85e02a74a452 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 8aa35482-60b8-4185-b14d-a2667fd3b5b7 {{(pid=72382) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 15:25:35 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-3d227ae8-8882-461a-aab9-85e02a74a452 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] Successfully detached device vdb from instance 8aa35482-60b8-4185-b14d-a2667fd3b5b7 from the live domain config.
Aug 09 15:25:35 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3d227ae8-8882-461a-aab9-85e02a74a452 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] [instance: 8aa35482-60b8-4185-b14d-a2667fd3b5b7] calling os-brick to detach iSCSI Volume {{(pid=72382) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 15:25:35 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d227ae8-8882-461a-aab9-85e02a74a452 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2a0c768340>, {'target_iqns': ['iqn.2010-10.org.openstack:0052e86d-16a7-4cbe-a802-ff770c0e20ba'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TMwGDLsY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 15:25:35 user nova-compute[72382]: WARNING os_brick.initiator.connectors.base [None req-3d227ae8-8882-461a-aab9-85e02a74a452 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 15:25:35 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-3d227ae8-8882-461a-aab9-85e02a74a452 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 15:25:35 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-3d227ae8-8882-461a-aab9-85e02a74a452 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 15:25:35 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d227ae8-8882-461a-aab9-85e02a74a452 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0052e86d-16a7-4cbe-a802-ff770c0e20ba', 0)] {{(pid=72382) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 15:25:35 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:25:35 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:25:35 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[98e5a844-79cb-4143-bba0-cd0654c1f003]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0052e86d-16a7-4cbe-a802-ff770c0e20ba\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:25:35 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:25:35 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:25:35 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f222bfa-24d3-4edf-a5c5-0c09f4aeb2bf]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0052e86d-16a7-4cbe-a802-ff770c0e20ba (non-flash)\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:25:35 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d227ae8-8882-461a-aab9-85e02a74a452 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)
Aug 09 15:25:35 user nova-compute[72382]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0052e86d-16a7-4cbe-a802-ff770c0e20ba (non-flash)
Aug 09 15:25:35 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 15:25:35 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d227ae8-8882-461a-aab9-85e02a74a452 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)
Aug 09 15:25:35 user nova-compute[72382]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0052e86d-16a7-4cbe-a802-ff770c0e20ba (non-flash)
Aug 09 15:25:35 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 15:25:35 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d227ae8-8882-461a-aab9-85e02a74a452 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2a0c758c10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0052e86d-16a7-4cbe-a802-ff770c0e20ba'): ({'sde'}, set())}) {{(pid=72382) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 15:25:35 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-3d227ae8-8882-461a-aab9-85e02a74a452 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] Removing single pathed devices sde {{(pid=72382) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 15:25:35 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:25:35 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:25:35 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe4e8ce6-a115-4711-b6bf-9950d3bed3d9]: (4, ('path checker states:\nup                  1\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:25:35 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:25:35 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.024s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:25:35 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[34c76eea-8e63-4a21-8a40-f3aa062f69ca]: (4, ('ok\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:25:35 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-3d227ae8-8882-461a-aab9-85e02a74a452 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] Flushing IO for device /dev/sde {{(pid=72382) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 15:25:35 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:25:35 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.026s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:25:35 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[981e49e9-779b-4928-8ace-b5b666511cad]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:25:35 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-3d227ae8-8882-461a-aab9-85e02a74a452 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72382) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 15:25:35 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:25:35 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.046s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:25:35 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc88817b-3368-4bf8-ae96-011f159857a4]: (4, ('1', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:25:35 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-3d227ae8-8882-461a-aab9-85e02a74a452 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72382) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 15:25:35 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-3d227ae8-8882-461a-aab9-85e02a74a452 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] SCSI volumes sde have been removed. {{(pid=72382) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 15:25:35 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d227ae8-8882-461a-aab9-85e02a74a452 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0052e86d-16a7-4cbe-a802-ff770c0e20ba')] {{(pid=72382) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 15:25:35 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0052e86d-16a7-4cbe-a802-ff770c0e20ba -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:25:35 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0052e86d-16a7-4cbe-a802-ff770c0e20ba -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:25:35 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c1f28f7-f2c7-4f0e-b574-0681279aee1b]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:25:35 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d227ae8-8882-461a-aab9-85e02a74a452 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:25:35 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0052e86d-16a7-4cbe-a802-ff770c0e20ba -p 172.16.0.220:3260 --logout {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:25:35 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0052e86d-16a7-4cbe-a802-ff770c0e20ba -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:25:35 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[28e161c7-f153-42ff-9afa-7922ecc23b8b]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:0052e86d-16a7-4cbe-a802-ff770c0e20ba, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:0052e86d-16a7-4cbe-a802-ff770c0e20ba, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:25:35 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d227ae8-8882-461a-aab9-85e02a74a452 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:0052e86d-16a7-4cbe-a802-ff770c0e20ba, portal: 172.16.0.220,3260]
Aug 09 15:25:35 user nova-compute[72382]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:0052e86d-16a7-4cbe-a802-ff770c0e20ba, portal: 172.16.0.220,3260] successful.
Aug 09 15:25:35 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:25:35 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0052e86d-16a7-4cbe-a802-ff770c0e20ba -p 172.16.0.220:3260 --op delete {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:25:35 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0052e86d-16a7-4cbe-a802-ff770c0e20ba -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:25:35 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[5825dfad-64f1-432e-9ddb-0463cf2194b7]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:25:35 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d227ae8-8882-461a-aab9-85e02a74a452 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:25:35 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-3d227ae8-8882-461a-aab9-85e02a74a452 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.317s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 15:25:35 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d227ae8-8882-461a-aab9-85e02a74a452 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] <== disconnect_volume: return (319ms) None {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 15:25:35 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3d227ae8-8882-461a-aab9-85e02a74a452 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] [instance: 8aa35482-60b8-4185-b14d-a2667fd3b5b7] Disconnected iSCSI Volume {{(pid=72382) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 15:25:36 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8f920262-1767-4022-924e-5efcdcba67c4 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] [instance: 6ea8f68c-3dc1-45ac-a7f3-bca32f929add] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:25:36 user nova-compute[72382]: INFO nova.compute.manager [None req-8f920262-1767-4022-924e-5efcdcba67c4 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] [instance: 6ea8f68c-3dc1-45ac-a7f3-bca32f929add] instance snapshotting
Aug 09 15:25:36 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-8f920262-1767-4022-924e-5efcdcba67c4 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] [instance: 6ea8f68c-3dc1-45ac-a7f3-bca32f929add] Beginning live snapshot process
Aug 09 15:25:36 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:25:36 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-8f920262-1767-4022-924e-5efcdcba67c4 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ea8f68c-3dc1-45ac-a7f3-bca32f929add/disk --force-share --output=json -f qcow2 {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:25:36 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-8f920262-1767-4022-924e-5efcdcba67c4 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ea8f68c-3dc1-45ac-a7f3-bca32f929add/disk --force-share --output=json -f qcow2" returned: 0 in 0.173s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:25:36 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-8f920262-1767-4022-924e-5efcdcba67c4 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ea8f68c-3dc1-45ac-a7f3-bca32f929add/disk --force-share --output=json -f qcow2 {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:25:36 user nova-compute[72382]: DEBUG nova.objects.instance [None req-3d227ae8-8882-461a-aab9-85e02a74a452 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] Lazy-loading 'flavor' on Instance uuid 8aa35482-60b8-4185-b14d-a2667fd3b5b7 {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:25:36 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-3d227ae8-8882-461a-aab9-85e02a74a452 tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] Lock "8aa35482-60b8-4185-b14d-a2667fd3b5b7" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.763s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:25:36 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-8f920262-1767-4022-924e-5efcdcba67c4 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ea8f68c-3dc1-45ac-a7f3-bca32f929add/disk --force-share --output=json -f qcow2" returned: 0 in 0.132s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:25:36 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-8f920262-1767-4022-924e-5efcdcba67c4 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:25:36 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-8f920262-1767-4022-924e-5efcdcba67c4 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b --force-share --output=json" returned: 0 in 0.136s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:25:36 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-8f920262-1767-4022-924e-5efcdcba67c4 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp8dl_5izp/c3ce6d178a1249f4b907a80e3c735586.delta 1073741824 {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:25:36 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-8f920262-1767-4022-924e-5efcdcba67c4 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp8dl_5izp/c3ce6d178a1249f4b907a80e3c735586.delta 1073741824" returned: 0 in 0.054s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:25:36 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-8f920262-1767-4022-924e-5efcdcba67c4 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] [instance: 6ea8f68c-3dc1-45ac-a7f3-bca32f929add] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 09 15:25:37 user nova-compute[72382]: DEBUG nova.virt.libvirt.guest [None req-8f920262-1767-4022-924e-5efcdcba67c4 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=72382) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 09 15:25:38 user nova-compute[72382]: DEBUG nova.virt.libvirt.guest [None req-8f920262-1767-4022-924e-5efcdcba67c4 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=72382) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 09 15:25:38 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-8f920262-1767-4022-924e-5efcdcba67c4 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] [instance: 6ea8f68c-3dc1-45ac-a7f3-bca32f929add] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 09 15:25:38 user nova-compute[72382]: DEBUG nova.privsep.utils [None req-8f920262-1767-4022-924e-5efcdcba67c4 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72382) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 09 15:25:38 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-8f920262-1767-4022-924e-5efcdcba67c4 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp8dl_5izp/c3ce6d178a1249f4b907a80e3c735586.delta /opt/stack/data/nova/instances/snapshots/tmp8dl_5izp/c3ce6d178a1249f4b907a80e3c735586 {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:25:38 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-8f920262-1767-4022-924e-5efcdcba67c4 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp8dl_5izp/c3ce6d178a1249f4b907a80e3c735586.delta /opt/stack/data/nova/instances/snapshots/tmp8dl_5izp/c3ce6d178a1249f4b907a80e3c735586" returned: 0 in 0.663s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:25:38 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-8f920262-1767-4022-924e-5efcdcba67c4 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] [instance: 6ea8f68c-3dc1-45ac-a7f3-bca32f929add] Snapshot extracted, beginning image upload
Aug 09 15:25:39 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:25:40 user nova-compute[72382]: DEBUG nova.compute.manager [req-7a36ed8d-bf99-4416-8c36-ae1b628e7f30 req-e865d1f2-09c5-480f-a64d-82acc5a8cc21 service nova] [instance: 61976531-76ae-4a1c-8950-0af784be376e] Received event network-changed-adf7f33a-6792-47f7-b8e6-4d0775b01f9d {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:25:40 user nova-compute[72382]: DEBUG nova.compute.manager [req-7a36ed8d-bf99-4416-8c36-ae1b628e7f30 req-e865d1f2-09c5-480f-a64d-82acc5a8cc21 service nova] [instance: 61976531-76ae-4a1c-8950-0af784be376e] Refreshing instance network info cache due to event network-changed-adf7f33a-6792-47f7-b8e6-4d0775b01f9d. {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 15:25:40 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-7a36ed8d-bf99-4416-8c36-ae1b628e7f30 req-e865d1f2-09c5-480f-a64d-82acc5a8cc21 service nova] Acquiring lock "refresh_cache-61976531-76ae-4a1c-8950-0af784be376e" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 15:25:40 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-7a36ed8d-bf99-4416-8c36-ae1b628e7f30 req-e865d1f2-09c5-480f-a64d-82acc5a8cc21 service nova] Acquired lock "refresh_cache-61976531-76ae-4a1c-8950-0af784be376e" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 15:25:40 user nova-compute[72382]: DEBUG nova.network.neutron [req-7a36ed8d-bf99-4416-8c36-ae1b628e7f30 req-e865d1f2-09c5-480f-a64d-82acc5a8cc21 service nova] [instance: 61976531-76ae-4a1c-8950-0af784be376e] Refreshing network info cache for port adf7f33a-6792-47f7-b8e6-4d0775b01f9d {{(pid=72382) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 15:25:40 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:25:41 user nova-compute[72382]: DEBUG nova.network.neutron [req-7a36ed8d-bf99-4416-8c36-ae1b628e7f30 req-e865d1f2-09c5-480f-a64d-82acc5a8cc21 service nova] [instance: 61976531-76ae-4a1c-8950-0af784be376e] Updated VIF entry in instance network info cache for port adf7f33a-6792-47f7-b8e6-4d0775b01f9d. {{(pid=72382) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 15:25:41 user nova-compute[72382]: DEBUG nova.network.neutron [req-7a36ed8d-bf99-4416-8c36-ae1b628e7f30 req-e865d1f2-09c5-480f-a64d-82acc5a8cc21 service nova] [instance: 61976531-76ae-4a1c-8950-0af784be376e] Updating instance_info_cache with network_info: [{"id": "adf7f33a-6792-47f7-b8e6-4d0775b01f9d", "address": "fa:16:3e:d5:b3:b9", "network": {"id": "46eb5f03-e04d-43d1-96d6-0792bc7a94b1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1842512309-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98009994d9c74eb9b4fc6321e82440de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadf7f33a-67", "ovs_interfaceid": "adf7f33a-6792-47f7-b8e6-4d0775b01f9d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:25:41 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-7a36ed8d-bf99-4416-8c36-ae1b628e7f30 req-e865d1f2-09c5-480f-a64d-82acc5a8cc21 service nova] Releasing lock "refresh_cache-61976531-76ae-4a1c-8950-0af784be376e" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 15:25:41 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:25:42 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-8f920262-1767-4022-924e-5efcdcba67c4 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] [instance: 6ea8f68c-3dc1-45ac-a7f3-bca32f929add] Snapshot image upload complete
Aug 09 15:25:42 user nova-compute[72382]: INFO nova.compute.manager [None req-8f920262-1767-4022-924e-5efcdcba67c4 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] [instance: 6ea8f68c-3dc1-45ac-a7f3-bca32f929add] Took 6.35 seconds to snapshot the instance on the hypervisor.
Aug 09 15:25:44 user nova-compute[72382]: DEBUG nova.compute.manager [req-245bf692-682b-4b99-b70d-1ae315a8878c req-7f5857e9-3b61-4f0a-a122-6ed43e37ff6a service nova] [instance: e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0] Received event network-changed-9513dc1d-79d5-482b-baaa-81f525e99de7 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:25:44 user nova-compute[72382]: DEBUG nova.compute.manager [req-245bf692-682b-4b99-b70d-1ae315a8878c req-7f5857e9-3b61-4f0a-a122-6ed43e37ff6a service nova] [instance: e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0] Refreshing instance network info cache due to event network-changed-9513dc1d-79d5-482b-baaa-81f525e99de7. {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 15:25:44 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-245bf692-682b-4b99-b70d-1ae315a8878c req-7f5857e9-3b61-4f0a-a122-6ed43e37ff6a service nova] Acquiring lock "refresh_cache-e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 15:25:44 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-245bf692-682b-4b99-b70d-1ae315a8878c req-7f5857e9-3b61-4f0a-a122-6ed43e37ff6a service nova] Acquired lock "refresh_cache-e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 15:25:44 user nova-compute[72382]: DEBUG nova.network.neutron [req-245bf692-682b-4b99-b70d-1ae315a8878c req-7f5857e9-3b61-4f0a-a122-6ed43e37ff6a service nova] [instance: e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0] Refreshing network info cache for port 9513dc1d-79d5-482b-baaa-81f525e99de7 {{(pid=72382) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 15:25:44 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:25:44 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e6319ece-6c83-47da-9076-5e18a51d07e1 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Acquiring lock "e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:25:44 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e6319ece-6c83-47da-9076-5e18a51d07e1 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Lock "e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:25:44 user nova-compute[72382]: DEBUG nova.objects.instance [None req-e6319ece-6c83-47da-9076-5e18a51d07e1 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Lazy-loading 'flavor' on Instance uuid e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0 {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:25:44 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e6319ece-6c83-47da-9076-5e18a51d07e1 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Lock "e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:25:44 user nova-compute[72382]: DEBUG nova.network.neutron [req-245bf692-682b-4b99-b70d-1ae315a8878c req-7f5857e9-3b61-4f0a-a122-6ed43e37ff6a service nova] [instance: e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0] Updated VIF entry in instance network info cache for port 9513dc1d-79d5-482b-baaa-81f525e99de7. {{(pid=72382) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 15:25:44 user nova-compute[72382]: DEBUG nova.network.neutron [req-245bf692-682b-4b99-b70d-1ae315a8878c req-7f5857e9-3b61-4f0a-a122-6ed43e37ff6a service nova] [instance: e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0] Updating instance_info_cache with network_info: [{"id": "9513dc1d-79d5-482b-baaa-81f525e99de7", "address": "fa:16:3e:6f:6b:41", "network": {"id": "46ef00c7-17ee-4e45-ba1d-dcc0a417ea85", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1360012261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.24", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "990ba791030940d38360af5879c853c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9513dc1d-79", "ovs_interfaceid": "9513dc1d-79d5-482b-baaa-81f525e99de7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:25:44 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-245bf692-682b-4b99-b70d-1ae315a8878c req-7f5857e9-3b61-4f0a-a122-6ed43e37ff6a service nova] Releasing lock "refresh_cache-e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 15:25:44 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e6319ece-6c83-47da-9076-5e18a51d07e1 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Acquiring lock "e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:25:44 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e6319ece-6c83-47da-9076-5e18a51d07e1 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Lock "e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:25:44 user nova-compute[72382]: INFO nova.compute.manager [None req-e6319ece-6c83-47da-9076-5e18a51d07e1 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] [instance: e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0] Attaching volume bd90521a-f3b5-485c-9fb9-61ab37267f3a to /dev/vdb
Aug 09 15:25:44 user nova-compute[72382]: DEBUG os_brick.utils [None req-e6319ece-6c83-47da-9076-5e18a51d07e1 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 15:25:44 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:25:44 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:25:44 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[558aae51-996d-4316-8b9b-696bfee95ca4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d2cfa7015fe\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:25:44 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:25:44 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:25:44 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2fc7e0d-e26a-4150-af10-82a4eb159fb5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:25:44 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:25:44 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:25:44 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[d62e1ff3-58a4-4a22-8f0e-c5313f702d74]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:25:44 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[4614e38f-0e69-4836-b11a-3f93ad999ef9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:25:44 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e6319ece-6c83-47da-9076-5e18a51d07e1 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Running cmd (subprocess): nvme version {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:25:44 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e6319ece-6c83-47da-9076-5e18a51d07e1 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] 'nvme version' failed. Not Retrying. {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 15:25:44 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e6319ece-6c83-47da-9076-5e18a51d07e1 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] nvme not present on system {{(pid=72382) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 15:25:44 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:25:44 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 15:25:44 user nova-compute[72382]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 15:25:44 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d3529f1-150c-4e87-9459-68feb8948ef1]: (4, '') {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:25:44 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.lightos [None req-e6319ece-6c83-47da-9076-5e18a51d07e1 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72382) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 15:25:44 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.lightos [None req-e6319ece-6c83-47da-9076-5e18a51d07e1 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72382) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 15:25:44 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.lightos [None req-e6319ece-6c83-47da-9076-5e18a51d07e1 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] LIGHTOS: no hostnqn found. {{(pid=72382) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 15:25:44 user nova-compute[72382]: DEBUG os_brick.utils [None req-e6319ece-6c83-47da-9076-5e18a51d07e1 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d2cfa7015fe', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 15:25:44 user nova-compute[72382]: DEBUG nova.virt.block_device [None req-e6319ece-6c83-47da-9076-5e18a51d07e1 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] [instance: e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0] Updating existing volume attachment record: 03ddcf8b-4271-46e2-9dff-4a87ce4d45b5 {{(pid=72382) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 15:25:45 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-5fecad87-cda1-40fc-9915-fd826adcdb92 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Acquiring lock "61976531-76ae-4a1c-8950-0af784be376e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:25:45 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-5fecad87-cda1-40fc-9915-fd826adcdb92 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Lock "61976531-76ae-4a1c-8950-0af784be376e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:25:45 user nova-compute[72382]: DEBUG nova.objects.instance [None req-5fecad87-cda1-40fc-9915-fd826adcdb92 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Lazy-loading 'flavor' on Instance uuid 61976531-76ae-4a1c-8950-0af784be376e {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:25:45 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-5fecad87-cda1-40fc-9915-fd826adcdb92 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Lock "61976531-76ae-4a1c-8950-0af784be376e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.064s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:25:45 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-5fecad87-cda1-40fc-9915-fd826adcdb92 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Acquiring lock "61976531-76ae-4a1c-8950-0af784be376e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:25:45 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-5fecad87-cda1-40fc-9915-fd826adcdb92 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Lock "61976531-76ae-4a1c-8950-0af784be376e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:25:45 user nova-compute[72382]: INFO nova.compute.manager [None req-5fecad87-cda1-40fc-9915-fd826adcdb92 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] [instance: 61976531-76ae-4a1c-8950-0af784be376e] Attaching volume 9572706e-c54c-42c2-9cf0-2690cdf4cca2 to /dev/vdb
Aug 09 15:25:45 user nova-compute[72382]: DEBUG os_brick.utils [None req-5fecad87-cda1-40fc-9915-fd826adcdb92 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 15:25:45 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:25:45 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:25:45 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[0440ec25-25dd-434e-955d-6acc42506282]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d2cfa7015fe\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:25:45 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:25:45 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:25:45 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[4500415d-d045-4f49-91e3-732c102b86d2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:25:45 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:25:45 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.013s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:25:45 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3dcc7bf-479d-4a60-9920-1b481942cfee]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:25:45 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3c14666-d200-472e-a610-a62c2eaf0aa6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:25:45 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-5fecad87-cda1-40fc-9915-fd826adcdb92 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Running cmd (subprocess): nvme version {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:25:45 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-5fecad87-cda1-40fc-9915-fd826adcdb92 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] 'nvme version' failed. Not Retrying. {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 15:25:45 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5fecad87-cda1-40fc-9915-fd826adcdb92 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] nvme not present on system {{(pid=72382) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 15:25:45 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:25:45 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 15:25:45 user nova-compute[72382]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 15:25:45 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb818948-4329-4c27-9550-3cef4ca120ff]: (4, '') {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:25:45 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.lightos [None req-5fecad87-cda1-40fc-9915-fd826adcdb92 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72382) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 15:25:45 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.lightos [None req-5fecad87-cda1-40fc-9915-fd826adcdb92 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72382) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 15:25:45 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.lightos [None req-5fecad87-cda1-40fc-9915-fd826adcdb92 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] LIGHTOS: no hostnqn found. {{(pid=72382) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 15:25:45 user nova-compute[72382]: DEBUG os_brick.utils [None req-5fecad87-cda1-40fc-9915-fd826adcdb92 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] <== get_connector_properties: return (111ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d2cfa7015fe', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 15:25:45 user nova-compute[72382]: DEBUG nova.virt.block_device [None req-5fecad87-cda1-40fc-9915-fd826adcdb92 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] [instance: 61976531-76ae-4a1c-8950-0af784be376e] Updating existing volume attachment record: 55acfc8e-3f31-4964-8928-c0aca732efd0 {{(pid=72382) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 15:25:46 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:25:49 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:25:51 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:25:53 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5fecad87-cda1-40fc-9915-fd826adcdb92 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] [instance: 61976531-76ae-4a1c-8950-0af784be376e] Calling os-brick to attach iSCSI Volume {{(pid=72382) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 15:25:53 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fecad87-cda1-40fc-9915-fd826adcdb92 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2a0c768340>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:9572706e-c54c-42c2-9cf0-2690cdf4cca2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XlKrmHQz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 15:25:53 user nova-compute[72382]: WARNING os_brick.initiator.connectors.base [None req-5fecad87-cda1-40fc-9915-fd826adcdb92 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 15:25:53 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-5fecad87-cda1-40fc-9915-fd826adcdb92 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 15:25:53 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-5fecad87-cda1-40fc-9915-fd826adcdb92 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 15:25:53 user nova-compute[72382]: WARNING os_brick.initiator.connectors.base [None req-5fecad87-cda1-40fc-9915-fd826adcdb92 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 15:25:53 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-5fecad87-cda1-40fc-9915-fd826adcdb92 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9572706e-c54c-42c2-9cf0-2690cdf4cca2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 15:25:53 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-5fecad87-cda1-40fc-9915-fd826adcdb92 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9572706e-c54c-42c2-9cf0-2690cdf4cca2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 15:25:53 user nova-compute[72382]: INFO os_brick.initiator.connectors.iscsi [None req-5fecad87-cda1-40fc-9915-fd826adcdb92 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 15:25:53 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9572706e-c54c-42c2-9cf0-2690cdf4cca2 -p 172.16.0.220:3260 {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:25:53 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9572706e-c54c-42c2-9cf0-2690cdf4cca2 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:25:53 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc401066-ea15-4845-a32b-0c0a38232d5d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:25:53 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fecad87-cda1-40fc-9915-fd826adcdb92 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 15:25:53 user nova-compute[72382]:  {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:25:53 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9572706e-c54c-42c2-9cf0-2690cdf4cca2 -p 172.16.0.220:3260 --interface default --op new {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:25:53 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9572706e-c54c-42c2-9cf0-2690cdf4cca2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:25:53 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c4b157b-1e78-413a-8ec6-e552ee6d126f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9572706e-c54c-42c2-9cf0-2690cdf4cca2] added\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:25:53 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fecad87-cda1-40fc-9915-fd826adcdb92 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9572706e-c54c-42c2-9cf0-2690cdf4cca2] added
Aug 09 15:25:53 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:25:53 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9572706e-c54c-42c2-9cf0-2690cdf4cca2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:25:53 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9572706e-c54c-42c2-9cf0-2690cdf4cca2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:25:53 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[272e696b-4a3c-4f9a-be96-345ac10358d9]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:25:53 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fecad87-cda1-40fc-9915-fd826adcdb92 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:25:53 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9572706e-c54c-42c2-9cf0-2690cdf4cca2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:25:54 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9572706e-c54c-42c2-9cf0-2690cdf4cca2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.062s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:25:54 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce4c34eb-b001-4fec-b36d-e996317c57e7]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:25:54 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fecad87-cda1-40fc-9915-fd826adcdb92 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:25:54 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9572706e-c54c-42c2-9cf0-2690cdf4cca2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XlKrmHQz {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:25:54 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9572706e-c54c-42c2-9cf0-2690cdf4cca2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XlKrmHQz" returned: 0 in 0.019s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:25:54 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[82f5e57a-b206-4915-8187-ccef72c076fe]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:25:54 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fecad87-cda1-40fc-9915-fd826adcdb92 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XlKrmHQz'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:25:54 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9572706e-c54c-42c2-9cf0-2690cdf4cca2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:25:54 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9572706e-c54c-42c2-9cf0-2690cdf4cca2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:25:54 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[abc02b6e-efd1-47ca-ac05-550dbf468b50]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:25:54 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fecad87-cda1-40fc-9915-fd826adcdb92 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:25:54 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:25:54 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:25:54 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b29a462-ef13-4025-b585-bf99786f0c1a]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:25:54 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fecad87-cda1-40fc-9915-fd826adcdb92 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)
Aug 09 15:25:54 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 15:25:54 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fecad87-cda1-40fc-9915-fd826adcdb92 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)
Aug 09 15:25:54 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 15:25:54 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9572706e-c54c-42c2-9cf0-2690cdf4cca2 -p 172.16.0.220:3260 --login {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:25:54 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9572706e-c54c-42c2-9cf0-2690cdf4cca2 -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:25:54 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[d528e493-a920-4407-a8cd-e914629deed9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9572706e-c54c-42c2-9cf0-2690cdf4cca2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9572706e-c54c-42c2-9cf0-2690cdf4cca2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:25:54 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fecad87-cda1-40fc-9915-fd826adcdb92 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9572706e-c54c-42c2-9cf0-2690cdf4cca2, portal: 172.16.0.220,3260]
Aug 09 15:25:54 user nova-compute[72382]: Login to [iface: default, target: iqn.2010-10.org.openstack:9572706e-c54c-42c2-9cf0-2690cdf4cca2, portal: 172.16.0.220,3260] successful.
Aug 09 15:25:54 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:25:54 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9572706e-c54c-42c2-9cf0-2690cdf4cca2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:25:54 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9572706e-c54c-42c2-9cf0-2690cdf4cca2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:25:54 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[b05e2cc0-ae15-47b5-b2b0-1fe36558ca15]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:25:54 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fecad87-cda1-40fc-9915-fd826adcdb92 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:25:54 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:25:54 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:25:54 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:25:54 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6a650fb-f739-4f11-ab88-9c84af1a6330]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9572706e-c54c-42c2-9cf0-2690cdf4cca2 (non-flash)\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:25:54 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fecad87-cda1-40fc-9915-fd826adcdb92 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)
Aug 09 15:25:54 user nova-compute[72382]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9572706e-c54c-42c2-9cf0-2690cdf4cca2 (non-flash)
Aug 09 15:25:54 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 15:25:54 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fecad87-cda1-40fc-9915-fd826adcdb92 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)
Aug 09 15:25:54 user nova-compute[72382]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9572706e-c54c-42c2-9cf0-2690cdf4cca2 (non-flash)
Aug 09 15:25:54 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 15:25:54 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-5fecad87-cda1-40fc-9915-fd826adcdb92 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9572706e-c54c-42c2-9cf0-2690cdf4cca2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.307s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 15:25:54 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fecad87-cda1-40fc-9915-fd826adcdb92 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Connected to 172.16.0.220:3260 {{(pid=72382) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 15:25:54 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-5fecad87-cda1-40fc-9915-fd826adcdb92 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] HCTL ('33', '-', '-', 0) found on session 28 with lun 0 {{(pid=72382) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 15:25:54 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-5fecad87-cda1-40fc-9915-fd826adcdb92 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72382) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 15:25:54 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:25:54 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:25:54 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0c45105-be16-4102-bcb9-55a5406ce166]: (4, ('- - 0', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:25:54 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-5fecad87-cda1-40fc-9915-fd826adcdb92 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Searching for a device in session 28 and hctl ['33', '*', '*', 0] yield: None {{(pid=72382) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 15:25:55 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-5fecad87-cda1-40fc-9915-fd826adcdb92 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Searching for a device in session 28 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72382) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 15:25:55 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fecad87-cda1-40fc-9915-fd826adcdb92 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XlKrmHQz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72382) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 15:25:55 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-5fecad87-cda1-40fc-9915-fd826adcdb92 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.338s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 15:25:55 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fecad87-cda1-40fc-9915-fd826adcdb92 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] <== connect_volume: return (1340ms) {'type': 'block', 'scsi_wwn': '26162396531613265', 'path': '/dev/sdb'} {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 15:25:55 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5fecad87-cda1-40fc-9915-fd826adcdb92 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] [instance: 61976531-76ae-4a1c-8950-0af784be376e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26162396531613265', 'path': '/dev/sdb'} {{(pid=72382) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 15:25:55 user nova-compute[72382]: DEBUG nova.objects.instance [None req-5fecad87-cda1-40fc-9915-fd826adcdb92 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Lazy-loading 'flavor' on Instance uuid 61976531-76ae-4a1c-8950-0af784be376e {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:25:55 user nova-compute[72382]: DEBUG nova.virt.libvirt.guest [None req-5fecad87-cda1-40fc-9915-fd826adcdb92 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 15:25:55 user nova-compute[72382]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 15:25:55 user nova-compute[72382]:   <source dev="/dev/sdb"/>
Aug 09 15:25:55 user nova-compute[72382]:   <target dev="vdb" bus="virtio"/>
Aug 09 15:25:55 user nova-compute[72382]:   <serial>9572706e-c54c-42c2-9cf0-2690cdf4cca2</serial>
Aug 09 15:25:55 user nova-compute[72382]: </disk>
Aug 09 15:25:55 user nova-compute[72382]:  {{(pid=72382) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 15:25:55 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-5fecad87-cda1-40fc-9915-fd826adcdb92 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] No BDM found with device name vda, not building metadata. {{(pid=72382) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 15:25:55 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-5fecad87-cda1-40fc-9915-fd826adcdb92 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72382) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 15:25:55 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-5fecad87-cda1-40fc-9915-fd826adcdb92 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] No VIF found with MAC fa:16:3e:d5:b3:b9, not building metadata {{(pid=72382) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 15:25:55 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-5fecad87-cda1-40fc-9915-fd826adcdb92 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Lock "61976531-76ae-4a1c-8950-0af784be376e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.380s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:25:56 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:25:59 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:25:59 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-8f436a6a-8e4b-4ef6-832a-dd6fa174fa55 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Acquiring lock "48161b45-d21a-4fb1-ae90-4613d849bfa7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:25:59 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-8f436a6a-8e4b-4ef6-832a-dd6fa174fa55 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Lock "48161b45-d21a-4fb1-ae90-4613d849bfa7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:25:59 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8f436a6a-8e4b-4ef6-832a-dd6fa174fa55 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] [instance: 48161b45-d21a-4fb1-ae90-4613d849bfa7] Starting instance... {{(pid=72382) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 15:25:59 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-8f436a6a-8e4b-4ef6-832a-dd6fa174fa55 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:25:59 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-8f436a6a-8e4b-4ef6-832a-dd6fa174fa55 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:25:59 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-8f436a6a-8e4b-4ef6-832a-dd6fa174fa55 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72382) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 15:25:59 user nova-compute[72382]: INFO nova.compute.claims [None req-8f436a6a-8e4b-4ef6-832a-dd6fa174fa55 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] [instance: 48161b45-d21a-4fb1-ae90-4613d849bfa7] Claim successful on node user
Aug 09 15:26:00 user nova-compute[72382]: DEBUG nova.compute.provider_tree [None req-8f436a6a-8e4b-4ef6-832a-dd6fa174fa55 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Inventory has not changed in ProviderTree for provider: 7b15b0e5-df4d-49db-833b-2855d21d10ae {{(pid=72382) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 15:26:00 user nova-compute[72382]: DEBUG nova.scheduler.client.report [None req-8f436a6a-8e4b-4ef6-832a-dd6fa174fa55 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Inventory has not changed for provider 7b15b0e5-df4d-49db-833b-2855d21d10ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72382) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 15:26:00 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-8f436a6a-8e4b-4ef6-832a-dd6fa174fa55 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.578s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:26:00 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8f436a6a-8e4b-4ef6-832a-dd6fa174fa55 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] [instance: 48161b45-d21a-4fb1-ae90-4613d849bfa7] Start building networks asynchronously for instance. {{(pid=72382) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 15:26:00 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8f436a6a-8e4b-4ef6-832a-dd6fa174fa55 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] [instance: 48161b45-d21a-4fb1-ae90-4613d849bfa7] Allocating IP information in the background. {{(pid=72382) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 15:26:00 user nova-compute[72382]: DEBUG nova.network.neutron [None req-8f436a6a-8e4b-4ef6-832a-dd6fa174fa55 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] [instance: 48161b45-d21a-4fb1-ae90-4613d849bfa7] allocate_for_instance() {{(pid=72382) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 15:26:00 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-8f436a6a-8e4b-4ef6-832a-dd6fa174fa55 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] [instance: 48161b45-d21a-4fb1-ae90-4613d849bfa7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 15:26:00 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8f436a6a-8e4b-4ef6-832a-dd6fa174fa55 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] [instance: 48161b45-d21a-4fb1-ae90-4613d849bfa7] Start building block device mappings for instance. {{(pid=72382) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 15:26:00 user nova-compute[72382]: DEBUG nova.policy [None req-8f436a6a-8e4b-4ef6-832a-dd6fa174fa55 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '401c9df41f284c88a86557485d7d9537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98009994d9c74eb9b4fc6321e82440de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72382) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 15:26:00 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8f436a6a-8e4b-4ef6-832a-dd6fa174fa55 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] [instance: 48161b45-d21a-4fb1-ae90-4613d849bfa7] Start spawning the instance on the hypervisor. {{(pid=72382) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 15:26:00 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-8f436a6a-8e4b-4ef6-832a-dd6fa174fa55 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] [instance: 48161b45-d21a-4fb1-ae90-4613d849bfa7] Creating instance directory {{(pid=72382) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 15:26:00 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-8f436a6a-8e4b-4ef6-832a-dd6fa174fa55 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] [instance: 48161b45-d21a-4fb1-ae90-4613d849bfa7] Creating image(s)
Aug 09 15:26:00 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-8f436a6a-8e4b-4ef6-832a-dd6fa174fa55 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Acquiring lock "/opt/stack/data/nova/instances/48161b45-d21a-4fb1-ae90-4613d849bfa7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:26:00 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-8f436a6a-8e4b-4ef6-832a-dd6fa174fa55 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Lock "/opt/stack/data/nova/instances/48161b45-d21a-4fb1-ae90-4613d849bfa7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:26:00 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-8f436a6a-8e4b-4ef6-832a-dd6fa174fa55 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Lock "/opt/stack/data/nova/instances/48161b45-d21a-4fb1-ae90-4613d849bfa7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:26:00 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-8f436a6a-8e4b-4ef6-832a-dd6fa174fa55 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:26:00 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-8f436a6a-8e4b-4ef6-832a-dd6fa174fa55 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b --force-share --output=json" returned: 0 in 0.145s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:26:00 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-8f436a6a-8e4b-4ef6-832a-dd6fa174fa55 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Acquiring lock "383812ff437283e0191ed5b9ecc04c27f1162b0b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:26:00 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-8f436a6a-8e4b-4ef6-832a-dd6fa174fa55 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Lock "383812ff437283e0191ed5b9ecc04c27f1162b0b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:26:00 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-8f436a6a-8e4b-4ef6-832a-dd6fa174fa55 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:26:00 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-8f436a6a-8e4b-4ef6-832a-dd6fa174fa55 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b --force-share --output=json" returned: 0 in 0.180s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:26:00 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-8f436a6a-8e4b-4ef6-832a-dd6fa174fa55 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b,backing_fmt=raw /opt/stack/data/nova/instances/48161b45-d21a-4fb1-ae90-4613d849bfa7/disk 1073741824 {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:26:00 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-8f436a6a-8e4b-4ef6-832a-dd6fa174fa55 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b,backing_fmt=raw /opt/stack/data/nova/instances/48161b45-d21a-4fb1-ae90-4613d849bfa7/disk 1073741824" returned: 0 in 0.051s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:26:00 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-8f436a6a-8e4b-4ef6-832a-dd6fa174fa55 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Lock "383812ff437283e0191ed5b9ecc04c27f1162b0b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.238s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:26:00 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-8f436a6a-8e4b-4ef6-832a-dd6fa174fa55 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:26:01 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-8f436a6a-8e4b-4ef6-832a-dd6fa174fa55 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b --force-share --output=json" returned: 0 in 0.143s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:26:01 user nova-compute[72382]: DEBUG nova.virt.disk.api [None req-8f436a6a-8e4b-4ef6-832a-dd6fa174fa55 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Checking if we can resize image /opt/stack/data/nova/instances/48161b45-d21a-4fb1-ae90-4613d849bfa7/disk. size=1073741824 {{(pid=72382) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 15:26:01 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-8f436a6a-8e4b-4ef6-832a-dd6fa174fa55 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48161b45-d21a-4fb1-ae90-4613d849bfa7/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:26:01 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-8f436a6a-8e4b-4ef6-832a-dd6fa174fa55 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48161b45-d21a-4fb1-ae90-4613d849bfa7/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:26:01 user nova-compute[72382]: DEBUG nova.virt.disk.api [None req-8f436a6a-8e4b-4ef6-832a-dd6fa174fa55 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Cannot resize image /opt/stack/data/nova/instances/48161b45-d21a-4fb1-ae90-4613d849bfa7/disk to a smaller size. {{(pid=72382) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 15:26:01 user nova-compute[72382]: DEBUG nova.objects.instance [None req-8f436a6a-8e4b-4ef6-832a-dd6fa174fa55 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Lazy-loading 'migration_context' on Instance uuid 48161b45-d21a-4fb1-ae90-4613d849bfa7 {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:26:01 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-8f436a6a-8e4b-4ef6-832a-dd6fa174fa55 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] [instance: 48161b45-d21a-4fb1-ae90-4613d849bfa7] Created local disks {{(pid=72382) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 15:26:01 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-8f436a6a-8e4b-4ef6-832a-dd6fa174fa55 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] [instance: 48161b45-d21a-4fb1-ae90-4613d849bfa7] Ensure instance console log exists: /opt/stack/data/nova/instances/48161b45-d21a-4fb1-ae90-4613d849bfa7/console.log {{(pid=72382) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 15:26:01 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-8f436a6a-8e4b-4ef6-832a-dd6fa174fa55 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:26:01 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-8f436a6a-8e4b-4ef6-832a-dd6fa174fa55 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:26:01 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-8f436a6a-8e4b-4ef6-832a-dd6fa174fa55 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:26:01 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:26:01 user nova-compute[72382]: DEBUG nova.network.neutron [None req-8f436a6a-8e4b-4ef6-832a-dd6fa174fa55 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] [instance: 48161b45-d21a-4fb1-ae90-4613d849bfa7] Successfully created port: fa20e470-cbff-4903-8515-f7a8b1cdfef6 {{(pid=72382) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 15:26:01 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e6319ece-6c83-47da-9076-5e18a51d07e1 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] [instance: e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0] Calling os-brick to attach iSCSI Volume {{(pid=72382) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 15:26:01 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6319ece-6c83-47da-9076-5e18a51d07e1 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2a0c768340>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:bd90521a-f3b5-485c-9fb9-61ab37267f3a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dBjztUgm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 15:26:01 user nova-compute[72382]: WARNING os_brick.initiator.connectors.base [None req-e6319ece-6c83-47da-9076-5e18a51d07e1 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 15:26:01 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-e6319ece-6c83-47da-9076-5e18a51d07e1 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 15:26:01 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-e6319ece-6c83-47da-9076-5e18a51d07e1 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 15:26:01 user nova-compute[72382]: WARNING os_brick.initiator.connectors.base [None req-e6319ece-6c83-47da-9076-5e18a51d07e1 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 15:26:01 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-e6319ece-6c83-47da-9076-5e18a51d07e1 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bd90521a-f3b5-485c-9fb9-61ab37267f3a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 15:26:01 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-e6319ece-6c83-47da-9076-5e18a51d07e1 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bd90521a-f3b5-485c-9fb9-61ab37267f3a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 15:26:01 user nova-compute[72382]: INFO os_brick.initiator.connectors.iscsi [None req-e6319ece-6c83-47da-9076-5e18a51d07e1 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 15:26:01 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd90521a-f3b5-485c-9fb9-61ab37267f3a -p 172.16.0.220:3260 {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:26:01 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd90521a-f3b5-485c-9fb9-61ab37267f3a -p 172.16.0.220:3260" returned: 21 in 0.027s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:26:01 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[a23364ca-bfe8-41a1-ba66-8499df288ded]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:26:01 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6319ece-6c83-47da-9076-5e18a51d07e1 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 15:26:01 user nova-compute[72382]:  {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:26:01 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd90521a-f3b5-485c-9fb9-61ab37267f3a -p 172.16.0.220:3260 --interface default --op new {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:26:01 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd90521a-f3b5-485c-9fb9-61ab37267f3a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:26:01 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[84328698-c8e3-44f4-b82a-de1df8e34364]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bd90521a-f3b5-485c-9fb9-61ab37267f3a] added\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:26:01 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6319ece-6c83-47da-9076-5e18a51d07e1 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bd90521a-f3b5-485c-9fb9-61ab37267f3a] added
Aug 09 15:26:01 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:26:01 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd90521a-f3b5-485c-9fb9-61ab37267f3a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:26:02 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd90521a-f3b5-485c-9fb9-61ab37267f3a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:26:02 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[59845f6a-ec10-4ffc-a78c-9e0ded4434e4]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:26:02 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6319ece-6c83-47da-9076-5e18a51d07e1 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:26:02 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd90521a-f3b5-485c-9fb9-61ab37267f3a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:26:02 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd90521a-f3b5-485c-9fb9-61ab37267f3a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:26:02 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[b01fa67d-0008-4914-a49d-558d4ddd24aa]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:26:02 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6319ece-6c83-47da-9076-5e18a51d07e1 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:26:02 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd90521a-f3b5-485c-9fb9-61ab37267f3a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dBjztUgm {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:26:02 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd90521a-f3b5-485c-9fb9-61ab37267f3a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dBjztUgm" returned: 0 in 0.024s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:26:02 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c9b8c29-b865-40db-a263-446855edba76]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:26:02 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6319ece-6c83-47da-9076-5e18a51d07e1 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dBjztUgm'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:26:02 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd90521a-f3b5-485c-9fb9-61ab37267f3a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:26:02 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd90521a-f3b5-485c-9fb9-61ab37267f3a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:26:02 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1194aee-c628-480a-a97e-d601b841526d]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:26:02 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6319ece-6c83-47da-9076-5e18a51d07e1 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:26:02 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:26:02 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:26:02 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[84ba7ddd-76bd-4a01-8d34-8e56aeb79ef9]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9572706e-c54c-42c2-9cf0-2690cdf4cca2 (non-flash)\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:26:02 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6319ece-6c83-47da-9076-5e18a51d07e1 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)
Aug 09 15:26:02 user nova-compute[72382]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9572706e-c54c-42c2-9cf0-2690cdf4cca2 (non-flash)
Aug 09 15:26:02 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 15:26:02 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6319ece-6c83-47da-9076-5e18a51d07e1 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)
Aug 09 15:26:02 user nova-compute[72382]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9572706e-c54c-42c2-9cf0-2690cdf4cca2 (non-flash)
Aug 09 15:26:02 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 15:26:02 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd90521a-f3b5-485c-9fb9-61ab37267f3a -p 172.16.0.220:3260 --login {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:26:02 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd90521a-f3b5-485c-9fb9-61ab37267f3a -p 172.16.0.220:3260 --login" returned: 0 in 0.094s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:26:02 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[f243817a-c7e3-41eb-988f-42b636f812e6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bd90521a-f3b5-485c-9fb9-61ab37267f3a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bd90521a-f3b5-485c-9fb9-61ab37267f3a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:26:02 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6319ece-6c83-47da-9076-5e18a51d07e1 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bd90521a-f3b5-485c-9fb9-61ab37267f3a, portal: 172.16.0.220,3260]
Aug 09 15:26:02 user nova-compute[72382]: Login to [iface: default, target: iqn.2010-10.org.openstack:bd90521a-f3b5-485c-9fb9-61ab37267f3a, portal: 172.16.0.220,3260] successful.
Aug 09 15:26:02 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:26:02 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd90521a-f3b5-485c-9fb9-61ab37267f3a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:26:02 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd90521a-f3b5-485c-9fb9-61ab37267f3a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.029s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:26:02 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f79fc00-6748-4169-80e4-da479ab072e0]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:26:02 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6319ece-6c83-47da-9076-5e18a51d07e1 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:26:02 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:26:02 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:26:02 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac04b725-1c94-4189-beb4-95c495c360ea]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9572706e-c54c-42c2-9cf0-2690cdf4cca2 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd90521a-f3b5-485c-9fb9-61ab37267f3a (non-flash)\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:26:02 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6319ece-6c83-47da-9076-5e18a51d07e1 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)
Aug 09 15:26:02 user nova-compute[72382]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9572706e-c54c-42c2-9cf0-2690cdf4cca2 (non-flash)
Aug 09 15:26:02 user nova-compute[72382]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd90521a-f3b5-485c-9fb9-61ab37267f3a (non-flash)
Aug 09 15:26:02 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 15:26:02 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6319ece-6c83-47da-9076-5e18a51d07e1 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)
Aug 09 15:26:02 user nova-compute[72382]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9572706e-c54c-42c2-9cf0-2690cdf4cca2 (non-flash)
Aug 09 15:26:02 user nova-compute[72382]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd90521a-f3b5-485c-9fb9-61ab37267f3a (non-flash)
Aug 09 15:26:02 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 15:26:02 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-e6319ece-6c83-47da-9076-5e18a51d07e1 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bd90521a-f3b5-485c-9fb9-61ab37267f3a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.384s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 15:26:02 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6319ece-6c83-47da-9076-5e18a51d07e1 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Connected to 172.16.0.220:3260 {{(pid=72382) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 15:26:02 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-e6319ece-6c83-47da-9076-5e18a51d07e1 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] HCTL ('34', '-', '-', 0) found on session 29 with lun 0 {{(pid=72382) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 15:26:02 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-e6319ece-6c83-47da-9076-5e18a51d07e1 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72382) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 15:26:02 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:26:02 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.021s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:26:02 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[22f75159-d47f-401d-80cf-e38c9cc6ee63]: (4, ('- - 0', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:26:02 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-e6319ece-6c83-47da-9076-5e18a51d07e1 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Searching for a device in session 29 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72382) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 15:26:02 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6319ece-6c83-47da-9076-5e18a51d07e1 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dBjztUgm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72382) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 15:26:02 user nova-compute[72382]: DEBUG nova.network.neutron [None req-8f436a6a-8e4b-4ef6-832a-dd6fa174fa55 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] [instance: 48161b45-d21a-4fb1-ae90-4613d849bfa7] Successfully updated port: fa20e470-cbff-4903-8515-f7a8b1cdfef6 {{(pid=72382) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 15:26:02 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-8f436a6a-8e4b-4ef6-832a-dd6fa174fa55 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Acquiring lock "refresh_cache-48161b45-d21a-4fb1-ae90-4613d849bfa7" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 15:26:02 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-8f436a6a-8e4b-4ef6-832a-dd6fa174fa55 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Acquired lock "refresh_cache-48161b45-d21a-4fb1-ae90-4613d849bfa7" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 15:26:02 user nova-compute[72382]: DEBUG nova.network.neutron [None req-8f436a6a-8e4b-4ef6-832a-dd6fa174fa55 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] [instance: 48161b45-d21a-4fb1-ae90-4613d849bfa7] Building network info cache for instance {{(pid=72382) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 15:26:02 user nova-compute[72382]: DEBUG nova.network.neutron [None req-8f436a6a-8e4b-4ef6-832a-dd6fa174fa55 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] [instance: 48161b45-d21a-4fb1-ae90-4613d849bfa7] Instance cache missing network info. {{(pid=72382) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 15:26:02 user nova-compute[72382]: DEBUG nova.compute.manager [req-a2c0dd04-0ff6-41d0-b214-3e41fb14a699 req-7b839479-6d6d-4260-ae9a-5d9eff2b076b service nova] [instance: 48161b45-d21a-4fb1-ae90-4613d849bfa7] Received event network-changed-fa20e470-cbff-4903-8515-f7a8b1cdfef6 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:26:02 user nova-compute[72382]: DEBUG nova.compute.manager [req-a2c0dd04-0ff6-41d0-b214-3e41fb14a699 req-7b839479-6d6d-4260-ae9a-5d9eff2b076b service nova] [instance: 48161b45-d21a-4fb1-ae90-4613d849bfa7] Refreshing instance network info cache due to event network-changed-fa20e470-cbff-4903-8515-f7a8b1cdfef6. {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 15:26:02 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-a2c0dd04-0ff6-41d0-b214-3e41fb14a699 req-7b839479-6d6d-4260-ae9a-5d9eff2b076b service nova] Acquiring lock "refresh_cache-48161b45-d21a-4fb1-ae90-4613d849bfa7" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 15:26:03 user nova-compute[72382]: DEBUG nova.network.neutron [None req-8f436a6a-8e4b-4ef6-832a-dd6fa174fa55 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] [instance: 48161b45-d21a-4fb1-ae90-4613d849bfa7] Updating instance_info_cache with network_info: [{"id": "fa20e470-cbff-4903-8515-f7a8b1cdfef6", "address": "fa:16:3e:48:c6:b5", "network": {"id": "46eb5f03-e04d-43d1-96d6-0792bc7a94b1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1842512309-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98009994d9c74eb9b4fc6321e82440de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa20e470-cb", "ovs_interfaceid": "fa20e470-cbff-4903-8515-f7a8b1cdfef6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:26:03 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-8f436a6a-8e4b-4ef6-832a-dd6fa174fa55 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Releasing lock "refresh_cache-48161b45-d21a-4fb1-ae90-4613d849bfa7" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 15:26:03 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8f436a6a-8e4b-4ef6-832a-dd6fa174fa55 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] [instance: 48161b45-d21a-4fb1-ae90-4613d849bfa7] Instance network_info: |[{"id": "fa20e470-cbff-4903-8515-f7a8b1cdfef6", "address": "fa:16:3e:48:c6:b5", "network": {"id": "46eb5f03-e04d-43d1-96d6-0792bc7a94b1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1842512309-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98009994d9c74eb9b4fc6321e82440de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa20e470-cb", "ovs_interfaceid": "fa20e470-cbff-4903-8515-f7a8b1cdfef6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72382) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 15:26:03 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-a2c0dd04-0ff6-41d0-b214-3e41fb14a699 req-7b839479-6d6d-4260-ae9a-5d9eff2b076b service nova] Acquired lock "refresh_cache-48161b45-d21a-4fb1-ae90-4613d849bfa7" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 15:26:03 user nova-compute[72382]: DEBUG nova.network.neutron [req-a2c0dd04-0ff6-41d0-b214-3e41fb14a699 req-7b839479-6d6d-4260-ae9a-5d9eff2b076b service nova] [instance: 48161b45-d21a-4fb1-ae90-4613d849bfa7] Refreshing network info cache for port fa20e470-cbff-4903-8515-f7a8b1cdfef6 {{(pid=72382) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 15:26:03 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-8f436a6a-8e4b-4ef6-832a-dd6fa174fa55 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] [instance: 48161b45-d21a-4fb1-ae90-4613d849bfa7] Start _get_guest_xml network_info=[{"id": "fa20e470-cbff-4903-8515-f7a8b1cdfef6", "address": "fa:16:3e:48:c6:b5", "network": {"id": "46eb5f03-e04d-43d1-96d6-0792bc7a94b1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1842512309-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98009994d9c74eb9b4fc6321e82440de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa20e470-cb", "ovs_interfaceid": "fa20e470-cbff-4903-8515-f7a8b1cdfef6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T15:11:25Z,direct_url=<?>,disk_format='qcow2',id=a79f2cea-eb27-4631-aaf3-05e7d9e411b4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a638990e12cc4d6eabb6d55e13be6bdf',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T15:11:27Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'a79f2cea-eb27-4631-aaf3-05e7d9e411b4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72382) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 15:26:03 user nova-compute[72382]: WARNING nova.virt.libvirt.driver [None req-8f436a6a-8e4b-4ef6-832a-dd6fa174fa55 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 15:26:03 user nova-compute[72382]: WARNING nova.virt.libvirt.driver [None req-8f436a6a-8e4b-4ef6-832a-dd6fa174fa55 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 15:26:03 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-8f436a6a-8e4b-4ef6-832a-dd6fa174fa55 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72382) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 15:26:03 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-8f436a6a-8e4b-4ef6-832a-dd6fa174fa55 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] CPU controller missing on host. {{(pid=72382) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 15:26:03 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-8f436a6a-8e4b-4ef6-832a-dd6fa174fa55 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72382) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 15:26:03 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-8f436a6a-8e4b-4ef6-832a-dd6fa174fa55 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] CPU controller found on host. {{(pid=72382) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 15:26:03 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-8f436a6a-8e4b-4ef6-832a-dd6fa174fa55 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72382) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 15:26:03 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-8f436a6a-8e4b-4ef6-832a-dd6fa174fa55 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T15:11:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T15:11:25Z,direct_url=<?>,disk_format='qcow2',id=a79f2cea-eb27-4631-aaf3-05e7d9e411b4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a638990e12cc4d6eabb6d55e13be6bdf',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T15:11:27Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 15:26:03 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-8f436a6a-8e4b-4ef6-832a-dd6fa174fa55 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Flavor limits 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 15:26:03 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-8f436a6a-8e4b-4ef6-832a-dd6fa174fa55 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Image limits 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 15:26:03 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-8f436a6a-8e4b-4ef6-832a-dd6fa174fa55 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Flavor pref 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 15:26:03 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-8f436a6a-8e4b-4ef6-832a-dd6fa174fa55 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Image pref 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 15:26:03 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-8f436a6a-8e4b-4ef6-832a-dd6fa174fa55 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 15:26:03 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-8f436a6a-8e4b-4ef6-832a-dd6fa174fa55 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 15:26:03 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-8f436a6a-8e4b-4ef6-832a-dd6fa174fa55 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72382) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 15:26:03 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-8f436a6a-8e4b-4ef6-832a-dd6fa174fa55 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Got 1 possible topologies {{(pid=72382) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 15:26:03 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-8f436a6a-8e4b-4ef6-832a-dd6fa174fa55 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 15:26:03 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-8f436a6a-8e4b-4ef6-832a-dd6fa174fa55 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 15:26:03 user nova-compute[72382]: DEBUG nova.virt.libvirt.vif [None req-8f436a6a-8e4b-4ef6-832a-dd6fa174fa55 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T15:25:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-405878590',display_name='tempest-AttachVolumeNegativeTest-server-405878590',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-405878590',id=26,image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKmH7XZTu+BpT7XfaWvSEoIi0u6Y8VQmOeYAPCTpPb+wvVv+q/ESpWzfB8L/gibhNp6zy0dSWolKGjRmeUv9muOySC5Qp2zentXrNIHQvlHwfwVjZPw4I/e/Q5DD62VQNw==',key_name='tempest-keypair-591688920',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='98009994d9c74eb9b4fc6321e82440de',ramdisk_id='',reservation_id='r-qwoou6vv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1325594356',owner_user_name='tempest-AttachVolumeNegativeTest-1325594356-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T15:26:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='401c9df41f284c88a86557485d7d9537',uuid=48161b45-d21a-4fb1-ae90-4613d849bfa7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fa20e470-cbff-4903-8515-f7a8b1cdfef6", "address": "fa:16:3e:48:c6:b5", "network": {"id": "46eb5f03-e04d-43d1-96d6-0792bc7a94b1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1842512309-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98009994d9c74eb9b4fc6321e82440de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa20e470-cb", "ovs_interfaceid": "fa20e470-cbff-4903-8515-f7a8b1cdfef6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72382) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 15:26:03 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-8f436a6a-8e4b-4ef6-832a-dd6fa174fa55 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Converting VIF {"id": "fa20e470-cbff-4903-8515-f7a8b1cdfef6", "address": "fa:16:3e:48:c6:b5", "network": {"id": "46eb5f03-e04d-43d1-96d6-0792bc7a94b1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1842512309-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98009994d9c74eb9b4fc6321e82440de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa20e470-cb", "ovs_interfaceid": "fa20e470-cbff-4903-8515-f7a8b1cdfef6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 15:26:03 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-8f436a6a-8e4b-4ef6-832a-dd6fa174fa55 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:48:c6:b5,bridge_name='br-int',has_traffic_filtering=True,id=fa20e470-cbff-4903-8515-f7a8b1cdfef6,network=Network(46eb5f03-e04d-43d1-96d6-0792bc7a94b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa20e470-cb') {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 15:26:03 user nova-compute[72382]: DEBUG nova.objects.instance [None req-8f436a6a-8e4b-4ef6-832a-dd6fa174fa55 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Lazy-loading 'pci_devices' on Instance uuid 48161b45-d21a-4fb1-ae90-4613d849bfa7 {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:26:03 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-8f436a6a-8e4b-4ef6-832a-dd6fa174fa55 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] [instance: 48161b45-d21a-4fb1-ae90-4613d849bfa7] End _get_guest_xml xml=<domain type="kvm">
Aug 09 15:26:03 user nova-compute[72382]:   <uuid>48161b45-d21a-4fb1-ae90-4613d849bfa7</uuid>
Aug 09 15:26:03 user nova-compute[72382]:   <name>instance-0000001a</name>
Aug 09 15:26:03 user nova-compute[72382]:   <memory>524288</memory>
Aug 09 15:26:03 user nova-compute[72382]:   <vcpu>1</vcpu>
Aug 09 15:26:03 user nova-compute[72382]:   <metadata>
Aug 09 15:26:03 user nova-compute[72382]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 15:26:03 user nova-compute[72382]:       <nova:package version="0.0.0"/>
Aug 09 15:26:03 user nova-compute[72382]:       <nova:name>tempest-AttachVolumeNegativeTest-server-405878590</nova:name>
Aug 09 15:26:03 user nova-compute[72382]:       <nova:creationTime>2023-08-09 15:26:03</nova:creationTime>
Aug 09 15:26:03 user nova-compute[72382]:       <nova:flavor name="m1.tiny">
Aug 09 15:26:03 user nova-compute[72382]:         <nova:memory>512</nova:memory>
Aug 09 15:26:03 user nova-compute[72382]:         <nova:disk>1</nova:disk>
Aug 09 15:26:03 user nova-compute[72382]:         <nova:swap>0</nova:swap>
Aug 09 15:26:03 user nova-compute[72382]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 15:26:03 user nova-compute[72382]:         <nova:vcpus>1</nova:vcpus>
Aug 09 15:26:03 user nova-compute[72382]:       </nova:flavor>
Aug 09 15:26:03 user nova-compute[72382]:       <nova:owner>
Aug 09 15:26:03 user nova-compute[72382]:         <nova:user uuid="401c9df41f284c88a86557485d7d9537">tempest-AttachVolumeNegativeTest-1325594356-project-member</nova:user>
Aug 09 15:26:03 user nova-compute[72382]:         <nova:project uuid="98009994d9c74eb9b4fc6321e82440de">tempest-AttachVolumeNegativeTest-1325594356</nova:project>
Aug 09 15:26:03 user nova-compute[72382]:       </nova:owner>
Aug 09 15:26:03 user nova-compute[72382]:       <nova:root type="image" uuid="a79f2cea-eb27-4631-aaf3-05e7d9e411b4"/>
Aug 09 15:26:03 user nova-compute[72382]:       <nova:ports>
Aug 09 15:26:03 user nova-compute[72382]:         <nova:port uuid="fa20e470-cbff-4903-8515-f7a8b1cdfef6">
Aug 09 15:26:03 user nova-compute[72382]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 09 15:26:03 user nova-compute[72382]:         </nova:port>
Aug 09 15:26:03 user nova-compute[72382]:       </nova:ports>
Aug 09 15:26:03 user nova-compute[72382]:     </nova:instance>
Aug 09 15:26:03 user nova-compute[72382]:   </metadata>
Aug 09 15:26:03 user nova-compute[72382]:   <sysinfo type="smbios">
Aug 09 15:26:03 user nova-compute[72382]:     <system>
Aug 09 15:26:03 user nova-compute[72382]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 15:26:03 user nova-compute[72382]:       <entry name="product">OpenStack Nova</entry>
Aug 09 15:26:03 user nova-compute[72382]:       <entry name="version">0.0.0</entry>
Aug 09 15:26:03 user nova-compute[72382]:       <entry name="serial">48161b45-d21a-4fb1-ae90-4613d849bfa7</entry>
Aug 09 15:26:03 user nova-compute[72382]:       <entry name="uuid">48161b45-d21a-4fb1-ae90-4613d849bfa7</entry>
Aug 09 15:26:03 user nova-compute[72382]:       <entry name="family">Virtual Machine</entry>
Aug 09 15:26:03 user nova-compute[72382]:     </system>
Aug 09 15:26:03 user nova-compute[72382]:   </sysinfo>
Aug 09 15:26:03 user nova-compute[72382]:   <os>
Aug 09 15:26:03 user nova-compute[72382]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 15:26:03 user nova-compute[72382]:     <boot dev="hd"/>
Aug 09 15:26:03 user nova-compute[72382]:     <smbios mode="sysinfo"/>
Aug 09 15:26:03 user nova-compute[72382]:   </os>
Aug 09 15:26:03 user nova-compute[72382]:   <features>
Aug 09 15:26:03 user nova-compute[72382]:     <acpi/>
Aug 09 15:26:03 user nova-compute[72382]:     <apic/>
Aug 09 15:26:03 user nova-compute[72382]:     <vmcoreinfo/>
Aug 09 15:26:03 user nova-compute[72382]:   </features>
Aug 09 15:26:03 user nova-compute[72382]:   <clock offset="utc">
Aug 09 15:26:03 user nova-compute[72382]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 15:26:03 user nova-compute[72382]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 15:26:03 user nova-compute[72382]:     <timer name="hpet" present="no"/>
Aug 09 15:26:03 user nova-compute[72382]:   </clock>
Aug 09 15:26:03 user nova-compute[72382]:   <cpu mode="custom" match="exact">
Aug 09 15:26:03 user nova-compute[72382]:     <model>Nehalem</model>
Aug 09 15:26:03 user nova-compute[72382]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 15:26:03 user nova-compute[72382]:   </cpu>
Aug 09 15:26:03 user nova-compute[72382]:   <devices>
Aug 09 15:26:03 user nova-compute[72382]:     <disk type="file" device="disk">
Aug 09 15:26:03 user nova-compute[72382]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 15:26:03 user nova-compute[72382]:       <source file="/opt/stack/data/nova/instances/48161b45-d21a-4fb1-ae90-4613d849bfa7/disk"/>
Aug 09 15:26:03 user nova-compute[72382]:       <target dev="vda" bus="virtio"/>
Aug 09 15:26:03 user nova-compute[72382]:     </disk>
Aug 09 15:26:03 user nova-compute[72382]:     <interface type="ethernet">
Aug 09 15:26:03 user nova-compute[72382]:       <mac address="fa:16:3e:48:c6:b5"/>
Aug 09 15:26:03 user nova-compute[72382]:       <model type="virtio"/>
Aug 09 15:26:03 user nova-compute[72382]:       <mtu size="1442"/>
Aug 09 15:26:03 user nova-compute[72382]:       <target dev="tapfa20e470-cb"/>
Aug 09 15:26:03 user nova-compute[72382]:     </interface>
Aug 09 15:26:03 user nova-compute[72382]:     <serial type="pty">
Aug 09 15:26:03 user nova-compute[72382]:       <log file="/opt/stack/data/nova/instances/48161b45-d21a-4fb1-ae90-4613d849bfa7/console.log" append="off"/>
Aug 09 15:26:03 user nova-compute[72382]:     </serial>
Aug 09 15:26:03 user nova-compute[72382]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 15:26:03 user nova-compute[72382]:     <video>
Aug 09 15:26:03 user nova-compute[72382]:       <model type="virtio"/>
Aug 09 15:26:03 user nova-compute[72382]:     </video>
Aug 09 15:26:03 user nova-compute[72382]:     <rng model="virtio">
Aug 09 15:26:03 user nova-compute[72382]:       <backend model="random">/dev/urandom</backend>
Aug 09 15:26:03 user nova-compute[72382]:     </rng>
Aug 09 15:26:03 user nova-compute[72382]:     <controller type="usb" index="0" model="none"/>
Aug 09 15:26:03 user nova-compute[72382]:     <memballoon model="virtio">
Aug 09 15:26:03 user nova-compute[72382]:       <stats period="10"/>
Aug 09 15:26:03 user nova-compute[72382]:     </memballoon>
Aug 09 15:26:03 user nova-compute[72382]:   </devices>
Aug 09 15:26:03 user nova-compute[72382]: </domain>
Aug 09 15:26:03 user nova-compute[72382]:  {{(pid=72382) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 15:26:03 user nova-compute[72382]: DEBUG nova.virt.libvirt.vif [None req-8f436a6a-8e4b-4ef6-832a-dd6fa174fa55 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T15:25:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-405878590',display_name='tempest-AttachVolumeNegativeTest-server-405878590',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-405878590',id=26,image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKmH7XZTu+BpT7XfaWvSEoIi0u6Y8VQmOeYAPCTpPb+wvVv+q/ESpWzfB8L/gibhNp6zy0dSWolKGjRmeUv9muOySC5Qp2zentXrNIHQvlHwfwVjZPw4I/e/Q5DD62VQNw==',key_name='tempest-keypair-591688920',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='98009994d9c74eb9b4fc6321e82440de',ramdisk_id='',reservation_id='r-qwoou6vv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1325594356',owner_user_name='tempest-AttachVolumeNegativeTest-1325594356-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T15:26:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='401c9df41f284c88a86557485d7d9537',uuid=48161b45-d21a-4fb1-ae90-4613d849bfa7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fa20e470-cbff-4903-8515-f7a8b1cdfef6", "address": "fa:16:3e:48:c6:b5", "network": {"id": "46eb5f03-e04d-43d1-96d6-0792bc7a94b1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1842512309-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98009994d9c74eb9b4fc6321e82440de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa20e470-cb", "ovs_interfaceid": "fa20e470-cbff-4903-8515-f7a8b1cdfef6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 15:26:03 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-8f436a6a-8e4b-4ef6-832a-dd6fa174fa55 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Converting VIF {"id": "fa20e470-cbff-4903-8515-f7a8b1cdfef6", "address": "fa:16:3e:48:c6:b5", "network": {"id": "46eb5f03-e04d-43d1-96d6-0792bc7a94b1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1842512309-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98009994d9c74eb9b4fc6321e82440de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa20e470-cb", "ovs_interfaceid": "fa20e470-cbff-4903-8515-f7a8b1cdfef6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 15:26:03 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-8f436a6a-8e4b-4ef6-832a-dd6fa174fa55 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:48:c6:b5,bridge_name='br-int',has_traffic_filtering=True,id=fa20e470-cbff-4903-8515-f7a8b1cdfef6,network=Network(46eb5f03-e04d-43d1-96d6-0792bc7a94b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa20e470-cb') {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 15:26:03 user nova-compute[72382]: DEBUG os_vif [None req-8f436a6a-8e4b-4ef6-832a-dd6fa174fa55 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:48:c6:b5,bridge_name='br-int',has_traffic_filtering=True,id=fa20e470-cbff-4903-8515-f7a8b1cdfef6,network=Network(46eb5f03-e04d-43d1-96d6-0792bc7a94b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa20e470-cb') {{(pid=72382) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 15:26:03 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:26:03 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:26:03 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 15:26:03 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:26:03 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfa20e470-cb, may_exist=True, interface_attrs={}) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:26:03 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapfa20e470-cb, col_values=(('external_ids', {'iface-id': 'fa20e470-cbff-4903-8515-f7a8b1cdfef6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:48:c6:b5', 'vm-uuid': '48161b45-d21a-4fb1-ae90-4613d849bfa7'}),), if_exists=True) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:26:03 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:26:03 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:26:03 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:26:03 user nova-compute[72382]: INFO os_vif [None req-8f436a6a-8e4b-4ef6-832a-dd6fa174fa55 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:48:c6:b5,bridge_name='br-int',has_traffic_filtering=True,id=fa20e470-cbff-4903-8515-f7a8b1cdfef6,network=Network(46eb5f03-e04d-43d1-96d6-0792bc7a94b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa20e470-cb')
Aug 09 15:26:03 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-8f436a6a-8e4b-4ef6-832a-dd6fa174fa55 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] No BDM found with device name vda, not building metadata. {{(pid=72382) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 15:26:03 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-8f436a6a-8e4b-4ef6-832a-dd6fa174fa55 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] No VIF found with MAC fa:16:3e:48:c6:b5, not building metadata {{(pid=72382) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 15:26:03 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-e6319ece-6c83-47da-9076-5e18a51d07e1 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.435s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 15:26:03 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6319ece-6c83-47da-9076-5e18a51d07e1 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] <== connect_volume: return (1438ms) {'type': 'block', 'scsi_wwn': '23764613432653732', 'path': '/dev/sdc'} {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 15:26:03 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e6319ece-6c83-47da-9076-5e18a51d07e1 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] [instance: e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23764613432653732', 'path': '/dev/sdc'} {{(pid=72382) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 15:26:03 user nova-compute[72382]: DEBUG nova.objects.instance [None req-e6319ece-6c83-47da-9076-5e18a51d07e1 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Lazy-loading 'flavor' on Instance uuid e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0 {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:26:03 user nova-compute[72382]: DEBUG nova.virt.libvirt.guest [None req-e6319ece-6c83-47da-9076-5e18a51d07e1 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 15:26:03 user nova-compute[72382]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 15:26:03 user nova-compute[72382]:   <source dev="/dev/sdc"/>
Aug 09 15:26:03 user nova-compute[72382]:   <target dev="vdb" bus="virtio"/>
Aug 09 15:26:03 user nova-compute[72382]:   <serial>bd90521a-f3b5-485c-9fb9-61ab37267f3a</serial>
Aug 09 15:26:03 user nova-compute[72382]: </disk>
Aug 09 15:26:03 user nova-compute[72382]:  {{(pid=72382) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 15:26:03 user nova-compute[72382]: DEBUG nova.network.neutron [req-a2c0dd04-0ff6-41d0-b214-3e41fb14a699 req-7b839479-6d6d-4260-ae9a-5d9eff2b076b service nova] [instance: 48161b45-d21a-4fb1-ae90-4613d849bfa7] Updated VIF entry in instance network info cache for port fa20e470-cbff-4903-8515-f7a8b1cdfef6. {{(pid=72382) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 15:26:03 user nova-compute[72382]: DEBUG nova.network.neutron [req-a2c0dd04-0ff6-41d0-b214-3e41fb14a699 req-7b839479-6d6d-4260-ae9a-5d9eff2b076b service nova] [instance: 48161b45-d21a-4fb1-ae90-4613d849bfa7] Updating instance_info_cache with network_info: [{"id": "fa20e470-cbff-4903-8515-f7a8b1cdfef6", "address": "fa:16:3e:48:c6:b5", "network": {"id": "46eb5f03-e04d-43d1-96d6-0792bc7a94b1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1842512309-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98009994d9c74eb9b4fc6321e82440de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa20e470-cb", "ovs_interfaceid": "fa20e470-cbff-4903-8515-f7a8b1cdfef6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:26:03 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-a2c0dd04-0ff6-41d0-b214-3e41fb14a699 req-7b839479-6d6d-4260-ae9a-5d9eff2b076b service nova] Releasing lock "refresh_cache-48161b45-d21a-4fb1-ae90-4613d849bfa7" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 15:26:04 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-e6319ece-6c83-47da-9076-5e18a51d07e1 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] No BDM found with device name vda, not building metadata. {{(pid=72382) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 15:26:04 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-e6319ece-6c83-47da-9076-5e18a51d07e1 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72382) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 15:26:04 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-e6319ece-6c83-47da-9076-5e18a51d07e1 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] No VIF found with MAC fa:16:3e:6f:6b:41, not building metadata {{(pid=72382) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 15:26:04 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e6319ece-6c83-47da-9076-5e18a51d07e1 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Lock "e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 19.964s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:26:04 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:26:05 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:26:05 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:26:05 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:26:05 user nova-compute[72382]: INFO nova.compute.manager [None req-7390a1b8-fcda-46ea-a5e3-46b55e4ff56b tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] [instance: e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0] Rescuing
Aug 09 15:26:05 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-7390a1b8-fcda-46ea-a5e3-46b55e4ff56b tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Acquiring lock "refresh_cache-e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 15:26:05 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-7390a1b8-fcda-46ea-a5e3-46b55e4ff56b tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Acquired lock "refresh_cache-e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 15:26:05 user nova-compute[72382]: DEBUG nova.network.neutron [None req-7390a1b8-fcda-46ea-a5e3-46b55e4ff56b tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] [instance: e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0] Building network info cache for instance {{(pid=72382) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 15:26:06 user nova-compute[72382]: DEBUG nova.compute.manager [req-744eb20b-ca71-46f2-8bc2-7cef044b6e8c req-f4b503cd-45ee-4a61-9c95-c80964d9b60c service nova] [instance: 48161b45-d21a-4fb1-ae90-4613d849bfa7] Received event network-vif-plugged-fa20e470-cbff-4903-8515-f7a8b1cdfef6 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:26:06 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-744eb20b-ca71-46f2-8bc2-7cef044b6e8c req-f4b503cd-45ee-4a61-9c95-c80964d9b60c service nova] Acquiring lock "48161b45-d21a-4fb1-ae90-4613d849bfa7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:26:06 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-744eb20b-ca71-46f2-8bc2-7cef044b6e8c req-f4b503cd-45ee-4a61-9c95-c80964d9b60c service nova] Lock "48161b45-d21a-4fb1-ae90-4613d849bfa7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:26:06 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-744eb20b-ca71-46f2-8bc2-7cef044b6e8c req-f4b503cd-45ee-4a61-9c95-c80964d9b60c service nova] Lock "48161b45-d21a-4fb1-ae90-4613d849bfa7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:26:06 user nova-compute[72382]: DEBUG nova.compute.manager [req-744eb20b-ca71-46f2-8bc2-7cef044b6e8c req-f4b503cd-45ee-4a61-9c95-c80964d9b60c service nova] [instance: 48161b45-d21a-4fb1-ae90-4613d849bfa7] No waiting events found dispatching network-vif-plugged-fa20e470-cbff-4903-8515-f7a8b1cdfef6 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:26:06 user nova-compute[72382]: WARNING nova.compute.manager [req-744eb20b-ca71-46f2-8bc2-7cef044b6e8c req-f4b503cd-45ee-4a61-9c95-c80964d9b60c service nova] [instance: 48161b45-d21a-4fb1-ae90-4613d849bfa7] Received unexpected event network-vif-plugged-fa20e470-cbff-4903-8515-f7a8b1cdfef6 for instance with vm_state building and task_state spawning.
Aug 09 15:26:06 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:26:06 user nova-compute[72382]: DEBUG nova.compute.manager [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Cleaning up deleted instances {{(pid=72382) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 09 15:26:06 user nova-compute[72382]: DEBUG nova.compute.manager [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] There are 0 instances to clean {{(pid=72382) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 09 15:26:06 user nova-compute[72382]: DEBUG nova.network.neutron [None req-7390a1b8-fcda-46ea-a5e3-46b55e4ff56b tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] [instance: e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0] Updating instance_info_cache with network_info: [{"id": "9513dc1d-79d5-482b-baaa-81f525e99de7", "address": "fa:16:3e:6f:6b:41", "network": {"id": "46ef00c7-17ee-4e45-ba1d-dcc0a417ea85", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1360012261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.24", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "990ba791030940d38360af5879c853c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9513dc1d-79", "ovs_interfaceid": "9513dc1d-79d5-482b-baaa-81f525e99de7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:26:06 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-7390a1b8-fcda-46ea-a5e3-46b55e4ff56b tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Releasing lock "refresh_cache-e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 15:26:07 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:26:07 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:26:07 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-ab872c41-983a-4a50-9741-98257a442e1d tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] Acquiring lock "6296ba5d-bcc6-405a-a635-0e9aa6114f7b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:26:07 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-ab872c41-983a-4a50-9741-98257a442e1d tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] Lock "6296ba5d-bcc6-405a-a635-0e9aa6114f7b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:26:07 user nova-compute[72382]: DEBUG nova.objects.instance [None req-ab872c41-983a-4a50-9741-98257a442e1d tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] Lazy-loading 'flavor' on Instance uuid 6296ba5d-bcc6-405a-a635-0e9aa6114f7b {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:26:07 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-ab872c41-983a-4a50-9741-98257a442e1d tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] Lock "6296ba5d-bcc6-405a-a635-0e9aa6114f7b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:26:07 user nova-compute[72382]: DEBUG nova.virt.driver [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Emitting event <LifecycleEvent: 1691594767.389532, 48161b45-d21a-4fb1-ae90-4613d849bfa7 => Resumed> {{(pid=72382) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 15:26:07 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 48161b45-d21a-4fb1-ae90-4613d849bfa7] VM Resumed (Lifecycle Event)
Aug 09 15:26:07 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8f436a6a-8e4b-4ef6-832a-dd6fa174fa55 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] [instance: 48161b45-d21a-4fb1-ae90-4613d849bfa7] Instance event wait completed in 0 seconds for  {{(pid=72382) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 15:26:07 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-8f436a6a-8e4b-4ef6-832a-dd6fa174fa55 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] [instance: 48161b45-d21a-4fb1-ae90-4613d849bfa7] Guest created on hypervisor {{(pid=72382) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 15:26:07 user nova-compute[72382]: INFO nova.virt.libvirt.driver [-] [instance: 48161b45-d21a-4fb1-ae90-4613d849bfa7] Instance spawned successfully.
Aug 09 15:26:07 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-8f436a6a-8e4b-4ef6-832a-dd6fa174fa55 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] [instance: 48161b45-d21a-4fb1-ae90-4613d849bfa7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 15:26:07 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:26:07 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 48161b45-d21a-4fb1-ae90-4613d849bfa7] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:26:07 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:26:07 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-ab872c41-983a-4a50-9741-98257a442e1d tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] Acquiring lock "6296ba5d-bcc6-405a-a635-0e9aa6114f7b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:26:07 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-ab872c41-983a-4a50-9741-98257a442e1d tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] Lock "6296ba5d-bcc6-405a-a635-0e9aa6114f7b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:26:07 user nova-compute[72382]: INFO nova.compute.manager [None req-ab872c41-983a-4a50-9741-98257a442e1d tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] [instance: 6296ba5d-bcc6-405a-a635-0e9aa6114f7b] Attaching volume 558df9d1-1695-4adc-9bac-22d967b14ce6 to /dev/vdb
Aug 09 15:26:07 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-8f436a6a-8e4b-4ef6-832a-dd6fa174fa55 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] [instance: 48161b45-d21a-4fb1-ae90-4613d849bfa7] Found default for hw_cdrom_bus of ide {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:26:07 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-8f436a6a-8e4b-4ef6-832a-dd6fa174fa55 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] [instance: 48161b45-d21a-4fb1-ae90-4613d849bfa7] Found default for hw_disk_bus of virtio {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:26:07 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-8f436a6a-8e4b-4ef6-832a-dd6fa174fa55 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] [instance: 48161b45-d21a-4fb1-ae90-4613d849bfa7] Found default for hw_input_bus of None {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:26:07 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-8f436a6a-8e4b-4ef6-832a-dd6fa174fa55 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] [instance: 48161b45-d21a-4fb1-ae90-4613d849bfa7] Found default for hw_pointer_model of None {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:26:07 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-8f436a6a-8e4b-4ef6-832a-dd6fa174fa55 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] [instance: 48161b45-d21a-4fb1-ae90-4613d849bfa7] Found default for hw_video_model of virtio {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:26:07 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-8f436a6a-8e4b-4ef6-832a-dd6fa174fa55 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] [instance: 48161b45-d21a-4fb1-ae90-4613d849bfa7] Found default for hw_vif_model of virtio {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:26:07 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 48161b45-d21a-4fb1-ae90-4613d849bfa7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72382) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 15:26:07 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 48161b45-d21a-4fb1-ae90-4613d849bfa7] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 15:26:07 user nova-compute[72382]: DEBUG nova.virt.driver [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Emitting event <LifecycleEvent: 1691594767.39514, 48161b45-d21a-4fb1-ae90-4613d849bfa7 => Started> {{(pid=72382) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 15:26:07 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 48161b45-d21a-4fb1-ae90-4613d849bfa7] VM Started (Lifecycle Event)
Aug 09 15:26:07 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 48161b45-d21a-4fb1-ae90-4613d849bfa7] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:26:07 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 48161b45-d21a-4fb1-ae90-4613d849bfa7] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72382) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 15:26:07 user nova-compute[72382]: INFO nova.compute.manager [None req-8f436a6a-8e4b-4ef6-832a-dd6fa174fa55 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] [instance: 48161b45-d21a-4fb1-ae90-4613d849bfa7] Took 7.11 seconds to spawn the instance on the hypervisor.
Aug 09 15:26:07 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8f436a6a-8e4b-4ef6-832a-dd6fa174fa55 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] [instance: 48161b45-d21a-4fb1-ae90-4613d849bfa7] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:26:07 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 48161b45-d21a-4fb1-ae90-4613d849bfa7] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 15:26:07 user nova-compute[72382]: DEBUG os_brick.utils [None req-ab872c41-983a-4a50-9741-98257a442e1d tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 15:26:07 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:26:07 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:26:07 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[011177b9-f2af-4490-96b3-44608a8993e5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d2cfa7015fe\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:26:07 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:26:07 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.022s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:26:07 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[0157c661-c608-4541-b581-203ebe70a782]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:26:07 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:26:07 user nova-compute[72382]: INFO nova.compute.manager [None req-8f436a6a-8e4b-4ef6-832a-dd6fa174fa55 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] [instance: 48161b45-d21a-4fb1-ae90-4613d849bfa7] Took 8.07 seconds to build instance.
Aug 09 15:26:07 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.024s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:26:07 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cddee34-3736-42d7-8d9e-73b482687f8d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:26:07 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b59622d-b1e8-44bb-9782-38534dbd8f78]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:26:07 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-ab872c41-983a-4a50-9741-98257a442e1d tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] Running cmd (subprocess): nvme version {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:26:07 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-ab872c41-983a-4a50-9741-98257a442e1d tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] 'nvme version' failed. Not Retrying. {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 15:26:07 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ab872c41-983a-4a50-9741-98257a442e1d tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] nvme not present on system {{(pid=72382) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 15:26:07 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-8f436a6a-8e4b-4ef6-832a-dd6fa174fa55 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Lock "48161b45-d21a-4fb1-ae90-4613d849bfa7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.213s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:26:07 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:26:07 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 15:26:07 user nova-compute[72382]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 15:26:07 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d615e32-33c8-45e0-bc64-d2a9e75f6c2f]: (4, '') {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:26:07 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.lightos [None req-ab872c41-983a-4a50-9741-98257a442e1d tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72382) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 15:26:07 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.lightos [None req-ab872c41-983a-4a50-9741-98257a442e1d tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72382) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 15:26:07 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.lightos [None req-ab872c41-983a-4a50-9741-98257a442e1d tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] LIGHTOS: no hostnqn found. {{(pid=72382) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 15:26:07 user nova-compute[72382]: DEBUG os_brick.utils [None req-ab872c41-983a-4a50-9741-98257a442e1d tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] <== get_connector_properties: return (140ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d2cfa7015fe', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 15:26:07 user nova-compute[72382]: DEBUG nova.virt.block_device [None req-ab872c41-983a-4a50-9741-98257a442e1d tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] [instance: 6296ba5d-bcc6-405a-a635-0e9aa6114f7b] Updating existing volume attachment record: 4b24c487-b026-4889-a56e-943e4712492f {{(pid=72382) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 15:26:07 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:26:07 user nova-compute[72382]: INFO nova.virt.libvirt.driver [-] [instance: e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0] Instance destroyed successfully.
Aug 09 15:26:07 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-7390a1b8-fcda-46ea-a5e3-46b55e4ff56b tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] [instance: e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0] Attempting rescue
Aug 09 15:26:07 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-7390a1b8-fcda-46ea-a5e3-46b55e4ff56b tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=72382) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 09 15:26:07 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-7390a1b8-fcda-46ea-a5e3-46b55e4ff56b tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] [instance: e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0] Instance directory exists: not creating {{(pid=72382) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 09 15:26:07 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-7390a1b8-fcda-46ea-a5e3-46b55e4ff56b tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] [instance: e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0] Creating image(s)
Aug 09 15:26:07 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-7390a1b8-fcda-46ea-a5e3-46b55e4ff56b tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Acquiring lock "/opt/stack/data/nova/instances/e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:26:07 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-7390a1b8-fcda-46ea-a5e3-46b55e4ff56b tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Lock "/opt/stack/data/nova/instances/e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:26:08 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-7390a1b8-fcda-46ea-a5e3-46b55e4ff56b tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Lock "/opt/stack/data/nova/instances/e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:26:08 user nova-compute[72382]: DEBUG nova.objects.instance [None req-7390a1b8-fcda-46ea-a5e3-46b55e4ff56b tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Lazy-loading 'trusted_certs' on Instance uuid e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0 {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:26:08 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-7390a1b8-fcda-46ea-a5e3-46b55e4ff56b tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Acquiring lock "383812ff437283e0191ed5b9ecc04c27f1162b0b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:26:08 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-7390a1b8-fcda-46ea-a5e3-46b55e4ff56b tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Lock "383812ff437283e0191ed5b9ecc04c27f1162b0b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:26:08 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-7390a1b8-fcda-46ea-a5e3-46b55e4ff56b tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:26:08 user nova-compute[72382]: DEBUG nova.compute.manager [req-9fafffde-2a70-417f-bb99-2f036b1ae002 req-acee3294-0f8e-49ed-a09b-edc92a33b078 service nova] [instance: 48161b45-d21a-4fb1-ae90-4613d849bfa7] Received event network-vif-plugged-fa20e470-cbff-4903-8515-f7a8b1cdfef6 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:26:08 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-9fafffde-2a70-417f-bb99-2f036b1ae002 req-acee3294-0f8e-49ed-a09b-edc92a33b078 service nova] Acquiring lock "48161b45-d21a-4fb1-ae90-4613d849bfa7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:26:08 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-9fafffde-2a70-417f-bb99-2f036b1ae002 req-acee3294-0f8e-49ed-a09b-edc92a33b078 service nova] Lock "48161b45-d21a-4fb1-ae90-4613d849bfa7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:26:08 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-9fafffde-2a70-417f-bb99-2f036b1ae002 req-acee3294-0f8e-49ed-a09b-edc92a33b078 service nova] Lock "48161b45-d21a-4fb1-ae90-4613d849bfa7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:26:08 user nova-compute[72382]: DEBUG nova.compute.manager [req-9fafffde-2a70-417f-bb99-2f036b1ae002 req-acee3294-0f8e-49ed-a09b-edc92a33b078 service nova] [instance: 48161b45-d21a-4fb1-ae90-4613d849bfa7] No waiting events found dispatching network-vif-plugged-fa20e470-cbff-4903-8515-f7a8b1cdfef6 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:26:08 user nova-compute[72382]: WARNING nova.compute.manager [req-9fafffde-2a70-417f-bb99-2f036b1ae002 req-acee3294-0f8e-49ed-a09b-edc92a33b078 service nova] [instance: 48161b45-d21a-4fb1-ae90-4613d849bfa7] Received unexpected event network-vif-plugged-fa20e470-cbff-4903-8515-f7a8b1cdfef6 for instance with vm_state active and task_state None.
Aug 09 15:26:08 user nova-compute[72382]: DEBUG nova.compute.manager [req-9fafffde-2a70-417f-bb99-2f036b1ae002 req-acee3294-0f8e-49ed-a09b-edc92a33b078 service nova] [instance: e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0] Received event network-vif-unplugged-9513dc1d-79d5-482b-baaa-81f525e99de7 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:26:08 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-9fafffde-2a70-417f-bb99-2f036b1ae002 req-acee3294-0f8e-49ed-a09b-edc92a33b078 service nova] Acquiring lock "e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:26:08 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-9fafffde-2a70-417f-bb99-2f036b1ae002 req-acee3294-0f8e-49ed-a09b-edc92a33b078 service nova] Lock "e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:26:08 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-9fafffde-2a70-417f-bb99-2f036b1ae002 req-acee3294-0f8e-49ed-a09b-edc92a33b078 service nova] Lock "e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:26:08 user nova-compute[72382]: DEBUG nova.compute.manager [req-9fafffde-2a70-417f-bb99-2f036b1ae002 req-acee3294-0f8e-49ed-a09b-edc92a33b078 service nova] [instance: e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0] No waiting events found dispatching network-vif-unplugged-9513dc1d-79d5-482b-baaa-81f525e99de7 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:26:08 user nova-compute[72382]: WARNING nova.compute.manager [req-9fafffde-2a70-417f-bb99-2f036b1ae002 req-acee3294-0f8e-49ed-a09b-edc92a33b078 service nova] [instance: e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0] Received unexpected event network-vif-unplugged-9513dc1d-79d5-482b-baaa-81f525e99de7 for instance with vm_state active and task_state rescuing.
Aug 09 15:26:08 user nova-compute[72382]: DEBUG nova.compute.manager [req-9fafffde-2a70-417f-bb99-2f036b1ae002 req-acee3294-0f8e-49ed-a09b-edc92a33b078 service nova] [instance: e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0] Received event network-vif-plugged-9513dc1d-79d5-482b-baaa-81f525e99de7 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:26:08 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-9fafffde-2a70-417f-bb99-2f036b1ae002 req-acee3294-0f8e-49ed-a09b-edc92a33b078 service nova] Acquiring lock "e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:26:08 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-9fafffde-2a70-417f-bb99-2f036b1ae002 req-acee3294-0f8e-49ed-a09b-edc92a33b078 service nova] Lock "e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:26:08 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-9fafffde-2a70-417f-bb99-2f036b1ae002 req-acee3294-0f8e-49ed-a09b-edc92a33b078 service nova] Lock "e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:26:08 user nova-compute[72382]: DEBUG nova.compute.manager [req-9fafffde-2a70-417f-bb99-2f036b1ae002 req-acee3294-0f8e-49ed-a09b-edc92a33b078 service nova] [instance: e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0] No waiting events found dispatching network-vif-plugged-9513dc1d-79d5-482b-baaa-81f525e99de7 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:26:08 user nova-compute[72382]: WARNING nova.compute.manager [req-9fafffde-2a70-417f-bb99-2f036b1ae002 req-acee3294-0f8e-49ed-a09b-edc92a33b078 service nova] [instance: e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0] Received unexpected event network-vif-plugged-9513dc1d-79d5-482b-baaa-81f525e99de7 for instance with vm_state active and task_state rescuing.
Aug 09 15:26:08 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-7390a1b8-fcda-46ea-a5e3-46b55e4ff56b tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b --force-share --output=json" returned: 0 in 0.149s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:26:08 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-7390a1b8-fcda-46ea-a5e3-46b55e4ff56b tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b,backing_fmt=raw /opt/stack/data/nova/instances/e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0/disk.rescue {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:26:08 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:26:08 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-7390a1b8-fcda-46ea-a5e3-46b55e4ff56b tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b,backing_fmt=raw /opt/stack/data/nova/instances/e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0/disk.rescue" returned: 0 in 0.059s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:26:08 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-7390a1b8-fcda-46ea-a5e3-46b55e4ff56b tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Lock "383812ff437283e0191ed5b9ecc04c27f1162b0b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.213s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:26:08 user nova-compute[72382]: DEBUG nova.objects.instance [None req-7390a1b8-fcda-46ea-a5e3-46b55e4ff56b tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Lazy-loading 'migration_context' on Instance uuid e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0 {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:26:08 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-7390a1b8-fcda-46ea-a5e3-46b55e4ff56b tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] [instance: e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0] Created local disks {{(pid=72382) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 15:26:08 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-7390a1b8-fcda-46ea-a5e3-46b55e4ff56b tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] [instance: e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0] Start _get_guest_xml network_info=[{"id": "9513dc1d-79d5-482b-baaa-81f525e99de7", "address": "fa:16:3e:6f:6b:41", "network": {"id": "46ef00c7-17ee-4e45-ba1d-dcc0a417ea85", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1360012261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.24", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1360012261-network", "vif_mac": "fa:16:3e:6f:6b:41"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "990ba791030940d38360af5879c853c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9513dc1d-79", "ovs_interfaceid": "9513dc1d-79d5-482b-baaa-81f525e99de7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T15:11:25Z,direct_url=<?>,disk_format='qcow2',id=a79f2cea-eb27-4631-aaf3-05e7d9e411b4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a638990e12cc4d6eabb6d55e13be6bdf',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T15:11:27Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'a79f2cea-eb27-4631-aaf3-05e7d9e411b4', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=72382) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 15:26:08 user nova-compute[72382]: DEBUG nova.objects.instance [None req-7390a1b8-fcda-46ea-a5e3-46b55e4ff56b tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Lazy-loading 'resources' on Instance uuid e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0 {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:26:08 user nova-compute[72382]: DEBUG nova.objects.instance [None req-7390a1b8-fcda-46ea-a5e3-46b55e4ff56b tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Lazy-loading 'numa_topology' on Instance uuid e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0 {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:26:08 user nova-compute[72382]: WARNING nova.virt.libvirt.driver [None req-7390a1b8-fcda-46ea-a5e3-46b55e4ff56b tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 15:26:08 user nova-compute[72382]: WARNING nova.virt.libvirt.driver [None req-7390a1b8-fcda-46ea-a5e3-46b55e4ff56b tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 15:26:08 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-7390a1b8-fcda-46ea-a5e3-46b55e4ff56b tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72382) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 15:26:08 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-7390a1b8-fcda-46ea-a5e3-46b55e4ff56b tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] CPU controller missing on host. {{(pid=72382) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 15:26:08 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-7390a1b8-fcda-46ea-a5e3-46b55e4ff56b tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72382) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 15:26:08 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-7390a1b8-fcda-46ea-a5e3-46b55e4ff56b tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] CPU controller found on host. {{(pid=72382) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 15:26:08 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-7390a1b8-fcda-46ea-a5e3-46b55e4ff56b tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72382) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 15:26:08 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-7390a1b8-fcda-46ea-a5e3-46b55e4ff56b tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T15:11:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T15:11:25Z,direct_url=<?>,disk_format='qcow2',id=a79f2cea-eb27-4631-aaf3-05e7d9e411b4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a638990e12cc4d6eabb6d55e13be6bdf',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T15:11:27Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 15:26:08 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-7390a1b8-fcda-46ea-a5e3-46b55e4ff56b tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Flavor limits 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 15:26:08 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-7390a1b8-fcda-46ea-a5e3-46b55e4ff56b tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Image limits 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 15:26:08 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-7390a1b8-fcda-46ea-a5e3-46b55e4ff56b tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Flavor pref 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 15:26:08 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-7390a1b8-fcda-46ea-a5e3-46b55e4ff56b tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Image pref 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 15:26:08 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-7390a1b8-fcda-46ea-a5e3-46b55e4ff56b tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 15:26:08 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-7390a1b8-fcda-46ea-a5e3-46b55e4ff56b tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 15:26:08 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-7390a1b8-fcda-46ea-a5e3-46b55e4ff56b tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72382) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 15:26:08 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-7390a1b8-fcda-46ea-a5e3-46b55e4ff56b tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Got 1 possible topologies {{(pid=72382) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 15:26:08 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-7390a1b8-fcda-46ea-a5e3-46b55e4ff56b tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 15:26:08 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-7390a1b8-fcda-46ea-a5e3-46b55e4ff56b tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 15:26:08 user nova-compute[72382]: DEBUG nova.objects.instance [None req-7390a1b8-fcda-46ea-a5e3-46b55e4ff56b tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Lazy-loading 'vcpu_model' on Instance uuid e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0 {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:26:08 user nova-compute[72382]: DEBUG nova.virt.libvirt.vif [None req-7390a1b8-fcda-46ea-a5e3-46b55e4ff56b tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T15:23:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-254167293',display_name='tempest-ServerRescueNegativeTestJSON-server-254167293',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-254167293',id=24,image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAaMCyNBQb3ylRgcQrIdw3Y84mRNrknOzJTzHyXWYqKGNSX5MBMhw93vJCCFehVKV4spG2iiG6YuL+cWRa1bzzVUXWVZYbOxKXYJ/onpVtDMdN4JhVqCK0JO3eF4bmbVSg==',key_name='tempest-keypair-1084909994',keypairs=<?>,launch_index=0,launched_at=2023-08-09T15:24:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='990ba791030940d38360af5879c853c5',ramdisk_id='',reservation_id='r-tk8hunpk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-867522113',owner_user_name='tempest-ServerRescueNegativeTestJSON-867522113-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T15:24:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f94ca386a2be42cfbc2407bb7520cd25',uuid=e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9513dc1d-79d5-482b-baaa-81f525e99de7", "address": "fa:16:3e:6f:6b:41", "network": {"id": "46ef00c7-17ee-4e45-ba1d-dcc0a417ea85", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1360012261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.24", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1360012261-network", "vif_mac": "fa:16:3e:6f:6b:41"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "990ba791030940d38360af5879c853c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9513dc1d-79", "ovs_interfaceid": "9513dc1d-79d5-482b-baaa-81f525e99de7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72382) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 15:26:08 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-7390a1b8-fcda-46ea-a5e3-46b55e4ff56b tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Converting VIF {"id": "9513dc1d-79d5-482b-baaa-81f525e99de7", "address": "fa:16:3e:6f:6b:41", "network": {"id": "46ef00c7-17ee-4e45-ba1d-dcc0a417ea85", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1360012261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.24", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1360012261-network", "vif_mac": "fa:16:3e:6f:6b:41"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "990ba791030940d38360af5879c853c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9513dc1d-79", "ovs_interfaceid": "9513dc1d-79d5-482b-baaa-81f525e99de7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 15:26:08 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-7390a1b8-fcda-46ea-a5e3-46b55e4ff56b tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6f:6b:41,bridge_name='br-int',has_traffic_filtering=True,id=9513dc1d-79d5-482b-baaa-81f525e99de7,network=Network(46ef00c7-17ee-4e45-ba1d-dcc0a417ea85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9513dc1d-79') {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 15:26:08 user nova-compute[72382]: DEBUG nova.objects.instance [None req-7390a1b8-fcda-46ea-a5e3-46b55e4ff56b tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Lazy-loading 'pci_devices' on Instance uuid e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0 {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:26:08 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-7390a1b8-fcda-46ea-a5e3-46b55e4ff56b tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] [instance: e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0] End _get_guest_xml xml=<domain type="kvm">
Aug 09 15:26:08 user nova-compute[72382]:   <uuid>e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0</uuid>
Aug 09 15:26:08 user nova-compute[72382]:   <name>instance-00000018</name>
Aug 09 15:26:08 user nova-compute[72382]:   <memory>524288</memory>
Aug 09 15:26:08 user nova-compute[72382]:   <vcpu>1</vcpu>
Aug 09 15:26:08 user nova-compute[72382]:   <metadata>
Aug 09 15:26:08 user nova-compute[72382]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 15:26:08 user nova-compute[72382]:       <nova:package version="0.0.0"/>
Aug 09 15:26:08 user nova-compute[72382]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-254167293</nova:name>
Aug 09 15:26:08 user nova-compute[72382]:       <nova:creationTime>2023-08-09 15:26:08</nova:creationTime>
Aug 09 15:26:08 user nova-compute[72382]:       <nova:flavor name="m1.tiny">
Aug 09 15:26:08 user nova-compute[72382]:         <nova:memory>512</nova:memory>
Aug 09 15:26:08 user nova-compute[72382]:         <nova:disk>1</nova:disk>
Aug 09 15:26:08 user nova-compute[72382]:         <nova:swap>0</nova:swap>
Aug 09 15:26:08 user nova-compute[72382]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 15:26:08 user nova-compute[72382]:         <nova:vcpus>1</nova:vcpus>
Aug 09 15:26:08 user nova-compute[72382]:       </nova:flavor>
Aug 09 15:26:08 user nova-compute[72382]:       <nova:owner>
Aug 09 15:26:08 user nova-compute[72382]:         <nova:user uuid="f94ca386a2be42cfbc2407bb7520cd25">tempest-ServerRescueNegativeTestJSON-867522113-project-member</nova:user>
Aug 09 15:26:08 user nova-compute[72382]:         <nova:project uuid="990ba791030940d38360af5879c853c5">tempest-ServerRescueNegativeTestJSON-867522113</nova:project>
Aug 09 15:26:08 user nova-compute[72382]:       </nova:owner>
Aug 09 15:26:08 user nova-compute[72382]:       <nova:root type="image" uuid="a79f2cea-eb27-4631-aaf3-05e7d9e411b4"/>
Aug 09 15:26:08 user nova-compute[72382]:       <nova:ports>
Aug 09 15:26:08 user nova-compute[72382]:         <nova:port uuid="9513dc1d-79d5-482b-baaa-81f525e99de7">
Aug 09 15:26:08 user nova-compute[72382]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 09 15:26:08 user nova-compute[72382]:         </nova:port>
Aug 09 15:26:08 user nova-compute[72382]:       </nova:ports>
Aug 09 15:26:08 user nova-compute[72382]:     </nova:instance>
Aug 09 15:26:08 user nova-compute[72382]:   </metadata>
Aug 09 15:26:08 user nova-compute[72382]:   <sysinfo type="smbios">
Aug 09 15:26:08 user nova-compute[72382]:     <system>
Aug 09 15:26:08 user nova-compute[72382]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 15:26:08 user nova-compute[72382]:       <entry name="product">OpenStack Nova</entry>
Aug 09 15:26:08 user nova-compute[72382]:       <entry name="version">0.0.0</entry>
Aug 09 15:26:08 user nova-compute[72382]:       <entry name="serial">e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0</entry>
Aug 09 15:26:08 user nova-compute[72382]:       <entry name="uuid">e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0</entry>
Aug 09 15:26:08 user nova-compute[72382]:       <entry name="family">Virtual Machine</entry>
Aug 09 15:26:08 user nova-compute[72382]:     </system>
Aug 09 15:26:08 user nova-compute[72382]:   </sysinfo>
Aug 09 15:26:08 user nova-compute[72382]:   <os>
Aug 09 15:26:08 user nova-compute[72382]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 15:26:08 user nova-compute[72382]:     <smbios mode="sysinfo"/>
Aug 09 15:26:08 user nova-compute[72382]:   </os>
Aug 09 15:26:08 user nova-compute[72382]:   <features>
Aug 09 15:26:08 user nova-compute[72382]:     <acpi/>
Aug 09 15:26:08 user nova-compute[72382]:     <apic/>
Aug 09 15:26:08 user nova-compute[72382]:     <vmcoreinfo/>
Aug 09 15:26:08 user nova-compute[72382]:   </features>
Aug 09 15:26:08 user nova-compute[72382]:   <clock offset="utc">
Aug 09 15:26:08 user nova-compute[72382]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 15:26:08 user nova-compute[72382]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 15:26:08 user nova-compute[72382]:     <timer name="hpet" present="no"/>
Aug 09 15:26:08 user nova-compute[72382]:   </clock>
Aug 09 15:26:08 user nova-compute[72382]:   <cpu mode="custom" match="exact">
Aug 09 15:26:08 user nova-compute[72382]:     <model>Nehalem</model>
Aug 09 15:26:08 user nova-compute[72382]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 15:26:08 user nova-compute[72382]:   </cpu>
Aug 09 15:26:08 user nova-compute[72382]:   <devices>
Aug 09 15:26:08 user nova-compute[72382]:     <disk type="file" device="disk">
Aug 09 15:26:08 user nova-compute[72382]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 15:26:08 user nova-compute[72382]:       <source file="/opt/stack/data/nova/instances/e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0/disk.rescue"/>
Aug 09 15:26:08 user nova-compute[72382]:       <target dev="vda" bus="virtio"/>
Aug 09 15:26:08 user nova-compute[72382]:     </disk>
Aug 09 15:26:08 user nova-compute[72382]:     <disk type="file" device="disk">
Aug 09 15:26:08 user nova-compute[72382]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 15:26:08 user nova-compute[72382]:       <source file="/opt/stack/data/nova/instances/e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0/disk"/>
Aug 09 15:26:08 user nova-compute[72382]:       <target dev="vdb" bus="virtio"/>
Aug 09 15:26:08 user nova-compute[72382]:     </disk>
Aug 09 15:26:08 user nova-compute[72382]:     <interface type="ethernet">
Aug 09 15:26:08 user nova-compute[72382]:       <mac address="fa:16:3e:6f:6b:41"/>
Aug 09 15:26:08 user nova-compute[72382]:       <model type="virtio"/>
Aug 09 15:26:08 user nova-compute[72382]:       <mtu size="1442"/>
Aug 09 15:26:08 user nova-compute[72382]:       <target dev="tap9513dc1d-79"/>
Aug 09 15:26:08 user nova-compute[72382]:     </interface>
Aug 09 15:26:08 user nova-compute[72382]:     <serial type="pty">
Aug 09 15:26:08 user nova-compute[72382]:       <log file="/opt/stack/data/nova/instances/e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0/console.log" append="off"/>
Aug 09 15:26:08 user nova-compute[72382]:     </serial>
Aug 09 15:26:08 user nova-compute[72382]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 15:26:08 user nova-compute[72382]:     <video>
Aug 09 15:26:08 user nova-compute[72382]:       <model type="virtio"/>
Aug 09 15:26:08 user nova-compute[72382]:     </video>
Aug 09 15:26:08 user nova-compute[72382]:     <rng model="virtio">
Aug 09 15:26:08 user nova-compute[72382]:       <backend model="random">/dev/urandom</backend>
Aug 09 15:26:08 user nova-compute[72382]:     </rng>
Aug 09 15:26:08 user nova-compute[72382]:     <controller type="usb" index="0" model="none"/>
Aug 09 15:26:08 user nova-compute[72382]:     <memballoon model="virtio">
Aug 09 15:26:08 user nova-compute[72382]:       <stats period="10"/>
Aug 09 15:26:08 user nova-compute[72382]:     </memballoon>
Aug 09 15:26:08 user nova-compute[72382]:   </devices>
Aug 09 15:26:08 user nova-compute[72382]: </domain>
Aug 09 15:26:08 user nova-compute[72382]:  {{(pid=72382) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 15:26:08 user nova-compute[72382]: INFO nova.virt.libvirt.driver [-] [instance: e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0] Instance destroyed successfully.
Aug 09 15:26:08 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-7390a1b8-fcda-46ea-a5e3-46b55e4ff56b tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] No BDM found with device name vda, not building metadata. {{(pid=72382) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 15:26:08 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-7390a1b8-fcda-46ea-a5e3-46b55e4ff56b tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72382) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 15:26:08 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-7390a1b8-fcda-46ea-a5e3-46b55e4ff56b tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] No VIF found with MAC fa:16:3e:6f:6b:41, not building metadata {{(pid=72382) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 15:26:08 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:26:08 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:26:08 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:26:08 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:26:08 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Auditing locally available compute resources for user (node: user) {{(pid=72382) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 15:26:09 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:26:09 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:26:09 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:26:10 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:26:10 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:26:10 user nova-compute[72382]: DEBUG nova.compute.manager [req-b49d0e05-e739-43a4-9ae7-c29a87f232c5 req-156ef9d7-062a-4b0f-a814-79ff838ae472 service nova] [instance: e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0] Received event network-vif-plugged-9513dc1d-79d5-482b-baaa-81f525e99de7 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:26:10 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-b49d0e05-e739-43a4-9ae7-c29a87f232c5 req-156ef9d7-062a-4b0f-a814-79ff838ae472 service nova] Acquiring lock "e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:26:10 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-b49d0e05-e739-43a4-9ae7-c29a87f232c5 req-156ef9d7-062a-4b0f-a814-79ff838ae472 service nova] Lock "e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:26:10 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-b49d0e05-e739-43a4-9ae7-c29a87f232c5 req-156ef9d7-062a-4b0f-a814-79ff838ae472 service nova] Lock "e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:26:10 user nova-compute[72382]: DEBUG nova.compute.manager [req-b49d0e05-e739-43a4-9ae7-c29a87f232c5 req-156ef9d7-062a-4b0f-a814-79ff838ae472 service nova] [instance: e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0] No waiting events found dispatching network-vif-plugged-9513dc1d-79d5-482b-baaa-81f525e99de7 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:26:10 user nova-compute[72382]: WARNING nova.compute.manager [req-b49d0e05-e739-43a4-9ae7-c29a87f232c5 req-156ef9d7-062a-4b0f-a814-79ff838ae472 service nova] [instance: e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0] Received unexpected event network-vif-plugged-9513dc1d-79d5-482b-baaa-81f525e99de7 for instance with vm_state active and task_state rescuing.
Aug 09 15:26:10 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:26:10 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:26:10 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0/disk.rescue --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:26:10 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0/disk.rescue --force-share --output=json" returned: 0 in 0.192s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:26:10 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0/disk.rescue --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:26:11 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0/disk.rescue --force-share --output=json" returned: 0 in 0.162s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:26:11 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] skipping disk /opt/stack/data/nova/instances/e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0/disk (vdb) as it is a volume {{(pid=72382) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 15:26:11 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ea8f68c-3dc1-45ac-a7f3-bca32f929add/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:26:11 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ea8f68c-3dc1-45ac-a7f3-bca32f929add/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:26:11 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ea8f68c-3dc1-45ac-a7f3-bca32f929add/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:26:11 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ea8f68c-3dc1-45ac-a7f3-bca32f929add/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:26:11 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f780040f-b789-4b72-8986-813c7b9fe4a6/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:26:11 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f780040f-b789-4b72-8986-813c7b9fe4a6/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:26:11 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f780040f-b789-4b72-8986-813c7b9fe4a6/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:26:11 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f780040f-b789-4b72-8986-813c7b9fe4a6/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:26:11 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/266be814-4a2b-4f8e-a0f6-e8821fdeb95d/disk.rescue --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:26:12 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/266be814-4a2b-4f8e-a0f6-e8821fdeb95d/disk.rescue --force-share --output=json" returned: 0 in 0.214s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:26:12 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/266be814-4a2b-4f8e-a0f6-e8821fdeb95d/disk.rescue --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:26:12 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/266be814-4a2b-4f8e-a0f6-e8821fdeb95d/disk.rescue --force-share --output=json" returned: 0 in 0.167s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:26:12 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/266be814-4a2b-4f8e-a0f6-e8821fdeb95d/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:26:12 user nova-compute[72382]: DEBUG nova.compute.manager [req-add709e5-2da1-43b8-b9f0-ebf08fccbc78 req-4348e023-b52d-4875-9949-10e41ff3f0af service nova] [instance: e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0] Received event network-vif-plugged-9513dc1d-79d5-482b-baaa-81f525e99de7 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:26:12 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-add709e5-2da1-43b8-b9f0-ebf08fccbc78 req-4348e023-b52d-4875-9949-10e41ff3f0af service nova] Acquiring lock "e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:26:12 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-add709e5-2da1-43b8-b9f0-ebf08fccbc78 req-4348e023-b52d-4875-9949-10e41ff3f0af service nova] Lock "e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:26:12 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-add709e5-2da1-43b8-b9f0-ebf08fccbc78 req-4348e023-b52d-4875-9949-10e41ff3f0af service nova] Lock "e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:26:12 user nova-compute[72382]: DEBUG nova.compute.manager [req-add709e5-2da1-43b8-b9f0-ebf08fccbc78 req-4348e023-b52d-4875-9949-10e41ff3f0af service nova] [instance: e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0] No waiting events found dispatching network-vif-plugged-9513dc1d-79d5-482b-baaa-81f525e99de7 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:26:12 user nova-compute[72382]: WARNING nova.compute.manager [req-add709e5-2da1-43b8-b9f0-ebf08fccbc78 req-4348e023-b52d-4875-9949-10e41ff3f0af service nova] [instance: e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0] Received unexpected event network-vif-plugged-9513dc1d-79d5-482b-baaa-81f525e99de7 for instance with vm_state active and task_state rescuing.
Aug 09 15:26:12 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/266be814-4a2b-4f8e-a0f6-e8821fdeb95d/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:26:12 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/266be814-4a2b-4f8e-a0f6-e8821fdeb95d/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:26:12 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/266be814-4a2b-4f8e-a0f6-e8821fdeb95d/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:26:12 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72382) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 15:26:12 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14c97840-88c0-4a8e-96e8-2e7da318ad07/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:26:12 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Removed pending event for e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0 due to event {{(pid=72382) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 09 15:26:12 user nova-compute[72382]: DEBUG nova.virt.driver [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Emitting event <LifecycleEvent: 1691594772.792057, e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0 => Resumed> {{(pid=72382) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 15:26:12 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0] VM Resumed (Lifecycle Event)
Aug 09 15:26:12 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:26:12 user nova-compute[72382]: DEBUG nova.compute.manager [None req-7390a1b8-fcda-46ea-a5e3-46b55e4ff56b tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] [instance: e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:26:12 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72382) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 15:26:12 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 09 15:26:12 user nova-compute[72382]: DEBUG nova.virt.driver [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Emitting event <LifecycleEvent: 1691594772.7959936, e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0 => Started> {{(pid=72382) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 15:26:12 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0] VM Started (Lifecycle Event)
Aug 09 15:26:12 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14c97840-88c0-4a8e-96e8-2e7da318ad07/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:26:12 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:26:12 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14c97840-88c0-4a8e-96e8-2e7da318ad07/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:26:12 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72382) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 15:26:13 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14c97840-88c0-4a8e-96e8-2e7da318ad07/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:26:13 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44afd1bf-fa5c-4b3e-8752-b16853fef54e/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:26:13 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:26:13 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44afd1bf-fa5c-4b3e-8752-b16853fef54e/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:26:13 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44afd1bf-fa5c-4b3e-8752-b16853fef54e/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:26:13 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44afd1bf-fa5c-4b3e-8752-b16853fef54e/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:26:13 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6296ba5d-bcc6-405a-a635-0e9aa6114f7b/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:26:13 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6296ba5d-bcc6-405a-a635-0e9aa6114f7b/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:26:13 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6296ba5d-bcc6-405a-a635-0e9aa6114f7b/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:26:13 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6296ba5d-bcc6-405a-a635-0e9aa6114f7b/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:26:13 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61976531-76ae-4a1c-8950-0af784be376e/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:26:14 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61976531-76ae-4a1c-8950-0af784be376e/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:26:14 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61976531-76ae-4a1c-8950-0af784be376e/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:26:14 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:26:14 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61976531-76ae-4a1c-8950-0af784be376e/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:26:14 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72382) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 15:26:14 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8aa35482-60b8-4185-b14d-a2667fd3b5b7/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:26:14 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8aa35482-60b8-4185-b14d-a2667fd3b5b7/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:26:14 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8aa35482-60b8-4185-b14d-a2667fd3b5b7/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:26:14 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8aa35482-60b8-4185-b14d-a2667fd3b5b7/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:26:14 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48161b45-d21a-4fb1-ae90-4613d849bfa7/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:26:14 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48161b45-d21a-4fb1-ae90-4613d849bfa7/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:26:14 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48161b45-d21a-4fb1-ae90-4613d849bfa7/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:26:15 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48161b45-d21a-4fb1-ae90-4613d849bfa7/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:26:15 user nova-compute[72382]: WARNING nova.virt.libvirt.driver [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 15:26:15 user nova-compute[72382]: WARNING nova.virt.libvirt.driver [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 15:26:15 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Hypervisor/Node resource view: name=user free_ram=7469MB free_disk=25.307579040527344GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72382) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 15:26:15 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:26:15 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:26:16 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance f780040f-b789-4b72-8986-813c7b9fe4a6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:26:16 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance 44afd1bf-fa5c-4b3e-8752-b16853fef54e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:26:16 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance 266be814-4a2b-4f8e-a0f6-e8821fdeb95d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:26:16 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance 0f510d75-5d1e-4a5c-b38f-731c299f0f5a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:26:16 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance 8aa35482-60b8-4185-b14d-a2667fd3b5b7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:26:16 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance 6296ba5d-bcc6-405a-a635-0e9aa6114f7b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:26:16 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance 6ea8f68c-3dc1-45ac-a7f3-bca32f929add actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:26:16 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance 61976531-76ae-4a1c-8950-0af784be376e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:26:16 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:26:16 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance 14c97840-88c0-4a8e-96e8-2e7da318ad07 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:26:16 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance 48161b45-d21a-4fb1-ae90-4613d849bfa7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:26:16 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=72382) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 15:26:16 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=72382) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 15:26:16 user nova-compute[72382]: DEBUG nova.scheduler.client.report [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Refreshing inventories for resource provider 7b15b0e5-df4d-49db-833b-2855d21d10ae {{(pid=72382) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 09 15:26:16 user nova-compute[72382]: DEBUG nova.scheduler.client.report [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Updating ProviderTree inventory for provider 7b15b0e5-df4d-49db-833b-2855d21d10ae from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72382) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 09 15:26:16 user nova-compute[72382]: DEBUG nova.compute.provider_tree [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Updating inventory in ProviderTree for provider 7b15b0e5-df4d-49db-833b-2855d21d10ae with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72382) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 09 15:26:16 user nova-compute[72382]: DEBUG nova.scheduler.client.report [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Refreshing aggregate associations for resource provider 7b15b0e5-df4d-49db-833b-2855d21d10ae, aggregates: None {{(pid=72382) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 09 15:26:16 user nova-compute[72382]: DEBUG nova.scheduler.client.report [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Refreshing trait associations for resource provider 7b15b0e5-df4d-49db-833b-2855d21d10ae, traits: COMPUTE_DEVICE_TAGGING,COMPUTE_NODE,COMPUTE_VOLUME_EXTEND,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE42,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_MMX,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE2 {{(pid=72382) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 09 15:26:17 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:26:17 user nova-compute[72382]: DEBUG nova.compute.provider_tree [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Inventory has not changed in ProviderTree for provider: 7b15b0e5-df4d-49db-833b-2855d21d10ae {{(pid=72382) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 15:26:17 user nova-compute[72382]: DEBUG nova.scheduler.client.report [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Inventory has not changed for provider 7b15b0e5-df4d-49db-833b-2855d21d10ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72382) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 15:26:17 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Compute_service record updated for user:user {{(pid=72382) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 15:26:17 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.431s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:26:18 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:26:18 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:26:18 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:26:18 user nova-compute[72382]: DEBUG nova.compute.manager [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Starting heal instance info cache {{(pid=72382) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 15:26:18 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Acquiring lock "refresh_cache-266be814-4a2b-4f8e-a0f6-e8821fdeb95d" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 15:26:18 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Acquired lock "refresh_cache-266be814-4a2b-4f8e-a0f6-e8821fdeb95d" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 15:26:18 user nova-compute[72382]: DEBUG nova.network.neutron [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] [instance: 266be814-4a2b-4f8e-a0f6-e8821fdeb95d] Forcefully refreshing network info cache for instance {{(pid=72382) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 15:26:18 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ab872c41-983a-4a50-9741-98257a442e1d tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] [instance: 6296ba5d-bcc6-405a-a635-0e9aa6114f7b] Calling os-brick to attach iSCSI Volume {{(pid=72382) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 15:26:18 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab872c41-983a-4a50-9741-98257a442e1d tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2a0c768340>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:558df9d1-1695-4adc-9bac-22d967b14ce6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BCGUNaZm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 15:26:18 user nova-compute[72382]: WARNING os_brick.initiator.connectors.base [None req-ab872c41-983a-4a50-9741-98257a442e1d tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 15:26:18 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-ab872c41-983a-4a50-9741-98257a442e1d tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 15:26:18 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-ab872c41-983a-4a50-9741-98257a442e1d tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 15:26:18 user nova-compute[72382]: WARNING os_brick.initiator.connectors.base [None req-ab872c41-983a-4a50-9741-98257a442e1d tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 15:26:18 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-ab872c41-983a-4a50-9741-98257a442e1d tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:558df9d1-1695-4adc-9bac-22d967b14ce6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 15:26:18 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-ab872c41-983a-4a50-9741-98257a442e1d tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:558df9d1-1695-4adc-9bac-22d967b14ce6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 15:26:18 user nova-compute[72382]: INFO os_brick.initiator.connectors.iscsi [None req-ab872c41-983a-4a50-9741-98257a442e1d tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 15:26:18 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:558df9d1-1695-4adc-9bac-22d967b14ce6 -p 172.16.0.220:3260 {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:26:18 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:558df9d1-1695-4adc-9bac-22d967b14ce6 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:26:18 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[a22e6270-3539-4bf5-a2d9-0cf29ad69e9a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:26:18 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab872c41-983a-4a50-9741-98257a442e1d tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 15:26:18 user nova-compute[72382]:  {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:26:18 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:558df9d1-1695-4adc-9bac-22d967b14ce6 -p 172.16.0.220:3260 --interface default --op new {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:26:18 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:558df9d1-1695-4adc-9bac-22d967b14ce6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:26:18 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[beb80ab5-f266-4e10-8e6c-d6d8590ce8ea]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:558df9d1-1695-4adc-9bac-22d967b14ce6] added\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:26:18 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab872c41-983a-4a50-9741-98257a442e1d tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:558df9d1-1695-4adc-9bac-22d967b14ce6] added
Aug 09 15:26:18 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:26:18 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:558df9d1-1695-4adc-9bac-22d967b14ce6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:26:18 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:558df9d1-1695-4adc-9bac-22d967b14ce6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:26:18 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[50a02b6d-aeb0-49a6-ba09-0aaa7e273a92]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:26:18 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab872c41-983a-4a50-9741-98257a442e1d tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:26:18 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:558df9d1-1695-4adc-9bac-22d967b14ce6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:26:18 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:558df9d1-1695-4adc-9bac-22d967b14ce6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:26:18 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc2ef144-b6ab-472d-aec5-b170d38d7262]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:26:18 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab872c41-983a-4a50-9741-98257a442e1d tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:26:18 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:558df9d1-1695-4adc-9bac-22d967b14ce6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BCGUNaZm {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:26:18 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:558df9d1-1695-4adc-9bac-22d967b14ce6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BCGUNaZm" returned: 0 in 0.023s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:26:18 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7a055d8-aa46-4ded-aee1-1cbbeb072356]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:26:18 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab872c41-983a-4a50-9741-98257a442e1d tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BCGUNaZm'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:26:18 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:558df9d1-1695-4adc-9bac-22d967b14ce6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:26:18 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:558df9d1-1695-4adc-9bac-22d967b14ce6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:26:18 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[769b5f7f-6ed7-4412-a9f8-846147283677]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:26:18 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab872c41-983a-4a50-9741-98257a442e1d tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:26:18 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:26:18 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:26:18 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[56a687ac-5174-4790-912f-65b50e5aaa00]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9572706e-c54c-42c2-9cf0-2690cdf4cca2 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd90521a-f3b5-485c-9fb9-61ab37267f3a (non-flash)\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:26:18 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab872c41-983a-4a50-9741-98257a442e1d tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)
Aug 09 15:26:18 user nova-compute[72382]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9572706e-c54c-42c2-9cf0-2690cdf4cca2 (non-flash)
Aug 09 15:26:18 user nova-compute[72382]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd90521a-f3b5-485c-9fb9-61ab37267f3a (non-flash)
Aug 09 15:26:18 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 15:26:18 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab872c41-983a-4a50-9741-98257a442e1d tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)
Aug 09 15:26:18 user nova-compute[72382]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9572706e-c54c-42c2-9cf0-2690cdf4cca2 (non-flash)
Aug 09 15:26:18 user nova-compute[72382]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd90521a-f3b5-485c-9fb9-61ab37267f3a (non-flash)
Aug 09 15:26:18 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 15:26:18 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:558df9d1-1695-4adc-9bac-22d967b14ce6 -p 172.16.0.220:3260 --login {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:26:19 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:558df9d1-1695-4adc-9bac-22d967b14ce6 -p 172.16.0.220:3260 --login" returned: 0 in 0.086s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:26:19 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfbe6712-0367-4abe-8b37-785cabe01f92]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:558df9d1-1695-4adc-9bac-22d967b14ce6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:558df9d1-1695-4adc-9bac-22d967b14ce6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:26:19 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab872c41-983a-4a50-9741-98257a442e1d tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:558df9d1-1695-4adc-9bac-22d967b14ce6, portal: 172.16.0.220,3260]
Aug 09 15:26:19 user nova-compute[72382]: Login to [iface: default, target: iqn.2010-10.org.openstack:558df9d1-1695-4adc-9bac-22d967b14ce6, portal: 172.16.0.220,3260] successful.
Aug 09 15:26:19 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:26:19 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:558df9d1-1695-4adc-9bac-22d967b14ce6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:26:19 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:558df9d1-1695-4adc-9bac-22d967b14ce6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:26:19 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c8a2102-5dec-4fd4-8311-18a2699a5e9b]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:26:19 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab872c41-983a-4a50-9741-98257a442e1d tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:26:19 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:26:19 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.041s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:26:19 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbe296b4-c63d-4727-a07a-9aa3fdba6ce6]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9572706e-c54c-42c2-9cf0-2690cdf4cca2 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd90521a-f3b5-485c-9fb9-61ab37267f3a (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:558df9d1-1695-4adc-9bac-22d967b14ce6 (non-flash)\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:26:19 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab872c41-983a-4a50-9741-98257a442e1d tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)
Aug 09 15:26:19 user nova-compute[72382]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9572706e-c54c-42c2-9cf0-2690cdf4cca2 (non-flash)
Aug 09 15:26:19 user nova-compute[72382]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd90521a-f3b5-485c-9fb9-61ab37267f3a (non-flash)
Aug 09 15:26:19 user nova-compute[72382]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:558df9d1-1695-4adc-9bac-22d967b14ce6 (non-flash)
Aug 09 15:26:19 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 15:26:19 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab872c41-983a-4a50-9741-98257a442e1d tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)
Aug 09 15:26:19 user nova-compute[72382]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9572706e-c54c-42c2-9cf0-2690cdf4cca2 (non-flash)
Aug 09 15:26:19 user nova-compute[72382]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd90521a-f3b5-485c-9fb9-61ab37267f3a (non-flash)
Aug 09 15:26:19 user nova-compute[72382]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:558df9d1-1695-4adc-9bac-22d967b14ce6 (non-flash)
Aug 09 15:26:19 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 15:26:19 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-ab872c41-983a-4a50-9741-98257a442e1d tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:558df9d1-1695-4adc-9bac-22d967b14ce6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.367s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 15:26:19 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab872c41-983a-4a50-9741-98257a442e1d tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] Connected to 172.16.0.220:3260 {{(pid=72382) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 15:26:19 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-ab872c41-983a-4a50-9741-98257a442e1d tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] HCTL ('36', '-', '-', 0) found on session 30 with lun 0 {{(pid=72382) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 15:26:19 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-ab872c41-983a-4a50-9741-98257a442e1d tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72382) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 15:26:19 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:26:19 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.020s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:26:19 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[37e34677-947b-4290-8543-53a080535e37]: (4, ('- - 0', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:26:19 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-ab872c41-983a-4a50-9741-98257a442e1d tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] Searching for a device in session 30 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72382) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 15:26:19 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab872c41-983a-4a50-9741-98257a442e1d tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BCGUNaZm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72382) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 15:26:19 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:26:20 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-ab872c41-983a-4a50-9741-98257a442e1d tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.420s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 15:26:20 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab872c41-983a-4a50-9741-98257a442e1d tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] <== connect_volume: return (1422ms) {'type': 'block', 'scsi_wwn': '26430306235333233', 'path': '/dev/sde'} {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 15:26:20 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ab872c41-983a-4a50-9741-98257a442e1d tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] [instance: 6296ba5d-bcc6-405a-a635-0e9aa6114f7b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26430306235333233', 'path': '/dev/sde'} {{(pid=72382) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 15:26:20 user nova-compute[72382]: DEBUG nova.objects.instance [None req-ab872c41-983a-4a50-9741-98257a442e1d tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] Lazy-loading 'flavor' on Instance uuid 6296ba5d-bcc6-405a-a635-0e9aa6114f7b {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:26:20 user nova-compute[72382]: DEBUG nova.virt.libvirt.guest [None req-ab872c41-983a-4a50-9741-98257a442e1d tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 15:26:20 user nova-compute[72382]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 15:26:20 user nova-compute[72382]:   <source dev="/dev/sde"/>
Aug 09 15:26:20 user nova-compute[72382]:   <target dev="vdb" bus="virtio"/>
Aug 09 15:26:20 user nova-compute[72382]:   <serial>558df9d1-1695-4adc-9bac-22d967b14ce6</serial>
Aug 09 15:26:20 user nova-compute[72382]: </disk>
Aug 09 15:26:20 user nova-compute[72382]:  {{(pid=72382) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 15:26:20 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:26:20 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-ab872c41-983a-4a50-9741-98257a442e1d tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] No BDM found with device name vda, not building metadata. {{(pid=72382) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 15:26:20 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-ab872c41-983a-4a50-9741-98257a442e1d tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72382) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 15:26:20 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-ab872c41-983a-4a50-9741-98257a442e1d tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] No VIF found with MAC fa:16:3e:0b:83:7d, not building metadata {{(pid=72382) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 15:26:20 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-ab872c41-983a-4a50-9741-98257a442e1d tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] Lock "6296ba5d-bcc6-405a-a635-0e9aa6114f7b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.377s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:26:20 user nova-compute[72382]: DEBUG nova.network.neutron [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] [instance: 266be814-4a2b-4f8e-a0f6-e8821fdeb95d] Updating instance_info_cache with network_info: [{"id": "48650c01-c5a9-44f2-a481-5120c429a5a5", "address": "fa:16:3e:25:0d:d4", "network": {"id": "46ef00c7-17ee-4e45-ba1d-dcc0a417ea85", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1360012261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "990ba791030940d38360af5879c853c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48650c01-c5", "ovs_interfaceid": "48650c01-c5a9-44f2-a481-5120c429a5a5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:26:20 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Releasing lock "refresh_cache-266be814-4a2b-4f8e-a0f6-e8821fdeb95d" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 15:26:20 user nova-compute[72382]: DEBUG nova.compute.manager [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] [instance: 266be814-4a2b-4f8e-a0f6-e8821fdeb95d] Updated the network info_cache for instance {{(pid=72382) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 15:26:20 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:26:20 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:26:20 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:26:20 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:26:20 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:26:20 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:26:20 user nova-compute[72382]: DEBUG nova.compute.manager [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72382) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 15:26:20 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:26:20 user nova-compute[72382]: DEBUG nova.compute.manager [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Cleaning up deleted instances with incomplete migration  {{(pid=72382) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 09 15:26:23 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:26:23 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-d973d751-b56f-4c27-87aa-ded0aacad23a tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] Acquiring lock "6296ba5d-bcc6-405a-a635-0e9aa6114f7b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:26:23 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-d973d751-b56f-4c27-87aa-ded0aacad23a tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] Lock "6296ba5d-bcc6-405a-a635-0e9aa6114f7b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:26:23 user nova-compute[72382]: INFO nova.compute.manager [None req-d973d751-b56f-4c27-87aa-ded0aacad23a tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] [instance: 6296ba5d-bcc6-405a-a635-0e9aa6114f7b] Detaching volume 558df9d1-1695-4adc-9bac-22d967b14ce6
Aug 09 15:26:23 user nova-compute[72382]: INFO nova.virt.block_device [None req-d973d751-b56f-4c27-87aa-ded0aacad23a tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] [instance: 6296ba5d-bcc6-405a-a635-0e9aa6114f7b] Attempting to driver detach volume 558df9d1-1695-4adc-9bac-22d967b14ce6 from mountpoint /dev/vdb
Aug 09 15:26:23 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-d973d751-b56f-4c27-87aa-ded0aacad23a tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] Attempting to detach device vdb from instance 6296ba5d-bcc6-405a-a635-0e9aa6114f7b from the persistent domain config. {{(pid=72382) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 15:26:23 user nova-compute[72382]: DEBUG nova.virt.libvirt.guest [None req-d973d751-b56f-4c27-87aa-ded0aacad23a tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 15:26:23 user nova-compute[72382]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 15:26:23 user nova-compute[72382]:   <source dev="/dev/sde"/>
Aug 09 15:26:23 user nova-compute[72382]:   <target dev="vdb" bus="virtio"/>
Aug 09 15:26:23 user nova-compute[72382]:   <serial>558df9d1-1695-4adc-9bac-22d967b14ce6</serial>
Aug 09 15:26:23 user nova-compute[72382]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 15:26:23 user nova-compute[72382]: </disk>
Aug 09 15:26:23 user nova-compute[72382]:  {{(pid=72382) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 15:26:23 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-d973d751-b56f-4c27-87aa-ded0aacad23a tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] Successfully detached device vdb from instance 6296ba5d-bcc6-405a-a635-0e9aa6114f7b from the persistent domain config.
Aug 09 15:26:23 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-d973d751-b56f-4c27-87aa-ded0aacad23a tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 6296ba5d-bcc6-405a-a635-0e9aa6114f7b from the live domain config. {{(pid=72382) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 15:26:23 user nova-compute[72382]: DEBUG nova.virt.libvirt.guest [None req-d973d751-b56f-4c27-87aa-ded0aacad23a tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 15:26:23 user nova-compute[72382]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 15:26:23 user nova-compute[72382]:   <source dev="/dev/sde"/>
Aug 09 15:26:23 user nova-compute[72382]:   <target dev="vdb" bus="virtio"/>
Aug 09 15:26:23 user nova-compute[72382]:   <serial>558df9d1-1695-4adc-9bac-22d967b14ce6</serial>
Aug 09 15:26:23 user nova-compute[72382]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 15:26:23 user nova-compute[72382]: </disk>
Aug 09 15:26:23 user nova-compute[72382]:  {{(pid=72382) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 15:26:24 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:26:24 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Received event <DeviceRemovedEvent: 1691594784.372199, 6296ba5d-bcc6-405a-a635-0e9aa6114f7b => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72382) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 15:26:24 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-d973d751-b56f-4c27-87aa-ded0aacad23a tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 6296ba5d-bcc6-405a-a635-0e9aa6114f7b {{(pid=72382) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 15:26:24 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-d973d751-b56f-4c27-87aa-ded0aacad23a tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] Successfully detached device vdb from instance 6296ba5d-bcc6-405a-a635-0e9aa6114f7b from the live domain config.
Aug 09 15:26:24 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d973d751-b56f-4c27-87aa-ded0aacad23a tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] [instance: 6296ba5d-bcc6-405a-a635-0e9aa6114f7b] calling os-brick to detach iSCSI Volume {{(pid=72382) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 15:26:24 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-d973d751-b56f-4c27-87aa-ded0aacad23a tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2a0c768340>, {'target_iqns': ['iqn.2010-10.org.openstack:558df9d1-1695-4adc-9bac-22d967b14ce6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BCGUNaZm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 15:26:24 user nova-compute[72382]: WARNING os_brick.initiator.connectors.base [None req-d973d751-b56f-4c27-87aa-ded0aacad23a tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 15:26:24 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-d973d751-b56f-4c27-87aa-ded0aacad23a tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 15:26:24 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-d973d751-b56f-4c27-87aa-ded0aacad23a tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 15:26:24 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-d973d751-b56f-4c27-87aa-ded0aacad23a tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:558df9d1-1695-4adc-9bac-22d967b14ce6', 0)] {{(pid=72382) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 15:26:24 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:26:24 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:26:24 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[59b8102a-3044-4495-b94f-4201e4d01369]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:558df9d1-1695-4adc-9bac-22d967b14ce6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9572706e-c54c-42c2-9cf0-2690cdf4cca2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bd90521a-f3b5-485c-9fb9-61ab37267f3a\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:26:24 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:26:24 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:26:24 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[3906f2c3-22b8-428c-96a6-74ae9434b040]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9572706e-c54c-42c2-9cf0-2690cdf4cca2 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd90521a-f3b5-485c-9fb9-61ab37267f3a (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:558df9d1-1695-4adc-9bac-22d967b14ce6 (non-flash)\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:26:24 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-d973d751-b56f-4c27-87aa-ded0aacad23a tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)
Aug 09 15:26:24 user nova-compute[72382]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9572706e-c54c-42c2-9cf0-2690cdf4cca2 (non-flash)
Aug 09 15:26:24 user nova-compute[72382]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd90521a-f3b5-485c-9fb9-61ab37267f3a (non-flash)
Aug 09 15:26:24 user nova-compute[72382]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:558df9d1-1695-4adc-9bac-22d967b14ce6 (non-flash)
Aug 09 15:26:24 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 15:26:24 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-d973d751-b56f-4c27-87aa-ded0aacad23a tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)
Aug 09 15:26:24 user nova-compute[72382]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9572706e-c54c-42c2-9cf0-2690cdf4cca2 (non-flash)
Aug 09 15:26:24 user nova-compute[72382]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd90521a-f3b5-485c-9fb9-61ab37267f3a (non-flash)
Aug 09 15:26:24 user nova-compute[72382]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:558df9d1-1695-4adc-9bac-22d967b14ce6 (non-flash)
Aug 09 15:26:24 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 15:26:24 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-d973d751-b56f-4c27-87aa-ded0aacad23a tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2a0c3a5b40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:558df9d1-1695-4adc-9bac-22d967b14ce6'): ({'sde'}, set())}) {{(pid=72382) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 15:26:24 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-d973d751-b56f-4c27-87aa-ded0aacad23a tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] Removing single pathed devices sde {{(pid=72382) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 15:26:24 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:26:24 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.034s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:26:24 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[7edc645b-b21d-44f6-bf89-e67bb34731e5]: (4, ('path checker states:\nup                  3\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:26:24 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:26:24 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.022s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:26:24 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5da69ae-9dbb-4bd3-9589-95fd293b6f96]: (4, ('ok\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:26:24 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-d973d751-b56f-4c27-87aa-ded0aacad23a tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] Flushing IO for device /dev/sde {{(pid=72382) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 15:26:24 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:26:24 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:26:24 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1a06a5d-09c8-4a98-966e-de0c4646295e]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:26:24 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-d973d751-b56f-4c27-87aa-ded0aacad23a tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72382) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 15:26:24 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:26:24 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.047s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:26:24 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[4385aae0-1de8-406f-b613-ac19ff3dbd8b]: (4, ('1', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:26:24 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-d973d751-b56f-4c27-87aa-ded0aacad23a tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72382) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 15:26:24 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-d973d751-b56f-4c27-87aa-ded0aacad23a tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] SCSI volumes sde have been removed. {{(pid=72382) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 15:26:24 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-d973d751-b56f-4c27-87aa-ded0aacad23a tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:558df9d1-1695-4adc-9bac-22d967b14ce6')] {{(pid=72382) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 15:26:24 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:558df9d1-1695-4adc-9bac-22d967b14ce6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:26:24 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:558df9d1-1695-4adc-9bac-22d967b14ce6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:26:24 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0870aa7-7ef3-4e60-8ab9-dd3aa0ae8bc8]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:26:24 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-d973d751-b56f-4c27-87aa-ded0aacad23a tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:26:24 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:558df9d1-1695-4adc-9bac-22d967b14ce6 -p 172.16.0.220:3260 --logout {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:26:24 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:558df9d1-1695-4adc-9bac-22d967b14ce6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:26:24 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[f22c9718-20fe-4931-88d5-965af67fe08b]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:558df9d1-1695-4adc-9bac-22d967b14ce6, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:558df9d1-1695-4adc-9bac-22d967b14ce6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:26:24 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-d973d751-b56f-4c27-87aa-ded0aacad23a tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:558df9d1-1695-4adc-9bac-22d967b14ce6, portal: 172.16.0.220,3260]
Aug 09 15:26:24 user nova-compute[72382]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:558df9d1-1695-4adc-9bac-22d967b14ce6, portal: 172.16.0.220,3260] successful.
Aug 09 15:26:24 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:26:24 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:558df9d1-1695-4adc-9bac-22d967b14ce6 -p 172.16.0.220:3260 --op delete {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:26:24 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:558df9d1-1695-4adc-9bac-22d967b14ce6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:26:24 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[77911e0f-37e7-4095-945d-021a7634f28f]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:26:24 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-d973d751-b56f-4c27-87aa-ded0aacad23a tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:26:24 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-d973d751-b56f-4c27-87aa-ded0aacad23a tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.340s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 15:26:24 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-d973d751-b56f-4c27-87aa-ded0aacad23a tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] <== disconnect_volume: return (341ms) None {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 15:26:24 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d973d751-b56f-4c27-87aa-ded0aacad23a tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] [instance: 6296ba5d-bcc6-405a-a635-0e9aa6114f7b] Disconnected iSCSI Volume {{(pid=72382) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 15:26:25 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-4eaa20a3-4b98-4fe3-bc02-1afcb3ac1bd1 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Acquiring lock "4ccbfda2-8bcd-4ec1-972a-cf49a62b1583" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:26:25 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-4eaa20a3-4b98-4fe3-bc02-1afcb3ac1bd1 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Lock "4ccbfda2-8bcd-4ec1-972a-cf49a62b1583" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:26:25 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:26:25 user nova-compute[72382]: DEBUG nova.compute.manager [None req-4eaa20a3-4b98-4fe3-bc02-1afcb3ac1bd1 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] [instance: 4ccbfda2-8bcd-4ec1-972a-cf49a62b1583] Starting instance... {{(pid=72382) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 15:26:25 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-4eaa20a3-4b98-4fe3-bc02-1afcb3ac1bd1 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:26:25 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-4eaa20a3-4b98-4fe3-bc02-1afcb3ac1bd1 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:26:25 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-4eaa20a3-4b98-4fe3-bc02-1afcb3ac1bd1 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72382) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 15:26:25 user nova-compute[72382]: INFO nova.compute.claims [None req-4eaa20a3-4b98-4fe3-bc02-1afcb3ac1bd1 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] [instance: 4ccbfda2-8bcd-4ec1-972a-cf49a62b1583] Claim successful on node user
Aug 09 15:26:25 user nova-compute[72382]: DEBUG nova.objects.instance [None req-d973d751-b56f-4c27-87aa-ded0aacad23a tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] Lazy-loading 'flavor' on Instance uuid 6296ba5d-bcc6-405a-a635-0e9aa6114f7b {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:26:25 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-d973d751-b56f-4c27-87aa-ded0aacad23a tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] Lock "6296ba5d-bcc6-405a-a635-0e9aa6114f7b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.948s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:26:25 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-a3b4b0dc-bd7b-4b71-8ac6-e53f0471c8af tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] Acquiring lock "8aa35482-60b8-4185-b14d-a2667fd3b5b7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:26:25 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-a3b4b0dc-bd7b-4b71-8ac6-e53f0471c8af tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] Lock "8aa35482-60b8-4185-b14d-a2667fd3b5b7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:26:25 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-a3b4b0dc-bd7b-4b71-8ac6-e53f0471c8af tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] Acquiring lock "8aa35482-60b8-4185-b14d-a2667fd3b5b7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:26:25 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-a3b4b0dc-bd7b-4b71-8ac6-e53f0471c8af tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] Lock "8aa35482-60b8-4185-b14d-a2667fd3b5b7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:26:25 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-a3b4b0dc-bd7b-4b71-8ac6-e53f0471c8af tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] Lock "8aa35482-60b8-4185-b14d-a2667fd3b5b7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:26:25 user nova-compute[72382]: INFO nova.compute.manager [None req-a3b4b0dc-bd7b-4b71-8ac6-e53f0471c8af tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] [instance: 8aa35482-60b8-4185-b14d-a2667fd3b5b7] Terminating instance
Aug 09 15:26:25 user nova-compute[72382]: DEBUG nova.compute.manager [None req-a3b4b0dc-bd7b-4b71-8ac6-e53f0471c8af tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] [instance: 8aa35482-60b8-4185-b14d-a2667fd3b5b7] Start destroying the instance on the hypervisor. {{(pid=72382) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 15:26:25 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:26:25 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:26:25 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:26:26 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:26:26 user nova-compute[72382]: DEBUG nova.compute.manager [req-42cea58f-e282-4643-9dbe-47eee79e3bd8 req-a83b066d-9baf-4a2f-946a-8fa98c3e5d11 service nova] [instance: 8aa35482-60b8-4185-b14d-a2667fd3b5b7] Received event network-vif-unplugged-b4902494-07bb-48a3-b0f8-26115f2b04d6 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:26:26 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-42cea58f-e282-4643-9dbe-47eee79e3bd8 req-a83b066d-9baf-4a2f-946a-8fa98c3e5d11 service nova] Acquiring lock "8aa35482-60b8-4185-b14d-a2667fd3b5b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:26:26 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-42cea58f-e282-4643-9dbe-47eee79e3bd8 req-a83b066d-9baf-4a2f-946a-8fa98c3e5d11 service nova] Lock "8aa35482-60b8-4185-b14d-a2667fd3b5b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:26:26 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-42cea58f-e282-4643-9dbe-47eee79e3bd8 req-a83b066d-9baf-4a2f-946a-8fa98c3e5d11 service nova] Lock "8aa35482-60b8-4185-b14d-a2667fd3b5b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:26:26 user nova-compute[72382]: DEBUG nova.compute.manager [req-42cea58f-e282-4643-9dbe-47eee79e3bd8 req-a83b066d-9baf-4a2f-946a-8fa98c3e5d11 service nova] [instance: 8aa35482-60b8-4185-b14d-a2667fd3b5b7] No waiting events found dispatching network-vif-unplugged-b4902494-07bb-48a3-b0f8-26115f2b04d6 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:26:26 user nova-compute[72382]: DEBUG nova.compute.manager [req-42cea58f-e282-4643-9dbe-47eee79e3bd8 req-a83b066d-9baf-4a2f-946a-8fa98c3e5d11 service nova] [instance: 8aa35482-60b8-4185-b14d-a2667fd3b5b7] Received event network-vif-unplugged-b4902494-07bb-48a3-b0f8-26115f2b04d6 for instance with task_state deleting. {{(pid=72382) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 15:26:26 user nova-compute[72382]: DEBUG nova.compute.provider_tree [None req-4eaa20a3-4b98-4fe3-bc02-1afcb3ac1bd1 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Inventory has not changed in ProviderTree for provider: 7b15b0e5-df4d-49db-833b-2855d21d10ae {{(pid=72382) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 15:26:26 user nova-compute[72382]: DEBUG nova.scheduler.client.report [None req-4eaa20a3-4b98-4fe3-bc02-1afcb3ac1bd1 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Inventory has not changed for provider 7b15b0e5-df4d-49db-833b-2855d21d10ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72382) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 15:26:26 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-4eaa20a3-4b98-4fe3-bc02-1afcb3ac1bd1 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.658s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:26:26 user nova-compute[72382]: DEBUG nova.compute.manager [None req-4eaa20a3-4b98-4fe3-bc02-1afcb3ac1bd1 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] [instance: 4ccbfda2-8bcd-4ec1-972a-cf49a62b1583] Start building networks asynchronously for instance. {{(pid=72382) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 15:26:26 user nova-compute[72382]: DEBUG nova.compute.manager [None req-4eaa20a3-4b98-4fe3-bc02-1afcb3ac1bd1 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] [instance: 4ccbfda2-8bcd-4ec1-972a-cf49a62b1583] Allocating IP information in the background. {{(pid=72382) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 15:26:26 user nova-compute[72382]: DEBUG nova.network.neutron [None req-4eaa20a3-4b98-4fe3-bc02-1afcb3ac1bd1 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] [instance: 4ccbfda2-8bcd-4ec1-972a-cf49a62b1583] allocate_for_instance() {{(pid=72382) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 15:26:26 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-4eaa20a3-4b98-4fe3-bc02-1afcb3ac1bd1 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] [instance: 4ccbfda2-8bcd-4ec1-972a-cf49a62b1583] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 15:26:26 user nova-compute[72382]: DEBUG nova.compute.manager [None req-4eaa20a3-4b98-4fe3-bc02-1afcb3ac1bd1 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] [instance: 4ccbfda2-8bcd-4ec1-972a-cf49a62b1583] Start building block device mappings for instance. {{(pid=72382) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 15:26:26 user nova-compute[72382]: INFO nova.virt.libvirt.driver [-] [instance: 8aa35482-60b8-4185-b14d-a2667fd3b5b7] Instance destroyed successfully.
Aug 09 15:26:26 user nova-compute[72382]: DEBUG nova.objects.instance [None req-a3b4b0dc-bd7b-4b71-8ac6-e53f0471c8af tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] Lazy-loading 'resources' on Instance uuid 8aa35482-60b8-4185-b14d-a2667fd3b5b7 {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:26:26 user nova-compute[72382]: DEBUG nova.compute.manager [None req-4eaa20a3-4b98-4fe3-bc02-1afcb3ac1bd1 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] [instance: 4ccbfda2-8bcd-4ec1-972a-cf49a62b1583] Start spawning the instance on the hypervisor. {{(pid=72382) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 15:26:26 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-4eaa20a3-4b98-4fe3-bc02-1afcb3ac1bd1 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] [instance: 4ccbfda2-8bcd-4ec1-972a-cf49a62b1583] Creating instance directory {{(pid=72382) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 15:26:26 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-4eaa20a3-4b98-4fe3-bc02-1afcb3ac1bd1 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] [instance: 4ccbfda2-8bcd-4ec1-972a-cf49a62b1583] Creating image(s)
Aug 09 15:26:26 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-4eaa20a3-4b98-4fe3-bc02-1afcb3ac1bd1 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Acquiring lock "/opt/stack/data/nova/instances/4ccbfda2-8bcd-4ec1-972a-cf49a62b1583/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:26:26 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-4eaa20a3-4b98-4fe3-bc02-1afcb3ac1bd1 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Lock "/opt/stack/data/nova/instances/4ccbfda2-8bcd-4ec1-972a-cf49a62b1583/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:26:26 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-4eaa20a3-4b98-4fe3-bc02-1afcb3ac1bd1 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Lock "/opt/stack/data/nova/instances/4ccbfda2-8bcd-4ec1-972a-cf49a62b1583/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:26:26 user nova-compute[72382]: DEBUG nova.virt.libvirt.vif [None req-a3b4b0dc-bd7b-4b71-8ac6-e53f0471c8af tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T15:19:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-341294476',display_name='tempest-ServerStableDeviceRescueTest-server-341294476',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-341294476',id=16,image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDSwCFKsEbYMyjyYEiifVNDRpUL+wgKrUr4wDsDSzZ9nQKSlq2Zyg/uMkgTj+Tetif7Q1/gEDWhIfZI9BKPsna9q628aX9WOBAayqzqMu/VUfXUdxiIc/aNSYqSeGLq3Rw==',key_name='tempest-keypair-1083668026',keypairs=<?>,launch_index=0,launched_at=2023-08-09T15:23:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9bab7a1ba67749ba85f0785846ce0338',ramdisk_id='',reservation_id='r-uxqtsogm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1490271161',owner_user_name='tempest-ServerStableDeviceRescueTest-1490271161-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T15:25:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1afcb1b9c1b04eecbc085bce97556046',uuid=8aa35482-60b8-4185-b14d-a2667fd3b5b7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b4902494-07bb-48a3-b0f8-26115f2b04d6", "address": "fa:16:3e:d9:46:4b", "network": {"id": "effdc019-a66a-4e9b-a99c-4a7c5b715201", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-414399276-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.250", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bab7a1ba67749ba85f0785846ce0338", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4902494-07", "ovs_interfaceid": "b4902494-07bb-48a3-b0f8-26115f2b04d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 15:26:26 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-a3b4b0dc-bd7b-4b71-8ac6-e53f0471c8af tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] Converting VIF {"id": "b4902494-07bb-48a3-b0f8-26115f2b04d6", "address": "fa:16:3e:d9:46:4b", "network": {"id": "effdc019-a66a-4e9b-a99c-4a7c5b715201", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-414399276-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.250", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bab7a1ba67749ba85f0785846ce0338", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4902494-07", "ovs_interfaceid": "b4902494-07bb-48a3-b0f8-26115f2b04d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 15:26:26 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-a3b4b0dc-bd7b-4b71-8ac6-e53f0471c8af tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d9:46:4b,bridge_name='br-int',has_traffic_filtering=True,id=b4902494-07bb-48a3-b0f8-26115f2b04d6,network=Network(effdc019-a66a-4e9b-a99c-4a7c5b715201),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4902494-07') {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 15:26:26 user nova-compute[72382]: DEBUG os_vif [None req-a3b4b0dc-bd7b-4b71-8ac6-e53f0471c8af tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d9:46:4b,bridge_name='br-int',has_traffic_filtering=True,id=b4902494-07bb-48a3-b0f8-26115f2b04d6,network=Network(effdc019-a66a-4e9b-a99c-4a7c5b715201),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4902494-07') {{(pid=72382) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 15:26:26 user nova-compute[72382]: DEBUG nova.policy [None req-4eaa20a3-4b98-4fe3-bc02-1afcb3ac1bd1 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2cca9aef887b4b91a46ff4bd5cd32302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb5bf3f95d2843af94dbcab2af932bd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72382) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 15:26:26 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-4eaa20a3-4b98-4fe3-bc02-1afcb3ac1bd1 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:26:26 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:26:26 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb4902494-07, bridge=br-int, if_exists=True) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:26:26 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:26:26 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:26:26 user nova-compute[72382]: INFO os_vif [None req-a3b4b0dc-bd7b-4b71-8ac6-e53f0471c8af tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d9:46:4b,bridge_name='br-int',has_traffic_filtering=True,id=b4902494-07bb-48a3-b0f8-26115f2b04d6,network=Network(effdc019-a66a-4e9b-a99c-4a7c5b715201),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4902494-07')
Aug 09 15:26:26 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-a3b4b0dc-bd7b-4b71-8ac6-e53f0471c8af tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] [instance: 8aa35482-60b8-4185-b14d-a2667fd3b5b7] Deleting instance files /opt/stack/data/nova/instances/8aa35482-60b8-4185-b14d-a2667fd3b5b7_del
Aug 09 15:26:26 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-a3b4b0dc-bd7b-4b71-8ac6-e53f0471c8af tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] [instance: 8aa35482-60b8-4185-b14d-a2667fd3b5b7] Deletion of /opt/stack/data/nova/instances/8aa35482-60b8-4185-b14d-a2667fd3b5b7_del complete
Aug 09 15:26:26 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-4eaa20a3-4b98-4fe3-bc02-1afcb3ac1bd1 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b --force-share --output=json" returned: 0 in 0.139s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:26:26 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-4eaa20a3-4b98-4fe3-bc02-1afcb3ac1bd1 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Acquiring lock "383812ff437283e0191ed5b9ecc04c27f1162b0b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:26:26 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-4eaa20a3-4b98-4fe3-bc02-1afcb3ac1bd1 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Lock "383812ff437283e0191ed5b9ecc04c27f1162b0b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:26:26 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-4eaa20a3-4b98-4fe3-bc02-1afcb3ac1bd1 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:26:26 user nova-compute[72382]: INFO nova.compute.manager [None req-a3b4b0dc-bd7b-4b71-8ac6-e53f0471c8af tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] [instance: 8aa35482-60b8-4185-b14d-a2667fd3b5b7] Took 1.06 seconds to destroy the instance on the hypervisor.
Aug 09 15:26:26 user nova-compute[72382]: DEBUG oslo.service.loopingcall [None req-a3b4b0dc-bd7b-4b71-8ac6-e53f0471c8af tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72382) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 15:26:26 user nova-compute[72382]: DEBUG nova.compute.manager [-] [instance: 8aa35482-60b8-4185-b14d-a2667fd3b5b7] Deallocating network for instance {{(pid=72382) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 15:26:26 user nova-compute[72382]: DEBUG nova.network.neutron [-] [instance: 8aa35482-60b8-4185-b14d-a2667fd3b5b7] deallocate_for_instance() {{(pid=72382) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 15:26:26 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-4eaa20a3-4b98-4fe3-bc02-1afcb3ac1bd1 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b --force-share --output=json" returned: 0 in 0.167s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:26:26 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-4eaa20a3-4b98-4fe3-bc02-1afcb3ac1bd1 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b,backing_fmt=raw /opt/stack/data/nova/instances/4ccbfda2-8bcd-4ec1-972a-cf49a62b1583/disk 1073741824 {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:26:27 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-4eaa20a3-4b98-4fe3-bc02-1afcb3ac1bd1 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b,backing_fmt=raw /opt/stack/data/nova/instances/4ccbfda2-8bcd-4ec1-972a-cf49a62b1583/disk 1073741824" returned: 0 in 0.053s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:26:27 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-4eaa20a3-4b98-4fe3-bc02-1afcb3ac1bd1 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Lock "383812ff437283e0191ed5b9ecc04c27f1162b0b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.224s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:26:27 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-4eaa20a3-4b98-4fe3-bc02-1afcb3ac1bd1 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:26:27 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-4eaa20a3-4b98-4fe3-bc02-1afcb3ac1bd1 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b --force-share --output=json" returned: 0 in 0.160s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:26:27 user nova-compute[72382]: DEBUG nova.virt.disk.api [None req-4eaa20a3-4b98-4fe3-bc02-1afcb3ac1bd1 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4ccbfda2-8bcd-4ec1-972a-cf49a62b1583/disk. size=1073741824 {{(pid=72382) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 15:26:27 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-4eaa20a3-4b98-4fe3-bc02-1afcb3ac1bd1 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ccbfda2-8bcd-4ec1-972a-cf49a62b1583/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:26:27 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-4eaa20a3-4b98-4fe3-bc02-1afcb3ac1bd1 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ccbfda2-8bcd-4ec1-972a-cf49a62b1583/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:26:27 user nova-compute[72382]: DEBUG nova.virt.disk.api [None req-4eaa20a3-4b98-4fe3-bc02-1afcb3ac1bd1 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Cannot resize image /opt/stack/data/nova/instances/4ccbfda2-8bcd-4ec1-972a-cf49a62b1583/disk to a smaller size. {{(pid=72382) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 15:26:27 user nova-compute[72382]: DEBUG nova.objects.instance [None req-4eaa20a3-4b98-4fe3-bc02-1afcb3ac1bd1 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Lazy-loading 'migration_context' on Instance uuid 4ccbfda2-8bcd-4ec1-972a-cf49a62b1583 {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:26:27 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-4eaa20a3-4b98-4fe3-bc02-1afcb3ac1bd1 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] [instance: 4ccbfda2-8bcd-4ec1-972a-cf49a62b1583] Created local disks {{(pid=72382) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 15:26:27 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-4eaa20a3-4b98-4fe3-bc02-1afcb3ac1bd1 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] [instance: 4ccbfda2-8bcd-4ec1-972a-cf49a62b1583] Ensure instance console log exists: /opt/stack/data/nova/instances/4ccbfda2-8bcd-4ec1-972a-cf49a62b1583/console.log {{(pid=72382) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 15:26:27 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-4eaa20a3-4b98-4fe3-bc02-1afcb3ac1bd1 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:26:27 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-4eaa20a3-4b98-4fe3-bc02-1afcb3ac1bd1 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:26:27 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-4eaa20a3-4b98-4fe3-bc02-1afcb3ac1bd1 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:26:28 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:26:28 user nova-compute[72382]: DEBUG nova.compute.manager [req-d37acf26-0dfa-41d0-9b06-7f8503dac064 req-046a9097-735c-4176-b31f-6989f437a54a service nova] [instance: 8aa35482-60b8-4185-b14d-a2667fd3b5b7] Received event network-vif-plugged-b4902494-07bb-48a3-b0f8-26115f2b04d6 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:26:28 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-d37acf26-0dfa-41d0-9b06-7f8503dac064 req-046a9097-735c-4176-b31f-6989f437a54a service nova] Acquiring lock "8aa35482-60b8-4185-b14d-a2667fd3b5b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:26:28 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-d37acf26-0dfa-41d0-9b06-7f8503dac064 req-046a9097-735c-4176-b31f-6989f437a54a service nova] Lock "8aa35482-60b8-4185-b14d-a2667fd3b5b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:26:28 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-d37acf26-0dfa-41d0-9b06-7f8503dac064 req-046a9097-735c-4176-b31f-6989f437a54a service nova] Lock "8aa35482-60b8-4185-b14d-a2667fd3b5b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:26:28 user nova-compute[72382]: DEBUG nova.compute.manager [req-d37acf26-0dfa-41d0-9b06-7f8503dac064 req-046a9097-735c-4176-b31f-6989f437a54a service nova] [instance: 8aa35482-60b8-4185-b14d-a2667fd3b5b7] No waiting events found dispatching network-vif-plugged-b4902494-07bb-48a3-b0f8-26115f2b04d6 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:26:28 user nova-compute[72382]: WARNING nova.compute.manager [req-d37acf26-0dfa-41d0-9b06-7f8503dac064 req-046a9097-735c-4176-b31f-6989f437a54a service nova] [instance: 8aa35482-60b8-4185-b14d-a2667fd3b5b7] Received unexpected event network-vif-plugged-b4902494-07bb-48a3-b0f8-26115f2b04d6 for instance with vm_state active and task_state deleting.
Aug 09 15:26:29 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:26:30 user nova-compute[72382]: DEBUG nova.network.neutron [None req-4eaa20a3-4b98-4fe3-bc02-1afcb3ac1bd1 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] [instance: 4ccbfda2-8bcd-4ec1-972a-cf49a62b1583] Successfully created port: 2d07e6a3-03b7-4035-bdd2-a95435b99852 {{(pid=72382) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 15:26:30 user nova-compute[72382]: DEBUG nova.network.neutron [-] [instance: 8aa35482-60b8-4185-b14d-a2667fd3b5b7] Updating instance_info_cache with network_info: [] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:26:30 user nova-compute[72382]: DEBUG nova.compute.manager [req-2e104f96-dfea-42a5-9df0-2bdb04b1ba96 req-9c5d1368-8c8e-44cb-b154-436c048ea3ff service nova] [instance: 8aa35482-60b8-4185-b14d-a2667fd3b5b7] Received event network-vif-deleted-b4902494-07bb-48a3-b0f8-26115f2b04d6 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:26:30 user nova-compute[72382]: INFO nova.compute.manager [req-2e104f96-dfea-42a5-9df0-2bdb04b1ba96 req-9c5d1368-8c8e-44cb-b154-436c048ea3ff service nova] [instance: 8aa35482-60b8-4185-b14d-a2667fd3b5b7] Neutron deleted interface b4902494-07bb-48a3-b0f8-26115f2b04d6; detaching it from the instance and deleting it from the info cache
Aug 09 15:26:30 user nova-compute[72382]: DEBUG nova.network.neutron [req-2e104f96-dfea-42a5-9df0-2bdb04b1ba96 req-9c5d1368-8c8e-44cb-b154-436c048ea3ff service nova] [instance: 8aa35482-60b8-4185-b14d-a2667fd3b5b7] Updating instance_info_cache with network_info: [] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:26:30 user nova-compute[72382]: INFO nova.compute.manager [-] [instance: 8aa35482-60b8-4185-b14d-a2667fd3b5b7] Took 3.77 seconds to deallocate network for instance.
Aug 09 15:26:30 user nova-compute[72382]: DEBUG nova.compute.manager [req-2e104f96-dfea-42a5-9df0-2bdb04b1ba96 req-9c5d1368-8c8e-44cb-b154-436c048ea3ff service nova] [instance: 8aa35482-60b8-4185-b14d-a2667fd3b5b7] Detach interface failed, port_id=b4902494-07bb-48a3-b0f8-26115f2b04d6, reason: Instance 8aa35482-60b8-4185-b14d-a2667fd3b5b7 could not be found. {{(pid=72382) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 09 15:26:30 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-a3b4b0dc-bd7b-4b71-8ac6-e53f0471c8af tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:26:30 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-a3b4b0dc-bd7b-4b71-8ac6-e53f0471c8af tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:26:31 user nova-compute[72382]: DEBUG nova.compute.provider_tree [None req-a3b4b0dc-bd7b-4b71-8ac6-e53f0471c8af tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] Inventory has not changed in ProviderTree for provider: 7b15b0e5-df4d-49db-833b-2855d21d10ae {{(pid=72382) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 15:26:31 user nova-compute[72382]: DEBUG nova.scheduler.client.report [None req-a3b4b0dc-bd7b-4b71-8ac6-e53f0471c8af tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] Inventory has not changed for provider 7b15b0e5-df4d-49db-833b-2855d21d10ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72382) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 15:26:31 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-a3b4b0dc-bd7b-4b71-8ac6-e53f0471c8af tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.567s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:26:31 user nova-compute[72382]: INFO nova.scheduler.client.report [None req-a3b4b0dc-bd7b-4b71-8ac6-e53f0471c8af tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] Deleted allocations for instance 8aa35482-60b8-4185-b14d-a2667fd3b5b7
Aug 09 15:26:31 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-a3b4b0dc-bd7b-4b71-8ac6-e53f0471c8af tempest-ServerStableDeviceRescueTest-1490271161 tempest-ServerStableDeviceRescueTest-1490271161-project-member] Lock "8aa35482-60b8-4185-b14d-a2667fd3b5b7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 5.683s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:26:31 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:26:32 user nova-compute[72382]: DEBUG nova.network.neutron [None req-4eaa20a3-4b98-4fe3-bc02-1afcb3ac1bd1 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] [instance: 4ccbfda2-8bcd-4ec1-972a-cf49a62b1583] Successfully updated port: 2d07e6a3-03b7-4035-bdd2-a95435b99852 {{(pid=72382) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 15:26:32 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-4eaa20a3-4b98-4fe3-bc02-1afcb3ac1bd1 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Acquiring lock "refresh_cache-4ccbfda2-8bcd-4ec1-972a-cf49a62b1583" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 15:26:32 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-4eaa20a3-4b98-4fe3-bc02-1afcb3ac1bd1 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Acquired lock "refresh_cache-4ccbfda2-8bcd-4ec1-972a-cf49a62b1583" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 15:26:32 user nova-compute[72382]: DEBUG nova.network.neutron [None req-4eaa20a3-4b98-4fe3-bc02-1afcb3ac1bd1 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] [instance: 4ccbfda2-8bcd-4ec1-972a-cf49a62b1583] Building network info cache for instance {{(pid=72382) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 15:26:32 user nova-compute[72382]: DEBUG nova.network.neutron [None req-4eaa20a3-4b98-4fe3-bc02-1afcb3ac1bd1 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] [instance: 4ccbfda2-8bcd-4ec1-972a-cf49a62b1583] Instance cache missing network info. {{(pid=72382) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 15:26:32 user nova-compute[72382]: DEBUG nova.network.neutron [None req-4eaa20a3-4b98-4fe3-bc02-1afcb3ac1bd1 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] [instance: 4ccbfda2-8bcd-4ec1-972a-cf49a62b1583] Updating instance_info_cache with network_info: [{"id": "2d07e6a3-03b7-4035-bdd2-a95435b99852", "address": "fa:16:3e:9a:d4:3a", "network": {"id": "308641dc-cc18-41db-9baa-7cc880e594ad", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1932973397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb5bf3f95d2843af94dbcab2af932bd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d07e6a3-03", "ovs_interfaceid": "2d07e6a3-03b7-4035-bdd2-a95435b99852", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:26:32 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-4eaa20a3-4b98-4fe3-bc02-1afcb3ac1bd1 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Releasing lock "refresh_cache-4ccbfda2-8bcd-4ec1-972a-cf49a62b1583" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 15:26:32 user nova-compute[72382]: DEBUG nova.compute.manager [None req-4eaa20a3-4b98-4fe3-bc02-1afcb3ac1bd1 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] [instance: 4ccbfda2-8bcd-4ec1-972a-cf49a62b1583] Instance network_info: |[{"id": "2d07e6a3-03b7-4035-bdd2-a95435b99852", "address": "fa:16:3e:9a:d4:3a", "network": {"id": "308641dc-cc18-41db-9baa-7cc880e594ad", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1932973397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb5bf3f95d2843af94dbcab2af932bd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d07e6a3-03", "ovs_interfaceid": "2d07e6a3-03b7-4035-bdd2-a95435b99852", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72382) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 15:26:32 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-4eaa20a3-4b98-4fe3-bc02-1afcb3ac1bd1 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] [instance: 4ccbfda2-8bcd-4ec1-972a-cf49a62b1583] Start _get_guest_xml network_info=[{"id": "2d07e6a3-03b7-4035-bdd2-a95435b99852", "address": "fa:16:3e:9a:d4:3a", "network": {"id": "308641dc-cc18-41db-9baa-7cc880e594ad", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1932973397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb5bf3f95d2843af94dbcab2af932bd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d07e6a3-03", "ovs_interfaceid": "2d07e6a3-03b7-4035-bdd2-a95435b99852", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T15:11:25Z,direct_url=<?>,disk_format='qcow2',id=a79f2cea-eb27-4631-aaf3-05e7d9e411b4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a638990e12cc4d6eabb6d55e13be6bdf',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T15:11:27Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'a79f2cea-eb27-4631-aaf3-05e7d9e411b4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72382) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 15:26:32 user nova-compute[72382]: WARNING nova.virt.libvirt.driver [None req-4eaa20a3-4b98-4fe3-bc02-1afcb3ac1bd1 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 15:26:32 user nova-compute[72382]: WARNING nova.virt.libvirt.driver [None req-4eaa20a3-4b98-4fe3-bc02-1afcb3ac1bd1 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 15:26:32 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-4eaa20a3-4b98-4fe3-bc02-1afcb3ac1bd1 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72382) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 15:26:32 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-4eaa20a3-4b98-4fe3-bc02-1afcb3ac1bd1 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] CPU controller missing on host. {{(pid=72382) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 15:26:32 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-4eaa20a3-4b98-4fe3-bc02-1afcb3ac1bd1 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72382) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 15:26:32 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-4eaa20a3-4b98-4fe3-bc02-1afcb3ac1bd1 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] CPU controller found on host. {{(pid=72382) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 15:26:32 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-4eaa20a3-4b98-4fe3-bc02-1afcb3ac1bd1 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72382) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 15:26:32 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-4eaa20a3-4b98-4fe3-bc02-1afcb3ac1bd1 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T15:11:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T15:11:25Z,direct_url=<?>,disk_format='qcow2',id=a79f2cea-eb27-4631-aaf3-05e7d9e411b4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a638990e12cc4d6eabb6d55e13be6bdf',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T15:11:27Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 15:26:32 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-4eaa20a3-4b98-4fe3-bc02-1afcb3ac1bd1 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Flavor limits 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 15:26:32 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-4eaa20a3-4b98-4fe3-bc02-1afcb3ac1bd1 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Image limits 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 15:26:32 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-4eaa20a3-4b98-4fe3-bc02-1afcb3ac1bd1 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Flavor pref 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 15:26:32 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-4eaa20a3-4b98-4fe3-bc02-1afcb3ac1bd1 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Image pref 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 15:26:32 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-4eaa20a3-4b98-4fe3-bc02-1afcb3ac1bd1 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 15:26:32 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-4eaa20a3-4b98-4fe3-bc02-1afcb3ac1bd1 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 15:26:32 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-4eaa20a3-4b98-4fe3-bc02-1afcb3ac1bd1 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72382) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 15:26:32 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-4eaa20a3-4b98-4fe3-bc02-1afcb3ac1bd1 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Got 1 possible topologies {{(pid=72382) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 15:26:32 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-4eaa20a3-4b98-4fe3-bc02-1afcb3ac1bd1 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 15:26:32 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-4eaa20a3-4b98-4fe3-bc02-1afcb3ac1bd1 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 15:26:32 user nova-compute[72382]: DEBUG nova.virt.libvirt.vif [None req-4eaa20a3-4b98-4fe3-bc02-1afcb3ac1bd1 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T15:26:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-726596602',display_name='tempest-ServerActionsTestOtherA-server-726596602',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-726596602',id=27,image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCmuVV1ynikE+pH75fjLIal2KFmSgV7eQmOTfU0+P2w2YCXfBWnAu9n1cQQTYYTDt/aP+JsGjkRdlSPqvnnG5WbnlJT+9aj9SfyqprOo87kqF8CD2U4mVDTvv+6ADzXJvQ==',key_name='tempest-keypair-568328368',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='eb5bf3f95d2843af94dbcab2af932bd1',ramdisk_id='',reservation_id='r-169g26o6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1899577274',owner_user_name='tempest-ServerActionsTestOtherA-1899577274-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T15:26:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2cca9aef887b4b91a46ff4bd5cd32302',uuid=4ccbfda2-8bcd-4ec1-972a-cf49a62b1583,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2d07e6a3-03b7-4035-bdd2-a95435b99852", "address": "fa:16:3e:9a:d4:3a", "network": {"id": "308641dc-cc18-41db-9baa-7cc880e594ad", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1932973397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb5bf3f95d2843af94dbcab2af932bd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d07e6a3-03", "ovs_interfaceid": "2d07e6a3-03b7-4035-bdd2-a95435b99852", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72382) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 15:26:32 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-4eaa20a3-4b98-4fe3-bc02-1afcb3ac1bd1 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Converting VIF {"id": "2d07e6a3-03b7-4035-bdd2-a95435b99852", "address": "fa:16:3e:9a:d4:3a", "network": {"id": "308641dc-cc18-41db-9baa-7cc880e594ad", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1932973397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb5bf3f95d2843af94dbcab2af932bd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d07e6a3-03", "ovs_interfaceid": "2d07e6a3-03b7-4035-bdd2-a95435b99852", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 15:26:32 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-4eaa20a3-4b98-4fe3-bc02-1afcb3ac1bd1 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9a:d4:3a,bridge_name='br-int',has_traffic_filtering=True,id=2d07e6a3-03b7-4035-bdd2-a95435b99852,network=Network(308641dc-cc18-41db-9baa-7cc880e594ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d07e6a3-03') {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 15:26:32 user nova-compute[72382]: DEBUG nova.objects.instance [None req-4eaa20a3-4b98-4fe3-bc02-1afcb3ac1bd1 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Lazy-loading 'pci_devices' on Instance uuid 4ccbfda2-8bcd-4ec1-972a-cf49a62b1583 {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:26:32 user nova-compute[72382]: DEBUG nova.compute.manager [req-4bee2256-3323-47fc-9e46-2ac277fa4a3a req-f149cbe9-f4ee-40f8-b937-3bb8850a53c6 service nova] [instance: 4ccbfda2-8bcd-4ec1-972a-cf49a62b1583] Received event network-changed-2d07e6a3-03b7-4035-bdd2-a95435b99852 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:26:32 user nova-compute[72382]: DEBUG nova.compute.manager [req-4bee2256-3323-47fc-9e46-2ac277fa4a3a req-f149cbe9-f4ee-40f8-b937-3bb8850a53c6 service nova] [instance: 4ccbfda2-8bcd-4ec1-972a-cf49a62b1583] Refreshing instance network info cache due to event network-changed-2d07e6a3-03b7-4035-bdd2-a95435b99852. {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 15:26:32 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-4bee2256-3323-47fc-9e46-2ac277fa4a3a req-f149cbe9-f4ee-40f8-b937-3bb8850a53c6 service nova] Acquiring lock "refresh_cache-4ccbfda2-8bcd-4ec1-972a-cf49a62b1583" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 15:26:32 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-4bee2256-3323-47fc-9e46-2ac277fa4a3a req-f149cbe9-f4ee-40f8-b937-3bb8850a53c6 service nova] Acquired lock "refresh_cache-4ccbfda2-8bcd-4ec1-972a-cf49a62b1583" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 15:26:32 user nova-compute[72382]: DEBUG nova.network.neutron [req-4bee2256-3323-47fc-9e46-2ac277fa4a3a req-f149cbe9-f4ee-40f8-b937-3bb8850a53c6 service nova] [instance: 4ccbfda2-8bcd-4ec1-972a-cf49a62b1583] Refreshing network info cache for port 2d07e6a3-03b7-4035-bdd2-a95435b99852 {{(pid=72382) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 15:26:32 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-4eaa20a3-4b98-4fe3-bc02-1afcb3ac1bd1 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] [instance: 4ccbfda2-8bcd-4ec1-972a-cf49a62b1583] End _get_guest_xml xml=<domain type="kvm">
Aug 09 15:26:32 user nova-compute[72382]:   <uuid>4ccbfda2-8bcd-4ec1-972a-cf49a62b1583</uuid>
Aug 09 15:26:32 user nova-compute[72382]:   <name>instance-0000001b</name>
Aug 09 15:26:32 user nova-compute[72382]:   <memory>524288</memory>
Aug 09 15:26:32 user nova-compute[72382]:   <vcpu>1</vcpu>
Aug 09 15:26:32 user nova-compute[72382]:   <metadata>
Aug 09 15:26:32 user nova-compute[72382]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 15:26:32 user nova-compute[72382]:       <nova:package version="0.0.0"/>
Aug 09 15:26:32 user nova-compute[72382]:       <nova:name>tempest-ServerActionsTestOtherA-server-726596602</nova:name>
Aug 09 15:26:32 user nova-compute[72382]:       <nova:creationTime>2023-08-09 15:26:32</nova:creationTime>
Aug 09 15:26:32 user nova-compute[72382]:       <nova:flavor name="m1.tiny">
Aug 09 15:26:32 user nova-compute[72382]:         <nova:memory>512</nova:memory>
Aug 09 15:26:32 user nova-compute[72382]:         <nova:disk>1</nova:disk>
Aug 09 15:26:32 user nova-compute[72382]:         <nova:swap>0</nova:swap>
Aug 09 15:26:32 user nova-compute[72382]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 15:26:32 user nova-compute[72382]:         <nova:vcpus>1</nova:vcpus>
Aug 09 15:26:32 user nova-compute[72382]:       </nova:flavor>
Aug 09 15:26:32 user nova-compute[72382]:       <nova:owner>
Aug 09 15:26:32 user nova-compute[72382]:         <nova:user uuid="2cca9aef887b4b91a46ff4bd5cd32302">tempest-ServerActionsTestOtherA-1899577274-project-member</nova:user>
Aug 09 15:26:32 user nova-compute[72382]:         <nova:project uuid="eb5bf3f95d2843af94dbcab2af932bd1">tempest-ServerActionsTestOtherA-1899577274</nova:project>
Aug 09 15:26:32 user nova-compute[72382]:       </nova:owner>
Aug 09 15:26:32 user nova-compute[72382]:       <nova:root type="image" uuid="a79f2cea-eb27-4631-aaf3-05e7d9e411b4"/>
Aug 09 15:26:32 user nova-compute[72382]:       <nova:ports>
Aug 09 15:26:32 user nova-compute[72382]:         <nova:port uuid="2d07e6a3-03b7-4035-bdd2-a95435b99852">
Aug 09 15:26:32 user nova-compute[72382]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 09 15:26:32 user nova-compute[72382]:         </nova:port>
Aug 09 15:26:32 user nova-compute[72382]:       </nova:ports>
Aug 09 15:26:32 user nova-compute[72382]:     </nova:instance>
Aug 09 15:26:32 user nova-compute[72382]:   </metadata>
Aug 09 15:26:32 user nova-compute[72382]:   <sysinfo type="smbios">
Aug 09 15:26:32 user nova-compute[72382]:     <system>
Aug 09 15:26:32 user nova-compute[72382]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 15:26:32 user nova-compute[72382]:       <entry name="product">OpenStack Nova</entry>
Aug 09 15:26:32 user nova-compute[72382]:       <entry name="version">0.0.0</entry>
Aug 09 15:26:32 user nova-compute[72382]:       <entry name="serial">4ccbfda2-8bcd-4ec1-972a-cf49a62b1583</entry>
Aug 09 15:26:32 user nova-compute[72382]:       <entry name="uuid">4ccbfda2-8bcd-4ec1-972a-cf49a62b1583</entry>
Aug 09 15:26:32 user nova-compute[72382]:       <entry name="family">Virtual Machine</entry>
Aug 09 15:26:32 user nova-compute[72382]:     </system>
Aug 09 15:26:32 user nova-compute[72382]:   </sysinfo>
Aug 09 15:26:32 user nova-compute[72382]:   <os>
Aug 09 15:26:32 user nova-compute[72382]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 15:26:32 user nova-compute[72382]:     <boot dev="hd"/>
Aug 09 15:26:32 user nova-compute[72382]:     <smbios mode="sysinfo"/>
Aug 09 15:26:32 user nova-compute[72382]:   </os>
Aug 09 15:26:32 user nova-compute[72382]:   <features>
Aug 09 15:26:32 user nova-compute[72382]:     <acpi/>
Aug 09 15:26:32 user nova-compute[72382]:     <apic/>
Aug 09 15:26:32 user nova-compute[72382]:     <vmcoreinfo/>
Aug 09 15:26:32 user nova-compute[72382]:   </features>
Aug 09 15:26:32 user nova-compute[72382]:   <clock offset="utc">
Aug 09 15:26:32 user nova-compute[72382]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 15:26:32 user nova-compute[72382]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 15:26:32 user nova-compute[72382]:     <timer name="hpet" present="no"/>
Aug 09 15:26:32 user nova-compute[72382]:   </clock>
Aug 09 15:26:32 user nova-compute[72382]:   <cpu mode="custom" match="exact">
Aug 09 15:26:32 user nova-compute[72382]:     <model>Nehalem</model>
Aug 09 15:26:32 user nova-compute[72382]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 15:26:32 user nova-compute[72382]:   </cpu>
Aug 09 15:26:32 user nova-compute[72382]:   <devices>
Aug 09 15:26:32 user nova-compute[72382]:     <disk type="file" device="disk">
Aug 09 15:26:32 user nova-compute[72382]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 15:26:32 user nova-compute[72382]:       <source file="/opt/stack/data/nova/instances/4ccbfda2-8bcd-4ec1-972a-cf49a62b1583/disk"/>
Aug 09 15:26:32 user nova-compute[72382]:       <target dev="vda" bus="virtio"/>
Aug 09 15:26:32 user nova-compute[72382]:     </disk>
Aug 09 15:26:32 user nova-compute[72382]:     <interface type="ethernet">
Aug 09 15:26:32 user nova-compute[72382]:       <mac address="fa:16:3e:9a:d4:3a"/>
Aug 09 15:26:32 user nova-compute[72382]:       <model type="virtio"/>
Aug 09 15:26:32 user nova-compute[72382]:       <mtu size="1442"/>
Aug 09 15:26:32 user nova-compute[72382]:       <target dev="tap2d07e6a3-03"/>
Aug 09 15:26:32 user nova-compute[72382]:     </interface>
Aug 09 15:26:32 user nova-compute[72382]:     <serial type="pty">
Aug 09 15:26:32 user nova-compute[72382]:       <log file="/opt/stack/data/nova/instances/4ccbfda2-8bcd-4ec1-972a-cf49a62b1583/console.log" append="off"/>
Aug 09 15:26:32 user nova-compute[72382]:     </serial>
Aug 09 15:26:32 user nova-compute[72382]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 15:26:32 user nova-compute[72382]:     <video>
Aug 09 15:26:32 user nova-compute[72382]:       <model type="virtio"/>
Aug 09 15:26:32 user nova-compute[72382]:     </video>
Aug 09 15:26:32 user nova-compute[72382]:     <rng model="virtio">
Aug 09 15:26:32 user nova-compute[72382]:       <backend model="random">/dev/urandom</backend>
Aug 09 15:26:32 user nova-compute[72382]:     </rng>
Aug 09 15:26:32 user nova-compute[72382]:     <controller type="usb" index="0" model="none"/>
Aug 09 15:26:32 user nova-compute[72382]:     <memballoon model="virtio">
Aug 09 15:26:32 user nova-compute[72382]:       <stats period="10"/>
Aug 09 15:26:32 user nova-compute[72382]:     </memballoon>
Aug 09 15:26:32 user nova-compute[72382]:   </devices>
Aug 09 15:26:32 user nova-compute[72382]: </domain>
Aug 09 15:26:32 user nova-compute[72382]:  {{(pid=72382) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 15:26:32 user nova-compute[72382]: DEBUG nova.virt.libvirt.vif [None req-4eaa20a3-4b98-4fe3-bc02-1afcb3ac1bd1 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T15:26:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-726596602',display_name='tempest-ServerActionsTestOtherA-server-726596602',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-726596602',id=27,image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCmuVV1ynikE+pH75fjLIal2KFmSgV7eQmOTfU0+P2w2YCXfBWnAu9n1cQQTYYTDt/aP+JsGjkRdlSPqvnnG5WbnlJT+9aj9SfyqprOo87kqF8CD2U4mVDTvv+6ADzXJvQ==',key_name='tempest-keypair-568328368',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='eb5bf3f95d2843af94dbcab2af932bd1',ramdisk_id='',reservation_id='r-169g26o6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1899577274',owner_user_name='tempest-ServerActionsTestOtherA-1899577274-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T15:26:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2cca9aef887b4b91a46ff4bd5cd32302',uuid=4ccbfda2-8bcd-4ec1-972a-cf49a62b1583,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2d07e6a3-03b7-4035-bdd2-a95435b99852", "address": "fa:16:3e:9a:d4:3a", "network": {"id": "308641dc-cc18-41db-9baa-7cc880e594ad", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1932973397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb5bf3f95d2843af94dbcab2af932bd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d07e6a3-03", "ovs_interfaceid": "2d07e6a3-03b7-4035-bdd2-a95435b99852", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 15:26:32 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-4eaa20a3-4b98-4fe3-bc02-1afcb3ac1bd1 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Converting VIF {"id": "2d07e6a3-03b7-4035-bdd2-a95435b99852", "address": "fa:16:3e:9a:d4:3a", "network": {"id": "308641dc-cc18-41db-9baa-7cc880e594ad", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1932973397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb5bf3f95d2843af94dbcab2af932bd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d07e6a3-03", "ovs_interfaceid": "2d07e6a3-03b7-4035-bdd2-a95435b99852", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 15:26:32 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-4eaa20a3-4b98-4fe3-bc02-1afcb3ac1bd1 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9a:d4:3a,bridge_name='br-int',has_traffic_filtering=True,id=2d07e6a3-03b7-4035-bdd2-a95435b99852,network=Network(308641dc-cc18-41db-9baa-7cc880e594ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d07e6a3-03') {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 15:26:32 user nova-compute[72382]: DEBUG os_vif [None req-4eaa20a3-4b98-4fe3-bc02-1afcb3ac1bd1 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:d4:3a,bridge_name='br-int',has_traffic_filtering=True,id=2d07e6a3-03b7-4035-bdd2-a95435b99852,network=Network(308641dc-cc18-41db-9baa-7cc880e594ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d07e6a3-03') {{(pid=72382) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 15:26:32 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:26:32 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:26:32 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 15:26:32 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:26:32 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2d07e6a3-03, may_exist=True, interface_attrs={}) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:26:32 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2d07e6a3-03, col_values=(('external_ids', {'iface-id': '2d07e6a3-03b7-4035-bdd2-a95435b99852', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9a:d4:3a', 'vm-uuid': '4ccbfda2-8bcd-4ec1-972a-cf49a62b1583'}),), if_exists=True) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:26:32 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:26:32 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:26:32 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:26:32 user nova-compute[72382]: INFO os_vif [None req-4eaa20a3-4b98-4fe3-bc02-1afcb3ac1bd1 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:d4:3a,bridge_name='br-int',has_traffic_filtering=True,id=2d07e6a3-03b7-4035-bdd2-a95435b99852,network=Network(308641dc-cc18-41db-9baa-7cc880e594ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d07e6a3-03')
Aug 09 15:26:32 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-4eaa20a3-4b98-4fe3-bc02-1afcb3ac1bd1 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] No BDM found with device name vda, not building metadata. {{(pid=72382) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 15:26:32 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-4eaa20a3-4b98-4fe3-bc02-1afcb3ac1bd1 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] No VIF found with MAC fa:16:3e:9a:d4:3a, not building metadata {{(pid=72382) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 15:26:33 user nova-compute[72382]: DEBUG nova.network.neutron [req-4bee2256-3323-47fc-9e46-2ac277fa4a3a req-f149cbe9-f4ee-40f8-b937-3bb8850a53c6 service nova] [instance: 4ccbfda2-8bcd-4ec1-972a-cf49a62b1583] Updated VIF entry in instance network info cache for port 2d07e6a3-03b7-4035-bdd2-a95435b99852. {{(pid=72382) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 15:26:33 user nova-compute[72382]: DEBUG nova.network.neutron [req-4bee2256-3323-47fc-9e46-2ac277fa4a3a req-f149cbe9-f4ee-40f8-b937-3bb8850a53c6 service nova] [instance: 4ccbfda2-8bcd-4ec1-972a-cf49a62b1583] Updating instance_info_cache with network_info: [{"id": "2d07e6a3-03b7-4035-bdd2-a95435b99852", "address": "fa:16:3e:9a:d4:3a", "network": {"id": "308641dc-cc18-41db-9baa-7cc880e594ad", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1932973397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb5bf3f95d2843af94dbcab2af932bd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d07e6a3-03", "ovs_interfaceid": "2d07e6a3-03b7-4035-bdd2-a95435b99852", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:26:33 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-4bee2256-3323-47fc-9e46-2ac277fa4a3a req-f149cbe9-f4ee-40f8-b937-3bb8850a53c6 service nova] Releasing lock "refresh_cache-4ccbfda2-8bcd-4ec1-972a-cf49a62b1583" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 15:26:34 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:26:34 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:26:34 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:26:34 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:26:34 user nova-compute[72382]: DEBUG nova.compute.manager [req-3f4187d8-2257-494b-a6d8-4f97b8e1558e req-62e346c4-f2eb-444c-81b1-ce78638906f3 service nova] [instance: 4ccbfda2-8bcd-4ec1-972a-cf49a62b1583] Received event network-vif-plugged-2d07e6a3-03b7-4035-bdd2-a95435b99852 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:26:34 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-3f4187d8-2257-494b-a6d8-4f97b8e1558e req-62e346c4-f2eb-444c-81b1-ce78638906f3 service nova] Acquiring lock "4ccbfda2-8bcd-4ec1-972a-cf49a62b1583-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:26:34 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-3f4187d8-2257-494b-a6d8-4f97b8e1558e req-62e346c4-f2eb-444c-81b1-ce78638906f3 service nova] Lock "4ccbfda2-8bcd-4ec1-972a-cf49a62b1583-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:26:34 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-3f4187d8-2257-494b-a6d8-4f97b8e1558e req-62e346c4-f2eb-444c-81b1-ce78638906f3 service nova] Lock "4ccbfda2-8bcd-4ec1-972a-cf49a62b1583-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:26:34 user nova-compute[72382]: DEBUG nova.compute.manager [req-3f4187d8-2257-494b-a6d8-4f97b8e1558e req-62e346c4-f2eb-444c-81b1-ce78638906f3 service nova] [instance: 4ccbfda2-8bcd-4ec1-972a-cf49a62b1583] No waiting events found dispatching network-vif-plugged-2d07e6a3-03b7-4035-bdd2-a95435b99852 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:26:34 user nova-compute[72382]: WARNING nova.compute.manager [req-3f4187d8-2257-494b-a6d8-4f97b8e1558e req-62e346c4-f2eb-444c-81b1-ce78638906f3 service nova] [instance: 4ccbfda2-8bcd-4ec1-972a-cf49a62b1583] Received unexpected event network-vif-plugged-2d07e6a3-03b7-4035-bdd2-a95435b99852 for instance with vm_state building and task_state spawning.
Aug 09 15:26:34 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:26:34 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:26:36 user nova-compute[72382]: DEBUG nova.virt.driver [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Emitting event <LifecycleEvent: 1691594796.4449153, 4ccbfda2-8bcd-4ec1-972a-cf49a62b1583 => Resumed> {{(pid=72382) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 15:26:36 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 4ccbfda2-8bcd-4ec1-972a-cf49a62b1583] VM Resumed (Lifecycle Event)
Aug 09 15:26:36 user nova-compute[72382]: DEBUG nova.compute.manager [None req-4eaa20a3-4b98-4fe3-bc02-1afcb3ac1bd1 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] [instance: 4ccbfda2-8bcd-4ec1-972a-cf49a62b1583] Instance event wait completed in 0 seconds for  {{(pid=72382) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 15:26:36 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-4eaa20a3-4b98-4fe3-bc02-1afcb3ac1bd1 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] [instance: 4ccbfda2-8bcd-4ec1-972a-cf49a62b1583] Guest created on hypervisor {{(pid=72382) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 15:26:36 user nova-compute[72382]: INFO nova.virt.libvirt.driver [-] [instance: 4ccbfda2-8bcd-4ec1-972a-cf49a62b1583] Instance spawned successfully.
Aug 09 15:26:36 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-4eaa20a3-4b98-4fe3-bc02-1afcb3ac1bd1 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] [instance: 4ccbfda2-8bcd-4ec1-972a-cf49a62b1583] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 15:26:36 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 4ccbfda2-8bcd-4ec1-972a-cf49a62b1583] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:26:36 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 4ccbfda2-8bcd-4ec1-972a-cf49a62b1583] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72382) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 15:26:36 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-4eaa20a3-4b98-4fe3-bc02-1afcb3ac1bd1 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] [instance: 4ccbfda2-8bcd-4ec1-972a-cf49a62b1583] Found default for hw_cdrom_bus of ide {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:26:36 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-4eaa20a3-4b98-4fe3-bc02-1afcb3ac1bd1 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] [instance: 4ccbfda2-8bcd-4ec1-972a-cf49a62b1583] Found default for hw_disk_bus of virtio {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:26:36 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-4eaa20a3-4b98-4fe3-bc02-1afcb3ac1bd1 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] [instance: 4ccbfda2-8bcd-4ec1-972a-cf49a62b1583] Found default for hw_input_bus of None {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:26:36 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-4eaa20a3-4b98-4fe3-bc02-1afcb3ac1bd1 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] [instance: 4ccbfda2-8bcd-4ec1-972a-cf49a62b1583] Found default for hw_pointer_model of None {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:26:36 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-4eaa20a3-4b98-4fe3-bc02-1afcb3ac1bd1 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] [instance: 4ccbfda2-8bcd-4ec1-972a-cf49a62b1583] Found default for hw_video_model of virtio {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:26:36 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-4eaa20a3-4b98-4fe3-bc02-1afcb3ac1bd1 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] [instance: 4ccbfda2-8bcd-4ec1-972a-cf49a62b1583] Found default for hw_vif_model of virtio {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:26:36 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 4ccbfda2-8bcd-4ec1-972a-cf49a62b1583] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 15:26:36 user nova-compute[72382]: DEBUG nova.virt.driver [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Emitting event <LifecycleEvent: 1691594796.4490821, 4ccbfda2-8bcd-4ec1-972a-cf49a62b1583 => Started> {{(pid=72382) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 15:26:36 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 4ccbfda2-8bcd-4ec1-972a-cf49a62b1583] VM Started (Lifecycle Event)
Aug 09 15:26:36 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 4ccbfda2-8bcd-4ec1-972a-cf49a62b1583] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:26:36 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 4ccbfda2-8bcd-4ec1-972a-cf49a62b1583] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72382) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 15:26:36 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 4ccbfda2-8bcd-4ec1-972a-cf49a62b1583] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 15:26:36 user nova-compute[72382]: INFO nova.compute.manager [None req-4eaa20a3-4b98-4fe3-bc02-1afcb3ac1bd1 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] [instance: 4ccbfda2-8bcd-4ec1-972a-cf49a62b1583] Took 9.93 seconds to spawn the instance on the hypervisor.
Aug 09 15:26:36 user nova-compute[72382]: DEBUG nova.compute.manager [None req-4eaa20a3-4b98-4fe3-bc02-1afcb3ac1bd1 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] [instance: 4ccbfda2-8bcd-4ec1-972a-cf49a62b1583] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:26:36 user nova-compute[72382]: INFO nova.compute.manager [None req-4eaa20a3-4b98-4fe3-bc02-1afcb3ac1bd1 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] [instance: 4ccbfda2-8bcd-4ec1-972a-cf49a62b1583] Took 11.04 seconds to build instance.
Aug 09 15:26:36 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-4eaa20a3-4b98-4fe3-bc02-1afcb3ac1bd1 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Lock "4ccbfda2-8bcd-4ec1-972a-cf49a62b1583" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.199s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:26:36 user nova-compute[72382]: DEBUG nova.compute.manager [req-6ed9afd2-3d22-405f-9b42-9b791cea18c0 req-129733c0-4b05-4995-a03a-aa1bd5a6a7a6 service nova] [instance: 4ccbfda2-8bcd-4ec1-972a-cf49a62b1583] Received event network-vif-plugged-2d07e6a3-03b7-4035-bdd2-a95435b99852 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:26:36 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-6ed9afd2-3d22-405f-9b42-9b791cea18c0 req-129733c0-4b05-4995-a03a-aa1bd5a6a7a6 service nova] Acquiring lock "4ccbfda2-8bcd-4ec1-972a-cf49a62b1583-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:26:36 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-6ed9afd2-3d22-405f-9b42-9b791cea18c0 req-129733c0-4b05-4995-a03a-aa1bd5a6a7a6 service nova] Lock "4ccbfda2-8bcd-4ec1-972a-cf49a62b1583-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:26:36 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-6ed9afd2-3d22-405f-9b42-9b791cea18c0 req-129733c0-4b05-4995-a03a-aa1bd5a6a7a6 service nova] Lock "4ccbfda2-8bcd-4ec1-972a-cf49a62b1583-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:26:36 user nova-compute[72382]: DEBUG nova.compute.manager [req-6ed9afd2-3d22-405f-9b42-9b791cea18c0 req-129733c0-4b05-4995-a03a-aa1bd5a6a7a6 service nova] [instance: 4ccbfda2-8bcd-4ec1-972a-cf49a62b1583] No waiting events found dispatching network-vif-plugged-2d07e6a3-03b7-4035-bdd2-a95435b99852 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:26:36 user nova-compute[72382]: WARNING nova.compute.manager [req-6ed9afd2-3d22-405f-9b42-9b791cea18c0 req-129733c0-4b05-4995-a03a-aa1bd5a6a7a6 service nova] [instance: 4ccbfda2-8bcd-4ec1-972a-cf49a62b1583] Received unexpected event network-vif-plugged-2d07e6a3-03b7-4035-bdd2-a95435b99852 for instance with vm_state active and task_state None.
Aug 09 15:26:37 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:26:39 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:26:41 user nova-compute[72382]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691594786.6300151, 8aa35482-60b8-4185-b14d-a2667fd3b5b7 => Stopped> {{(pid=72382) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 15:26:41 user nova-compute[72382]: INFO nova.compute.manager [-] [instance: 8aa35482-60b8-4185-b14d-a2667fd3b5b7] VM Stopped (Lifecycle Event)
Aug 09 15:26:41 user nova-compute[72382]: DEBUG nova.compute.manager [None req-1e294ada-1c3d-4ae2-86f7-b1ca6d47996c None None] [instance: 8aa35482-60b8-4185-b14d-a2667fd3b5b7] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:26:42 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:26:44 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:26:45 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-5a02efe0-8485-4d22-bd41-1d55e3f6a486 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Acquiring lock "2f430d9a-9fbf-43cd-8c0d-e5dec162be71" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:26:45 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-5a02efe0-8485-4d22-bd41-1d55e3f6a486 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Lock "2f430d9a-9fbf-43cd-8c0d-e5dec162be71" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:26:45 user nova-compute[72382]: DEBUG nova.compute.manager [None req-5a02efe0-8485-4d22-bd41-1d55e3f6a486 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] [instance: 2f430d9a-9fbf-43cd-8c0d-e5dec162be71] Starting instance... {{(pid=72382) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 15:26:45 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-5a02efe0-8485-4d22-bd41-1d55e3f6a486 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:26:45 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-5a02efe0-8485-4d22-bd41-1d55e3f6a486 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:26:45 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-5a02efe0-8485-4d22-bd41-1d55e3f6a486 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72382) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 15:26:45 user nova-compute[72382]: INFO nova.compute.claims [None req-5a02efe0-8485-4d22-bd41-1d55e3f6a486 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] [instance: 2f430d9a-9fbf-43cd-8c0d-e5dec162be71] Claim successful on node user
Aug 09 15:26:45 user nova-compute[72382]: DEBUG nova.compute.provider_tree [None req-5a02efe0-8485-4d22-bd41-1d55e3f6a486 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Inventory has not changed in ProviderTree for provider: 7b15b0e5-df4d-49db-833b-2855d21d10ae {{(pid=72382) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 15:26:45 user nova-compute[72382]: DEBUG nova.scheduler.client.report [None req-5a02efe0-8485-4d22-bd41-1d55e3f6a486 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Inventory has not changed for provider 7b15b0e5-df4d-49db-833b-2855d21d10ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72382) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 15:26:45 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-5a02efe0-8485-4d22-bd41-1d55e3f6a486 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.493s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:26:45 user nova-compute[72382]: DEBUG nova.compute.manager [None req-5a02efe0-8485-4d22-bd41-1d55e3f6a486 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] [instance: 2f430d9a-9fbf-43cd-8c0d-e5dec162be71] Start building networks asynchronously for instance. {{(pid=72382) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 15:26:45 user nova-compute[72382]: DEBUG nova.compute.manager [None req-5a02efe0-8485-4d22-bd41-1d55e3f6a486 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] [instance: 2f430d9a-9fbf-43cd-8c0d-e5dec162be71] Allocating IP information in the background. {{(pid=72382) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 15:26:45 user nova-compute[72382]: DEBUG nova.network.neutron [None req-5a02efe0-8485-4d22-bd41-1d55e3f6a486 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] [instance: 2f430d9a-9fbf-43cd-8c0d-e5dec162be71] allocate_for_instance() {{(pid=72382) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 15:26:45 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-5a02efe0-8485-4d22-bd41-1d55e3f6a486 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] [instance: 2f430d9a-9fbf-43cd-8c0d-e5dec162be71] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 15:26:45 user nova-compute[72382]: DEBUG nova.compute.manager [None req-5a02efe0-8485-4d22-bd41-1d55e3f6a486 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] [instance: 2f430d9a-9fbf-43cd-8c0d-e5dec162be71] Start building block device mappings for instance. {{(pid=72382) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 15:26:45 user nova-compute[72382]: DEBUG nova.policy [None req-5a02efe0-8485-4d22-bd41-1d55e3f6a486 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e71af7a4912147cd9fab070cb77b275c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080d1ded4cd94e5083ee0b7e691b7363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72382) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 15:26:45 user nova-compute[72382]: INFO nova.virt.block_device [None req-5a02efe0-8485-4d22-bd41-1d55e3f6a486 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] [instance: 2f430d9a-9fbf-43cd-8c0d-e5dec162be71] Booting with volume-backed-image a79f2cea-eb27-4631-aaf3-05e7d9e411b4 at /dev/vda
Aug 09 15:26:46 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:26:46 user nova-compute[72382]: DEBUG nova.network.neutron [None req-5a02efe0-8485-4d22-bd41-1d55e3f6a486 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] [instance: 2f430d9a-9fbf-43cd-8c0d-e5dec162be71] Successfully created port: d13c4d4e-9004-4d4b-999d-619564a98542 {{(pid=72382) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 15:26:47 user nova-compute[72382]: DEBUG nova.network.neutron [None req-5a02efe0-8485-4d22-bd41-1d55e3f6a486 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] [instance: 2f430d9a-9fbf-43cd-8c0d-e5dec162be71] Successfully updated port: d13c4d4e-9004-4d4b-999d-619564a98542 {{(pid=72382) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 15:26:47 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-5a02efe0-8485-4d22-bd41-1d55e3f6a486 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Acquiring lock "refresh_cache-2f430d9a-9fbf-43cd-8c0d-e5dec162be71" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 15:26:47 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-5a02efe0-8485-4d22-bd41-1d55e3f6a486 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Acquired lock "refresh_cache-2f430d9a-9fbf-43cd-8c0d-e5dec162be71" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 15:26:47 user nova-compute[72382]: DEBUG nova.network.neutron [None req-5a02efe0-8485-4d22-bd41-1d55e3f6a486 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] [instance: 2f430d9a-9fbf-43cd-8c0d-e5dec162be71] Building network info cache for instance {{(pid=72382) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 15:26:47 user nova-compute[72382]: DEBUG nova.compute.manager [req-46533e83-d647-41c6-80a5-d81e52958b8e req-a9f25649-506f-499b-a0b5-af72aab538c1 service nova] [instance: 2f430d9a-9fbf-43cd-8c0d-e5dec162be71] Received event network-changed-d13c4d4e-9004-4d4b-999d-619564a98542 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:26:47 user nova-compute[72382]: DEBUG nova.compute.manager [req-46533e83-d647-41c6-80a5-d81e52958b8e req-a9f25649-506f-499b-a0b5-af72aab538c1 service nova] [instance: 2f430d9a-9fbf-43cd-8c0d-e5dec162be71] Refreshing instance network info cache due to event network-changed-d13c4d4e-9004-4d4b-999d-619564a98542. {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 15:26:47 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-46533e83-d647-41c6-80a5-d81e52958b8e req-a9f25649-506f-499b-a0b5-af72aab538c1 service nova] Acquiring lock "refresh_cache-2f430d9a-9fbf-43cd-8c0d-e5dec162be71" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 15:26:47 user nova-compute[72382]: DEBUG nova.network.neutron [None req-5a02efe0-8485-4d22-bd41-1d55e3f6a486 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] [instance: 2f430d9a-9fbf-43cd-8c0d-e5dec162be71] Instance cache missing network info. {{(pid=72382) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 15:26:47 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:26:47 user nova-compute[72382]: DEBUG nova.network.neutron [None req-5a02efe0-8485-4d22-bd41-1d55e3f6a486 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] [instance: 2f430d9a-9fbf-43cd-8c0d-e5dec162be71] Updating instance_info_cache with network_info: [{"id": "d13c4d4e-9004-4d4b-999d-619564a98542", "address": "fa:16:3e:10:88:6e", "network": {"id": "d47e3749-fdff-4112-bd72-69ca584efe1f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-302967634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "080d1ded4cd94e5083ee0b7e691b7363", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd13c4d4e-90", "ovs_interfaceid": "d13c4d4e-9004-4d4b-999d-619564a98542", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:26:47 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-5a02efe0-8485-4d22-bd41-1d55e3f6a486 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Releasing lock "refresh_cache-2f430d9a-9fbf-43cd-8c0d-e5dec162be71" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 15:26:47 user nova-compute[72382]: DEBUG nova.compute.manager [None req-5a02efe0-8485-4d22-bd41-1d55e3f6a486 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] [instance: 2f430d9a-9fbf-43cd-8c0d-e5dec162be71] Instance network_info: |[{"id": "d13c4d4e-9004-4d4b-999d-619564a98542", "address": "fa:16:3e:10:88:6e", "network": {"id": "d47e3749-fdff-4112-bd72-69ca584efe1f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-302967634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "080d1ded4cd94e5083ee0b7e691b7363", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd13c4d4e-90", "ovs_interfaceid": "d13c4d4e-9004-4d4b-999d-619564a98542", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72382) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 15:26:47 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-46533e83-d647-41c6-80a5-d81e52958b8e req-a9f25649-506f-499b-a0b5-af72aab538c1 service nova] Acquired lock "refresh_cache-2f430d9a-9fbf-43cd-8c0d-e5dec162be71" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 15:26:47 user nova-compute[72382]: DEBUG nova.network.neutron [req-46533e83-d647-41c6-80a5-d81e52958b8e req-a9f25649-506f-499b-a0b5-af72aab538c1 service nova] [instance: 2f430d9a-9fbf-43cd-8c0d-e5dec162be71] Refreshing network info cache for port d13c4d4e-9004-4d4b-999d-619564a98542 {{(pid=72382) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 15:26:48 user nova-compute[72382]: DEBUG nova.network.neutron [req-46533e83-d647-41c6-80a5-d81e52958b8e req-a9f25649-506f-499b-a0b5-af72aab538c1 service nova] [instance: 2f430d9a-9fbf-43cd-8c0d-e5dec162be71] Updated VIF entry in instance network info cache for port d13c4d4e-9004-4d4b-999d-619564a98542. {{(pid=72382) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 15:26:48 user nova-compute[72382]: DEBUG nova.network.neutron [req-46533e83-d647-41c6-80a5-d81e52958b8e req-a9f25649-506f-499b-a0b5-af72aab538c1 service nova] [instance: 2f430d9a-9fbf-43cd-8c0d-e5dec162be71] Updating instance_info_cache with network_info: [{"id": "d13c4d4e-9004-4d4b-999d-619564a98542", "address": "fa:16:3e:10:88:6e", "network": {"id": "d47e3749-fdff-4112-bd72-69ca584efe1f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-302967634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "080d1ded4cd94e5083ee0b7e691b7363", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd13c4d4e-90", "ovs_interfaceid": "d13c4d4e-9004-4d4b-999d-619564a98542", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:26:48 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-46533e83-d647-41c6-80a5-d81e52958b8e req-a9f25649-506f-499b-a0b5-af72aab538c1 service nova] Releasing lock "refresh_cache-2f430d9a-9fbf-43cd-8c0d-e5dec162be71" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 15:26:49 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:26:52 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:26:54 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:26:56 user nova-compute[72382]: DEBUG os_brick.utils [None req-5a02efe0-8485-4d22-bd41-1d55e3f6a486 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 15:26:56 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:26:56 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:26:56 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9a833de-c16d-4e43-9823-744193490fc1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d2cfa7015fe\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:26:56 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:26:56 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:26:56 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[93aaec37-31d4-4e6c-80aa-6add3a897e06]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:26:56 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:26:56 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:26:56 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[51bd9734-1c1b-4d13-b3f9-6aef9667a53d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:26:56 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6ec514d-abf8-4427-abf9-55d4778a39e7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:26:56 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-5a02efe0-8485-4d22-bd41-1d55e3f6a486 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Running cmd (subprocess): nvme version {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:26:56 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-5a02efe0-8485-4d22-bd41-1d55e3f6a486 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] 'nvme version' failed. Not Retrying. {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 15:26:56 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5a02efe0-8485-4d22-bd41-1d55e3f6a486 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] nvme not present on system {{(pid=72382) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 15:26:56 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:26:56 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 15:26:56 user nova-compute[72382]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 15:26:56 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[78133856-b713-4fb1-afaf-067290c9dfc0]: (4, '') {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:26:56 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.lightos [None req-5a02efe0-8485-4d22-bd41-1d55e3f6a486 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72382) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 15:26:56 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.lightos [None req-5a02efe0-8485-4d22-bd41-1d55e3f6a486 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72382) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 15:26:56 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.lightos [None req-5a02efe0-8485-4d22-bd41-1d55e3f6a486 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] LIGHTOS: no hostnqn found. {{(pid=72382) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 15:26:56 user nova-compute[72382]: DEBUG os_brick.utils [None req-5a02efe0-8485-4d22-bd41-1d55e3f6a486 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d2cfa7015fe', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 15:26:56 user nova-compute[72382]: DEBUG nova.virt.block_device [None req-5a02efe0-8485-4d22-bd41-1d55e3f6a486 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] [instance: 2f430d9a-9fbf-43cd-8c0d-e5dec162be71] Updating existing volume attachment record: 67c24730-95dc-4950-ae8c-05c2a1d628f5 {{(pid=72382) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 15:26:57 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:26:58 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:26:58 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-43e02c7e-7c3e-45e7-b04d-ab078ebd458e tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] Acquiring lock "e0adbec9-eb22-4147-8c46-df7d02879f37" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:26:58 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-43e02c7e-7c3e-45e7-b04d-ab078ebd458e tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] Lock "e0adbec9-eb22-4147-8c46-df7d02879f37" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:26:58 user nova-compute[72382]: DEBUG nova.compute.manager [None req-43e02c7e-7c3e-45e7-b04d-ab078ebd458e tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] [instance: e0adbec9-eb22-4147-8c46-df7d02879f37] Starting instance... {{(pid=72382) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 15:26:58 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-43e02c7e-7c3e-45e7-b04d-ab078ebd458e tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:26:58 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-43e02c7e-7c3e-45e7-b04d-ab078ebd458e tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:26:58 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-43e02c7e-7c3e-45e7-b04d-ab078ebd458e tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72382) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 15:26:58 user nova-compute[72382]: INFO nova.compute.claims [None req-43e02c7e-7c3e-45e7-b04d-ab078ebd458e tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] [instance: e0adbec9-eb22-4147-8c46-df7d02879f37] Claim successful on node user
Aug 09 15:26:59 user nova-compute[72382]: DEBUG nova.compute.provider_tree [None req-43e02c7e-7c3e-45e7-b04d-ab078ebd458e tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] Inventory has not changed in ProviderTree for provider: 7b15b0e5-df4d-49db-833b-2855d21d10ae {{(pid=72382) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 15:26:59 user nova-compute[72382]: DEBUG nova.scheduler.client.report [None req-43e02c7e-7c3e-45e7-b04d-ab078ebd458e tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] Inventory has not changed for provider 7b15b0e5-df4d-49db-833b-2855d21d10ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72382) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 15:26:59 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-43e02c7e-7c3e-45e7-b04d-ab078ebd458e tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.554s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:26:59 user nova-compute[72382]: DEBUG nova.compute.manager [None req-43e02c7e-7c3e-45e7-b04d-ab078ebd458e tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] [instance: e0adbec9-eb22-4147-8c46-df7d02879f37] Start building networks asynchronously for instance. {{(pid=72382) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 15:26:59 user nova-compute[72382]: DEBUG nova.compute.manager [None req-43e02c7e-7c3e-45e7-b04d-ab078ebd458e tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] [instance: e0adbec9-eb22-4147-8c46-df7d02879f37] Allocating IP information in the background. {{(pid=72382) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 15:26:59 user nova-compute[72382]: DEBUG nova.network.neutron [None req-43e02c7e-7c3e-45e7-b04d-ab078ebd458e tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] [instance: e0adbec9-eb22-4147-8c46-df7d02879f37] allocate_for_instance() {{(pid=72382) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 15:26:59 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-43e02c7e-7c3e-45e7-b04d-ab078ebd458e tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] [instance: e0adbec9-eb22-4147-8c46-df7d02879f37] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 15:26:59 user nova-compute[72382]: DEBUG nova.compute.manager [None req-43e02c7e-7c3e-45e7-b04d-ab078ebd458e tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] [instance: e0adbec9-eb22-4147-8c46-df7d02879f37] Start building block device mappings for instance. {{(pid=72382) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 15:26:59 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:26:59 user nova-compute[72382]: DEBUG nova.policy [None req-43e02c7e-7c3e-45e7-b04d-ab078ebd458e tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '04ecf94b76144c64b2ca5ecc7932dd32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9949fc5e9167457d8c7a455350936255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72382) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 15:26:59 user nova-compute[72382]: DEBUG nova.compute.manager [None req-43e02c7e-7c3e-45e7-b04d-ab078ebd458e tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] [instance: e0adbec9-eb22-4147-8c46-df7d02879f37] Start spawning the instance on the hypervisor. {{(pid=72382) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 15:26:59 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-43e02c7e-7c3e-45e7-b04d-ab078ebd458e tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] [instance: e0adbec9-eb22-4147-8c46-df7d02879f37] Creating instance directory {{(pid=72382) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 15:26:59 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-43e02c7e-7c3e-45e7-b04d-ab078ebd458e tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] [instance: e0adbec9-eb22-4147-8c46-df7d02879f37] Creating image(s)
Aug 09 15:26:59 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-43e02c7e-7c3e-45e7-b04d-ab078ebd458e tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] Acquiring lock "/opt/stack/data/nova/instances/e0adbec9-eb22-4147-8c46-df7d02879f37/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:26:59 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-43e02c7e-7c3e-45e7-b04d-ab078ebd458e tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] Lock "/opt/stack/data/nova/instances/e0adbec9-eb22-4147-8c46-df7d02879f37/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:26:59 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-43e02c7e-7c3e-45e7-b04d-ab078ebd458e tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] Lock "/opt/stack/data/nova/instances/e0adbec9-eb22-4147-8c46-df7d02879f37/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:26:59 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-43e02c7e-7c3e-45e7-b04d-ab078ebd458e tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:26:59 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-43e02c7e-7c3e-45e7-b04d-ab078ebd458e tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b --force-share --output=json" returned: 0 in 0.143s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:26:59 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-43e02c7e-7c3e-45e7-b04d-ab078ebd458e tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] Acquiring lock "383812ff437283e0191ed5b9ecc04c27f1162b0b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:26:59 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-43e02c7e-7c3e-45e7-b04d-ab078ebd458e tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] Lock "383812ff437283e0191ed5b9ecc04c27f1162b0b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:26:59 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-43e02c7e-7c3e-45e7-b04d-ab078ebd458e tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:26:59 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-43e02c7e-7c3e-45e7-b04d-ab078ebd458e tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b --force-share --output=json" returned: 0 in 0.148s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:26:59 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-43e02c7e-7c3e-45e7-b04d-ab078ebd458e tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b,backing_fmt=raw /opt/stack/data/nova/instances/e0adbec9-eb22-4147-8c46-df7d02879f37/disk 1073741824 {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:26:59 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-43e02c7e-7c3e-45e7-b04d-ab078ebd458e tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b,backing_fmt=raw /opt/stack/data/nova/instances/e0adbec9-eb22-4147-8c46-df7d02879f37/disk 1073741824" returned: 0 in 0.069s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:26:59 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-43e02c7e-7c3e-45e7-b04d-ab078ebd458e tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] Lock "383812ff437283e0191ed5b9ecc04c27f1162b0b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.224s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:26:59 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-43e02c7e-7c3e-45e7-b04d-ab078ebd458e tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:26:59 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-43e02c7e-7c3e-45e7-b04d-ab078ebd458e tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b --force-share --output=json" returned: 0 in 0.155s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:26:59 user nova-compute[72382]: DEBUG nova.virt.disk.api [None req-43e02c7e-7c3e-45e7-b04d-ab078ebd458e tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e0adbec9-eb22-4147-8c46-df7d02879f37/disk. size=1073741824 {{(pid=72382) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 15:26:59 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-43e02c7e-7c3e-45e7-b04d-ab078ebd458e tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0adbec9-eb22-4147-8c46-df7d02879f37/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:27:00 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-43e02c7e-7c3e-45e7-b04d-ab078ebd458e tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0adbec9-eb22-4147-8c46-df7d02879f37/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:27:00 user nova-compute[72382]: DEBUG nova.virt.disk.api [None req-43e02c7e-7c3e-45e7-b04d-ab078ebd458e tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] Cannot resize image /opt/stack/data/nova/instances/e0adbec9-eb22-4147-8c46-df7d02879f37/disk to a smaller size. {{(pid=72382) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 15:27:00 user nova-compute[72382]: DEBUG nova.objects.instance [None req-43e02c7e-7c3e-45e7-b04d-ab078ebd458e tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] Lazy-loading 'migration_context' on Instance uuid e0adbec9-eb22-4147-8c46-df7d02879f37 {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:27:00 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-43e02c7e-7c3e-45e7-b04d-ab078ebd458e tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] [instance: e0adbec9-eb22-4147-8c46-df7d02879f37] Created local disks {{(pid=72382) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 15:27:00 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-43e02c7e-7c3e-45e7-b04d-ab078ebd458e tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] [instance: e0adbec9-eb22-4147-8c46-df7d02879f37] Ensure instance console log exists: /opt/stack/data/nova/instances/e0adbec9-eb22-4147-8c46-df7d02879f37/console.log {{(pid=72382) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 15:27:00 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-43e02c7e-7c3e-45e7-b04d-ab078ebd458e tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:27:00 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-43e02c7e-7c3e-45e7-b04d-ab078ebd458e tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:27:00 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-43e02c7e-7c3e-45e7-b04d-ab078ebd458e tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:27:00 user nova-compute[72382]: DEBUG nova.network.neutron [None req-43e02c7e-7c3e-45e7-b04d-ab078ebd458e tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] [instance: e0adbec9-eb22-4147-8c46-df7d02879f37] Successfully created port: ae457c5d-81eb-466b-beb7-d9a3b3c11d59 {{(pid=72382) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 15:27:01 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:27:02 user nova-compute[72382]: DEBUG nova.network.neutron [None req-43e02c7e-7c3e-45e7-b04d-ab078ebd458e tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] [instance: e0adbec9-eb22-4147-8c46-df7d02879f37] Successfully updated port: ae457c5d-81eb-466b-beb7-d9a3b3c11d59 {{(pid=72382) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 15:27:02 user nova-compute[72382]: DEBUG nova.compute.manager [req-8f715cf8-6348-468d-9101-72fdc56a608a req-72fcb976-7c0a-47f9-a3a7-00bfa0501265 service nova] [instance: e0adbec9-eb22-4147-8c46-df7d02879f37] Received event network-changed-ae457c5d-81eb-466b-beb7-d9a3b3c11d59 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:27:02 user nova-compute[72382]: DEBUG nova.compute.manager [req-8f715cf8-6348-468d-9101-72fdc56a608a req-72fcb976-7c0a-47f9-a3a7-00bfa0501265 service nova] [instance: e0adbec9-eb22-4147-8c46-df7d02879f37] Refreshing instance network info cache due to event network-changed-ae457c5d-81eb-466b-beb7-d9a3b3c11d59. {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 15:27:02 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-8f715cf8-6348-468d-9101-72fdc56a608a req-72fcb976-7c0a-47f9-a3a7-00bfa0501265 service nova] Acquiring lock "refresh_cache-e0adbec9-eb22-4147-8c46-df7d02879f37" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 15:27:02 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-8f715cf8-6348-468d-9101-72fdc56a608a req-72fcb976-7c0a-47f9-a3a7-00bfa0501265 service nova] Acquired lock "refresh_cache-e0adbec9-eb22-4147-8c46-df7d02879f37" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 15:27:02 user nova-compute[72382]: DEBUG nova.network.neutron [req-8f715cf8-6348-468d-9101-72fdc56a608a req-72fcb976-7c0a-47f9-a3a7-00bfa0501265 service nova] [instance: e0adbec9-eb22-4147-8c46-df7d02879f37] Refreshing network info cache for port ae457c5d-81eb-466b-beb7-d9a3b3c11d59 {{(pid=72382) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 15:27:02 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-43e02c7e-7c3e-45e7-b04d-ab078ebd458e tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] Acquiring lock "refresh_cache-e0adbec9-eb22-4147-8c46-df7d02879f37" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 15:27:02 user nova-compute[72382]: DEBUG nova.network.neutron [req-8f715cf8-6348-468d-9101-72fdc56a608a req-72fcb976-7c0a-47f9-a3a7-00bfa0501265 service nova] [instance: e0adbec9-eb22-4147-8c46-df7d02879f37] Instance cache missing network info. {{(pid=72382) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 15:27:02 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:27:02 user nova-compute[72382]: DEBUG nova.network.neutron [req-8f715cf8-6348-468d-9101-72fdc56a608a req-72fcb976-7c0a-47f9-a3a7-00bfa0501265 service nova] [instance: e0adbec9-eb22-4147-8c46-df7d02879f37] Updating instance_info_cache with network_info: [] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:27:02 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-8f715cf8-6348-468d-9101-72fdc56a608a req-72fcb976-7c0a-47f9-a3a7-00bfa0501265 service nova] Releasing lock "refresh_cache-e0adbec9-eb22-4147-8c46-df7d02879f37" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 15:27:02 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-43e02c7e-7c3e-45e7-b04d-ab078ebd458e tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] Acquired lock "refresh_cache-e0adbec9-eb22-4147-8c46-df7d02879f37" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 15:27:02 user nova-compute[72382]: DEBUG nova.network.neutron [None req-43e02c7e-7c3e-45e7-b04d-ab078ebd458e tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] [instance: e0adbec9-eb22-4147-8c46-df7d02879f37] Building network info cache for instance {{(pid=72382) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 15:27:02 user nova-compute[72382]: DEBUG nova.network.neutron [None req-43e02c7e-7c3e-45e7-b04d-ab078ebd458e tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] [instance: e0adbec9-eb22-4147-8c46-df7d02879f37] Instance cache missing network info. {{(pid=72382) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 15:27:03 user nova-compute[72382]: DEBUG nova.network.neutron [None req-43e02c7e-7c3e-45e7-b04d-ab078ebd458e tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] [instance: e0adbec9-eb22-4147-8c46-df7d02879f37] Updating instance_info_cache with network_info: [{"id": "ae457c5d-81eb-466b-beb7-d9a3b3c11d59", "address": "fa:16:3e:35:bc:34", "network": {"id": "1b9920a2-9613-4741-a0c0-72172380b365", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-455407214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9949fc5e9167457d8c7a455350936255", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae457c5d-81", "ovs_interfaceid": "ae457c5d-81eb-466b-beb7-d9a3b3c11d59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:27:03 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-43e02c7e-7c3e-45e7-b04d-ab078ebd458e tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] Releasing lock "refresh_cache-e0adbec9-eb22-4147-8c46-df7d02879f37" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 15:27:03 user nova-compute[72382]: DEBUG nova.compute.manager [None req-43e02c7e-7c3e-45e7-b04d-ab078ebd458e tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] [instance: e0adbec9-eb22-4147-8c46-df7d02879f37] Instance network_info: |[{"id": "ae457c5d-81eb-466b-beb7-d9a3b3c11d59", "address": "fa:16:3e:35:bc:34", "network": {"id": "1b9920a2-9613-4741-a0c0-72172380b365", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-455407214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9949fc5e9167457d8c7a455350936255", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae457c5d-81", "ovs_interfaceid": "ae457c5d-81eb-466b-beb7-d9a3b3c11d59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72382) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 15:27:03 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-43e02c7e-7c3e-45e7-b04d-ab078ebd458e tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] [instance: e0adbec9-eb22-4147-8c46-df7d02879f37] Start _get_guest_xml network_info=[{"id": "ae457c5d-81eb-466b-beb7-d9a3b3c11d59", "address": "fa:16:3e:35:bc:34", "network": {"id": "1b9920a2-9613-4741-a0c0-72172380b365", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-455407214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9949fc5e9167457d8c7a455350936255", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae457c5d-81", "ovs_interfaceid": "ae457c5d-81eb-466b-beb7-d9a3b3c11d59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T15:11:25Z,direct_url=<?>,disk_format='qcow2',id=a79f2cea-eb27-4631-aaf3-05e7d9e411b4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a638990e12cc4d6eabb6d55e13be6bdf',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T15:11:27Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'a79f2cea-eb27-4631-aaf3-05e7d9e411b4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72382) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 15:27:03 user nova-compute[72382]: WARNING nova.virt.libvirt.driver [None req-43e02c7e-7c3e-45e7-b04d-ab078ebd458e tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 15:27:03 user nova-compute[72382]: WARNING nova.virt.libvirt.driver [None req-43e02c7e-7c3e-45e7-b04d-ab078ebd458e tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 15:27:03 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-43e02c7e-7c3e-45e7-b04d-ab078ebd458e tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72382) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 15:27:03 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-43e02c7e-7c3e-45e7-b04d-ab078ebd458e tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] CPU controller missing on host. {{(pid=72382) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 15:27:03 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-43e02c7e-7c3e-45e7-b04d-ab078ebd458e tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72382) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 15:27:03 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-43e02c7e-7c3e-45e7-b04d-ab078ebd458e tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] CPU controller found on host. {{(pid=72382) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 15:27:03 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-43e02c7e-7c3e-45e7-b04d-ab078ebd458e tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72382) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 15:27:03 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-43e02c7e-7c3e-45e7-b04d-ab078ebd458e tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T15:11:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T15:11:25Z,direct_url=<?>,disk_format='qcow2',id=a79f2cea-eb27-4631-aaf3-05e7d9e411b4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a638990e12cc4d6eabb6d55e13be6bdf',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T15:11:27Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 15:27:03 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-43e02c7e-7c3e-45e7-b04d-ab078ebd458e tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] Flavor limits 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 15:27:03 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-43e02c7e-7c3e-45e7-b04d-ab078ebd458e tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] Image limits 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 15:27:03 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-43e02c7e-7c3e-45e7-b04d-ab078ebd458e tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] Flavor pref 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 15:27:03 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-43e02c7e-7c3e-45e7-b04d-ab078ebd458e tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] Image pref 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 15:27:03 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-43e02c7e-7c3e-45e7-b04d-ab078ebd458e tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 15:27:03 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-43e02c7e-7c3e-45e7-b04d-ab078ebd458e tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 15:27:03 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-43e02c7e-7c3e-45e7-b04d-ab078ebd458e tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72382) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 15:27:03 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-43e02c7e-7c3e-45e7-b04d-ab078ebd458e tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] Got 1 possible topologies {{(pid=72382) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 15:27:03 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-43e02c7e-7c3e-45e7-b04d-ab078ebd458e tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 15:27:03 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-43e02c7e-7c3e-45e7-b04d-ab078ebd458e tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 15:27:03 user nova-compute[72382]: DEBUG nova.virt.libvirt.vif [None req-43e02c7e-7c3e-45e7-b04d-ab078ebd458e tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T15:26:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1309457343',display_name='tempest-VolumesSnapshotTestJSON-instance-1309457343',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1309457343',id=29,image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC4J5s/e64QwkKpkXrv2/HxjMFR67embNinTg5rv2W+dRJzFLS5SR+bTVPf2ch817MOXJek2YrXFDhAEuIeKf0VO83ckcUktx64kqgF/ucNpfXjKZ5UGgVMPJ2dolkD1sg==',key_name='tempest-keypair-270486525',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9949fc5e9167457d8c7a455350936255',ramdisk_id='',reservation_id='r-aur0xu5v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-985960330',owner_user_name='tempest-VolumesSnapshotTestJSON-985960330-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T15:26:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='04ecf94b76144c64b2ca5ecc7932dd32',uuid=e0adbec9-eb22-4147-8c46-df7d02879f37,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ae457c5d-81eb-466b-beb7-d9a3b3c11d59", "address": "fa:16:3e:35:bc:34", "network": {"id": "1b9920a2-9613-4741-a0c0-72172380b365", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-455407214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9949fc5e9167457d8c7a455350936255", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae457c5d-81", "ovs_interfaceid": "ae457c5d-81eb-466b-beb7-d9a3b3c11d59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72382) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 15:27:03 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-43e02c7e-7c3e-45e7-b04d-ab078ebd458e tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] Converting VIF {"id": "ae457c5d-81eb-466b-beb7-d9a3b3c11d59", "address": "fa:16:3e:35:bc:34", "network": {"id": "1b9920a2-9613-4741-a0c0-72172380b365", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-455407214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9949fc5e9167457d8c7a455350936255", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae457c5d-81", "ovs_interfaceid": "ae457c5d-81eb-466b-beb7-d9a3b3c11d59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 15:27:03 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-43e02c7e-7c3e-45e7-b04d-ab078ebd458e tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:35:bc:34,bridge_name='br-int',has_traffic_filtering=True,id=ae457c5d-81eb-466b-beb7-d9a3b3c11d59,network=Network(1b9920a2-9613-4741-a0c0-72172380b365),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae457c5d-81') {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 15:27:03 user nova-compute[72382]: DEBUG nova.objects.instance [None req-43e02c7e-7c3e-45e7-b04d-ab078ebd458e tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] Lazy-loading 'pci_devices' on Instance uuid e0adbec9-eb22-4147-8c46-df7d02879f37 {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:27:03 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-43e02c7e-7c3e-45e7-b04d-ab078ebd458e tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] [instance: e0adbec9-eb22-4147-8c46-df7d02879f37] End _get_guest_xml xml=<domain type="kvm">
Aug 09 15:27:03 user nova-compute[72382]:   <uuid>e0adbec9-eb22-4147-8c46-df7d02879f37</uuid>
Aug 09 15:27:03 user nova-compute[72382]:   <name>instance-0000001d</name>
Aug 09 15:27:03 user nova-compute[72382]:   <memory>524288</memory>
Aug 09 15:27:03 user nova-compute[72382]:   <vcpu>1</vcpu>
Aug 09 15:27:03 user nova-compute[72382]:   <metadata>
Aug 09 15:27:03 user nova-compute[72382]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 15:27:03 user nova-compute[72382]:       <nova:package version="0.0.0"/>
Aug 09 15:27:03 user nova-compute[72382]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1309457343</nova:name>
Aug 09 15:27:03 user nova-compute[72382]:       <nova:creationTime>2023-08-09 15:27:03</nova:creationTime>
Aug 09 15:27:03 user nova-compute[72382]:       <nova:flavor name="m1.tiny">
Aug 09 15:27:03 user nova-compute[72382]:         <nova:memory>512</nova:memory>
Aug 09 15:27:03 user nova-compute[72382]:         <nova:disk>1</nova:disk>
Aug 09 15:27:03 user nova-compute[72382]:         <nova:swap>0</nova:swap>
Aug 09 15:27:03 user nova-compute[72382]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 15:27:03 user nova-compute[72382]:         <nova:vcpus>1</nova:vcpus>
Aug 09 15:27:03 user nova-compute[72382]:       </nova:flavor>
Aug 09 15:27:03 user nova-compute[72382]:       <nova:owner>
Aug 09 15:27:03 user nova-compute[72382]:         <nova:user uuid="04ecf94b76144c64b2ca5ecc7932dd32">tempest-VolumesSnapshotTestJSON-985960330-project-member</nova:user>
Aug 09 15:27:03 user nova-compute[72382]:         <nova:project uuid="9949fc5e9167457d8c7a455350936255">tempest-VolumesSnapshotTestJSON-985960330</nova:project>
Aug 09 15:27:03 user nova-compute[72382]:       </nova:owner>
Aug 09 15:27:03 user nova-compute[72382]:       <nova:root type="image" uuid="a79f2cea-eb27-4631-aaf3-05e7d9e411b4"/>
Aug 09 15:27:03 user nova-compute[72382]:       <nova:ports>
Aug 09 15:27:03 user nova-compute[72382]:         <nova:port uuid="ae457c5d-81eb-466b-beb7-d9a3b3c11d59">
Aug 09 15:27:03 user nova-compute[72382]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 09 15:27:03 user nova-compute[72382]:         </nova:port>
Aug 09 15:27:03 user nova-compute[72382]:       </nova:ports>
Aug 09 15:27:03 user nova-compute[72382]:     </nova:instance>
Aug 09 15:27:03 user nova-compute[72382]:   </metadata>
Aug 09 15:27:03 user nova-compute[72382]:   <sysinfo type="smbios">
Aug 09 15:27:03 user nova-compute[72382]:     <system>
Aug 09 15:27:03 user nova-compute[72382]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 15:27:03 user nova-compute[72382]:       <entry name="product">OpenStack Nova</entry>
Aug 09 15:27:03 user nova-compute[72382]:       <entry name="version">0.0.0</entry>
Aug 09 15:27:03 user nova-compute[72382]:       <entry name="serial">e0adbec9-eb22-4147-8c46-df7d02879f37</entry>
Aug 09 15:27:03 user nova-compute[72382]:       <entry name="uuid">e0adbec9-eb22-4147-8c46-df7d02879f37</entry>
Aug 09 15:27:03 user nova-compute[72382]:       <entry name="family">Virtual Machine</entry>
Aug 09 15:27:03 user nova-compute[72382]:     </system>
Aug 09 15:27:03 user nova-compute[72382]:   </sysinfo>
Aug 09 15:27:03 user nova-compute[72382]:   <os>
Aug 09 15:27:03 user nova-compute[72382]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 15:27:03 user nova-compute[72382]:     <boot dev="hd"/>
Aug 09 15:27:03 user nova-compute[72382]:     <smbios mode="sysinfo"/>
Aug 09 15:27:03 user nova-compute[72382]:   </os>
Aug 09 15:27:03 user nova-compute[72382]:   <features>
Aug 09 15:27:03 user nova-compute[72382]:     <acpi/>
Aug 09 15:27:03 user nova-compute[72382]:     <apic/>
Aug 09 15:27:03 user nova-compute[72382]:     <vmcoreinfo/>
Aug 09 15:27:03 user nova-compute[72382]:   </features>
Aug 09 15:27:03 user nova-compute[72382]:   <clock offset="utc">
Aug 09 15:27:03 user nova-compute[72382]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 15:27:03 user nova-compute[72382]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 15:27:03 user nova-compute[72382]:     <timer name="hpet" present="no"/>
Aug 09 15:27:03 user nova-compute[72382]:   </clock>
Aug 09 15:27:03 user nova-compute[72382]:   <cpu mode="custom" match="exact">
Aug 09 15:27:03 user nova-compute[72382]:     <model>Nehalem</model>
Aug 09 15:27:03 user nova-compute[72382]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 15:27:03 user nova-compute[72382]:   </cpu>
Aug 09 15:27:03 user nova-compute[72382]:   <devices>
Aug 09 15:27:03 user nova-compute[72382]:     <disk type="file" device="disk">
Aug 09 15:27:03 user nova-compute[72382]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 15:27:03 user nova-compute[72382]:       <source file="/opt/stack/data/nova/instances/e0adbec9-eb22-4147-8c46-df7d02879f37/disk"/>
Aug 09 15:27:03 user nova-compute[72382]:       <target dev="vda" bus="virtio"/>
Aug 09 15:27:03 user nova-compute[72382]:     </disk>
Aug 09 15:27:03 user nova-compute[72382]:     <interface type="ethernet">
Aug 09 15:27:03 user nova-compute[72382]:       <mac address="fa:16:3e:35:bc:34"/>
Aug 09 15:27:03 user nova-compute[72382]:       <model type="virtio"/>
Aug 09 15:27:03 user nova-compute[72382]:       <mtu size="1442"/>
Aug 09 15:27:03 user nova-compute[72382]:       <target dev="tapae457c5d-81"/>
Aug 09 15:27:03 user nova-compute[72382]:     </interface>
Aug 09 15:27:03 user nova-compute[72382]:     <serial type="pty">
Aug 09 15:27:03 user nova-compute[72382]:       <log file="/opt/stack/data/nova/instances/e0adbec9-eb22-4147-8c46-df7d02879f37/console.log" append="off"/>
Aug 09 15:27:03 user nova-compute[72382]:     </serial>
Aug 09 15:27:03 user nova-compute[72382]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 15:27:03 user nova-compute[72382]:     <video>
Aug 09 15:27:03 user nova-compute[72382]:       <model type="virtio"/>
Aug 09 15:27:03 user nova-compute[72382]:     </video>
Aug 09 15:27:03 user nova-compute[72382]:     <rng model="virtio">
Aug 09 15:27:03 user nova-compute[72382]:       <backend model="random">/dev/urandom</backend>
Aug 09 15:27:03 user nova-compute[72382]:     </rng>
Aug 09 15:27:03 user nova-compute[72382]:     <controller type="usb" index="0" model="none"/>
Aug 09 15:27:03 user nova-compute[72382]:     <memballoon model="virtio">
Aug 09 15:27:03 user nova-compute[72382]:       <stats period="10"/>
Aug 09 15:27:03 user nova-compute[72382]:     </memballoon>
Aug 09 15:27:03 user nova-compute[72382]:   </devices>
Aug 09 15:27:03 user nova-compute[72382]: </domain>
Aug 09 15:27:03 user nova-compute[72382]:  {{(pid=72382) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 15:27:03 user nova-compute[72382]: DEBUG nova.virt.libvirt.vif [None req-43e02c7e-7c3e-45e7-b04d-ab078ebd458e tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T15:26:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1309457343',display_name='tempest-VolumesSnapshotTestJSON-instance-1309457343',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1309457343',id=29,image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC4J5s/e64QwkKpkXrv2/HxjMFR67embNinTg5rv2W+dRJzFLS5SR+bTVPf2ch817MOXJek2YrXFDhAEuIeKf0VO83ckcUktx64kqgF/ucNpfXjKZ5UGgVMPJ2dolkD1sg==',key_name='tempest-keypair-270486525',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9949fc5e9167457d8c7a455350936255',ramdisk_id='',reservation_id='r-aur0xu5v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-985960330',owner_user_name='tempest-VolumesSnapshotTestJSON-985960330-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T15:26:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='04ecf94b76144c64b2ca5ecc7932dd32',uuid=e0adbec9-eb22-4147-8c46-df7d02879f37,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ae457c5d-81eb-466b-beb7-d9a3b3c11d59", "address": "fa:16:3e:35:bc:34", "network": {"id": "1b9920a2-9613-4741-a0c0-72172380b365", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-455407214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9949fc5e9167457d8c7a455350936255", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae457c5d-81", "ovs_interfaceid": "ae457c5d-81eb-466b-beb7-d9a3b3c11d59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 15:27:03 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-43e02c7e-7c3e-45e7-b04d-ab078ebd458e tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] Converting VIF {"id": "ae457c5d-81eb-466b-beb7-d9a3b3c11d59", "address": "fa:16:3e:35:bc:34", "network": {"id": "1b9920a2-9613-4741-a0c0-72172380b365", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-455407214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9949fc5e9167457d8c7a455350936255", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae457c5d-81", "ovs_interfaceid": "ae457c5d-81eb-466b-beb7-d9a3b3c11d59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 15:27:03 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-43e02c7e-7c3e-45e7-b04d-ab078ebd458e tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:35:bc:34,bridge_name='br-int',has_traffic_filtering=True,id=ae457c5d-81eb-466b-beb7-d9a3b3c11d59,network=Network(1b9920a2-9613-4741-a0c0-72172380b365),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae457c5d-81') {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 15:27:03 user nova-compute[72382]: DEBUG os_vif [None req-43e02c7e-7c3e-45e7-b04d-ab078ebd458e tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:bc:34,bridge_name='br-int',has_traffic_filtering=True,id=ae457c5d-81eb-466b-beb7-d9a3b3c11d59,network=Network(1b9920a2-9613-4741-a0c0-72172380b365),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae457c5d-81') {{(pid=72382) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 15:27:03 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:27:03 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:27:03 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 15:27:03 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:27:03 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapae457c5d-81, may_exist=True, interface_attrs={}) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:27:03 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapae457c5d-81, col_values=(('external_ids', {'iface-id': 'ae457c5d-81eb-466b-beb7-d9a3b3c11d59', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:35:bc:34', 'vm-uuid': 'e0adbec9-eb22-4147-8c46-df7d02879f37'}),), if_exists=True) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:27:03 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:27:03 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:27:03 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:27:03 user nova-compute[72382]: INFO os_vif [None req-43e02c7e-7c3e-45e7-b04d-ab078ebd458e tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:bc:34,bridge_name='br-int',has_traffic_filtering=True,id=ae457c5d-81eb-466b-beb7-d9a3b3c11d59,network=Network(1b9920a2-9613-4741-a0c0-72172380b365),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae457c5d-81')
Aug 09 15:27:03 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-43e02c7e-7c3e-45e7-b04d-ab078ebd458e tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] No BDM found with device name vda, not building metadata. {{(pid=72382) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 15:27:03 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-43e02c7e-7c3e-45e7-b04d-ab078ebd458e tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] No VIF found with MAC fa:16:3e:35:bc:34, not building metadata {{(pid=72382) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 15:27:04 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:27:04 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:27:04 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:27:04 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:27:05 user nova-compute[72382]: DEBUG nova.compute.manager [req-e54f997d-7f18-4f89-911c-07dd7a930379 req-2a99676e-ce6d-4c2b-8e9b-05a81b58d164 service nova] [instance: e0adbec9-eb22-4147-8c46-df7d02879f37] Received event network-vif-plugged-ae457c5d-81eb-466b-beb7-d9a3b3c11d59 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:27:05 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-e54f997d-7f18-4f89-911c-07dd7a930379 req-2a99676e-ce6d-4c2b-8e9b-05a81b58d164 service nova] Acquiring lock "e0adbec9-eb22-4147-8c46-df7d02879f37-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:27:05 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-e54f997d-7f18-4f89-911c-07dd7a930379 req-2a99676e-ce6d-4c2b-8e9b-05a81b58d164 service nova] Lock "e0adbec9-eb22-4147-8c46-df7d02879f37-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:27:05 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-e54f997d-7f18-4f89-911c-07dd7a930379 req-2a99676e-ce6d-4c2b-8e9b-05a81b58d164 service nova] Lock "e0adbec9-eb22-4147-8c46-df7d02879f37-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:27:05 user nova-compute[72382]: DEBUG nova.compute.manager [req-e54f997d-7f18-4f89-911c-07dd7a930379 req-2a99676e-ce6d-4c2b-8e9b-05a81b58d164 service nova] [instance: e0adbec9-eb22-4147-8c46-df7d02879f37] No waiting events found dispatching network-vif-plugged-ae457c5d-81eb-466b-beb7-d9a3b3c11d59 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:27:05 user nova-compute[72382]: WARNING nova.compute.manager [req-e54f997d-7f18-4f89-911c-07dd7a930379 req-2a99676e-ce6d-4c2b-8e9b-05a81b58d164 service nova] [instance: e0adbec9-eb22-4147-8c46-df7d02879f37] Received unexpected event network-vif-plugged-ae457c5d-81eb-466b-beb7-d9a3b3c11d59 for instance with vm_state building and task_state spawning.
Aug 09 15:27:05 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:27:05 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:27:05 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:27:05 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:27:06 user nova-compute[72382]: DEBUG nova.compute.manager [None req-5a02efe0-8485-4d22-bd41-1d55e3f6a486 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] [instance: 2f430d9a-9fbf-43cd-8c0d-e5dec162be71] Start spawning the instance on the hypervisor. {{(pid=72382) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 15:27:06 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-5a02efe0-8485-4d22-bd41-1d55e3f6a486 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] [instance: 2f430d9a-9fbf-43cd-8c0d-e5dec162be71] Creating instance directory {{(pid=72382) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 15:27:06 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-5a02efe0-8485-4d22-bd41-1d55e3f6a486 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] [instance: 2f430d9a-9fbf-43cd-8c0d-e5dec162be71] Creating image(s)
Aug 09 15:27:06 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-5a02efe0-8485-4d22-bd41-1d55e3f6a486 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] [instance: 2f430d9a-9fbf-43cd-8c0d-e5dec162be71] Did not create local disks {{(pid=72382) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 09 15:27:06 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-5a02efe0-8485-4d22-bd41-1d55e3f6a486 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] [instance: 2f430d9a-9fbf-43cd-8c0d-e5dec162be71] Ensure instance console log exists: /opt/stack/data/nova/instances/2f430d9a-9fbf-43cd-8c0d-e5dec162be71/console.log {{(pid=72382) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 15:27:06 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-5a02efe0-8485-4d22-bd41-1d55e3f6a486 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:27:06 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-5a02efe0-8485-4d22-bd41-1d55e3f6a486 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:27:06 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-5a02efe0-8485-4d22-bd41-1d55e3f6a486 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:27:06 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-5a02efe0-8485-4d22-bd41-1d55e3f6a486 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] [instance: 2f430d9a-9fbf-43cd-8c0d-e5dec162be71] Start _get_guest_xml network_info=[{"id": "d13c4d4e-9004-4d4b-999d-619564a98542", "address": "fa:16:3e:10:88:6e", "network": {"id": "d47e3749-fdff-4112-bd72-69ca584efe1f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-302967634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "080d1ded4cd94e5083ee0b7e691b7363", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd13c4d4e-90", "ovs_interfaceid": "d13c4d4e-9004-4d4b-999d-619564a98542", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T15:11:25Z,direct_url=<?>,disk_format='qcow2',id=a79f2cea-eb27-4631-aaf3-05e7d9e411b4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a638990e12cc4d6eabb6d55e13be6bdf',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T15:11:27Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:25503c6e-bfc0-4008-846a-8cad783fc0fb'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DpcMQIwC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '2f430d9a-9fbf-43cd-8c0d-e5dec162be71', 'attached_at': '', 'detached_at': '', 'volume_id': '25503c6e-bfc0-4008-846a-8cad783fc0fb', 'serial': '25503c6e-bfc0-4008-846a-8cad783fc0fb'}, 'disk_bus': 'virtio', 'attachment_id': '67c24730-95dc-4950-ae8c-05c2a1d628f5', 'delete_on_termination': False, 'volume_type': None} {{(pid=72382) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 15:27:06 user nova-compute[72382]: WARNING nova.virt.libvirt.driver [None req-5a02efe0-8485-4d22-bd41-1d55e3f6a486 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 15:27:06 user nova-compute[72382]: WARNING nova.virt.libvirt.driver [None req-5a02efe0-8485-4d22-bd41-1d55e3f6a486 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 15:27:06 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-5a02efe0-8485-4d22-bd41-1d55e3f6a486 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72382) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 15:27:06 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-5a02efe0-8485-4d22-bd41-1d55e3f6a486 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] CPU controller missing on host. {{(pid=72382) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 15:27:06 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-5a02efe0-8485-4d22-bd41-1d55e3f6a486 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72382) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 15:27:06 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-5a02efe0-8485-4d22-bd41-1d55e3f6a486 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] CPU controller found on host. {{(pid=72382) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 15:27:06 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-5a02efe0-8485-4d22-bd41-1d55e3f6a486 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72382) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 15:27:06 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-5a02efe0-8485-4d22-bd41-1d55e3f6a486 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T15:11:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T15:11:25Z,direct_url=<?>,disk_format='qcow2',id=a79f2cea-eb27-4631-aaf3-05e7d9e411b4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a638990e12cc4d6eabb6d55e13be6bdf',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T15:11:27Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 15:27:06 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-5a02efe0-8485-4d22-bd41-1d55e3f6a486 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Flavor limits 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 15:27:06 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-5a02efe0-8485-4d22-bd41-1d55e3f6a486 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Image limits 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 15:27:06 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-5a02efe0-8485-4d22-bd41-1d55e3f6a486 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Flavor pref 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 15:27:06 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-5a02efe0-8485-4d22-bd41-1d55e3f6a486 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Image pref 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 15:27:06 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-5a02efe0-8485-4d22-bd41-1d55e3f6a486 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 15:27:06 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-5a02efe0-8485-4d22-bd41-1d55e3f6a486 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 15:27:06 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-5a02efe0-8485-4d22-bd41-1d55e3f6a486 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72382) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 15:27:06 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-5a02efe0-8485-4d22-bd41-1d55e3f6a486 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Got 1 possible topologies {{(pid=72382) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 15:27:06 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-5a02efe0-8485-4d22-bd41-1d55e3f6a486 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 15:27:06 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-5a02efe0-8485-4d22-bd41-1d55e3f6a486 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 15:27:06 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5a02efe0-8485-4d22-bd41-1d55e3f6a486 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] [instance: 2f430d9a-9fbf-43cd-8c0d-e5dec162be71] Calling os-brick to attach iSCSI Volume {{(pid=72382) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 15:27:06 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a02efe0-8485-4d22-bd41-1d55e3f6a486 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2a0c768340>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:25503c6e-bfc0-4008-846a-8cad783fc0fb'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DpcMQIwC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 15:27:06 user nova-compute[72382]: WARNING os_brick.initiator.connectors.base [None req-5a02efe0-8485-4d22-bd41-1d55e3f6a486 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 15:27:06 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-5a02efe0-8485-4d22-bd41-1d55e3f6a486 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 15:27:06 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-5a02efe0-8485-4d22-bd41-1d55e3f6a486 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 15:27:06 user nova-compute[72382]: WARNING os_brick.initiator.connectors.base [None req-5a02efe0-8485-4d22-bd41-1d55e3f6a486 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 15:27:06 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-5a02efe0-8485-4d22-bd41-1d55e3f6a486 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:25503c6e-bfc0-4008-846a-8cad783fc0fb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 15:27:06 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-5a02efe0-8485-4d22-bd41-1d55e3f6a486 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:25503c6e-bfc0-4008-846a-8cad783fc0fb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 15:27:06 user nova-compute[72382]: INFO os_brick.initiator.connectors.iscsi [None req-5a02efe0-8485-4d22-bd41-1d55e3f6a486 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 15:27:06 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25503c6e-bfc0-4008-846a-8cad783fc0fb -p 172.16.0.220:3260 {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:27:06 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25503c6e-bfc0-4008-846a-8cad783fc0fb -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:27:06 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[913b0219-d313-4426-8f3d-61a670352a77]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:27:06 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a02efe0-8485-4d22-bd41-1d55e3f6a486 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 15:27:06 user nova-compute[72382]:  {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:27:06 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25503c6e-bfc0-4008-846a-8cad783fc0fb -p 172.16.0.220:3260 --interface default --op new {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:27:06 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25503c6e-bfc0-4008-846a-8cad783fc0fb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:27:06 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[3db0d717-7cff-4d1f-a165-9713c3e31b57]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:25503c6e-bfc0-4008-846a-8cad783fc0fb] added\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:27:06 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a02efe0-8485-4d22-bd41-1d55e3f6a486 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:25503c6e-bfc0-4008-846a-8cad783fc0fb] added
Aug 09 15:27:06 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:27:06 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25503c6e-bfc0-4008-846a-8cad783fc0fb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:27:06 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25503c6e-bfc0-4008-846a-8cad783fc0fb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:27:06 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[784010ee-0972-482a-b144-9d3b4544edc5]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:27:06 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a02efe0-8485-4d22-bd41-1d55e3f6a486 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:27:06 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25503c6e-bfc0-4008-846a-8cad783fc0fb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:27:06 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25503c6e-bfc0-4008-846a-8cad783fc0fb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:27:06 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[425e8f97-b595-48f0-939a-68b92d4fc750]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:27:06 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a02efe0-8485-4d22-bd41-1d55e3f6a486 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:27:06 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25503c6e-bfc0-4008-846a-8cad783fc0fb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DpcMQIwC {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:27:06 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25503c6e-bfc0-4008-846a-8cad783fc0fb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DpcMQIwC" returned: 0 in 0.018s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:27:06 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f637d2d-0d25-4dea-92a4-dbc91ecb7b00]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:27:06 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a02efe0-8485-4d22-bd41-1d55e3f6a486 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DpcMQIwC'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:27:06 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25503c6e-bfc0-4008-846a-8cad783fc0fb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:27:06 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25503c6e-bfc0-4008-846a-8cad783fc0fb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:27:06 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[40a61160-32d3-45d3-be4d-6596467ef619]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:27:06 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a02efe0-8485-4d22-bd41-1d55e3f6a486 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:27:06 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:27:06 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:27:06 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2696e39-b2d9-49a8-8155-4cc1c8021ad7]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9572706e-c54c-42c2-9cf0-2690cdf4cca2 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd90521a-f3b5-485c-9fb9-61ab37267f3a (non-flash)\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:27:06 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a02efe0-8485-4d22-bd41-1d55e3f6a486 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)
Aug 09 15:27:06 user nova-compute[72382]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9572706e-c54c-42c2-9cf0-2690cdf4cca2 (non-flash)
Aug 09 15:27:06 user nova-compute[72382]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd90521a-f3b5-485c-9fb9-61ab37267f3a (non-flash)
Aug 09 15:27:06 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 15:27:06 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a02efe0-8485-4d22-bd41-1d55e3f6a486 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)
Aug 09 15:27:06 user nova-compute[72382]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9572706e-c54c-42c2-9cf0-2690cdf4cca2 (non-flash)
Aug 09 15:27:06 user nova-compute[72382]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd90521a-f3b5-485c-9fb9-61ab37267f3a (non-flash)
Aug 09 15:27:06 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 15:27:06 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25503c6e-bfc0-4008-846a-8cad783fc0fb -p 172.16.0.220:3260 --login {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:27:06 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25503c6e-bfc0-4008-846a-8cad783fc0fb -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:27:06 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[00613a8f-c899-44d1-be1d-612db56c4717]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:25503c6e-bfc0-4008-846a-8cad783fc0fb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:25503c6e-bfc0-4008-846a-8cad783fc0fb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:27:06 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a02efe0-8485-4d22-bd41-1d55e3f6a486 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:25503c6e-bfc0-4008-846a-8cad783fc0fb, portal: 172.16.0.220,3260]
Aug 09 15:27:06 user nova-compute[72382]: Login to [iface: default, target: iqn.2010-10.org.openstack:25503c6e-bfc0-4008-846a-8cad783fc0fb, portal: 172.16.0.220,3260] successful.
Aug 09 15:27:06 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:27:06 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25503c6e-bfc0-4008-846a-8cad783fc0fb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:27:06 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25503c6e-bfc0-4008-846a-8cad783fc0fb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:27:06 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd1c8c3f-2b32-4d2d-b69c-33c1b9d0fbdc]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:27:06 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a02efe0-8485-4d22-bd41-1d55e3f6a486 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:27:06 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:27:06 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:27:06 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[52670ecf-b7bd-421c-884e-68ca90593ed1]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9572706e-c54c-42c2-9cf0-2690cdf4cca2 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd90521a-f3b5-485c-9fb9-61ab37267f3a (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25503c6e-bfc0-4008-846a-8cad783fc0fb (non-flash)\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:27:06 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a02efe0-8485-4d22-bd41-1d55e3f6a486 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)
Aug 09 15:27:06 user nova-compute[72382]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9572706e-c54c-42c2-9cf0-2690cdf4cca2 (non-flash)
Aug 09 15:27:06 user nova-compute[72382]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd90521a-f3b5-485c-9fb9-61ab37267f3a (non-flash)
Aug 09 15:27:06 user nova-compute[72382]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25503c6e-bfc0-4008-846a-8cad783fc0fb (non-flash)
Aug 09 15:27:06 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 15:27:06 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a02efe0-8485-4d22-bd41-1d55e3f6a486 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)
Aug 09 15:27:06 user nova-compute[72382]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9572706e-c54c-42c2-9cf0-2690cdf4cca2 (non-flash)
Aug 09 15:27:06 user nova-compute[72382]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd90521a-f3b5-485c-9fb9-61ab37267f3a (non-flash)
Aug 09 15:27:06 user nova-compute[72382]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25503c6e-bfc0-4008-846a-8cad783fc0fb (non-flash)
Aug 09 15:27:06 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 15:27:06 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-5a02efe0-8485-4d22-bd41-1d55e3f6a486 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:25503c6e-bfc0-4008-846a-8cad783fc0fb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.283s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 15:27:06 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a02efe0-8485-4d22-bd41-1d55e3f6a486 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Connected to 172.16.0.220:3260 {{(pid=72382) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 15:27:06 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-5a02efe0-8485-4d22-bd41-1d55e3f6a486 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] HCTL ('36', '-', '-', 0) found on session 31 with lun 0 {{(pid=72382) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 15:27:06 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-5a02efe0-8485-4d22-bd41-1d55e3f6a486 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72382) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 15:27:06 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:27:06 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:27:06 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[6915aad1-2fec-4d66-ae5c-03b3cf68266a]: (4, ('- - 0', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:27:06 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-5a02efe0-8485-4d22-bd41-1d55e3f6a486 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Searching for a device in session 31 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72382) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 15:27:06 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a02efe0-8485-4d22-bd41-1d55e3f6a486 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DpcMQIwC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72382) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 15:27:06 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:27:07 user nova-compute[72382]: DEBUG nova.virt.driver [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Emitting event <LifecycleEvent: 1691594827.1309798, e0adbec9-eb22-4147-8c46-df7d02879f37 => Resumed> {{(pid=72382) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 15:27:07 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: e0adbec9-eb22-4147-8c46-df7d02879f37] VM Resumed (Lifecycle Event)
Aug 09 15:27:07 user nova-compute[72382]: DEBUG nova.compute.manager [None req-43e02c7e-7c3e-45e7-b04d-ab078ebd458e tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] [instance: e0adbec9-eb22-4147-8c46-df7d02879f37] Instance event wait completed in 0 seconds for  {{(pid=72382) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 15:27:07 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-43e02c7e-7c3e-45e7-b04d-ab078ebd458e tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] [instance: e0adbec9-eb22-4147-8c46-df7d02879f37] Guest created on hypervisor {{(pid=72382) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 15:27:07 user nova-compute[72382]: INFO nova.virt.libvirt.driver [-] [instance: e0adbec9-eb22-4147-8c46-df7d02879f37] Instance spawned successfully.
Aug 09 15:27:07 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-43e02c7e-7c3e-45e7-b04d-ab078ebd458e tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] [instance: e0adbec9-eb22-4147-8c46-df7d02879f37] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 15:27:07 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: e0adbec9-eb22-4147-8c46-df7d02879f37] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:27:07 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: e0adbec9-eb22-4147-8c46-df7d02879f37] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72382) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 15:27:07 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-43e02c7e-7c3e-45e7-b04d-ab078ebd458e tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] [instance: e0adbec9-eb22-4147-8c46-df7d02879f37] Found default for hw_cdrom_bus of ide {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:27:07 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-43e02c7e-7c3e-45e7-b04d-ab078ebd458e tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] [instance: e0adbec9-eb22-4147-8c46-df7d02879f37] Found default for hw_disk_bus of virtio {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:27:07 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-43e02c7e-7c3e-45e7-b04d-ab078ebd458e tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] [instance: e0adbec9-eb22-4147-8c46-df7d02879f37] Found default for hw_input_bus of None {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:27:07 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-43e02c7e-7c3e-45e7-b04d-ab078ebd458e tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] [instance: e0adbec9-eb22-4147-8c46-df7d02879f37] Found default for hw_pointer_model of None {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:27:07 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-43e02c7e-7c3e-45e7-b04d-ab078ebd458e tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] [instance: e0adbec9-eb22-4147-8c46-df7d02879f37] Found default for hw_video_model of virtio {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:27:07 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-43e02c7e-7c3e-45e7-b04d-ab078ebd458e tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] [instance: e0adbec9-eb22-4147-8c46-df7d02879f37] Found default for hw_vif_model of virtio {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:27:07 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: e0adbec9-eb22-4147-8c46-df7d02879f37] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 15:27:07 user nova-compute[72382]: DEBUG nova.virt.driver [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Emitting event <LifecycleEvent: 1691594827.1321914, e0adbec9-eb22-4147-8c46-df7d02879f37 => Started> {{(pid=72382) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 15:27:07 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: e0adbec9-eb22-4147-8c46-df7d02879f37] VM Started (Lifecycle Event)
Aug 09 15:27:07 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: e0adbec9-eb22-4147-8c46-df7d02879f37] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:27:07 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: e0adbec9-eb22-4147-8c46-df7d02879f37] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72382) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 15:27:07 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: e0adbec9-eb22-4147-8c46-df7d02879f37] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 15:27:07 user nova-compute[72382]: INFO nova.compute.manager [None req-43e02c7e-7c3e-45e7-b04d-ab078ebd458e tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] [instance: e0adbec9-eb22-4147-8c46-df7d02879f37] Took 7.87 seconds to spawn the instance on the hypervisor.
Aug 09 15:27:07 user nova-compute[72382]: DEBUG nova.compute.manager [None req-43e02c7e-7c3e-45e7-b04d-ab078ebd458e tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] [instance: e0adbec9-eb22-4147-8c46-df7d02879f37] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:27:07 user nova-compute[72382]: INFO nova.compute.manager [None req-43e02c7e-7c3e-45e7-b04d-ab078ebd458e tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] [instance: e0adbec9-eb22-4147-8c46-df7d02879f37] Took 8.78 seconds to build instance.
Aug 09 15:27:07 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-43e02c7e-7c3e-45e7-b04d-ab078ebd458e tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] Lock "e0adbec9-eb22-4147-8c46-df7d02879f37" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.884s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:27:07 user nova-compute[72382]: DEBUG nova.compute.manager [req-1bb5f4ca-01a4-4517-9650-e3e2b95c219c req-9a8a89aa-fdb1-45ce-9a9c-9fce9ad995a0 service nova] [instance: e0adbec9-eb22-4147-8c46-df7d02879f37] Received event network-vif-plugged-ae457c5d-81eb-466b-beb7-d9a3b3c11d59 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:27:07 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-1bb5f4ca-01a4-4517-9650-e3e2b95c219c req-9a8a89aa-fdb1-45ce-9a9c-9fce9ad995a0 service nova] Acquiring lock "e0adbec9-eb22-4147-8c46-df7d02879f37-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:27:07 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-1bb5f4ca-01a4-4517-9650-e3e2b95c219c req-9a8a89aa-fdb1-45ce-9a9c-9fce9ad995a0 service nova] Lock "e0adbec9-eb22-4147-8c46-df7d02879f37-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:27:07 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-1bb5f4ca-01a4-4517-9650-e3e2b95c219c req-9a8a89aa-fdb1-45ce-9a9c-9fce9ad995a0 service nova] Lock "e0adbec9-eb22-4147-8c46-df7d02879f37-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:27:07 user nova-compute[72382]: DEBUG nova.compute.manager [req-1bb5f4ca-01a4-4517-9650-e3e2b95c219c req-9a8a89aa-fdb1-45ce-9a9c-9fce9ad995a0 service nova] [instance: e0adbec9-eb22-4147-8c46-df7d02879f37] No waiting events found dispatching network-vif-plugged-ae457c5d-81eb-466b-beb7-d9a3b3c11d59 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:27:07 user nova-compute[72382]: WARNING nova.compute.manager [req-1bb5f4ca-01a4-4517-9650-e3e2b95c219c req-9a8a89aa-fdb1-45ce-9a9c-9fce9ad995a0 service nova] [instance: e0adbec9-eb22-4147-8c46-df7d02879f37] Received unexpected event network-vif-plugged-ae457c5d-81eb-466b-beb7-d9a3b3c11d59 for instance with vm_state active and task_state None.
Aug 09 15:27:07 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-5a02efe0-8485-4d22-bd41-1d55e3f6a486 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.312s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 15:27:07 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a02efe0-8485-4d22-bd41-1d55e3f6a486 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] <== connect_volume: return (1313ms) {'type': 'block', 'scsi_wwn': '23465613331343433', 'path': '/dev/sde'} {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 15:27:07 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5a02efe0-8485-4d22-bd41-1d55e3f6a486 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] [instance: 2f430d9a-9fbf-43cd-8c0d-e5dec162be71] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23465613331343433', 'path': '/dev/sde'} {{(pid=72382) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 15:27:07 user nova-compute[72382]: DEBUG nova.virt.libvirt.vif [None req-5a02efe0-8485-4d22-bd41-1d55e3f6a486 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T15:26:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-193859421',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-193859421',id=28,image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='080d1ded4cd94e5083ee0b7e691b7363',ramdisk_id='',reservation_id='r-7lwplflb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1187177274',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T15:26:46Z,user_data=None,user_id='e71af7a4912147cd9fab070cb77b275c',uuid=2f430d9a-9fbf-43cd-8c0d-e5dec162be71,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d13c4d4e-9004-4d4b-999d-619564a98542", "address": "fa:16:3e:10:88:6e", "network": {"id": "d47e3749-fdff-4112-bd72-69ca584efe1f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-302967634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "080d1ded4cd94e5083ee0b7e691b7363", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd13c4d4e-90", "ovs_interfaceid": "d13c4d4e-9004-4d4b-999d-619564a98542", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72382) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 15:27:07 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-5a02efe0-8485-4d22-bd41-1d55e3f6a486 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Converting VIF {"id": "d13c4d4e-9004-4d4b-999d-619564a98542", "address": "fa:16:3e:10:88:6e", "network": {"id": "d47e3749-fdff-4112-bd72-69ca584efe1f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-302967634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "080d1ded4cd94e5083ee0b7e691b7363", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd13c4d4e-90", "ovs_interfaceid": "d13c4d4e-9004-4d4b-999d-619564a98542", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 15:27:07 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-5a02efe0-8485-4d22-bd41-1d55e3f6a486 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:10:88:6e,bridge_name='br-int',has_traffic_filtering=True,id=d13c4d4e-9004-4d4b-999d-619564a98542,network=Network(d47e3749-fdff-4112-bd72-69ca584efe1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd13c4d4e-90') {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 15:27:07 user nova-compute[72382]: DEBUG nova.objects.instance [None req-5a02efe0-8485-4d22-bd41-1d55e3f6a486 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Lazy-loading 'pci_devices' on Instance uuid 2f430d9a-9fbf-43cd-8c0d-e5dec162be71 {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:27:07 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-5a02efe0-8485-4d22-bd41-1d55e3f6a486 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] [instance: 2f430d9a-9fbf-43cd-8c0d-e5dec162be71] End _get_guest_xml xml=<domain type="kvm">
Aug 09 15:27:07 user nova-compute[72382]:   <uuid>2f430d9a-9fbf-43cd-8c0d-e5dec162be71</uuid>
Aug 09 15:27:07 user nova-compute[72382]:   <name>instance-0000001c</name>
Aug 09 15:27:07 user nova-compute[72382]:   <memory>524288</memory>
Aug 09 15:27:07 user nova-compute[72382]:   <vcpu>1</vcpu>
Aug 09 15:27:07 user nova-compute[72382]:   <metadata>
Aug 09 15:27:07 user nova-compute[72382]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 15:27:07 user nova-compute[72382]:       <nova:package version="0.0.0"/>
Aug 09 15:27:07 user nova-compute[72382]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-193859421</nova:name>
Aug 09 15:27:07 user nova-compute[72382]:       <nova:creationTime>2023-08-09 15:27:06</nova:creationTime>
Aug 09 15:27:07 user nova-compute[72382]:       <nova:flavor name="m1.tiny">
Aug 09 15:27:07 user nova-compute[72382]:         <nova:memory>512</nova:memory>
Aug 09 15:27:07 user nova-compute[72382]:         <nova:disk>1</nova:disk>
Aug 09 15:27:07 user nova-compute[72382]:         <nova:swap>0</nova:swap>
Aug 09 15:27:07 user nova-compute[72382]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 15:27:07 user nova-compute[72382]:         <nova:vcpus>1</nova:vcpus>
Aug 09 15:27:07 user nova-compute[72382]:       </nova:flavor>
Aug 09 15:27:07 user nova-compute[72382]:       <nova:owner>
Aug 09 15:27:07 user nova-compute[72382]:         <nova:user uuid="e71af7a4912147cd9fab070cb77b275c">tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member</nova:user>
Aug 09 15:27:07 user nova-compute[72382]:         <nova:project uuid="080d1ded4cd94e5083ee0b7e691b7363">tempest-ServerBootFromVolumeStableRescueTest-1187177274</nova:project>
Aug 09 15:27:07 user nova-compute[72382]:       </nova:owner>
Aug 09 15:27:07 user nova-compute[72382]:       <nova:root type="image" uuid="a79f2cea-eb27-4631-aaf3-05e7d9e411b4"/>
Aug 09 15:27:07 user nova-compute[72382]:       <nova:ports>
Aug 09 15:27:07 user nova-compute[72382]:         <nova:port uuid="d13c4d4e-9004-4d4b-999d-619564a98542">
Aug 09 15:27:07 user nova-compute[72382]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 09 15:27:07 user nova-compute[72382]:         </nova:port>
Aug 09 15:27:07 user nova-compute[72382]:       </nova:ports>
Aug 09 15:27:07 user nova-compute[72382]:     </nova:instance>
Aug 09 15:27:07 user nova-compute[72382]:   </metadata>
Aug 09 15:27:07 user nova-compute[72382]:   <sysinfo type="smbios">
Aug 09 15:27:07 user nova-compute[72382]:     <system>
Aug 09 15:27:07 user nova-compute[72382]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 15:27:07 user nova-compute[72382]:       <entry name="product">OpenStack Nova</entry>
Aug 09 15:27:07 user nova-compute[72382]:       <entry name="version">0.0.0</entry>
Aug 09 15:27:07 user nova-compute[72382]:       <entry name="serial">2f430d9a-9fbf-43cd-8c0d-e5dec162be71</entry>
Aug 09 15:27:07 user nova-compute[72382]:       <entry name="uuid">2f430d9a-9fbf-43cd-8c0d-e5dec162be71</entry>
Aug 09 15:27:07 user nova-compute[72382]:       <entry name="family">Virtual Machine</entry>
Aug 09 15:27:07 user nova-compute[72382]:     </system>
Aug 09 15:27:07 user nova-compute[72382]:   </sysinfo>
Aug 09 15:27:07 user nova-compute[72382]:   <os>
Aug 09 15:27:07 user nova-compute[72382]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 15:27:07 user nova-compute[72382]:     <boot dev="hd"/>
Aug 09 15:27:07 user nova-compute[72382]:     <smbios mode="sysinfo"/>
Aug 09 15:27:07 user nova-compute[72382]:   </os>
Aug 09 15:27:07 user nova-compute[72382]:   <features>
Aug 09 15:27:07 user nova-compute[72382]:     <acpi/>
Aug 09 15:27:07 user nova-compute[72382]:     <apic/>
Aug 09 15:27:07 user nova-compute[72382]:     <vmcoreinfo/>
Aug 09 15:27:07 user nova-compute[72382]:   </features>
Aug 09 15:27:07 user nova-compute[72382]:   <clock offset="utc">
Aug 09 15:27:07 user nova-compute[72382]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 15:27:07 user nova-compute[72382]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 15:27:07 user nova-compute[72382]:     <timer name="hpet" present="no"/>
Aug 09 15:27:07 user nova-compute[72382]:   </clock>
Aug 09 15:27:07 user nova-compute[72382]:   <cpu mode="custom" match="exact">
Aug 09 15:27:07 user nova-compute[72382]:     <model>Nehalem</model>
Aug 09 15:27:07 user nova-compute[72382]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 15:27:07 user nova-compute[72382]:   </cpu>
Aug 09 15:27:07 user nova-compute[72382]:   <devices>
Aug 09 15:27:07 user nova-compute[72382]:     <disk type="block" device="disk">
Aug 09 15:27:07 user nova-compute[72382]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 15:27:07 user nova-compute[72382]:       <source dev="/dev/sde"/>
Aug 09 15:27:07 user nova-compute[72382]:       <target dev="vda" bus="virtio"/>
Aug 09 15:27:07 user nova-compute[72382]:       <serial>25503c6e-bfc0-4008-846a-8cad783fc0fb</serial>
Aug 09 15:27:07 user nova-compute[72382]:     </disk>
Aug 09 15:27:07 user nova-compute[72382]:     <interface type="ethernet">
Aug 09 15:27:07 user nova-compute[72382]:       <mac address="fa:16:3e:10:88:6e"/>
Aug 09 15:27:07 user nova-compute[72382]:       <model type="virtio"/>
Aug 09 15:27:07 user nova-compute[72382]:       <mtu size="1442"/>
Aug 09 15:27:07 user nova-compute[72382]:       <target dev="tapd13c4d4e-90"/>
Aug 09 15:27:07 user nova-compute[72382]:     </interface>
Aug 09 15:27:07 user nova-compute[72382]:     <serial type="pty">
Aug 09 15:27:07 user nova-compute[72382]:       <log file="/opt/stack/data/nova/instances/2f430d9a-9fbf-43cd-8c0d-e5dec162be71/console.log" append="off"/>
Aug 09 15:27:07 user nova-compute[72382]:     </serial>
Aug 09 15:27:07 user nova-compute[72382]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 15:27:07 user nova-compute[72382]:     <video>
Aug 09 15:27:07 user nova-compute[72382]:       <model type="virtio"/>
Aug 09 15:27:07 user nova-compute[72382]:     </video>
Aug 09 15:27:07 user nova-compute[72382]:     <rng model="virtio">
Aug 09 15:27:07 user nova-compute[72382]:       <backend model="random">/dev/urandom</backend>
Aug 09 15:27:07 user nova-compute[72382]:     </rng>
Aug 09 15:27:07 user nova-compute[72382]:     <controller type="usb" index="0" model="none"/>
Aug 09 15:27:07 user nova-compute[72382]:     <memballoon model="virtio">
Aug 09 15:27:07 user nova-compute[72382]:       <stats period="10"/>
Aug 09 15:27:07 user nova-compute[72382]:     </memballoon>
Aug 09 15:27:07 user nova-compute[72382]:   </devices>
Aug 09 15:27:07 user nova-compute[72382]: </domain>
Aug 09 15:27:07 user nova-compute[72382]:  {{(pid=72382) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 15:27:07 user nova-compute[72382]: DEBUG nova.virt.libvirt.vif [None req-5a02efe0-8485-4d22-bd41-1d55e3f6a486 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T15:26:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-193859421',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-193859421',id=28,image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='080d1ded4cd94e5083ee0b7e691b7363',ramdisk_id='',reservation_id='r-7lwplflb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1187177274',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T15:26:46Z,user_data=None,user_id='e71af7a4912147cd9fab070cb77b275c',uuid=2f430d9a-9fbf-43cd-8c0d-e5dec162be71,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d13c4d4e-9004-4d4b-999d-619564a98542", "address": "fa:16:3e:10:88:6e", "network": {"id": "d47e3749-fdff-4112-bd72-69ca584efe1f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-302967634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "080d1ded4cd94e5083ee0b7e691b7363", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd13c4d4e-90", "ovs_interfaceid": "d13c4d4e-9004-4d4b-999d-619564a98542", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 15:27:07 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-5a02efe0-8485-4d22-bd41-1d55e3f6a486 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Converting VIF {"id": "d13c4d4e-9004-4d4b-999d-619564a98542", "address": "fa:16:3e:10:88:6e", "network": {"id": "d47e3749-fdff-4112-bd72-69ca584efe1f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-302967634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "080d1ded4cd94e5083ee0b7e691b7363", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd13c4d4e-90", "ovs_interfaceid": "d13c4d4e-9004-4d4b-999d-619564a98542", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 15:27:07 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-5a02efe0-8485-4d22-bd41-1d55e3f6a486 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:10:88:6e,bridge_name='br-int',has_traffic_filtering=True,id=d13c4d4e-9004-4d4b-999d-619564a98542,network=Network(d47e3749-fdff-4112-bd72-69ca584efe1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd13c4d4e-90') {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 15:27:07 user nova-compute[72382]: DEBUG os_vif [None req-5a02efe0-8485-4d22-bd41-1d55e3f6a486 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:88:6e,bridge_name='br-int',has_traffic_filtering=True,id=d13c4d4e-9004-4d4b-999d-619564a98542,network=Network(d47e3749-fdff-4112-bd72-69ca584efe1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd13c4d4e-90') {{(pid=72382) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 15:27:07 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:27:07 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:27:07 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 15:27:07 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:27:07 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd13c4d4e-90, may_exist=True, interface_attrs={}) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:27:07 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd13c4d4e-90, col_values=(('external_ids', {'iface-id': 'd13c4d4e-9004-4d4b-999d-619564a98542', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:10:88:6e', 'vm-uuid': '2f430d9a-9fbf-43cd-8c0d-e5dec162be71'}),), if_exists=True) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:27:07 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:27:07 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:27:07 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:27:07 user nova-compute[72382]: INFO os_vif [None req-5a02efe0-8485-4d22-bd41-1d55e3f6a486 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:88:6e,bridge_name='br-int',has_traffic_filtering=True,id=d13c4d4e-9004-4d4b-999d-619564a98542,network=Network(d47e3749-fdff-4112-bd72-69ca584efe1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd13c4d4e-90')
Aug 09 15:27:07 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-5a02efe0-8485-4d22-bd41-1d55e3f6a486 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] No BDM found with device name vda, not building metadata. {{(pid=72382) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 15:27:07 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-5a02efe0-8485-4d22-bd41-1d55e3f6a486 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] No VIF found with MAC fa:16:3e:10:88:6e, not building metadata {{(pid=72382) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 15:27:09 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:27:09 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:27:09 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:27:09 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:27:09 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:27:09 user nova-compute[72382]: DEBUG nova.compute.manager [req-1219675e-bc5b-4dcd-912b-3fe515152476 req-0516db58-b9ac-4f58-b8dd-83dc4289956b service nova] [instance: 2f430d9a-9fbf-43cd-8c0d-e5dec162be71] Received event network-vif-plugged-d13c4d4e-9004-4d4b-999d-619564a98542 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:27:09 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-1219675e-bc5b-4dcd-912b-3fe515152476 req-0516db58-b9ac-4f58-b8dd-83dc4289956b service nova] Acquiring lock "2f430d9a-9fbf-43cd-8c0d-e5dec162be71-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:27:09 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-1219675e-bc5b-4dcd-912b-3fe515152476 req-0516db58-b9ac-4f58-b8dd-83dc4289956b service nova] Lock "2f430d9a-9fbf-43cd-8c0d-e5dec162be71-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:27:09 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-1219675e-bc5b-4dcd-912b-3fe515152476 req-0516db58-b9ac-4f58-b8dd-83dc4289956b service nova] Lock "2f430d9a-9fbf-43cd-8c0d-e5dec162be71-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:27:09 user nova-compute[72382]: DEBUG nova.compute.manager [req-1219675e-bc5b-4dcd-912b-3fe515152476 req-0516db58-b9ac-4f58-b8dd-83dc4289956b service nova] [instance: 2f430d9a-9fbf-43cd-8c0d-e5dec162be71] No waiting events found dispatching network-vif-plugged-d13c4d4e-9004-4d4b-999d-619564a98542 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:27:09 user nova-compute[72382]: WARNING nova.compute.manager [req-1219675e-bc5b-4dcd-912b-3fe515152476 req-0516db58-b9ac-4f58-b8dd-83dc4289956b service nova] [instance: 2f430d9a-9fbf-43cd-8c0d-e5dec162be71] Received unexpected event network-vif-plugged-d13c4d4e-9004-4d4b-999d-619564a98542 for instance with vm_state building and task_state spawning.
Aug 09 15:27:09 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:27:10 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:27:10 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:27:10 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:27:10 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:27:10 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:27:10 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:27:10 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Auditing locally available compute resources for user (node: user) {{(pid=72382) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 15:27:11 user nova-compute[72382]: DEBUG nova.virt.driver [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Emitting event <LifecycleEvent: 1691594831.354782, 2f430d9a-9fbf-43cd-8c0d-e5dec162be71 => Resumed> {{(pid=72382) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 15:27:11 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 2f430d9a-9fbf-43cd-8c0d-e5dec162be71] VM Resumed (Lifecycle Event)
Aug 09 15:27:11 user nova-compute[72382]: DEBUG nova.compute.manager [None req-5a02efe0-8485-4d22-bd41-1d55e3f6a486 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] [instance: 2f430d9a-9fbf-43cd-8c0d-e5dec162be71] Instance event wait completed in 0 seconds for  {{(pid=72382) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 15:27:11 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-5a02efe0-8485-4d22-bd41-1d55e3f6a486 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] [instance: 2f430d9a-9fbf-43cd-8c0d-e5dec162be71] Guest created on hypervisor {{(pid=72382) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 15:27:11 user nova-compute[72382]: INFO nova.virt.libvirt.driver [-] [instance: 2f430d9a-9fbf-43cd-8c0d-e5dec162be71] Instance spawned successfully.
Aug 09 15:27:11 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-5a02efe0-8485-4d22-bd41-1d55e3f6a486 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] [instance: 2f430d9a-9fbf-43cd-8c0d-e5dec162be71] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 15:27:11 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 2f430d9a-9fbf-43cd-8c0d-e5dec162be71] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:27:11 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 2f430d9a-9fbf-43cd-8c0d-e5dec162be71] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72382) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 15:27:11 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-5a02efe0-8485-4d22-bd41-1d55e3f6a486 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] [instance: 2f430d9a-9fbf-43cd-8c0d-e5dec162be71] Found default for hw_cdrom_bus of ide {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:27:11 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-5a02efe0-8485-4d22-bd41-1d55e3f6a486 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] [instance: 2f430d9a-9fbf-43cd-8c0d-e5dec162be71] Found default for hw_disk_bus of virtio {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:27:11 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-5a02efe0-8485-4d22-bd41-1d55e3f6a486 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] [instance: 2f430d9a-9fbf-43cd-8c0d-e5dec162be71] Found default for hw_input_bus of None {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:27:11 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-5a02efe0-8485-4d22-bd41-1d55e3f6a486 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] [instance: 2f430d9a-9fbf-43cd-8c0d-e5dec162be71] Found default for hw_pointer_model of None {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:27:11 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-5a02efe0-8485-4d22-bd41-1d55e3f6a486 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] [instance: 2f430d9a-9fbf-43cd-8c0d-e5dec162be71] Found default for hw_video_model of virtio {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:27:11 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-5a02efe0-8485-4d22-bd41-1d55e3f6a486 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] [instance: 2f430d9a-9fbf-43cd-8c0d-e5dec162be71] Found default for hw_vif_model of virtio {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:27:11 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 2f430d9a-9fbf-43cd-8c0d-e5dec162be71] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 15:27:11 user nova-compute[72382]: DEBUG nova.virt.driver [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Emitting event <LifecycleEvent: 1691594831.3563757, 2f430d9a-9fbf-43cd-8c0d-e5dec162be71 => Started> {{(pid=72382) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 15:27:11 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 2f430d9a-9fbf-43cd-8c0d-e5dec162be71] VM Started (Lifecycle Event)
Aug 09 15:27:11 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 2f430d9a-9fbf-43cd-8c0d-e5dec162be71] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:27:11 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 2f430d9a-9fbf-43cd-8c0d-e5dec162be71] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72382) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 15:27:11 user nova-compute[72382]: INFO nova.compute.manager [None req-5a02efe0-8485-4d22-bd41-1d55e3f6a486 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] [instance: 2f430d9a-9fbf-43cd-8c0d-e5dec162be71] Took 5.30 seconds to spawn the instance on the hypervisor.
Aug 09 15:27:11 user nova-compute[72382]: DEBUG nova.compute.manager [None req-5a02efe0-8485-4d22-bd41-1d55e3f6a486 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] [instance: 2f430d9a-9fbf-43cd-8c0d-e5dec162be71] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:27:11 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 2f430d9a-9fbf-43cd-8c0d-e5dec162be71] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 15:27:11 user nova-compute[72382]: INFO nova.compute.manager [None req-5a02efe0-8485-4d22-bd41-1d55e3f6a486 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] [instance: 2f430d9a-9fbf-43cd-8c0d-e5dec162be71] Took 26.47 seconds to build instance.
Aug 09 15:27:11 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-5a02efe0-8485-4d22-bd41-1d55e3f6a486 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Lock "2f430d9a-9fbf-43cd-8c0d-e5dec162be71" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 26.577s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:27:11 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0/disk.rescue --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:27:11 user nova-compute[72382]: DEBUG nova.compute.manager [req-9827a5ca-3abe-4fe4-9926-02c21ff9427d req-e5db2b49-310c-4d92-b41b-84f7c79e9f16 service nova] [instance: 14c97840-88c0-4a8e-96e8-2e7da318ad07] Received event network-changed-f22c0d53-f0da-4bc9-bf7b-c10fe61e2e1f {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:27:11 user nova-compute[72382]: DEBUG nova.compute.manager [req-9827a5ca-3abe-4fe4-9926-02c21ff9427d req-e5db2b49-310c-4d92-b41b-84f7c79e9f16 service nova] [instance: 14c97840-88c0-4a8e-96e8-2e7da318ad07] Refreshing instance network info cache due to event network-changed-f22c0d53-f0da-4bc9-bf7b-c10fe61e2e1f. {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 15:27:11 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-9827a5ca-3abe-4fe4-9926-02c21ff9427d req-e5db2b49-310c-4d92-b41b-84f7c79e9f16 service nova] Acquiring lock "refresh_cache-14c97840-88c0-4a8e-96e8-2e7da318ad07" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 15:27:11 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-9827a5ca-3abe-4fe4-9926-02c21ff9427d req-e5db2b49-310c-4d92-b41b-84f7c79e9f16 service nova] Acquired lock "refresh_cache-14c97840-88c0-4a8e-96e8-2e7da318ad07" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 15:27:11 user nova-compute[72382]: DEBUG nova.network.neutron [req-9827a5ca-3abe-4fe4-9926-02c21ff9427d req-e5db2b49-310c-4d92-b41b-84f7c79e9f16 service nova] [instance: 14c97840-88c0-4a8e-96e8-2e7da318ad07] Refreshing network info cache for port f22c0d53-f0da-4bc9-bf7b-c10fe61e2e1f {{(pid=72382) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 15:27:11 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0/disk.rescue --force-share --output=json" returned: 0 in 0.161s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:27:11 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0/disk.rescue --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:27:11 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0/disk.rescue --force-share --output=json" returned: 0 in 0.183s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:27:11 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] skipping disk /opt/stack/data/nova/instances/e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0/disk (vdb) as it is a volume {{(pid=72382) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 15:27:11 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ea8f68c-3dc1-45ac-a7f3-bca32f929add/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:27:12 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ea8f68c-3dc1-45ac-a7f3-bca32f929add/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:27:12 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ea8f68c-3dc1-45ac-a7f3-bca32f929add/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:27:12 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ea8f68c-3dc1-45ac-a7f3-bca32f929add/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:27:12 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f780040f-b789-4b72-8986-813c7b9fe4a6/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:27:12 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f780040f-b789-4b72-8986-813c7b9fe4a6/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:27:12 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f780040f-b789-4b72-8986-813c7b9fe4a6/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:27:12 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:27:12 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f780040f-b789-4b72-8986-813c7b9fe4a6/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:27:12 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/266be814-4a2b-4f8e-a0f6-e8821fdeb95d/disk.rescue --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:27:12 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/266be814-4a2b-4f8e-a0f6-e8821fdeb95d/disk.rescue --force-share --output=json" returned: 0 in 0.161s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:27:12 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/266be814-4a2b-4f8e-a0f6-e8821fdeb95d/disk.rescue --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:27:12 user nova-compute[72382]: DEBUG nova.network.neutron [req-9827a5ca-3abe-4fe4-9926-02c21ff9427d req-e5db2b49-310c-4d92-b41b-84f7c79e9f16 service nova] [instance: 14c97840-88c0-4a8e-96e8-2e7da318ad07] Updated VIF entry in instance network info cache for port f22c0d53-f0da-4bc9-bf7b-c10fe61e2e1f. {{(pid=72382) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 15:27:12 user nova-compute[72382]: DEBUG nova.network.neutron [req-9827a5ca-3abe-4fe4-9926-02c21ff9427d req-e5db2b49-310c-4d92-b41b-84f7c79e9f16 service nova] [instance: 14c97840-88c0-4a8e-96e8-2e7da318ad07] Updating instance_info_cache with network_info: [{"id": "f22c0d53-f0da-4bc9-bf7b-c10fe61e2e1f", "address": "fa:16:3e:72:44:b1", "network": {"id": "a85a6e1f-20f5-4719-90d2-0dc23ce525cd", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-780716970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c1a50eacfd0414bbc13e3fd4087e998", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf22c0d53-f0", "ovs_interfaceid": "f22c0d53-f0da-4bc9-bf7b-c10fe61e2e1f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:27:12 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-9827a5ca-3abe-4fe4-9926-02c21ff9427d req-e5db2b49-310c-4d92-b41b-84f7c79e9f16 service nova] Releasing lock "refresh_cache-14c97840-88c0-4a8e-96e8-2e7da318ad07" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 15:27:12 user nova-compute[72382]: DEBUG nova.compute.manager [req-9827a5ca-3abe-4fe4-9926-02c21ff9427d req-e5db2b49-310c-4d92-b41b-84f7c79e9f16 service nova] [instance: 2f430d9a-9fbf-43cd-8c0d-e5dec162be71] Received event network-vif-plugged-d13c4d4e-9004-4d4b-999d-619564a98542 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:27:12 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-9827a5ca-3abe-4fe4-9926-02c21ff9427d req-e5db2b49-310c-4d92-b41b-84f7c79e9f16 service nova] Acquiring lock "2f430d9a-9fbf-43cd-8c0d-e5dec162be71-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:27:12 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-9827a5ca-3abe-4fe4-9926-02c21ff9427d req-e5db2b49-310c-4d92-b41b-84f7c79e9f16 service nova] Lock "2f430d9a-9fbf-43cd-8c0d-e5dec162be71-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:27:12 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-9827a5ca-3abe-4fe4-9926-02c21ff9427d req-e5db2b49-310c-4d92-b41b-84f7c79e9f16 service nova] Lock "2f430d9a-9fbf-43cd-8c0d-e5dec162be71-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:27:12 user nova-compute[72382]: DEBUG nova.compute.manager [req-9827a5ca-3abe-4fe4-9926-02c21ff9427d req-e5db2b49-310c-4d92-b41b-84f7c79e9f16 service nova] [instance: 2f430d9a-9fbf-43cd-8c0d-e5dec162be71] No waiting events found dispatching network-vif-plugged-d13c4d4e-9004-4d4b-999d-619564a98542 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:27:12 user nova-compute[72382]: WARNING nova.compute.manager [req-9827a5ca-3abe-4fe4-9926-02c21ff9427d req-e5db2b49-310c-4d92-b41b-84f7c79e9f16 service nova] [instance: 2f430d9a-9fbf-43cd-8c0d-e5dec162be71] Received unexpected event network-vif-plugged-d13c4d4e-9004-4d4b-999d-619564a98542 for instance with vm_state active and task_state None.
Aug 09 15:27:12 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/266be814-4a2b-4f8e-a0f6-e8821fdeb95d/disk.rescue --force-share --output=json" returned: 0 in 0.155s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:27:12 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/266be814-4a2b-4f8e-a0f6-e8821fdeb95d/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:27:13 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/266be814-4a2b-4f8e-a0f6-e8821fdeb95d/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:27:13 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/266be814-4a2b-4f8e-a0f6-e8821fdeb95d/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:27:13 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/266be814-4a2b-4f8e-a0f6-e8821fdeb95d/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:27:13 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72382) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 15:27:13 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14c97840-88c0-4a8e-96e8-2e7da318ad07/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:27:13 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14c97840-88c0-4a8e-96e8-2e7da318ad07/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:27:13 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14c97840-88c0-4a8e-96e8-2e7da318ad07/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:27:13 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14c97840-88c0-4a8e-96e8-2e7da318ad07/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:27:13 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-1bb878f1-75cf-485c-b352-c4353ac4fca3 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Acquiring lock "14c97840-88c0-4a8e-96e8-2e7da318ad07" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:27:13 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-1bb878f1-75cf-485c-b352-c4353ac4fca3 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Lock "14c97840-88c0-4a8e-96e8-2e7da318ad07" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:27:13 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44afd1bf-fa5c-4b3e-8752-b16853fef54e/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:27:13 user nova-compute[72382]: DEBUG nova.objects.instance [None req-1bb878f1-75cf-485c-b352-c4353ac4fca3 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Lazy-loading 'flavor' on Instance uuid 14c97840-88c0-4a8e-96e8-2e7da318ad07 {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:27:13 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-1bb878f1-75cf-485c-b352-c4353ac4fca3 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Lock "14c97840-88c0-4a8e-96e8-2e7da318ad07" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.105s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:27:13 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44afd1bf-fa5c-4b3e-8752-b16853fef54e/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:27:13 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44afd1bf-fa5c-4b3e-8752-b16853fef54e/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:27:13 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-1bb878f1-75cf-485c-b352-c4353ac4fca3 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Acquiring lock "14c97840-88c0-4a8e-96e8-2e7da318ad07" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:27:13 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-1bb878f1-75cf-485c-b352-c4353ac4fca3 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Lock "14c97840-88c0-4a8e-96e8-2e7da318ad07" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:27:13 user nova-compute[72382]: INFO nova.compute.manager [None req-1bb878f1-75cf-485c-b352-c4353ac4fca3 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] [instance: 14c97840-88c0-4a8e-96e8-2e7da318ad07] Attaching volume e62d4416-be8c-4327-9a51-0cc509109c53 to /dev/vdb
Aug 09 15:27:14 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44afd1bf-fa5c-4b3e-8752-b16853fef54e/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:27:14 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6296ba5d-bcc6-405a-a635-0e9aa6114f7b/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:27:14 user nova-compute[72382]: DEBUG os_brick.utils [None req-1bb878f1-75cf-485c-b352-c4353ac4fca3 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 15:27:14 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:27:14 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:27:14 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[84e27286-7b22-4b4c-950d-6669283a89b8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d2cfa7015fe\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:27:14 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:27:14 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:27:14 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[7644b2a3-5307-4086-b9b0-5bd988344d66]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:27:14 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:27:14 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:27:14 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae116be1-ed38-410f-a3e3-4914b304e73d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:27:14 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cf0b6a0-26a2-4e0c-8bcc-61b94f1a8e8a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:27:14 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-1bb878f1-75cf-485c-b352-c4353ac4fca3 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Running cmd (subprocess): nvme version {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:27:14 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-1bb878f1-75cf-485c-b352-c4353ac4fca3 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] 'nvme version' failed. Not Retrying. {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 15:27:14 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1bb878f1-75cf-485c-b352-c4353ac4fca3 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] nvme not present on system {{(pid=72382) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 15:27:14 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:27:14 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6296ba5d-bcc6-405a-a635-0e9aa6114f7b/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:27:14 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6296ba5d-bcc6-405a-a635-0e9aa6114f7b/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:27:14 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 15:27:14 user nova-compute[72382]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 15:27:14 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[d35ce9ba-d88d-4ced-ac82-ecb191cb7ec4]: (4, '') {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:27:14 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.lightos [None req-1bb878f1-75cf-485c-b352-c4353ac4fca3 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72382) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 15:27:14 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.lightos [None req-1bb878f1-75cf-485c-b352-c4353ac4fca3 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72382) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 15:27:14 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.lightos [None req-1bb878f1-75cf-485c-b352-c4353ac4fca3 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] LIGHTOS: no hostnqn found. {{(pid=72382) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 15:27:14 user nova-compute[72382]: DEBUG os_brick.utils [None req-1bb878f1-75cf-485c-b352-c4353ac4fca3 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] <== get_connector_properties: return (174ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d2cfa7015fe', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 15:27:14 user nova-compute[72382]: DEBUG nova.virt.block_device [None req-1bb878f1-75cf-485c-b352-c4353ac4fca3 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] [instance: 14c97840-88c0-4a8e-96e8-2e7da318ad07] Updating existing volume attachment record: 53c335a9-dd38-46fd-9994-7129340339c9 {{(pid=72382) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 15:27:14 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:27:14 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6296ba5d-bcc6-405a-a635-0e9aa6114f7b/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:27:14 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61976531-76ae-4a1c-8950-0af784be376e/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:27:14 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61976531-76ae-4a1c-8950-0af784be376e/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:27:14 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61976531-76ae-4a1c-8950-0af784be376e/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:27:14 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61976531-76ae-4a1c-8950-0af784be376e/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:27:14 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72382) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 15:27:14 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ccbfda2-8bcd-4ec1-972a-cf49a62b1583/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:27:14 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ccbfda2-8bcd-4ec1-972a-cf49a62b1583/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:27:14 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ccbfda2-8bcd-4ec1-972a-cf49a62b1583/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:27:15 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ccbfda2-8bcd-4ec1-972a-cf49a62b1583/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:27:15 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=72382) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 15:27:15 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48161b45-d21a-4fb1-ae90-4613d849bfa7/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:27:15 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48161b45-d21a-4fb1-ae90-4613d849bfa7/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:27:15 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48161b45-d21a-4fb1-ae90-4613d849bfa7/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:27:15 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48161b45-d21a-4fb1-ae90-4613d849bfa7/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:27:15 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0adbec9-eb22-4147-8c46-df7d02879f37/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:27:15 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0adbec9-eb22-4147-8c46-df7d02879f37/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:27:15 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0adbec9-eb22-4147-8c46-df7d02879f37/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:27:15 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0adbec9-eb22-4147-8c46-df7d02879f37/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:27:16 user nova-compute[72382]: WARNING nova.virt.libvirt.driver [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 15:27:16 user nova-compute[72382]: WARNING nova.virt.libvirt.driver [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 15:27:16 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Hypervisor/Node resource view: name=user free_ram=7135MB free_disk=25.35906982421875GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72382) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 15:27:16 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:27:16 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:27:16 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance f780040f-b789-4b72-8986-813c7b9fe4a6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:27:16 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance 44afd1bf-fa5c-4b3e-8752-b16853fef54e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:27:16 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance 266be814-4a2b-4f8e-a0f6-e8821fdeb95d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:27:16 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance 0f510d75-5d1e-4a5c-b38f-731c299f0f5a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:27:16 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance 6296ba5d-bcc6-405a-a635-0e9aa6114f7b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:27:16 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance 6ea8f68c-3dc1-45ac-a7f3-bca32f929add actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:27:16 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance 61976531-76ae-4a1c-8950-0af784be376e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:27:16 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:27:16 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance 14c97840-88c0-4a8e-96e8-2e7da318ad07 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:27:16 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance 48161b45-d21a-4fb1-ae90-4613d849bfa7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:27:16 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance 4ccbfda2-8bcd-4ec1-972a-cf49a62b1583 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:27:16 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance 2f430d9a-9fbf-43cd-8c0d-e5dec162be71 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:27:16 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance e0adbec9-eb22-4147-8c46-df7d02879f37 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:27:16 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=72382) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 15:27:16 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=72382) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 15:27:16 user nova-compute[72382]: DEBUG nova.compute.provider_tree [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Inventory has not changed in ProviderTree for provider: 7b15b0e5-df4d-49db-833b-2855d21d10ae {{(pid=72382) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 15:27:16 user nova-compute[72382]: DEBUG nova.scheduler.client.report [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Inventory has not changed for provider 7b15b0e5-df4d-49db-833b-2855d21d10ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72382) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 15:27:16 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Compute_service record updated for user:user {{(pid=72382) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 15:27:16 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.614s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:27:17 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:27:18 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:27:18 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:27:18 user nova-compute[72382]: DEBUG nova.compute.manager [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Starting heal instance info cache {{(pid=72382) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 15:27:19 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-10a50243-ac72-4345-938d-c5ad0537185d tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] Acquiring lock "6296ba5d-bcc6-405a-a635-0e9aa6114f7b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:27:19 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-10a50243-ac72-4345-938d-c5ad0537185d tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] Lock "6296ba5d-bcc6-405a-a635-0e9aa6114f7b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:27:19 user nova-compute[72382]: DEBUG nova.objects.instance [None req-10a50243-ac72-4345-938d-c5ad0537185d tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] Lazy-loading 'flavor' on Instance uuid 6296ba5d-bcc6-405a-a635-0e9aa6114f7b {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:27:19 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Acquiring lock "refresh_cache-0f510d75-5d1e-4a5c-b38f-731c299f0f5a" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 15:27:19 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Acquired lock "refresh_cache-0f510d75-5d1e-4a5c-b38f-731c299f0f5a" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 15:27:19 user nova-compute[72382]: DEBUG nova.network.neutron [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] [instance: 0f510d75-5d1e-4a5c-b38f-731c299f0f5a] Forcefully refreshing network info cache for instance {{(pid=72382) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 15:27:19 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-10a50243-ac72-4345-938d-c5ad0537185d tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] Lock "6296ba5d-bcc6-405a-a635-0e9aa6114f7b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.068s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:27:19 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-10a50243-ac72-4345-938d-c5ad0537185d tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] Acquiring lock "6296ba5d-bcc6-405a-a635-0e9aa6114f7b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:27:19 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-10a50243-ac72-4345-938d-c5ad0537185d tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] Lock "6296ba5d-bcc6-405a-a635-0e9aa6114f7b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:27:19 user nova-compute[72382]: INFO nova.compute.manager [None req-10a50243-ac72-4345-938d-c5ad0537185d tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] [instance: 6296ba5d-bcc6-405a-a635-0e9aa6114f7b] Attaching volume 398b5741-5332-4210-a0b3-58c2a51df083 to /dev/vdb
Aug 09 15:27:19 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:27:19 user nova-compute[72382]: DEBUG os_brick.utils [None req-10a50243-ac72-4345-938d-c5ad0537185d tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 15:27:19 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:27:19 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:27:19 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[8146a831-146d-4b51-9aef-88a84140b514]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d2cfa7015fe\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:27:19 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:27:19 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:27:19 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e92bb30-4062-4a26-8cab-48d85f0afd12]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:27:19 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:27:19 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:27:19 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[bca05ad8-270e-47bd-bb2d-9994e9b654c0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:27:19 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[842695fe-1922-4056-8f04-df6014d6a00c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:27:19 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-10a50243-ac72-4345-938d-c5ad0537185d tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] Running cmd (subprocess): nvme version {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:27:19 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-10a50243-ac72-4345-938d-c5ad0537185d tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] 'nvme version' failed. Not Retrying. {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 15:27:19 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.nvmeof [None req-10a50243-ac72-4345-938d-c5ad0537185d tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] nvme not present on system {{(pid=72382) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 15:27:19 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:27:19 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 15:27:19 user nova-compute[72382]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 15:27:19 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8ff1240-fbdb-47b7-bf54-b4f918d9b990]: (4, '') {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:27:19 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.lightos [None req-10a50243-ac72-4345-938d-c5ad0537185d tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72382) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 15:27:19 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.lightos [None req-10a50243-ac72-4345-938d-c5ad0537185d tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72382) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 15:27:19 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.lightos [None req-10a50243-ac72-4345-938d-c5ad0537185d tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] LIGHTOS: no hostnqn found. {{(pid=72382) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 15:27:19 user nova-compute[72382]: DEBUG os_brick.utils [None req-10a50243-ac72-4345-938d-c5ad0537185d tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d2cfa7015fe', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 15:27:19 user nova-compute[72382]: DEBUG nova.virt.block_device [None req-10a50243-ac72-4345-938d-c5ad0537185d tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] [instance: 6296ba5d-bcc6-405a-a635-0e9aa6114f7b] Updating existing volume attachment record: 4af84c8c-cab8-4efd-ad2f-c26e4829e9ca {{(pid=72382) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 15:27:19 user nova-compute[72382]: DEBUG nova.network.neutron [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] [instance: 0f510d75-5d1e-4a5c-b38f-731c299f0f5a] Updating instance_info_cache with network_info: [{"id": "c67a8d45-c4ba-4302-940f-c05799ecc732", "address": "fa:16:3e:02:6d:5d", "network": {"id": "d47e3749-fdff-4112-bd72-69ca584efe1f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-302967634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "080d1ded4cd94e5083ee0b7e691b7363", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc67a8d45-c4", "ovs_interfaceid": "c67a8d45-c4ba-4302-940f-c05799ecc732", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:27:19 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Releasing lock "refresh_cache-0f510d75-5d1e-4a5c-b38f-731c299f0f5a" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 15:27:19 user nova-compute[72382]: DEBUG nova.compute.manager [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] [instance: 0f510d75-5d1e-4a5c-b38f-731c299f0f5a] Updated the network info_cache for instance {{(pid=72382) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 15:27:19 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:27:19 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:27:19 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:27:19 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:27:19 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:27:19 user nova-compute[72382]: DEBUG nova.compute.manager [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72382) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 15:27:22 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:27:24 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:27:27 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:27:27 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:27:29 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-10a50243-ac72-4345-938d-c5ad0537185d tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] [instance: 6296ba5d-bcc6-405a-a635-0e9aa6114f7b] Calling os-brick to attach iSCSI Volume {{(pid=72382) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 15:27:29 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-10a50243-ac72-4345-938d-c5ad0537185d tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2a0c768340>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:398b5741-5332-4210-a0b3-58c2a51df083'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xQbevBKu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 15:27:29 user nova-compute[72382]: WARNING os_brick.initiator.connectors.base [None req-10a50243-ac72-4345-938d-c5ad0537185d tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 15:27:29 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-10a50243-ac72-4345-938d-c5ad0537185d tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 15:27:29 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-10a50243-ac72-4345-938d-c5ad0537185d tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 15:27:29 user nova-compute[72382]: WARNING os_brick.initiator.connectors.base [None req-10a50243-ac72-4345-938d-c5ad0537185d tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 15:27:29 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-10a50243-ac72-4345-938d-c5ad0537185d tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:398b5741-5332-4210-a0b3-58c2a51df083" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 15:27:29 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-10a50243-ac72-4345-938d-c5ad0537185d tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:398b5741-5332-4210-a0b3-58c2a51df083" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 15:27:29 user nova-compute[72382]: INFO os_brick.initiator.connectors.iscsi [None req-10a50243-ac72-4345-938d-c5ad0537185d tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 15:27:29 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:398b5741-5332-4210-a0b3-58c2a51df083 -p 172.16.0.220:3260 {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:27:29 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:398b5741-5332-4210-a0b3-58c2a51df083 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:27:29 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4a14805-6222-425c-8306-f3b56be85e33]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:27:29 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-10a50243-ac72-4345-938d-c5ad0537185d tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 15:27:29 user nova-compute[72382]:  {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:27:29 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:398b5741-5332-4210-a0b3-58c2a51df083 -p 172.16.0.220:3260 --interface default --op new {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:27:29 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:398b5741-5332-4210-a0b3-58c2a51df083 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:27:29 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[79ba81ca-4b64-4067-9210-197bb7114b92]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:398b5741-5332-4210-a0b3-58c2a51df083] added\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:27:29 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-10a50243-ac72-4345-938d-c5ad0537185d tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:398b5741-5332-4210-a0b3-58c2a51df083] added
Aug 09 15:27:29 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:27:29 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:398b5741-5332-4210-a0b3-58c2a51df083 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:27:29 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:398b5741-5332-4210-a0b3-58c2a51df083 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:27:29 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[4731fd97-eaa6-4b03-bc8e-20158ec99763]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:27:29 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-10a50243-ac72-4345-938d-c5ad0537185d tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:27:29 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:398b5741-5332-4210-a0b3-58c2a51df083 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:27:29 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:398b5741-5332-4210-a0b3-58c2a51df083 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:27:29 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[58b7be1b-21a8-4860-ac5d-13bbddda7671]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:27:29 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-10a50243-ac72-4345-938d-c5ad0537185d tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:27:29 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:398b5741-5332-4210-a0b3-58c2a51df083 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xQbevBKu {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:27:29 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:398b5741-5332-4210-a0b3-58c2a51df083 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xQbevBKu" returned: 0 in 0.019s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:27:29 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[4897f0e9-f9db-4632-a537-ef5d02d890f0]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:27:29 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-10a50243-ac72-4345-938d-c5ad0537185d tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xQbevBKu'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:27:29 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:398b5741-5332-4210-a0b3-58c2a51df083 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:27:29 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:398b5741-5332-4210-a0b3-58c2a51df083 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:27:29 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5dd3eac-75c7-4866-88cd-f66c3ca8e8cd]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:27:29 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:27:29 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-10a50243-ac72-4345-938d-c5ad0537185d tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:27:29 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:27:29 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:27:29 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[948986bc-0b89-4d3d-9d0c-b91be2e2e4d3]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9572706e-c54c-42c2-9cf0-2690cdf4cca2 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd90521a-f3b5-485c-9fb9-61ab37267f3a (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25503c6e-bfc0-4008-846a-8cad783fc0fb (non-flash)\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:27:29 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-10a50243-ac72-4345-938d-c5ad0537185d tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)
Aug 09 15:27:29 user nova-compute[72382]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9572706e-c54c-42c2-9cf0-2690cdf4cca2 (non-flash)
Aug 09 15:27:29 user nova-compute[72382]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd90521a-f3b5-485c-9fb9-61ab37267f3a (non-flash)
Aug 09 15:27:29 user nova-compute[72382]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25503c6e-bfc0-4008-846a-8cad783fc0fb (non-flash)
Aug 09 15:27:29 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 15:27:29 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-10a50243-ac72-4345-938d-c5ad0537185d tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)
Aug 09 15:27:29 user nova-compute[72382]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9572706e-c54c-42c2-9cf0-2690cdf4cca2 (non-flash)
Aug 09 15:27:29 user nova-compute[72382]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd90521a-f3b5-485c-9fb9-61ab37267f3a (non-flash)
Aug 09 15:27:29 user nova-compute[72382]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25503c6e-bfc0-4008-846a-8cad783fc0fb (non-flash)
Aug 09 15:27:29 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 15:27:29 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:398b5741-5332-4210-a0b3-58c2a51df083 -p 172.16.0.220:3260 --login {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:27:29 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:398b5741-5332-4210-a0b3-58c2a51df083 -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:27:29 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[8805b0d9-d9e7-493a-8757-7606940b1980]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:398b5741-5332-4210-a0b3-58c2a51df083, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:398b5741-5332-4210-a0b3-58c2a51df083, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:27:29 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-10a50243-ac72-4345-938d-c5ad0537185d tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:398b5741-5332-4210-a0b3-58c2a51df083, portal: 172.16.0.220,3260]
Aug 09 15:27:29 user nova-compute[72382]: Login to [iface: default, target: iqn.2010-10.org.openstack:398b5741-5332-4210-a0b3-58c2a51df083, portal: 172.16.0.220,3260] successful.
Aug 09 15:27:29 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:27:29 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:398b5741-5332-4210-a0b3-58c2a51df083 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:27:29 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:398b5741-5332-4210-a0b3-58c2a51df083 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:27:29 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[238d7968-098f-4e25-80d0-e6c1d84a0c92]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:27:29 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-10a50243-ac72-4345-938d-c5ad0537185d tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:27:29 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:27:29 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:27:29 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[0967311b-62ab-47f8-9747-13bb23d6c317]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9572706e-c54c-42c2-9cf0-2690cdf4cca2 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd90521a-f3b5-485c-9fb9-61ab37267f3a (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25503c6e-bfc0-4008-846a-8cad783fc0fb (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:398b5741-5332-4210-a0b3-58c2a51df083 (non-flash)\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:27:29 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-10a50243-ac72-4345-938d-c5ad0537185d tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)
Aug 09 15:27:29 user nova-compute[72382]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9572706e-c54c-42c2-9cf0-2690cdf4cca2 (non-flash)
Aug 09 15:27:29 user nova-compute[72382]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd90521a-f3b5-485c-9fb9-61ab37267f3a (non-flash)
Aug 09 15:27:29 user nova-compute[72382]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25503c6e-bfc0-4008-846a-8cad783fc0fb (non-flash)
Aug 09 15:27:29 user nova-compute[72382]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:398b5741-5332-4210-a0b3-58c2a51df083 (non-flash)
Aug 09 15:27:29 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 15:27:29 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-10a50243-ac72-4345-938d-c5ad0537185d tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)
Aug 09 15:27:29 user nova-compute[72382]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9572706e-c54c-42c2-9cf0-2690cdf4cca2 (non-flash)
Aug 09 15:27:29 user nova-compute[72382]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd90521a-f3b5-485c-9fb9-61ab37267f3a (non-flash)
Aug 09 15:27:29 user nova-compute[72382]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25503c6e-bfc0-4008-846a-8cad783fc0fb (non-flash)
Aug 09 15:27:29 user nova-compute[72382]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:398b5741-5332-4210-a0b3-58c2a51df083 (non-flash)
Aug 09 15:27:29 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 15:27:29 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-10a50243-ac72-4345-938d-c5ad0537185d tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:398b5741-5332-4210-a0b3-58c2a51df083" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.321s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 15:27:29 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-10a50243-ac72-4345-938d-c5ad0537185d tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] Connected to 172.16.0.220:3260 {{(pid=72382) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 15:27:29 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-10a50243-ac72-4345-938d-c5ad0537185d tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] HCTL ('37', '-', '-', 0) found on session 32 with lun 0 {{(pid=72382) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 15:27:29 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-10a50243-ac72-4345-938d-c5ad0537185d tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=72382) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 15:27:29 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:27:29 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.017s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:27:29 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[017ac1b5-7870-41ef-8680-24850dba082f]: (4, ('- - 0', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:27:29 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-10a50243-ac72-4345-938d-c5ad0537185d tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] Searching for a device in session 32 and hctl ['37', '*', '*', 0] yield: None {{(pid=72382) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 15:27:30 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-10a50243-ac72-4345-938d-c5ad0537185d tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] Searching for a device in session 32 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=72382) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 15:27:30 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-10a50243-ac72-4345-938d-c5ad0537185d tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xQbevBKu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72382) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 15:27:30 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-10a50243-ac72-4345-938d-c5ad0537185d tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.352s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 15:27:30 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-10a50243-ac72-4345-938d-c5ad0537185d tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] <== connect_volume: return (1354ms) {'type': 'block', 'scsi_wwn': '23136383036343334', 'path': '/dev/sdf'} {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 15:27:30 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-10a50243-ac72-4345-938d-c5ad0537185d tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] [instance: 6296ba5d-bcc6-405a-a635-0e9aa6114f7b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23136383036343334', 'path': '/dev/sdf'} {{(pid=72382) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 15:27:30 user nova-compute[72382]: DEBUG nova.objects.instance [None req-10a50243-ac72-4345-938d-c5ad0537185d tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] Lazy-loading 'flavor' on Instance uuid 6296ba5d-bcc6-405a-a635-0e9aa6114f7b {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:27:30 user nova-compute[72382]: DEBUG nova.virt.libvirt.guest [None req-10a50243-ac72-4345-938d-c5ad0537185d tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 15:27:30 user nova-compute[72382]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 15:27:30 user nova-compute[72382]:   <source dev="/dev/sdf"/>
Aug 09 15:27:30 user nova-compute[72382]:   <target dev="vdb" bus="virtio"/>
Aug 09 15:27:30 user nova-compute[72382]:   <serial>398b5741-5332-4210-a0b3-58c2a51df083</serial>
Aug 09 15:27:30 user nova-compute[72382]: </disk>
Aug 09 15:27:30 user nova-compute[72382]:  {{(pid=72382) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 15:27:30 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-10a50243-ac72-4345-938d-c5ad0537185d tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] No BDM found with device name vda, not building metadata. {{(pid=72382) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 15:27:30 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-10a50243-ac72-4345-938d-c5ad0537185d tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72382) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 15:27:30 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-10a50243-ac72-4345-938d-c5ad0537185d tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] No VIF found with MAC fa:16:3e:0b:83:7d, not building metadata {{(pid=72382) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 15:27:31 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-10a50243-ac72-4345-938d-c5ad0537185d tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] Lock "6296ba5d-bcc6-405a-a635-0e9aa6114f7b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.819s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:27:32 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:27:32 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:27:33 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-69fed0cd-f0bd-4e18-9cdc-c4a4af1323bc tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] Acquiring lock "6296ba5d-bcc6-405a-a635-0e9aa6114f7b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:27:33 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-69fed0cd-f0bd-4e18-9cdc-c4a4af1323bc tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] Lock "6296ba5d-bcc6-405a-a635-0e9aa6114f7b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:27:33 user nova-compute[72382]: INFO nova.compute.manager [None req-69fed0cd-f0bd-4e18-9cdc-c4a4af1323bc tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] [instance: 6296ba5d-bcc6-405a-a635-0e9aa6114f7b] Detaching volume 398b5741-5332-4210-a0b3-58c2a51df083
Aug 09 15:27:33 user nova-compute[72382]: INFO nova.virt.block_device [None req-69fed0cd-f0bd-4e18-9cdc-c4a4af1323bc tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] [instance: 6296ba5d-bcc6-405a-a635-0e9aa6114f7b] Attempting to driver detach volume 398b5741-5332-4210-a0b3-58c2a51df083 from mountpoint /dev/vdb
Aug 09 15:27:33 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-69fed0cd-f0bd-4e18-9cdc-c4a4af1323bc tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] Attempting to detach device vdb from instance 6296ba5d-bcc6-405a-a635-0e9aa6114f7b from the persistent domain config. {{(pid=72382) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 15:27:33 user nova-compute[72382]: DEBUG nova.virt.libvirt.guest [None req-69fed0cd-f0bd-4e18-9cdc-c4a4af1323bc tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 15:27:33 user nova-compute[72382]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 15:27:33 user nova-compute[72382]:   <source dev="/dev/sdf"/>
Aug 09 15:27:33 user nova-compute[72382]:   <target dev="vdb" bus="virtio"/>
Aug 09 15:27:33 user nova-compute[72382]:   <serial>398b5741-5332-4210-a0b3-58c2a51df083</serial>
Aug 09 15:27:33 user nova-compute[72382]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 15:27:33 user nova-compute[72382]: </disk>
Aug 09 15:27:33 user nova-compute[72382]:  {{(pid=72382) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 15:27:33 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-69fed0cd-f0bd-4e18-9cdc-c4a4af1323bc tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] Successfully detached device vdb from instance 6296ba5d-bcc6-405a-a635-0e9aa6114f7b from the persistent domain config.
Aug 09 15:27:33 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-69fed0cd-f0bd-4e18-9cdc-c4a4af1323bc tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 6296ba5d-bcc6-405a-a635-0e9aa6114f7b from the live domain config. {{(pid=72382) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 15:27:33 user nova-compute[72382]: DEBUG nova.virt.libvirt.guest [None req-69fed0cd-f0bd-4e18-9cdc-c4a4af1323bc tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 15:27:33 user nova-compute[72382]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 15:27:33 user nova-compute[72382]:   <source dev="/dev/sdf"/>
Aug 09 15:27:33 user nova-compute[72382]:   <target dev="vdb" bus="virtio"/>
Aug 09 15:27:33 user nova-compute[72382]:   <serial>398b5741-5332-4210-a0b3-58c2a51df083</serial>
Aug 09 15:27:33 user nova-compute[72382]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 15:27:33 user nova-compute[72382]: </disk>
Aug 09 15:27:33 user nova-compute[72382]:  {{(pid=72382) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 15:27:33 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Received event <DeviceRemovedEvent: 1691594853.7180178, 6296ba5d-bcc6-405a-a635-0e9aa6114f7b => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72382) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 15:27:33 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-69fed0cd-f0bd-4e18-9cdc-c4a4af1323bc tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 6296ba5d-bcc6-405a-a635-0e9aa6114f7b {{(pid=72382) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 15:27:33 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-69fed0cd-f0bd-4e18-9cdc-c4a4af1323bc tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] Successfully detached device vdb from instance 6296ba5d-bcc6-405a-a635-0e9aa6114f7b from the live domain config.
Aug 09 15:27:33 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-69fed0cd-f0bd-4e18-9cdc-c4a4af1323bc tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] [instance: 6296ba5d-bcc6-405a-a635-0e9aa6114f7b] calling os-brick to detach iSCSI Volume {{(pid=72382) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 15:27:33 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-69fed0cd-f0bd-4e18-9cdc-c4a4af1323bc tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2a0c768340>, {'target_iqns': ['iqn.2010-10.org.openstack:398b5741-5332-4210-a0b3-58c2a51df083'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xQbevBKu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 15:27:33 user nova-compute[72382]: WARNING os_brick.initiator.connectors.base [None req-69fed0cd-f0bd-4e18-9cdc-c4a4af1323bc tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 15:27:33 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-69fed0cd-f0bd-4e18-9cdc-c4a4af1323bc tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 15:27:33 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-69fed0cd-f0bd-4e18-9cdc-c4a4af1323bc tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 15:27:33 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-69fed0cd-f0bd-4e18-9cdc-c4a4af1323bc tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:398b5741-5332-4210-a0b3-58c2a51df083', 0)] {{(pid=72382) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 15:27:33 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:27:33 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:27:33 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[6930af5d-4367-42ba-9751-310b10c52daf]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:25503c6e-bfc0-4008-846a-8cad783fc0fb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:398b5741-5332-4210-a0b3-58c2a51df083\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9572706e-c54c-42c2-9cf0-2690cdf4cca2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bd90521a-f3b5-485c-9fb9-61ab37267f3a\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:27:33 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:27:33 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:27:33 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[57e52848-81ad-4610-93e4-9b5c5352afa3]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9572706e-c54c-42c2-9cf0-2690cdf4cca2 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd90521a-f3b5-485c-9fb9-61ab37267f3a (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25503c6e-bfc0-4008-846a-8cad783fc0fb (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:398b5741-5332-4210-a0b3-58c2a51df083 (non-flash)\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:27:33 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-69fed0cd-f0bd-4e18-9cdc-c4a4af1323bc tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)
Aug 09 15:27:33 user nova-compute[72382]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9572706e-c54c-42c2-9cf0-2690cdf4cca2 (non-flash)
Aug 09 15:27:33 user nova-compute[72382]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd90521a-f3b5-485c-9fb9-61ab37267f3a (non-flash)
Aug 09 15:27:33 user nova-compute[72382]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25503c6e-bfc0-4008-846a-8cad783fc0fb (non-flash)
Aug 09 15:27:33 user nova-compute[72382]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:398b5741-5332-4210-a0b3-58c2a51df083 (non-flash)
Aug 09 15:27:33 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 15:27:33 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-69fed0cd-f0bd-4e18-9cdc-c4a4af1323bc tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)
Aug 09 15:27:33 user nova-compute[72382]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9572706e-c54c-42c2-9cf0-2690cdf4cca2 (non-flash)
Aug 09 15:27:33 user nova-compute[72382]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd90521a-f3b5-485c-9fb9-61ab37267f3a (non-flash)
Aug 09 15:27:33 user nova-compute[72382]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25503c6e-bfc0-4008-846a-8cad783fc0fb (non-flash)
Aug 09 15:27:33 user nova-compute[72382]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:398b5741-5332-4210-a0b3-58c2a51df083 (non-flash)
Aug 09 15:27:33 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 15:27:33 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-69fed0cd-f0bd-4e18-9cdc-c4a4af1323bc tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2a2c0f79a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:398b5741-5332-4210-a0b3-58c2a51df083'): ({'sdf'}, set())}) {{(pid=72382) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 15:27:33 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-69fed0cd-f0bd-4e18-9cdc-c4a4af1323bc tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] Removing single pathed devices sdf {{(pid=72382) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 15:27:33 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:27:33 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:27:33 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fdbdc9c-85b4-4c43-b83c-056effa9b645]: (4, ('path checker states:\nup                  3\npending             2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:27:33 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:27:33 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.024s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:27:33 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f94b381-bb8c-496b-b0bc-ab8cbc4f0aed]: (4, ('ok\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:27:33 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-69fed0cd-f0bd-4e18-9cdc-c4a4af1323bc tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] Flushing IO for device /dev/sdf {{(pid=72382) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 15:27:33 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:27:33 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.016s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:27:33 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fd5be1e-2ad5-4ff5-bc13-46ffee3a7423]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:27:33 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-69fed0cd-f0bd-4e18-9cdc-c4a4af1323bc tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=72382) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 15:27:33 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:27:33 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.046s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:27:33 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9958e81-0b8f-4b52-a16d-d276d0dc3211]: (4, ('1', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:27:33 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-69fed0cd-f0bd-4e18-9cdc-c4a4af1323bc tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=72382) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 15:27:33 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-69fed0cd-f0bd-4e18-9cdc-c4a4af1323bc tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] SCSI volumes sdf have been removed. {{(pid=72382) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 15:27:33 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-69fed0cd-f0bd-4e18-9cdc-c4a4af1323bc tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:398b5741-5332-4210-a0b3-58c2a51df083')] {{(pid=72382) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 15:27:33 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:398b5741-5332-4210-a0b3-58c2a51df083 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:27:33 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:398b5741-5332-4210-a0b3-58c2a51df083 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:27:33 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e599fb5-7f1d-4bea-8f8c-f1174706246d]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:27:33 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-69fed0cd-f0bd-4e18-9cdc-c4a4af1323bc tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:27:33 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:398b5741-5332-4210-a0b3-58c2a51df083 -p 172.16.0.220:3260 --logout {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:27:34 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:398b5741-5332-4210-a0b3-58c2a51df083 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:27:34 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[400cc3d1-a941-4244-9892-06b50148a1f1]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:398b5741-5332-4210-a0b3-58c2a51df083, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:398b5741-5332-4210-a0b3-58c2a51df083, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:27:34 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-69fed0cd-f0bd-4e18-9cdc-c4a4af1323bc tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:398b5741-5332-4210-a0b3-58c2a51df083, portal: 172.16.0.220,3260]
Aug 09 15:27:34 user nova-compute[72382]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:398b5741-5332-4210-a0b3-58c2a51df083, portal: 172.16.0.220,3260] successful.
Aug 09 15:27:34 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:27:34 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:398b5741-5332-4210-a0b3-58c2a51df083 -p 172.16.0.220:3260 --op delete {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:27:34 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:398b5741-5332-4210-a0b3-58c2a51df083 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:27:34 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[001c46c4-69cd-4d4f-9577-f59817ead046]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:27:34 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-69fed0cd-f0bd-4e18-9cdc-c4a4af1323bc tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:27:34 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-69fed0cd-f0bd-4e18-9cdc-c4a4af1323bc tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.311s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 15:27:34 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-69fed0cd-f0bd-4e18-9cdc-c4a4af1323bc tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] <== disconnect_volume: return (313ms) None {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 15:27:34 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-69fed0cd-f0bd-4e18-9cdc-c4a4af1323bc tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] [instance: 6296ba5d-bcc6-405a-a635-0e9aa6114f7b] Disconnected iSCSI Volume {{(pid=72382) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 15:27:34 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:27:34 user nova-compute[72382]: DEBUG nova.objects.instance [None req-69fed0cd-f0bd-4e18-9cdc-c4a4af1323bc tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] Lazy-loading 'flavor' on Instance uuid 6296ba5d-bcc6-405a-a635-0e9aa6114f7b {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:27:34 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-69fed0cd-f0bd-4e18-9cdc-c4a4af1323bc tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] Lock "6296ba5d-bcc6-405a-a635-0e9aa6114f7b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.898s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:27:35 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1bb878f1-75cf-485c-b352-c4353ac4fca3 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] [instance: 14c97840-88c0-4a8e-96e8-2e7da318ad07] Calling os-brick to attach iSCSI Volume {{(pid=72382) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 15:27:35 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bb878f1-75cf-485c-b352-c4353ac4fca3 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2a0c768340>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:e62d4416-be8c-4327-9a51-0cc509109c53'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cxDzGkfS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 15:27:35 user nova-compute[72382]: WARNING os_brick.initiator.connectors.base [None req-1bb878f1-75cf-485c-b352-c4353ac4fca3 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 15:27:35 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-1bb878f1-75cf-485c-b352-c4353ac4fca3 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 15:27:35 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-1bb878f1-75cf-485c-b352-c4353ac4fca3 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 15:27:35 user nova-compute[72382]: WARNING os_brick.initiator.connectors.base [None req-1bb878f1-75cf-485c-b352-c4353ac4fca3 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 15:27:35 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-1bb878f1-75cf-485c-b352-c4353ac4fca3 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e62d4416-be8c-4327-9a51-0cc509109c53" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 15:27:35 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-1bb878f1-75cf-485c-b352-c4353ac4fca3 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e62d4416-be8c-4327-9a51-0cc509109c53" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 15:27:35 user nova-compute[72382]: INFO os_brick.initiator.connectors.iscsi [None req-1bb878f1-75cf-485c-b352-c4353ac4fca3 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 15:27:35 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e62d4416-be8c-4327-9a51-0cc509109c53 -p 172.16.0.220:3260 {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:27:35 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e62d4416-be8c-4327-9a51-0cc509109c53 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:27:35 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae80f8bf-22cb-4bf6-a274-81654823c1b2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:27:35 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bb878f1-75cf-485c-b352-c4353ac4fca3 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 15:27:35 user nova-compute[72382]:  {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:27:35 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e62d4416-be8c-4327-9a51-0cc509109c53 -p 172.16.0.220:3260 --interface default --op new {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:27:35 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e62d4416-be8c-4327-9a51-0cc509109c53 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:27:35 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[6982a31c-4886-4845-baaf-02873c7ec82b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e62d4416-be8c-4327-9a51-0cc509109c53] added\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:27:35 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bb878f1-75cf-485c-b352-c4353ac4fca3 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e62d4416-be8c-4327-9a51-0cc509109c53] added
Aug 09 15:27:35 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:27:35 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e62d4416-be8c-4327-9a51-0cc509109c53 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:27:35 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e62d4416-be8c-4327-9a51-0cc509109c53 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:27:35 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3d4bdeb-54d6-46bd-a1d8-18a09ab7e92a]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:27:35 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bb878f1-75cf-485c-b352-c4353ac4fca3 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:27:35 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e62d4416-be8c-4327-9a51-0cc509109c53 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:27:35 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e62d4416-be8c-4327-9a51-0cc509109c53 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:27:35 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb4e3276-4d61-4731-9939-3987b0b10a5a]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:27:35 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bb878f1-75cf-485c-b352-c4353ac4fca3 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:27:35 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e62d4416-be8c-4327-9a51-0cc509109c53 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cxDzGkfS {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:27:35 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e62d4416-be8c-4327-9a51-0cc509109c53 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cxDzGkfS" returned: 0 in 0.018s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:27:35 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba215667-c4bb-42eb-98fa-12d284493309]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:27:35 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bb878f1-75cf-485c-b352-c4353ac4fca3 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cxDzGkfS'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:27:35 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e62d4416-be8c-4327-9a51-0cc509109c53 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:27:35 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e62d4416-be8c-4327-9a51-0cc509109c53 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:27:35 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef42aaef-c1e8-4b53-b854-2e3b388e1707]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:27:35 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bb878f1-75cf-485c-b352-c4353ac4fca3 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:27:35 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:27:35 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:27:35 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[609976bf-2373-467b-bc7f-fd52ed739689]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9572706e-c54c-42c2-9cf0-2690cdf4cca2 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd90521a-f3b5-485c-9fb9-61ab37267f3a (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25503c6e-bfc0-4008-846a-8cad783fc0fb (non-flash)\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:27:35 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bb878f1-75cf-485c-b352-c4353ac4fca3 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)
Aug 09 15:27:35 user nova-compute[72382]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9572706e-c54c-42c2-9cf0-2690cdf4cca2 (non-flash)
Aug 09 15:27:35 user nova-compute[72382]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd90521a-f3b5-485c-9fb9-61ab37267f3a (non-flash)
Aug 09 15:27:35 user nova-compute[72382]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25503c6e-bfc0-4008-846a-8cad783fc0fb (non-flash)
Aug 09 15:27:35 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 15:27:35 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bb878f1-75cf-485c-b352-c4353ac4fca3 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)
Aug 09 15:27:35 user nova-compute[72382]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9572706e-c54c-42c2-9cf0-2690cdf4cca2 (non-flash)
Aug 09 15:27:35 user nova-compute[72382]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd90521a-f3b5-485c-9fb9-61ab37267f3a (non-flash)
Aug 09 15:27:35 user nova-compute[72382]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25503c6e-bfc0-4008-846a-8cad783fc0fb (non-flash)
Aug 09 15:27:35 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 15:27:35 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e62d4416-be8c-4327-9a51-0cc509109c53 -p 172.16.0.220:3260 --login {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:27:35 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e62d4416-be8c-4327-9a51-0cc509109c53 -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:27:35 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b7c7881-4298-4c1f-b359-15912a70ca3f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e62d4416-be8c-4327-9a51-0cc509109c53, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e62d4416-be8c-4327-9a51-0cc509109c53, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:27:35 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bb878f1-75cf-485c-b352-c4353ac4fca3 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e62d4416-be8c-4327-9a51-0cc509109c53, portal: 172.16.0.220,3260]
Aug 09 15:27:35 user nova-compute[72382]: Login to [iface: default, target: iqn.2010-10.org.openstack:e62d4416-be8c-4327-9a51-0cc509109c53, portal: 172.16.0.220,3260] successful.
Aug 09 15:27:35 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:27:35 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e62d4416-be8c-4327-9a51-0cc509109c53 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:27:35 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e62d4416-be8c-4327-9a51-0cc509109c53 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:27:35 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[8be06ad1-be7c-409d-91b7-516e05f89a5c]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:27:35 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bb878f1-75cf-485c-b352-c4353ac4fca3 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:27:35 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:27:35 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:27:35 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d7ddf28-704c-42b2-bf37-b71436721f0d]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9572706e-c54c-42c2-9cf0-2690cdf4cca2 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd90521a-f3b5-485c-9fb9-61ab37267f3a (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25503c6e-bfc0-4008-846a-8cad783fc0fb (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e62d4416-be8c-4327-9a51-0cc509109c53 (non-flash)\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:27:35 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bb878f1-75cf-485c-b352-c4353ac4fca3 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)
Aug 09 15:27:35 user nova-compute[72382]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9572706e-c54c-42c2-9cf0-2690cdf4cca2 (non-flash)
Aug 09 15:27:35 user nova-compute[72382]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd90521a-f3b5-485c-9fb9-61ab37267f3a (non-flash)
Aug 09 15:27:35 user nova-compute[72382]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25503c6e-bfc0-4008-846a-8cad783fc0fb (non-flash)
Aug 09 15:27:35 user nova-compute[72382]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e62d4416-be8c-4327-9a51-0cc509109c53 (non-flash)
Aug 09 15:27:35 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 15:27:35 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bb878f1-75cf-485c-b352-c4353ac4fca3 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)
Aug 09 15:27:35 user nova-compute[72382]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9572706e-c54c-42c2-9cf0-2690cdf4cca2 (non-flash)
Aug 09 15:27:35 user nova-compute[72382]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd90521a-f3b5-485c-9fb9-61ab37267f3a (non-flash)
Aug 09 15:27:35 user nova-compute[72382]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25503c6e-bfc0-4008-846a-8cad783fc0fb (non-flash)
Aug 09 15:27:35 user nova-compute[72382]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e62d4416-be8c-4327-9a51-0cc509109c53 (non-flash)
Aug 09 15:27:35 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 15:27:35 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-1bb878f1-75cf-485c-b352-c4353ac4fca3 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e62d4416-be8c-4327-9a51-0cc509109c53" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.296s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 15:27:35 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bb878f1-75cf-485c-b352-c4353ac4fca3 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Connected to 172.16.0.220:3260 {{(pid=72382) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 15:27:35 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-1bb878f1-75cf-485c-b352-c4353ac4fca3 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] HCTL ('37', '-', '-', 0) found on session 33 with lun 0 {{(pid=72382) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 15:27:35 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-1bb878f1-75cf-485c-b352-c4353ac4fca3 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=72382) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 15:27:35 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:27:35 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.018s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:27:35 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d21f6c1-ab3d-46e7-8db1-a594f6783c2c]: (4, ('- - 0', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:27:35 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-1bb878f1-75cf-485c-b352-c4353ac4fca3 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Searching for a device in session 33 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=72382) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 15:27:35 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bb878f1-75cf-485c-b352-c4353ac4fca3 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cxDzGkfS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72382) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 15:27:36 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:27:36 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-1bb878f1-75cf-485c-b352-c4353ac4fca3 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.329s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 15:27:36 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bb878f1-75cf-485c-b352-c4353ac4fca3 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] <== connect_volume: return (1331ms) {'type': 'block', 'scsi_wwn': '26439653462353332', 'path': '/dev/sdf'} {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 15:27:36 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1bb878f1-75cf-485c-b352-c4353ac4fca3 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] [instance: 14c97840-88c0-4a8e-96e8-2e7da318ad07] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26439653462353332', 'path': '/dev/sdf'} {{(pid=72382) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 15:27:36 user nova-compute[72382]: DEBUG nova.objects.instance [None req-1bb878f1-75cf-485c-b352-c4353ac4fca3 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Lazy-loading 'flavor' on Instance uuid 14c97840-88c0-4a8e-96e8-2e7da318ad07 {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:27:36 user nova-compute[72382]: DEBUG nova.virt.libvirt.guest [None req-1bb878f1-75cf-485c-b352-c4353ac4fca3 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 15:27:36 user nova-compute[72382]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 15:27:36 user nova-compute[72382]:   <source dev="/dev/sdf"/>
Aug 09 15:27:36 user nova-compute[72382]:   <target dev="vdb" bus="virtio"/>
Aug 09 15:27:36 user nova-compute[72382]:   <serial>e62d4416-be8c-4327-9a51-0cc509109c53</serial>
Aug 09 15:27:36 user nova-compute[72382]: </disk>
Aug 09 15:27:36 user nova-compute[72382]:  {{(pid=72382) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 15:27:36 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-1bb878f1-75cf-485c-b352-c4353ac4fca3 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] No BDM found with device name vda, not building metadata. {{(pid=72382) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 15:27:36 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-1bb878f1-75cf-485c-b352-c4353ac4fca3 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72382) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 15:27:36 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-1bb878f1-75cf-485c-b352-c4353ac4fca3 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] No VIF found with MAC fa:16:3e:72:44:b1, not building metadata {{(pid=72382) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 15:27:37 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-1bb878f1-75cf-485c-b352-c4353ac4fca3 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Lock "14c97840-88c0-4a8e-96e8-2e7da318ad07" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 23.067s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:27:37 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:27:37 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-1537c037-13aa-456e-b1b7-522edddd9ba8 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Acquiring lock "14c97840-88c0-4a8e-96e8-2e7da318ad07" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:27:37 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-1537c037-13aa-456e-b1b7-522edddd9ba8 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Lock "14c97840-88c0-4a8e-96e8-2e7da318ad07" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:27:37 user nova-compute[72382]: DEBUG nova.compute.manager [None req-1537c037-13aa-456e-b1b7-522edddd9ba8 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] [instance: 14c97840-88c0-4a8e-96e8-2e7da318ad07] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:27:37 user nova-compute[72382]: DEBUG nova.compute.manager [None req-1537c037-13aa-456e-b1b7-522edddd9ba8 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] [instance: 14c97840-88c0-4a8e-96e8-2e7da318ad07] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=72382) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3342}}
Aug 09 15:27:37 user nova-compute[72382]: DEBUG nova.objects.instance [None req-1537c037-13aa-456e-b1b7-522edddd9ba8 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Lazy-loading 'flavor' on Instance uuid 14c97840-88c0-4a8e-96e8-2e7da318ad07 {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:27:38 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:27:38 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:27:38 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:27:38 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:27:38 user nova-compute[72382]: DEBUG nova.compute.manager [req-072fc785-bdbf-4298-a199-43659b80807a req-78497ec4-3a27-437a-8899-fe2c0e3e8cc4 service nova] [instance: 14c97840-88c0-4a8e-96e8-2e7da318ad07] Received event network-vif-unplugged-f22c0d53-f0da-4bc9-bf7b-c10fe61e2e1f {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:27:38 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-072fc785-bdbf-4298-a199-43659b80807a req-78497ec4-3a27-437a-8899-fe2c0e3e8cc4 service nova] Acquiring lock "14c97840-88c0-4a8e-96e8-2e7da318ad07-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:27:38 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-072fc785-bdbf-4298-a199-43659b80807a req-78497ec4-3a27-437a-8899-fe2c0e3e8cc4 service nova] Lock "14c97840-88c0-4a8e-96e8-2e7da318ad07-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:27:38 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-072fc785-bdbf-4298-a199-43659b80807a req-78497ec4-3a27-437a-8899-fe2c0e3e8cc4 service nova] Lock "14c97840-88c0-4a8e-96e8-2e7da318ad07-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:27:38 user nova-compute[72382]: DEBUG nova.compute.manager [req-072fc785-bdbf-4298-a199-43659b80807a req-78497ec4-3a27-437a-8899-fe2c0e3e8cc4 service nova] [instance: 14c97840-88c0-4a8e-96e8-2e7da318ad07] No waiting events found dispatching network-vif-unplugged-f22c0d53-f0da-4bc9-bf7b-c10fe61e2e1f {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:27:38 user nova-compute[72382]: WARNING nova.compute.manager [req-072fc785-bdbf-4298-a199-43659b80807a req-78497ec4-3a27-437a-8899-fe2c0e3e8cc4 service nova] [instance: 14c97840-88c0-4a8e-96e8-2e7da318ad07] Received unexpected event network-vif-unplugged-f22c0d53-f0da-4bc9-bf7b-c10fe61e2e1f for instance with vm_state active and task_state powering-off.
Aug 09 15:27:38 user nova-compute[72382]: INFO nova.virt.libvirt.driver [-] [instance: 14c97840-88c0-4a8e-96e8-2e7da318ad07] Instance destroyed successfully.
Aug 09 15:27:38 user nova-compute[72382]: DEBUG nova.compute.manager [None req-1537c037-13aa-456e-b1b7-522edddd9ba8 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] [instance: 14c97840-88c0-4a8e-96e8-2e7da318ad07] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:27:38 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-1537c037-13aa-456e-b1b7-522edddd9ba8 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Lock "14c97840-88c0-4a8e-96e8-2e7da318ad07" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.907s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:27:39 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-bb1b72b1-498b-4ea0-b8b5-7186666d6162 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Acquiring lock "b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:27:39 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-bb1b72b1-498b-4ea0-b8b5-7186666d6162 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Lock "b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:27:39 user nova-compute[72382]: DEBUG nova.compute.manager [None req-bb1b72b1-498b-4ea0-b8b5-7186666d6162 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] [instance: b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d] Starting instance... {{(pid=72382) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 15:27:39 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:27:39 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-bb1b72b1-498b-4ea0-b8b5-7186666d6162 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:27:39 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-bb1b72b1-498b-4ea0-b8b5-7186666d6162 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:27:39 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-bb1b72b1-498b-4ea0-b8b5-7186666d6162 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72382) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 15:27:39 user nova-compute[72382]: INFO nova.compute.claims [None req-bb1b72b1-498b-4ea0-b8b5-7186666d6162 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] [instance: b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d] Claim successful on node user
Aug 09 15:27:39 user nova-compute[72382]: DEBUG nova.compute.provider_tree [None req-bb1b72b1-498b-4ea0-b8b5-7186666d6162 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Inventory has not changed in ProviderTree for provider: 7b15b0e5-df4d-49db-833b-2855d21d10ae {{(pid=72382) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 15:27:39 user nova-compute[72382]: DEBUG nova.scheduler.client.report [None req-bb1b72b1-498b-4ea0-b8b5-7186666d6162 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Inventory has not changed for provider 7b15b0e5-df4d-49db-833b-2855d21d10ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72382) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 15:27:39 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-bb1b72b1-498b-4ea0-b8b5-7186666d6162 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.635s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:27:39 user nova-compute[72382]: DEBUG nova.compute.manager [None req-bb1b72b1-498b-4ea0-b8b5-7186666d6162 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] [instance: b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d] Start building networks asynchronously for instance. {{(pid=72382) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 15:27:40 user nova-compute[72382]: DEBUG nova.compute.manager [None req-bb1b72b1-498b-4ea0-b8b5-7186666d6162 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] [instance: b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d] Allocating IP information in the background. {{(pid=72382) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 15:27:40 user nova-compute[72382]: DEBUG nova.network.neutron [None req-bb1b72b1-498b-4ea0-b8b5-7186666d6162 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] [instance: b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d] allocate_for_instance() {{(pid=72382) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 15:27:40 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-bb1b72b1-498b-4ea0-b8b5-7186666d6162 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] [instance: b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 15:27:40 user nova-compute[72382]: DEBUG nova.compute.manager [None req-bb1b72b1-498b-4ea0-b8b5-7186666d6162 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] [instance: b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d] Start building block device mappings for instance. {{(pid=72382) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 15:27:40 user nova-compute[72382]: DEBUG nova.policy [None req-bb1b72b1-498b-4ea0-b8b5-7186666d6162 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9f95e50aa6194e778dfaee31e6e2fa68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6db5fd3ce24c1cadbedd64757e219b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72382) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 15:27:40 user nova-compute[72382]: DEBUG nova.compute.manager [None req-bb1b72b1-498b-4ea0-b8b5-7186666d6162 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] [instance: b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d] Start spawning the instance on the hypervisor. {{(pid=72382) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 15:27:40 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-bb1b72b1-498b-4ea0-b8b5-7186666d6162 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] [instance: b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d] Creating instance directory {{(pid=72382) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 15:27:40 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-bb1b72b1-498b-4ea0-b8b5-7186666d6162 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] [instance: b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d] Creating image(s)
Aug 09 15:27:40 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-bb1b72b1-498b-4ea0-b8b5-7186666d6162 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Acquiring lock "/opt/stack/data/nova/instances/b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:27:40 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-bb1b72b1-498b-4ea0-b8b5-7186666d6162 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Lock "/opt/stack/data/nova/instances/b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:27:40 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-bb1b72b1-498b-4ea0-b8b5-7186666d6162 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Lock "/opt/stack/data/nova/instances/b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:27:40 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-bb1b72b1-498b-4ea0-b8b5-7186666d6162 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:27:40 user nova-compute[72382]: DEBUG nova.compute.manager [req-e4eb5abf-80de-41d2-8957-a4810530b543 req-a512528d-c05e-42c5-90ef-35f185781bf5 service nova] [instance: 14c97840-88c0-4a8e-96e8-2e7da318ad07] Received event network-vif-plugged-f22c0d53-f0da-4bc9-bf7b-c10fe61e2e1f {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:27:40 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-e4eb5abf-80de-41d2-8957-a4810530b543 req-a512528d-c05e-42c5-90ef-35f185781bf5 service nova] Acquiring lock "14c97840-88c0-4a8e-96e8-2e7da318ad07-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:27:40 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-e4eb5abf-80de-41d2-8957-a4810530b543 req-a512528d-c05e-42c5-90ef-35f185781bf5 service nova] Lock "14c97840-88c0-4a8e-96e8-2e7da318ad07-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:27:40 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-e4eb5abf-80de-41d2-8957-a4810530b543 req-a512528d-c05e-42c5-90ef-35f185781bf5 service nova] Lock "14c97840-88c0-4a8e-96e8-2e7da318ad07-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:27:40 user nova-compute[72382]: DEBUG nova.compute.manager [req-e4eb5abf-80de-41d2-8957-a4810530b543 req-a512528d-c05e-42c5-90ef-35f185781bf5 service nova] [instance: 14c97840-88c0-4a8e-96e8-2e7da318ad07] No waiting events found dispatching network-vif-plugged-f22c0d53-f0da-4bc9-bf7b-c10fe61e2e1f {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:27:40 user nova-compute[72382]: WARNING nova.compute.manager [req-e4eb5abf-80de-41d2-8957-a4810530b543 req-a512528d-c05e-42c5-90ef-35f185781bf5 service nova] [instance: 14c97840-88c0-4a8e-96e8-2e7da318ad07] Received unexpected event network-vif-plugged-f22c0d53-f0da-4bc9-bf7b-c10fe61e2e1f for instance with vm_state stopped and task_state None.
Aug 09 15:27:40 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-bb1b72b1-498b-4ea0-b8b5-7186666d6162 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b --force-share --output=json" returned: 0 in 0.183s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:27:40 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-bb1b72b1-498b-4ea0-b8b5-7186666d6162 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Acquiring lock "383812ff437283e0191ed5b9ecc04c27f1162b0b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:27:40 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-bb1b72b1-498b-4ea0-b8b5-7186666d6162 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Lock "383812ff437283e0191ed5b9ecc04c27f1162b0b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:27:40 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-bb1b72b1-498b-4ea0-b8b5-7186666d6162 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:27:40 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-bb1b72b1-498b-4ea0-b8b5-7186666d6162 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b --force-share --output=json" returned: 0 in 0.131s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:27:40 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-bb1b72b1-498b-4ea0-b8b5-7186666d6162 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b,backing_fmt=raw /opt/stack/data/nova/instances/b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d/disk 1073741824 {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:27:40 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-bb1b72b1-498b-4ea0-b8b5-7186666d6162 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b,backing_fmt=raw /opt/stack/data/nova/instances/b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d/disk 1073741824" returned: 0 in 0.059s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:27:40 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-bb1b72b1-498b-4ea0-b8b5-7186666d6162 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Lock "383812ff437283e0191ed5b9ecc04c27f1162b0b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.197s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:27:40 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-bb1b72b1-498b-4ea0-b8b5-7186666d6162 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:27:40 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-bb1b72b1-498b-4ea0-b8b5-7186666d6162 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b --force-share --output=json" returned: 0 in 0.139s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:27:40 user nova-compute[72382]: DEBUG nova.virt.disk.api [None req-bb1b72b1-498b-4ea0-b8b5-7186666d6162 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d/disk. size=1073741824 {{(pid=72382) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 15:27:40 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-bb1b72b1-498b-4ea0-b8b5-7186666d6162 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:27:40 user nova-compute[72382]: DEBUG nova.network.neutron [None req-bb1b72b1-498b-4ea0-b8b5-7186666d6162 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] [instance: b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d] Successfully created port: 99b65ca7-d891-4625-917d-460e7fb69654 {{(pid=72382) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 15:27:40 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-bb1b72b1-498b-4ea0-b8b5-7186666d6162 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:27:40 user nova-compute[72382]: DEBUG nova.virt.disk.api [None req-bb1b72b1-498b-4ea0-b8b5-7186666d6162 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Cannot resize image /opt/stack/data/nova/instances/b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d/disk to a smaller size. {{(pid=72382) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 15:27:40 user nova-compute[72382]: DEBUG nova.objects.instance [None req-bb1b72b1-498b-4ea0-b8b5-7186666d6162 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Lazy-loading 'migration_context' on Instance uuid b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:27:41 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-bb1b72b1-498b-4ea0-b8b5-7186666d6162 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] [instance: b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d] Created local disks {{(pid=72382) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 15:27:41 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-bb1b72b1-498b-4ea0-b8b5-7186666d6162 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] [instance: b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d] Ensure instance console log exists: /opt/stack/data/nova/instances/b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d/console.log {{(pid=72382) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 15:27:41 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-bb1b72b1-498b-4ea0-b8b5-7186666d6162 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:27:41 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-bb1b72b1-498b-4ea0-b8b5-7186666d6162 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:27:41 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-bb1b72b1-498b-4ea0-b8b5-7186666d6162 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:27:41 user nova-compute[72382]: DEBUG nova.network.neutron [None req-bb1b72b1-498b-4ea0-b8b5-7186666d6162 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] [instance: b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d] Successfully updated port: 99b65ca7-d891-4625-917d-460e7fb69654 {{(pid=72382) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 15:27:41 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-bb1b72b1-498b-4ea0-b8b5-7186666d6162 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Acquiring lock "refresh_cache-b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 15:27:41 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-bb1b72b1-498b-4ea0-b8b5-7186666d6162 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Acquired lock "refresh_cache-b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 15:27:41 user nova-compute[72382]: DEBUG nova.network.neutron [None req-bb1b72b1-498b-4ea0-b8b5-7186666d6162 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] [instance: b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d] Building network info cache for instance {{(pid=72382) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 15:27:41 user nova-compute[72382]: DEBUG nova.network.neutron [None req-bb1b72b1-498b-4ea0-b8b5-7186666d6162 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] [instance: b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d] Instance cache missing network info. {{(pid=72382) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 15:27:42 user nova-compute[72382]: DEBUG nova.compute.manager [req-746eae0f-4f91-488a-b383-d9fcef501839 req-ce2fe299-9409-4183-b63a-3ac6cd34eaf2 service nova] [instance: b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d] Received event network-changed-99b65ca7-d891-4625-917d-460e7fb69654 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:27:42 user nova-compute[72382]: DEBUG nova.compute.manager [req-746eae0f-4f91-488a-b383-d9fcef501839 req-ce2fe299-9409-4183-b63a-3ac6cd34eaf2 service nova] [instance: b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d] Refreshing instance network info cache due to event network-changed-99b65ca7-d891-4625-917d-460e7fb69654. {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 15:27:42 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-746eae0f-4f91-488a-b383-d9fcef501839 req-ce2fe299-9409-4183-b63a-3ac6cd34eaf2 service nova] Acquiring lock "refresh_cache-b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 15:27:42 user nova-compute[72382]: DEBUG nova.network.neutron [None req-bb1b72b1-498b-4ea0-b8b5-7186666d6162 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] [instance: b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d] Updating instance_info_cache with network_info: [{"id": "99b65ca7-d891-4625-917d-460e7fb69654", "address": "fa:16:3e:98:b9:f2", "network": {"id": "643703fd-46b7-4309-862c-109141cb008c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-512918576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa6db5fd3ce24c1cadbedd64757e219b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99b65ca7-d8", "ovs_interfaceid": "99b65ca7-d891-4625-917d-460e7fb69654", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:27:42 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-bb1b72b1-498b-4ea0-b8b5-7186666d6162 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Releasing lock "refresh_cache-b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 15:27:42 user nova-compute[72382]: DEBUG nova.compute.manager [None req-bb1b72b1-498b-4ea0-b8b5-7186666d6162 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] [instance: b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d] Instance network_info: |[{"id": "99b65ca7-d891-4625-917d-460e7fb69654", "address": "fa:16:3e:98:b9:f2", "network": {"id": "643703fd-46b7-4309-862c-109141cb008c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-512918576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa6db5fd3ce24c1cadbedd64757e219b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99b65ca7-d8", "ovs_interfaceid": "99b65ca7-d891-4625-917d-460e7fb69654", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72382) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 15:27:42 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-746eae0f-4f91-488a-b383-d9fcef501839 req-ce2fe299-9409-4183-b63a-3ac6cd34eaf2 service nova] Acquired lock "refresh_cache-b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 15:27:42 user nova-compute[72382]: DEBUG nova.network.neutron [req-746eae0f-4f91-488a-b383-d9fcef501839 req-ce2fe299-9409-4183-b63a-3ac6cd34eaf2 service nova] [instance: b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d] Refreshing network info cache for port 99b65ca7-d891-4625-917d-460e7fb69654 {{(pid=72382) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 15:27:42 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-bb1b72b1-498b-4ea0-b8b5-7186666d6162 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] [instance: b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d] Start _get_guest_xml network_info=[{"id": "99b65ca7-d891-4625-917d-460e7fb69654", "address": "fa:16:3e:98:b9:f2", "network": {"id": "643703fd-46b7-4309-862c-109141cb008c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-512918576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa6db5fd3ce24c1cadbedd64757e219b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99b65ca7-d8", "ovs_interfaceid": "99b65ca7-d891-4625-917d-460e7fb69654", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T15:11:25Z,direct_url=<?>,disk_format='qcow2',id=a79f2cea-eb27-4631-aaf3-05e7d9e411b4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a638990e12cc4d6eabb6d55e13be6bdf',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T15:11:27Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'a79f2cea-eb27-4631-aaf3-05e7d9e411b4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72382) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 15:27:42 user nova-compute[72382]: WARNING nova.virt.libvirt.driver [None req-bb1b72b1-498b-4ea0-b8b5-7186666d6162 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 15:27:42 user nova-compute[72382]: WARNING nova.virt.libvirt.driver [None req-bb1b72b1-498b-4ea0-b8b5-7186666d6162 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 15:27:42 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-bb1b72b1-498b-4ea0-b8b5-7186666d6162 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72382) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 15:27:42 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-bb1b72b1-498b-4ea0-b8b5-7186666d6162 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] CPU controller missing on host. {{(pid=72382) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 15:27:42 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-bb1b72b1-498b-4ea0-b8b5-7186666d6162 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72382) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 15:27:42 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-bb1b72b1-498b-4ea0-b8b5-7186666d6162 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] CPU controller found on host. {{(pid=72382) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 15:27:42 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-bb1b72b1-498b-4ea0-b8b5-7186666d6162 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72382) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 15:27:42 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-bb1b72b1-498b-4ea0-b8b5-7186666d6162 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T15:11:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T15:11:25Z,direct_url=<?>,disk_format='qcow2',id=a79f2cea-eb27-4631-aaf3-05e7d9e411b4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a638990e12cc4d6eabb6d55e13be6bdf',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T15:11:27Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 15:27:42 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-bb1b72b1-498b-4ea0-b8b5-7186666d6162 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Flavor limits 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 15:27:42 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-bb1b72b1-498b-4ea0-b8b5-7186666d6162 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Image limits 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 15:27:42 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-bb1b72b1-498b-4ea0-b8b5-7186666d6162 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Flavor pref 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 15:27:42 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-bb1b72b1-498b-4ea0-b8b5-7186666d6162 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Image pref 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 15:27:42 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-bb1b72b1-498b-4ea0-b8b5-7186666d6162 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 15:27:42 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-bb1b72b1-498b-4ea0-b8b5-7186666d6162 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 15:27:42 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-bb1b72b1-498b-4ea0-b8b5-7186666d6162 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72382) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 15:27:42 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-bb1b72b1-498b-4ea0-b8b5-7186666d6162 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Got 1 possible topologies {{(pid=72382) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 15:27:42 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-bb1b72b1-498b-4ea0-b8b5-7186666d6162 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 15:27:42 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-bb1b72b1-498b-4ea0-b8b5-7186666d6162 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 15:27:42 user nova-compute[72382]: DEBUG nova.virt.libvirt.vif [None req-bb1b72b1-498b-4ea0-b8b5-7186666d6162 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T15:27:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1040530269',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1040530269',id=30,image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMiQiccBAZbSGjl9sbSNKnQGJNN64201drRNdzHrfy2kYoUIkJ4KB4xuR2qLyVMxz2GHt6tPPGyITCyus9o+6b9G1oDw0H1d1ZWMxnk3TgYZXztCoqRxXenLA44cFa0yrg==',key_name='tempest-keypair-1139327477',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aa6db5fd3ce24c1cadbedd64757e219b',ramdisk_id='',reservation_id='r-ydxxngnu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1817688709',owner_user_name='tempest-AttachVolumeShelveTestJSON-1817688709-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T15:27:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9f95e50aa6194e778dfaee31e6e2fa68',uuid=b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "99b65ca7-d891-4625-917d-460e7fb69654", "address": "fa:16:3e:98:b9:f2", "network": {"id": "643703fd-46b7-4309-862c-109141cb008c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-512918576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa6db5fd3ce24c1cadbedd64757e219b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99b65ca7-d8", "ovs_interfaceid": "99b65ca7-d891-4625-917d-460e7fb69654", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72382) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 15:27:42 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-bb1b72b1-498b-4ea0-b8b5-7186666d6162 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Converting VIF {"id": "99b65ca7-d891-4625-917d-460e7fb69654", "address": "fa:16:3e:98:b9:f2", "network": {"id": "643703fd-46b7-4309-862c-109141cb008c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-512918576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa6db5fd3ce24c1cadbedd64757e219b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99b65ca7-d8", "ovs_interfaceid": "99b65ca7-d891-4625-917d-460e7fb69654", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 15:27:42 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-bb1b72b1-498b-4ea0-b8b5-7186666d6162 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:98:b9:f2,bridge_name='br-int',has_traffic_filtering=True,id=99b65ca7-d891-4625-917d-460e7fb69654,network=Network(643703fd-46b7-4309-862c-109141cb008c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99b65ca7-d8') {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 15:27:42 user nova-compute[72382]: DEBUG nova.objects.instance [None req-bb1b72b1-498b-4ea0-b8b5-7186666d6162 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Lazy-loading 'pci_devices' on Instance uuid b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:27:42 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-bb1b72b1-498b-4ea0-b8b5-7186666d6162 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] [instance: b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d] End _get_guest_xml xml=<domain type="kvm">
Aug 09 15:27:42 user nova-compute[72382]:   <uuid>b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d</uuid>
Aug 09 15:27:42 user nova-compute[72382]:   <name>instance-0000001e</name>
Aug 09 15:27:42 user nova-compute[72382]:   <memory>524288</memory>
Aug 09 15:27:42 user nova-compute[72382]:   <vcpu>1</vcpu>
Aug 09 15:27:42 user nova-compute[72382]:   <metadata>
Aug 09 15:27:42 user nova-compute[72382]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 15:27:42 user nova-compute[72382]:       <nova:package version="0.0.0"/>
Aug 09 15:27:42 user nova-compute[72382]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1040530269</nova:name>
Aug 09 15:27:42 user nova-compute[72382]:       <nova:creationTime>2023-08-09 15:27:42</nova:creationTime>
Aug 09 15:27:42 user nova-compute[72382]:       <nova:flavor name="m1.tiny">
Aug 09 15:27:42 user nova-compute[72382]:         <nova:memory>512</nova:memory>
Aug 09 15:27:42 user nova-compute[72382]:         <nova:disk>1</nova:disk>
Aug 09 15:27:42 user nova-compute[72382]:         <nova:swap>0</nova:swap>
Aug 09 15:27:42 user nova-compute[72382]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 15:27:42 user nova-compute[72382]:         <nova:vcpus>1</nova:vcpus>
Aug 09 15:27:42 user nova-compute[72382]:       </nova:flavor>
Aug 09 15:27:42 user nova-compute[72382]:       <nova:owner>
Aug 09 15:27:42 user nova-compute[72382]:         <nova:user uuid="9f95e50aa6194e778dfaee31e6e2fa68">tempest-AttachVolumeShelveTestJSON-1817688709-project-member</nova:user>
Aug 09 15:27:42 user nova-compute[72382]:         <nova:project uuid="aa6db5fd3ce24c1cadbedd64757e219b">tempest-AttachVolumeShelveTestJSON-1817688709</nova:project>
Aug 09 15:27:42 user nova-compute[72382]:       </nova:owner>
Aug 09 15:27:42 user nova-compute[72382]:       <nova:root type="image" uuid="a79f2cea-eb27-4631-aaf3-05e7d9e411b4"/>
Aug 09 15:27:42 user nova-compute[72382]:       <nova:ports>
Aug 09 15:27:42 user nova-compute[72382]:         <nova:port uuid="99b65ca7-d891-4625-917d-460e7fb69654">
Aug 09 15:27:42 user nova-compute[72382]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 09 15:27:42 user nova-compute[72382]:         </nova:port>
Aug 09 15:27:42 user nova-compute[72382]:       </nova:ports>
Aug 09 15:27:42 user nova-compute[72382]:     </nova:instance>
Aug 09 15:27:42 user nova-compute[72382]:   </metadata>
Aug 09 15:27:42 user nova-compute[72382]:   <sysinfo type="smbios">
Aug 09 15:27:42 user nova-compute[72382]:     <system>
Aug 09 15:27:42 user nova-compute[72382]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 15:27:42 user nova-compute[72382]:       <entry name="product">OpenStack Nova</entry>
Aug 09 15:27:42 user nova-compute[72382]:       <entry name="version">0.0.0</entry>
Aug 09 15:27:42 user nova-compute[72382]:       <entry name="serial">b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d</entry>
Aug 09 15:27:42 user nova-compute[72382]:       <entry name="uuid">b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d</entry>
Aug 09 15:27:42 user nova-compute[72382]:       <entry name="family">Virtual Machine</entry>
Aug 09 15:27:42 user nova-compute[72382]:     </system>
Aug 09 15:27:42 user nova-compute[72382]:   </sysinfo>
Aug 09 15:27:42 user nova-compute[72382]:   <os>
Aug 09 15:27:42 user nova-compute[72382]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 15:27:42 user nova-compute[72382]:     <boot dev="hd"/>
Aug 09 15:27:42 user nova-compute[72382]:     <smbios mode="sysinfo"/>
Aug 09 15:27:42 user nova-compute[72382]:   </os>
Aug 09 15:27:42 user nova-compute[72382]:   <features>
Aug 09 15:27:42 user nova-compute[72382]:     <acpi/>
Aug 09 15:27:42 user nova-compute[72382]:     <apic/>
Aug 09 15:27:42 user nova-compute[72382]:     <vmcoreinfo/>
Aug 09 15:27:42 user nova-compute[72382]:   </features>
Aug 09 15:27:42 user nova-compute[72382]:   <clock offset="utc">
Aug 09 15:27:42 user nova-compute[72382]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 15:27:42 user nova-compute[72382]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 15:27:42 user nova-compute[72382]:     <timer name="hpet" present="no"/>
Aug 09 15:27:42 user nova-compute[72382]:   </clock>
Aug 09 15:27:42 user nova-compute[72382]:   <cpu mode="custom" match="exact">
Aug 09 15:27:42 user nova-compute[72382]:     <model>Nehalem</model>
Aug 09 15:27:42 user nova-compute[72382]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 15:27:42 user nova-compute[72382]:   </cpu>
Aug 09 15:27:42 user nova-compute[72382]:   <devices>
Aug 09 15:27:42 user nova-compute[72382]:     <disk type="file" device="disk">
Aug 09 15:27:42 user nova-compute[72382]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 15:27:42 user nova-compute[72382]:       <source file="/opt/stack/data/nova/instances/b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d/disk"/>
Aug 09 15:27:42 user nova-compute[72382]:       <target dev="vda" bus="virtio"/>
Aug 09 15:27:42 user nova-compute[72382]:     </disk>
Aug 09 15:27:42 user nova-compute[72382]:     <interface type="ethernet">
Aug 09 15:27:42 user nova-compute[72382]:       <mac address="fa:16:3e:98:b9:f2"/>
Aug 09 15:27:42 user nova-compute[72382]:       <model type="virtio"/>
Aug 09 15:27:42 user nova-compute[72382]:       <mtu size="1442"/>
Aug 09 15:27:42 user nova-compute[72382]:       <target dev="tap99b65ca7-d8"/>
Aug 09 15:27:42 user nova-compute[72382]:     </interface>
Aug 09 15:27:42 user nova-compute[72382]:     <serial type="pty">
Aug 09 15:27:42 user nova-compute[72382]:       <log file="/opt/stack/data/nova/instances/b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d/console.log" append="off"/>
Aug 09 15:27:42 user nova-compute[72382]:     </serial>
Aug 09 15:27:42 user nova-compute[72382]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 15:27:42 user nova-compute[72382]:     <video>
Aug 09 15:27:42 user nova-compute[72382]:       <model type="virtio"/>
Aug 09 15:27:42 user nova-compute[72382]:     </video>
Aug 09 15:27:42 user nova-compute[72382]:     <rng model="virtio">
Aug 09 15:27:42 user nova-compute[72382]:       <backend model="random">/dev/urandom</backend>
Aug 09 15:27:42 user nova-compute[72382]:     </rng>
Aug 09 15:27:42 user nova-compute[72382]:     <controller type="usb" index="0" model="none"/>
Aug 09 15:27:42 user nova-compute[72382]:     <memballoon model="virtio">
Aug 09 15:27:42 user nova-compute[72382]:       <stats period="10"/>
Aug 09 15:27:42 user nova-compute[72382]:     </memballoon>
Aug 09 15:27:42 user nova-compute[72382]:   </devices>
Aug 09 15:27:42 user nova-compute[72382]: </domain>
Aug 09 15:27:42 user nova-compute[72382]:  {{(pid=72382) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 15:27:42 user nova-compute[72382]: DEBUG nova.virt.libvirt.vif [None req-bb1b72b1-498b-4ea0-b8b5-7186666d6162 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T15:27:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1040530269',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1040530269',id=30,image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMiQiccBAZbSGjl9sbSNKnQGJNN64201drRNdzHrfy2kYoUIkJ4KB4xuR2qLyVMxz2GHt6tPPGyITCyus9o+6b9G1oDw0H1d1ZWMxnk3TgYZXztCoqRxXenLA44cFa0yrg==',key_name='tempest-keypair-1139327477',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aa6db5fd3ce24c1cadbedd64757e219b',ramdisk_id='',reservation_id='r-ydxxngnu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1817688709',owner_user_name='tempest-AttachVolumeShelveTestJSON-1817688709-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T15:27:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9f95e50aa6194e778dfaee31e6e2fa68',uuid=b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "99b65ca7-d891-4625-917d-460e7fb69654", "address": "fa:16:3e:98:b9:f2", "network": {"id": "643703fd-46b7-4309-862c-109141cb008c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-512918576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa6db5fd3ce24c1cadbedd64757e219b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99b65ca7-d8", "ovs_interfaceid": "99b65ca7-d891-4625-917d-460e7fb69654", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 15:27:42 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-bb1b72b1-498b-4ea0-b8b5-7186666d6162 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Converting VIF {"id": "99b65ca7-d891-4625-917d-460e7fb69654", "address": "fa:16:3e:98:b9:f2", "network": {"id": "643703fd-46b7-4309-862c-109141cb008c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-512918576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa6db5fd3ce24c1cadbedd64757e219b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99b65ca7-d8", "ovs_interfaceid": "99b65ca7-d891-4625-917d-460e7fb69654", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 15:27:42 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-bb1b72b1-498b-4ea0-b8b5-7186666d6162 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:98:b9:f2,bridge_name='br-int',has_traffic_filtering=True,id=99b65ca7-d891-4625-917d-460e7fb69654,network=Network(643703fd-46b7-4309-862c-109141cb008c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99b65ca7-d8') {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 15:27:42 user nova-compute[72382]: DEBUG os_vif [None req-bb1b72b1-498b-4ea0-b8b5-7186666d6162 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:b9:f2,bridge_name='br-int',has_traffic_filtering=True,id=99b65ca7-d891-4625-917d-460e7fb69654,network=Network(643703fd-46b7-4309-862c-109141cb008c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99b65ca7-d8') {{(pid=72382) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 15:27:42 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:27:42 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:27:42 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 15:27:42 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:27:42 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap99b65ca7-d8, may_exist=True, interface_attrs={}) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:27:42 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap99b65ca7-d8, col_values=(('external_ids', {'iface-id': '99b65ca7-d891-4625-917d-460e7fb69654', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:98:b9:f2', 'vm-uuid': 'b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d'}),), if_exists=True) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:27:42 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:27:42 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:27:42 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:27:42 user nova-compute[72382]: INFO os_vif [None req-bb1b72b1-498b-4ea0-b8b5-7186666d6162 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:b9:f2,bridge_name='br-int',has_traffic_filtering=True,id=99b65ca7-d891-4625-917d-460e7fb69654,network=Network(643703fd-46b7-4309-862c-109141cb008c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99b65ca7-d8')
Aug 09 15:27:42 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-bb1b72b1-498b-4ea0-b8b5-7186666d6162 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] No BDM found with device name vda, not building metadata. {{(pid=72382) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 15:27:42 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-bb1b72b1-498b-4ea0-b8b5-7186666d6162 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] No VIF found with MAC fa:16:3e:98:b9:f2, not building metadata {{(pid=72382) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 15:27:42 user nova-compute[72382]: DEBUG nova.network.neutron [req-746eae0f-4f91-488a-b383-d9fcef501839 req-ce2fe299-9409-4183-b63a-3ac6cd34eaf2 service nova] [instance: b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d] Updated VIF entry in instance network info cache for port 99b65ca7-d891-4625-917d-460e7fb69654. {{(pid=72382) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 15:27:42 user nova-compute[72382]: DEBUG nova.network.neutron [req-746eae0f-4f91-488a-b383-d9fcef501839 req-ce2fe299-9409-4183-b63a-3ac6cd34eaf2 service nova] [instance: b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d] Updating instance_info_cache with network_info: [{"id": "99b65ca7-d891-4625-917d-460e7fb69654", "address": "fa:16:3e:98:b9:f2", "network": {"id": "643703fd-46b7-4309-862c-109141cb008c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-512918576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa6db5fd3ce24c1cadbedd64757e219b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99b65ca7-d8", "ovs_interfaceid": "99b65ca7-d891-4625-917d-460e7fb69654", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:27:42 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-746eae0f-4f91-488a-b383-d9fcef501839 req-ce2fe299-9409-4183-b63a-3ac6cd34eaf2 service nova] Releasing lock "refresh_cache-b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 15:27:43 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:27:43 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:27:43 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:27:43 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:27:43 user nova-compute[72382]: DEBUG nova.compute.manager [req-310260ca-f81a-4a0c-ad7a-4e49a3d96d68 req-48ac7130-abb5-43fb-9d10-bc03612433c9 service nova] [instance: b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d] Received event network-vif-plugged-99b65ca7-d891-4625-917d-460e7fb69654 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:27:43 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-310260ca-f81a-4a0c-ad7a-4e49a3d96d68 req-48ac7130-abb5-43fb-9d10-bc03612433c9 service nova] Acquiring lock "b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:27:43 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-310260ca-f81a-4a0c-ad7a-4e49a3d96d68 req-48ac7130-abb5-43fb-9d10-bc03612433c9 service nova] Lock "b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:27:43 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-310260ca-f81a-4a0c-ad7a-4e49a3d96d68 req-48ac7130-abb5-43fb-9d10-bc03612433c9 service nova] Lock "b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:27:43 user nova-compute[72382]: DEBUG nova.compute.manager [req-310260ca-f81a-4a0c-ad7a-4e49a3d96d68 req-48ac7130-abb5-43fb-9d10-bc03612433c9 service nova] [instance: b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d] No waiting events found dispatching network-vif-plugged-99b65ca7-d891-4625-917d-460e7fb69654 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:27:43 user nova-compute[72382]: WARNING nova.compute.manager [req-310260ca-f81a-4a0c-ad7a-4e49a3d96d68 req-48ac7130-abb5-43fb-9d10-bc03612433c9 service nova] [instance: b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d] Received unexpected event network-vif-plugged-99b65ca7-d891-4625-917d-460e7fb69654 for instance with vm_state building and task_state spawning.
Aug 09 15:27:44 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:27:44 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:27:44 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:27:44 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:27:44 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:27:44 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:27:45 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-b935d40d-84d9-4664-88f3-3befc822c9d8 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Acquiring lock "5002dc68-150a-4e96-bfe7-e66c6d764b9f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:27:45 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-b935d40d-84d9-4664-88f3-3befc822c9d8 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Lock "5002dc68-150a-4e96-bfe7-e66c6d764b9f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:27:45 user nova-compute[72382]: DEBUG nova.compute.manager [None req-b935d40d-84d9-4664-88f3-3befc822c9d8 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: 5002dc68-150a-4e96-bfe7-e66c6d764b9f] Starting instance... {{(pid=72382) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 15:27:45 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-b935d40d-84d9-4664-88f3-3befc822c9d8 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:27:45 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-b935d40d-84d9-4664-88f3-3befc822c9d8 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:27:45 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-b935d40d-84d9-4664-88f3-3befc822c9d8 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72382) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 15:27:45 user nova-compute[72382]: INFO nova.compute.claims [None req-b935d40d-84d9-4664-88f3-3befc822c9d8 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: 5002dc68-150a-4e96-bfe7-e66c6d764b9f] Claim successful on node user
Aug 09 15:27:45 user nova-compute[72382]: DEBUG nova.virt.driver [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Emitting event <LifecycleEvent: 1691594865.8043032, b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d => Resumed> {{(pid=72382) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 15:27:45 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d] VM Resumed (Lifecycle Event)
Aug 09 15:27:45 user nova-compute[72382]: DEBUG nova.compute.manager [None req-bb1b72b1-498b-4ea0-b8b5-7186666d6162 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] [instance: b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d] Instance event wait completed in 0 seconds for  {{(pid=72382) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 15:27:45 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-bb1b72b1-498b-4ea0-b8b5-7186666d6162 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] [instance: b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d] Guest created on hypervisor {{(pid=72382) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 15:27:45 user nova-compute[72382]: INFO nova.virt.libvirt.driver [-] [instance: b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d] Instance spawned successfully.
Aug 09 15:27:45 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-bb1b72b1-498b-4ea0-b8b5-7186666d6162 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] [instance: b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 15:27:45 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:27:45 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72382) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 15:27:45 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-bb1b72b1-498b-4ea0-b8b5-7186666d6162 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] [instance: b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d] Found default for hw_cdrom_bus of ide {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:27:45 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-bb1b72b1-498b-4ea0-b8b5-7186666d6162 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] [instance: b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d] Found default for hw_disk_bus of virtio {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:27:45 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-bb1b72b1-498b-4ea0-b8b5-7186666d6162 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] [instance: b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d] Found default for hw_input_bus of None {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:27:45 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-bb1b72b1-498b-4ea0-b8b5-7186666d6162 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] [instance: b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d] Found default for hw_pointer_model of None {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:27:45 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-bb1b72b1-498b-4ea0-b8b5-7186666d6162 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] [instance: b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d] Found default for hw_video_model of virtio {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:27:45 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-bb1b72b1-498b-4ea0-b8b5-7186666d6162 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] [instance: b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d] Found default for hw_vif_model of virtio {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:27:45 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 15:27:45 user nova-compute[72382]: DEBUG nova.virt.driver [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Emitting event <LifecycleEvent: 1691594865.808096, b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d => Started> {{(pid=72382) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 15:27:45 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d] VM Started (Lifecycle Event)
Aug 09 15:27:45 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:27:45 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72382) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 15:27:45 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 15:27:45 user nova-compute[72382]: INFO nova.compute.manager [None req-bb1b72b1-498b-4ea0-b8b5-7186666d6162 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] [instance: b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d] Took 5.63 seconds to spawn the instance on the hypervisor.
Aug 09 15:27:45 user nova-compute[72382]: DEBUG nova.compute.manager [None req-bb1b72b1-498b-4ea0-b8b5-7186666d6162 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] [instance: b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:27:45 user nova-compute[72382]: DEBUG nova.compute.manager [req-23f66894-56fa-4c64-b1db-f23d7e2103e5 req-51f40b83-a2bb-48c6-95bb-e698f467c607 service nova] [instance: b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d] Received event network-vif-plugged-99b65ca7-d891-4625-917d-460e7fb69654 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:27:45 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-23f66894-56fa-4c64-b1db-f23d7e2103e5 req-51f40b83-a2bb-48c6-95bb-e698f467c607 service nova] Acquiring lock "b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:27:45 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-23f66894-56fa-4c64-b1db-f23d7e2103e5 req-51f40b83-a2bb-48c6-95bb-e698f467c607 service nova] Lock "b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:27:45 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-23f66894-56fa-4c64-b1db-f23d7e2103e5 req-51f40b83-a2bb-48c6-95bb-e698f467c607 service nova] Lock "b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:27:45 user nova-compute[72382]: DEBUG nova.compute.manager [req-23f66894-56fa-4c64-b1db-f23d7e2103e5 req-51f40b83-a2bb-48c6-95bb-e698f467c607 service nova] [instance: b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d] No waiting events found dispatching network-vif-plugged-99b65ca7-d891-4625-917d-460e7fb69654 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:27:45 user nova-compute[72382]: WARNING nova.compute.manager [req-23f66894-56fa-4c64-b1db-f23d7e2103e5 req-51f40b83-a2bb-48c6-95bb-e698f467c607 service nova] [instance: b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d] Received unexpected event network-vif-plugged-99b65ca7-d891-4625-917d-460e7fb69654 for instance with vm_state building and task_state spawning.
Aug 09 15:27:46 user nova-compute[72382]: INFO nova.compute.manager [None req-bb1b72b1-498b-4ea0-b8b5-7186666d6162 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] [instance: b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d] Took 6.68 seconds to build instance.
Aug 09 15:27:46 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-bb1b72b1-498b-4ea0-b8b5-7186666d6162 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Lock "b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.906s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:27:46 user nova-compute[72382]: DEBUG nova.compute.provider_tree [None req-b935d40d-84d9-4664-88f3-3befc822c9d8 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Inventory has not changed in ProviderTree for provider: 7b15b0e5-df4d-49db-833b-2855d21d10ae {{(pid=72382) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 15:27:46 user nova-compute[72382]: DEBUG nova.scheduler.client.report [None req-b935d40d-84d9-4664-88f3-3befc822c9d8 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Inventory has not changed for provider 7b15b0e5-df4d-49db-833b-2855d21d10ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72382) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 15:27:46 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-b935d40d-84d9-4664-88f3-3befc822c9d8 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.638s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:27:46 user nova-compute[72382]: DEBUG nova.compute.manager [None req-b935d40d-84d9-4664-88f3-3befc822c9d8 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: 5002dc68-150a-4e96-bfe7-e66c6d764b9f] Start building networks asynchronously for instance. {{(pid=72382) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 15:27:46 user nova-compute[72382]: DEBUG nova.compute.manager [None req-b935d40d-84d9-4664-88f3-3befc822c9d8 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: 5002dc68-150a-4e96-bfe7-e66c6d764b9f] Allocating IP information in the background. {{(pid=72382) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 15:27:46 user nova-compute[72382]: DEBUG nova.network.neutron [None req-b935d40d-84d9-4664-88f3-3befc822c9d8 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: 5002dc68-150a-4e96-bfe7-e66c6d764b9f] allocate_for_instance() {{(pid=72382) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 15:27:46 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-b935d40d-84d9-4664-88f3-3befc822c9d8 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: 5002dc68-150a-4e96-bfe7-e66c6d764b9f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 15:27:46 user nova-compute[72382]: DEBUG nova.compute.manager [None req-b935d40d-84d9-4664-88f3-3befc822c9d8 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: 5002dc68-150a-4e96-bfe7-e66c6d764b9f] Start building block device mappings for instance. {{(pid=72382) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 15:27:46 user nova-compute[72382]: DEBUG nova.policy [None req-b935d40d-84d9-4664-88f3-3befc822c9d8 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '280bcf2afd7245a7bcd605e0db79c569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70310b1af40b4d239fe5ea362972554b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72382) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 15:27:46 user nova-compute[72382]: INFO nova.virt.block_device [None req-b935d40d-84d9-4664-88f3-3befc822c9d8 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: 5002dc68-150a-4e96-bfe7-e66c6d764b9f] Booting with volume snapshot 8575ab05-8f6b-444d-b6ab-f85fdc88ca16 at /dev/vda
Aug 09 15:27:47 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:27:47 user nova-compute[72382]: DEBUG nova.network.neutron [None req-b935d40d-84d9-4664-88f3-3befc822c9d8 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: 5002dc68-150a-4e96-bfe7-e66c6d764b9f] Successfully created port: a778401a-b0e7-45f5-9148-86853431427d {{(pid=72382) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 15:27:47 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:27:48 user nova-compute[72382]: DEBUG nova.network.neutron [None req-b935d40d-84d9-4664-88f3-3befc822c9d8 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: 5002dc68-150a-4e96-bfe7-e66c6d764b9f] Successfully updated port: a778401a-b0e7-45f5-9148-86853431427d {{(pid=72382) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 15:27:48 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-b935d40d-84d9-4664-88f3-3befc822c9d8 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Acquiring lock "refresh_cache-5002dc68-150a-4e96-bfe7-e66c6d764b9f" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 15:27:48 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-b935d40d-84d9-4664-88f3-3befc822c9d8 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Acquired lock "refresh_cache-5002dc68-150a-4e96-bfe7-e66c6d764b9f" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 15:27:48 user nova-compute[72382]: DEBUG nova.network.neutron [None req-b935d40d-84d9-4664-88f3-3befc822c9d8 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: 5002dc68-150a-4e96-bfe7-e66c6d764b9f] Building network info cache for instance {{(pid=72382) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 15:27:48 user nova-compute[72382]: DEBUG nova.compute.manager [req-a58b9145-f059-4b59-a3ae-2e539dfe8f7f req-730c9270-d257-47dd-bca4-e4ecb7aca5b4 service nova] [instance: 5002dc68-150a-4e96-bfe7-e66c6d764b9f] Received event network-changed-a778401a-b0e7-45f5-9148-86853431427d {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:27:48 user nova-compute[72382]: DEBUG nova.compute.manager [req-a58b9145-f059-4b59-a3ae-2e539dfe8f7f req-730c9270-d257-47dd-bca4-e4ecb7aca5b4 service nova] [instance: 5002dc68-150a-4e96-bfe7-e66c6d764b9f] Refreshing instance network info cache due to event network-changed-a778401a-b0e7-45f5-9148-86853431427d. {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 15:27:48 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-a58b9145-f059-4b59-a3ae-2e539dfe8f7f req-730c9270-d257-47dd-bca4-e4ecb7aca5b4 service nova] Acquiring lock "refresh_cache-5002dc68-150a-4e96-bfe7-e66c6d764b9f" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 15:27:48 user nova-compute[72382]: DEBUG nova.network.neutron [None req-b935d40d-84d9-4664-88f3-3befc822c9d8 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: 5002dc68-150a-4e96-bfe7-e66c6d764b9f] Instance cache missing network info. {{(pid=72382) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 15:27:48 user nova-compute[72382]: DEBUG nova.network.neutron [None req-b935d40d-84d9-4664-88f3-3befc822c9d8 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: 5002dc68-150a-4e96-bfe7-e66c6d764b9f] Updating instance_info_cache with network_info: [{"id": "a778401a-b0e7-45f5-9148-86853431427d", "address": "fa:16:3e:bf:ea:de", "network": {"id": "a78e6cb6-feb7-4f64-a3c0-4900594b6e37", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-338007968-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70310b1af40b4d239fe5ea362972554b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa778401a-b0", "ovs_interfaceid": "a778401a-b0e7-45f5-9148-86853431427d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:27:48 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-b935d40d-84d9-4664-88f3-3befc822c9d8 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Releasing lock "refresh_cache-5002dc68-150a-4e96-bfe7-e66c6d764b9f" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 15:27:48 user nova-compute[72382]: DEBUG nova.compute.manager [None req-b935d40d-84d9-4664-88f3-3befc822c9d8 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: 5002dc68-150a-4e96-bfe7-e66c6d764b9f] Instance network_info: |[{"id": "a778401a-b0e7-45f5-9148-86853431427d", "address": "fa:16:3e:bf:ea:de", "network": {"id": "a78e6cb6-feb7-4f64-a3c0-4900594b6e37", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-338007968-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70310b1af40b4d239fe5ea362972554b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa778401a-b0", "ovs_interfaceid": "a778401a-b0e7-45f5-9148-86853431427d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72382) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 15:27:48 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-a58b9145-f059-4b59-a3ae-2e539dfe8f7f req-730c9270-d257-47dd-bca4-e4ecb7aca5b4 service nova] Acquired lock "refresh_cache-5002dc68-150a-4e96-bfe7-e66c6d764b9f" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 15:27:48 user nova-compute[72382]: DEBUG nova.network.neutron [req-a58b9145-f059-4b59-a3ae-2e539dfe8f7f req-730c9270-d257-47dd-bca4-e4ecb7aca5b4 service nova] [instance: 5002dc68-150a-4e96-bfe7-e66c6d764b9f] Refreshing network info cache for port a778401a-b0e7-45f5-9148-86853431427d {{(pid=72382) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 15:27:49 user nova-compute[72382]: DEBUG nova.network.neutron [req-a58b9145-f059-4b59-a3ae-2e539dfe8f7f req-730c9270-d257-47dd-bca4-e4ecb7aca5b4 service nova] [instance: 5002dc68-150a-4e96-bfe7-e66c6d764b9f] Updated VIF entry in instance network info cache for port a778401a-b0e7-45f5-9148-86853431427d. {{(pid=72382) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 15:27:49 user nova-compute[72382]: DEBUG nova.network.neutron [req-a58b9145-f059-4b59-a3ae-2e539dfe8f7f req-730c9270-d257-47dd-bca4-e4ecb7aca5b4 service nova] [instance: 5002dc68-150a-4e96-bfe7-e66c6d764b9f] Updating instance_info_cache with network_info: [{"id": "a778401a-b0e7-45f5-9148-86853431427d", "address": "fa:16:3e:bf:ea:de", "network": {"id": "a78e6cb6-feb7-4f64-a3c0-4900594b6e37", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-338007968-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70310b1af40b4d239fe5ea362972554b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa778401a-b0", "ovs_interfaceid": "a778401a-b0e7-45f5-9148-86853431427d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:27:49 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-a58b9145-f059-4b59-a3ae-2e539dfe8f7f req-730c9270-d257-47dd-bca4-e4ecb7aca5b4 service nova] Releasing lock "refresh_cache-5002dc68-150a-4e96-bfe7-e66c6d764b9f" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 15:27:49 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:27:50 user nova-compute[72382]: DEBUG nova.compute.manager [req-bf48ea05-3551-4f4e-8d8f-fcbe79488ea3 req-77a2b6cb-a069-4142-9311-e9d3a2864dbc service nova] [instance: 48161b45-d21a-4fb1-ae90-4613d849bfa7] Received event network-changed-fa20e470-cbff-4903-8515-f7a8b1cdfef6 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:27:50 user nova-compute[72382]: DEBUG nova.compute.manager [req-bf48ea05-3551-4f4e-8d8f-fcbe79488ea3 req-77a2b6cb-a069-4142-9311-e9d3a2864dbc service nova] [instance: 48161b45-d21a-4fb1-ae90-4613d849bfa7] Refreshing instance network info cache due to event network-changed-fa20e470-cbff-4903-8515-f7a8b1cdfef6. {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 15:27:50 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-bf48ea05-3551-4f4e-8d8f-fcbe79488ea3 req-77a2b6cb-a069-4142-9311-e9d3a2864dbc service nova] Acquiring lock "refresh_cache-48161b45-d21a-4fb1-ae90-4613d849bfa7" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 15:27:50 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-bf48ea05-3551-4f4e-8d8f-fcbe79488ea3 req-77a2b6cb-a069-4142-9311-e9d3a2864dbc service nova] Acquired lock "refresh_cache-48161b45-d21a-4fb1-ae90-4613d849bfa7" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 15:27:50 user nova-compute[72382]: DEBUG nova.network.neutron [req-bf48ea05-3551-4f4e-8d8f-fcbe79488ea3 req-77a2b6cb-a069-4142-9311-e9d3a2864dbc service nova] [instance: 48161b45-d21a-4fb1-ae90-4613d849bfa7] Refreshing network info cache for port fa20e470-cbff-4903-8515-f7a8b1cdfef6 {{(pid=72382) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 15:27:50 user nova-compute[72382]: DEBUG nova.network.neutron [req-bf48ea05-3551-4f4e-8d8f-fcbe79488ea3 req-77a2b6cb-a069-4142-9311-e9d3a2864dbc service nova] [instance: 48161b45-d21a-4fb1-ae90-4613d849bfa7] Updated VIF entry in instance network info cache for port fa20e470-cbff-4903-8515-f7a8b1cdfef6. {{(pid=72382) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 15:27:50 user nova-compute[72382]: DEBUG nova.network.neutron [req-bf48ea05-3551-4f4e-8d8f-fcbe79488ea3 req-77a2b6cb-a069-4142-9311-e9d3a2864dbc service nova] [instance: 48161b45-d21a-4fb1-ae90-4613d849bfa7] Updating instance_info_cache with network_info: [{"id": "fa20e470-cbff-4903-8515-f7a8b1cdfef6", "address": "fa:16:3e:48:c6:b5", "network": {"id": "46eb5f03-e04d-43d1-96d6-0792bc7a94b1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1842512309-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98009994d9c74eb9b4fc6321e82440de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa20e470-cb", "ovs_interfaceid": "fa20e470-cbff-4903-8515-f7a8b1cdfef6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:27:50 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-bf48ea05-3551-4f4e-8d8f-fcbe79488ea3 req-77a2b6cb-a069-4142-9311-e9d3a2864dbc service nova] Releasing lock "refresh_cache-48161b45-d21a-4fb1-ae90-4613d849bfa7" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 15:27:50 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-368d353e-b0d0-4cbc-8e99-df97c5e592fa tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Acquiring lock "48161b45-d21a-4fb1-ae90-4613d849bfa7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:27:50 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-368d353e-b0d0-4cbc-8e99-df97c5e592fa tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Lock "48161b45-d21a-4fb1-ae90-4613d849bfa7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:27:50 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-368d353e-b0d0-4cbc-8e99-df97c5e592fa tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Acquiring lock "48161b45-d21a-4fb1-ae90-4613d849bfa7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:27:50 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-368d353e-b0d0-4cbc-8e99-df97c5e592fa tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Lock "48161b45-d21a-4fb1-ae90-4613d849bfa7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:27:50 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-368d353e-b0d0-4cbc-8e99-df97c5e592fa tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Lock "48161b45-d21a-4fb1-ae90-4613d849bfa7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:27:50 user nova-compute[72382]: INFO nova.compute.manager [None req-368d353e-b0d0-4cbc-8e99-df97c5e592fa tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] [instance: 48161b45-d21a-4fb1-ae90-4613d849bfa7] Terminating instance
Aug 09 15:27:50 user nova-compute[72382]: DEBUG nova.compute.manager [None req-368d353e-b0d0-4cbc-8e99-df97c5e592fa tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] [instance: 48161b45-d21a-4fb1-ae90-4613d849bfa7] Start destroying the instance on the hypervisor. {{(pid=72382) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 15:27:50 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:27:51 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:27:51 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:27:51 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:27:51 user nova-compute[72382]: INFO nova.virt.libvirt.driver [-] [instance: 48161b45-d21a-4fb1-ae90-4613d849bfa7] Instance destroyed successfully.
Aug 09 15:27:51 user nova-compute[72382]: DEBUG nova.objects.instance [None req-368d353e-b0d0-4cbc-8e99-df97c5e592fa tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Lazy-loading 'resources' on Instance uuid 48161b45-d21a-4fb1-ae90-4613d849bfa7 {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:27:51 user nova-compute[72382]: DEBUG nova.virt.libvirt.vif [None req-368d353e-b0d0-4cbc-8e99-df97c5e592fa tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T15:25:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-405878590',display_name='tempest-AttachVolumeNegativeTest-server-405878590',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-405878590',id=26,image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKmH7XZTu+BpT7XfaWvSEoIi0u6Y8VQmOeYAPCTpPb+wvVv+q/ESpWzfB8L/gibhNp6zy0dSWolKGjRmeUv9muOySC5Qp2zentXrNIHQvlHwfwVjZPw4I/e/Q5DD62VQNw==',key_name='tempest-keypair-591688920',keypairs=<?>,launch_index=0,launched_at=2023-08-09T15:26:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='98009994d9c74eb9b4fc6321e82440de',ramdisk_id='',reservation_id='r-qwoou6vv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1325594356',owner_user_name='tempest-AttachVolumeNegativeTest-1325594356-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T15:26:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='401c9df41f284c88a86557485d7d9537',uuid=48161b45-d21a-4fb1-ae90-4613d849bfa7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fa20e470-cbff-4903-8515-f7a8b1cdfef6", "address": "fa:16:3e:48:c6:b5", "network": {"id": "46eb5f03-e04d-43d1-96d6-0792bc7a94b1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1842512309-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98009994d9c74eb9b4fc6321e82440de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa20e470-cb", "ovs_interfaceid": "fa20e470-cbff-4903-8515-f7a8b1cdfef6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 15:27:51 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-368d353e-b0d0-4cbc-8e99-df97c5e592fa tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Converting VIF {"id": "fa20e470-cbff-4903-8515-f7a8b1cdfef6", "address": "fa:16:3e:48:c6:b5", "network": {"id": "46eb5f03-e04d-43d1-96d6-0792bc7a94b1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1842512309-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98009994d9c74eb9b4fc6321e82440de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa20e470-cb", "ovs_interfaceid": "fa20e470-cbff-4903-8515-f7a8b1cdfef6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 15:27:51 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-368d353e-b0d0-4cbc-8e99-df97c5e592fa tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:48:c6:b5,bridge_name='br-int',has_traffic_filtering=True,id=fa20e470-cbff-4903-8515-f7a8b1cdfef6,network=Network(46eb5f03-e04d-43d1-96d6-0792bc7a94b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa20e470-cb') {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 15:27:51 user nova-compute[72382]: DEBUG os_vif [None req-368d353e-b0d0-4cbc-8e99-df97c5e592fa tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:48:c6:b5,bridge_name='br-int',has_traffic_filtering=True,id=fa20e470-cbff-4903-8515-f7a8b1cdfef6,network=Network(46eb5f03-e04d-43d1-96d6-0792bc7a94b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa20e470-cb') {{(pid=72382) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 15:27:51 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:27:51 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfa20e470-cb, bridge=br-int, if_exists=True) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:27:51 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:27:51 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:27:51 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:27:51 user nova-compute[72382]: INFO os_vif [None req-368d353e-b0d0-4cbc-8e99-df97c5e592fa tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:48:c6:b5,bridge_name='br-int',has_traffic_filtering=True,id=fa20e470-cbff-4903-8515-f7a8b1cdfef6,network=Network(46eb5f03-e04d-43d1-96d6-0792bc7a94b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa20e470-cb')
Aug 09 15:27:51 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-368d353e-b0d0-4cbc-8e99-df97c5e592fa tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] [instance: 48161b45-d21a-4fb1-ae90-4613d849bfa7] Deleting instance files /opt/stack/data/nova/instances/48161b45-d21a-4fb1-ae90-4613d849bfa7_del
Aug 09 15:27:51 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-368d353e-b0d0-4cbc-8e99-df97c5e592fa tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] [instance: 48161b45-d21a-4fb1-ae90-4613d849bfa7] Deletion of /opt/stack/data/nova/instances/48161b45-d21a-4fb1-ae90-4613d849bfa7_del complete
Aug 09 15:27:51 user nova-compute[72382]: INFO nova.compute.manager [None req-368d353e-b0d0-4cbc-8e99-df97c5e592fa tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] [instance: 48161b45-d21a-4fb1-ae90-4613d849bfa7] Took 0.90 seconds to destroy the instance on the hypervisor.
Aug 09 15:27:51 user nova-compute[72382]: DEBUG oslo.service.loopingcall [None req-368d353e-b0d0-4cbc-8e99-df97c5e592fa tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72382) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 15:27:51 user nova-compute[72382]: DEBUG nova.compute.manager [-] [instance: 48161b45-d21a-4fb1-ae90-4613d849bfa7] Deallocating network for instance {{(pid=72382) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 15:27:51 user nova-compute[72382]: DEBUG nova.network.neutron [-] [instance: 48161b45-d21a-4fb1-ae90-4613d849bfa7] deallocate_for_instance() {{(pid=72382) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 15:27:52 user nova-compute[72382]: DEBUG os_brick.utils [None req-b935d40d-84d9-4664-88f3-3befc822c9d8 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 15:27:52 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:27:52 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:27:52 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d0e4fc9-276b-4dec-a913-fa98410ef16c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d2cfa7015fe\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:27:52 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:27:52 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:27:52 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[008bb332-11bc-4ba5-923b-de3aff6215c9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:27:52 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:27:52 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:27:52 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcfde8d4-b46b-4804-8cba-345e69f9bec3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:27:52 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[65712e37-2c05-411e-bd16-61e6e73ad9d8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:27:52 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-b935d40d-84d9-4664-88f3-3befc822c9d8 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Running cmd (subprocess): nvme version {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:27:52 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-b935d40d-84d9-4664-88f3-3befc822c9d8 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] 'nvme version' failed. Not Retrying. {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 15:27:52 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b935d40d-84d9-4664-88f3-3befc822c9d8 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] nvme not present on system {{(pid=72382) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 15:27:52 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:27:52 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 15:27:52 user nova-compute[72382]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 15:27:52 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[acf4289e-0989-4d63-82da-2407c9de408b]: (4, '') {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:27:52 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.lightos [None req-b935d40d-84d9-4664-88f3-3befc822c9d8 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72382) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 15:27:52 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.lightos [None req-b935d40d-84d9-4664-88f3-3befc822c9d8 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72382) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 15:27:52 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.lightos [None req-b935d40d-84d9-4664-88f3-3befc822c9d8 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] LIGHTOS: no hostnqn found. {{(pid=72382) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 15:27:52 user nova-compute[72382]: DEBUG os_brick.utils [None req-b935d40d-84d9-4664-88f3-3befc822c9d8 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] <== get_connector_properties: return (162ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d2cfa7015fe', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 15:27:52 user nova-compute[72382]: DEBUG nova.virt.block_device [None req-b935d40d-84d9-4664-88f3-3befc822c9d8 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: 5002dc68-150a-4e96-bfe7-e66c6d764b9f] Updating existing volume attachment record: 4fe5dc5d-aaea-4e0d-ac60-07c9814f7a2c {{(pid=72382) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 15:27:52 user nova-compute[72382]: DEBUG nova.compute.manager [req-372c1f06-640d-4d3a-9019-e79a18aed074 req-dab6356b-24d1-45af-a93a-4742ede7c592 service nova] [instance: 48161b45-d21a-4fb1-ae90-4613d849bfa7] Received event network-vif-unplugged-fa20e470-cbff-4903-8515-f7a8b1cdfef6 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:27:52 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-372c1f06-640d-4d3a-9019-e79a18aed074 req-dab6356b-24d1-45af-a93a-4742ede7c592 service nova] Acquiring lock "48161b45-d21a-4fb1-ae90-4613d849bfa7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:27:52 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-372c1f06-640d-4d3a-9019-e79a18aed074 req-dab6356b-24d1-45af-a93a-4742ede7c592 service nova] Lock "48161b45-d21a-4fb1-ae90-4613d849bfa7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:27:52 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-372c1f06-640d-4d3a-9019-e79a18aed074 req-dab6356b-24d1-45af-a93a-4742ede7c592 service nova] Lock "48161b45-d21a-4fb1-ae90-4613d849bfa7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:27:52 user nova-compute[72382]: DEBUG nova.compute.manager [req-372c1f06-640d-4d3a-9019-e79a18aed074 req-dab6356b-24d1-45af-a93a-4742ede7c592 service nova] [instance: 48161b45-d21a-4fb1-ae90-4613d849bfa7] No waiting events found dispatching network-vif-unplugged-fa20e470-cbff-4903-8515-f7a8b1cdfef6 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:27:52 user nova-compute[72382]: DEBUG nova.compute.manager [req-372c1f06-640d-4d3a-9019-e79a18aed074 req-dab6356b-24d1-45af-a93a-4742ede7c592 service nova] [instance: 48161b45-d21a-4fb1-ae90-4613d849bfa7] Received event network-vif-unplugged-fa20e470-cbff-4903-8515-f7a8b1cdfef6 for instance with task_state deleting. {{(pid=72382) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 15:27:52 user nova-compute[72382]: DEBUG nova.compute.manager [req-372c1f06-640d-4d3a-9019-e79a18aed074 req-dab6356b-24d1-45af-a93a-4742ede7c592 service nova] [instance: 48161b45-d21a-4fb1-ae90-4613d849bfa7] Received event network-vif-plugged-fa20e470-cbff-4903-8515-f7a8b1cdfef6 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:27:52 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-372c1f06-640d-4d3a-9019-e79a18aed074 req-dab6356b-24d1-45af-a93a-4742ede7c592 service nova] Acquiring lock "48161b45-d21a-4fb1-ae90-4613d849bfa7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:27:52 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-372c1f06-640d-4d3a-9019-e79a18aed074 req-dab6356b-24d1-45af-a93a-4742ede7c592 service nova] Lock "48161b45-d21a-4fb1-ae90-4613d849bfa7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:27:52 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-372c1f06-640d-4d3a-9019-e79a18aed074 req-dab6356b-24d1-45af-a93a-4742ede7c592 service nova] Lock "48161b45-d21a-4fb1-ae90-4613d849bfa7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:27:52 user nova-compute[72382]: DEBUG nova.compute.manager [req-372c1f06-640d-4d3a-9019-e79a18aed074 req-dab6356b-24d1-45af-a93a-4742ede7c592 service nova] [instance: 48161b45-d21a-4fb1-ae90-4613d849bfa7] No waiting events found dispatching network-vif-plugged-fa20e470-cbff-4903-8515-f7a8b1cdfef6 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:27:52 user nova-compute[72382]: WARNING nova.compute.manager [req-372c1f06-640d-4d3a-9019-e79a18aed074 req-dab6356b-24d1-45af-a93a-4742ede7c592 service nova] [instance: 48161b45-d21a-4fb1-ae90-4613d849bfa7] Received unexpected event network-vif-plugged-fa20e470-cbff-4903-8515-f7a8b1cdfef6 for instance with vm_state active and task_state deleting.
Aug 09 15:27:52 user nova-compute[72382]: DEBUG nova.network.neutron [-] [instance: 48161b45-d21a-4fb1-ae90-4613d849bfa7] Updating instance_info_cache with network_info: [] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:27:52 user nova-compute[72382]: INFO nova.compute.manager [-] [instance: 48161b45-d21a-4fb1-ae90-4613d849bfa7] Took 1.10 seconds to deallocate network for instance.
Aug 09 15:27:52 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-368d353e-b0d0-4cbc-8e99-df97c5e592fa tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:27:52 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-368d353e-b0d0-4cbc-8e99-df97c5e592fa tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:27:53 user nova-compute[72382]: DEBUG nova.compute.provider_tree [None req-368d353e-b0d0-4cbc-8e99-df97c5e592fa tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Inventory has not changed in ProviderTree for provider: 7b15b0e5-df4d-49db-833b-2855d21d10ae {{(pid=72382) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 15:27:53 user nova-compute[72382]: DEBUG nova.scheduler.client.report [None req-368d353e-b0d0-4cbc-8e99-df97c5e592fa tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Inventory has not changed for provider 7b15b0e5-df4d-49db-833b-2855d21d10ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72382) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 15:27:53 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-368d353e-b0d0-4cbc-8e99-df97c5e592fa tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.472s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:27:53 user nova-compute[72382]: INFO nova.scheduler.client.report [None req-368d353e-b0d0-4cbc-8e99-df97c5e592fa tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Deleted allocations for instance 48161b45-d21a-4fb1-ae90-4613d849bfa7
Aug 09 15:27:53 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-368d353e-b0d0-4cbc-8e99-df97c5e592fa tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Lock "48161b45-d21a-4fb1-ae90-4613d849bfa7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.691s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:27:53 user nova-compute[72382]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691594858.8131099, 14c97840-88c0-4a8e-96e8-2e7da318ad07 => Stopped> {{(pid=72382) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 15:27:53 user nova-compute[72382]: INFO nova.compute.manager [-] [instance: 14c97840-88c0-4a8e-96e8-2e7da318ad07] VM Stopped (Lifecycle Event)
Aug 09 15:27:53 user nova-compute[72382]: DEBUG nova.compute.manager [None req-4560bb41-311a-4dd3-9367-34424e8d29b2 None None] [instance: 14c97840-88c0-4a8e-96e8-2e7da318ad07] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:27:53 user nova-compute[72382]: DEBUG nova.compute.manager [None req-4560bb41-311a-4dd3-9367-34424e8d29b2 None None] [instance: 14c97840-88c0-4a8e-96e8-2e7da318ad07] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=72382) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 15:27:54 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:27:54 user nova-compute[72382]: DEBUG nova.compute.manager [req-7c47f1ee-2737-4694-838e-b4d5af33889c req-b673bc4e-1cbe-46fc-9a5b-b378c2c3445a service nova] [instance: 48161b45-d21a-4fb1-ae90-4613d849bfa7] Received event network-vif-deleted-fa20e470-cbff-4903-8515-f7a8b1cdfef6 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:27:56 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:27:56 user nova-compute[72382]: INFO nova.compute.manager [None req-65bd0e12-aa6e-4fbe-96f2-6fda8630216e tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] [instance: e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0] Unrescuing
Aug 09 15:27:56 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-65bd0e12-aa6e-4fbe-96f2-6fda8630216e tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Acquiring lock "refresh_cache-e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 15:27:56 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-65bd0e12-aa6e-4fbe-96f2-6fda8630216e tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Acquired lock "refresh_cache-e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 15:27:56 user nova-compute[72382]: DEBUG nova.network.neutron [None req-65bd0e12-aa6e-4fbe-96f2-6fda8630216e tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] [instance: e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0] Building network info cache for instance {{(pid=72382) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 15:27:58 user nova-compute[72382]: DEBUG nova.network.neutron [None req-65bd0e12-aa6e-4fbe-96f2-6fda8630216e tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] [instance: e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0] Updating instance_info_cache with network_info: [{"id": "9513dc1d-79d5-482b-baaa-81f525e99de7", "address": "fa:16:3e:6f:6b:41", "network": {"id": "46ef00c7-17ee-4e45-ba1d-dcc0a417ea85", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1360012261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.24", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "990ba791030940d38360af5879c853c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9513dc1d-79", "ovs_interfaceid": "9513dc1d-79d5-482b-baaa-81f525e99de7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:27:58 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-65bd0e12-aa6e-4fbe-96f2-6fda8630216e tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Releasing lock "refresh_cache-e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 15:27:58 user nova-compute[72382]: DEBUG nova.objects.instance [None req-65bd0e12-aa6e-4fbe-96f2-6fda8630216e tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Lazy-loading 'flavor' on Instance uuid e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0 {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:27:58 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:27:58 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:27:58 user nova-compute[72382]: DEBUG nova.compute.manager [req-34baab0b-4a0d-49ff-9b8b-2808120687ee req-d797a5b4-d327-4f8d-a498-e2a9c3e7010d service nova] [instance: e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0] Received event network-vif-unplugged-9513dc1d-79d5-482b-baaa-81f525e99de7 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:27:58 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-34baab0b-4a0d-49ff-9b8b-2808120687ee req-d797a5b4-d327-4f8d-a498-e2a9c3e7010d service nova] Acquiring lock "e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:27:58 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-34baab0b-4a0d-49ff-9b8b-2808120687ee req-d797a5b4-d327-4f8d-a498-e2a9c3e7010d service nova] Lock "e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:27:58 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-34baab0b-4a0d-49ff-9b8b-2808120687ee req-d797a5b4-d327-4f8d-a498-e2a9c3e7010d service nova] Lock "e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:27:58 user nova-compute[72382]: DEBUG nova.compute.manager [req-34baab0b-4a0d-49ff-9b8b-2808120687ee req-d797a5b4-d327-4f8d-a498-e2a9c3e7010d service nova] [instance: e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0] No waiting events found dispatching network-vif-unplugged-9513dc1d-79d5-482b-baaa-81f525e99de7 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:27:58 user nova-compute[72382]: WARNING nova.compute.manager [req-34baab0b-4a0d-49ff-9b8b-2808120687ee req-d797a5b4-d327-4f8d-a498-e2a9c3e7010d service nova] [instance: e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0] Received unexpected event network-vif-unplugged-9513dc1d-79d5-482b-baaa-81f525e99de7 for instance with vm_state rescued and task_state unrescuing.
Aug 09 15:27:58 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:27:58 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:27:59 user nova-compute[72382]: INFO nova.virt.libvirt.driver [-] [instance: e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0] Instance destroyed successfully.
Aug 09 15:28:00 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:28:00 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:28:00 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:28:00 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:28:00 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:28:00 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:28:00 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:28:00 user nova-compute[72382]: DEBUG nova.compute.manager [req-552172a9-4913-4cc7-b22e-6efb63e2dcf1 req-5037a8ca-dbb3-42d0-8adb-7fd2f3d400e3 service nova] [instance: e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0] Received event network-vif-plugged-9513dc1d-79d5-482b-baaa-81f525e99de7 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:28:00 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-552172a9-4913-4cc7-b22e-6efb63e2dcf1 req-5037a8ca-dbb3-42d0-8adb-7fd2f3d400e3 service nova] Acquiring lock "e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:28:00 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-552172a9-4913-4cc7-b22e-6efb63e2dcf1 req-5037a8ca-dbb3-42d0-8adb-7fd2f3d400e3 service nova] Lock "e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:28:00 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-552172a9-4913-4cc7-b22e-6efb63e2dcf1 req-5037a8ca-dbb3-42d0-8adb-7fd2f3d400e3 service nova] Lock "e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:28:00 user nova-compute[72382]: DEBUG nova.compute.manager [req-552172a9-4913-4cc7-b22e-6efb63e2dcf1 req-5037a8ca-dbb3-42d0-8adb-7fd2f3d400e3 service nova] [instance: e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0] No waiting events found dispatching network-vif-plugged-9513dc1d-79d5-482b-baaa-81f525e99de7 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:28:00 user nova-compute[72382]: WARNING nova.compute.manager [req-552172a9-4913-4cc7-b22e-6efb63e2dcf1 req-5037a8ca-dbb3-42d0-8adb-7fd2f3d400e3 service nova] [instance: e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0] Received unexpected event network-vif-plugged-9513dc1d-79d5-482b-baaa-81f525e99de7 for instance with vm_state rescued and task_state unrescuing.
Aug 09 15:28:00 user nova-compute[72382]: DEBUG nova.compute.manager [req-552172a9-4913-4cc7-b22e-6efb63e2dcf1 req-5037a8ca-dbb3-42d0-8adb-7fd2f3d400e3 service nova] [instance: e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0] Received event network-vif-plugged-9513dc1d-79d5-482b-baaa-81f525e99de7 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:28:00 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-552172a9-4913-4cc7-b22e-6efb63e2dcf1 req-5037a8ca-dbb3-42d0-8adb-7fd2f3d400e3 service nova] Acquiring lock "e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:28:00 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-552172a9-4913-4cc7-b22e-6efb63e2dcf1 req-5037a8ca-dbb3-42d0-8adb-7fd2f3d400e3 service nova] Lock "e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:28:00 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-552172a9-4913-4cc7-b22e-6efb63e2dcf1 req-5037a8ca-dbb3-42d0-8adb-7fd2f3d400e3 service nova] Lock "e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:28:00 user nova-compute[72382]: DEBUG nova.compute.manager [req-552172a9-4913-4cc7-b22e-6efb63e2dcf1 req-5037a8ca-dbb3-42d0-8adb-7fd2f3d400e3 service nova] [instance: e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0] No waiting events found dispatching network-vif-plugged-9513dc1d-79d5-482b-baaa-81f525e99de7 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:28:00 user nova-compute[72382]: WARNING nova.compute.manager [req-552172a9-4913-4cc7-b22e-6efb63e2dcf1 req-5037a8ca-dbb3-42d0-8adb-7fd2f3d400e3 service nova] [instance: e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0] Received unexpected event network-vif-plugged-9513dc1d-79d5-482b-baaa-81f525e99de7 for instance with vm_state rescued and task_state unrescuing.
Aug 09 15:28:01 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:28:01 user nova-compute[72382]: DEBUG nova.compute.manager [None req-b935d40d-84d9-4664-88f3-3befc822c9d8 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: 5002dc68-150a-4e96-bfe7-e66c6d764b9f] Start spawning the instance on the hypervisor. {{(pid=72382) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 15:28:01 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-b935d40d-84d9-4664-88f3-3befc822c9d8 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: 5002dc68-150a-4e96-bfe7-e66c6d764b9f] Creating instance directory {{(pid=72382) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 15:28:01 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-b935d40d-84d9-4664-88f3-3befc822c9d8 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: 5002dc68-150a-4e96-bfe7-e66c6d764b9f] Creating image(s)
Aug 09 15:28:01 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-b935d40d-84d9-4664-88f3-3befc822c9d8 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: 5002dc68-150a-4e96-bfe7-e66c6d764b9f] Did not create local disks {{(pid=72382) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 09 15:28:01 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-b935d40d-84d9-4664-88f3-3befc822c9d8 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: 5002dc68-150a-4e96-bfe7-e66c6d764b9f] Ensure instance console log exists: /opt/stack/data/nova/instances/5002dc68-150a-4e96-bfe7-e66c6d764b9f/console.log {{(pid=72382) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 15:28:01 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-b935d40d-84d9-4664-88f3-3befc822c9d8 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:28:01 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-b935d40d-84d9-4664-88f3-3befc822c9d8 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:28:01 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-b935d40d-84d9-4664-88f3-3befc822c9d8 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:28:01 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-b935d40d-84d9-4664-88f3-3befc822c9d8 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: 5002dc68-150a-4e96-bfe7-e66c6d764b9f] Start _get_guest_xml network_info=[{"id": "a778401a-b0e7-45f5-9148-86853431427d", "address": "fa:16:3e:bf:ea:de", "network": {"id": "a78e6cb6-feb7-4f64-a3c0-4900594b6e37", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-338007968-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70310b1af40b4d239fe5ea362972554b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa778401a-b0", "ovs_interfaceid": "a778401a-b0e7-45f5-9148-86853431427d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:37c53941-47c4-4d6d-8826-d0833f90643e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kyeaOCtp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '5002dc68-150a-4e96-bfe7-e66c6d764b9f', 'attached_at': '', 'detached_at': '', 'volume_id': '37c53941-47c4-4d6d-8826-d0833f90643e', 'serial': '37c53941-47c4-4d6d-8826-d0833f90643e'}, 'disk_bus': 'virtio', 'attachment_id': '4fe5dc5d-aaea-4e0d-ac60-07c9814f7a2c', 'delete_on_termination': True, 'volume_type': None} {{(pid=72382) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 15:28:01 user nova-compute[72382]: WARNING nova.virt.libvirt.driver [None req-b935d40d-84d9-4664-88f3-3befc822c9d8 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 15:28:01 user nova-compute[72382]: WARNING nova.virt.libvirt.driver [None req-b935d40d-84d9-4664-88f3-3befc822c9d8 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 15:28:01 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-b935d40d-84d9-4664-88f3-3befc822c9d8 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72382) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 15:28:01 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-b935d40d-84d9-4664-88f3-3befc822c9d8 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] CPU controller missing on host. {{(pid=72382) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 15:28:01 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-b935d40d-84d9-4664-88f3-3befc822c9d8 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72382) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 15:28:01 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-b935d40d-84d9-4664-88f3-3befc822c9d8 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] CPU controller found on host. {{(pid=72382) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 15:28:01 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-b935d40d-84d9-4664-88f3-3befc822c9d8 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72382) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 15:28:01 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-b935d40d-84d9-4664-88f3-3befc822c9d8 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T15:11:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 15:28:01 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-b935d40d-84d9-4664-88f3-3befc822c9d8 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Flavor limits 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 15:28:01 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-b935d40d-84d9-4664-88f3-3befc822c9d8 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Image limits 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 15:28:01 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-b935d40d-84d9-4664-88f3-3befc822c9d8 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Flavor pref 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 15:28:01 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-b935d40d-84d9-4664-88f3-3befc822c9d8 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Image pref 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 15:28:01 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-b935d40d-84d9-4664-88f3-3befc822c9d8 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 15:28:01 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-b935d40d-84d9-4664-88f3-3befc822c9d8 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 15:28:01 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-b935d40d-84d9-4664-88f3-3befc822c9d8 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72382) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 15:28:01 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-b935d40d-84d9-4664-88f3-3befc822c9d8 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Got 1 possible topologies {{(pid=72382) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 15:28:01 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-b935d40d-84d9-4664-88f3-3befc822c9d8 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 15:28:01 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-b935d40d-84d9-4664-88f3-3befc822c9d8 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 15:28:01 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b935d40d-84d9-4664-88f3-3befc822c9d8 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: 5002dc68-150a-4e96-bfe7-e66c6d764b9f] Calling os-brick to attach iSCSI Volume {{(pid=72382) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 15:28:01 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-b935d40d-84d9-4664-88f3-3befc822c9d8 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2a0c768340>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:37c53941-47c4-4d6d-8826-d0833f90643e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kyeaOCtp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 15:28:01 user nova-compute[72382]: WARNING os_brick.initiator.connectors.base [None req-b935d40d-84d9-4664-88f3-3befc822c9d8 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 15:28:01 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-b935d40d-84d9-4664-88f3-3befc822c9d8 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 15:28:01 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-b935d40d-84d9-4664-88f3-3befc822c9d8 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 15:28:01 user nova-compute[72382]: WARNING os_brick.initiator.connectors.base [None req-b935d40d-84d9-4664-88f3-3befc822c9d8 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 15:28:01 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-b935d40d-84d9-4664-88f3-3befc822c9d8 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:37c53941-47c4-4d6d-8826-d0833f90643e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 15:28:01 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-b935d40d-84d9-4664-88f3-3befc822c9d8 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:37c53941-47c4-4d6d-8826-d0833f90643e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 15:28:01 user nova-compute[72382]: INFO os_brick.initiator.connectors.iscsi [None req-b935d40d-84d9-4664-88f3-3befc822c9d8 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 15:28:01 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37c53941-47c4-4d6d-8826-d0833f90643e -p 172.16.0.220:3260 {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:28:01 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37c53941-47c4-4d6d-8826-d0833f90643e -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:28:01 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ffe6514-2284-49e2-aa2e-5b1de2eaef53]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:28:01 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-b935d40d-84d9-4664-88f3-3befc822c9d8 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 15:28:01 user nova-compute[72382]:  {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:28:01 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37c53941-47c4-4d6d-8826-d0833f90643e -p 172.16.0.220:3260 --interface default --op new {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:28:01 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37c53941-47c4-4d6d-8826-d0833f90643e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:28:01 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[182d71e1-40ed-40df-b375-f5dde9008bd2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:37c53941-47c4-4d6d-8826-d0833f90643e] added\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:28:01 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-b935d40d-84d9-4664-88f3-3befc822c9d8 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:37c53941-47c4-4d6d-8826-d0833f90643e] added
Aug 09 15:28:01 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:28:01 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37c53941-47c4-4d6d-8826-d0833f90643e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:28:01 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37c53941-47c4-4d6d-8826-d0833f90643e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:28:01 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[b834d1aa-b417-476d-8e39-69caf716b9d6]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:28:01 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-b935d40d-84d9-4664-88f3-3befc822c9d8 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:28:01 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37c53941-47c4-4d6d-8826-d0833f90643e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:28:01 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37c53941-47c4-4d6d-8826-d0833f90643e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:28:01 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[3062e575-c83f-445e-9a66-5642350cefd9]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:28:01 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-b935d40d-84d9-4664-88f3-3befc822c9d8 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:28:01 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37c53941-47c4-4d6d-8826-d0833f90643e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kyeaOCtp {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:28:01 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37c53941-47c4-4d6d-8826-d0833f90643e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kyeaOCtp" returned: 0 in 0.019s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:28:01 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d883e1f-3a6b-478a-94fb-f68f822a0ae9]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:28:01 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-b935d40d-84d9-4664-88f3-3befc822c9d8 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kyeaOCtp'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:28:01 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37c53941-47c4-4d6d-8826-d0833f90643e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:28:01 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37c53941-47c4-4d6d-8826-d0833f90643e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:28:01 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[14ca7466-f68b-4e6c-a3ce-bf167476dd6e]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:28:01 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-b935d40d-84d9-4664-88f3-3befc822c9d8 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:28:01 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:28:01 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:28:01 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[e43cddc3-b486-4deb-a01c-df5c60599635]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9572706e-c54c-42c2-9cf0-2690cdf4cca2 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd90521a-f3b5-485c-9fb9-61ab37267f3a (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25503c6e-bfc0-4008-846a-8cad783fc0fb (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e62d4416-be8c-4327-9a51-0cc509109c53 (non-flash)\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:28:01 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-b935d40d-84d9-4664-88f3-3befc822c9d8 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)
Aug 09 15:28:01 user nova-compute[72382]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9572706e-c54c-42c2-9cf0-2690cdf4cca2 (non-flash)
Aug 09 15:28:01 user nova-compute[72382]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd90521a-f3b5-485c-9fb9-61ab37267f3a (non-flash)
Aug 09 15:28:01 user nova-compute[72382]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25503c6e-bfc0-4008-846a-8cad783fc0fb (non-flash)
Aug 09 15:28:01 user nova-compute[72382]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e62d4416-be8c-4327-9a51-0cc509109c53 (non-flash)
Aug 09 15:28:01 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 15:28:01 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-b935d40d-84d9-4664-88f3-3befc822c9d8 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)
Aug 09 15:28:01 user nova-compute[72382]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9572706e-c54c-42c2-9cf0-2690cdf4cca2 (non-flash)
Aug 09 15:28:01 user nova-compute[72382]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd90521a-f3b5-485c-9fb9-61ab37267f3a (non-flash)
Aug 09 15:28:01 user nova-compute[72382]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25503c6e-bfc0-4008-846a-8cad783fc0fb (non-flash)
Aug 09 15:28:01 user nova-compute[72382]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e62d4416-be8c-4327-9a51-0cc509109c53 (non-flash)
Aug 09 15:28:01 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 15:28:01 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37c53941-47c4-4d6d-8826-d0833f90643e -p 172.16.0.220:3260 --login {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:28:02 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37c53941-47c4-4d6d-8826-d0833f90643e -p 172.16.0.220:3260 --login" returned: 0 in 0.075s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:28:02 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b5e6f88-0f8b-4914-8268-c951dbb121f8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:37c53941-47c4-4d6d-8826-d0833f90643e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:37c53941-47c4-4d6d-8826-d0833f90643e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:28:02 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-b935d40d-84d9-4664-88f3-3befc822c9d8 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:37c53941-47c4-4d6d-8826-d0833f90643e, portal: 172.16.0.220,3260]
Aug 09 15:28:02 user nova-compute[72382]: Login to [iface: default, target: iqn.2010-10.org.openstack:37c53941-47c4-4d6d-8826-d0833f90643e, portal: 172.16.0.220,3260] successful.
Aug 09 15:28:02 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:28:02 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37c53941-47c4-4d6d-8826-d0833f90643e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:28:02 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37c53941-47c4-4d6d-8826-d0833f90643e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.033s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:28:02 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2d26548-2b56-4aad-941b-415e5041e097]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:28:02 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-b935d40d-84d9-4664-88f3-3befc822c9d8 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:28:02 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:28:02 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:28:02 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e40b157-345d-46f8-8975-349f2d4dc32c]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9572706e-c54c-42c2-9cf0-2690cdf4cca2 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd90521a-f3b5-485c-9fb9-61ab37267f3a (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25503c6e-bfc0-4008-846a-8cad783fc0fb (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e62d4416-be8c-4327-9a51-0cc509109c53 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37c53941-47c4-4d6d-8826-d0833f90643e (non-flash)\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:28:02 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-b935d40d-84d9-4664-88f3-3befc822c9d8 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)
Aug 09 15:28:02 user nova-compute[72382]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9572706e-c54c-42c2-9cf0-2690cdf4cca2 (non-flash)
Aug 09 15:28:02 user nova-compute[72382]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd90521a-f3b5-485c-9fb9-61ab37267f3a (non-flash)
Aug 09 15:28:02 user nova-compute[72382]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25503c6e-bfc0-4008-846a-8cad783fc0fb (non-flash)
Aug 09 15:28:02 user nova-compute[72382]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e62d4416-be8c-4327-9a51-0cc509109c53 (non-flash)
Aug 09 15:28:02 user nova-compute[72382]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37c53941-47c4-4d6d-8826-d0833f90643e (non-flash)
Aug 09 15:28:02 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 15:28:02 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-b935d40d-84d9-4664-88f3-3befc822c9d8 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)
Aug 09 15:28:02 user nova-compute[72382]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9572706e-c54c-42c2-9cf0-2690cdf4cca2 (non-flash)
Aug 09 15:28:02 user nova-compute[72382]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd90521a-f3b5-485c-9fb9-61ab37267f3a (non-flash)
Aug 09 15:28:02 user nova-compute[72382]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25503c6e-bfc0-4008-846a-8cad783fc0fb (non-flash)
Aug 09 15:28:02 user nova-compute[72382]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e62d4416-be8c-4327-9a51-0cc509109c53 (non-flash)
Aug 09 15:28:02 user nova-compute[72382]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37c53941-47c4-4d6d-8826-d0833f90643e (non-flash)
Aug 09 15:28:02 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 15:28:02 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-b935d40d-84d9-4664-88f3-3befc822c9d8 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:37c53941-47c4-4d6d-8826-d0833f90643e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.329s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 15:28:02 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-b935d40d-84d9-4664-88f3-3befc822c9d8 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Connected to 172.16.0.220:3260 {{(pid=72382) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 15:28:02 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-b935d40d-84d9-4664-88f3-3befc822c9d8 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] HCTL ('38', '-', '-', 0) found on session 34 with lun 0 {{(pid=72382) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 15:28:02 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-b935d40d-84d9-4664-88f3-3befc822c9d8 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=72382) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 15:28:02 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:28:02 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.021s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:28:02 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[66d2008a-38de-4cce-b969-0d91480e7f1d]: (4, ('- - 0', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:28:02 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-b935d40d-84d9-4664-88f3-3befc822c9d8 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Searching for a device in session 34 and hctl ['38', '*', '*', 0] yield: None {{(pid=72382) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 15:28:02 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Removed pending event for e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0 due to event {{(pid=72382) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 09 15:28:02 user nova-compute[72382]: DEBUG nova.virt.driver [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Emitting event <LifecycleEvent: 1691594882.7786045, e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0 => Resumed> {{(pid=72382) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 15:28:02 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0] VM Resumed (Lifecycle Event)
Aug 09 15:28:02 user nova-compute[72382]: DEBUG nova.compute.manager [None req-65bd0e12-aa6e-4fbe-96f2-6fda8630216e tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] [instance: e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:28:02 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:28:02 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72382) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 15:28:02 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 09 15:28:02 user nova-compute[72382]: DEBUG nova.virt.driver [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Emitting event <LifecycleEvent: 1691594882.7803252, e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0 => Started> {{(pid=72382) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 15:28:02 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0] VM Started (Lifecycle Event)
Aug 09 15:28:02 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:28:02 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72382) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 15:28:02 user nova-compute[72382]: DEBUG nova.compute.manager [req-946a97ef-e89c-46f2-b38b-42cc88baefe4 req-b5de6c5e-b003-4c7f-bd81-b69916d9340d service nova] [instance: e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0] Received event network-vif-plugged-9513dc1d-79d5-482b-baaa-81f525e99de7 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:28:02 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-946a97ef-e89c-46f2-b38b-42cc88baefe4 req-b5de6c5e-b003-4c7f-bd81-b69916d9340d service nova] Acquiring lock "e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:28:02 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-946a97ef-e89c-46f2-b38b-42cc88baefe4 req-b5de6c5e-b003-4c7f-bd81-b69916d9340d service nova] Lock "e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:28:02 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-946a97ef-e89c-46f2-b38b-42cc88baefe4 req-b5de6c5e-b003-4c7f-bd81-b69916d9340d service nova] Lock "e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:28:02 user nova-compute[72382]: DEBUG nova.compute.manager [req-946a97ef-e89c-46f2-b38b-42cc88baefe4 req-b5de6c5e-b003-4c7f-bd81-b69916d9340d service nova] [instance: e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0] No waiting events found dispatching network-vif-plugged-9513dc1d-79d5-482b-baaa-81f525e99de7 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:28:02 user nova-compute[72382]: WARNING nova.compute.manager [req-946a97ef-e89c-46f2-b38b-42cc88baefe4 req-b5de6c5e-b003-4c7f-bd81-b69916d9340d service nova] [instance: e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0] Received unexpected event network-vif-plugged-9513dc1d-79d5-482b-baaa-81f525e99de7 for instance with vm_state active and task_state None.
Aug 09 15:28:03 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-b935d40d-84d9-4664-88f3-3befc822c9d8 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Searching for a device in session 34 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=72382) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 15:28:03 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-b935d40d-84d9-4664-88f3-3befc822c9d8 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Connected to sdg using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kyeaOCtp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72382) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 15:28:03 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-b935d40d-84d9-4664-88f3-3befc822c9d8 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.363s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 15:28:03 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-b935d40d-84d9-4664-88f3-3befc822c9d8 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] <== connect_volume: return (1365ms) {'type': 'block', 'scsi_wwn': '23236373263646436', 'path': '/dev/sdg'} {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 15:28:03 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b935d40d-84d9-4664-88f3-3befc822c9d8 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: 5002dc68-150a-4e96-bfe7-e66c6d764b9f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23236373263646436', 'path': '/dev/sdg'} {{(pid=72382) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 15:28:03 user nova-compute[72382]: DEBUG nova.virt.libvirt.vif [None req-b935d40d-84d9-4664-88f3-3befc822c9d8 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T15:27:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-197734401',display_name='tempest-TestVolumeBootPattern-server-197734401',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-197734401',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='70310b1af40b4d239fe5ea362972554b',ramdisk_id='',reservation_id='r-ovztepxm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-451643589',owner_user_name='tempest-TestVolumeBootPattern-451643589-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T15:27:46Z,user_data=None,user_id='280bcf2afd7245a7bcd605e0db79c569',uuid=5002dc68-150a-4e96-bfe7-e66c6d764b9f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a778401a-b0e7-45f5-9148-86853431427d", "address": "fa:16:3e:bf:ea:de", "network": {"id": "a78e6cb6-feb7-4f64-a3c0-4900594b6e37", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-338007968-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70310b1af40b4d239fe5ea362972554b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa778401a-b0", "ovs_interfaceid": "a778401a-b0e7-45f5-9148-86853431427d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72382) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 15:28:03 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-b935d40d-84d9-4664-88f3-3befc822c9d8 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Converting VIF {"id": "a778401a-b0e7-45f5-9148-86853431427d", "address": "fa:16:3e:bf:ea:de", "network": {"id": "a78e6cb6-feb7-4f64-a3c0-4900594b6e37", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-338007968-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70310b1af40b4d239fe5ea362972554b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa778401a-b0", "ovs_interfaceid": "a778401a-b0e7-45f5-9148-86853431427d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 15:28:03 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-b935d40d-84d9-4664-88f3-3befc822c9d8 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bf:ea:de,bridge_name='br-int',has_traffic_filtering=True,id=a778401a-b0e7-45f5-9148-86853431427d,network=Network(a78e6cb6-feb7-4f64-a3c0-4900594b6e37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa778401a-b0') {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 15:28:03 user nova-compute[72382]: DEBUG nova.objects.instance [None req-b935d40d-84d9-4664-88f3-3befc822c9d8 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Lazy-loading 'pci_devices' on Instance uuid 5002dc68-150a-4e96-bfe7-e66c6d764b9f {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:28:03 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-b935d40d-84d9-4664-88f3-3befc822c9d8 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: 5002dc68-150a-4e96-bfe7-e66c6d764b9f] End _get_guest_xml xml=<domain type="kvm">
Aug 09 15:28:03 user nova-compute[72382]:   <uuid>5002dc68-150a-4e96-bfe7-e66c6d764b9f</uuid>
Aug 09 15:28:03 user nova-compute[72382]:   <name>instance-0000001f</name>
Aug 09 15:28:03 user nova-compute[72382]:   <memory>524288</memory>
Aug 09 15:28:03 user nova-compute[72382]:   <vcpu>1</vcpu>
Aug 09 15:28:03 user nova-compute[72382]:   <metadata>
Aug 09 15:28:03 user nova-compute[72382]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 15:28:03 user nova-compute[72382]:       <nova:package version="0.0.0"/>
Aug 09 15:28:03 user nova-compute[72382]:       <nova:name>tempest-TestVolumeBootPattern-server-197734401</nova:name>
Aug 09 15:28:03 user nova-compute[72382]:       <nova:creationTime>2023-08-09 15:28:01</nova:creationTime>
Aug 09 15:28:03 user nova-compute[72382]:       <nova:flavor name="m1.tiny">
Aug 09 15:28:03 user nova-compute[72382]:         <nova:memory>512</nova:memory>
Aug 09 15:28:03 user nova-compute[72382]:         <nova:disk>1</nova:disk>
Aug 09 15:28:03 user nova-compute[72382]:         <nova:swap>0</nova:swap>
Aug 09 15:28:03 user nova-compute[72382]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 15:28:03 user nova-compute[72382]:         <nova:vcpus>1</nova:vcpus>
Aug 09 15:28:03 user nova-compute[72382]:       </nova:flavor>
Aug 09 15:28:03 user nova-compute[72382]:       <nova:owner>
Aug 09 15:28:03 user nova-compute[72382]:         <nova:user uuid="280bcf2afd7245a7bcd605e0db79c569">tempest-TestVolumeBootPattern-451643589-project-member</nova:user>
Aug 09 15:28:03 user nova-compute[72382]:         <nova:project uuid="70310b1af40b4d239fe5ea362972554b">tempest-TestVolumeBootPattern-451643589</nova:project>
Aug 09 15:28:03 user nova-compute[72382]:       </nova:owner>
Aug 09 15:28:03 user nova-compute[72382]:       <nova:ports>
Aug 09 15:28:03 user nova-compute[72382]:         <nova:port uuid="a778401a-b0e7-45f5-9148-86853431427d">
Aug 09 15:28:03 user nova-compute[72382]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 09 15:28:03 user nova-compute[72382]:         </nova:port>
Aug 09 15:28:03 user nova-compute[72382]:       </nova:ports>
Aug 09 15:28:03 user nova-compute[72382]:     </nova:instance>
Aug 09 15:28:03 user nova-compute[72382]:   </metadata>
Aug 09 15:28:03 user nova-compute[72382]:   <sysinfo type="smbios">
Aug 09 15:28:03 user nova-compute[72382]:     <system>
Aug 09 15:28:03 user nova-compute[72382]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 15:28:03 user nova-compute[72382]:       <entry name="product">OpenStack Nova</entry>
Aug 09 15:28:03 user nova-compute[72382]:       <entry name="version">0.0.0</entry>
Aug 09 15:28:03 user nova-compute[72382]:       <entry name="serial">5002dc68-150a-4e96-bfe7-e66c6d764b9f</entry>
Aug 09 15:28:03 user nova-compute[72382]:       <entry name="uuid">5002dc68-150a-4e96-bfe7-e66c6d764b9f</entry>
Aug 09 15:28:03 user nova-compute[72382]:       <entry name="family">Virtual Machine</entry>
Aug 09 15:28:03 user nova-compute[72382]:     </system>
Aug 09 15:28:03 user nova-compute[72382]:   </sysinfo>
Aug 09 15:28:03 user nova-compute[72382]:   <os>
Aug 09 15:28:03 user nova-compute[72382]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 15:28:03 user nova-compute[72382]:     <boot dev="hd"/>
Aug 09 15:28:03 user nova-compute[72382]:     <smbios mode="sysinfo"/>
Aug 09 15:28:03 user nova-compute[72382]:   </os>
Aug 09 15:28:03 user nova-compute[72382]:   <features>
Aug 09 15:28:03 user nova-compute[72382]:     <acpi/>
Aug 09 15:28:03 user nova-compute[72382]:     <apic/>
Aug 09 15:28:03 user nova-compute[72382]:     <vmcoreinfo/>
Aug 09 15:28:03 user nova-compute[72382]:   </features>
Aug 09 15:28:03 user nova-compute[72382]:   <clock offset="utc">
Aug 09 15:28:03 user nova-compute[72382]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 15:28:03 user nova-compute[72382]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 15:28:03 user nova-compute[72382]:     <timer name="hpet" present="no"/>
Aug 09 15:28:03 user nova-compute[72382]:   </clock>
Aug 09 15:28:03 user nova-compute[72382]:   <cpu mode="custom" match="exact">
Aug 09 15:28:03 user nova-compute[72382]:     <model>Nehalem</model>
Aug 09 15:28:03 user nova-compute[72382]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 15:28:03 user nova-compute[72382]:   </cpu>
Aug 09 15:28:03 user nova-compute[72382]:   <devices>
Aug 09 15:28:03 user nova-compute[72382]:     <disk type="block" device="disk">
Aug 09 15:28:03 user nova-compute[72382]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 15:28:03 user nova-compute[72382]:       <source dev="/dev/sdg"/>
Aug 09 15:28:03 user nova-compute[72382]:       <target dev="vda" bus="virtio"/>
Aug 09 15:28:03 user nova-compute[72382]:       <serial>37c53941-47c4-4d6d-8826-d0833f90643e</serial>
Aug 09 15:28:03 user nova-compute[72382]:     </disk>
Aug 09 15:28:03 user nova-compute[72382]:     <interface type="ethernet">
Aug 09 15:28:03 user nova-compute[72382]:       <mac address="fa:16:3e:bf:ea:de"/>
Aug 09 15:28:03 user nova-compute[72382]:       <model type="virtio"/>
Aug 09 15:28:03 user nova-compute[72382]:       <mtu size="1442"/>
Aug 09 15:28:03 user nova-compute[72382]:       <target dev="tapa778401a-b0"/>
Aug 09 15:28:03 user nova-compute[72382]:     </interface>
Aug 09 15:28:03 user nova-compute[72382]:     <serial type="pty">
Aug 09 15:28:03 user nova-compute[72382]:       <log file="/opt/stack/data/nova/instances/5002dc68-150a-4e96-bfe7-e66c6d764b9f/console.log" append="off"/>
Aug 09 15:28:03 user nova-compute[72382]:     </serial>
Aug 09 15:28:03 user nova-compute[72382]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 15:28:03 user nova-compute[72382]:     <video>
Aug 09 15:28:03 user nova-compute[72382]:       <model type="virtio"/>
Aug 09 15:28:03 user nova-compute[72382]:     </video>
Aug 09 15:28:03 user nova-compute[72382]:     <rng model="virtio">
Aug 09 15:28:03 user nova-compute[72382]:       <backend model="random">/dev/urandom</backend>
Aug 09 15:28:03 user nova-compute[72382]:     </rng>
Aug 09 15:28:03 user nova-compute[72382]:     <controller type="usb" index="0" model="none"/>
Aug 09 15:28:03 user nova-compute[72382]:     <memballoon model="virtio">
Aug 09 15:28:03 user nova-compute[72382]:       <stats period="10"/>
Aug 09 15:28:03 user nova-compute[72382]:     </memballoon>
Aug 09 15:28:03 user nova-compute[72382]:   </devices>
Aug 09 15:28:03 user nova-compute[72382]: </domain>
Aug 09 15:28:03 user nova-compute[72382]:  {{(pid=72382) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 15:28:03 user nova-compute[72382]: DEBUG nova.virt.libvirt.vif [None req-b935d40d-84d9-4664-88f3-3befc822c9d8 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T15:27:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-197734401',display_name='tempest-TestVolumeBootPattern-server-197734401',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-197734401',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='70310b1af40b4d239fe5ea362972554b',ramdisk_id='',reservation_id='r-ovztepxm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-451643589',owner_user_name='tempest-TestVolumeBootPattern-451643589-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T15:27:46Z,user_data=None,user_id='280bcf2afd7245a7bcd605e0db79c569',uuid=5002dc68-150a-4e96-bfe7-e66c6d764b9f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a778401a-b0e7-45f5-9148-86853431427d", "address": "fa:16:3e:bf:ea:de", "network": {"id": "a78e6cb6-feb7-4f64-a3c0-4900594b6e37", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-338007968-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70310b1af40b4d239fe5ea362972554b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa778401a-b0", "ovs_interfaceid": "a778401a-b0e7-45f5-9148-86853431427d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 15:28:03 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-b935d40d-84d9-4664-88f3-3befc822c9d8 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Converting VIF {"id": "a778401a-b0e7-45f5-9148-86853431427d", "address": "fa:16:3e:bf:ea:de", "network": {"id": "a78e6cb6-feb7-4f64-a3c0-4900594b6e37", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-338007968-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70310b1af40b4d239fe5ea362972554b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa778401a-b0", "ovs_interfaceid": "a778401a-b0e7-45f5-9148-86853431427d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 15:28:03 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-b935d40d-84d9-4664-88f3-3befc822c9d8 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bf:ea:de,bridge_name='br-int',has_traffic_filtering=True,id=a778401a-b0e7-45f5-9148-86853431427d,network=Network(a78e6cb6-feb7-4f64-a3c0-4900594b6e37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa778401a-b0') {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 15:28:03 user nova-compute[72382]: DEBUG os_vif [None req-b935d40d-84d9-4664-88f3-3befc822c9d8 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bf:ea:de,bridge_name='br-int',has_traffic_filtering=True,id=a778401a-b0e7-45f5-9148-86853431427d,network=Network(a78e6cb6-feb7-4f64-a3c0-4900594b6e37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa778401a-b0') {{(pid=72382) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 15:28:03 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:28:03 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:28:03 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 15:28:03 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:28:03 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa778401a-b0, may_exist=True, interface_attrs={}) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:28:03 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa778401a-b0, col_values=(('external_ids', {'iface-id': 'a778401a-b0e7-45f5-9148-86853431427d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bf:ea:de', 'vm-uuid': '5002dc68-150a-4e96-bfe7-e66c6d764b9f'}),), if_exists=True) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:28:03 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:28:03 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:28:03 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:28:03 user nova-compute[72382]: INFO os_vif [None req-b935d40d-84d9-4664-88f3-3befc822c9d8 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bf:ea:de,bridge_name='br-int',has_traffic_filtering=True,id=a778401a-b0e7-45f5-9148-86853431427d,network=Network(a78e6cb6-feb7-4f64-a3c0-4900594b6e37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa778401a-b0')
Aug 09 15:28:03 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-b935d40d-84d9-4664-88f3-3befc822c9d8 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] No BDM found with device name vda, not building metadata. {{(pid=72382) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 15:28:03 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-b935d40d-84d9-4664-88f3-3befc822c9d8 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] No VIF found with MAC fa:16:3e:bf:ea:de, not building metadata {{(pid=72382) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 15:28:04 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:28:04 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:28:04 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:28:04 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:28:04 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:28:04 user nova-compute[72382]: DEBUG nova.compute.manager [req-3a53c822-751e-44e4-ba90-3cd1d8e72123 req-47ee01da-132b-40fe-9f17-6acddafb8580 service nova] [instance: 5002dc68-150a-4e96-bfe7-e66c6d764b9f] Received event network-vif-plugged-a778401a-b0e7-45f5-9148-86853431427d {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:28:04 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-3a53c822-751e-44e4-ba90-3cd1d8e72123 req-47ee01da-132b-40fe-9f17-6acddafb8580 service nova] Acquiring lock "5002dc68-150a-4e96-bfe7-e66c6d764b9f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:28:04 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-3a53c822-751e-44e4-ba90-3cd1d8e72123 req-47ee01da-132b-40fe-9f17-6acddafb8580 service nova] Lock "5002dc68-150a-4e96-bfe7-e66c6d764b9f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:28:04 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-3a53c822-751e-44e4-ba90-3cd1d8e72123 req-47ee01da-132b-40fe-9f17-6acddafb8580 service nova] Lock "5002dc68-150a-4e96-bfe7-e66c6d764b9f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:28:04 user nova-compute[72382]: DEBUG nova.compute.manager [req-3a53c822-751e-44e4-ba90-3cd1d8e72123 req-47ee01da-132b-40fe-9f17-6acddafb8580 service nova] [instance: 5002dc68-150a-4e96-bfe7-e66c6d764b9f] No waiting events found dispatching network-vif-plugged-a778401a-b0e7-45f5-9148-86853431427d {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:28:04 user nova-compute[72382]: WARNING nova.compute.manager [req-3a53c822-751e-44e4-ba90-3cd1d8e72123 req-47ee01da-132b-40fe-9f17-6acddafb8580 service nova] [instance: 5002dc68-150a-4e96-bfe7-e66c6d764b9f] Received unexpected event network-vif-plugged-a778401a-b0e7-45f5-9148-86853431427d for instance with vm_state building and task_state spawning.
Aug 09 15:28:05 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:28:05 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:28:05 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:28:05 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:28:05 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:28:06 user nova-compute[72382]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691594871.6612499, 48161b45-d21a-4fb1-ae90-4613d849bfa7 => Stopped> {{(pid=72382) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 15:28:06 user nova-compute[72382]: INFO nova.compute.manager [-] [instance: 48161b45-d21a-4fb1-ae90-4613d849bfa7] VM Stopped (Lifecycle Event)
Aug 09 15:28:06 user nova-compute[72382]: DEBUG nova.compute.manager [None req-fd0661a8-aa33-4e53-a346-49e52fab2237 None None] [instance: 48161b45-d21a-4fb1-ae90-4613d849bfa7] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:28:06 user nova-compute[72382]: DEBUG nova.virt.driver [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Emitting event <LifecycleEvent: 1691594886.8713725, 5002dc68-150a-4e96-bfe7-e66c6d764b9f => Resumed> {{(pid=72382) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 15:28:06 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 5002dc68-150a-4e96-bfe7-e66c6d764b9f] VM Resumed (Lifecycle Event)
Aug 09 15:28:06 user nova-compute[72382]: DEBUG nova.compute.manager [None req-b935d40d-84d9-4664-88f3-3befc822c9d8 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: 5002dc68-150a-4e96-bfe7-e66c6d764b9f] Instance event wait completed in 0 seconds for  {{(pid=72382) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 15:28:06 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-b935d40d-84d9-4664-88f3-3befc822c9d8 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: 5002dc68-150a-4e96-bfe7-e66c6d764b9f] Guest created on hypervisor {{(pid=72382) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 15:28:06 user nova-compute[72382]: INFO nova.virt.libvirt.driver [-] [instance: 5002dc68-150a-4e96-bfe7-e66c6d764b9f] Instance spawned successfully.
Aug 09 15:28:06 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-b935d40d-84d9-4664-88f3-3befc822c9d8 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: 5002dc68-150a-4e96-bfe7-e66c6d764b9f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 15:28:06 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 5002dc68-150a-4e96-bfe7-e66c6d764b9f] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:28:06 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 5002dc68-150a-4e96-bfe7-e66c6d764b9f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72382) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 15:28:06 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-b935d40d-84d9-4664-88f3-3befc822c9d8 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: 5002dc68-150a-4e96-bfe7-e66c6d764b9f] Found default for hw_cdrom_bus of ide {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:28:06 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-b935d40d-84d9-4664-88f3-3befc822c9d8 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: 5002dc68-150a-4e96-bfe7-e66c6d764b9f] Found default for hw_disk_bus of virtio {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:28:06 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-b935d40d-84d9-4664-88f3-3befc822c9d8 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: 5002dc68-150a-4e96-bfe7-e66c6d764b9f] Found default for hw_input_bus of None {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:28:06 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-b935d40d-84d9-4664-88f3-3befc822c9d8 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: 5002dc68-150a-4e96-bfe7-e66c6d764b9f] Found default for hw_pointer_model of None {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:28:06 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-b935d40d-84d9-4664-88f3-3befc822c9d8 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: 5002dc68-150a-4e96-bfe7-e66c6d764b9f] Found default for hw_video_model of virtio {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:28:06 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-b935d40d-84d9-4664-88f3-3befc822c9d8 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: 5002dc68-150a-4e96-bfe7-e66c6d764b9f] Found default for hw_vif_model of virtio {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:28:06 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 5002dc68-150a-4e96-bfe7-e66c6d764b9f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 15:28:06 user nova-compute[72382]: DEBUG nova.virt.driver [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Emitting event <LifecycleEvent: 1691594886.8754659, 5002dc68-150a-4e96-bfe7-e66c6d764b9f => Started> {{(pid=72382) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 15:28:06 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 5002dc68-150a-4e96-bfe7-e66c6d764b9f] VM Started (Lifecycle Event)
Aug 09 15:28:06 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 5002dc68-150a-4e96-bfe7-e66c6d764b9f] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:28:06 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 5002dc68-150a-4e96-bfe7-e66c6d764b9f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72382) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 15:28:06 user nova-compute[72382]: DEBUG nova.compute.manager [req-da1cba3e-42d9-4ebe-b0e5-a2578798532d req-8a76209b-fd62-466a-9ae6-c4c6f9e190f9 service nova] [instance: 5002dc68-150a-4e96-bfe7-e66c6d764b9f] Received event network-vif-plugged-a778401a-b0e7-45f5-9148-86853431427d {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:28:06 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-da1cba3e-42d9-4ebe-b0e5-a2578798532d req-8a76209b-fd62-466a-9ae6-c4c6f9e190f9 service nova] Acquiring lock "5002dc68-150a-4e96-bfe7-e66c6d764b9f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:28:06 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-da1cba3e-42d9-4ebe-b0e5-a2578798532d req-8a76209b-fd62-466a-9ae6-c4c6f9e190f9 service nova] Lock "5002dc68-150a-4e96-bfe7-e66c6d764b9f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:28:06 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-da1cba3e-42d9-4ebe-b0e5-a2578798532d req-8a76209b-fd62-466a-9ae6-c4c6f9e190f9 service nova] Lock "5002dc68-150a-4e96-bfe7-e66c6d764b9f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:28:06 user nova-compute[72382]: DEBUG nova.compute.manager [req-da1cba3e-42d9-4ebe-b0e5-a2578798532d req-8a76209b-fd62-466a-9ae6-c4c6f9e190f9 service nova] [instance: 5002dc68-150a-4e96-bfe7-e66c6d764b9f] No waiting events found dispatching network-vif-plugged-a778401a-b0e7-45f5-9148-86853431427d {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:28:06 user nova-compute[72382]: WARNING nova.compute.manager [req-da1cba3e-42d9-4ebe-b0e5-a2578798532d req-8a76209b-fd62-466a-9ae6-c4c6f9e190f9 service nova] [instance: 5002dc68-150a-4e96-bfe7-e66c6d764b9f] Received unexpected event network-vif-plugged-a778401a-b0e7-45f5-9148-86853431427d for instance with vm_state building and task_state spawning.
Aug 09 15:28:06 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 5002dc68-150a-4e96-bfe7-e66c6d764b9f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 15:28:07 user nova-compute[72382]: INFO nova.compute.manager [None req-b935d40d-84d9-4664-88f3-3befc822c9d8 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: 5002dc68-150a-4e96-bfe7-e66c6d764b9f] Took 5.26 seconds to spawn the instance on the hypervisor.
Aug 09 15:28:07 user nova-compute[72382]: DEBUG nova.compute.manager [None req-b935d40d-84d9-4664-88f3-3befc822c9d8 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: 5002dc68-150a-4e96-bfe7-e66c6d764b9f] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:28:07 user nova-compute[72382]: INFO nova.compute.manager [None req-b935d40d-84d9-4664-88f3-3befc822c9d8 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: 5002dc68-150a-4e96-bfe7-e66c6d764b9f] Took 21.60 seconds to build instance.
Aug 09 15:28:07 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-b935d40d-84d9-4664-88f3-3befc822c9d8 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Lock "5002dc68-150a-4e96-bfe7-e66c6d764b9f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 21.708s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:28:08 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:28:09 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:28:10 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:28:10 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:28:10 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:28:10 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:28:10 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:28:10 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:28:10 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Auditing locally available compute resources for user (node: user) {{(pid=72382) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 15:28:11 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:28:11 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:28:11 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:28:11 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:28:11 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72382) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 15:28:11 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ea8f68c-3dc1-45ac-a7f3-bca32f929add/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:28:11 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ea8f68c-3dc1-45ac-a7f3-bca32f929add/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:28:11 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ea8f68c-3dc1-45ac-a7f3-bca32f929add/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:28:11 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ea8f68c-3dc1-45ac-a7f3-bca32f929add/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:28:11 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f780040f-b789-4b72-8986-813c7b9fe4a6/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:28:11 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f780040f-b789-4b72-8986-813c7b9fe4a6/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:28:11 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f780040f-b789-4b72-8986-813c7b9fe4a6/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:28:12 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f780040f-b789-4b72-8986-813c7b9fe4a6/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:28:12 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/266be814-4a2b-4f8e-a0f6-e8821fdeb95d/disk.rescue --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:28:12 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/266be814-4a2b-4f8e-a0f6-e8821fdeb95d/disk.rescue --force-share --output=json" returned: 0 in 0.144s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:28:12 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/266be814-4a2b-4f8e-a0f6-e8821fdeb95d/disk.rescue --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:28:12 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/266be814-4a2b-4f8e-a0f6-e8821fdeb95d/disk.rescue --force-share --output=json" returned: 0 in 0.143s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:28:12 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/266be814-4a2b-4f8e-a0f6-e8821fdeb95d/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:28:12 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/266be814-4a2b-4f8e-a0f6-e8821fdeb95d/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:28:12 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/266be814-4a2b-4f8e-a0f6-e8821fdeb95d/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:28:12 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/266be814-4a2b-4f8e-a0f6-e8821fdeb95d/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:28:12 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72382) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 15:28:12 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14c97840-88c0-4a8e-96e8-2e7da318ad07/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:28:12 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14c97840-88c0-4a8e-96e8-2e7da318ad07/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:28:12 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14c97840-88c0-4a8e-96e8-2e7da318ad07/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:28:12 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14c97840-88c0-4a8e-96e8-2e7da318ad07/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:28:12 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=72382) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 15:28:13 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44afd1bf-fa5c-4b3e-8752-b16853fef54e/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:28:13 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44afd1bf-fa5c-4b3e-8752-b16853fef54e/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:28:13 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44afd1bf-fa5c-4b3e-8752-b16853fef54e/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:28:13 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:28:13 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44afd1bf-fa5c-4b3e-8752-b16853fef54e/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:28:13 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6296ba5d-bcc6-405a-a635-0e9aa6114f7b/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:28:13 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6296ba5d-bcc6-405a-a635-0e9aa6114f7b/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:28:13 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6296ba5d-bcc6-405a-a635-0e9aa6114f7b/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:28:13 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6296ba5d-bcc6-405a-a635-0e9aa6114f7b/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:28:13 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61976531-76ae-4a1c-8950-0af784be376e/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:28:13 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61976531-76ae-4a1c-8950-0af784be376e/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:28:13 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61976531-76ae-4a1c-8950-0af784be376e/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:28:13 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61976531-76ae-4a1c-8950-0af784be376e/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:28:13 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72382) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 15:28:13 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:28:14 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:28:14 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:28:14 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:28:14 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ccbfda2-8bcd-4ec1-972a-cf49a62b1583/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:28:14 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:28:14 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ccbfda2-8bcd-4ec1-972a-cf49a62b1583/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:28:14 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ccbfda2-8bcd-4ec1-972a-cf49a62b1583/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:28:14 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ccbfda2-8bcd-4ec1-972a-cf49a62b1583/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:28:14 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=72382) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 15:28:14 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=72382) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 15:28:14 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0adbec9-eb22-4147-8c46-df7d02879f37/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:28:14 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0adbec9-eb22-4147-8c46-df7d02879f37/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:28:14 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0adbec9-eb22-4147-8c46-df7d02879f37/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:28:14 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0adbec9-eb22-4147-8c46-df7d02879f37/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:28:15 user nova-compute[72382]: WARNING nova.virt.libvirt.driver [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 15:28:15 user nova-compute[72382]: WARNING nova.virt.libvirt.driver [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 15:28:15 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Hypervisor/Node resource view: name=user free_ram=6998MB free_disk=25.317211151123047GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72382) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 15:28:15 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:28:15 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:28:15 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance f780040f-b789-4b72-8986-813c7b9fe4a6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:28:15 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance 44afd1bf-fa5c-4b3e-8752-b16853fef54e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:28:15 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance 266be814-4a2b-4f8e-a0f6-e8821fdeb95d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:28:15 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance 0f510d75-5d1e-4a5c-b38f-731c299f0f5a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:28:15 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance 6296ba5d-bcc6-405a-a635-0e9aa6114f7b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:28:15 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance 6ea8f68c-3dc1-45ac-a7f3-bca32f929add actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:28:15 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance 61976531-76ae-4a1c-8950-0af784be376e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:28:15 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:28:15 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance 14c97840-88c0-4a8e-96e8-2e7da318ad07 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:28:15 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance 4ccbfda2-8bcd-4ec1-972a-cf49a62b1583 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:28:15 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance 2f430d9a-9fbf-43cd-8c0d-e5dec162be71 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:28:15 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance e0adbec9-eb22-4147-8c46-df7d02879f37 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:28:15 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:28:15 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance 5002dc68-150a-4e96-bfe7-e66c6d764b9f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:28:15 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Total usable vcpus: 12, total allocated vcpus: 14 {{(pid=72382) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 15:28:15 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=14 pci_stats=[] {{(pid=72382) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 15:28:15 user nova-compute[72382]: DEBUG nova.compute.provider_tree [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Inventory has not changed in ProviderTree for provider: 7b15b0e5-df4d-49db-833b-2855d21d10ae {{(pid=72382) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 15:28:16 user nova-compute[72382]: DEBUG nova.scheduler.client.report [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Inventory has not changed for provider 7b15b0e5-df4d-49db-833b-2855d21d10ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72382) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 15:28:16 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Compute_service record updated for user:user {{(pid=72382) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 15:28:16 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.650s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:28:16 user nova-compute[72382]: DEBUG nova.compute.manager [req-d8724d30-8228-46ab-a10c-5d34d3352720 req-c29c3393-78fb-4672-b8a8-8b96bde4162d service nova] [instance: 4ccbfda2-8bcd-4ec1-972a-cf49a62b1583] Received event network-changed-2d07e6a3-03b7-4035-bdd2-a95435b99852 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:28:16 user nova-compute[72382]: DEBUG nova.compute.manager [req-d8724d30-8228-46ab-a10c-5d34d3352720 req-c29c3393-78fb-4672-b8a8-8b96bde4162d service nova] [instance: 4ccbfda2-8bcd-4ec1-972a-cf49a62b1583] Refreshing instance network info cache due to event network-changed-2d07e6a3-03b7-4035-bdd2-a95435b99852. {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 15:28:16 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-d8724d30-8228-46ab-a10c-5d34d3352720 req-c29c3393-78fb-4672-b8a8-8b96bde4162d service nova] Acquiring lock "refresh_cache-4ccbfda2-8bcd-4ec1-972a-cf49a62b1583" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 15:28:16 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-d8724d30-8228-46ab-a10c-5d34d3352720 req-c29c3393-78fb-4672-b8a8-8b96bde4162d service nova] Acquired lock "refresh_cache-4ccbfda2-8bcd-4ec1-972a-cf49a62b1583" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 15:28:16 user nova-compute[72382]: DEBUG nova.network.neutron [req-d8724d30-8228-46ab-a10c-5d34d3352720 req-c29c3393-78fb-4672-b8a8-8b96bde4162d service nova] [instance: 4ccbfda2-8bcd-4ec1-972a-cf49a62b1583] Refreshing network info cache for port 2d07e6a3-03b7-4035-bdd2-a95435b99852 {{(pid=72382) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 15:28:16 user nova-compute[72382]: DEBUG nova.network.neutron [req-d8724d30-8228-46ab-a10c-5d34d3352720 req-c29c3393-78fb-4672-b8a8-8b96bde4162d service nova] [instance: 4ccbfda2-8bcd-4ec1-972a-cf49a62b1583] Updated VIF entry in instance network info cache for port 2d07e6a3-03b7-4035-bdd2-a95435b99852. {{(pid=72382) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 15:28:16 user nova-compute[72382]: DEBUG nova.network.neutron [req-d8724d30-8228-46ab-a10c-5d34d3352720 req-c29c3393-78fb-4672-b8a8-8b96bde4162d service nova] [instance: 4ccbfda2-8bcd-4ec1-972a-cf49a62b1583] Updating instance_info_cache with network_info: [{"id": "2d07e6a3-03b7-4035-bdd2-a95435b99852", "address": "fa:16:3e:9a:d4:3a", "network": {"id": "308641dc-cc18-41db-9baa-7cc880e594ad", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1932973397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb5bf3f95d2843af94dbcab2af932bd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d07e6a3-03", "ovs_interfaceid": "2d07e6a3-03b7-4035-bdd2-a95435b99852", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:28:17 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-d8724d30-8228-46ab-a10c-5d34d3352720 req-c29c3393-78fb-4672-b8a8-8b96bde4162d service nova] Releasing lock "refresh_cache-4ccbfda2-8bcd-4ec1-972a-cf49a62b1583" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 15:28:18 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:28:19 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:28:19 user nova-compute[72382]: DEBUG nova.compute.manager [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Starting heal instance info cache {{(pid=72382) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 15:28:19 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Acquiring lock "refresh_cache-6296ba5d-bcc6-405a-a635-0e9aa6114f7b" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 15:28:19 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Acquired lock "refresh_cache-6296ba5d-bcc6-405a-a635-0e9aa6114f7b" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 15:28:19 user nova-compute[72382]: DEBUG nova.network.neutron [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] [instance: 6296ba5d-bcc6-405a-a635-0e9aa6114f7b] Forcefully refreshing network info cache for instance {{(pid=72382) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 15:28:19 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:28:19 user nova-compute[72382]: DEBUG nova.network.neutron [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] [instance: 6296ba5d-bcc6-405a-a635-0e9aa6114f7b] Updating instance_info_cache with network_info: [{"id": "dc2f667c-53dc-44b5-bd9d-55b4e9a4c86b", "address": "fa:16:3e:0b:83:7d", "network": {"id": "db8ab944-48c5-49d7-8f11-1216b54c6ea6", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1491766949-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca3091c1fc764326b65d9db6f1de9746", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc2f667c-53", "ovs_interfaceid": "dc2f667c-53dc-44b5-bd9d-55b4e9a4c86b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:28:19 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Releasing lock "refresh_cache-6296ba5d-bcc6-405a-a635-0e9aa6114f7b" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 15:28:19 user nova-compute[72382]: DEBUG nova.compute.manager [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] [instance: 6296ba5d-bcc6-405a-a635-0e9aa6114f7b] Updated the network info_cache for instance {{(pid=72382) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 15:28:19 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:28:19 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:28:19 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:28:19 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:28:19 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:28:19 user nova-compute[72382]: DEBUG nova.compute.manager [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72382) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 15:28:23 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:28:24 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:28:27 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-3e94bd51-9c8e-4753-a12f-99d77b18c166 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] Acquiring lock "6296ba5d-bcc6-405a-a635-0e9aa6114f7b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:28:27 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-3e94bd51-9c8e-4753-a12f-99d77b18c166 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] Lock "6296ba5d-bcc6-405a-a635-0e9aa6114f7b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:28:27 user nova-compute[72382]: DEBUG nova.objects.instance [None req-3e94bd51-9c8e-4753-a12f-99d77b18c166 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] Lazy-loading 'flavor' on Instance uuid 6296ba5d-bcc6-405a-a635-0e9aa6114f7b {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:28:27 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-3e94bd51-9c8e-4753-a12f-99d77b18c166 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] Lock "6296ba5d-bcc6-405a-a635-0e9aa6114f7b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.062s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:28:27 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-3e94bd51-9c8e-4753-a12f-99d77b18c166 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] Acquiring lock "6296ba5d-bcc6-405a-a635-0e9aa6114f7b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:28:27 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-3e94bd51-9c8e-4753-a12f-99d77b18c166 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] Lock "6296ba5d-bcc6-405a-a635-0e9aa6114f7b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:28:27 user nova-compute[72382]: INFO nova.compute.manager [None req-3e94bd51-9c8e-4753-a12f-99d77b18c166 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] [instance: 6296ba5d-bcc6-405a-a635-0e9aa6114f7b] Attaching volume e4e37d7b-3804-4117-840a-7e8ba26ea512 to /dev/vdb
Aug 09 15:28:27 user nova-compute[72382]: DEBUG os_brick.utils [None req-3e94bd51-9c8e-4753-a12f-99d77b18c166 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 15:28:27 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:28:27 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:28:27 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[3efa24c6-28b7-427c-9e35-77f287f82848]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d2cfa7015fe\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:28:27 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:28:27 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:28:27 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[47f60984-d81c-4700-ab76-2dcdbf105131]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:28:27 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:28:27 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:28:27 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb0ba4d5-6c63-4a1b-8f38-e87067bf96f5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:28:27 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[171048b4-c252-40a6-a8b3-9c0136577371]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:28:27 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-3e94bd51-9c8e-4753-a12f-99d77b18c166 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] Running cmd (subprocess): nvme version {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:28:27 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-3e94bd51-9c8e-4753-a12f-99d77b18c166 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] 'nvme version' failed. Not Retrying. {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 15:28:27 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3e94bd51-9c8e-4753-a12f-99d77b18c166 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] nvme not present on system {{(pid=72382) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 15:28:27 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:28:27 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 15:28:27 user nova-compute[72382]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 15:28:27 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[94dc195d-e20f-443c-b2f1-f0c53cf8b8e5]: (4, '') {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:28:27 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.lightos [None req-3e94bd51-9c8e-4753-a12f-99d77b18c166 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72382) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 15:28:27 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.lightos [None req-3e94bd51-9c8e-4753-a12f-99d77b18c166 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72382) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 15:28:27 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.lightos [None req-3e94bd51-9c8e-4753-a12f-99d77b18c166 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] LIGHTOS: no hostnqn found. {{(pid=72382) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 15:28:27 user nova-compute[72382]: DEBUG os_brick.utils [None req-3e94bd51-9c8e-4753-a12f-99d77b18c166 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d2cfa7015fe', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 15:28:27 user nova-compute[72382]: DEBUG nova.virt.block_device [None req-3e94bd51-9c8e-4753-a12f-99d77b18c166 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] [instance: 6296ba5d-bcc6-405a-a635-0e9aa6114f7b] Updating existing volume attachment record: 753d20d1-14d2-4164-b9d8-b4172049441b {{(pid=72382) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 15:28:28 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:28:29 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:28:33 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:28:34 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:28:36 user nova-compute[72382]: INFO nova.compute.manager [None req-7ea5e9f7-4e1e-4e6e-9fd3-f09291b11d4f tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] [instance: 2f430d9a-9fbf-43cd-8c0d-e5dec162be71] Rescuing
Aug 09 15:28:36 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-7ea5e9f7-4e1e-4e6e-9fd3-f09291b11d4f tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Acquiring lock "refresh_cache-2f430d9a-9fbf-43cd-8c0d-e5dec162be71" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 15:28:36 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-7ea5e9f7-4e1e-4e6e-9fd3-f09291b11d4f tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Acquired lock "refresh_cache-2f430d9a-9fbf-43cd-8c0d-e5dec162be71" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 15:28:36 user nova-compute[72382]: DEBUG nova.network.neutron [None req-7ea5e9f7-4e1e-4e6e-9fd3-f09291b11d4f tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] [instance: 2f430d9a-9fbf-43cd-8c0d-e5dec162be71] Building network info cache for instance {{(pid=72382) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 15:28:36 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3e94bd51-9c8e-4753-a12f-99d77b18c166 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] [instance: 6296ba5d-bcc6-405a-a635-0e9aa6114f7b] Calling os-brick to attach iSCSI Volume {{(pid=72382) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 15:28:36 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e94bd51-9c8e-4753-a12f-99d77b18c166 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2a0c768340>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:e4e37d7b-3804-4117-840a-7e8ba26ea512'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zMyvQSZJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 15:28:36 user nova-compute[72382]: WARNING os_brick.initiator.connectors.base [None req-3e94bd51-9c8e-4753-a12f-99d77b18c166 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 15:28:36 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-3e94bd51-9c8e-4753-a12f-99d77b18c166 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 15:28:36 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-3e94bd51-9c8e-4753-a12f-99d77b18c166 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 15:28:36 user nova-compute[72382]: WARNING os_brick.initiator.connectors.base [None req-3e94bd51-9c8e-4753-a12f-99d77b18c166 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 15:28:36 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-3e94bd51-9c8e-4753-a12f-99d77b18c166 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e4e37d7b-3804-4117-840a-7e8ba26ea512" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 15:28:36 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-3e94bd51-9c8e-4753-a12f-99d77b18c166 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e4e37d7b-3804-4117-840a-7e8ba26ea512" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 15:28:36 user nova-compute[72382]: INFO os_brick.initiator.connectors.iscsi [None req-3e94bd51-9c8e-4753-a12f-99d77b18c166 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 15:28:36 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4e37d7b-3804-4117-840a-7e8ba26ea512 -p 172.16.0.220:3260 {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:28:36 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4e37d7b-3804-4117-840a-7e8ba26ea512 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:28:36 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[99fc8a43-648e-4a37-8e15-4eba7a037a00]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:28:36 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e94bd51-9c8e-4753-a12f-99d77b18c166 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 15:28:36 user nova-compute[72382]:  {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:28:36 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4e37d7b-3804-4117-840a-7e8ba26ea512 -p 172.16.0.220:3260 --interface default --op new {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:28:36 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4e37d7b-3804-4117-840a-7e8ba26ea512 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:28:36 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfcc8c0f-d872-4bae-8f33-8915062b1fa6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e4e37d7b-3804-4117-840a-7e8ba26ea512] added\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:28:36 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e94bd51-9c8e-4753-a12f-99d77b18c166 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e4e37d7b-3804-4117-840a-7e8ba26ea512] added
Aug 09 15:28:36 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:28:36 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4e37d7b-3804-4117-840a-7e8ba26ea512 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:28:36 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4e37d7b-3804-4117-840a-7e8ba26ea512 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:28:36 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[eea18115-5eea-4930-a6bc-4bb3ec253d37]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:28:36 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e94bd51-9c8e-4753-a12f-99d77b18c166 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:28:36 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4e37d7b-3804-4117-840a-7e8ba26ea512 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:28:36 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4e37d7b-3804-4117-840a-7e8ba26ea512 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:28:36 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f8b0c46-d9c6-41c7-b2a6-a96713251431]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:28:36 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e94bd51-9c8e-4753-a12f-99d77b18c166 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:28:36 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4e37d7b-3804-4117-840a-7e8ba26ea512 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zMyvQSZJ {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:28:36 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4e37d7b-3804-4117-840a-7e8ba26ea512 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zMyvQSZJ" returned: 0 in 0.019s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:28:36 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[6905bbde-711a-4ffd-be26-e0059263249a]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:28:36 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e94bd51-9c8e-4753-a12f-99d77b18c166 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zMyvQSZJ'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:28:36 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4e37d7b-3804-4117-840a-7e8ba26ea512 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:28:36 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4e37d7b-3804-4117-840a-7e8ba26ea512 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:28:36 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[aff81d37-231c-4988-a631-a056ff9ac7ea]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:28:36 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e94bd51-9c8e-4753-a12f-99d77b18c166 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:28:36 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:28:36 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:28:36 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[436ac692-c158-4487-939a-bbda3df0800c]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9572706e-c54c-42c2-9cf0-2690cdf4cca2 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd90521a-f3b5-485c-9fb9-61ab37267f3a (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25503c6e-bfc0-4008-846a-8cad783fc0fb (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e62d4416-be8c-4327-9a51-0cc509109c53 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37c53941-47c4-4d6d-8826-d0833f90643e (non-flash)\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:28:36 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e94bd51-9c8e-4753-a12f-99d77b18c166 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)
Aug 09 15:28:36 user nova-compute[72382]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9572706e-c54c-42c2-9cf0-2690cdf4cca2 (non-flash)
Aug 09 15:28:36 user nova-compute[72382]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd90521a-f3b5-485c-9fb9-61ab37267f3a (non-flash)
Aug 09 15:28:36 user nova-compute[72382]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25503c6e-bfc0-4008-846a-8cad783fc0fb (non-flash)
Aug 09 15:28:36 user nova-compute[72382]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e62d4416-be8c-4327-9a51-0cc509109c53 (non-flash)
Aug 09 15:28:36 user nova-compute[72382]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37c53941-47c4-4d6d-8826-d0833f90643e (non-flash)
Aug 09 15:28:36 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 15:28:36 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e94bd51-9c8e-4753-a12f-99d77b18c166 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)
Aug 09 15:28:36 user nova-compute[72382]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9572706e-c54c-42c2-9cf0-2690cdf4cca2 (non-flash)
Aug 09 15:28:36 user nova-compute[72382]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd90521a-f3b5-485c-9fb9-61ab37267f3a (non-flash)
Aug 09 15:28:36 user nova-compute[72382]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25503c6e-bfc0-4008-846a-8cad783fc0fb (non-flash)
Aug 09 15:28:36 user nova-compute[72382]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e62d4416-be8c-4327-9a51-0cc509109c53 (non-flash)
Aug 09 15:28:36 user nova-compute[72382]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37c53941-47c4-4d6d-8826-d0833f90643e (non-flash)
Aug 09 15:28:36 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 15:28:36 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4e37d7b-3804-4117-840a-7e8ba26ea512 -p 172.16.0.220:3260 --login {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:28:36 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4e37d7b-3804-4117-840a-7e8ba26ea512 -p 172.16.0.220:3260 --login" returned: 0 in 0.079s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:28:36 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac3225b1-dd29-4573-93cf-b414c5e82e2f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e4e37d7b-3804-4117-840a-7e8ba26ea512, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e4e37d7b-3804-4117-840a-7e8ba26ea512, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:28:36 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e94bd51-9c8e-4753-a12f-99d77b18c166 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e4e37d7b-3804-4117-840a-7e8ba26ea512, portal: 172.16.0.220,3260]
Aug 09 15:28:36 user nova-compute[72382]: Login to [iface: default, target: iqn.2010-10.org.openstack:e4e37d7b-3804-4117-840a-7e8ba26ea512, portal: 172.16.0.220,3260] successful.
Aug 09 15:28:36 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:28:36 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4e37d7b-3804-4117-840a-7e8ba26ea512 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:28:36 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4e37d7b-3804-4117-840a-7e8ba26ea512 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:28:36 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[9113764e-ed91-46b8-a463-e7a714475a69]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:28:36 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e94bd51-9c8e-4753-a12f-99d77b18c166 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:28:36 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:28:36 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:28:36 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[d05c35ad-75c1-4746-b56c-3f73d5227475]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9572706e-c54c-42c2-9cf0-2690cdf4cca2 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd90521a-f3b5-485c-9fb9-61ab37267f3a (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25503c6e-bfc0-4008-846a-8cad783fc0fb (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e62d4416-be8c-4327-9a51-0cc509109c53 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37c53941-47c4-4d6d-8826-d0833f90643e (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4e37d7b-3804-4117-840a-7e8ba26ea512 (non-flash)\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:28:36 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e94bd51-9c8e-4753-a12f-99d77b18c166 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)
Aug 09 15:28:36 user nova-compute[72382]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9572706e-c54c-42c2-9cf0-2690cdf4cca2 (non-flash)
Aug 09 15:28:36 user nova-compute[72382]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd90521a-f3b5-485c-9fb9-61ab37267f3a (non-flash)
Aug 09 15:28:36 user nova-compute[72382]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25503c6e-bfc0-4008-846a-8cad783fc0fb (non-flash)
Aug 09 15:28:36 user nova-compute[72382]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e62d4416-be8c-4327-9a51-0cc509109c53 (non-flash)
Aug 09 15:28:36 user nova-compute[72382]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37c53941-47c4-4d6d-8826-d0833f90643e (non-flash)
Aug 09 15:28:36 user nova-compute[72382]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4e37d7b-3804-4117-840a-7e8ba26ea512 (non-flash)
Aug 09 15:28:36 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 15:28:36 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e94bd51-9c8e-4753-a12f-99d77b18c166 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)
Aug 09 15:28:36 user nova-compute[72382]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9572706e-c54c-42c2-9cf0-2690cdf4cca2 (non-flash)
Aug 09 15:28:36 user nova-compute[72382]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd90521a-f3b5-485c-9fb9-61ab37267f3a (non-flash)
Aug 09 15:28:36 user nova-compute[72382]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25503c6e-bfc0-4008-846a-8cad783fc0fb (non-flash)
Aug 09 15:28:36 user nova-compute[72382]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e62d4416-be8c-4327-9a51-0cc509109c53 (non-flash)
Aug 09 15:28:36 user nova-compute[72382]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37c53941-47c4-4d6d-8826-d0833f90643e (non-flash)
Aug 09 15:28:36 user nova-compute[72382]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4e37d7b-3804-4117-840a-7e8ba26ea512 (non-flash)
Aug 09 15:28:36 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 15:28:36 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-3e94bd51-9c8e-4753-a12f-99d77b18c166 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e4e37d7b-3804-4117-840a-7e8ba26ea512" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.322s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 15:28:36 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e94bd51-9c8e-4753-a12f-99d77b18c166 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] Connected to 172.16.0.220:3260 {{(pid=72382) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 15:28:36 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-3e94bd51-9c8e-4753-a12f-99d77b18c166 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] HCTL ('39', '-', '-', 0) found on session 35 with lun 0 {{(pid=72382) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 15:28:36 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-3e94bd51-9c8e-4753-a12f-99d77b18c166 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=72382) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 15:28:36 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:28:36 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.017s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:28:36 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[83e77627-a131-4d6c-ad79-e3e6aa6dc2dc]: (4, ('- - 0', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:28:36 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-3e94bd51-9c8e-4753-a12f-99d77b18c166 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] Searching for a device in session 35 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=72382) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 15:28:36 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e94bd51-9c8e-4753-a12f-99d77b18c166 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] Connected to sdh using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zMyvQSZJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72382) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 15:28:36 user nova-compute[72382]: DEBUG nova.network.neutron [None req-7ea5e9f7-4e1e-4e6e-9fd3-f09291b11d4f tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] [instance: 2f430d9a-9fbf-43cd-8c0d-e5dec162be71] Updating instance_info_cache with network_info: [{"id": "d13c4d4e-9004-4d4b-999d-619564a98542", "address": "fa:16:3e:10:88:6e", "network": {"id": "d47e3749-fdff-4112-bd72-69ca584efe1f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-302967634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "080d1ded4cd94e5083ee0b7e691b7363", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd13c4d4e-90", "ovs_interfaceid": "d13c4d4e-9004-4d4b-999d-619564a98542", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:28:36 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-7ea5e9f7-4e1e-4e6e-9fd3-f09291b11d4f tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Releasing lock "refresh_cache-2f430d9a-9fbf-43cd-8c0d-e5dec162be71" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 15:28:37 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:28:37 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:28:37 user nova-compute[72382]: DEBUG nova.compute.manager [req-d1b1f704-74b4-43b6-be54-48f3d319e378 req-8b0940f9-a1a3-4d61-b382-5b548f94b4f0 service nova] [instance: 2f430d9a-9fbf-43cd-8c0d-e5dec162be71] Received event network-vif-unplugged-d13c4d4e-9004-4d4b-999d-619564a98542 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:28:37 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-d1b1f704-74b4-43b6-be54-48f3d319e378 req-8b0940f9-a1a3-4d61-b382-5b548f94b4f0 service nova] Acquiring lock "2f430d9a-9fbf-43cd-8c0d-e5dec162be71-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:28:37 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-d1b1f704-74b4-43b6-be54-48f3d319e378 req-8b0940f9-a1a3-4d61-b382-5b548f94b4f0 service nova] Lock "2f430d9a-9fbf-43cd-8c0d-e5dec162be71-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:28:37 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-d1b1f704-74b4-43b6-be54-48f3d319e378 req-8b0940f9-a1a3-4d61-b382-5b548f94b4f0 service nova] Lock "2f430d9a-9fbf-43cd-8c0d-e5dec162be71-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:28:37 user nova-compute[72382]: DEBUG nova.compute.manager [req-d1b1f704-74b4-43b6-be54-48f3d319e378 req-8b0940f9-a1a3-4d61-b382-5b548f94b4f0 service nova] [instance: 2f430d9a-9fbf-43cd-8c0d-e5dec162be71] No waiting events found dispatching network-vif-unplugged-d13c4d4e-9004-4d4b-999d-619564a98542 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:28:37 user nova-compute[72382]: WARNING nova.compute.manager [req-d1b1f704-74b4-43b6-be54-48f3d319e378 req-8b0940f9-a1a3-4d61-b382-5b548f94b4f0 service nova] [instance: 2f430d9a-9fbf-43cd-8c0d-e5dec162be71] Received unexpected event network-vif-unplugged-d13c4d4e-9004-4d4b-999d-619564a98542 for instance with vm_state active and task_state rescuing.
Aug 09 15:28:37 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:28:37 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:28:37 user nova-compute[72382]: INFO nova.virt.libvirt.driver [-] [instance: 2f430d9a-9fbf-43cd-8c0d-e5dec162be71] Instance destroyed successfully.
Aug 09 15:28:37 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-7ea5e9f7-4e1e-4e6e-9fd3-f09291b11d4f tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] [instance: 2f430d9a-9fbf-43cd-8c0d-e5dec162be71] Attempting a stable device rescue
Aug 09 15:28:37 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-7ea5e9f7-4e1e-4e6e-9fd3-f09291b11d4f tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=72382) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 09 15:28:37 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-7ea5e9f7-4e1e-4e6e-9fd3-f09291b11d4f tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] [instance: 2f430d9a-9fbf-43cd-8c0d-e5dec162be71] Instance directory exists: not creating {{(pid=72382) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 09 15:28:37 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-7ea5e9f7-4e1e-4e6e-9fd3-f09291b11d4f tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] [instance: 2f430d9a-9fbf-43cd-8c0d-e5dec162be71] Creating image(s)
Aug 09 15:28:37 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-7ea5e9f7-4e1e-4e6e-9fd3-f09291b11d4f tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Acquiring lock "/opt/stack/data/nova/instances/2f430d9a-9fbf-43cd-8c0d-e5dec162be71/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:28:37 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-7ea5e9f7-4e1e-4e6e-9fd3-f09291b11d4f tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Lock "/opt/stack/data/nova/instances/2f430d9a-9fbf-43cd-8c0d-e5dec162be71/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:28:37 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-7ea5e9f7-4e1e-4e6e-9fd3-f09291b11d4f tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Lock "/opt/stack/data/nova/instances/2f430d9a-9fbf-43cd-8c0d-e5dec162be71/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:28:37 user nova-compute[72382]: DEBUG nova.objects.instance [None req-7ea5e9f7-4e1e-4e6e-9fd3-f09291b11d4f tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Lazy-loading 'trusted_certs' on Instance uuid 2f430d9a-9fbf-43cd-8c0d-e5dec162be71 {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:28:37 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-7ea5e9f7-4e1e-4e6e-9fd3-f09291b11d4f tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Acquiring lock "1e07b87ed1ce10fc0f4fae6000fff51bd0d2dde9" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:28:37 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-7ea5e9f7-4e1e-4e6e-9fd3-f09291b11d4f tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Lock "1e07b87ed1ce10fc0f4fae6000fff51bd0d2dde9" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:28:37 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-3e94bd51-9c8e-4753-a12f-99d77b18c166 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.361s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 15:28:37 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e94bd51-9c8e-4753-a12f-99d77b18c166 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] <== connect_volume: return (1362ms) {'type': 'block', 'scsi_wwn': '26163643036316266', 'path': '/dev/sdh'} {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 15:28:37 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3e94bd51-9c8e-4753-a12f-99d77b18c166 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] [instance: 6296ba5d-bcc6-405a-a635-0e9aa6114f7b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26163643036316266', 'path': '/dev/sdh'} {{(pid=72382) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 15:28:37 user nova-compute[72382]: DEBUG nova.objects.instance [None req-3e94bd51-9c8e-4753-a12f-99d77b18c166 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] Lazy-loading 'flavor' on Instance uuid 6296ba5d-bcc6-405a-a635-0e9aa6114f7b {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:28:37 user nova-compute[72382]: DEBUG nova.virt.libvirt.guest [None req-3e94bd51-9c8e-4753-a12f-99d77b18c166 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 15:28:37 user nova-compute[72382]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 15:28:37 user nova-compute[72382]:   <source dev="/dev/sdh"/>
Aug 09 15:28:37 user nova-compute[72382]:   <target dev="vdb" bus="virtio"/>
Aug 09 15:28:37 user nova-compute[72382]:   <serial>e4e37d7b-3804-4117-840a-7e8ba26ea512</serial>
Aug 09 15:28:37 user nova-compute[72382]: </disk>
Aug 09 15:28:37 user nova-compute[72382]:  {{(pid=72382) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 15:28:38 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-7ea5e9f7-4e1e-4e6e-9fd3-f09291b11d4f tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e07b87ed1ce10fc0f4fae6000fff51bd0d2dde9.part --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:28:38 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:28:38 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-3e94bd51-9c8e-4753-a12f-99d77b18c166 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] No BDM found with device name vda, not building metadata. {{(pid=72382) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 15:28:38 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-3e94bd51-9c8e-4753-a12f-99d77b18c166 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72382) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 15:28:38 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-3e94bd51-9c8e-4753-a12f-99d77b18c166 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] No VIF found with MAC fa:16:3e:0b:83:7d, not building metadata {{(pid=72382) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 15:28:38 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-7ea5e9f7-4e1e-4e6e-9fd3-f09291b11d4f tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e07b87ed1ce10fc0f4fae6000fff51bd0d2dde9.part --force-share --output=json" returned: 0 in 0.158s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:28:38 user nova-compute[72382]: DEBUG nova.virt.images [None req-7ea5e9f7-4e1e-4e6e-9fd3-f09291b11d4f tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] a5bea329-f776-47c1-9473-7b29a89db8c3 was qcow2, converting to raw {{(pid=72382) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 09 15:28:38 user nova-compute[72382]: DEBUG nova.privsep.utils [None req-7ea5e9f7-4e1e-4e6e-9fd3-f09291b11d4f tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72382) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 09 15:28:38 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-7ea5e9f7-4e1e-4e6e-9fd3-f09291b11d4f tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/1e07b87ed1ce10fc0f4fae6000fff51bd0d2dde9.part /opt/stack/data/nova/instances/_base/1e07b87ed1ce10fc0f4fae6000fff51bd0d2dde9.converted {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:28:39 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-3e94bd51-9c8e-4753-a12f-99d77b18c166 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] Lock "6296ba5d-bcc6-405a-a635-0e9aa6114f7b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.741s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:28:39 user nova-compute[72382]: DEBUG nova.compute.manager [req-ec82b562-132c-4f73-a7a7-78b589d80075 req-a8d44b19-fd8d-48c9-acf7-16400c43bf28 service nova] [instance: 2f430d9a-9fbf-43cd-8c0d-e5dec162be71] Received event network-vif-plugged-d13c4d4e-9004-4d4b-999d-619564a98542 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:28:39 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-ec82b562-132c-4f73-a7a7-78b589d80075 req-a8d44b19-fd8d-48c9-acf7-16400c43bf28 service nova] Acquiring lock "2f430d9a-9fbf-43cd-8c0d-e5dec162be71-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:28:39 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-ec82b562-132c-4f73-a7a7-78b589d80075 req-a8d44b19-fd8d-48c9-acf7-16400c43bf28 service nova] Lock "2f430d9a-9fbf-43cd-8c0d-e5dec162be71-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:28:39 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-ec82b562-132c-4f73-a7a7-78b589d80075 req-a8d44b19-fd8d-48c9-acf7-16400c43bf28 service nova] Lock "2f430d9a-9fbf-43cd-8c0d-e5dec162be71-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:28:39 user nova-compute[72382]: DEBUG nova.compute.manager [req-ec82b562-132c-4f73-a7a7-78b589d80075 req-a8d44b19-fd8d-48c9-acf7-16400c43bf28 service nova] [instance: 2f430d9a-9fbf-43cd-8c0d-e5dec162be71] No waiting events found dispatching network-vif-plugged-d13c4d4e-9004-4d4b-999d-619564a98542 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:28:39 user nova-compute[72382]: WARNING nova.compute.manager [req-ec82b562-132c-4f73-a7a7-78b589d80075 req-a8d44b19-fd8d-48c9-acf7-16400c43bf28 service nova] [instance: 2f430d9a-9fbf-43cd-8c0d-e5dec162be71] Received unexpected event network-vif-plugged-d13c4d4e-9004-4d4b-999d-619564a98542 for instance with vm_state active and task_state rescuing.
Aug 09 15:28:39 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:28:39 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-7ea5e9f7-4e1e-4e6e-9fd3-f09291b11d4f tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/1e07b87ed1ce10fc0f4fae6000fff51bd0d2dde9.part /opt/stack/data/nova/instances/_base/1e07b87ed1ce10fc0f4fae6000fff51bd0d2dde9.converted" returned: 0 in 0.486s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:28:39 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-7ea5e9f7-4e1e-4e6e-9fd3-f09291b11d4f tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e07b87ed1ce10fc0f4fae6000fff51bd0d2dde9.converted --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:28:39 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-7ea5e9f7-4e1e-4e6e-9fd3-f09291b11d4f tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e07b87ed1ce10fc0f4fae6000fff51bd0d2dde9.converted --force-share --output=json" returned: 0 in 0.171s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:28:39 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-7ea5e9f7-4e1e-4e6e-9fd3-f09291b11d4f tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Lock "1e07b87ed1ce10fc0f4fae6000fff51bd0d2dde9" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.879s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:28:39 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-7ea5e9f7-4e1e-4e6e-9fd3-f09291b11d4f tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Acquiring lock "1e07b87ed1ce10fc0f4fae6000fff51bd0d2dde9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:28:39 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-7ea5e9f7-4e1e-4e6e-9fd3-f09291b11d4f tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Lock "1e07b87ed1ce10fc0f4fae6000fff51bd0d2dde9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:28:39 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-7ea5e9f7-4e1e-4e6e-9fd3-f09291b11d4f tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e07b87ed1ce10fc0f4fae6000fff51bd0d2dde9 --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:28:39 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-7ea5e9f7-4e1e-4e6e-9fd3-f09291b11d4f tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e07b87ed1ce10fc0f4fae6000fff51bd0d2dde9 --force-share --output=json" returned: 0 in 0.159s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:28:39 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-7ea5e9f7-4e1e-4e6e-9fd3-f09291b11d4f tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1e07b87ed1ce10fc0f4fae6000fff51bd0d2dde9,backing_fmt=raw /opt/stack/data/nova/instances/2f430d9a-9fbf-43cd-8c0d-e5dec162be71/disk.rescue {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:28:39 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-7ea5e9f7-4e1e-4e6e-9fd3-f09291b11d4f tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1e07b87ed1ce10fc0f4fae6000fff51bd0d2dde9,backing_fmt=raw /opt/stack/data/nova/instances/2f430d9a-9fbf-43cd-8c0d-e5dec162be71/disk.rescue" returned: 0 in 0.069s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:28:39 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-7ea5e9f7-4e1e-4e6e-9fd3-f09291b11d4f tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Lock "1e07b87ed1ce10fc0f4fae6000fff51bd0d2dde9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.237s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:28:39 user nova-compute[72382]: DEBUG nova.objects.instance [None req-7ea5e9f7-4e1e-4e6e-9fd3-f09291b11d4f tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Lazy-loading 'migration_context' on Instance uuid 2f430d9a-9fbf-43cd-8c0d-e5dec162be71 {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:28:39 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-7ea5e9f7-4e1e-4e6e-9fd3-f09291b11d4f tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] [instance: 2f430d9a-9fbf-43cd-8c0d-e5dec162be71] Created local disks {{(pid=72382) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 15:28:39 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-7ea5e9f7-4e1e-4e6e-9fd3-f09291b11d4f tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] [instance: 2f430d9a-9fbf-43cd-8c0d-e5dec162be71] Start _get_guest_xml network_info=[{"id": "d13c4d4e-9004-4d4b-999d-619564a98542", "address": "fa:16:3e:10:88:6e", "network": {"id": "d47e3749-fdff-4112-bd72-69ca584efe1f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-302967634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-302967634-network", "vif_mac": "fa:16:3e:10:88:6e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "080d1ded4cd94e5083ee0b7e691b7363", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd13c4d4e-90", "ovs_interfaceid": "d13c4d4e-9004-4d4b-999d-619564a98542", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T15:11:25Z,direct_url=<?>,disk_format='qcow2',id=a79f2cea-eb27-4631-aaf3-05e7d9e411b4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a638990e12cc4d6eabb6d55e13be6bdf',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T15:11:27Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'a5bea329-f776-47c1-9473-7b29a89db8c3', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:25503c6e-bfc0-4008-846a-8cad783fc0fb'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DpcMQIwC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': '2f430d9a-9fbf-43cd-8c0d-e5dec162be71', 'attached_at': '', 'detached_at': '', 'volume_id': '25503c6e-bfc0-4008-846a-8cad783fc0fb', 'serial': '25503c6e-bfc0-4008-846a-8cad783fc0fb'}, 'disk_bus': 'virtio', 'attachment_id': '67c24730-95dc-4950-ae8c-05c2a1d628f5', 'delete_on_termination': False, 'volume_type': None} {{(pid=72382) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 15:28:39 user nova-compute[72382]: DEBUG nova.objects.instance [None req-7ea5e9f7-4e1e-4e6e-9fd3-f09291b11d4f tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Lazy-loading 'resources' on Instance uuid 2f430d9a-9fbf-43cd-8c0d-e5dec162be71 {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:28:39 user nova-compute[72382]: DEBUG nova.objects.instance [None req-7ea5e9f7-4e1e-4e6e-9fd3-f09291b11d4f tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Lazy-loading 'numa_topology' on Instance uuid 2f430d9a-9fbf-43cd-8c0d-e5dec162be71 {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:28:39 user nova-compute[72382]: WARNING nova.virt.libvirt.driver [None req-7ea5e9f7-4e1e-4e6e-9fd3-f09291b11d4f tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 15:28:39 user nova-compute[72382]: WARNING nova.virt.libvirt.driver [None req-7ea5e9f7-4e1e-4e6e-9fd3-f09291b11d4f tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 15:28:39 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-7ea5e9f7-4e1e-4e6e-9fd3-f09291b11d4f tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72382) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 15:28:39 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-7ea5e9f7-4e1e-4e6e-9fd3-f09291b11d4f tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] CPU controller missing on host. {{(pid=72382) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 15:28:39 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-7ea5e9f7-4e1e-4e6e-9fd3-f09291b11d4f tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72382) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 15:28:39 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-7ea5e9f7-4e1e-4e6e-9fd3-f09291b11d4f tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] CPU controller found on host. {{(pid=72382) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 15:28:39 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-7ea5e9f7-4e1e-4e6e-9fd3-f09291b11d4f tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72382) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 15:28:39 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-7ea5e9f7-4e1e-4e6e-9fd3-f09291b11d4f tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T15:11:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T15:11:25Z,direct_url=<?>,disk_format='qcow2',id=a79f2cea-eb27-4631-aaf3-05e7d9e411b4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a638990e12cc4d6eabb6d55e13be6bdf',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T15:11:27Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 15:28:39 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-7ea5e9f7-4e1e-4e6e-9fd3-f09291b11d4f tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Flavor limits 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 15:28:39 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-7ea5e9f7-4e1e-4e6e-9fd3-f09291b11d4f tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Image limits 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 15:28:39 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-7ea5e9f7-4e1e-4e6e-9fd3-f09291b11d4f tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Flavor pref 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 15:28:39 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-7ea5e9f7-4e1e-4e6e-9fd3-f09291b11d4f tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Image pref 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 15:28:39 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-7ea5e9f7-4e1e-4e6e-9fd3-f09291b11d4f tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 15:28:39 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-7ea5e9f7-4e1e-4e6e-9fd3-f09291b11d4f tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 15:28:39 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-7ea5e9f7-4e1e-4e6e-9fd3-f09291b11d4f tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72382) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 15:28:39 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-7ea5e9f7-4e1e-4e6e-9fd3-f09291b11d4f tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Got 1 possible topologies {{(pid=72382) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 15:28:39 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-7ea5e9f7-4e1e-4e6e-9fd3-f09291b11d4f tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 15:28:39 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-7ea5e9f7-4e1e-4e6e-9fd3-f09291b11d4f tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 15:28:39 user nova-compute[72382]: DEBUG nova.objects.instance [None req-7ea5e9f7-4e1e-4e6e-9fd3-f09291b11d4f tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Lazy-loading 'vcpu_model' on Instance uuid 2f430d9a-9fbf-43cd-8c0d-e5dec162be71 {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:28:40 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7ea5e9f7-4e1e-4e6e-9fd3-f09291b11d4f tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] [instance: 2f430d9a-9fbf-43cd-8c0d-e5dec162be71] Calling os-brick to attach iSCSI Volume {{(pid=72382) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 15:28:40 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ea5e9f7-4e1e-4e6e-9fd3-f09291b11d4f tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2a0c768340>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:25503c6e-bfc0-4008-846a-8cad783fc0fb'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DpcMQIwC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 15:28:40 user nova-compute[72382]: WARNING os_brick.initiator.connectors.base [None req-7ea5e9f7-4e1e-4e6e-9fd3-f09291b11d4f tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 15:28:40 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-7ea5e9f7-4e1e-4e6e-9fd3-f09291b11d4f tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 15:28:40 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-7ea5e9f7-4e1e-4e6e-9fd3-f09291b11d4f tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 15:28:40 user nova-compute[72382]: WARNING os_brick.initiator.connectors.base [None req-7ea5e9f7-4e1e-4e6e-9fd3-f09291b11d4f tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 15:28:40 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-7ea5e9f7-4e1e-4e6e-9fd3-f09291b11d4f tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:25503c6e-bfc0-4008-846a-8cad783fc0fb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 15:28:40 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-7ea5e9f7-4e1e-4e6e-9fd3-f09291b11d4f tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:25503c6e-bfc0-4008-846a-8cad783fc0fb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 15:28:40 user nova-compute[72382]: INFO os_brick.initiator.connectors.iscsi [None req-7ea5e9f7-4e1e-4e6e-9fd3-f09291b11d4f tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 15:28:40 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25503c6e-bfc0-4008-846a-8cad783fc0fb -p 172.16.0.220:3260 {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:28:40 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25503c6e-bfc0-4008-846a-8cad783fc0fb -p 172.16.0.220:3260" returned: 0 in 0.020s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:28:40 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[083bdb16-673d-4fd9-9c90-13254a486f58]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:25503c6e-bfc0-4008-846a-8cad783fc0fb\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = DpcMQIwC\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:28:40 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ea5e9f7-4e1e-4e6e-9fd3-f09291b11d4f tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Aug 09 15:28:40 user nova-compute[72382]: node.name = iqn.2010-10.org.openstack:25503c6e-bfc0-4008-846a-8cad783fc0fb
Aug 09 15:28:40 user nova-compute[72382]: node.tpgt = -1
Aug 09 15:28:40 user nova-compute[72382]: node.startup = automatic
Aug 09 15:28:40 user nova-compute[72382]: node.leading_login = No
Aug 09 15:28:40 user nova-compute[72382]: iface.iscsi_ifacename = default
Aug 09 15:28:40 user nova-compute[72382]: iface.net_ifacename = <empty>
Aug 09 15:28:40 user nova-compute[72382]: iface.ipaddress = <empty>
Aug 09 15:28:40 user nova-compute[72382]: iface.prefix_len = 0
Aug 09 15:28:40 user nova-compute[72382]: iface.hwaddress = <empty>
Aug 09 15:28:40 user nova-compute[72382]: iface.transport_name = tcp
Aug 09 15:28:40 user nova-compute[72382]: iface.initiatorname = <empty>
Aug 09 15:28:40 user nova-compute[72382]: iface.state = <empty>
Aug 09 15:28:40 user nova-compute[72382]: iface.vlan_id = 0
Aug 09 15:28:40 user nova-compute[72382]: iface.vlan_priority = 0
Aug 09 15:28:40 user nova-compute[72382]: iface.vlan_state = <empty>
Aug 09 15:28:40 user nova-compute[72382]: iface.iface_num = 0
Aug 09 15:28:40 user nova-compute[72382]: iface.mtu = 0
Aug 09 15:28:40 user nova-compute[72382]: iface.port = 0
Aug 09 15:28:40 user nova-compute[72382]: iface.bootproto = <empty>
Aug 09 15:28:40 user nova-compute[72382]: iface.subnet_mask = <empty>
Aug 09 15:28:40 user nova-compute[72382]: iface.gateway = <empty>
Aug 09 15:28:40 user nova-compute[72382]: iface.dhcp_alt_client_id_state = <empty>
Aug 09 15:28:40 user nova-compute[72382]: iface.dhcp_alt_client_id = <empty>
Aug 09 15:28:40 user nova-compute[72382]: iface.dhcp_dns = <empty>
Aug 09 15:28:40 user nova-compute[72382]: iface.dhcp_learn_iqn = <empty>
Aug 09 15:28:40 user nova-compute[72382]: iface.dhcp_req_vendor_id_state = <empty>
Aug 09 15:28:40 user nova-compute[72382]: iface.dhcp_vendor_id_state = <empty>
Aug 09 15:28:40 user nova-compute[72382]: iface.dhcp_vendor_id = <empty>
Aug 09 15:28:40 user nova-compute[72382]: iface.dhcp_slp_da = <empty>
Aug 09 15:28:40 user nova-compute[72382]: iface.fragmentation = <empty>
Aug 09 15:28:40 user nova-compute[72382]: iface.gratuitous_arp = <empty>
Aug 09 15:28:40 user nova-compute[72382]: iface.incoming_forwarding = <empty>
Aug 09 15:28:40 user nova-compute[72382]: iface.tos_state = <empty>
Aug 09 15:28:40 user nova-compute[72382]: iface.tos = 0
Aug 09 15:28:40 user nova-compute[72382]: iface.ttl = 0
Aug 09 15:28:40 user nova-compute[72382]: iface.delayed_ack = <empty>
Aug 09 15:28:40 user nova-compute[72382]: iface.tcp_nagle = <empty>
Aug 09 15:28:40 user nova-compute[72382]: iface.tcp_wsf_state = <empty>
Aug 09 15:28:40 user nova-compute[72382]: iface.tcp_wsf = 0
Aug 09 15:28:40 user nova-compute[72382]: iface.tcp_timer_scale = 0
Aug 09 15:28:40 user nova-compute[72382]: iface.tcp_timestamp = <empty>
Aug 09 15:28:40 user nova-compute[72382]: iface.redirect = <empty>
Aug 09 15:28:40 user nova-compute[72382]: iface.def_task_mgmt_timeout = 0
Aug 09 15:28:40 user nova-compute[72382]: iface.header_digest = <empty>
Aug 09 15:28:40 user nova-compute[72382]: iface.data_digest = <empty>
Aug 09 15:28:40 user nova-compute[72382]: iface.immediate_data = <empty>
Aug 09 15:28:40 user nova-compute[72382]: iface.initial_r2t = <empty>
Aug 09 15:28:40 user nova-compute[72382]: iface.data_seq_inorder = <empty>
Aug 09 15:28:40 user nova-compute[72382]: iface.data_pdu_inorder = <empty>
Aug 09 15:28:40 user nova-compute[72382]: iface.erl = 0
Aug 09 15:28:40 user nova-compute[72382]: iface.max_receive_data_len = 0
Aug 09 15:28:40 user nova-compute[72382]: iface.first_burst_len = 0
Aug 09 15:28:40 user nova-compute[72382]: iface.max_outstanding_r2t = 0
Aug 09 15:28:40 user nova-compute[72382]: iface.max_burst_len = 0
Aug 09 15:28:40 user nova-compute[72382]: iface.chap_auth = <empty>
Aug 09 15:28:40 user nova-compute[72382]: iface.bidi_chap = <empty>
Aug 09 15:28:40 user nova-compute[72382]: iface.strict_login_compliance = <empty>
Aug 09 15:28:40 user nova-compute[72382]: iface.discovery_auth = <empty>
Aug 09 15:28:40 user nova-compute[72382]: iface.discovery_logout = <empty>
Aug 09 15:28:40 user nova-compute[72382]: node.discovery_address = <empty>
Aug 09 15:28:40 user nova-compute[72382]: node.discovery_port = 0
Aug 09 15:28:40 user nova-compute[72382]: node.discovery_type = static
Aug 09 15:28:40 user nova-compute[72382]: node.session.initial_cmdsn = 0
Aug 09 15:28:40 user nova-compute[72382]: node.session.initial_login_retry_max = 8
Aug 09 15:28:40 user nova-compute[72382]: node.session.xmit_thread_priority = -20
Aug 09 15:28:40 user nova-compute[72382]: node.session.cmds_max = 128
Aug 09 15:28:40 user nova-compute[72382]: node.session.queue_depth = 32
Aug 09 15:28:40 user nova-compute[72382]: node.session.nr_sessions = 1
Aug 09 15:28:40 user nova-compute[72382]: node.session.auth.authmethod = CHAP
Aug 09 15:28:40 user nova-compute[72382]: node.session.auth.username = DpcMQIwC
Aug 09 15:28:40 user nova-compute[72382]: node.session.auth.password = ***
Aug 09 15:28:40 user nova-compute[72382]: node.session.auth.username_in = <empty>
Aug 09 15:28:40 user nova-compute[72382]: node.session.auth.password_in = <empty>
Aug 09 15:28:40 user nova-compute[72382]: node.session.auth.chap_algs = MD5
Aug 09 15:28:40 user nova-compute[72382]: node.session.timeo.replacement_timeout = 120
Aug 09 15:28:40 user nova-compute[72382]: node.session.err_timeo.abort_timeout = 15
Aug 09 15:28:40 user nova-compute[72382]: node.session.err_timeo.lu_reset_timeout = 30
Aug 09 15:28:40 user nova-compute[72382]: node.session.err_timeo.tgt_reset_timeout = 30
Aug 09 15:28:40 user nova-compute[72382]: node.session.err_timeo.host_reset_timeout = 60
Aug 09 15:28:40 user nova-compute[72382]: node.session.iscsi.FastAbort = Yes
Aug 09 15:28:40 user nova-compute[72382]: node.session.iscsi.InitialR2T = No
Aug 09 15:28:40 user nova-compute[72382]: node.session.iscsi.ImmediateData = Yes
Aug 09 15:28:40 user nova-compute[72382]: node.session.iscsi.FirstBurstLength = 262144
Aug 09 15:28:40 user nova-compute[72382]: node.session.iscsi.MaxBurstLength = 16776192
Aug 09 15:28:40 user nova-compute[72382]: node.session.iscsi.DefaultTime2Retain = 0
Aug 09 15:28:40 user nova-compute[72382]: node.session.iscsi.DefaultTime2Wait = 2
Aug 09 15:28:40 user nova-compute[72382]: node.session.iscsi.MaxConnections = 1
Aug 09 15:28:40 user nova-compute[72382]: node.session.iscsi.MaxOutstandingR2T = 1
Aug 09 15:28:40 user nova-compute[72382]: node.session.iscsi.ERL = 0
Aug 09 15:28:40 user nova-compute[72382]: node.session.scan = manual
Aug 09 15:28:40 user nova-compute[72382]: node.session.reopen_max = 0
Aug 09 15:28:40 user nova-compute[72382]: node.conn[0].address = 172.16.0.220
Aug 09 15:28:40 user nova-compute[72382]: node.conn[0].port = 3260
Aug 09 15:28:40 user nova-compute[72382]: node.conn[0].startup = manual
Aug 09 15:28:40 user nova-compute[72382]: node.conn[0].tcp.window_size = 524288
Aug 09 15:28:40 user nova-compute[72382]: node.conn[0].tcp.type_of_service = 0
Aug 09 15:28:40 user nova-compute[72382]: node.conn[0].timeo.logout_timeout = 15
Aug 09 15:28:40 user nova-compute[72382]: node.conn[0].timeo.login_timeout = 15
Aug 09 15:28:40 user nova-compute[72382]: node.conn[0].timeo.auth_timeout = 45
Aug 09 15:28:40 user nova-compute[72382]: node.conn[0].timeo.noop_out_interval = 5
Aug 09 15:28:40 user nova-compute[72382]: node.conn[0].timeo.noop_out_timeout = 5
Aug 09 15:28:40 user nova-compute[72382]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Aug 09 15:28:40 user nova-compute[72382]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Aug 09 15:28:40 user nova-compute[72382]: node.conn[0].iscsi.HeaderDigest = None
Aug 09 15:28:40 user nova-compute[72382]: node.conn[0].iscsi.DataDigest = None
Aug 09 15:28:40 user nova-compute[72382]: node.conn[0].iscsi.IFMarker = No
Aug 09 15:28:40 user nova-compute[72382]: node.conn[0].iscsi.OFMarker = No
Aug 09 15:28:40 user nova-compute[72382]: # END RECORD
Aug 09 15:28:40 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:28:40 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25503c6e-bfc0-4008-846a-8cad783fc0fb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:28:40 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25503c6e-bfc0-4008-846a-8cad783fc0fb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:28:40 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffe12936-4bd8-4787-9d8e-6f2406ad5a8b]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:28:40 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ea5e9f7-4e1e-4e6e-9fd3-f09291b11d4f tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:28:40 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25503c6e-bfc0-4008-846a-8cad783fc0fb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:28:40 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25503c6e-bfc0-4008-846a-8cad783fc0fb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:28:40 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ff98e53-0fa5-4587-934c-c9b3651b86e5]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:28:40 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ea5e9f7-4e1e-4e6e-9fd3-f09291b11d4f tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:28:40 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25503c6e-bfc0-4008-846a-8cad783fc0fb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DpcMQIwC {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:28:40 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25503c6e-bfc0-4008-846a-8cad783fc0fb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DpcMQIwC" returned: 0 in 0.032s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:28:40 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[c951d156-ac01-4c6f-8209-88b80d6c9d55]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:28:40 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ea5e9f7-4e1e-4e6e-9fd3-f09291b11d4f tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DpcMQIwC'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:28:40 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25503c6e-bfc0-4008-846a-8cad783fc0fb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:28:40 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25503c6e-bfc0-4008-846a-8cad783fc0fb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:28:40 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[b190bec2-8260-4084-889f-33b1db4bfa66]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:28:40 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ea5e9f7-4e1e-4e6e-9fd3-f09291b11d4f tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:28:40 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:28:40 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:28:40 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[15eee2b0-901a-4232-8975-1d8289f01f73]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9572706e-c54c-42c2-9cf0-2690cdf4cca2 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd90521a-f3b5-485c-9fb9-61ab37267f3a (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25503c6e-bfc0-4008-846a-8cad783fc0fb (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e62d4416-be8c-4327-9a51-0cc509109c53 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37c53941-47c4-4d6d-8826-d0833f90643e (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4e37d7b-3804-4117-840a-7e8ba26ea512 (non-flash)\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:28:40 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ea5e9f7-4e1e-4e6e-9fd3-f09291b11d4f tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)
Aug 09 15:28:40 user nova-compute[72382]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9572706e-c54c-42c2-9cf0-2690cdf4cca2 (non-flash)
Aug 09 15:28:40 user nova-compute[72382]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd90521a-f3b5-485c-9fb9-61ab37267f3a (non-flash)
Aug 09 15:28:40 user nova-compute[72382]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25503c6e-bfc0-4008-846a-8cad783fc0fb (non-flash)
Aug 09 15:28:40 user nova-compute[72382]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e62d4416-be8c-4327-9a51-0cc509109c53 (non-flash)
Aug 09 15:28:40 user nova-compute[72382]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37c53941-47c4-4d6d-8826-d0833f90643e (non-flash)
Aug 09 15:28:40 user nova-compute[72382]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4e37d7b-3804-4117-840a-7e8ba26ea512 (non-flash)
Aug 09 15:28:40 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 15:28:40 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ea5e9f7-4e1e-4e6e-9fd3-f09291b11d4f tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)
Aug 09 15:28:40 user nova-compute[72382]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9572706e-c54c-42c2-9cf0-2690cdf4cca2 (non-flash)
Aug 09 15:28:40 user nova-compute[72382]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd90521a-f3b5-485c-9fb9-61ab37267f3a (non-flash)
Aug 09 15:28:40 user nova-compute[72382]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25503c6e-bfc0-4008-846a-8cad783fc0fb (non-flash)
Aug 09 15:28:40 user nova-compute[72382]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e62d4416-be8c-4327-9a51-0cc509109c53 (non-flash)
Aug 09 15:28:40 user nova-compute[72382]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37c53941-47c4-4d6d-8826-d0833f90643e (non-flash)
Aug 09 15:28:40 user nova-compute[72382]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4e37d7b-3804-4117-840a-7e8ba26ea512 (non-flash)
Aug 09 15:28:40 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 15:28:40 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-7ea5e9f7-4e1e-4e6e-9fd3-f09291b11d4f tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:25503c6e-bfc0-4008-846a-8cad783fc0fb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.183s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 15:28:40 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ea5e9f7-4e1e-4e6e-9fd3-f09291b11d4f tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Connected to 172.16.0.220:3260 {{(pid=72382) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 15:28:40 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-7ea5e9f7-4e1e-4e6e-9fd3-f09291b11d4f tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] HCTL ('36', '0', '0', 0) found on session 31 with lun 0 {{(pid=72382) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 15:28:40 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-7ea5e9f7-4e1e-4e6e-9fd3-f09291b11d4f tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Scanning host 36 c: 0, t: 0, l: 0) {{(pid=72382) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 15:28:40 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:28:40 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:28:40 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[d551512c-39c2-4338-98a9-f27c4704cc7c]: (4, ('0 0 0', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:28:40 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-7ea5e9f7-4e1e-4e6e-9fd3-f09291b11d4f tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Searching for a device in session 31 and hctl ('36', '0', '0', 0) yield: sde {{(pid=72382) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 15:28:40 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ea5e9f7-4e1e-4e6e-9fd3-f09291b11d4f tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DpcMQIwC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72382) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 15:28:40 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-7ea5e9f7-4e1e-4e6e-9fd3-f09291b11d4f tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.212s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 15:28:40 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ea5e9f7-4e1e-4e6e-9fd3-f09291b11d4f tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] <== connect_volume: return (213ms) {'type': 'block', 'scsi_wwn': '23465613331343433', 'path': '/dev/sde'} {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 15:28:40 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7ea5e9f7-4e1e-4e6e-9fd3-f09291b11d4f tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] [instance: 2f430d9a-9fbf-43cd-8c0d-e5dec162be71] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23465613331343433', 'path': '/dev/sde'} {{(pid=72382) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 15:28:40 user nova-compute[72382]: DEBUG nova.virt.libvirt.vif [None req-7ea5e9f7-4e1e-4e6e-9fd3-f09291b11d4f tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T15:26:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-193859421',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-193859421',id=28,image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-09T15:27:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='080d1ded4cd94e5083ee0b7e691b7363',ramdisk_id='',reservation_id='r-7lwplflb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1187177274',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T15:27:12Z,user_data=None,user_id='e71af7a4912147cd9fab070cb77b275c',uuid=2f430d9a-9fbf-43cd-8c0d-e5dec162be71,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d13c4d4e-9004-4d4b-999d-619564a98542", "address": "fa:16:3e:10:88:6e", "network": {"id": "d47e3749-fdff-4112-bd72-69ca584efe1f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-302967634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-302967634-network", "vif_mac": "fa:16:3e:10:88:6e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "080d1ded4cd94e5083ee0b7e691b7363", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd13c4d4e-90", "ovs_interfaceid": "d13c4d4e-9004-4d4b-999d-619564a98542", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72382) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 15:28:40 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-7ea5e9f7-4e1e-4e6e-9fd3-f09291b11d4f tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Converting VIF {"id": "d13c4d4e-9004-4d4b-999d-619564a98542", "address": "fa:16:3e:10:88:6e", "network": {"id": "d47e3749-fdff-4112-bd72-69ca584efe1f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-302967634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-302967634-network", "vif_mac": "fa:16:3e:10:88:6e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "080d1ded4cd94e5083ee0b7e691b7363", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd13c4d4e-90", "ovs_interfaceid": "d13c4d4e-9004-4d4b-999d-619564a98542", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 15:28:40 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-7ea5e9f7-4e1e-4e6e-9fd3-f09291b11d4f tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:10:88:6e,bridge_name='br-int',has_traffic_filtering=True,id=d13c4d4e-9004-4d4b-999d-619564a98542,network=Network(d47e3749-fdff-4112-bd72-69ca584efe1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd13c4d4e-90') {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 15:28:40 user nova-compute[72382]: DEBUG nova.objects.instance [None req-7ea5e9f7-4e1e-4e6e-9fd3-f09291b11d4f tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Lazy-loading 'pci_devices' on Instance uuid 2f430d9a-9fbf-43cd-8c0d-e5dec162be71 {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:28:40 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-7ea5e9f7-4e1e-4e6e-9fd3-f09291b11d4f tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] [instance: 2f430d9a-9fbf-43cd-8c0d-e5dec162be71] End _get_guest_xml xml=<domain type="kvm">
Aug 09 15:28:40 user nova-compute[72382]:   <uuid>2f430d9a-9fbf-43cd-8c0d-e5dec162be71</uuid>
Aug 09 15:28:40 user nova-compute[72382]:   <name>instance-0000001c</name>
Aug 09 15:28:40 user nova-compute[72382]:   <memory>524288</memory>
Aug 09 15:28:40 user nova-compute[72382]:   <vcpu>1</vcpu>
Aug 09 15:28:40 user nova-compute[72382]:   <metadata>
Aug 09 15:28:40 user nova-compute[72382]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 15:28:40 user nova-compute[72382]:       <nova:package version="0.0.0"/>
Aug 09 15:28:40 user nova-compute[72382]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-193859421</nova:name>
Aug 09 15:28:40 user nova-compute[72382]:       <nova:creationTime>2023-08-09 15:28:39</nova:creationTime>
Aug 09 15:28:40 user nova-compute[72382]:       <nova:flavor name="m1.tiny">
Aug 09 15:28:40 user nova-compute[72382]:         <nova:memory>512</nova:memory>
Aug 09 15:28:40 user nova-compute[72382]:         <nova:disk>1</nova:disk>
Aug 09 15:28:40 user nova-compute[72382]:         <nova:swap>0</nova:swap>
Aug 09 15:28:40 user nova-compute[72382]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 15:28:40 user nova-compute[72382]:         <nova:vcpus>1</nova:vcpus>
Aug 09 15:28:40 user nova-compute[72382]:       </nova:flavor>
Aug 09 15:28:40 user nova-compute[72382]:       <nova:owner>
Aug 09 15:28:40 user nova-compute[72382]:         <nova:user uuid="e71af7a4912147cd9fab070cb77b275c">tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member</nova:user>
Aug 09 15:28:40 user nova-compute[72382]:         <nova:project uuid="080d1ded4cd94e5083ee0b7e691b7363">tempest-ServerBootFromVolumeStableRescueTest-1187177274</nova:project>
Aug 09 15:28:40 user nova-compute[72382]:       </nova:owner>
Aug 09 15:28:40 user nova-compute[72382]:       <nova:root type="image" uuid="a79f2cea-eb27-4631-aaf3-05e7d9e411b4"/>
Aug 09 15:28:40 user nova-compute[72382]:       <nova:ports>
Aug 09 15:28:40 user nova-compute[72382]:         <nova:port uuid="d13c4d4e-9004-4d4b-999d-619564a98542">
Aug 09 15:28:40 user nova-compute[72382]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 09 15:28:40 user nova-compute[72382]:         </nova:port>
Aug 09 15:28:40 user nova-compute[72382]:       </nova:ports>
Aug 09 15:28:40 user nova-compute[72382]:     </nova:instance>
Aug 09 15:28:40 user nova-compute[72382]:   </metadata>
Aug 09 15:28:40 user nova-compute[72382]:   <sysinfo type="smbios">
Aug 09 15:28:40 user nova-compute[72382]:     <system>
Aug 09 15:28:40 user nova-compute[72382]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 15:28:40 user nova-compute[72382]:       <entry name="product">OpenStack Nova</entry>
Aug 09 15:28:40 user nova-compute[72382]:       <entry name="version">0.0.0</entry>
Aug 09 15:28:40 user nova-compute[72382]:       <entry name="serial">2f430d9a-9fbf-43cd-8c0d-e5dec162be71</entry>
Aug 09 15:28:40 user nova-compute[72382]:       <entry name="uuid">2f430d9a-9fbf-43cd-8c0d-e5dec162be71</entry>
Aug 09 15:28:40 user nova-compute[72382]:       <entry name="family">Virtual Machine</entry>
Aug 09 15:28:40 user nova-compute[72382]:     </system>
Aug 09 15:28:40 user nova-compute[72382]:   </sysinfo>
Aug 09 15:28:40 user nova-compute[72382]:   <os>
Aug 09 15:28:40 user nova-compute[72382]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 15:28:40 user nova-compute[72382]:     <smbios mode="sysinfo"/>
Aug 09 15:28:40 user nova-compute[72382]:   </os>
Aug 09 15:28:40 user nova-compute[72382]:   <features>
Aug 09 15:28:40 user nova-compute[72382]:     <acpi/>
Aug 09 15:28:40 user nova-compute[72382]:     <apic/>
Aug 09 15:28:40 user nova-compute[72382]:     <vmcoreinfo/>
Aug 09 15:28:40 user nova-compute[72382]:   </features>
Aug 09 15:28:40 user nova-compute[72382]:   <clock offset="utc">
Aug 09 15:28:40 user nova-compute[72382]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 15:28:40 user nova-compute[72382]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 15:28:40 user nova-compute[72382]:     <timer name="hpet" present="no"/>
Aug 09 15:28:40 user nova-compute[72382]:   </clock>
Aug 09 15:28:40 user nova-compute[72382]:   <cpu mode="custom" match="exact">
Aug 09 15:28:40 user nova-compute[72382]:     <model>Nehalem</model>
Aug 09 15:28:40 user nova-compute[72382]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 15:28:40 user nova-compute[72382]:   </cpu>
Aug 09 15:28:40 user nova-compute[72382]:   <devices>
Aug 09 15:28:40 user nova-compute[72382]:     <disk type="block" device="disk">
Aug 09 15:28:40 user nova-compute[72382]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 15:28:40 user nova-compute[72382]:       <source dev="/dev/sde"/>
Aug 09 15:28:40 user nova-compute[72382]:       <target dev="vda" bus="virtio"/>
Aug 09 15:28:40 user nova-compute[72382]:       <serial>25503c6e-bfc0-4008-846a-8cad783fc0fb</serial>
Aug 09 15:28:40 user nova-compute[72382]:     </disk>
Aug 09 15:28:40 user nova-compute[72382]:     <disk type="file" device="disk">
Aug 09 15:28:40 user nova-compute[72382]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 15:28:40 user nova-compute[72382]:       <source file="/opt/stack/data/nova/instances/2f430d9a-9fbf-43cd-8c0d-e5dec162be71/disk.rescue"/>
Aug 09 15:28:40 user nova-compute[72382]:       <target dev="vdb" bus="virtio"/>
Aug 09 15:28:40 user nova-compute[72382]:       <boot order="1"/>
Aug 09 15:28:40 user nova-compute[72382]:     </disk>
Aug 09 15:28:40 user nova-compute[72382]:     <interface type="ethernet">
Aug 09 15:28:40 user nova-compute[72382]:       <mac address="fa:16:3e:10:88:6e"/>
Aug 09 15:28:40 user nova-compute[72382]:       <model type="virtio"/>
Aug 09 15:28:40 user nova-compute[72382]:       <mtu size="1442"/>
Aug 09 15:28:40 user nova-compute[72382]:       <target dev="tapd13c4d4e-90"/>
Aug 09 15:28:40 user nova-compute[72382]:     </interface>
Aug 09 15:28:40 user nova-compute[72382]:     <serial type="pty">
Aug 09 15:28:40 user nova-compute[72382]:       <log file="/opt/stack/data/nova/instances/2f430d9a-9fbf-43cd-8c0d-e5dec162be71/console.log" append="off"/>
Aug 09 15:28:40 user nova-compute[72382]:     </serial>
Aug 09 15:28:40 user nova-compute[72382]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 15:28:40 user nova-compute[72382]:     <video>
Aug 09 15:28:40 user nova-compute[72382]:       <model type="virtio"/>
Aug 09 15:28:40 user nova-compute[72382]:     </video>
Aug 09 15:28:40 user nova-compute[72382]:     <rng model="virtio">
Aug 09 15:28:40 user nova-compute[72382]:       <backend model="random">/dev/urandom</backend>
Aug 09 15:28:40 user nova-compute[72382]:     </rng>
Aug 09 15:28:40 user nova-compute[72382]:     <controller type="usb" index="0" model="none"/>
Aug 09 15:28:40 user nova-compute[72382]:     <memballoon model="virtio">
Aug 09 15:28:40 user nova-compute[72382]:       <stats period="10"/>
Aug 09 15:28:40 user nova-compute[72382]:     </memballoon>
Aug 09 15:28:40 user nova-compute[72382]:   </devices>
Aug 09 15:28:40 user nova-compute[72382]: </domain>
Aug 09 15:28:40 user nova-compute[72382]:  {{(pid=72382) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 15:28:40 user nova-compute[72382]: INFO nova.virt.libvirt.driver [-] [instance: 2f430d9a-9fbf-43cd-8c0d-e5dec162be71] Instance destroyed successfully.
Aug 09 15:28:40 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-7ea5e9f7-4e1e-4e6e-9fd3-f09291b11d4f tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] No BDM found with device name vda, not building metadata. {{(pid=72382) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 15:28:40 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-7ea5e9f7-4e1e-4e6e-9fd3-f09291b11d4f tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72382) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 15:28:40 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-7ea5e9f7-4e1e-4e6e-9fd3-f09291b11d4f tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] No VIF found with MAC fa:16:3e:10:88:6e, not building metadata {{(pid=72382) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 15:28:40 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-fd64f0fb-e81f-47ee-aac6-8db3bb3fc570 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] Acquiring lock "6296ba5d-bcc6-405a-a635-0e9aa6114f7b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:28:40 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-fd64f0fb-e81f-47ee-aac6-8db3bb3fc570 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] Lock "6296ba5d-bcc6-405a-a635-0e9aa6114f7b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:28:40 user nova-compute[72382]: INFO nova.compute.manager [None req-fd64f0fb-e81f-47ee-aac6-8db3bb3fc570 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] [instance: 6296ba5d-bcc6-405a-a635-0e9aa6114f7b] Detaching volume e4e37d7b-3804-4117-840a-7e8ba26ea512
Aug 09 15:28:41 user nova-compute[72382]: INFO nova.virt.block_device [None req-fd64f0fb-e81f-47ee-aac6-8db3bb3fc570 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] [instance: 6296ba5d-bcc6-405a-a635-0e9aa6114f7b] Attempting to driver detach volume e4e37d7b-3804-4117-840a-7e8ba26ea512 from mountpoint /dev/vdb
Aug 09 15:28:41 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-fd64f0fb-e81f-47ee-aac6-8db3bb3fc570 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] Attempting to detach device vdb from instance 6296ba5d-bcc6-405a-a635-0e9aa6114f7b from the persistent domain config. {{(pid=72382) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 15:28:41 user nova-compute[72382]: DEBUG nova.virt.libvirt.guest [None req-fd64f0fb-e81f-47ee-aac6-8db3bb3fc570 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 15:28:41 user nova-compute[72382]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 15:28:41 user nova-compute[72382]:   <source dev="/dev/sdh"/>
Aug 09 15:28:41 user nova-compute[72382]:   <target dev="vdb" bus="virtio"/>
Aug 09 15:28:41 user nova-compute[72382]:   <serial>e4e37d7b-3804-4117-840a-7e8ba26ea512</serial>
Aug 09 15:28:41 user nova-compute[72382]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 15:28:41 user nova-compute[72382]: </disk>
Aug 09 15:28:41 user nova-compute[72382]:  {{(pid=72382) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 15:28:41 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-fd64f0fb-e81f-47ee-aac6-8db3bb3fc570 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] Successfully detached device vdb from instance 6296ba5d-bcc6-405a-a635-0e9aa6114f7b from the persistent domain config.
Aug 09 15:28:41 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-fd64f0fb-e81f-47ee-aac6-8db3bb3fc570 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 6296ba5d-bcc6-405a-a635-0e9aa6114f7b from the live domain config. {{(pid=72382) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 15:28:41 user nova-compute[72382]: DEBUG nova.virt.libvirt.guest [None req-fd64f0fb-e81f-47ee-aac6-8db3bb3fc570 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 15:28:41 user nova-compute[72382]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 15:28:41 user nova-compute[72382]:   <source dev="/dev/sdh"/>
Aug 09 15:28:41 user nova-compute[72382]:   <target dev="vdb" bus="virtio"/>
Aug 09 15:28:41 user nova-compute[72382]:   <serial>e4e37d7b-3804-4117-840a-7e8ba26ea512</serial>
Aug 09 15:28:41 user nova-compute[72382]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 15:28:41 user nova-compute[72382]: </disk>
Aug 09 15:28:41 user nova-compute[72382]:  {{(pid=72382) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 15:28:41 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Received event <DeviceRemovedEvent: 1691594921.693148, 6296ba5d-bcc6-405a-a635-0e9aa6114f7b => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72382) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 15:28:41 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-fd64f0fb-e81f-47ee-aac6-8db3bb3fc570 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 6296ba5d-bcc6-405a-a635-0e9aa6114f7b {{(pid=72382) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 15:28:41 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-fd64f0fb-e81f-47ee-aac6-8db3bb3fc570 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] Successfully detached device vdb from instance 6296ba5d-bcc6-405a-a635-0e9aa6114f7b from the live domain config.
Aug 09 15:28:41 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fd64f0fb-e81f-47ee-aac6-8db3bb3fc570 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] [instance: 6296ba5d-bcc6-405a-a635-0e9aa6114f7b] calling os-brick to detach iSCSI Volume {{(pid=72382) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 15:28:41 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd64f0fb-e81f-47ee-aac6-8db3bb3fc570 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2a0c768340>, {'target_iqns': ['iqn.2010-10.org.openstack:e4e37d7b-3804-4117-840a-7e8ba26ea512'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zMyvQSZJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 15:28:41 user nova-compute[72382]: WARNING os_brick.initiator.connectors.base [None req-fd64f0fb-e81f-47ee-aac6-8db3bb3fc570 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 15:28:41 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-fd64f0fb-e81f-47ee-aac6-8db3bb3fc570 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 15:28:41 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-fd64f0fb-e81f-47ee-aac6-8db3bb3fc570 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 15:28:41 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd64f0fb-e81f-47ee-aac6-8db3bb3fc570 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e4e37d7b-3804-4117-840a-7e8ba26ea512', 0)] {{(pid=72382) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 15:28:41 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:28:41 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:28:41 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed79f484-03f1-4b68-a24b-efaa62fc0114]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:25503c6e-bfc0-4008-846a-8cad783fc0fb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:37c53941-47c4-4d6d-8826-d0833f90643e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9572706e-c54c-42c2-9cf0-2690cdf4cca2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bd90521a-f3b5-485c-9fb9-61ab37267f3a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e4e37d7b-3804-4117-840a-7e8ba26ea512\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e62d4416-be8c-4327-9a51-0cc509109c53\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:28:41 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:28:41 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:28:41 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[a184dd0f-32e4-4ebc-bf79-6b58eddecfcb]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9572706e-c54c-42c2-9cf0-2690cdf4cca2 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd90521a-f3b5-485c-9fb9-61ab37267f3a (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25503c6e-bfc0-4008-846a-8cad783fc0fb (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e62d4416-be8c-4327-9a51-0cc509109c53 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37c53941-47c4-4d6d-8826-d0833f90643e (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4e37d7b-3804-4117-840a-7e8ba26ea512 (non-flash)\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:28:41 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd64f0fb-e81f-47ee-aac6-8db3bb3fc570 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)
Aug 09 15:28:41 user nova-compute[72382]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9572706e-c54c-42c2-9cf0-2690cdf4cca2 (non-flash)
Aug 09 15:28:41 user nova-compute[72382]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd90521a-f3b5-485c-9fb9-61ab37267f3a (non-flash)
Aug 09 15:28:41 user nova-compute[72382]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25503c6e-bfc0-4008-846a-8cad783fc0fb (non-flash)
Aug 09 15:28:41 user nova-compute[72382]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e62d4416-be8c-4327-9a51-0cc509109c53 (non-flash)
Aug 09 15:28:41 user nova-compute[72382]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37c53941-47c4-4d6d-8826-d0833f90643e (non-flash)
Aug 09 15:28:41 user nova-compute[72382]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4e37d7b-3804-4117-840a-7e8ba26ea512 (non-flash)
Aug 09 15:28:41 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 15:28:41 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd64f0fb-e81f-47ee-aac6-8db3bb3fc570 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)
Aug 09 15:28:41 user nova-compute[72382]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9572706e-c54c-42c2-9cf0-2690cdf4cca2 (non-flash)
Aug 09 15:28:41 user nova-compute[72382]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd90521a-f3b5-485c-9fb9-61ab37267f3a (non-flash)
Aug 09 15:28:41 user nova-compute[72382]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25503c6e-bfc0-4008-846a-8cad783fc0fb (non-flash)
Aug 09 15:28:41 user nova-compute[72382]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e62d4416-be8c-4327-9a51-0cc509109c53 (non-flash)
Aug 09 15:28:41 user nova-compute[72382]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37c53941-47c4-4d6d-8826-d0833f90643e (non-flash)
Aug 09 15:28:41 user nova-compute[72382]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4e37d7b-3804-4117-840a-7e8ba26ea512 (non-flash)
Aug 09 15:28:41 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 15:28:41 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd64f0fb-e81f-47ee-aac6-8db3bb3fc570 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2a0c736050>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e4e37d7b-3804-4117-840a-7e8ba26ea512'): ({'sdh'}, set())}) {{(pid=72382) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 15:28:41 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-fd64f0fb-e81f-47ee-aac6-8db3bb3fc570 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] Removing single pathed devices sdh {{(pid=72382) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 15:28:41 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:28:41 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:28:41 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[524651c1-b01b-44a1-b74f-b25c106927a0]: (4, ('path checker states:\nup                  6\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:28:41 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:28:41 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.022s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:28:41 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5a6778f-faf5-49c2-883f-a8ee07c4cc68]: (4, ('ok\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:28:41 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-fd64f0fb-e81f-47ee-aac6-8db3bb3fc570 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] Flushing IO for device /dev/sdh {{(pid=72382) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 15:28:41 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:28:41 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.015s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:28:41 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc988b72-fece-49b0-9fc6-5ff8347e941b]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:28:41 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-fd64f0fb-e81f-47ee-aac6-8db3bb3fc570 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=72382) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 15:28:41 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:28:41 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.032s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:28:41 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0f6d120-f152-4e69-9880-41ceb07cf1ba]: (4, ('1', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:28:41 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-fd64f0fb-e81f-47ee-aac6-8db3bb3fc570 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=72382) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 15:28:41 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-fd64f0fb-e81f-47ee-aac6-8db3bb3fc570 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] SCSI volumes sdh have been removed. {{(pid=72382) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 15:28:41 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd64f0fb-e81f-47ee-aac6-8db3bb3fc570 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e4e37d7b-3804-4117-840a-7e8ba26ea512')] {{(pid=72382) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 15:28:41 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4e37d7b-3804-4117-840a-7e8ba26ea512 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:28:41 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4e37d7b-3804-4117-840a-7e8ba26ea512 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:28:41 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f9c6645-2855-40cc-89d6-e006174a77a9]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:28:41 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd64f0fb-e81f-47ee-aac6-8db3bb3fc570 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:28:41 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4e37d7b-3804-4117-840a-7e8ba26ea512 -p 172.16.0.220:3260 --logout {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:28:41 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4e37d7b-3804-4117-840a-7e8ba26ea512 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:28:41 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b785812-e8f5-4ea7-8b6b-e1037d98f1c6]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:e4e37d7b-3804-4117-840a-7e8ba26ea512, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:e4e37d7b-3804-4117-840a-7e8ba26ea512, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:28:41 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd64f0fb-e81f-47ee-aac6-8db3bb3fc570 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:e4e37d7b-3804-4117-840a-7e8ba26ea512, portal: 172.16.0.220,3260]
Aug 09 15:28:41 user nova-compute[72382]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:e4e37d7b-3804-4117-840a-7e8ba26ea512, portal: 172.16.0.220,3260] successful.
Aug 09 15:28:41 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:28:41 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4e37d7b-3804-4117-840a-7e8ba26ea512 -p 172.16.0.220:3260 --op delete {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:28:42 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4e37d7b-3804-4117-840a-7e8ba26ea512 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.039s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:28:42 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[233fa2ed-dbdb-4f4b-a530-0bd0cbf49317]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:28:42 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd64f0fb-e81f-47ee-aac6-8db3bb3fc570 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:28:42 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-fd64f0fb-e81f-47ee-aac6-8db3bb3fc570 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.318s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 15:28:42 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd64f0fb-e81f-47ee-aac6-8db3bb3fc570 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] <== disconnect_volume: return (320ms) None {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 15:28:42 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fd64f0fb-e81f-47ee-aac6-8db3bb3fc570 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] [instance: 6296ba5d-bcc6-405a-a635-0e9aa6114f7b] Disconnected iSCSI Volume {{(pid=72382) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 15:28:42 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:28:42 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:28:42 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:28:42 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:28:42 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:28:42 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-af0dadf1-e9d8-4e06-90c5-df7d4f3fc8c5 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Acquiring lock "61976531-76ae-4a1c-8950-0af784be376e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:28:42 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-af0dadf1-e9d8-4e06-90c5-df7d4f3fc8c5 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Lock "61976531-76ae-4a1c-8950-0af784be376e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:28:42 user nova-compute[72382]: INFO nova.compute.manager [None req-af0dadf1-e9d8-4e06-90c5-df7d4f3fc8c5 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] [instance: 61976531-76ae-4a1c-8950-0af784be376e] Detaching volume 9572706e-c54c-42c2-9cf0-2690cdf4cca2
Aug 09 15:28:42 user nova-compute[72382]: INFO nova.virt.block_device [None req-af0dadf1-e9d8-4e06-90c5-df7d4f3fc8c5 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] [instance: 61976531-76ae-4a1c-8950-0af784be376e] Attempting to driver detach volume 9572706e-c54c-42c2-9cf0-2690cdf4cca2 from mountpoint /dev/vdb
Aug 09 15:28:42 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-af0dadf1-e9d8-4e06-90c5-df7d4f3fc8c5 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Attempting to detach device vdb from instance 61976531-76ae-4a1c-8950-0af784be376e from the persistent domain config. {{(pid=72382) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 15:28:42 user nova-compute[72382]: DEBUG nova.virt.libvirt.guest [None req-af0dadf1-e9d8-4e06-90c5-df7d4f3fc8c5 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 15:28:42 user nova-compute[72382]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 15:28:42 user nova-compute[72382]:   <source dev="/dev/sdb"/>
Aug 09 15:28:42 user nova-compute[72382]:   <target dev="vdb" bus="virtio"/>
Aug 09 15:28:42 user nova-compute[72382]:   <serial>9572706e-c54c-42c2-9cf0-2690cdf4cca2</serial>
Aug 09 15:28:42 user nova-compute[72382]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 15:28:42 user nova-compute[72382]: </disk>
Aug 09 15:28:42 user nova-compute[72382]:  {{(pid=72382) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 15:28:42 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-af0dadf1-e9d8-4e06-90c5-df7d4f3fc8c5 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Successfully detached device vdb from instance 61976531-76ae-4a1c-8950-0af784be376e from the persistent domain config.
Aug 09 15:28:42 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-af0dadf1-e9d8-4e06-90c5-df7d4f3fc8c5 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 61976531-76ae-4a1c-8950-0af784be376e from the live domain config. {{(pid=72382) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 15:28:42 user nova-compute[72382]: DEBUG nova.virt.libvirt.guest [None req-af0dadf1-e9d8-4e06-90c5-df7d4f3fc8c5 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 15:28:42 user nova-compute[72382]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 15:28:42 user nova-compute[72382]:   <source dev="/dev/sdb"/>
Aug 09 15:28:42 user nova-compute[72382]:   <target dev="vdb" bus="virtio"/>
Aug 09 15:28:42 user nova-compute[72382]:   <serial>9572706e-c54c-42c2-9cf0-2690cdf4cca2</serial>
Aug 09 15:28:42 user nova-compute[72382]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 15:28:42 user nova-compute[72382]: </disk>
Aug 09 15:28:42 user nova-compute[72382]:  {{(pid=72382) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 15:28:42 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:28:42 user nova-compute[72382]: DEBUG nova.compute.manager [req-02c659a6-a513-4c61-a5de-eb9c4c3c6bf7 req-258d30c5-9dba-4486-931d-b8740a4439fa service nova] [instance: 2f430d9a-9fbf-43cd-8c0d-e5dec162be71] Received event network-vif-plugged-d13c4d4e-9004-4d4b-999d-619564a98542 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:28:42 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-02c659a6-a513-4c61-a5de-eb9c4c3c6bf7 req-258d30c5-9dba-4486-931d-b8740a4439fa service nova] Acquiring lock "2f430d9a-9fbf-43cd-8c0d-e5dec162be71-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:28:42 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-02c659a6-a513-4c61-a5de-eb9c4c3c6bf7 req-258d30c5-9dba-4486-931d-b8740a4439fa service nova] Lock "2f430d9a-9fbf-43cd-8c0d-e5dec162be71-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:28:42 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-02c659a6-a513-4c61-a5de-eb9c4c3c6bf7 req-258d30c5-9dba-4486-931d-b8740a4439fa service nova] Lock "2f430d9a-9fbf-43cd-8c0d-e5dec162be71-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:28:42 user nova-compute[72382]: DEBUG nova.compute.manager [req-02c659a6-a513-4c61-a5de-eb9c4c3c6bf7 req-258d30c5-9dba-4486-931d-b8740a4439fa service nova] [instance: 2f430d9a-9fbf-43cd-8c0d-e5dec162be71] No waiting events found dispatching network-vif-plugged-d13c4d4e-9004-4d4b-999d-619564a98542 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:28:42 user nova-compute[72382]: WARNING nova.compute.manager [req-02c659a6-a513-4c61-a5de-eb9c4c3c6bf7 req-258d30c5-9dba-4486-931d-b8740a4439fa service nova] [instance: 2f430d9a-9fbf-43cd-8c0d-e5dec162be71] Received unexpected event network-vif-plugged-d13c4d4e-9004-4d4b-999d-619564a98542 for instance with vm_state active and task_state rescuing.
Aug 09 15:28:42 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:28:42 user nova-compute[72382]: DEBUG nova.objects.instance [None req-fd64f0fb-e81f-47ee-aac6-8db3bb3fc570 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] Lazy-loading 'flavor' on Instance uuid 6296ba5d-bcc6-405a-a635-0e9aa6114f7b {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:28:42 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Received event <DeviceRemovedEvent: 1691594922.97804, 61976531-76ae-4a1c-8950-0af784be376e => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72382) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 15:28:42 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-af0dadf1-e9d8-4e06-90c5-df7d4f3fc8c5 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 61976531-76ae-4a1c-8950-0af784be376e {{(pid=72382) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 15:28:42 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-af0dadf1-e9d8-4e06-90c5-df7d4f3fc8c5 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Successfully detached device vdb from instance 61976531-76ae-4a1c-8950-0af784be376e from the live domain config.
Aug 09 15:28:42 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-af0dadf1-e9d8-4e06-90c5-df7d4f3fc8c5 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] [instance: 61976531-76ae-4a1c-8950-0af784be376e] calling os-brick to detach iSCSI Volume {{(pid=72382) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 15:28:42 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-af0dadf1-e9d8-4e06-90c5-df7d4f3fc8c5 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2a0c768340>, {'target_iqns': ['iqn.2010-10.org.openstack:9572706e-c54c-42c2-9cf0-2690cdf4cca2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XlKrmHQz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 15:28:42 user nova-compute[72382]: WARNING os_brick.initiator.connectors.base [None req-af0dadf1-e9d8-4e06-90c5-df7d4f3fc8c5 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 15:28:42 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-af0dadf1-e9d8-4e06-90c5-df7d4f3fc8c5 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 15:28:42 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-af0dadf1-e9d8-4e06-90c5-df7d4f3fc8c5 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 15:28:42 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-af0dadf1-e9d8-4e06-90c5-df7d4f3fc8c5 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9572706e-c54c-42c2-9cf0-2690cdf4cca2', 0)] {{(pid=72382) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 15:28:43 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:28:43 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:28:43 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9eac85e-f099-465f-af56-27f9a3aca872]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:25503c6e-bfc0-4008-846a-8cad783fc0fb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:37c53941-47c4-4d6d-8826-d0833f90643e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9572706e-c54c-42c2-9cf0-2690cdf4cca2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bd90521a-f3b5-485c-9fb9-61ab37267f3a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e62d4416-be8c-4327-9a51-0cc509109c53\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:28:43 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:28:43 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-fd64f0fb-e81f-47ee-aac6-8db3bb3fc570 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] Lock "6296ba5d-bcc6-405a-a635-0e9aa6114f7b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.091s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:28:43 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:28:43 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a5c04b7-e992-4ed8-868c-4b8e0f02d1af]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9572706e-c54c-42c2-9cf0-2690cdf4cca2 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd90521a-f3b5-485c-9fb9-61ab37267f3a (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25503c6e-bfc0-4008-846a-8cad783fc0fb (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e62d4416-be8c-4327-9a51-0cc509109c53 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37c53941-47c4-4d6d-8826-d0833f90643e (non-flash)\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:28:43 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-af0dadf1-e9d8-4e06-90c5-df7d4f3fc8c5 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)
Aug 09 15:28:43 user nova-compute[72382]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9572706e-c54c-42c2-9cf0-2690cdf4cca2 (non-flash)
Aug 09 15:28:43 user nova-compute[72382]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd90521a-f3b5-485c-9fb9-61ab37267f3a (non-flash)
Aug 09 15:28:43 user nova-compute[72382]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25503c6e-bfc0-4008-846a-8cad783fc0fb (non-flash)
Aug 09 15:28:43 user nova-compute[72382]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e62d4416-be8c-4327-9a51-0cc509109c53 (non-flash)
Aug 09 15:28:43 user nova-compute[72382]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37c53941-47c4-4d6d-8826-d0833f90643e (non-flash)
Aug 09 15:28:43 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 15:28:43 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-af0dadf1-e9d8-4e06-90c5-df7d4f3fc8c5 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)
Aug 09 15:28:43 user nova-compute[72382]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9572706e-c54c-42c2-9cf0-2690cdf4cca2 (non-flash)
Aug 09 15:28:43 user nova-compute[72382]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd90521a-f3b5-485c-9fb9-61ab37267f3a (non-flash)
Aug 09 15:28:43 user nova-compute[72382]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25503c6e-bfc0-4008-846a-8cad783fc0fb (non-flash)
Aug 09 15:28:43 user nova-compute[72382]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e62d4416-be8c-4327-9a51-0cc509109c53 (non-flash)
Aug 09 15:28:43 user nova-compute[72382]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37c53941-47c4-4d6d-8826-d0833f90643e (non-flash)
Aug 09 15:28:43 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 15:28:43 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-af0dadf1-e9d8-4e06-90c5-df7d4f3fc8c5 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2a0c759fc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9572706e-c54c-42c2-9cf0-2690cdf4cca2'): ({'sdb'}, set())}) {{(pid=72382) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 15:28:43 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-af0dadf1-e9d8-4e06-90c5-df7d4f3fc8c5 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Removing single pathed devices sdb {{(pid=72382) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 15:28:43 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:28:43 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:28:43 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bcde095-ca4e-4a9a-8af5-481f6e11fd40]: (4, ('path checker states:\nup                  5\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:28:43 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:28:43 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:28:43 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[7344615a-b0d4-4504-8930-918866e6925e]: (4, ('ok\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:28:43 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-af0dadf1-e9d8-4e06-90c5-df7d4f3fc8c5 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Flushing IO for device /dev/sdb {{(pid=72382) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 15:28:43 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:28:43 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:28:43 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce334f4d-2f02-4fb8-8c41-d24d4f0ef246]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:28:43 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-af0dadf1-e9d8-4e06-90c5-df7d4f3fc8c5 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72382) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 15:28:43 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:28:43 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.142s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:28:43 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[47271073-1ba3-4f55-a06a-7f71ad6c8517]: (4, ('1', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:28:43 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-af0dadf1-e9d8-4e06-90c5-df7d4f3fc8c5 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72382) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 15:28:43 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-af0dadf1-e9d8-4e06-90c5-df7d4f3fc8c5 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] SCSI volumes sdb have been removed. {{(pid=72382) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 15:28:43 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-af0dadf1-e9d8-4e06-90c5-df7d4f3fc8c5 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9572706e-c54c-42c2-9cf0-2690cdf4cca2')] {{(pid=72382) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 15:28:43 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9572706e-c54c-42c2-9cf0-2690cdf4cca2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:28:43 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9572706e-c54c-42c2-9cf0-2690cdf4cca2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:28:43 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[3044fd17-c5ad-41a0-98c9-938ede37cdd7]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:28:43 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-af0dadf1-e9d8-4e06-90c5-df7d4f3fc8c5 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:28:43 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9572706e-c54c-42c2-9cf0-2690cdf4cca2 -p 172.16.0.220:3260 --logout {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:28:43 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9572706e-c54c-42c2-9cf0-2690cdf4cca2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:28:43 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d331836-05b2-4ff2-a437-4a04daacf70a]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:9572706e-c54c-42c2-9cf0-2690cdf4cca2, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:9572706e-c54c-42c2-9cf0-2690cdf4cca2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:28:43 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-af0dadf1-e9d8-4e06-90c5-df7d4f3fc8c5 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:9572706e-c54c-42c2-9cf0-2690cdf4cca2, portal: 172.16.0.220,3260]
Aug 09 15:28:43 user nova-compute[72382]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:9572706e-c54c-42c2-9cf0-2690cdf4cca2, portal: 172.16.0.220,3260] successful.
Aug 09 15:28:43 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:28:43 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9572706e-c54c-42c2-9cf0-2690cdf4cca2 -p 172.16.0.220:3260 --op delete {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:28:43 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9572706e-c54c-42c2-9cf0-2690cdf4cca2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:28:43 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5e295c1-abba-4842-8391-f759050d120f]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:28:43 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-af0dadf1-e9d8-4e06-90c5-df7d4f3fc8c5 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:28:43 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-af0dadf1-e9d8-4e06-90c5-df7d4f3fc8c5 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.411s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 15:28:43 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-af0dadf1-e9d8-4e06-90c5-df7d4f3fc8c5 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] <== disconnect_volume: return (414ms) None {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 15:28:43 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-af0dadf1-e9d8-4e06-90c5-df7d4f3fc8c5 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] [instance: 61976531-76ae-4a1c-8950-0af784be376e] Disconnected iSCSI Volume {{(pid=72382) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 15:28:43 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:28:44 user nova-compute[72382]: DEBUG nova.objects.instance [None req-af0dadf1-e9d8-4e06-90c5-df7d4f3fc8c5 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Lazy-loading 'flavor' on Instance uuid 61976531-76ae-4a1c-8950-0af784be376e {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:28:44 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-af0dadf1-e9d8-4e06-90c5-df7d4f3fc8c5 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Lock "61976531-76ae-4a1c-8950-0af784be376e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.755s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:28:44 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:28:44 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Removed pending event for 2f430d9a-9fbf-43cd-8c0d-e5dec162be71 due to event {{(pid=72382) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 09 15:28:44 user nova-compute[72382]: DEBUG nova.virt.driver [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Emitting event <LifecycleEvent: 1691594924.530535, 2f430d9a-9fbf-43cd-8c0d-e5dec162be71 => Resumed> {{(pid=72382) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 15:28:44 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 2f430d9a-9fbf-43cd-8c0d-e5dec162be71] VM Resumed (Lifecycle Event)
Aug 09 15:28:44 user nova-compute[72382]: DEBUG nova.compute.manager [None req-7ea5e9f7-4e1e-4e6e-9fd3-f09291b11d4f tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] [instance: 2f430d9a-9fbf-43cd-8c0d-e5dec162be71] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:28:44 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 2f430d9a-9fbf-43cd-8c0d-e5dec162be71] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:28:44 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 2f430d9a-9fbf-43cd-8c0d-e5dec162be71] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72382) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 15:28:44 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 2f430d9a-9fbf-43cd-8c0d-e5dec162be71] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 09 15:28:44 user nova-compute[72382]: DEBUG nova.virt.driver [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Emitting event <LifecycleEvent: 1691594924.531867, 2f430d9a-9fbf-43cd-8c0d-e5dec162be71 => Started> {{(pid=72382) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 15:28:44 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 2f430d9a-9fbf-43cd-8c0d-e5dec162be71] VM Started (Lifecycle Event)
Aug 09 15:28:44 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 2f430d9a-9fbf-43cd-8c0d-e5dec162be71] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:28:44 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 2f430d9a-9fbf-43cd-8c0d-e5dec162be71] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72382) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 15:28:44 user nova-compute[72382]: DEBUG nova.compute.manager [req-acba94da-2ec0-4647-9d57-9bf43c372325 req-77a323ce-39e4-4978-84f2-064be857deab service nova] [instance: 2f430d9a-9fbf-43cd-8c0d-e5dec162be71] Received event network-vif-plugged-d13c4d4e-9004-4d4b-999d-619564a98542 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:28:44 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-acba94da-2ec0-4647-9d57-9bf43c372325 req-77a323ce-39e4-4978-84f2-064be857deab service nova] Acquiring lock "2f430d9a-9fbf-43cd-8c0d-e5dec162be71-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:28:44 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-acba94da-2ec0-4647-9d57-9bf43c372325 req-77a323ce-39e4-4978-84f2-064be857deab service nova] Lock "2f430d9a-9fbf-43cd-8c0d-e5dec162be71-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:28:44 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-acba94da-2ec0-4647-9d57-9bf43c372325 req-77a323ce-39e4-4978-84f2-064be857deab service nova] Lock "2f430d9a-9fbf-43cd-8c0d-e5dec162be71-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:28:44 user nova-compute[72382]: DEBUG nova.compute.manager [req-acba94da-2ec0-4647-9d57-9bf43c372325 req-77a323ce-39e4-4978-84f2-064be857deab service nova] [instance: 2f430d9a-9fbf-43cd-8c0d-e5dec162be71] No waiting events found dispatching network-vif-plugged-d13c4d4e-9004-4d4b-999d-619564a98542 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:28:44 user nova-compute[72382]: WARNING nova.compute.manager [req-acba94da-2ec0-4647-9d57-9bf43c372325 req-77a323ce-39e4-4978-84f2-064be857deab service nova] [instance: 2f430d9a-9fbf-43cd-8c0d-e5dec162be71] Received unexpected event network-vif-plugged-d13c4d4e-9004-4d4b-999d-619564a98542 for instance with vm_state rescued and task_state None.
Aug 09 15:28:48 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:28:49 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:28:49 user nova-compute[72382]: DEBUG nova.compute.manager [req-df21d463-f275-40f9-ad10-aed8bf74cebd req-2cc3febc-8ffd-4e59-b0ef-b40a77709bc8 service nova] [instance: e0adbec9-eb22-4147-8c46-df7d02879f37] Received event network-changed-ae457c5d-81eb-466b-beb7-d9a3b3c11d59 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:28:49 user nova-compute[72382]: DEBUG nova.compute.manager [req-df21d463-f275-40f9-ad10-aed8bf74cebd req-2cc3febc-8ffd-4e59-b0ef-b40a77709bc8 service nova] [instance: e0adbec9-eb22-4147-8c46-df7d02879f37] Refreshing instance network info cache due to event network-changed-ae457c5d-81eb-466b-beb7-d9a3b3c11d59. {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 15:28:49 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-df21d463-f275-40f9-ad10-aed8bf74cebd req-2cc3febc-8ffd-4e59-b0ef-b40a77709bc8 service nova] Acquiring lock "refresh_cache-e0adbec9-eb22-4147-8c46-df7d02879f37" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 15:28:49 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-df21d463-f275-40f9-ad10-aed8bf74cebd req-2cc3febc-8ffd-4e59-b0ef-b40a77709bc8 service nova] Acquired lock "refresh_cache-e0adbec9-eb22-4147-8c46-df7d02879f37" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 15:28:49 user nova-compute[72382]: DEBUG nova.network.neutron [req-df21d463-f275-40f9-ad10-aed8bf74cebd req-2cc3febc-8ffd-4e59-b0ef-b40a77709bc8 service nova] [instance: e0adbec9-eb22-4147-8c46-df7d02879f37] Refreshing network info cache for port ae457c5d-81eb-466b-beb7-d9a3b3c11d59 {{(pid=72382) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 15:28:50 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-024e63d1-aa7d-4ab6-8821-34ea3440afb8 tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] Acquiring lock "e0adbec9-eb22-4147-8c46-df7d02879f37" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:28:50 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-024e63d1-aa7d-4ab6-8821-34ea3440afb8 tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] Lock "e0adbec9-eb22-4147-8c46-df7d02879f37" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:28:50 user nova-compute[72382]: DEBUG nova.objects.instance [None req-024e63d1-aa7d-4ab6-8821-34ea3440afb8 tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] Lazy-loading 'flavor' on Instance uuid e0adbec9-eb22-4147-8c46-df7d02879f37 {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:28:50 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-024e63d1-aa7d-4ab6-8821-34ea3440afb8 tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] [instance: e0adbec9-eb22-4147-8c46-df7d02879f37] Ignoring supplied device name: /dev/vdb
Aug 09 15:28:50 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-024e63d1-aa7d-4ab6-8821-34ea3440afb8 tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] Lock "e0adbec9-eb22-4147-8c46-df7d02879f37" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.078s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:28:50 user nova-compute[72382]: DEBUG nova.network.neutron [req-df21d463-f275-40f9-ad10-aed8bf74cebd req-2cc3febc-8ffd-4e59-b0ef-b40a77709bc8 service nova] [instance: e0adbec9-eb22-4147-8c46-df7d02879f37] Updated VIF entry in instance network info cache for port ae457c5d-81eb-466b-beb7-d9a3b3c11d59. {{(pid=72382) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 15:28:50 user nova-compute[72382]: DEBUG nova.network.neutron [req-df21d463-f275-40f9-ad10-aed8bf74cebd req-2cc3febc-8ffd-4e59-b0ef-b40a77709bc8 service nova] [instance: e0adbec9-eb22-4147-8c46-df7d02879f37] Updating instance_info_cache with network_info: [{"id": "ae457c5d-81eb-466b-beb7-d9a3b3c11d59", "address": "fa:16:3e:35:bc:34", "network": {"id": "1b9920a2-9613-4741-a0c0-72172380b365", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-455407214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9949fc5e9167457d8c7a455350936255", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae457c5d-81", "ovs_interfaceid": "ae457c5d-81eb-466b-beb7-d9a3b3c11d59", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:28:50 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-024e63d1-aa7d-4ab6-8821-34ea3440afb8 tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] Acquiring lock "e0adbec9-eb22-4147-8c46-df7d02879f37" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:28:50 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-024e63d1-aa7d-4ab6-8821-34ea3440afb8 tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] Lock "e0adbec9-eb22-4147-8c46-df7d02879f37" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:28:50 user nova-compute[72382]: INFO nova.compute.manager [None req-024e63d1-aa7d-4ab6-8821-34ea3440afb8 tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] [instance: e0adbec9-eb22-4147-8c46-df7d02879f37] Attaching volume 9fb38a17-5c70-4b9b-909a-614a81e5b75b to /dev/vdb
Aug 09 15:28:50 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-df21d463-f275-40f9-ad10-aed8bf74cebd req-2cc3febc-8ffd-4e59-b0ef-b40a77709bc8 service nova] Releasing lock "refresh_cache-e0adbec9-eb22-4147-8c46-df7d02879f37" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 15:28:50 user nova-compute[72382]: DEBUG os_brick.utils [None req-024e63d1-aa7d-4ab6-8821-34ea3440afb8 tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 15:28:50 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:28:50 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:28:50 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e79e94f-014c-415b-a862-0d9afce7dfb5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d2cfa7015fe\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:28:50 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:28:50 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.024s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:28:50 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6e31c74-1ba0-4fce-a32f-0eee04b2eacd]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:28:50 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:28:50 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:28:50 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb124496-5e2c-4280-8758-31b41a749a6a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:28:50 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[e34b1194-bc6b-41e9-9c54-adda622ad904]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:28:50 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-024e63d1-aa7d-4ab6-8821-34ea3440afb8 tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] Running cmd (subprocess): nvme version {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:28:50 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-024e63d1-aa7d-4ab6-8821-34ea3440afb8 tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] 'nvme version' failed. Not Retrying. {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 15:28:50 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.nvmeof [None req-024e63d1-aa7d-4ab6-8821-34ea3440afb8 tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] nvme not present on system {{(pid=72382) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 15:28:50 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:28:50 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 15:28:50 user nova-compute[72382]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 15:28:50 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f439aae-58c7-46a8-947d-9e1ba7e61523]: (4, '') {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:28:50 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.lightos [None req-024e63d1-aa7d-4ab6-8821-34ea3440afb8 tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72382) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 15:28:50 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.lightos [None req-024e63d1-aa7d-4ab6-8821-34ea3440afb8 tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72382) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 15:28:50 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.lightos [None req-024e63d1-aa7d-4ab6-8821-34ea3440afb8 tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] LIGHTOS: no hostnqn found. {{(pid=72382) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 15:28:50 user nova-compute[72382]: DEBUG os_brick.utils [None req-024e63d1-aa7d-4ab6-8821-34ea3440afb8 tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] <== get_connector_properties: return (143ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d2cfa7015fe', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 15:28:50 user nova-compute[72382]: DEBUG nova.virt.block_device [None req-024e63d1-aa7d-4ab6-8821-34ea3440afb8 tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] [instance: e0adbec9-eb22-4147-8c46-df7d02879f37] Updating existing volume attachment record: 52643297-647f-48d5-bb32-345607ed27ce {{(pid=72382) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 15:28:53 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:28:54 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:28:58 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:28:58 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:28:59 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:28:59 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-024e63d1-aa7d-4ab6-8821-34ea3440afb8 tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] [instance: e0adbec9-eb22-4147-8c46-df7d02879f37] Calling os-brick to attach iSCSI Volume {{(pid=72382) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 15:28:59 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-024e63d1-aa7d-4ab6-8821-34ea3440afb8 tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2a0c768340>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:9fb38a17-5c70-4b9b-909a-614a81e5b75b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XMTyoqHY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 15:28:59 user nova-compute[72382]: WARNING os_brick.initiator.connectors.base [None req-024e63d1-aa7d-4ab6-8821-34ea3440afb8 tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 15:28:59 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-024e63d1-aa7d-4ab6-8821-34ea3440afb8 tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 15:28:59 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-024e63d1-aa7d-4ab6-8821-34ea3440afb8 tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 15:28:59 user nova-compute[72382]: WARNING os_brick.initiator.connectors.base [None req-024e63d1-aa7d-4ab6-8821-34ea3440afb8 tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 15:28:59 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-024e63d1-aa7d-4ab6-8821-34ea3440afb8 tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9fb38a17-5c70-4b9b-909a-614a81e5b75b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 15:28:59 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-024e63d1-aa7d-4ab6-8821-34ea3440afb8 tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9fb38a17-5c70-4b9b-909a-614a81e5b75b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 15:28:59 user nova-compute[72382]: INFO os_brick.initiator.connectors.iscsi [None req-024e63d1-aa7d-4ab6-8821-34ea3440afb8 tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 15:28:59 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9fb38a17-5c70-4b9b-909a-614a81e5b75b -p 172.16.0.220:3260 {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:28:59 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9fb38a17-5c70-4b9b-909a-614a81e5b75b -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:28:59 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4fe3225-5abf-4b26-a37b-56555343db71]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:28:59 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-024e63d1-aa7d-4ab6-8821-34ea3440afb8 tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 15:28:59 user nova-compute[72382]:  {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:28:59 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9fb38a17-5c70-4b9b-909a-614a81e5b75b -p 172.16.0.220:3260 --interface default --op new {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:28:59 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9fb38a17-5c70-4b9b-909a-614a81e5b75b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:28:59 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[53ad8814-0c75-441a-a9ef-572ec9db6d2c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9fb38a17-5c70-4b9b-909a-614a81e5b75b] added\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:28:59 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-024e63d1-aa7d-4ab6-8821-34ea3440afb8 tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9fb38a17-5c70-4b9b-909a-614a81e5b75b] added
Aug 09 15:28:59 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:28:59 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9fb38a17-5c70-4b9b-909a-614a81e5b75b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:28:59 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9fb38a17-5c70-4b9b-909a-614a81e5b75b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:28:59 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[5801e98c-8ea4-4838-9d22-6abef2be51ed]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:28:59 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-024e63d1-aa7d-4ab6-8821-34ea3440afb8 tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:28:59 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9fb38a17-5c70-4b9b-909a-614a81e5b75b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:28:59 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9fb38a17-5c70-4b9b-909a-614a81e5b75b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:28:59 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[177bbfd7-8de8-4b02-8855-99ab722a4b82]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:28:59 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-024e63d1-aa7d-4ab6-8821-34ea3440afb8 tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:28:59 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9fb38a17-5c70-4b9b-909a-614a81e5b75b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XMTyoqHY {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:28:59 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9fb38a17-5c70-4b9b-909a-614a81e5b75b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XMTyoqHY" returned: 0 in 0.036s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:28:59 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef914c0a-b016-45f5-8929-0d9042e1b7f1]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:28:59 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-024e63d1-aa7d-4ab6-8821-34ea3440afb8 tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XMTyoqHY'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:28:59 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9fb38a17-5c70-4b9b-909a-614a81e5b75b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:28:59 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9fb38a17-5c70-4b9b-909a-614a81e5b75b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:28:59 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6708e1d-8266-4f14-812f-158d5f02b913]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:28:59 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-024e63d1-aa7d-4ab6-8821-34ea3440afb8 tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:28:59 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:28:59 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:28:59 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[66f74ce7-53ed-4444-a49c-d897e3258663]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd90521a-f3b5-485c-9fb9-61ab37267f3a (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25503c6e-bfc0-4008-846a-8cad783fc0fb (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e62d4416-be8c-4327-9a51-0cc509109c53 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37c53941-47c4-4d6d-8826-d0833f90643e (non-flash)\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:28:59 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-024e63d1-aa7d-4ab6-8821-34ea3440afb8 tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)
Aug 09 15:28:59 user nova-compute[72382]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd90521a-f3b5-485c-9fb9-61ab37267f3a (non-flash)
Aug 09 15:28:59 user nova-compute[72382]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25503c6e-bfc0-4008-846a-8cad783fc0fb (non-flash)
Aug 09 15:28:59 user nova-compute[72382]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e62d4416-be8c-4327-9a51-0cc509109c53 (non-flash)
Aug 09 15:28:59 user nova-compute[72382]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37c53941-47c4-4d6d-8826-d0833f90643e (non-flash)
Aug 09 15:28:59 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 15:28:59 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-024e63d1-aa7d-4ab6-8821-34ea3440afb8 tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)
Aug 09 15:28:59 user nova-compute[72382]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd90521a-f3b5-485c-9fb9-61ab37267f3a (non-flash)
Aug 09 15:28:59 user nova-compute[72382]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25503c6e-bfc0-4008-846a-8cad783fc0fb (non-flash)
Aug 09 15:28:59 user nova-compute[72382]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e62d4416-be8c-4327-9a51-0cc509109c53 (non-flash)
Aug 09 15:28:59 user nova-compute[72382]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37c53941-47c4-4d6d-8826-d0833f90643e (non-flash)
Aug 09 15:28:59 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 15:28:59 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9fb38a17-5c70-4b9b-909a-614a81e5b75b -p 172.16.0.220:3260 --login {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:28:59 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9fb38a17-5c70-4b9b-909a-614a81e5b75b -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:28:59 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d886f1a-85ce-47f3-9546-e62efa8732ca]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9fb38a17-5c70-4b9b-909a-614a81e5b75b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9fb38a17-5c70-4b9b-909a-614a81e5b75b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:28:59 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-024e63d1-aa7d-4ab6-8821-34ea3440afb8 tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9fb38a17-5c70-4b9b-909a-614a81e5b75b, portal: 172.16.0.220,3260]
Aug 09 15:28:59 user nova-compute[72382]: Login to [iface: default, target: iqn.2010-10.org.openstack:9fb38a17-5c70-4b9b-909a-614a81e5b75b, portal: 172.16.0.220,3260] successful.
Aug 09 15:28:59 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:28:59 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9fb38a17-5c70-4b9b-909a-614a81e5b75b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:28:59 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9fb38a17-5c70-4b9b-909a-614a81e5b75b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:28:59 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bd68ad2-ba5d-49e0-9a58-b94b2fc8c497]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:28:59 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-024e63d1-aa7d-4ab6-8821-34ea3440afb8 tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:28:59 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:29:00 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:29:00 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[590b3fa5-91c9-4db6-aaec-725ffab1c336]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd90521a-f3b5-485c-9fb9-61ab37267f3a (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25503c6e-bfc0-4008-846a-8cad783fc0fb (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e62d4416-be8c-4327-9a51-0cc509109c53 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37c53941-47c4-4d6d-8826-d0833f90643e (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fb38a17-5c70-4b9b-909a-614a81e5b75b (non-flash)\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:29:00 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-024e63d1-aa7d-4ab6-8821-34ea3440afb8 tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)
Aug 09 15:29:00 user nova-compute[72382]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd90521a-f3b5-485c-9fb9-61ab37267f3a (non-flash)
Aug 09 15:29:00 user nova-compute[72382]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25503c6e-bfc0-4008-846a-8cad783fc0fb (non-flash)
Aug 09 15:29:00 user nova-compute[72382]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e62d4416-be8c-4327-9a51-0cc509109c53 (non-flash)
Aug 09 15:29:00 user nova-compute[72382]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37c53941-47c4-4d6d-8826-d0833f90643e (non-flash)
Aug 09 15:29:00 user nova-compute[72382]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fb38a17-5c70-4b9b-909a-614a81e5b75b (non-flash)
Aug 09 15:29:00 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 15:29:00 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-024e63d1-aa7d-4ab6-8821-34ea3440afb8 tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)
Aug 09 15:29:00 user nova-compute[72382]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd90521a-f3b5-485c-9fb9-61ab37267f3a (non-flash)
Aug 09 15:29:00 user nova-compute[72382]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25503c6e-bfc0-4008-846a-8cad783fc0fb (non-flash)
Aug 09 15:29:00 user nova-compute[72382]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e62d4416-be8c-4327-9a51-0cc509109c53 (non-flash)
Aug 09 15:29:00 user nova-compute[72382]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37c53941-47c4-4d6d-8826-d0833f90643e (non-flash)
Aug 09 15:29:00 user nova-compute[72382]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fb38a17-5c70-4b9b-909a-614a81e5b75b (non-flash)
Aug 09 15:29:00 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 15:29:00 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-024e63d1-aa7d-4ab6-8821-34ea3440afb8 tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9fb38a17-5c70-4b9b-909a-614a81e5b75b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.348s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 15:29:00 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-024e63d1-aa7d-4ab6-8821-34ea3440afb8 tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] Connected to 172.16.0.220:3260 {{(pid=72382) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 15:29:00 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-024e63d1-aa7d-4ab6-8821-34ea3440afb8 tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] HCTL ('33', '-', '-', 0) found on session 36 with lun 0 {{(pid=72382) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 15:29:00 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-024e63d1-aa7d-4ab6-8821-34ea3440afb8 tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72382) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 15:29:00 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:29:00 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:29:00 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4bc4638-0077-49ae-ae13-e27b12f6a208]: (4, ('- - 0', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:29:00 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-024e63d1-aa7d-4ab6-8821-34ea3440afb8 tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] Searching for a device in session 36 and hctl ['33', '*', '*', 0] yield: None {{(pid=72382) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 15:29:01 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-024e63d1-aa7d-4ab6-8821-34ea3440afb8 tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] Searching for a device in session 36 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72382) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 15:29:01 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-024e63d1-aa7d-4ab6-8821-34ea3440afb8 tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XMTyoqHY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72382) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 15:29:01 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-024e63d1-aa7d-4ab6-8821-34ea3440afb8 tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.381s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 15:29:01 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-024e63d1-aa7d-4ab6-8821-34ea3440afb8 tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] <== connect_volume: return (1384ms) {'type': 'block', 'scsi_wwn': '26362613961303263', 'path': '/dev/sdb'} {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 15:29:01 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-024e63d1-aa7d-4ab6-8821-34ea3440afb8 tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] [instance: e0adbec9-eb22-4147-8c46-df7d02879f37] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26362613961303263', 'path': '/dev/sdb'} {{(pid=72382) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 15:29:01 user nova-compute[72382]: DEBUG nova.objects.instance [None req-024e63d1-aa7d-4ab6-8821-34ea3440afb8 tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] Lazy-loading 'flavor' on Instance uuid e0adbec9-eb22-4147-8c46-df7d02879f37 {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:29:01 user nova-compute[72382]: DEBUG nova.virt.libvirt.guest [None req-024e63d1-aa7d-4ab6-8821-34ea3440afb8 tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 15:29:01 user nova-compute[72382]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 15:29:01 user nova-compute[72382]:   <source dev="/dev/sdb"/>
Aug 09 15:29:01 user nova-compute[72382]:   <target dev="vdb" bus="virtio"/>
Aug 09 15:29:01 user nova-compute[72382]:   <serial>9fb38a17-5c70-4b9b-909a-614a81e5b75b</serial>
Aug 09 15:29:01 user nova-compute[72382]: </disk>
Aug 09 15:29:01 user nova-compute[72382]:  {{(pid=72382) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 15:29:01 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-024e63d1-aa7d-4ab6-8821-34ea3440afb8 tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] No BDM found with device name vda, not building metadata. {{(pid=72382) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 15:29:01 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-024e63d1-aa7d-4ab6-8821-34ea3440afb8 tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72382) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 15:29:01 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-024e63d1-aa7d-4ab6-8821-34ea3440afb8 tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] No VIF found with MAC fa:16:3e:35:bc:34, not building metadata {{(pid=72382) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 15:29:01 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-024e63d1-aa7d-4ab6-8821-34ea3440afb8 tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] Lock "e0adbec9-eb22-4147-8c46-df7d02879f37" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.375s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:29:03 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:29:04 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:29:08 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:29:09 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:29:10 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:29:10 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:29:10 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:29:10 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:29:10 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:29:10 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Auditing locally available compute resources for user (node: user) {{(pid=72382) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 15:29:11 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:29:11 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:29:11 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:29:11 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:29:11 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72382) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 15:29:11 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ea8f68c-3dc1-45ac-a7f3-bca32f929add/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:29:11 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ea8f68c-3dc1-45ac-a7f3-bca32f929add/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:29:11 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ea8f68c-3dc1-45ac-a7f3-bca32f929add/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:29:11 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ea8f68c-3dc1-45ac-a7f3-bca32f929add/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:29:11 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f780040f-b789-4b72-8986-813c7b9fe4a6/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:29:11 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f780040f-b789-4b72-8986-813c7b9fe4a6/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:29:11 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f780040f-b789-4b72-8986-813c7b9fe4a6/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:29:11 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f780040f-b789-4b72-8986-813c7b9fe4a6/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:29:11 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/266be814-4a2b-4f8e-a0f6-e8821fdeb95d/disk.rescue --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:29:12 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/266be814-4a2b-4f8e-a0f6-e8821fdeb95d/disk.rescue --force-share --output=json" returned: 0 in 0.136s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:29:12 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/266be814-4a2b-4f8e-a0f6-e8821fdeb95d/disk.rescue --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:29:12 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/266be814-4a2b-4f8e-a0f6-e8821fdeb95d/disk.rescue --force-share --output=json" returned: 0 in 0.150s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:29:12 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/266be814-4a2b-4f8e-a0f6-e8821fdeb95d/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:29:12 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/266be814-4a2b-4f8e-a0f6-e8821fdeb95d/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:29:12 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/266be814-4a2b-4f8e-a0f6-e8821fdeb95d/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:29:12 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/266be814-4a2b-4f8e-a0f6-e8821fdeb95d/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:29:12 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72382) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 15:29:12 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14c97840-88c0-4a8e-96e8-2e7da318ad07/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:29:12 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14c97840-88c0-4a8e-96e8-2e7da318ad07/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:29:12 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14c97840-88c0-4a8e-96e8-2e7da318ad07/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:29:12 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14c97840-88c0-4a8e-96e8-2e7da318ad07/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:29:12 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=72382) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 15:29:12 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44afd1bf-fa5c-4b3e-8752-b16853fef54e/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:29:13 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44afd1bf-fa5c-4b3e-8752-b16853fef54e/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:29:13 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44afd1bf-fa5c-4b3e-8752-b16853fef54e/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:29:13 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44afd1bf-fa5c-4b3e-8752-b16853fef54e/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:29:13 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6296ba5d-bcc6-405a-a635-0e9aa6114f7b/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:29:13 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6296ba5d-bcc6-405a-a635-0e9aa6114f7b/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:29:13 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6296ba5d-bcc6-405a-a635-0e9aa6114f7b/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:29:13 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6296ba5d-bcc6-405a-a635-0e9aa6114f7b/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:29:13 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61976531-76ae-4a1c-8950-0af784be376e/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:29:13 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61976531-76ae-4a1c-8950-0af784be376e/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:29:13 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61976531-76ae-4a1c-8950-0af784be376e/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:29:13 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61976531-76ae-4a1c-8950-0af784be376e/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:29:13 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:29:13 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:29:13 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:29:14 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:29:14 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:29:14 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ccbfda2-8bcd-4ec1-972a-cf49a62b1583/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:29:14 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ccbfda2-8bcd-4ec1-972a-cf49a62b1583/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:29:14 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ccbfda2-8bcd-4ec1-972a-cf49a62b1583/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:29:14 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:29:14 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ccbfda2-8bcd-4ec1-972a-cf49a62b1583/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:29:14 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=72382) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 15:29:14 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f430d9a-9fbf-43cd-8c0d-e5dec162be71/disk.rescue --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:29:14 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f430d9a-9fbf-43cd-8c0d-e5dec162be71/disk.rescue --force-share --output=json" returned: 0 in 0.147s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:29:14 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f430d9a-9fbf-43cd-8c0d-e5dec162be71/disk.rescue --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:29:14 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f430d9a-9fbf-43cd-8c0d-e5dec162be71/disk.rescue --force-share --output=json" returned: 0 in 0.148s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:29:14 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=72382) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 15:29:14 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0adbec9-eb22-4147-8c46-df7d02879f37/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:29:14 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0adbec9-eb22-4147-8c46-df7d02879f37/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:29:14 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0adbec9-eb22-4147-8c46-df7d02879f37/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:29:15 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0adbec9-eb22-4147-8c46-df7d02879f37/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:29:15 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72382) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 15:29:15 user nova-compute[72382]: WARNING nova.virt.libvirt.driver [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 15:29:15 user nova-compute[72382]: WARNING nova.virt.libvirt.driver [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 15:29:15 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Hypervisor/Node resource view: name=user free_ram=6939MB free_disk=25.217376708984375GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72382) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 15:29:15 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:29:15 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:29:15 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance f780040f-b789-4b72-8986-813c7b9fe4a6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:29:15 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance 44afd1bf-fa5c-4b3e-8752-b16853fef54e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:29:15 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance 266be814-4a2b-4f8e-a0f6-e8821fdeb95d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:29:15 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance 0f510d75-5d1e-4a5c-b38f-731c299f0f5a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:29:15 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance 6296ba5d-bcc6-405a-a635-0e9aa6114f7b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:29:15 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance 6ea8f68c-3dc1-45ac-a7f3-bca32f929add actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:29:15 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance 61976531-76ae-4a1c-8950-0af784be376e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:29:15 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:29:15 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance 14c97840-88c0-4a8e-96e8-2e7da318ad07 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:29:15 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance 4ccbfda2-8bcd-4ec1-972a-cf49a62b1583 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:29:15 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance 2f430d9a-9fbf-43cd-8c0d-e5dec162be71 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:29:15 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance e0adbec9-eb22-4147-8c46-df7d02879f37 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:29:15 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:29:15 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance 5002dc68-150a-4e96-bfe7-e66c6d764b9f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:29:15 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Total usable vcpus: 12, total allocated vcpus: 14 {{(pid=72382) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 15:29:15 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=14 pci_stats=[] {{(pid=72382) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 15:29:16 user nova-compute[72382]: DEBUG nova.compute.provider_tree [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Inventory has not changed in ProviderTree for provider: 7b15b0e5-df4d-49db-833b-2855d21d10ae {{(pid=72382) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 15:29:16 user nova-compute[72382]: DEBUG nova.scheduler.client.report [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Inventory has not changed for provider 7b15b0e5-df4d-49db-833b-2855d21d10ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72382) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 15:29:16 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Compute_service record updated for user:user {{(pid=72382) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 15:29:16 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.596s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:29:18 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:29:18 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:29:18 user nova-compute[72382]: DEBUG nova.compute.manager [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Starting heal instance info cache {{(pid=72382) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 15:29:18 user nova-compute[72382]: DEBUG nova.compute.manager [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Didn't find any instances for network info cache update. {{(pid=72382) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 09 15:29:18 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:29:18 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:29:18 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:29:18 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:29:18 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:29:18 user nova-compute[72382]: DEBUG nova.compute.manager [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72382) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 15:29:18 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:29:18 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:29:19 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:29:23 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:29:24 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:29:28 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:29:28 user nova-compute[72382]: DEBUG nova.objects.instance [None req-c210187f-0bde-4742-b35d-96ea46e85501 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Lazy-loading 'flavor' on Instance uuid 14c97840-88c0-4a8e-96e8-2e7da318ad07 {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:29:28 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-c210187f-0bde-4742-b35d-96ea46e85501 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Acquiring lock "refresh_cache-14c97840-88c0-4a8e-96e8-2e7da318ad07" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 15:29:28 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-c210187f-0bde-4742-b35d-96ea46e85501 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Acquired lock "refresh_cache-14c97840-88c0-4a8e-96e8-2e7da318ad07" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 15:29:28 user nova-compute[72382]: DEBUG nova.network.neutron [None req-c210187f-0bde-4742-b35d-96ea46e85501 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] [instance: 14c97840-88c0-4a8e-96e8-2e7da318ad07] Building network info cache for instance {{(pid=72382) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 15:29:28 user nova-compute[72382]: DEBUG nova.objects.instance [None req-c210187f-0bde-4742-b35d-96ea46e85501 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Lazy-loading 'info_cache' on Instance uuid 14c97840-88c0-4a8e-96e8-2e7da318ad07 {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:29:29 user nova-compute[72382]: DEBUG nova.network.neutron [None req-c210187f-0bde-4742-b35d-96ea46e85501 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] [instance: 14c97840-88c0-4a8e-96e8-2e7da318ad07] Updating instance_info_cache with network_info: [{"id": "f22c0d53-f0da-4bc9-bf7b-c10fe61e2e1f", "address": "fa:16:3e:72:44:b1", "network": {"id": "a85a6e1f-20f5-4719-90d2-0dc23ce525cd", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-780716970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c1a50eacfd0414bbc13e3fd4087e998", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf22c0d53-f0", "ovs_interfaceid": "f22c0d53-f0da-4bc9-bf7b-c10fe61e2e1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:29:29 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-c210187f-0bde-4742-b35d-96ea46e85501 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Releasing lock "refresh_cache-14c97840-88c0-4a8e-96e8-2e7da318ad07" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 15:29:29 user nova-compute[72382]: INFO nova.virt.libvirt.driver [-] [instance: 14c97840-88c0-4a8e-96e8-2e7da318ad07] Instance destroyed successfully.
Aug 09 15:29:29 user nova-compute[72382]: DEBUG nova.objects.instance [None req-c210187f-0bde-4742-b35d-96ea46e85501 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Lazy-loading 'resources' on Instance uuid 14c97840-88c0-4a8e-96e8-2e7da318ad07 {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:29:29 user nova-compute[72382]: DEBUG nova.virt.libvirt.vif [None req-c210187f-0bde-4742-b35d-96ea46e85501 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T15:25:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1065057662',display_name='tempest-AttachVolumeTestJSON-server-1065057662',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1065057662',id=25,image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDpgWhLPGWY2ElRglFQBqLuKZWglAfFVsofJemv1+kc4sKM1iZJZQ3Zp8fFAbw72Xaat0sVYwxhfDdHsZAI0ReSI/gfbVL6O5P/l5QvCIWZ9WBMY/UBAwONL1kUKiqSY5Q==',key_name='tempest-keypair-138739448',keypairs=<?>,launch_index=0,launched_at=2023-08-09T15:25:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='8c1a50eacfd0414bbc13e3fd4087e998',ramdisk_id='',reservation_id='r-p2h4ne70',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-502043064',owner_user_name='tempest-AttachVolumeTestJSON-502043064-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T15:27:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='13c67153e9ec44029e8d80c09d405175',uuid=14c97840-88c0-4a8e-96e8-2e7da318ad07,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "f22c0d53-f0da-4bc9-bf7b-c10fe61e2e1f", "address": "fa:16:3e:72:44:b1", "network": {"id": "a85a6e1f-20f5-4719-90d2-0dc23ce525cd", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-780716970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c1a50eacfd0414bbc13e3fd4087e998", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf22c0d53-f0", "ovs_interfaceid": "f22c0d53-f0da-4bc9-bf7b-c10fe61e2e1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 15:29:29 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-c210187f-0bde-4742-b35d-96ea46e85501 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Converting VIF {"id": "f22c0d53-f0da-4bc9-bf7b-c10fe61e2e1f", "address": "fa:16:3e:72:44:b1", "network": {"id": "a85a6e1f-20f5-4719-90d2-0dc23ce525cd", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-780716970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c1a50eacfd0414bbc13e3fd4087e998", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf22c0d53-f0", "ovs_interfaceid": "f22c0d53-f0da-4bc9-bf7b-c10fe61e2e1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 15:29:29 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-c210187f-0bde-4742-b35d-96ea46e85501 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:72:44:b1,bridge_name='br-int',has_traffic_filtering=True,id=f22c0d53-f0da-4bc9-bf7b-c10fe61e2e1f,network=Network(a85a6e1f-20f5-4719-90d2-0dc23ce525cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf22c0d53-f0') {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 15:29:29 user nova-compute[72382]: DEBUG os_vif [None req-c210187f-0bde-4742-b35d-96ea46e85501 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:44:b1,bridge_name='br-int',has_traffic_filtering=True,id=f22c0d53-f0da-4bc9-bf7b-c10fe61e2e1f,network=Network(a85a6e1f-20f5-4719-90d2-0dc23ce525cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf22c0d53-f0') {{(pid=72382) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 15:29:29 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:29:29 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf22c0d53-f0, bridge=br-int, if_exists=True) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:29:29 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:29:29 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:29:29 user nova-compute[72382]: INFO os_vif [None req-c210187f-0bde-4742-b35d-96ea46e85501 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:44:b1,bridge_name='br-int',has_traffic_filtering=True,id=f22c0d53-f0da-4bc9-bf7b-c10fe61e2e1f,network=Network(a85a6e1f-20f5-4719-90d2-0dc23ce525cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf22c0d53-f0')
Aug 09 15:29:29 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c210187f-0bde-4742-b35d-96ea46e85501 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] [instance: 14c97840-88c0-4a8e-96e8-2e7da318ad07] calling os-brick to detach iSCSI Volume {{(pid=72382) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 15:29:29 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-c210187f-0bde-4742-b35d-96ea46e85501 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2a0c768340>, {'target_iqns': ['iqn.2010-10.org.openstack:e62d4416-be8c-4327-9a51-0cc509109c53'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cxDzGkfS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 15:29:29 user nova-compute[72382]: WARNING os_brick.initiator.connectors.base [None req-c210187f-0bde-4742-b35d-96ea46e85501 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 15:29:29 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-c210187f-0bde-4742-b35d-96ea46e85501 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 15:29:29 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-c210187f-0bde-4742-b35d-96ea46e85501 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 15:29:29 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-c210187f-0bde-4742-b35d-96ea46e85501 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e62d4416-be8c-4327-9a51-0cc509109c53', 0)] {{(pid=72382) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 15:29:29 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:29:29 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:29:29 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d229da4-86e6-4b93-bece-2c9db7c83af2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:25503c6e-bfc0-4008-846a-8cad783fc0fb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:37c53941-47c4-4d6d-8826-d0833f90643e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9fb38a17-5c70-4b9b-909a-614a81e5b75b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bd90521a-f3b5-485c-9fb9-61ab37267f3a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e62d4416-be8c-4327-9a51-0cc509109c53\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:29:29 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:29:29 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:29:29 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b271cba-c616-4cb7-a050-19eced4582e4]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd90521a-f3b5-485c-9fb9-61ab37267f3a (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25503c6e-bfc0-4008-846a-8cad783fc0fb (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e62d4416-be8c-4327-9a51-0cc509109c53 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37c53941-47c4-4d6d-8826-d0833f90643e (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fb38a17-5c70-4b9b-909a-614a81e5b75b (non-flash)\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:29:29 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-c210187f-0bde-4742-b35d-96ea46e85501 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)
Aug 09 15:29:29 user nova-compute[72382]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd90521a-f3b5-485c-9fb9-61ab37267f3a (non-flash)
Aug 09 15:29:29 user nova-compute[72382]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25503c6e-bfc0-4008-846a-8cad783fc0fb (non-flash)
Aug 09 15:29:29 user nova-compute[72382]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e62d4416-be8c-4327-9a51-0cc509109c53 (non-flash)
Aug 09 15:29:29 user nova-compute[72382]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37c53941-47c4-4d6d-8826-d0833f90643e (non-flash)
Aug 09 15:29:29 user nova-compute[72382]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fb38a17-5c70-4b9b-909a-614a81e5b75b (non-flash)
Aug 09 15:29:29 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 15:29:29 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-c210187f-0bde-4742-b35d-96ea46e85501 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)
Aug 09 15:29:29 user nova-compute[72382]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd90521a-f3b5-485c-9fb9-61ab37267f3a (non-flash)
Aug 09 15:29:29 user nova-compute[72382]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25503c6e-bfc0-4008-846a-8cad783fc0fb (non-flash)
Aug 09 15:29:29 user nova-compute[72382]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e62d4416-be8c-4327-9a51-0cc509109c53 (non-flash)
Aug 09 15:29:29 user nova-compute[72382]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37c53941-47c4-4d6d-8826-d0833f90643e (non-flash)
Aug 09 15:29:29 user nova-compute[72382]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fb38a17-5c70-4b9b-909a-614a81e5b75b (non-flash)
Aug 09 15:29:29 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 15:29:30 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-c210187f-0bde-4742-b35d-96ea46e85501 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2a241ecd30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e62d4416-be8c-4327-9a51-0cc509109c53'): ({'sdf'}, set())}) {{(pid=72382) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 15:29:30 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-c210187f-0bde-4742-b35d-96ea46e85501 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Removing single pathed devices sdf {{(pid=72382) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 15:29:30 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:29:30 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:29:30 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2746811-f620-47c4-bfcb-f390b4803f22]: (4, ('path checker states:\nup                  5\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:29:30 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:29:30 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.022s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:29:30 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4cacd3f-87fd-43ce-b855-c8d5f2c0fd31]: (4, ('ok\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:29:30 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-c210187f-0bde-4742-b35d-96ea46e85501 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Flushing IO for device /dev/sdf {{(pid=72382) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 15:29:30 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:29:30 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:29:30 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8c196a0-6ec8-41a4-9d6c-7380038d26c3]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:29:30 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-c210187f-0bde-4742-b35d-96ea46e85501 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=72382) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 15:29:30 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:29:30 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.043s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:29:30 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d87f7a6-934a-40d9-bf7b-1041670a420c]: (4, ('1', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:29:30 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-c210187f-0bde-4742-b35d-96ea46e85501 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=72382) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 15:29:30 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-c210187f-0bde-4742-b35d-96ea46e85501 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] SCSI volumes sdf have been removed. {{(pid=72382) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 15:29:30 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-c210187f-0bde-4742-b35d-96ea46e85501 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e62d4416-be8c-4327-9a51-0cc509109c53')] {{(pid=72382) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 15:29:30 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e62d4416-be8c-4327-9a51-0cc509109c53 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:29:30 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e62d4416-be8c-4327-9a51-0cc509109c53 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:29:30 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[077b162c-72b4-454a-811c-63b30eb01fdf]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:29:30 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-c210187f-0bde-4742-b35d-96ea46e85501 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:29:30 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e62d4416-be8c-4327-9a51-0cc509109c53 -p 172.16.0.220:3260 --logout {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:29:30 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e62d4416-be8c-4327-9a51-0cc509109c53 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:29:30 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[b54a4de8-b89b-4966-9031-b2184afda686]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:e62d4416-be8c-4327-9a51-0cc509109c53, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:e62d4416-be8c-4327-9a51-0cc509109c53, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:29:30 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-c210187f-0bde-4742-b35d-96ea46e85501 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:e62d4416-be8c-4327-9a51-0cc509109c53, portal: 172.16.0.220,3260]
Aug 09 15:29:30 user nova-compute[72382]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:e62d4416-be8c-4327-9a51-0cc509109c53, portal: 172.16.0.220,3260] successful.
Aug 09 15:29:30 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:29:30 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e62d4416-be8c-4327-9a51-0cc509109c53 -p 172.16.0.220:3260 --op delete {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:29:30 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e62d4416-be8c-4327-9a51-0cc509109c53 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:29:30 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a805b9c-d13f-4e28-b1e6-afb84df603f9]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:29:30 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-c210187f-0bde-4742-b35d-96ea46e85501 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:29:30 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-c210187f-0bde-4742-b35d-96ea46e85501 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.293s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 15:29:30 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-c210187f-0bde-4742-b35d-96ea46e85501 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] <== disconnect_volume: return (295ms) None {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 15:29:30 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c210187f-0bde-4742-b35d-96ea46e85501 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] [instance: 14c97840-88c0-4a8e-96e8-2e7da318ad07] Disconnected iSCSI Volume {{(pid=72382) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 15:29:30 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-c210187f-0bde-4742-b35d-96ea46e85501 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] [instance: 14c97840-88c0-4a8e-96e8-2e7da318ad07] Start _get_guest_xml network_info=[{"id": "f22c0d53-f0da-4bc9-bf7b-c10fe61e2e1f", "address": "fa:16:3e:72:44:b1", "network": {"id": "a85a6e1f-20f5-4719-90d2-0dc23ce525cd", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-780716970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c1a50eacfd0414bbc13e3fd4087e998", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf22c0d53-f0", "ovs_interfaceid": "f22c0d53-f0da-4bc9-bf7b-c10fe61e2e1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=a79f2cea-eb27-4631-aaf3-05e7d9e411b4,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'a79f2cea-eb27-4631-aaf3-05e7d9e411b4'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'boot_index': None, 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:e62d4416-be8c-4327-9a51-0cc509109c53'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cxDzGkfS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, 'status': 'reserved', 'instance': '14c97840-88c0-4a8e-96e8-2e7da318ad07', 'attached_at': '', 'detached_at': '', 'volume_id': 'e62d4416-be8c-4327-9a51-0cc509109c53', 'serial': 'e62d4416-be8c-4327-9a51-0cc509109c53'}, 'disk_bus': 'virtio', 'attachment_id': '53c335a9-dd38-46fd-9994-7129340339c9', 'delete_on_termination': False, 'volume_type': None} {{(pid=72382) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 15:29:30 user nova-compute[72382]: DEBUG nova.objects.instance [None req-c210187f-0bde-4742-b35d-96ea46e85501 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Lazy-loading 'numa_topology' on Instance uuid 14c97840-88c0-4a8e-96e8-2e7da318ad07 {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:29:30 user nova-compute[72382]: WARNING nova.virt.libvirt.driver [None req-c210187f-0bde-4742-b35d-96ea46e85501 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 15:29:30 user nova-compute[72382]: WARNING nova.virt.libvirt.driver [None req-c210187f-0bde-4742-b35d-96ea46e85501 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 15:29:30 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-c210187f-0bde-4742-b35d-96ea46e85501 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72382) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 15:29:30 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-c210187f-0bde-4742-b35d-96ea46e85501 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] CPU controller missing on host. {{(pid=72382) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 15:29:30 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-c210187f-0bde-4742-b35d-96ea46e85501 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72382) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 15:29:30 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-c210187f-0bde-4742-b35d-96ea46e85501 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] CPU controller found on host. {{(pid=72382) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 15:29:30 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-c210187f-0bde-4742-b35d-96ea46e85501 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72382) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 15:29:30 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-c210187f-0bde-4742-b35d-96ea46e85501 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T15:11:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=a79f2cea-eb27-4631-aaf3-05e7d9e411b4,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 15:29:30 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-c210187f-0bde-4742-b35d-96ea46e85501 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Flavor limits 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 15:29:30 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-c210187f-0bde-4742-b35d-96ea46e85501 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Image limits 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 15:29:30 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-c210187f-0bde-4742-b35d-96ea46e85501 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Flavor pref 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 15:29:30 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-c210187f-0bde-4742-b35d-96ea46e85501 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Image pref 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 15:29:30 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-c210187f-0bde-4742-b35d-96ea46e85501 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 15:29:30 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-c210187f-0bde-4742-b35d-96ea46e85501 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 15:29:30 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-c210187f-0bde-4742-b35d-96ea46e85501 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72382) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 15:29:30 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-c210187f-0bde-4742-b35d-96ea46e85501 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Got 1 possible topologies {{(pid=72382) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 15:29:30 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-c210187f-0bde-4742-b35d-96ea46e85501 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 15:29:30 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-c210187f-0bde-4742-b35d-96ea46e85501 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 15:29:30 user nova-compute[72382]: DEBUG nova.objects.instance [None req-c210187f-0bde-4742-b35d-96ea46e85501 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Lazy-loading 'vcpu_model' on Instance uuid 14c97840-88c0-4a8e-96e8-2e7da318ad07 {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:29:30 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c210187f-0bde-4742-b35d-96ea46e85501 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] [instance: 14c97840-88c0-4a8e-96e8-2e7da318ad07] Calling os-brick to attach iSCSI Volume {{(pid=72382) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 15:29:30 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-c210187f-0bde-4742-b35d-96ea46e85501 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2a0c768340>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:e62d4416-be8c-4327-9a51-0cc509109c53'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cxDzGkfS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 15:29:30 user nova-compute[72382]: WARNING os_brick.initiator.connectors.base [None req-c210187f-0bde-4742-b35d-96ea46e85501 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 15:29:30 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-c210187f-0bde-4742-b35d-96ea46e85501 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 15:29:30 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-c210187f-0bde-4742-b35d-96ea46e85501 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 15:29:30 user nova-compute[72382]: WARNING os_brick.initiator.connectors.base [None req-c210187f-0bde-4742-b35d-96ea46e85501 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 15:29:30 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-c210187f-0bde-4742-b35d-96ea46e85501 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e62d4416-be8c-4327-9a51-0cc509109c53" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 15:29:30 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-c210187f-0bde-4742-b35d-96ea46e85501 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e62d4416-be8c-4327-9a51-0cc509109c53" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 15:29:30 user nova-compute[72382]: INFO os_brick.initiator.connectors.iscsi [None req-c210187f-0bde-4742-b35d-96ea46e85501 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 15:29:30 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e62d4416-be8c-4327-9a51-0cc509109c53 -p 172.16.0.220:3260 {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:29:30 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e62d4416-be8c-4327-9a51-0cc509109c53 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:29:30 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca465e24-916f-4ca8-96fe-00495ba92fb7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:29:30 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-c210187f-0bde-4742-b35d-96ea46e85501 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 15:29:30 user nova-compute[72382]:  {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:29:30 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e62d4416-be8c-4327-9a51-0cc509109c53 -p 172.16.0.220:3260 --interface default --op new {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:29:30 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e62d4416-be8c-4327-9a51-0cc509109c53 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:29:30 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[73ae091d-ccf3-4937-90f4-5dbf082eb374]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e62d4416-be8c-4327-9a51-0cc509109c53] added\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:29:30 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-c210187f-0bde-4742-b35d-96ea46e85501 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e62d4416-be8c-4327-9a51-0cc509109c53] added
Aug 09 15:29:30 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:29:30 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e62d4416-be8c-4327-9a51-0cc509109c53 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:29:30 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e62d4416-be8c-4327-9a51-0cc509109c53 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:29:30 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[317fe7cc-71d1-435b-9cd6-c09ee407e6b0]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:29:30 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-c210187f-0bde-4742-b35d-96ea46e85501 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:29:30 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e62d4416-be8c-4327-9a51-0cc509109c53 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:29:30 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e62d4416-be8c-4327-9a51-0cc509109c53 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:29:30 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[411aa484-7ab0-4c7c-a8f9-a0a6eee27df9]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:29:30 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-c210187f-0bde-4742-b35d-96ea46e85501 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:29:30 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e62d4416-be8c-4327-9a51-0cc509109c53 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cxDzGkfS {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:29:30 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e62d4416-be8c-4327-9a51-0cc509109c53 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cxDzGkfS" returned: 0 in 0.024s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:29:30 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[6356c34c-0210-4f60-bc91-016a9e53b635]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:29:30 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-c210187f-0bde-4742-b35d-96ea46e85501 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cxDzGkfS'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:29:30 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e62d4416-be8c-4327-9a51-0cc509109c53 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:29:30 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e62d4416-be8c-4327-9a51-0cc509109c53 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:29:30 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[da14f7fd-9ded-4249-af2c-c1ee0af3e768]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:29:30 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-c210187f-0bde-4742-b35d-96ea46e85501 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:29:30 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:29:30 user nova-compute[72382]: DEBUG nova.compute.manager [req-efe2eac5-1012-4d17-b1a8-a57accd23f77 req-2edc462b-8636-48d1-848a-4233ec440c3e service nova] [instance: b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d] Received event network-changed-99b65ca7-d891-4625-917d-460e7fb69654 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:29:30 user nova-compute[72382]: DEBUG nova.compute.manager [req-efe2eac5-1012-4d17-b1a8-a57accd23f77 req-2edc462b-8636-48d1-848a-4233ec440c3e service nova] [instance: b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d] Refreshing instance network info cache due to event network-changed-99b65ca7-d891-4625-917d-460e7fb69654. {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 15:29:30 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-efe2eac5-1012-4d17-b1a8-a57accd23f77 req-2edc462b-8636-48d1-848a-4233ec440c3e service nova] Acquiring lock "refresh_cache-b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 15:29:30 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-efe2eac5-1012-4d17-b1a8-a57accd23f77 req-2edc462b-8636-48d1-848a-4233ec440c3e service nova] Acquired lock "refresh_cache-b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 15:29:30 user nova-compute[72382]: DEBUG nova.network.neutron [req-efe2eac5-1012-4d17-b1a8-a57accd23f77 req-2edc462b-8636-48d1-848a-4233ec440c3e service nova] [instance: b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d] Refreshing network info cache for port 99b65ca7-d891-4625-917d-460e7fb69654 {{(pid=72382) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 15:29:30 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:29:30 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3458948-a79f-47eb-bdb9-835a41fee252]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd90521a-f3b5-485c-9fb9-61ab37267f3a (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25503c6e-bfc0-4008-846a-8cad783fc0fb (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37c53941-47c4-4d6d-8826-d0833f90643e (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fb38a17-5c70-4b9b-909a-614a81e5b75b (non-flash)\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:29:30 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-c210187f-0bde-4742-b35d-96ea46e85501 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)
Aug 09 15:29:30 user nova-compute[72382]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd90521a-f3b5-485c-9fb9-61ab37267f3a (non-flash)
Aug 09 15:29:30 user nova-compute[72382]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25503c6e-bfc0-4008-846a-8cad783fc0fb (non-flash)
Aug 09 15:29:30 user nova-compute[72382]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37c53941-47c4-4d6d-8826-d0833f90643e (non-flash)
Aug 09 15:29:30 user nova-compute[72382]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fb38a17-5c70-4b9b-909a-614a81e5b75b (non-flash)
Aug 09 15:29:30 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 15:29:30 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-c210187f-0bde-4742-b35d-96ea46e85501 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)
Aug 09 15:29:30 user nova-compute[72382]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd90521a-f3b5-485c-9fb9-61ab37267f3a (non-flash)
Aug 09 15:29:30 user nova-compute[72382]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25503c6e-bfc0-4008-846a-8cad783fc0fb (non-flash)
Aug 09 15:29:30 user nova-compute[72382]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37c53941-47c4-4d6d-8826-d0833f90643e (non-flash)
Aug 09 15:29:30 user nova-compute[72382]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fb38a17-5c70-4b9b-909a-614a81e5b75b (non-flash)
Aug 09 15:29:30 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 15:29:30 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e62d4416-be8c-4327-9a51-0cc509109c53 -p 172.16.0.220:3260 --login {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:29:30 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e62d4416-be8c-4327-9a51-0cc509109c53 -p 172.16.0.220:3260 --login" returned: 0 in 0.084s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:29:30 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe83080c-78cd-4cc9-91a9-05e51b2a439f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e62d4416-be8c-4327-9a51-0cc509109c53, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e62d4416-be8c-4327-9a51-0cc509109c53, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:29:30 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-c210187f-0bde-4742-b35d-96ea46e85501 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e62d4416-be8c-4327-9a51-0cc509109c53, portal: 172.16.0.220,3260]
Aug 09 15:29:30 user nova-compute[72382]: Login to [iface: default, target: iqn.2010-10.org.openstack:e62d4416-be8c-4327-9a51-0cc509109c53, portal: 172.16.0.220,3260] successful.
Aug 09 15:29:30 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:29:30 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e62d4416-be8c-4327-9a51-0cc509109c53 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:29:30 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e62d4416-be8c-4327-9a51-0cc509109c53 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:29:30 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[3099d52a-d64d-43e2-89dd-b12412dd59a4]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:29:30 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-c210187f-0bde-4742-b35d-96ea46e85501 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:29:30 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:29:30 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:29:30 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5048e4b-4ca2-42d0-a51b-7447459b70d1]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd90521a-f3b5-485c-9fb9-61ab37267f3a (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25503c6e-bfc0-4008-846a-8cad783fc0fb (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37c53941-47c4-4d6d-8826-d0833f90643e (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fb38a17-5c70-4b9b-909a-614a81e5b75b (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e62d4416-be8c-4327-9a51-0cc509109c53 (non-flash)\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:29:30 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-c210187f-0bde-4742-b35d-96ea46e85501 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)
Aug 09 15:29:30 user nova-compute[72382]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd90521a-f3b5-485c-9fb9-61ab37267f3a (non-flash)
Aug 09 15:29:30 user nova-compute[72382]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25503c6e-bfc0-4008-846a-8cad783fc0fb (non-flash)
Aug 09 15:29:30 user nova-compute[72382]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37c53941-47c4-4d6d-8826-d0833f90643e (non-flash)
Aug 09 15:29:30 user nova-compute[72382]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fb38a17-5c70-4b9b-909a-614a81e5b75b (non-flash)
Aug 09 15:29:30 user nova-compute[72382]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e62d4416-be8c-4327-9a51-0cc509109c53 (non-flash)
Aug 09 15:29:30 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 15:29:30 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-c210187f-0bde-4742-b35d-96ea46e85501 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)
Aug 09 15:29:30 user nova-compute[72382]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd90521a-f3b5-485c-9fb9-61ab37267f3a (non-flash)
Aug 09 15:29:30 user nova-compute[72382]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25503c6e-bfc0-4008-846a-8cad783fc0fb (non-flash)
Aug 09 15:29:30 user nova-compute[72382]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37c53941-47c4-4d6d-8826-d0833f90643e (non-flash)
Aug 09 15:29:30 user nova-compute[72382]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fb38a17-5c70-4b9b-909a-614a81e5b75b (non-flash)
Aug 09 15:29:30 user nova-compute[72382]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e62d4416-be8c-4327-9a51-0cc509109c53 (non-flash)
Aug 09 15:29:30 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 15:29:30 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-c210187f-0bde-4742-b35d-96ea46e85501 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e62d4416-be8c-4327-9a51-0cc509109c53" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.342s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 15:29:30 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-c210187f-0bde-4742-b35d-96ea46e85501 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Connected to 172.16.0.220:3260 {{(pid=72382) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 15:29:30 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-c210187f-0bde-4742-b35d-96ea46e85501 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] HCTL ('37', '-', '-', 0) found on session 37 with lun 0 {{(pid=72382) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 15:29:30 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-c210187f-0bde-4742-b35d-96ea46e85501 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=72382) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 15:29:30 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:29:30 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.020s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:29:30 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbf5ca64-1715-4753-835b-ed3bf02610da]: (4, ('- - 0', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:29:30 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-c210187f-0bde-4742-b35d-96ea46e85501 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Searching for a device in session 37 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=72382) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 15:29:30 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-c210187f-0bde-4742-b35d-96ea46e85501 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cxDzGkfS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72382) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 15:29:31 user nova-compute[72382]: DEBUG nova.network.neutron [req-efe2eac5-1012-4d17-b1a8-a57accd23f77 req-2edc462b-8636-48d1-848a-4233ec440c3e service nova] [instance: b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d] Updated VIF entry in instance network info cache for port 99b65ca7-d891-4625-917d-460e7fb69654. {{(pid=72382) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 15:29:31 user nova-compute[72382]: DEBUG nova.network.neutron [req-efe2eac5-1012-4d17-b1a8-a57accd23f77 req-2edc462b-8636-48d1-848a-4233ec440c3e service nova] [instance: b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d] Updating instance_info_cache with network_info: [{"id": "99b65ca7-d891-4625-917d-460e7fb69654", "address": "fa:16:3e:98:b9:f2", "network": {"id": "643703fd-46b7-4309-862c-109141cb008c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-512918576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.131", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa6db5fd3ce24c1cadbedd64757e219b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99b65ca7-d8", "ovs_interfaceid": "99b65ca7-d891-4625-917d-460e7fb69654", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:29:31 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-efe2eac5-1012-4d17-b1a8-a57accd23f77 req-2edc462b-8636-48d1-848a-4233ec440c3e service nova] Releasing lock "refresh_cache-b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 15:29:31 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-c210187f-0bde-4742-b35d-96ea46e85501 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.383s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 15:29:31 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-c210187f-0bde-4742-b35d-96ea46e85501 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] <== connect_volume: return (1384ms) {'type': 'block', 'scsi_wwn': '26439653462353332', 'path': '/dev/sdf'} {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 15:29:31 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c210187f-0bde-4742-b35d-96ea46e85501 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] [instance: 14c97840-88c0-4a8e-96e8-2e7da318ad07] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26439653462353332', 'path': '/dev/sdf'} {{(pid=72382) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 15:29:31 user nova-compute[72382]: DEBUG nova.virt.libvirt.vif [None req-c210187f-0bde-4742-b35d-96ea46e85501 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T15:25:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1065057662',display_name='tempest-AttachVolumeTestJSON-server-1065057662',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1065057662',id=25,image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDpgWhLPGWY2ElRglFQBqLuKZWglAfFVsofJemv1+kc4sKM1iZJZQ3Zp8fFAbw72Xaat0sVYwxhfDdHsZAI0ReSI/gfbVL6O5P/l5QvCIWZ9WBMY/UBAwONL1kUKiqSY5Q==',key_name='tempest-keypair-138739448',keypairs=<?>,launch_index=0,launched_at=2023-08-09T15:25:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='8c1a50eacfd0414bbc13e3fd4087e998',ramdisk_id='',reservation_id='r-p2h4ne70',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-502043064',owner_user_name='tempest-AttachVolumeTestJSON-502043064-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T15:27:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='13c67153e9ec44029e8d80c09d405175',uuid=14c97840-88c0-4a8e-96e8-2e7da318ad07,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "f22c0d53-f0da-4bc9-bf7b-c10fe61e2e1f", "address": "fa:16:3e:72:44:b1", "network": {"id": "a85a6e1f-20f5-4719-90d2-0dc23ce525cd", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-780716970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c1a50eacfd0414bbc13e3fd4087e998", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf22c0d53-f0", "ovs_interfaceid": "f22c0d53-f0da-4bc9-bf7b-c10fe61e2e1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72382) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 15:29:31 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-c210187f-0bde-4742-b35d-96ea46e85501 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Converting VIF {"id": "f22c0d53-f0da-4bc9-bf7b-c10fe61e2e1f", "address": "fa:16:3e:72:44:b1", "network": {"id": "a85a6e1f-20f5-4719-90d2-0dc23ce525cd", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-780716970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c1a50eacfd0414bbc13e3fd4087e998", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf22c0d53-f0", "ovs_interfaceid": "f22c0d53-f0da-4bc9-bf7b-c10fe61e2e1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 15:29:31 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-c210187f-0bde-4742-b35d-96ea46e85501 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:72:44:b1,bridge_name='br-int',has_traffic_filtering=True,id=f22c0d53-f0da-4bc9-bf7b-c10fe61e2e1f,network=Network(a85a6e1f-20f5-4719-90d2-0dc23ce525cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf22c0d53-f0') {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 15:29:31 user nova-compute[72382]: DEBUG nova.objects.instance [None req-c210187f-0bde-4742-b35d-96ea46e85501 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Lazy-loading 'pci_devices' on Instance uuid 14c97840-88c0-4a8e-96e8-2e7da318ad07 {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:29:31 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-c210187f-0bde-4742-b35d-96ea46e85501 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] [instance: 14c97840-88c0-4a8e-96e8-2e7da318ad07] End _get_guest_xml xml=<domain type="kvm">
Aug 09 15:29:31 user nova-compute[72382]:   <uuid>14c97840-88c0-4a8e-96e8-2e7da318ad07</uuid>
Aug 09 15:29:31 user nova-compute[72382]:   <name>instance-00000019</name>
Aug 09 15:29:31 user nova-compute[72382]:   <memory>524288</memory>
Aug 09 15:29:31 user nova-compute[72382]:   <vcpu>1</vcpu>
Aug 09 15:29:31 user nova-compute[72382]:   <metadata>
Aug 09 15:29:31 user nova-compute[72382]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 15:29:31 user nova-compute[72382]:       <nova:package version="0.0.0"/>
Aug 09 15:29:31 user nova-compute[72382]:       <nova:name>tempest-AttachVolumeTestJSON-server-1065057662</nova:name>
Aug 09 15:29:31 user nova-compute[72382]:       <nova:creationTime>2023-08-09 15:29:30</nova:creationTime>
Aug 09 15:29:31 user nova-compute[72382]:       <nova:flavor name="m1.tiny">
Aug 09 15:29:31 user nova-compute[72382]:         <nova:memory>512</nova:memory>
Aug 09 15:29:31 user nova-compute[72382]:         <nova:disk>1</nova:disk>
Aug 09 15:29:31 user nova-compute[72382]:         <nova:swap>0</nova:swap>
Aug 09 15:29:31 user nova-compute[72382]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 15:29:31 user nova-compute[72382]:         <nova:vcpus>1</nova:vcpus>
Aug 09 15:29:31 user nova-compute[72382]:       </nova:flavor>
Aug 09 15:29:31 user nova-compute[72382]:       <nova:owner>
Aug 09 15:29:31 user nova-compute[72382]:         <nova:user uuid="13c67153e9ec44029e8d80c09d405175">tempest-AttachVolumeTestJSON-502043064-project-member</nova:user>
Aug 09 15:29:31 user nova-compute[72382]:         <nova:project uuid="8c1a50eacfd0414bbc13e3fd4087e998">tempest-AttachVolumeTestJSON-502043064</nova:project>
Aug 09 15:29:31 user nova-compute[72382]:       </nova:owner>
Aug 09 15:29:31 user nova-compute[72382]:       <nova:root type="image" uuid="a79f2cea-eb27-4631-aaf3-05e7d9e411b4"/>
Aug 09 15:29:31 user nova-compute[72382]:       <nova:ports>
Aug 09 15:29:31 user nova-compute[72382]:         <nova:port uuid="f22c0d53-f0da-4bc9-bf7b-c10fe61e2e1f">
Aug 09 15:29:31 user nova-compute[72382]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 09 15:29:31 user nova-compute[72382]:         </nova:port>
Aug 09 15:29:31 user nova-compute[72382]:       </nova:ports>
Aug 09 15:29:31 user nova-compute[72382]:     </nova:instance>
Aug 09 15:29:31 user nova-compute[72382]:   </metadata>
Aug 09 15:29:31 user nova-compute[72382]:   <sysinfo type="smbios">
Aug 09 15:29:31 user nova-compute[72382]:     <system>
Aug 09 15:29:31 user nova-compute[72382]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 15:29:31 user nova-compute[72382]:       <entry name="product">OpenStack Nova</entry>
Aug 09 15:29:31 user nova-compute[72382]:       <entry name="version">0.0.0</entry>
Aug 09 15:29:31 user nova-compute[72382]:       <entry name="serial">14c97840-88c0-4a8e-96e8-2e7da318ad07</entry>
Aug 09 15:29:31 user nova-compute[72382]:       <entry name="uuid">14c97840-88c0-4a8e-96e8-2e7da318ad07</entry>
Aug 09 15:29:31 user nova-compute[72382]:       <entry name="family">Virtual Machine</entry>
Aug 09 15:29:31 user nova-compute[72382]:     </system>
Aug 09 15:29:31 user nova-compute[72382]:   </sysinfo>
Aug 09 15:29:31 user nova-compute[72382]:   <os>
Aug 09 15:29:31 user nova-compute[72382]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 15:29:31 user nova-compute[72382]:     <boot dev="hd"/>
Aug 09 15:29:31 user nova-compute[72382]:     <smbios mode="sysinfo"/>
Aug 09 15:29:31 user nova-compute[72382]:   </os>
Aug 09 15:29:31 user nova-compute[72382]:   <features>
Aug 09 15:29:31 user nova-compute[72382]:     <acpi/>
Aug 09 15:29:31 user nova-compute[72382]:     <apic/>
Aug 09 15:29:31 user nova-compute[72382]:     <vmcoreinfo/>
Aug 09 15:29:31 user nova-compute[72382]:   </features>
Aug 09 15:29:31 user nova-compute[72382]:   <clock offset="utc">
Aug 09 15:29:31 user nova-compute[72382]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 15:29:31 user nova-compute[72382]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 15:29:31 user nova-compute[72382]:     <timer name="hpet" present="no"/>
Aug 09 15:29:31 user nova-compute[72382]:   </clock>
Aug 09 15:29:31 user nova-compute[72382]:   <cpu mode="custom" match="exact">
Aug 09 15:29:31 user nova-compute[72382]:     <model>Nehalem</model>
Aug 09 15:29:31 user nova-compute[72382]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 15:29:31 user nova-compute[72382]:   </cpu>
Aug 09 15:29:31 user nova-compute[72382]:   <devices>
Aug 09 15:29:31 user nova-compute[72382]:     <disk type="file" device="disk">
Aug 09 15:29:31 user nova-compute[72382]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 15:29:31 user nova-compute[72382]:       <source file="/opt/stack/data/nova/instances/14c97840-88c0-4a8e-96e8-2e7da318ad07/disk"/>
Aug 09 15:29:31 user nova-compute[72382]:       <target dev="vda" bus="virtio"/>
Aug 09 15:29:31 user nova-compute[72382]:     </disk>
Aug 09 15:29:31 user nova-compute[72382]:     <disk type="block" device="disk">
Aug 09 15:29:31 user nova-compute[72382]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 15:29:31 user nova-compute[72382]:       <source dev="/dev/sdf"/>
Aug 09 15:29:31 user nova-compute[72382]:       <target dev="vdb" bus="virtio"/>
Aug 09 15:29:31 user nova-compute[72382]:       <serial>e62d4416-be8c-4327-9a51-0cc509109c53</serial>
Aug 09 15:29:31 user nova-compute[72382]:     </disk>
Aug 09 15:29:31 user nova-compute[72382]:     <interface type="ethernet">
Aug 09 15:29:31 user nova-compute[72382]:       <mac address="fa:16:3e:72:44:b1"/>
Aug 09 15:29:31 user nova-compute[72382]:       <model type="virtio"/>
Aug 09 15:29:31 user nova-compute[72382]:       <mtu size="1442"/>
Aug 09 15:29:31 user nova-compute[72382]:       <target dev="tapf22c0d53-f0"/>
Aug 09 15:29:31 user nova-compute[72382]:     </interface>
Aug 09 15:29:31 user nova-compute[72382]:     <serial type="pty">
Aug 09 15:29:31 user nova-compute[72382]:       <log file="/opt/stack/data/nova/instances/14c97840-88c0-4a8e-96e8-2e7da318ad07/console.log" append="off"/>
Aug 09 15:29:31 user nova-compute[72382]:     </serial>
Aug 09 15:29:31 user nova-compute[72382]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 15:29:31 user nova-compute[72382]:     <video>
Aug 09 15:29:31 user nova-compute[72382]:       <model type="virtio"/>
Aug 09 15:29:31 user nova-compute[72382]:     </video>
Aug 09 15:29:31 user nova-compute[72382]:     <rng model="virtio">
Aug 09 15:29:31 user nova-compute[72382]:       <backend model="random">/dev/urandom</backend>
Aug 09 15:29:31 user nova-compute[72382]:     </rng>
Aug 09 15:29:31 user nova-compute[72382]:     <controller type="usb" index="0" model="none"/>
Aug 09 15:29:31 user nova-compute[72382]:     <memballoon model="virtio">
Aug 09 15:29:31 user nova-compute[72382]:       <stats period="10"/>
Aug 09 15:29:31 user nova-compute[72382]:     </memballoon>
Aug 09 15:29:31 user nova-compute[72382]:   </devices>
Aug 09 15:29:31 user nova-compute[72382]: </domain>
Aug 09 15:29:31 user nova-compute[72382]:  {{(pid=72382) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 15:29:31 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-c210187f-0bde-4742-b35d-96ea46e85501 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14c97840-88c0-4a8e-96e8-2e7da318ad07/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:29:31 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-c210187f-0bde-4742-b35d-96ea46e85501 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14c97840-88c0-4a8e-96e8-2e7da318ad07/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:29:31 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-c210187f-0bde-4742-b35d-96ea46e85501 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14c97840-88c0-4a8e-96e8-2e7da318ad07/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:29:32 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-c210187f-0bde-4742-b35d-96ea46e85501 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14c97840-88c0-4a8e-96e8-2e7da318ad07/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:29:32 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-c210187f-0bde-4742-b35d-96ea46e85501 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=72382) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 15:29:32 user nova-compute[72382]: DEBUG nova.objects.instance [None req-c210187f-0bde-4742-b35d-96ea46e85501 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Lazy-loading 'trusted_certs' on Instance uuid 14c97840-88c0-4a8e-96e8-2e7da318ad07 {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:29:32 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-c210187f-0bde-4742-b35d-96ea46e85501 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:29:32 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-c210187f-0bde-4742-b35d-96ea46e85501 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b --force-share --output=json" returned: 0 in 0.138s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:29:32 user nova-compute[72382]: DEBUG nova.virt.disk.api [None req-c210187f-0bde-4742-b35d-96ea46e85501 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Checking if we can resize image /opt/stack/data/nova/instances/14c97840-88c0-4a8e-96e8-2e7da318ad07/disk. size=1073741824 {{(pid=72382) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 15:29:32 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-c210187f-0bde-4742-b35d-96ea46e85501 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14c97840-88c0-4a8e-96e8-2e7da318ad07/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:29:32 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-c210187f-0bde-4742-b35d-96ea46e85501 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14c97840-88c0-4a8e-96e8-2e7da318ad07/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:29:32 user nova-compute[72382]: DEBUG nova.virt.disk.api [None req-c210187f-0bde-4742-b35d-96ea46e85501 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Cannot resize image /opt/stack/data/nova/instances/14c97840-88c0-4a8e-96e8-2e7da318ad07/disk to a smaller size. {{(pid=72382) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 15:29:32 user nova-compute[72382]: DEBUG nova.objects.instance [None req-c210187f-0bde-4742-b35d-96ea46e85501 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Lazy-loading 'migration_context' on Instance uuid 14c97840-88c0-4a8e-96e8-2e7da318ad07 {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:29:32 user nova-compute[72382]: DEBUG nova.virt.libvirt.vif [None req-c210187f-0bde-4742-b35d-96ea46e85501 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T15:25:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1065057662',display_name='tempest-AttachVolumeTestJSON-server-1065057662',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1065057662',id=25,image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDpgWhLPGWY2ElRglFQBqLuKZWglAfFVsofJemv1+kc4sKM1iZJZQ3Zp8fFAbw72Xaat0sVYwxhfDdHsZAI0ReSI/gfbVL6O5P/l5QvCIWZ9WBMY/UBAwONL1kUKiqSY5Q==',key_name='tempest-keypair-138739448',keypairs=<?>,launch_index=0,launched_at=2023-08-09T15:25:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='8c1a50eacfd0414bbc13e3fd4087e998',ramdisk_id='',reservation_id='r-p2h4ne70',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-502043064',owner_user_name='tempest-AttachVolumeTestJSON-502043064-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T15:27:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='13c67153e9ec44029e8d80c09d405175',uuid=14c97840-88c0-4a8e-96e8-2e7da318ad07,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "f22c0d53-f0da-4bc9-bf7b-c10fe61e2e1f", "address": "fa:16:3e:72:44:b1", "network": {"id": "a85a6e1f-20f5-4719-90d2-0dc23ce525cd", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-780716970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c1a50eacfd0414bbc13e3fd4087e998", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf22c0d53-f0", "ovs_interfaceid": "f22c0d53-f0da-4bc9-bf7b-c10fe61e2e1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 15:29:32 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-c210187f-0bde-4742-b35d-96ea46e85501 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Converting VIF {"id": "f22c0d53-f0da-4bc9-bf7b-c10fe61e2e1f", "address": "fa:16:3e:72:44:b1", "network": {"id": "a85a6e1f-20f5-4719-90d2-0dc23ce525cd", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-780716970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c1a50eacfd0414bbc13e3fd4087e998", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf22c0d53-f0", "ovs_interfaceid": "f22c0d53-f0da-4bc9-bf7b-c10fe61e2e1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 15:29:32 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-c210187f-0bde-4742-b35d-96ea46e85501 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:72:44:b1,bridge_name='br-int',has_traffic_filtering=True,id=f22c0d53-f0da-4bc9-bf7b-c10fe61e2e1f,network=Network(a85a6e1f-20f5-4719-90d2-0dc23ce525cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf22c0d53-f0') {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 15:29:32 user nova-compute[72382]: DEBUG os_vif [None req-c210187f-0bde-4742-b35d-96ea46e85501 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:44:b1,bridge_name='br-int',has_traffic_filtering=True,id=f22c0d53-f0da-4bc9-bf7b-c10fe61e2e1f,network=Network(a85a6e1f-20f5-4719-90d2-0dc23ce525cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf22c0d53-f0') {{(pid=72382) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 15:29:32 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:29:32 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:29:32 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 15:29:32 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:29:32 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf22c0d53-f0, may_exist=True, interface_attrs={}) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:29:32 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf22c0d53-f0, col_values=(('external_ids', {'iface-id': 'f22c0d53-f0da-4bc9-bf7b-c10fe61e2e1f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:72:44:b1', 'vm-uuid': '14c97840-88c0-4a8e-96e8-2e7da318ad07'}),), if_exists=True) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:29:32 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:29:32 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:29:32 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:29:32 user nova-compute[72382]: INFO os_vif [None req-c210187f-0bde-4742-b35d-96ea46e85501 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:44:b1,bridge_name='br-int',has_traffic_filtering=True,id=f22c0d53-f0da-4bc9-bf7b-c10fe61e2e1f,network=Network(a85a6e1f-20f5-4719-90d2-0dc23ce525cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf22c0d53-f0')
Aug 09 15:29:33 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-ccd304f0-714c-4b41-b71b-6955c10fa68b tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Acquiring lock "61976531-76ae-4a1c-8950-0af784be376e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:29:33 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-ccd304f0-714c-4b41-b71b-6955c10fa68b tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Lock "61976531-76ae-4a1c-8950-0af784be376e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:29:33 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-ccd304f0-714c-4b41-b71b-6955c10fa68b tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Acquiring lock "61976531-76ae-4a1c-8950-0af784be376e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:29:33 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-ccd304f0-714c-4b41-b71b-6955c10fa68b tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Lock "61976531-76ae-4a1c-8950-0af784be376e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:29:33 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-ccd304f0-714c-4b41-b71b-6955c10fa68b tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Lock "61976531-76ae-4a1c-8950-0af784be376e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:29:33 user nova-compute[72382]: INFO nova.compute.manager [None req-ccd304f0-714c-4b41-b71b-6955c10fa68b tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] [instance: 61976531-76ae-4a1c-8950-0af784be376e] Terminating instance
Aug 09 15:29:33 user nova-compute[72382]: DEBUG nova.compute.manager [None req-ccd304f0-714c-4b41-b71b-6955c10fa68b tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] [instance: 61976531-76ae-4a1c-8950-0af784be376e] Start destroying the instance on the hypervisor. {{(pid=72382) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 15:29:33 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:29:33 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:29:33 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:29:33 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:29:33 user nova-compute[72382]: DEBUG nova.compute.manager [req-143fcf90-f685-4ec2-b766-0c19e363ba32 req-e6b58e9b-6743-4404-8cfb-16cc160e49ce service nova] [instance: 61976531-76ae-4a1c-8950-0af784be376e] Received event network-vif-unplugged-adf7f33a-6792-47f7-b8e6-4d0775b01f9d {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:29:33 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-143fcf90-f685-4ec2-b766-0c19e363ba32 req-e6b58e9b-6743-4404-8cfb-16cc160e49ce service nova] Acquiring lock "61976531-76ae-4a1c-8950-0af784be376e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:29:33 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-143fcf90-f685-4ec2-b766-0c19e363ba32 req-e6b58e9b-6743-4404-8cfb-16cc160e49ce service nova] Lock "61976531-76ae-4a1c-8950-0af784be376e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:29:33 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-143fcf90-f685-4ec2-b766-0c19e363ba32 req-e6b58e9b-6743-4404-8cfb-16cc160e49ce service nova] Lock "61976531-76ae-4a1c-8950-0af784be376e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:29:33 user nova-compute[72382]: DEBUG nova.compute.manager [req-143fcf90-f685-4ec2-b766-0c19e363ba32 req-e6b58e9b-6743-4404-8cfb-16cc160e49ce service nova] [instance: 61976531-76ae-4a1c-8950-0af784be376e] No waiting events found dispatching network-vif-unplugged-adf7f33a-6792-47f7-b8e6-4d0775b01f9d {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:29:33 user nova-compute[72382]: DEBUG nova.compute.manager [req-143fcf90-f685-4ec2-b766-0c19e363ba32 req-e6b58e9b-6743-4404-8cfb-16cc160e49ce service nova] [instance: 61976531-76ae-4a1c-8950-0af784be376e] Received event network-vif-unplugged-adf7f33a-6792-47f7-b8e6-4d0775b01f9d for instance with task_state deleting. {{(pid=72382) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 15:29:34 user nova-compute[72382]: INFO nova.virt.libvirt.driver [-] [instance: 61976531-76ae-4a1c-8950-0af784be376e] Instance destroyed successfully.
Aug 09 15:29:34 user nova-compute[72382]: DEBUG nova.objects.instance [None req-ccd304f0-714c-4b41-b71b-6955c10fa68b tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Lazy-loading 'resources' on Instance uuid 61976531-76ae-4a1c-8950-0af784be376e {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:29:34 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:29:34 user nova-compute[72382]: DEBUG nova.virt.libvirt.vif [None req-ccd304f0-714c-4b41-b71b-6955c10fa68b tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T15:23:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-581682554',display_name='tempest-AttachVolumeNegativeTest-server-581682554',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-581682554',id=23,image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCqzpgLe26+CO+iEWWZ6fk6b+sUSRBvrenyu9mxDg1V0hePyoVSSYOmkUervplRS05uiKk4LEhF0Jcm/wYq10j0UUXVE/okdH6n9YbPdapLvC1RbEJslOhj1iAjy+5zzFw==',key_name='tempest-keypair-278200558',keypairs=<?>,launch_index=0,launched_at=2023-08-09T15:23:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='98009994d9c74eb9b4fc6321e82440de',ramdisk_id='',reservation_id='r-s488sgc7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1325594356',owner_user_name='tempest-AttachVolumeNegativeTest-1325594356-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T15:23:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='401c9df41f284c88a86557485d7d9537',uuid=61976531-76ae-4a1c-8950-0af784be376e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "adf7f33a-6792-47f7-b8e6-4d0775b01f9d", "address": "fa:16:3e:d5:b3:b9", "network": {"id": "46eb5f03-e04d-43d1-96d6-0792bc7a94b1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1842512309-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98009994d9c74eb9b4fc6321e82440de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadf7f33a-67", "ovs_interfaceid": "adf7f33a-6792-47f7-b8e6-4d0775b01f9d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 15:29:34 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-ccd304f0-714c-4b41-b71b-6955c10fa68b tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Converting VIF {"id": "adf7f33a-6792-47f7-b8e6-4d0775b01f9d", "address": "fa:16:3e:d5:b3:b9", "network": {"id": "46eb5f03-e04d-43d1-96d6-0792bc7a94b1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1842512309-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98009994d9c74eb9b4fc6321e82440de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadf7f33a-67", "ovs_interfaceid": "adf7f33a-6792-47f7-b8e6-4d0775b01f9d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 15:29:34 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-ccd304f0-714c-4b41-b71b-6955c10fa68b tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d5:b3:b9,bridge_name='br-int',has_traffic_filtering=True,id=adf7f33a-6792-47f7-b8e6-4d0775b01f9d,network=Network(46eb5f03-e04d-43d1-96d6-0792bc7a94b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapadf7f33a-67') {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 15:29:34 user nova-compute[72382]: DEBUG os_vif [None req-ccd304f0-714c-4b41-b71b-6955c10fa68b tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d5:b3:b9,bridge_name='br-int',has_traffic_filtering=True,id=adf7f33a-6792-47f7-b8e6-4d0775b01f9d,network=Network(46eb5f03-e04d-43d1-96d6-0792bc7a94b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapadf7f33a-67') {{(pid=72382) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 15:29:34 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:29:34 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapadf7f33a-67, bridge=br-int, if_exists=True) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:29:34 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:29:34 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:29:34 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:29:34 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:29:34 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:29:34 user nova-compute[72382]: INFO os_vif [None req-ccd304f0-714c-4b41-b71b-6955c10fa68b tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d5:b3:b9,bridge_name='br-int',has_traffic_filtering=True,id=adf7f33a-6792-47f7-b8e6-4d0775b01f9d,network=Network(46eb5f03-e04d-43d1-96d6-0792bc7a94b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapadf7f33a-67')
Aug 09 15:29:34 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-ccd304f0-714c-4b41-b71b-6955c10fa68b tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] [instance: 61976531-76ae-4a1c-8950-0af784be376e] Deleting instance files /opt/stack/data/nova/instances/61976531-76ae-4a1c-8950-0af784be376e_del
Aug 09 15:29:34 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-ccd304f0-714c-4b41-b71b-6955c10fa68b tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] [instance: 61976531-76ae-4a1c-8950-0af784be376e] Deletion of /opt/stack/data/nova/instances/61976531-76ae-4a1c-8950-0af784be376e_del complete
Aug 09 15:29:34 user nova-compute[72382]: INFO nova.compute.manager [None req-ccd304f0-714c-4b41-b71b-6955c10fa68b tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] [instance: 61976531-76ae-4a1c-8950-0af784be376e] Took 1.27 seconds to destroy the instance on the hypervisor.
Aug 09 15:29:34 user nova-compute[72382]: DEBUG oslo.service.loopingcall [None req-ccd304f0-714c-4b41-b71b-6955c10fa68b tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72382) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 15:29:34 user nova-compute[72382]: DEBUG nova.compute.manager [-] [instance: 61976531-76ae-4a1c-8950-0af784be376e] Deallocating network for instance {{(pid=72382) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 15:29:34 user nova-compute[72382]: DEBUG nova.network.neutron [-] [instance: 61976531-76ae-4a1c-8950-0af784be376e] deallocate_for_instance() {{(pid=72382) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 15:29:34 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:29:34 user nova-compute[72382]: DEBUG nova.compute.manager [req-c053fc36-802f-414f-b967-e10c526b0b47 req-1ea266ae-35f0-459e-a956-97db6adc2493 service nova] [instance: 14c97840-88c0-4a8e-96e8-2e7da318ad07] Received event network-vif-plugged-f22c0d53-f0da-4bc9-bf7b-c10fe61e2e1f {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:29:34 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-c053fc36-802f-414f-b967-e10c526b0b47 req-1ea266ae-35f0-459e-a956-97db6adc2493 service nova] Acquiring lock "14c97840-88c0-4a8e-96e8-2e7da318ad07-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:29:34 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-c053fc36-802f-414f-b967-e10c526b0b47 req-1ea266ae-35f0-459e-a956-97db6adc2493 service nova] Lock "14c97840-88c0-4a8e-96e8-2e7da318ad07-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:29:34 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-c053fc36-802f-414f-b967-e10c526b0b47 req-1ea266ae-35f0-459e-a956-97db6adc2493 service nova] Lock "14c97840-88c0-4a8e-96e8-2e7da318ad07-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:29:34 user nova-compute[72382]: DEBUG nova.compute.manager [req-c053fc36-802f-414f-b967-e10c526b0b47 req-1ea266ae-35f0-459e-a956-97db6adc2493 service nova] [instance: 14c97840-88c0-4a8e-96e8-2e7da318ad07] No waiting events found dispatching network-vif-plugged-f22c0d53-f0da-4bc9-bf7b-c10fe61e2e1f {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:29:34 user nova-compute[72382]: WARNING nova.compute.manager [req-c053fc36-802f-414f-b967-e10c526b0b47 req-1ea266ae-35f0-459e-a956-97db6adc2493 service nova] [instance: 14c97840-88c0-4a8e-96e8-2e7da318ad07] Received unexpected event network-vif-plugged-f22c0d53-f0da-4bc9-bf7b-c10fe61e2e1f for instance with vm_state stopped and task_state powering-on.
Aug 09 15:29:34 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:29:34 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:29:34 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:29:35 user nova-compute[72382]: DEBUG nova.network.neutron [-] [instance: 61976531-76ae-4a1c-8950-0af784be376e] Updating instance_info_cache with network_info: [] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:29:35 user nova-compute[72382]: INFO nova.compute.manager [-] [instance: 61976531-76ae-4a1c-8950-0af784be376e] Took 1.00 seconds to deallocate network for instance.
Aug 09 15:29:35 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-ccd304f0-714c-4b41-b71b-6955c10fa68b tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:29:35 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-ccd304f0-714c-4b41-b71b-6955c10fa68b tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:29:35 user nova-compute[72382]: DEBUG nova.compute.manager [req-d1f39776-5b16-4c51-8fdd-b5a5fa31e279 req-d3723996-c81b-4179-b4e0-45890b996ae6 service nova] [instance: 61976531-76ae-4a1c-8950-0af784be376e] Received event network-vif-plugged-adf7f33a-6792-47f7-b8e6-4d0775b01f9d {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:29:35 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-d1f39776-5b16-4c51-8fdd-b5a5fa31e279 req-d3723996-c81b-4179-b4e0-45890b996ae6 service nova] Acquiring lock "61976531-76ae-4a1c-8950-0af784be376e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:29:35 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-d1f39776-5b16-4c51-8fdd-b5a5fa31e279 req-d3723996-c81b-4179-b4e0-45890b996ae6 service nova] Lock "61976531-76ae-4a1c-8950-0af784be376e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:29:35 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-d1f39776-5b16-4c51-8fdd-b5a5fa31e279 req-d3723996-c81b-4179-b4e0-45890b996ae6 service nova] Lock "61976531-76ae-4a1c-8950-0af784be376e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:29:35 user nova-compute[72382]: DEBUG nova.compute.manager [req-d1f39776-5b16-4c51-8fdd-b5a5fa31e279 req-d3723996-c81b-4179-b4e0-45890b996ae6 service nova] [instance: 61976531-76ae-4a1c-8950-0af784be376e] No waiting events found dispatching network-vif-plugged-adf7f33a-6792-47f7-b8e6-4d0775b01f9d {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:29:35 user nova-compute[72382]: WARNING nova.compute.manager [req-d1f39776-5b16-4c51-8fdd-b5a5fa31e279 req-d3723996-c81b-4179-b4e0-45890b996ae6 service nova] [instance: 61976531-76ae-4a1c-8950-0af784be376e] Received unexpected event network-vif-plugged-adf7f33a-6792-47f7-b8e6-4d0775b01f9d for instance with vm_state deleted and task_state None.
Aug 09 15:29:35 user nova-compute[72382]: DEBUG nova.compute.manager [req-d1f39776-5b16-4c51-8fdd-b5a5fa31e279 req-d3723996-c81b-4179-b4e0-45890b996ae6 service nova] [instance: 61976531-76ae-4a1c-8950-0af784be376e] Received event network-vif-deleted-adf7f33a-6792-47f7-b8e6-4d0775b01f9d {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:29:35 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-f023be2e-15a6-4820-9df5-4dec698589a3 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Acquiring lock "b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:29:35 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-f023be2e-15a6-4820-9df5-4dec698589a3 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Lock "b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:29:35 user nova-compute[72382]: INFO nova.compute.manager [None req-f023be2e-15a6-4820-9df5-4dec698589a3 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] [instance: b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d] Shelving
Aug 09 15:29:35 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:29:35 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:29:35 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:29:35 user nova-compute[72382]: DEBUG nova.compute.provider_tree [None req-ccd304f0-714c-4b41-b71b-6955c10fa68b tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Inventory has not changed in ProviderTree for provider: 7b15b0e5-df4d-49db-833b-2855d21d10ae {{(pid=72382) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 15:29:35 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:29:35 user nova-compute[72382]: DEBUG nova.scheduler.client.report [None req-ccd304f0-714c-4b41-b71b-6955c10fa68b tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Inventory has not changed for provider 7b15b0e5-df4d-49db-833b-2855d21d10ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72382) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 15:29:35 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-ccd304f0-714c-4b41-b71b-6955c10fa68b tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.497s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:29:35 user nova-compute[72382]: INFO nova.scheduler.client.report [None req-ccd304f0-714c-4b41-b71b-6955c10fa68b tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Deleted allocations for instance 61976531-76ae-4a1c-8950-0af784be376e
Aug 09 15:29:35 user nova-compute[72382]: DEBUG nova.compute.manager [req-f03f814f-9f03-4b49-9b6a-b025731348a0 req-9b9c3a01-6da2-4d6b-a4de-a5bd05688f02 service nova] [instance: b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d] Received event network-vif-unplugged-99b65ca7-d891-4625-917d-460e7fb69654 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:29:35 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-f03f814f-9f03-4b49-9b6a-b025731348a0 req-9b9c3a01-6da2-4d6b-a4de-a5bd05688f02 service nova] Acquiring lock "b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:29:35 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-f03f814f-9f03-4b49-9b6a-b025731348a0 req-9b9c3a01-6da2-4d6b-a4de-a5bd05688f02 service nova] Lock "b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:29:35 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-f03f814f-9f03-4b49-9b6a-b025731348a0 req-9b9c3a01-6da2-4d6b-a4de-a5bd05688f02 service nova] Lock "b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:29:35 user nova-compute[72382]: DEBUG nova.compute.manager [req-f03f814f-9f03-4b49-9b6a-b025731348a0 req-9b9c3a01-6da2-4d6b-a4de-a5bd05688f02 service nova] [instance: b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d] No waiting events found dispatching network-vif-unplugged-99b65ca7-d891-4625-917d-460e7fb69654 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:29:35 user nova-compute[72382]: WARNING nova.compute.manager [req-f03f814f-9f03-4b49-9b6a-b025731348a0 req-9b9c3a01-6da2-4d6b-a4de-a5bd05688f02 service nova] [instance: b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d] Received unexpected event network-vif-unplugged-99b65ca7-d891-4625-917d-460e7fb69654 for instance with vm_state active and task_state shelving.
Aug 09 15:29:35 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-ccd304f0-714c-4b41-b71b-6955c10fa68b tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Lock "61976531-76ae-4a1c-8950-0af784be376e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.972s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:29:36 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:29:36 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:29:36 user nova-compute[72382]: INFO nova.virt.libvirt.driver [-] [instance: b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d] Instance destroyed successfully.
Aug 09 15:29:36 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-f023be2e-15a6-4820-9df5-4dec698589a3 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] [instance: b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d] Beginning cold snapshot process
Aug 09 15:29:36 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-16d54ead-c513-4373-a481-6b82e19eceed tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Acquiring lock "5002dc68-150a-4e96-bfe7-e66c6d764b9f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:29:36 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-16d54ead-c513-4373-a481-6b82e19eceed tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Lock "5002dc68-150a-4e96-bfe7-e66c6d764b9f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:29:36 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-16d54ead-c513-4373-a481-6b82e19eceed tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Acquiring lock "5002dc68-150a-4e96-bfe7-e66c6d764b9f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:29:36 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-16d54ead-c513-4373-a481-6b82e19eceed tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Lock "5002dc68-150a-4e96-bfe7-e66c6d764b9f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:29:36 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-16d54ead-c513-4373-a481-6b82e19eceed tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Lock "5002dc68-150a-4e96-bfe7-e66c6d764b9f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:29:36 user nova-compute[72382]: DEBUG nova.compute.manager [req-dfd7b872-c4ba-46ee-8b01-1244a949d226 req-a2f4fd8a-c89a-4666-b85d-34b5e7d978b9 service nova] [instance: 14c97840-88c0-4a8e-96e8-2e7da318ad07] Received event network-vif-plugged-f22c0d53-f0da-4bc9-bf7b-c10fe61e2e1f {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:29:36 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-dfd7b872-c4ba-46ee-8b01-1244a949d226 req-a2f4fd8a-c89a-4666-b85d-34b5e7d978b9 service nova] Acquiring lock "14c97840-88c0-4a8e-96e8-2e7da318ad07-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:29:36 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-dfd7b872-c4ba-46ee-8b01-1244a949d226 req-a2f4fd8a-c89a-4666-b85d-34b5e7d978b9 service nova] Lock "14c97840-88c0-4a8e-96e8-2e7da318ad07-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:29:36 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-dfd7b872-c4ba-46ee-8b01-1244a949d226 req-a2f4fd8a-c89a-4666-b85d-34b5e7d978b9 service nova] Lock "14c97840-88c0-4a8e-96e8-2e7da318ad07-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:29:36 user nova-compute[72382]: DEBUG nova.compute.manager [req-dfd7b872-c4ba-46ee-8b01-1244a949d226 req-a2f4fd8a-c89a-4666-b85d-34b5e7d978b9 service nova] [instance: 14c97840-88c0-4a8e-96e8-2e7da318ad07] No waiting events found dispatching network-vif-plugged-f22c0d53-f0da-4bc9-bf7b-c10fe61e2e1f {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:29:36 user nova-compute[72382]: WARNING nova.compute.manager [req-dfd7b872-c4ba-46ee-8b01-1244a949d226 req-a2f4fd8a-c89a-4666-b85d-34b5e7d978b9 service nova] [instance: 14c97840-88c0-4a8e-96e8-2e7da318ad07] Received unexpected event network-vif-plugged-f22c0d53-f0da-4bc9-bf7b-c10fe61e2e1f for instance with vm_state stopped and task_state powering-on.
Aug 09 15:29:36 user nova-compute[72382]: INFO nova.compute.manager [None req-16d54ead-c513-4373-a481-6b82e19eceed tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: 5002dc68-150a-4e96-bfe7-e66c6d764b9f] Terminating instance
Aug 09 15:29:36 user nova-compute[72382]: DEBUG nova.compute.manager [None req-16d54ead-c513-4373-a481-6b82e19eceed tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: 5002dc68-150a-4e96-bfe7-e66c6d764b9f] Start destroying the instance on the hypervisor. {{(pid=72382) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 15:29:36 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:29:36 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:29:36 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:29:36 user nova-compute[72382]: DEBUG nova.privsep.utils [None req-f023be2e-15a6-4820-9df5-4dec698589a3 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72382) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 09 15:29:36 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-f023be2e-15a6-4820-9df5-4dec698589a3 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d/disk /opt/stack/data/nova/instances/snapshots/tmpxfddq6fs/37b864c54c224725be45445d82831554 {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:29:36 user nova-compute[72382]: DEBUG nova.virt.driver [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Emitting event <LifecycleEvent: 1691594976.707739, 14c97840-88c0-4a8e-96e8-2e7da318ad07 => Resumed> {{(pid=72382) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 15:29:36 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 14c97840-88c0-4a8e-96e8-2e7da318ad07] VM Resumed (Lifecycle Event)
Aug 09 15:29:36 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:29:36 user nova-compute[72382]: DEBUG nova.compute.manager [None req-c210187f-0bde-4742-b35d-96ea46e85501 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] [instance: 14c97840-88c0-4a8e-96e8-2e7da318ad07] Instance event wait completed in 0 seconds for  {{(pid=72382) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 15:29:36 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 14c97840-88c0-4a8e-96e8-2e7da318ad07] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:29:36 user nova-compute[72382]: INFO nova.virt.libvirt.driver [-] [instance: 14c97840-88c0-4a8e-96e8-2e7da318ad07] Instance rebooted successfully.
Aug 09 15:29:36 user nova-compute[72382]: DEBUG nova.compute.manager [None req-c210187f-0bde-4742-b35d-96ea46e85501 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] [instance: 14c97840-88c0-4a8e-96e8-2e7da318ad07] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:29:36 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 14c97840-88c0-4a8e-96e8-2e7da318ad07] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=72382) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 15:29:36 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 14c97840-88c0-4a8e-96e8-2e7da318ad07] During sync_power_state the instance has a pending task (powering-on). Skip.
Aug 09 15:29:36 user nova-compute[72382]: DEBUG nova.virt.driver [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Emitting event <LifecycleEvent: 1691594976.709693, 14c97840-88c0-4a8e-96e8-2e7da318ad07 => Started> {{(pid=72382) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 15:29:36 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 14c97840-88c0-4a8e-96e8-2e7da318ad07] VM Started (Lifecycle Event)
Aug 09 15:29:36 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 14c97840-88c0-4a8e-96e8-2e7da318ad07] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:29:36 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 14c97840-88c0-4a8e-96e8-2e7da318ad07] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=72382) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 15:29:37 user nova-compute[72382]: INFO nova.virt.libvirt.driver [-] [instance: 5002dc68-150a-4e96-bfe7-e66c6d764b9f] Instance destroyed successfully.
Aug 09 15:29:37 user nova-compute[72382]: DEBUG nova.objects.instance [None req-16d54ead-c513-4373-a481-6b82e19eceed tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Lazy-loading 'resources' on Instance uuid 5002dc68-150a-4e96-bfe7-e66c6d764b9f {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:29:37 user nova-compute[72382]: DEBUG nova.virt.libvirt.vif [None req-16d54ead-c513-4373-a481-6b82e19eceed tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T15:27:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-197734401',display_name='tempest-TestVolumeBootPattern-server-197734401',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-197734401',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-09T15:28:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='70310b1af40b4d239fe5ea362972554b',ramdisk_id='',reservation_id='r-ovztepxm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-451643589',owner_user_name='tempest-TestVolumeBootPattern-451643589-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T15:28:07Z,user_data=None,user_id='280bcf2afd7245a7bcd605e0db79c569',uuid=5002dc68-150a-4e96-bfe7-e66c6d764b9f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a778401a-b0e7-45f5-9148-86853431427d", "address": "fa:16:3e:bf:ea:de", "network": {"id": "a78e6cb6-feb7-4f64-a3c0-4900594b6e37", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-338007968-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70310b1af40b4d239fe5ea362972554b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa778401a-b0", "ovs_interfaceid": "a778401a-b0e7-45f5-9148-86853431427d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 15:29:37 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-16d54ead-c513-4373-a481-6b82e19eceed tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Converting VIF {"id": "a778401a-b0e7-45f5-9148-86853431427d", "address": "fa:16:3e:bf:ea:de", "network": {"id": "a78e6cb6-feb7-4f64-a3c0-4900594b6e37", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-338007968-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70310b1af40b4d239fe5ea362972554b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa778401a-b0", "ovs_interfaceid": "a778401a-b0e7-45f5-9148-86853431427d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 15:29:37 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-16d54ead-c513-4373-a481-6b82e19eceed tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bf:ea:de,bridge_name='br-int',has_traffic_filtering=True,id=a778401a-b0e7-45f5-9148-86853431427d,network=Network(a78e6cb6-feb7-4f64-a3c0-4900594b6e37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa778401a-b0') {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 15:29:37 user nova-compute[72382]: DEBUG os_vif [None req-16d54ead-c513-4373-a481-6b82e19eceed tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bf:ea:de,bridge_name='br-int',has_traffic_filtering=True,id=a778401a-b0e7-45f5-9148-86853431427d,network=Network(a78e6cb6-feb7-4f64-a3c0-4900594b6e37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa778401a-b0') {{(pid=72382) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 15:29:37 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:29:37 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa778401a-b0, bridge=br-int, if_exists=True) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:29:37 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:29:37 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:29:37 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:29:37 user nova-compute[72382]: INFO os_vif [None req-16d54ead-c513-4373-a481-6b82e19eceed tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bf:ea:de,bridge_name='br-int',has_traffic_filtering=True,id=a778401a-b0e7-45f5-9148-86853431427d,network=Network(a78e6cb6-feb7-4f64-a3c0-4900594b6e37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa778401a-b0')
Aug 09 15:29:37 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-16d54ead-c513-4373-a481-6b82e19eceed tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: 5002dc68-150a-4e96-bfe7-e66c6d764b9f] calling os-brick to detach iSCSI Volume {{(pid=72382) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 15:29:37 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-16d54ead-c513-4373-a481-6b82e19eceed tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2a0c768340>, {'target_iqns': ['iqn.2010-10.org.openstack:37c53941-47c4-4d6d-8826-d0833f90643e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kyeaOCtp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 15:29:37 user nova-compute[72382]: WARNING os_brick.initiator.connectors.base [None req-16d54ead-c513-4373-a481-6b82e19eceed tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 15:29:37 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-16d54ead-c513-4373-a481-6b82e19eceed tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 15:29:37 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-16d54ead-c513-4373-a481-6b82e19eceed tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 15:29:37 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-16d54ead-c513-4373-a481-6b82e19eceed tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:37c53941-47c4-4d6d-8826-d0833f90643e', 0)] {{(pid=72382) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 15:29:37 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:29:37 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:29:37 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f03cf97-d381-4db8-9a2d-7d2a0a2364f8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:25503c6e-bfc0-4008-846a-8cad783fc0fb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:37c53941-47c4-4d6d-8826-d0833f90643e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9fb38a17-5c70-4b9b-909a-614a81e5b75b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bd90521a-f3b5-485c-9fb9-61ab37267f3a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e62d4416-be8c-4327-9a51-0cc509109c53\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:29:37 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:29:37 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:29:37 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb3c028a-16bc-42d7-99b8-64ec8d5c6aa6]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd90521a-f3b5-485c-9fb9-61ab37267f3a (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25503c6e-bfc0-4008-846a-8cad783fc0fb (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37c53941-47c4-4d6d-8826-d0833f90643e (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fb38a17-5c70-4b9b-909a-614a81e5b75b (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e62d4416-be8c-4327-9a51-0cc509109c53 (non-flash)\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:29:37 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-16d54ead-c513-4373-a481-6b82e19eceed tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)
Aug 09 15:29:37 user nova-compute[72382]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd90521a-f3b5-485c-9fb9-61ab37267f3a (non-flash)
Aug 09 15:29:37 user nova-compute[72382]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25503c6e-bfc0-4008-846a-8cad783fc0fb (non-flash)
Aug 09 15:29:37 user nova-compute[72382]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37c53941-47c4-4d6d-8826-d0833f90643e (non-flash)
Aug 09 15:29:37 user nova-compute[72382]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fb38a17-5c70-4b9b-909a-614a81e5b75b (non-flash)
Aug 09 15:29:37 user nova-compute[72382]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e62d4416-be8c-4327-9a51-0cc509109c53 (non-flash)
Aug 09 15:29:37 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 15:29:37 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-16d54ead-c513-4373-a481-6b82e19eceed tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)
Aug 09 15:29:37 user nova-compute[72382]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd90521a-f3b5-485c-9fb9-61ab37267f3a (non-flash)
Aug 09 15:29:37 user nova-compute[72382]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25503c6e-bfc0-4008-846a-8cad783fc0fb (non-flash)
Aug 09 15:29:37 user nova-compute[72382]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37c53941-47c4-4d6d-8826-d0833f90643e (non-flash)
Aug 09 15:29:37 user nova-compute[72382]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fb38a17-5c70-4b9b-909a-614a81e5b75b (non-flash)
Aug 09 15:29:37 user nova-compute[72382]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e62d4416-be8c-4327-9a51-0cc509109c53 (non-flash)
Aug 09 15:29:37 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 15:29:37 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-16d54ead-c513-4373-a481-6b82e19eceed tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2a0c210280>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:37c53941-47c4-4d6d-8826-d0833f90643e'): ({'sdg'}, set())}) {{(pid=72382) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 15:29:37 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-16d54ead-c513-4373-a481-6b82e19eceed tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Removing single pathed devices sdg {{(pid=72382) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 15:29:37 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:29:37 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:29:37 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0e20606-271c-4e13-8fc2-3918a9216633]: (4, ('path checker states:\nup                  5\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:29:37 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:29:37 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-f023be2e-15a6-4820-9df5-4dec698589a3 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d/disk /opt/stack/data/nova/instances/snapshots/tmpxfddq6fs/37b864c54c224725be45445d82831554" returned: 0 in 0.924s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:29:37 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-f023be2e-15a6-4820-9df5-4dec698589a3 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] [instance: b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d] Snapshot extracted, beginning image upload
Aug 09 15:29:37 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.023s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:29:37 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3b71ffa-9e6d-4378-baff-5f6f202853a6]: (4, ('ok\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:29:37 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-16d54ead-c513-4373-a481-6b82e19eceed tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Flushing IO for device /dev/sdg {{(pid=72382) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 15:29:37 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:29:37 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.015s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:29:37 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[968e3464-2faa-4338-9aef-09d9c65e510b]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:29:37 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-16d54ead-c513-4373-a481-6b82e19eceed tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=72382) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 15:29:37 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:29:37 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.060s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:29:37 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[384ebbb0-556b-45d8-bbc7-729663f49d71]: (4, ('1', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:29:37 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-16d54ead-c513-4373-a481-6b82e19eceed tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=72382) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 15:29:37 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-16d54ead-c513-4373-a481-6b82e19eceed tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] SCSI volumes sdg have been removed. {{(pid=72382) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 15:29:37 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-16d54ead-c513-4373-a481-6b82e19eceed tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:37c53941-47c4-4d6d-8826-d0833f90643e')] {{(pid=72382) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 15:29:37 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37c53941-47c4-4d6d-8826-d0833f90643e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:29:37 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37c53941-47c4-4d6d-8826-d0833f90643e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:29:37 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebfc8fa5-e0a6-4ca4-abd9-894b6c0f2c43]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:29:37 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-16d54ead-c513-4373-a481-6b82e19eceed tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:29:37 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37c53941-47c4-4d6d-8826-d0833f90643e -p 172.16.0.220:3260 --logout {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:29:37 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37c53941-47c4-4d6d-8826-d0833f90643e -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:29:37 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[d386e235-a098-4ccd-ae07-a94a37839063]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:37c53941-47c4-4d6d-8826-d0833f90643e, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:37c53941-47c4-4d6d-8826-d0833f90643e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:29:37 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-16d54ead-c513-4373-a481-6b82e19eceed tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:37c53941-47c4-4d6d-8826-d0833f90643e, portal: 172.16.0.220,3260]
Aug 09 15:29:37 user nova-compute[72382]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:37c53941-47c4-4d6d-8826-d0833f90643e, portal: 172.16.0.220,3260] successful.
Aug 09 15:29:37 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:29:37 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37c53941-47c4-4d6d-8826-d0833f90643e -p 172.16.0.220:3260 --op delete {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:29:37 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37c53941-47c4-4d6d-8826-d0833f90643e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:29:37 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[78df0011-46f7-4858-9e5f-92bd1f391062]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:29:37 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-16d54ead-c513-4373-a481-6b82e19eceed tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:29:37 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-16d54ead-c513-4373-a481-6b82e19eceed tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.344s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 15:29:37 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-16d54ead-c513-4373-a481-6b82e19eceed tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] <== disconnect_volume: return (345ms) None {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 15:29:37 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-16d54ead-c513-4373-a481-6b82e19eceed tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: 5002dc68-150a-4e96-bfe7-e66c6d764b9f] Disconnected iSCSI Volume {{(pid=72382) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 15:29:37 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-16d54ead-c513-4373-a481-6b82e19eceed tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: 5002dc68-150a-4e96-bfe7-e66c6d764b9f] Deleting instance files /opt/stack/data/nova/instances/5002dc68-150a-4e96-bfe7-e66c6d764b9f_del
Aug 09 15:29:37 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-16d54ead-c513-4373-a481-6b82e19eceed tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: 5002dc68-150a-4e96-bfe7-e66c6d764b9f] Deletion of /opt/stack/data/nova/instances/5002dc68-150a-4e96-bfe7-e66c6d764b9f_del complete
Aug 09 15:29:37 user nova-compute[72382]: INFO nova.compute.manager [None req-16d54ead-c513-4373-a481-6b82e19eceed tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: 5002dc68-150a-4e96-bfe7-e66c6d764b9f] Took 1.36 seconds to destroy the instance on the hypervisor.
Aug 09 15:29:37 user nova-compute[72382]: DEBUG oslo.service.loopingcall [None req-16d54ead-c513-4373-a481-6b82e19eceed tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72382) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 15:29:37 user nova-compute[72382]: DEBUG nova.compute.manager [-] [instance: 5002dc68-150a-4e96-bfe7-e66c6d764b9f] Deallocating network for instance {{(pid=72382) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 15:29:37 user nova-compute[72382]: DEBUG nova.network.neutron [-] [instance: 5002dc68-150a-4e96-bfe7-e66c6d764b9f] deallocate_for_instance() {{(pid=72382) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 15:29:38 user nova-compute[72382]: DEBUG nova.compute.manager [req-457ec35d-2647-4f06-9c0b-0b9361f9e380 req-106e34da-424e-473a-bd4c-bfca448c3d61 service nova] [instance: b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d] Received event network-vif-plugged-99b65ca7-d891-4625-917d-460e7fb69654 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:29:38 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-457ec35d-2647-4f06-9c0b-0b9361f9e380 req-106e34da-424e-473a-bd4c-bfca448c3d61 service nova] Acquiring lock "b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:29:38 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-457ec35d-2647-4f06-9c0b-0b9361f9e380 req-106e34da-424e-473a-bd4c-bfca448c3d61 service nova] Lock "b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:29:38 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-457ec35d-2647-4f06-9c0b-0b9361f9e380 req-106e34da-424e-473a-bd4c-bfca448c3d61 service nova] Lock "b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:29:38 user nova-compute[72382]: DEBUG nova.compute.manager [req-457ec35d-2647-4f06-9c0b-0b9361f9e380 req-106e34da-424e-473a-bd4c-bfca448c3d61 service nova] [instance: b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d] No waiting events found dispatching network-vif-plugged-99b65ca7-d891-4625-917d-460e7fb69654 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:29:38 user nova-compute[72382]: WARNING nova.compute.manager [req-457ec35d-2647-4f06-9c0b-0b9361f9e380 req-106e34da-424e-473a-bd4c-bfca448c3d61 service nova] [instance: b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d] Received unexpected event network-vif-plugged-99b65ca7-d891-4625-917d-460e7fb69654 for instance with vm_state active and task_state shelving_image_uploading.
Aug 09 15:29:38 user nova-compute[72382]: DEBUG nova.network.neutron [-] [instance: 5002dc68-150a-4e96-bfe7-e66c6d764b9f] Updating instance_info_cache with network_info: [] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:29:38 user nova-compute[72382]: INFO nova.compute.manager [-] [instance: 5002dc68-150a-4e96-bfe7-e66c6d764b9f] Took 0.78 seconds to deallocate network for instance.
Aug 09 15:29:38 user nova-compute[72382]: DEBUG nova.compute.manager [req-88e080ce-614c-402b-8e7e-d85c384c2f05 req-753b8ad0-8279-4442-bfcf-3d6fe315d0bd service nova] [instance: 5002dc68-150a-4e96-bfe7-e66c6d764b9f] Received event network-vif-unplugged-a778401a-b0e7-45f5-9148-86853431427d {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:29:38 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-88e080ce-614c-402b-8e7e-d85c384c2f05 req-753b8ad0-8279-4442-bfcf-3d6fe315d0bd service nova] Acquiring lock "5002dc68-150a-4e96-bfe7-e66c6d764b9f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:29:38 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-88e080ce-614c-402b-8e7e-d85c384c2f05 req-753b8ad0-8279-4442-bfcf-3d6fe315d0bd service nova] Lock "5002dc68-150a-4e96-bfe7-e66c6d764b9f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:29:38 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-88e080ce-614c-402b-8e7e-d85c384c2f05 req-753b8ad0-8279-4442-bfcf-3d6fe315d0bd service nova] Lock "5002dc68-150a-4e96-bfe7-e66c6d764b9f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:29:38 user nova-compute[72382]: DEBUG nova.compute.manager [req-88e080ce-614c-402b-8e7e-d85c384c2f05 req-753b8ad0-8279-4442-bfcf-3d6fe315d0bd service nova] [instance: 5002dc68-150a-4e96-bfe7-e66c6d764b9f] No waiting events found dispatching network-vif-unplugged-a778401a-b0e7-45f5-9148-86853431427d {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:29:38 user nova-compute[72382]: DEBUG nova.compute.manager [req-88e080ce-614c-402b-8e7e-d85c384c2f05 req-753b8ad0-8279-4442-bfcf-3d6fe315d0bd service nova] [instance: 5002dc68-150a-4e96-bfe7-e66c6d764b9f] Received event network-vif-unplugged-a778401a-b0e7-45f5-9148-86853431427d for instance with task_state deleting. {{(pid=72382) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 15:29:38 user nova-compute[72382]: DEBUG nova.compute.manager [req-88e080ce-614c-402b-8e7e-d85c384c2f05 req-753b8ad0-8279-4442-bfcf-3d6fe315d0bd service nova] [instance: 5002dc68-150a-4e96-bfe7-e66c6d764b9f] Received event network-vif-plugged-a778401a-b0e7-45f5-9148-86853431427d {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:29:38 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-88e080ce-614c-402b-8e7e-d85c384c2f05 req-753b8ad0-8279-4442-bfcf-3d6fe315d0bd service nova] Acquiring lock "5002dc68-150a-4e96-bfe7-e66c6d764b9f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:29:38 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-88e080ce-614c-402b-8e7e-d85c384c2f05 req-753b8ad0-8279-4442-bfcf-3d6fe315d0bd service nova] Lock "5002dc68-150a-4e96-bfe7-e66c6d764b9f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:29:38 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-88e080ce-614c-402b-8e7e-d85c384c2f05 req-753b8ad0-8279-4442-bfcf-3d6fe315d0bd service nova] Lock "5002dc68-150a-4e96-bfe7-e66c6d764b9f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:29:38 user nova-compute[72382]: DEBUG nova.compute.manager [req-88e080ce-614c-402b-8e7e-d85c384c2f05 req-753b8ad0-8279-4442-bfcf-3d6fe315d0bd service nova] [instance: 5002dc68-150a-4e96-bfe7-e66c6d764b9f] No waiting events found dispatching network-vif-plugged-a778401a-b0e7-45f5-9148-86853431427d {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:29:38 user nova-compute[72382]: WARNING nova.compute.manager [req-88e080ce-614c-402b-8e7e-d85c384c2f05 req-753b8ad0-8279-4442-bfcf-3d6fe315d0bd service nova] [instance: 5002dc68-150a-4e96-bfe7-e66c6d764b9f] Received unexpected event network-vif-plugged-a778401a-b0e7-45f5-9148-86853431427d for instance with vm_state active and task_state deleting.
Aug 09 15:29:38 user nova-compute[72382]: DEBUG nova.compute.manager [req-9fa46ae9-1c35-4574-bb15-c43fdf49f7ff req-400c4ff6-6186-4715-af6c-4110380da6ef service nova] [instance: 5002dc68-150a-4e96-bfe7-e66c6d764b9f] Received event network-vif-deleted-a778401a-b0e7-45f5-9148-86853431427d {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:29:38 user nova-compute[72382]: INFO nova.compute.manager [req-9fa46ae9-1c35-4574-bb15-c43fdf49f7ff req-400c4ff6-6186-4715-af6c-4110380da6ef service nova] [instance: 5002dc68-150a-4e96-bfe7-e66c6d764b9f] Neutron deleted interface a778401a-b0e7-45f5-9148-86853431427d; detaching it from the instance and deleting it from the info cache
Aug 09 15:29:38 user nova-compute[72382]: DEBUG nova.network.neutron [req-9fa46ae9-1c35-4574-bb15-c43fdf49f7ff req-400c4ff6-6186-4715-af6c-4110380da6ef service nova] [instance: 5002dc68-150a-4e96-bfe7-e66c6d764b9f] Updating instance_info_cache with network_info: [] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:29:38 user nova-compute[72382]: DEBUG nova.compute.manager [req-9fa46ae9-1c35-4574-bb15-c43fdf49f7ff req-400c4ff6-6186-4715-af6c-4110380da6ef service nova] [instance: 5002dc68-150a-4e96-bfe7-e66c6d764b9f] Detach interface failed, port_id=a778401a-b0e7-45f5-9148-86853431427d, reason: Instance 5002dc68-150a-4e96-bfe7-e66c6d764b9f could not be found. {{(pid=72382) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 09 15:29:39 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:29:39 user nova-compute[72382]: INFO nova.compute.manager [None req-16d54ead-c513-4373-a481-6b82e19eceed tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: 5002dc68-150a-4e96-bfe7-e66c6d764b9f] Took 0.88 seconds to detach 1 volumes for instance.
Aug 09 15:29:39 user nova-compute[72382]: DEBUG nova.compute.manager [None req-16d54ead-c513-4373-a481-6b82e19eceed tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: 5002dc68-150a-4e96-bfe7-e66c6d764b9f] Deleting volume: 37c53941-47c4-4d6d-8826-d0833f90643e {{(pid=72382) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 09 15:29:39 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-16d54ead-c513-4373-a481-6b82e19eceed tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:29:39 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-16d54ead-c513-4373-a481-6b82e19eceed tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:29:39 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-a1cd7668-7055-4a63-8af1-43ad0532a38b tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] Acquiring lock "e0adbec9-eb22-4147-8c46-df7d02879f37" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:29:39 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-a1cd7668-7055-4a63-8af1-43ad0532a38b tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] Lock "e0adbec9-eb22-4147-8c46-df7d02879f37" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:29:39 user nova-compute[72382]: INFO nova.compute.manager [None req-a1cd7668-7055-4a63-8af1-43ad0532a38b tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] [instance: e0adbec9-eb22-4147-8c46-df7d02879f37] Detaching volume 9fb38a17-5c70-4b9b-909a-614a81e5b75b
Aug 09 15:29:39 user nova-compute[72382]: INFO nova.virt.block_device [None req-a1cd7668-7055-4a63-8af1-43ad0532a38b tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] [instance: e0adbec9-eb22-4147-8c46-df7d02879f37] Attempting to driver detach volume 9fb38a17-5c70-4b9b-909a-614a81e5b75b from mountpoint /dev/vdb
Aug 09 15:29:39 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-a1cd7668-7055-4a63-8af1-43ad0532a38b tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] Attempting to detach device vdb from instance e0adbec9-eb22-4147-8c46-df7d02879f37 from the persistent domain config. {{(pid=72382) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 15:29:39 user nova-compute[72382]: DEBUG nova.virt.libvirt.guest [None req-a1cd7668-7055-4a63-8af1-43ad0532a38b tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 15:29:39 user nova-compute[72382]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 15:29:39 user nova-compute[72382]:   <source dev="/dev/sdb"/>
Aug 09 15:29:39 user nova-compute[72382]:   <target dev="vdb" bus="virtio"/>
Aug 09 15:29:39 user nova-compute[72382]:   <serial>9fb38a17-5c70-4b9b-909a-614a81e5b75b</serial>
Aug 09 15:29:39 user nova-compute[72382]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 15:29:39 user nova-compute[72382]: </disk>
Aug 09 15:29:39 user nova-compute[72382]:  {{(pid=72382) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 15:29:39 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-a1cd7668-7055-4a63-8af1-43ad0532a38b tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] Successfully detached device vdb from instance e0adbec9-eb22-4147-8c46-df7d02879f37 from the persistent domain config.
Aug 09 15:29:39 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-a1cd7668-7055-4a63-8af1-43ad0532a38b tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e0adbec9-eb22-4147-8c46-df7d02879f37 from the live domain config. {{(pid=72382) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 15:29:39 user nova-compute[72382]: DEBUG nova.virt.libvirt.guest [None req-a1cd7668-7055-4a63-8af1-43ad0532a38b tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 15:29:39 user nova-compute[72382]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 15:29:39 user nova-compute[72382]:   <source dev="/dev/sdb"/>
Aug 09 15:29:39 user nova-compute[72382]:   <target dev="vdb" bus="virtio"/>
Aug 09 15:29:39 user nova-compute[72382]:   <serial>9fb38a17-5c70-4b9b-909a-614a81e5b75b</serial>
Aug 09 15:29:39 user nova-compute[72382]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 15:29:39 user nova-compute[72382]: </disk>
Aug 09 15:29:39 user nova-compute[72382]:  {{(pid=72382) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 15:29:40 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-2c2a5464-daed-46b8-994d-62e164c93ba0 tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] Acquiring lock "e0adbec9-eb22-4147-8c46-df7d02879f37" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:29:40 user nova-compute[72382]: DEBUG nova.compute.provider_tree [None req-16d54ead-c513-4373-a481-6b82e19eceed tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Inventory has not changed in ProviderTree for provider: 7b15b0e5-df4d-49db-833b-2855d21d10ae {{(pid=72382) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 15:29:40 user nova-compute[72382]: DEBUG nova.scheduler.client.report [None req-16d54ead-c513-4373-a481-6b82e19eceed tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Inventory has not changed for provider 7b15b0e5-df4d-49db-833b-2855d21d10ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72382) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 15:29:40 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-16d54ead-c513-4373-a481-6b82e19eceed tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.741s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:29:40 user nova-compute[72382]: INFO nova.scheduler.client.report [None req-16d54ead-c513-4373-a481-6b82e19eceed tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Deleted allocations for instance 5002dc68-150a-4e96-bfe7-e66c6d764b9f
Aug 09 15:29:40 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Received event <DeviceRemovedEvent: 1691594980.643661, e0adbec9-eb22-4147-8c46-df7d02879f37 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72382) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 15:29:40 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-a1cd7668-7055-4a63-8af1-43ad0532a38b tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e0adbec9-eb22-4147-8c46-df7d02879f37 {{(pid=72382) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 15:29:40 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-a1cd7668-7055-4a63-8af1-43ad0532a38b tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] Successfully detached device vdb from instance e0adbec9-eb22-4147-8c46-df7d02879f37 from the live domain config.
Aug 09 15:29:40 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a1cd7668-7055-4a63-8af1-43ad0532a38b tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] [instance: e0adbec9-eb22-4147-8c46-df7d02879f37] calling os-brick to detach iSCSI Volume {{(pid=72382) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 15:29:40 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1cd7668-7055-4a63-8af1-43ad0532a38b tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2a0c768340>, {'target_iqns': ['iqn.2010-10.org.openstack:9fb38a17-5c70-4b9b-909a-614a81e5b75b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XMTyoqHY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 15:29:40 user nova-compute[72382]: WARNING os_brick.initiator.connectors.base [None req-a1cd7668-7055-4a63-8af1-43ad0532a38b tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 15:29:40 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-a1cd7668-7055-4a63-8af1-43ad0532a38b tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 15:29:40 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-a1cd7668-7055-4a63-8af1-43ad0532a38b tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 15:29:40 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1cd7668-7055-4a63-8af1-43ad0532a38b tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9fb38a17-5c70-4b9b-909a-614a81e5b75b', 0)] {{(pid=72382) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 15:29:40 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:29:40 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-16d54ead-c513-4373-a481-6b82e19eceed tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Lock "5002dc68-150a-4e96-bfe7-e66c6d764b9f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.157s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:29:40 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.067s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:29:40 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b19df31-3410-4199-b94e-9b42b3b705c3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:25503c6e-bfc0-4008-846a-8cad783fc0fb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9fb38a17-5c70-4b9b-909a-614a81e5b75b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bd90521a-f3b5-485c-9fb9-61ab37267f3a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e62d4416-be8c-4327-9a51-0cc509109c53\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:29:40 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:29:40 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:29:40 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[00a8c722-d85b-4a47-a457-feca3b56ce2b]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd90521a-f3b5-485c-9fb9-61ab37267f3a (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25503c6e-bfc0-4008-846a-8cad783fc0fb (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fb38a17-5c70-4b9b-909a-614a81e5b75b (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e62d4416-be8c-4327-9a51-0cc509109c53 (non-flash)\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:29:40 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1cd7668-7055-4a63-8af1-43ad0532a38b tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)
Aug 09 15:29:40 user nova-compute[72382]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd90521a-f3b5-485c-9fb9-61ab37267f3a (non-flash)
Aug 09 15:29:40 user nova-compute[72382]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25503c6e-bfc0-4008-846a-8cad783fc0fb (non-flash)
Aug 09 15:29:40 user nova-compute[72382]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fb38a17-5c70-4b9b-909a-614a81e5b75b (non-flash)
Aug 09 15:29:40 user nova-compute[72382]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e62d4416-be8c-4327-9a51-0cc509109c53 (non-flash)
Aug 09 15:29:40 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 15:29:40 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1cd7668-7055-4a63-8af1-43ad0532a38b tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)
Aug 09 15:29:40 user nova-compute[72382]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd90521a-f3b5-485c-9fb9-61ab37267f3a (non-flash)
Aug 09 15:29:40 user nova-compute[72382]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25503c6e-bfc0-4008-846a-8cad783fc0fb (non-flash)
Aug 09 15:29:40 user nova-compute[72382]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fb38a17-5c70-4b9b-909a-614a81e5b75b (non-flash)
Aug 09 15:29:40 user nova-compute[72382]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e62d4416-be8c-4327-9a51-0cc509109c53 (non-flash)
Aug 09 15:29:40 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 15:29:40 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1cd7668-7055-4a63-8af1-43ad0532a38b tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2a0c34b0a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9fb38a17-5c70-4b9b-909a-614a81e5b75b'): ({'sdb'}, set())}) {{(pid=72382) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 15:29:40 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-a1cd7668-7055-4a63-8af1-43ad0532a38b tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] Removing single pathed devices sdb {{(pid=72382) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 15:29:40 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:29:40 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:29:40 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9896c59-f1bb-4f1b-874d-5093846bfe65]: (4, ('path checker states:\nup                  4\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:29:40 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:29:40 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.031s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:29:40 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[9377cb6f-5555-4e1e-bad2-a37a5200b1c3]: (4, ('ok\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:29:40 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-a1cd7668-7055-4a63-8af1-43ad0532a38b tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] Flushing IO for device /dev/sdb {{(pid=72382) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 15:29:40 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:29:40 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.019s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:29:40 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[3241a76b-5e0c-4f7f-a752-37fcc37c1fbe]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:29:40 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-a1cd7668-7055-4a63-8af1-43ad0532a38b tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72382) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 15:29:40 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:29:40 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.070s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:29:40 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[79184f15-e290-4aec-98ac-14c16991b5e1]: (4, ('1', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:29:40 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-a1cd7668-7055-4a63-8af1-43ad0532a38b tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72382) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 15:29:40 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-a1cd7668-7055-4a63-8af1-43ad0532a38b tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] SCSI volumes sdb have been removed. {{(pid=72382) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 15:29:40 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1cd7668-7055-4a63-8af1-43ad0532a38b tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9fb38a17-5c70-4b9b-909a-614a81e5b75b')] {{(pid=72382) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 15:29:40 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9fb38a17-5c70-4b9b-909a-614a81e5b75b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:29:41 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9fb38a17-5c70-4b9b-909a-614a81e5b75b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:29:41 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4a0a51a-4e97-4066-9b19-c9510301eeb4]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:29:41 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1cd7668-7055-4a63-8af1-43ad0532a38b tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:29:41 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9fb38a17-5c70-4b9b-909a-614a81e5b75b -p 172.16.0.220:3260 --logout {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:29:41 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9fb38a17-5c70-4b9b-909a-614a81e5b75b -p 172.16.0.220:3260 --logout" returned: 0 in 0.094s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:29:41 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[830a4135-35bb-4cee-8222-3bf133b62c27]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:9fb38a17-5c70-4b9b-909a-614a81e5b75b, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:9fb38a17-5c70-4b9b-909a-614a81e5b75b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:29:41 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1cd7668-7055-4a63-8af1-43ad0532a38b tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:9fb38a17-5c70-4b9b-909a-614a81e5b75b, portal: 172.16.0.220,3260]
Aug 09 15:29:41 user nova-compute[72382]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:9fb38a17-5c70-4b9b-909a-614a81e5b75b, portal: 172.16.0.220,3260] successful.
Aug 09 15:29:41 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:29:41 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9fb38a17-5c70-4b9b-909a-614a81e5b75b -p 172.16.0.220:3260 --op delete {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:29:41 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9fb38a17-5c70-4b9b-909a-614a81e5b75b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.038s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:29:41 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8c841d4-8660-407c-a965-1eb6521ecc36]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:29:41 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1cd7668-7055-4a63-8af1-43ad0532a38b tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:29:41 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-a1cd7668-7055-4a63-8af1-43ad0532a38b tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.475s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 15:29:41 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1cd7668-7055-4a63-8af1-43ad0532a38b tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] <== disconnect_volume: return (477ms) None {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 15:29:41 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a1cd7668-7055-4a63-8af1-43ad0532a38b tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] [instance: e0adbec9-eb22-4147-8c46-df7d02879f37] Disconnected iSCSI Volume {{(pid=72382) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 15:29:41 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-f023be2e-15a6-4820-9df5-4dec698589a3 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] [instance: b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d] Snapshot image upload complete
Aug 09 15:29:41 user nova-compute[72382]: DEBUG nova.compute.manager [None req-f023be2e-15a6-4820-9df5-4dec698589a3 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] [instance: b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:29:41 user nova-compute[72382]: INFO nova.compute.manager [None req-f023be2e-15a6-4820-9df5-4dec698589a3 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] [instance: b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d] Shelve offloading
Aug 09 15:29:41 user nova-compute[72382]: INFO nova.virt.libvirt.driver [-] [instance: b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d] Instance destroyed successfully.
Aug 09 15:29:41 user nova-compute[72382]: DEBUG nova.compute.manager [None req-f023be2e-15a6-4820-9df5-4dec698589a3 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] [instance: b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:29:41 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-f023be2e-15a6-4820-9df5-4dec698589a3 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Acquiring lock "refresh_cache-b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 15:29:41 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-f023be2e-15a6-4820-9df5-4dec698589a3 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Acquired lock "refresh_cache-b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 15:29:41 user nova-compute[72382]: DEBUG nova.network.neutron [None req-f023be2e-15a6-4820-9df5-4dec698589a3 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] [instance: b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d] Building network info cache for instance {{(pid=72382) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 15:29:42 user nova-compute[72382]: DEBUG nova.objects.instance [None req-a1cd7668-7055-4a63-8af1-43ad0532a38b tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] Lazy-loading 'flavor' on Instance uuid e0adbec9-eb22-4147-8c46-df7d02879f37 {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:29:42 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-a1cd7668-7055-4a63-8af1-43ad0532a38b tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] Lock "e0adbec9-eb22-4147-8c46-df7d02879f37" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.332s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:29:42 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-2c2a5464-daed-46b8-994d-62e164c93ba0 tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] Lock "e0adbec9-eb22-4147-8c46-df7d02879f37" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 2.108s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:29:42 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-2c2a5464-daed-46b8-994d-62e164c93ba0 tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] Acquiring lock "e0adbec9-eb22-4147-8c46-df7d02879f37-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:29:42 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-2c2a5464-daed-46b8-994d-62e164c93ba0 tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] Lock "e0adbec9-eb22-4147-8c46-df7d02879f37-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:29:42 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-2c2a5464-daed-46b8-994d-62e164c93ba0 tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] Lock "e0adbec9-eb22-4147-8c46-df7d02879f37-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:29:42 user nova-compute[72382]: INFO nova.compute.manager [None req-2c2a5464-daed-46b8-994d-62e164c93ba0 tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] [instance: e0adbec9-eb22-4147-8c46-df7d02879f37] Terminating instance
Aug 09 15:29:42 user nova-compute[72382]: DEBUG nova.compute.manager [None req-2c2a5464-daed-46b8-994d-62e164c93ba0 tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] [instance: e0adbec9-eb22-4147-8c46-df7d02879f37] Start destroying the instance on the hypervisor. {{(pid=72382) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 15:29:42 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:29:42 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:29:42 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:29:42 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:29:42 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:29:42 user nova-compute[72382]: DEBUG nova.compute.manager [req-78dd3ae8-d91d-4294-bf04-599fba207b8f req-cef1c526-0cb1-42bc-a441-a455b75d9e65 service nova] [instance: e0adbec9-eb22-4147-8c46-df7d02879f37] Received event network-vif-unplugged-ae457c5d-81eb-466b-beb7-d9a3b3c11d59 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:29:42 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-78dd3ae8-d91d-4294-bf04-599fba207b8f req-cef1c526-0cb1-42bc-a441-a455b75d9e65 service nova] Acquiring lock "e0adbec9-eb22-4147-8c46-df7d02879f37-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:29:42 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-78dd3ae8-d91d-4294-bf04-599fba207b8f req-cef1c526-0cb1-42bc-a441-a455b75d9e65 service nova] Lock "e0adbec9-eb22-4147-8c46-df7d02879f37-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:29:42 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-78dd3ae8-d91d-4294-bf04-599fba207b8f req-cef1c526-0cb1-42bc-a441-a455b75d9e65 service nova] Lock "e0adbec9-eb22-4147-8c46-df7d02879f37-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:29:42 user nova-compute[72382]: DEBUG nova.compute.manager [req-78dd3ae8-d91d-4294-bf04-599fba207b8f req-cef1c526-0cb1-42bc-a441-a455b75d9e65 service nova] [instance: e0adbec9-eb22-4147-8c46-df7d02879f37] No waiting events found dispatching network-vif-unplugged-ae457c5d-81eb-466b-beb7-d9a3b3c11d59 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:29:42 user nova-compute[72382]: DEBUG nova.compute.manager [req-78dd3ae8-d91d-4294-bf04-599fba207b8f req-cef1c526-0cb1-42bc-a441-a455b75d9e65 service nova] [instance: e0adbec9-eb22-4147-8c46-df7d02879f37] Received event network-vif-unplugged-ae457c5d-81eb-466b-beb7-d9a3b3c11d59 for instance with task_state deleting. {{(pid=72382) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 15:29:42 user nova-compute[72382]: DEBUG nova.network.neutron [None req-f023be2e-15a6-4820-9df5-4dec698589a3 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] [instance: b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d] Updating instance_info_cache with network_info: [{"id": "99b65ca7-d891-4625-917d-460e7fb69654", "address": "fa:16:3e:98:b9:f2", "network": {"id": "643703fd-46b7-4309-862c-109141cb008c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-512918576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.131", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa6db5fd3ce24c1cadbedd64757e219b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99b65ca7-d8", "ovs_interfaceid": "99b65ca7-d891-4625-917d-460e7fb69654", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:29:42 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-f023be2e-15a6-4820-9df5-4dec698589a3 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Releasing lock "refresh_cache-b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 15:29:42 user nova-compute[72382]: INFO nova.virt.libvirt.driver [-] [instance: e0adbec9-eb22-4147-8c46-df7d02879f37] Instance destroyed successfully.
Aug 09 15:29:42 user nova-compute[72382]: DEBUG nova.objects.instance [None req-2c2a5464-daed-46b8-994d-62e164c93ba0 tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] Lazy-loading 'resources' on Instance uuid e0adbec9-eb22-4147-8c46-df7d02879f37 {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:29:43 user nova-compute[72382]: DEBUG nova.virt.libvirt.vif [None req-2c2a5464-daed-46b8-994d-62e164c93ba0 tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T15:26:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1309457343',display_name='tempest-VolumesSnapshotTestJSON-instance-1309457343',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1309457343',id=29,image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC4J5s/e64QwkKpkXrv2/HxjMFR67embNinTg5rv2W+dRJzFLS5SR+bTVPf2ch817MOXJek2YrXFDhAEuIeKf0VO83ckcUktx64kqgF/ucNpfXjKZ5UGgVMPJ2dolkD1sg==',key_name='tempest-keypair-270486525',keypairs=<?>,launch_index=0,launched_at=2023-08-09T15:27:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9949fc5e9167457d8c7a455350936255',ramdisk_id='',reservation_id='r-aur0xu5v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-985960330',owner_user_name='tempest-VolumesSnapshotTestJSON-985960330-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T15:27:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='04ecf94b76144c64b2ca5ecc7932dd32',uuid=e0adbec9-eb22-4147-8c46-df7d02879f37,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ae457c5d-81eb-466b-beb7-d9a3b3c11d59", "address": "fa:16:3e:35:bc:34", "network": {"id": "1b9920a2-9613-4741-a0c0-72172380b365", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-455407214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9949fc5e9167457d8c7a455350936255", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae457c5d-81", "ovs_interfaceid": "ae457c5d-81eb-466b-beb7-d9a3b3c11d59", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 15:29:43 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-2c2a5464-daed-46b8-994d-62e164c93ba0 tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] Converting VIF {"id": "ae457c5d-81eb-466b-beb7-d9a3b3c11d59", "address": "fa:16:3e:35:bc:34", "network": {"id": "1b9920a2-9613-4741-a0c0-72172380b365", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-455407214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9949fc5e9167457d8c7a455350936255", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae457c5d-81", "ovs_interfaceid": "ae457c5d-81eb-466b-beb7-d9a3b3c11d59", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 15:29:43 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-2c2a5464-daed-46b8-994d-62e164c93ba0 tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:35:bc:34,bridge_name='br-int',has_traffic_filtering=True,id=ae457c5d-81eb-466b-beb7-d9a3b3c11d59,network=Network(1b9920a2-9613-4741-a0c0-72172380b365),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae457c5d-81') {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 15:29:43 user nova-compute[72382]: DEBUG os_vif [None req-2c2a5464-daed-46b8-994d-62e164c93ba0 tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:35:bc:34,bridge_name='br-int',has_traffic_filtering=True,id=ae457c5d-81eb-466b-beb7-d9a3b3c11d59,network=Network(1b9920a2-9613-4741-a0c0-72172380b365),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae457c5d-81') {{(pid=72382) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 15:29:43 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:29:43 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapae457c5d-81, bridge=br-int, if_exists=True) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:29:43 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:29:43 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:29:43 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:29:43 user nova-compute[72382]: INFO os_vif [None req-2c2a5464-daed-46b8-994d-62e164c93ba0 tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:35:bc:34,bridge_name='br-int',has_traffic_filtering=True,id=ae457c5d-81eb-466b-beb7-d9a3b3c11d59,network=Network(1b9920a2-9613-4741-a0c0-72172380b365),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae457c5d-81')
Aug 09 15:29:43 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2c2a5464-daed-46b8-994d-62e164c93ba0 tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] [instance: e0adbec9-eb22-4147-8c46-df7d02879f37] calling os-brick to detach iSCSI Volume {{(pid=72382) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 15:29:43 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c2a5464-daed-46b8-994d-62e164c93ba0 tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2a0c768340>, {'target_iqns': ['iqn.2010-10.org.openstack:9fb38a17-5c70-4b9b-909a-614a81e5b75b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XMTyoqHY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 15:29:43 user nova-compute[72382]: WARNING os_brick.initiator.connectors.base [None req-2c2a5464-daed-46b8-994d-62e164c93ba0 tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 15:29:43 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-2c2a5464-daed-46b8-994d-62e164c93ba0 tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 15:29:43 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-2c2a5464-daed-46b8-994d-62e164c93ba0 tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 15:29:43 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c2a5464-daed-46b8-994d-62e164c93ba0 tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9fb38a17-5c70-4b9b-909a-614a81e5b75b', 0)] {{(pid=72382) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 15:29:43 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:29:43 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:29:43 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3748852-6c8d-444c-9b62-5009c8635f2b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:25503c6e-bfc0-4008-846a-8cad783fc0fb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bd90521a-f3b5-485c-9fb9-61ab37267f3a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e62d4416-be8c-4327-9a51-0cc509109c53\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:29:43 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:29:43 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:29:43 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e40a31a-e4e7-4d6c-b3f6-2555628ca90a]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd90521a-f3b5-485c-9fb9-61ab37267f3a (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25503c6e-bfc0-4008-846a-8cad783fc0fb (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e62d4416-be8c-4327-9a51-0cc509109c53 (non-flash)\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:29:43 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c2a5464-daed-46b8-994d-62e164c93ba0 tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)
Aug 09 15:29:43 user nova-compute[72382]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd90521a-f3b5-485c-9fb9-61ab37267f3a (non-flash)
Aug 09 15:29:43 user nova-compute[72382]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25503c6e-bfc0-4008-846a-8cad783fc0fb (non-flash)
Aug 09 15:29:43 user nova-compute[72382]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e62d4416-be8c-4327-9a51-0cc509109c53 (non-flash)
Aug 09 15:29:43 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 15:29:43 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c2a5464-daed-46b8-994d-62e164c93ba0 tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)
Aug 09 15:29:43 user nova-compute[72382]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd90521a-f3b5-485c-9fb9-61ab37267f3a (non-flash)
Aug 09 15:29:43 user nova-compute[72382]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25503c6e-bfc0-4008-846a-8cad783fc0fb (non-flash)
Aug 09 15:29:43 user nova-compute[72382]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e62d4416-be8c-4327-9a51-0cc509109c53 (non-flash)
Aug 09 15:29:43 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 15:29:43 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c2a5464-daed-46b8-994d-62e164c93ba0 tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2a0c3480d0>, {}) {{(pid=72382) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 15:29:43 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c2a5464-daed-46b8-994d-62e164c93ba0 tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] Disconnecting from: [] {{(pid=72382) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 15:29:43 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-2c2a5464-daed-46b8-994d-62e164c93ba0 tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.066s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 15:29:43 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c2a5464-daed-46b8-994d-62e164c93ba0 tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] <== disconnect_volume: return (68ms) None {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 15:29:43 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2c2a5464-daed-46b8-994d-62e164c93ba0 tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] [instance: e0adbec9-eb22-4147-8c46-df7d02879f37] Disconnected iSCSI Volume {{(pid=72382) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 15:29:43 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-2c2a5464-daed-46b8-994d-62e164c93ba0 tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] [instance: e0adbec9-eb22-4147-8c46-df7d02879f37] Deleting instance files /opt/stack/data/nova/instances/e0adbec9-eb22-4147-8c46-df7d02879f37_del
Aug 09 15:29:43 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-2c2a5464-daed-46b8-994d-62e164c93ba0 tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] [instance: e0adbec9-eb22-4147-8c46-df7d02879f37] Deletion of /opt/stack/data/nova/instances/e0adbec9-eb22-4147-8c46-df7d02879f37_del complete
Aug 09 15:29:43 user nova-compute[72382]: INFO nova.compute.manager [None req-2c2a5464-daed-46b8-994d-62e164c93ba0 tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] [instance: e0adbec9-eb22-4147-8c46-df7d02879f37] Took 1.08 seconds to destroy the instance on the hypervisor.
Aug 09 15:29:43 user nova-compute[72382]: DEBUG oslo.service.loopingcall [None req-2c2a5464-daed-46b8-994d-62e164c93ba0 tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72382) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 15:29:43 user nova-compute[72382]: DEBUG nova.compute.manager [-] [instance: e0adbec9-eb22-4147-8c46-df7d02879f37] Deallocating network for instance {{(pid=72382) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 15:29:43 user nova-compute[72382]: DEBUG nova.network.neutron [-] [instance: e0adbec9-eb22-4147-8c46-df7d02879f37] deallocate_for_instance() {{(pid=72382) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 15:29:44 user nova-compute[72382]: INFO nova.virt.libvirt.driver [-] [instance: b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d] Instance destroyed successfully.
Aug 09 15:29:44 user nova-compute[72382]: DEBUG nova.objects.instance [None req-f023be2e-15a6-4820-9df5-4dec698589a3 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Lazy-loading 'resources' on Instance uuid b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:29:44 user nova-compute[72382]: DEBUG nova.virt.libvirt.vif [None req-f023be2e-15a6-4820-9df5-4dec698589a3 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T15:27:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1040530269',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1040530269',id=30,image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMiQiccBAZbSGjl9sbSNKnQGJNN64201drRNdzHrfy2kYoUIkJ4KB4xuR2qLyVMxz2GHt6tPPGyITCyus9o+6b9G1oDw0H1d1ZWMxnk3TgYZXztCoqRxXenLA44cFa0yrg==',key_name='tempest-keypair-1139327477',keypairs=<?>,launch_index=0,launched_at=2023-08-09T15:27:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='aa6db5fd3ce24c1cadbedd64757e219b',ramdisk_id='',reservation_id='r-ydxxngnu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1817688709',owner_user_name='tempest-AttachVolumeShelveTestJSON-1817688709-project-member',shelved_at='2023-08-09T15:29:41.490901',shelved_host='user',shelved_image_id='1abdf598-2e0e-40ba-a420-05440167d4ed'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T15:29:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9f95e50aa6194e778dfaee31e6e2fa68',uuid=b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "99b65ca7-d891-4625-917d-460e7fb69654", "address": "fa:16:3e:98:b9:f2", "network": {"id": "643703fd-46b7-4309-862c-109141cb008c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-512918576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.131", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa6db5fd3ce24c1cadbedd64757e219b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99b65ca7-d8", "ovs_interfaceid": "99b65ca7-d891-4625-917d-460e7fb69654", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 15:29:44 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-f023be2e-15a6-4820-9df5-4dec698589a3 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Converting VIF {"id": "99b65ca7-d891-4625-917d-460e7fb69654", "address": "fa:16:3e:98:b9:f2", "network": {"id": "643703fd-46b7-4309-862c-109141cb008c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-512918576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.131", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa6db5fd3ce24c1cadbedd64757e219b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99b65ca7-d8", "ovs_interfaceid": "99b65ca7-d891-4625-917d-460e7fb69654", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 15:29:44 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-f023be2e-15a6-4820-9df5-4dec698589a3 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:98:b9:f2,bridge_name='br-int',has_traffic_filtering=True,id=99b65ca7-d891-4625-917d-460e7fb69654,network=Network(643703fd-46b7-4309-862c-109141cb008c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99b65ca7-d8') {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 15:29:44 user nova-compute[72382]: DEBUG os_vif [None req-f023be2e-15a6-4820-9df5-4dec698589a3 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:b9:f2,bridge_name='br-int',has_traffic_filtering=True,id=99b65ca7-d891-4625-917d-460e7fb69654,network=Network(643703fd-46b7-4309-862c-109141cb008c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99b65ca7-d8') {{(pid=72382) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 15:29:44 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:29:44 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap99b65ca7-d8, bridge=br-int, if_exists=True) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:29:44 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:29:44 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:29:44 user nova-compute[72382]: INFO os_vif [None req-f023be2e-15a6-4820-9df5-4dec698589a3 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:b9:f2,bridge_name='br-int',has_traffic_filtering=True,id=99b65ca7-d891-4625-917d-460e7fb69654,network=Network(643703fd-46b7-4309-862c-109141cb008c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99b65ca7-d8')
Aug 09 15:29:44 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-f023be2e-15a6-4820-9df5-4dec698589a3 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] [instance: b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d] Deleting instance files /opt/stack/data/nova/instances/b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d_del
Aug 09 15:29:44 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-f023be2e-15a6-4820-9df5-4dec698589a3 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] [instance: b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d] Deletion of /opt/stack/data/nova/instances/b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d_del complete
Aug 09 15:29:44 user nova-compute[72382]: INFO nova.scheduler.client.report [None req-f023be2e-15a6-4820-9df5-4dec698589a3 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Deleted allocations for instance b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d
Aug 09 15:29:44 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-f023be2e-15a6-4820-9df5-4dec698589a3 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:29:44 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-f023be2e-15a6-4820-9df5-4dec698589a3 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:29:44 user nova-compute[72382]: DEBUG nova.objects.instance [None req-f023be2e-15a6-4820-9df5-4dec698589a3 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Lazy-loading 'numa_topology' on Instance uuid b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:29:44 user nova-compute[72382]: DEBUG nova.network.neutron [-] [instance: e0adbec9-eb22-4147-8c46-df7d02879f37] Updating instance_info_cache with network_info: [] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:29:44 user nova-compute[72382]: INFO nova.compute.manager [-] [instance: e0adbec9-eb22-4147-8c46-df7d02879f37] Took 1.33 seconds to deallocate network for instance.
Aug 09 15:29:44 user nova-compute[72382]: WARNING nova.volume.cinder [None req-2c2a5464-daed-46b8-994d-62e164c93ba0 tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] Attachment 52643297-647f-48d5-bb32-345607ed27ce does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 52643297-647f-48d5-bb32-345607ed27ce. (HTTP 404) (Request-ID: req-c475e09f-e1cc-487d-8d74-a5d5cc863f3a)
Aug 09 15:29:44 user nova-compute[72382]: INFO nova.compute.manager [None req-2c2a5464-daed-46b8-994d-62e164c93ba0 tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] [instance: e0adbec9-eb22-4147-8c46-df7d02879f37] Took 0.02 seconds to detach 1 volumes for instance.
Aug 09 15:29:44 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-2c2a5464-daed-46b8-994d-62e164c93ba0 tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:29:44 user nova-compute[72382]: DEBUG nova.compute.manager [req-32ae190c-b099-4d6c-8586-97028f2d3045 req-0c2a9083-56df-45af-84cd-f28f8ad459df service nova] [instance: e0adbec9-eb22-4147-8c46-df7d02879f37] Received event network-vif-plugged-ae457c5d-81eb-466b-beb7-d9a3b3c11d59 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:29:44 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-32ae190c-b099-4d6c-8586-97028f2d3045 req-0c2a9083-56df-45af-84cd-f28f8ad459df service nova] Acquiring lock "e0adbec9-eb22-4147-8c46-df7d02879f37-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:29:44 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-32ae190c-b099-4d6c-8586-97028f2d3045 req-0c2a9083-56df-45af-84cd-f28f8ad459df service nova] Lock "e0adbec9-eb22-4147-8c46-df7d02879f37-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:29:44 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-32ae190c-b099-4d6c-8586-97028f2d3045 req-0c2a9083-56df-45af-84cd-f28f8ad459df service nova] Lock "e0adbec9-eb22-4147-8c46-df7d02879f37-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:29:44 user nova-compute[72382]: DEBUG nova.compute.manager [req-32ae190c-b099-4d6c-8586-97028f2d3045 req-0c2a9083-56df-45af-84cd-f28f8ad459df service nova] [instance: e0adbec9-eb22-4147-8c46-df7d02879f37] No waiting events found dispatching network-vif-plugged-ae457c5d-81eb-466b-beb7-d9a3b3c11d59 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:29:44 user nova-compute[72382]: WARNING nova.compute.manager [req-32ae190c-b099-4d6c-8586-97028f2d3045 req-0c2a9083-56df-45af-84cd-f28f8ad459df service nova] [instance: e0adbec9-eb22-4147-8c46-df7d02879f37] Received unexpected event network-vif-plugged-ae457c5d-81eb-466b-beb7-d9a3b3c11d59 for instance with vm_state deleted and task_state None.
Aug 09 15:29:44 user nova-compute[72382]: DEBUG nova.compute.manager [req-32ae190c-b099-4d6c-8586-97028f2d3045 req-0c2a9083-56df-45af-84cd-f28f8ad459df service nova] [instance: b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d] Received event network-changed-99b65ca7-d891-4625-917d-460e7fb69654 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:29:44 user nova-compute[72382]: DEBUG nova.compute.manager [req-32ae190c-b099-4d6c-8586-97028f2d3045 req-0c2a9083-56df-45af-84cd-f28f8ad459df service nova] [instance: b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d] Refreshing instance network info cache due to event network-changed-99b65ca7-d891-4625-917d-460e7fb69654. {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 15:29:44 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-32ae190c-b099-4d6c-8586-97028f2d3045 req-0c2a9083-56df-45af-84cd-f28f8ad459df service nova] Acquiring lock "refresh_cache-b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 15:29:44 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-32ae190c-b099-4d6c-8586-97028f2d3045 req-0c2a9083-56df-45af-84cd-f28f8ad459df service nova] Acquired lock "refresh_cache-b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 15:29:44 user nova-compute[72382]: DEBUG nova.network.neutron [req-32ae190c-b099-4d6c-8586-97028f2d3045 req-0c2a9083-56df-45af-84cd-f28f8ad459df service nova] [instance: b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d] Refreshing network info cache for port 99b65ca7-d891-4625-917d-460e7fb69654 {{(pid=72382) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 15:29:44 user nova-compute[72382]: DEBUG nova.compute.provider_tree [None req-f023be2e-15a6-4820-9df5-4dec698589a3 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Inventory has not changed in ProviderTree for provider: 7b15b0e5-df4d-49db-833b-2855d21d10ae {{(pid=72382) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 15:29:44 user nova-compute[72382]: DEBUG nova.scheduler.client.report [None req-f023be2e-15a6-4820-9df5-4dec698589a3 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Inventory has not changed for provider 7b15b0e5-df4d-49db-833b-2855d21d10ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72382) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 15:29:44 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-f023be2e-15a6-4820-9df5-4dec698589a3 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.511s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:29:44 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-2c2a5464-daed-46b8-994d-62e164c93ba0 tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.334s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:29:45 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-f023be2e-15a6-4820-9df5-4dec698589a3 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Lock "b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 9.457s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:29:45 user nova-compute[72382]: DEBUG nova.compute.provider_tree [None req-2c2a5464-daed-46b8-994d-62e164c93ba0 tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] Inventory has not changed in ProviderTree for provider: 7b15b0e5-df4d-49db-833b-2855d21d10ae {{(pid=72382) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 15:29:45 user nova-compute[72382]: DEBUG nova.scheduler.client.report [None req-2c2a5464-daed-46b8-994d-62e164c93ba0 tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] Inventory has not changed for provider 7b15b0e5-df4d-49db-833b-2855d21d10ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72382) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 15:29:45 user nova-compute[72382]: DEBUG nova.network.neutron [req-32ae190c-b099-4d6c-8586-97028f2d3045 req-0c2a9083-56df-45af-84cd-f28f8ad459df service nova] [instance: b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d] Updated VIF entry in instance network info cache for port 99b65ca7-d891-4625-917d-460e7fb69654. {{(pid=72382) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 15:29:45 user nova-compute[72382]: DEBUG nova.network.neutron [req-32ae190c-b099-4d6c-8586-97028f2d3045 req-0c2a9083-56df-45af-84cd-f28f8ad459df service nova] [instance: b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d] Updating instance_info_cache with network_info: [{"id": "99b65ca7-d891-4625-917d-460e7fb69654", "address": "fa:16:3e:98:b9:f2", "network": {"id": "643703fd-46b7-4309-862c-109141cb008c", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-512918576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.131", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa6db5fd3ce24c1cadbedd64757e219b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap99b65ca7-d8", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:29:45 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-2c2a5464-daed-46b8-994d-62e164c93ba0 tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.421s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:29:45 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-32ae190c-b099-4d6c-8586-97028f2d3045 req-0c2a9083-56df-45af-84cd-f28f8ad459df service nova] Releasing lock "refresh_cache-b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 15:29:45 user nova-compute[72382]: DEBUG nova.compute.manager [req-32ae190c-b099-4d6c-8586-97028f2d3045 req-0c2a9083-56df-45af-84cd-f28f8ad459df service nova] [instance: e0adbec9-eb22-4147-8c46-df7d02879f37] Received event network-vif-deleted-ae457c5d-81eb-466b-beb7-d9a3b3c11d59 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:29:45 user nova-compute[72382]: INFO nova.scheduler.client.report [None req-2c2a5464-daed-46b8-994d-62e164c93ba0 tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] Deleted allocations for instance e0adbec9-eb22-4147-8c46-df7d02879f37
Aug 09 15:29:45 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-2c2a5464-daed-46b8-994d-62e164c93ba0 tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] Lock "e0adbec9-eb22-4147-8c46-df7d02879f37" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.408s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:29:49 user nova-compute[72382]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691594974.1120882, 61976531-76ae-4a1c-8950-0af784be376e => Stopped> {{(pid=72382) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 15:29:49 user nova-compute[72382]: INFO nova.compute.manager [-] [instance: 61976531-76ae-4a1c-8950-0af784be376e] VM Stopped (Lifecycle Event)
Aug 09 15:29:49 user nova-compute[72382]: DEBUG nova.compute.manager [None req-e83c886d-20b2-4b72-8742-6a02f019f80a None None] [instance: 61976531-76ae-4a1c-8950-0af784be376e] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:29:49 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:29:49 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:29:49 user nova-compute[72382]: DEBUG nova.compute.manager [req-5d311f53-81f1-4529-8a03-7761f98fa35e req-e72b018b-a94a-46e8-b3d6-5adaed6cf7b1 service nova] [instance: e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0] Received event network-changed-9513dc1d-79d5-482b-baaa-81f525e99de7 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:29:49 user nova-compute[72382]: DEBUG nova.compute.manager [req-5d311f53-81f1-4529-8a03-7761f98fa35e req-e72b018b-a94a-46e8-b3d6-5adaed6cf7b1 service nova] [instance: e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0] Refreshing instance network info cache due to event network-changed-9513dc1d-79d5-482b-baaa-81f525e99de7. {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 15:29:49 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-5d311f53-81f1-4529-8a03-7761f98fa35e req-e72b018b-a94a-46e8-b3d6-5adaed6cf7b1 service nova] Acquiring lock "refresh_cache-e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 15:29:49 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-5d311f53-81f1-4529-8a03-7761f98fa35e req-e72b018b-a94a-46e8-b3d6-5adaed6cf7b1 service nova] Acquired lock "refresh_cache-e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 15:29:49 user nova-compute[72382]: DEBUG nova.network.neutron [req-5d311f53-81f1-4529-8a03-7761f98fa35e req-e72b018b-a94a-46e8-b3d6-5adaed6cf7b1 service nova] [instance: e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0] Refreshing network info cache for port 9513dc1d-79d5-482b-baaa-81f525e99de7 {{(pid=72382) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 15:29:50 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-7c120a60-114d-40fc-b984-307d23da17df tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Acquiring lock "e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:29:50 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-7c120a60-114d-40fc-b984-307d23da17df tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Lock "e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:29:50 user nova-compute[72382]: INFO nova.compute.manager [None req-7c120a60-114d-40fc-b984-307d23da17df tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] [instance: e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0] Detaching volume bd90521a-f3b5-485c-9fb9-61ab37267f3a
Aug 09 15:29:50 user nova-compute[72382]: DEBUG nova.network.neutron [req-5d311f53-81f1-4529-8a03-7761f98fa35e req-e72b018b-a94a-46e8-b3d6-5adaed6cf7b1 service nova] [instance: e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0] Updated VIF entry in instance network info cache for port 9513dc1d-79d5-482b-baaa-81f525e99de7. {{(pid=72382) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 15:29:50 user nova-compute[72382]: DEBUG nova.network.neutron [req-5d311f53-81f1-4529-8a03-7761f98fa35e req-e72b018b-a94a-46e8-b3d6-5adaed6cf7b1 service nova] [instance: e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0] Updating instance_info_cache with network_info: [{"id": "9513dc1d-79d5-482b-baaa-81f525e99de7", "address": "fa:16:3e:6f:6b:41", "network": {"id": "46ef00c7-17ee-4e45-ba1d-dcc0a417ea85", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1360012261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.24", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "990ba791030940d38360af5879c853c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9513dc1d-79", "ovs_interfaceid": "9513dc1d-79d5-482b-baaa-81f525e99de7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:29:50 user nova-compute[72382]: INFO nova.virt.block_device [None req-7c120a60-114d-40fc-b984-307d23da17df tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] [instance: e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0] Attempting to driver detach volume bd90521a-f3b5-485c-9fb9-61ab37267f3a from mountpoint /dev/vdb
Aug 09 15:29:50 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-7c120a60-114d-40fc-b984-307d23da17df tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Attempting to detach device vdb from instance e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0 from the persistent domain config. {{(pid=72382) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 15:29:50 user nova-compute[72382]: DEBUG nova.virt.libvirt.guest [None req-7c120a60-114d-40fc-b984-307d23da17df tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 15:29:50 user nova-compute[72382]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 15:29:50 user nova-compute[72382]:   <source dev="/dev/sdc"/>
Aug 09 15:29:50 user nova-compute[72382]:   <target dev="vdb" bus="virtio"/>
Aug 09 15:29:50 user nova-compute[72382]:   <serial>bd90521a-f3b5-485c-9fb9-61ab37267f3a</serial>
Aug 09 15:29:50 user nova-compute[72382]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 15:29:50 user nova-compute[72382]: </disk>
Aug 09 15:29:50 user nova-compute[72382]:  {{(pid=72382) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 15:29:50 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-5d311f53-81f1-4529-8a03-7761f98fa35e req-e72b018b-a94a-46e8-b3d6-5adaed6cf7b1 service nova] Releasing lock "refresh_cache-e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 15:29:50 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-7c120a60-114d-40fc-b984-307d23da17df tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Successfully detached device vdb from instance e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0 from the persistent domain config.
Aug 09 15:29:50 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-7c120a60-114d-40fc-b984-307d23da17df tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0 from the live domain config. {{(pid=72382) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 15:29:50 user nova-compute[72382]: DEBUG nova.virt.libvirt.guest [None req-7c120a60-114d-40fc-b984-307d23da17df tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 15:29:50 user nova-compute[72382]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 15:29:50 user nova-compute[72382]:   <source dev="/dev/sdc"/>
Aug 09 15:29:50 user nova-compute[72382]:   <target dev="vdb" bus="virtio"/>
Aug 09 15:29:50 user nova-compute[72382]:   <serial>bd90521a-f3b5-485c-9fb9-61ab37267f3a</serial>
Aug 09 15:29:50 user nova-compute[72382]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 15:29:50 user nova-compute[72382]: </disk>
Aug 09 15:29:50 user nova-compute[72382]:  {{(pid=72382) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 15:29:50 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Received event <DeviceRemovedEvent: 1691594990.9276302, e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72382) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 15:29:50 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-7c120a60-114d-40fc-b984-307d23da17df tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0 {{(pid=72382) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 15:29:50 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-7c120a60-114d-40fc-b984-307d23da17df tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Successfully detached device vdb from instance e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0 from the live domain config.
Aug 09 15:29:50 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7c120a60-114d-40fc-b984-307d23da17df tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] [instance: e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0] calling os-brick to detach iSCSI Volume {{(pid=72382) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 15:29:50 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c120a60-114d-40fc-b984-307d23da17df tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2a0c768340>, {'target_iqns': ['iqn.2010-10.org.openstack:bd90521a-f3b5-485c-9fb9-61ab37267f3a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dBjztUgm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 15:29:50 user nova-compute[72382]: WARNING os_brick.initiator.connectors.base [None req-7c120a60-114d-40fc-b984-307d23da17df tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 15:29:50 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-7c120a60-114d-40fc-b984-307d23da17df tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 15:29:50 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-7c120a60-114d-40fc-b984-307d23da17df tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 15:29:50 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c120a60-114d-40fc-b984-307d23da17df tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bd90521a-f3b5-485c-9fb9-61ab37267f3a', 0)] {{(pid=72382) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 15:29:50 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:29:50 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:29:50 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[db190942-2c12-4b57-b5b7-d72a407ec7b6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:25503c6e-bfc0-4008-846a-8cad783fc0fb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bd90521a-f3b5-485c-9fb9-61ab37267f3a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e62d4416-be8c-4327-9a51-0cc509109c53\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:29:50 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:29:51 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:29:51 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[010e5c0b-09a3-4327-9ded-970cef4bcaaa]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd90521a-f3b5-485c-9fb9-61ab37267f3a (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25503c6e-bfc0-4008-846a-8cad783fc0fb (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e62d4416-be8c-4327-9a51-0cc509109c53 (non-flash)\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:29:51 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c120a60-114d-40fc-b984-307d23da17df tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)
Aug 09 15:29:51 user nova-compute[72382]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd90521a-f3b5-485c-9fb9-61ab37267f3a (non-flash)
Aug 09 15:29:51 user nova-compute[72382]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25503c6e-bfc0-4008-846a-8cad783fc0fb (non-flash)
Aug 09 15:29:51 user nova-compute[72382]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e62d4416-be8c-4327-9a51-0cc509109c53 (non-flash)
Aug 09 15:29:51 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 15:29:51 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c120a60-114d-40fc-b984-307d23da17df tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)
Aug 09 15:29:51 user nova-compute[72382]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd90521a-f3b5-485c-9fb9-61ab37267f3a (non-flash)
Aug 09 15:29:51 user nova-compute[72382]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25503c6e-bfc0-4008-846a-8cad783fc0fb (non-flash)
Aug 09 15:29:51 user nova-compute[72382]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e62d4416-be8c-4327-9a51-0cc509109c53 (non-flash)
Aug 09 15:29:51 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 15:29:51 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c120a60-114d-40fc-b984-307d23da17df tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2a0c3512d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bd90521a-f3b5-485c-9fb9-61ab37267f3a'): ({'sdc'}, set())}) {{(pid=72382) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 15:29:51 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-7c120a60-114d-40fc-b984-307d23da17df tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Removing single pathed devices sdc {{(pid=72382) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 15:29:51 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:29:51 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:29:51 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[610ec685-8e5f-425c-a6cb-e860959ba6ab]: (4, ('path checker states:\nup                  3\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:29:51 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:29:51 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:29:51 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[b42b9464-11bd-4c94-a9fe-e80b619502bb]: (4, ('ok\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:29:51 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-7c120a60-114d-40fc-b984-307d23da17df tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Flushing IO for device /dev/sdc {{(pid=72382) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 15:29:51 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:29:51 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:29:51 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[67d4e616-09b9-4cba-8bfb-3dba6ecbe4eb]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:29:51 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-7c120a60-114d-40fc-b984-307d23da17df tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72382) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 15:29:51 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:29:51 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.048s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:29:51 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c21ba1e-9373-480e-a30a-af1d1d533718]: (4, ('1', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:29:51 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-7c120a60-114d-40fc-b984-307d23da17df tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72382) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 15:29:51 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-7c120a60-114d-40fc-b984-307d23da17df tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] SCSI volumes sdc have been removed. {{(pid=72382) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 15:29:51 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c120a60-114d-40fc-b984-307d23da17df tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bd90521a-f3b5-485c-9fb9-61ab37267f3a')] {{(pid=72382) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 15:29:51 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd90521a-f3b5-485c-9fb9-61ab37267f3a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:29:51 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd90521a-f3b5-485c-9fb9-61ab37267f3a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:29:51 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e4a45a4-40d0-47b8-a3c6-0c8abe70f075]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:29:51 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c120a60-114d-40fc-b984-307d23da17df tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:29:51 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd90521a-f3b5-485c-9fb9-61ab37267f3a -p 172.16.0.220:3260 --logout {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:29:51 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd90521a-f3b5-485c-9fb9-61ab37267f3a -p 172.16.0.220:3260 --logout" returned: 0 in 0.048s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:29:51 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[5334ffd3-1126-44ac-b219-f45eab7e1745]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:bd90521a-f3b5-485c-9fb9-61ab37267f3a, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:bd90521a-f3b5-485c-9fb9-61ab37267f3a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:29:51 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c120a60-114d-40fc-b984-307d23da17df tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:bd90521a-f3b5-485c-9fb9-61ab37267f3a, portal: 172.16.0.220,3260]
Aug 09 15:29:51 user nova-compute[72382]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:bd90521a-f3b5-485c-9fb9-61ab37267f3a, portal: 172.16.0.220,3260] successful.
Aug 09 15:29:51 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:29:51 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd90521a-f3b5-485c-9fb9-61ab37267f3a -p 172.16.0.220:3260 --op delete {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:29:51 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd90521a-f3b5-485c-9fb9-61ab37267f3a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:29:51 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[755c00cf-02f0-4b1c-8777-8ddbdb931bcd]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:29:51 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c120a60-114d-40fc-b984-307d23da17df tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:29:51 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-7c120a60-114d-40fc-b984-307d23da17df tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.312s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 15:29:51 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c120a60-114d-40fc-b984-307d23da17df tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] <== disconnect_volume: return (313ms) None {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 15:29:51 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7c120a60-114d-40fc-b984-307d23da17df tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] [instance: e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0] Disconnected iSCSI Volume {{(pid=72382) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 15:29:51 user nova-compute[72382]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691594976.4109762, b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d => Stopped> {{(pid=72382) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 15:29:51 user nova-compute[72382]: INFO nova.compute.manager [-] [instance: b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d] VM Stopped (Lifecycle Event)
Aug 09 15:29:51 user nova-compute[72382]: DEBUG nova.compute.manager [None req-d620e168-36e0-4149-81de-622b46a76c85 None None] [instance: b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:29:51 user nova-compute[72382]: DEBUG nova.compute.manager [req-54f7b171-1e22-4c54-ab38-ef842f2d4a74 req-3ac41512-7bff-41ae-a772-4377cca25280 service nova] [instance: e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0] Received event network-changed-9513dc1d-79d5-482b-baaa-81f525e99de7 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:29:51 user nova-compute[72382]: DEBUG nova.compute.manager [req-54f7b171-1e22-4c54-ab38-ef842f2d4a74 req-3ac41512-7bff-41ae-a772-4377cca25280 service nova] [instance: e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0] Refreshing instance network info cache due to event network-changed-9513dc1d-79d5-482b-baaa-81f525e99de7. {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 15:29:51 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-54f7b171-1e22-4c54-ab38-ef842f2d4a74 req-3ac41512-7bff-41ae-a772-4377cca25280 service nova] Acquiring lock "refresh_cache-e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 15:29:51 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-54f7b171-1e22-4c54-ab38-ef842f2d4a74 req-3ac41512-7bff-41ae-a772-4377cca25280 service nova] Acquired lock "refresh_cache-e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 15:29:51 user nova-compute[72382]: DEBUG nova.network.neutron [req-54f7b171-1e22-4c54-ab38-ef842f2d4a74 req-3ac41512-7bff-41ae-a772-4377cca25280 service nova] [instance: e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0] Refreshing network info cache for port 9513dc1d-79d5-482b-baaa-81f525e99de7 {{(pid=72382) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 15:29:51 user nova-compute[72382]: DEBUG nova.objects.instance [None req-7c120a60-114d-40fc-b984-307d23da17df tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Lazy-loading 'flavor' on Instance uuid e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0 {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:29:52 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-7c120a60-114d-40fc-b984-307d23da17df tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Lock "e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.665s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:29:52 user nova-compute[72382]: DEBUG nova.network.neutron [req-54f7b171-1e22-4c54-ab38-ef842f2d4a74 req-3ac41512-7bff-41ae-a772-4377cca25280 service nova] [instance: e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0] Updated VIF entry in instance network info cache for port 9513dc1d-79d5-482b-baaa-81f525e99de7. {{(pid=72382) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 15:29:52 user nova-compute[72382]: DEBUG nova.network.neutron [req-54f7b171-1e22-4c54-ab38-ef842f2d4a74 req-3ac41512-7bff-41ae-a772-4377cca25280 service nova] [instance: e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0] Updating instance_info_cache with network_info: [{"id": "9513dc1d-79d5-482b-baaa-81f525e99de7", "address": "fa:16:3e:6f:6b:41", "network": {"id": "46ef00c7-17ee-4e45-ba1d-dcc0a417ea85", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1360012261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.24", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "990ba791030940d38360af5879c853c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9513dc1d-79", "ovs_interfaceid": "9513dc1d-79d5-482b-baaa-81f525e99de7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:29:52 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-54f7b171-1e22-4c54-ab38-ef842f2d4a74 req-3ac41512-7bff-41ae-a772-4377cca25280 service nova] Releasing lock "refresh_cache-e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 15:29:52 user nova-compute[72382]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691594977.3881953, 5002dc68-150a-4e96-bfe7-e66c6d764b9f => Stopped> {{(pid=72382) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 15:29:52 user nova-compute[72382]: INFO nova.compute.manager [-] [instance: 5002dc68-150a-4e96-bfe7-e66c6d764b9f] VM Stopped (Lifecycle Event)
Aug 09 15:29:52 user nova-compute[72382]: DEBUG nova.compute.manager [None req-2dc35d6c-2048-4ac3-bab0-a60c37b22310 None None] [instance: 5002dc68-150a-4e96-bfe7-e66c6d764b9f] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:29:54 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:29:54 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:29:57 user nova-compute[72382]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691594982.9770036, e0adbec9-eb22-4147-8c46-df7d02879f37 => Stopped> {{(pid=72382) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 15:29:57 user nova-compute[72382]: INFO nova.compute.manager [-] [instance: e0adbec9-eb22-4147-8c46-df7d02879f37] VM Stopped (Lifecycle Event)
Aug 09 15:29:57 user nova-compute[72382]: DEBUG nova.compute.manager [None req-947480b8-b766-4d54-b47e-e5566a329c02 None None] [instance: e0adbec9-eb22-4147-8c46-df7d02879f37] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:29:59 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:29:59 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:30:04 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:30:04 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:30:09 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:30:09 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:30:10 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-ab993759-8979-43fc-a46f-bfab9b21d9b5 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] Acquiring lock "6296ba5d-bcc6-405a-a635-0e9aa6114f7b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:30:10 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-ab993759-8979-43fc-a46f-bfab9b21d9b5 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] Lock "6296ba5d-bcc6-405a-a635-0e9aa6114f7b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:30:10 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-ab993759-8979-43fc-a46f-bfab9b21d9b5 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] Acquiring lock "6296ba5d-bcc6-405a-a635-0e9aa6114f7b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:30:10 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-ab993759-8979-43fc-a46f-bfab9b21d9b5 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] Lock "6296ba5d-bcc6-405a-a635-0e9aa6114f7b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:30:10 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-ab993759-8979-43fc-a46f-bfab9b21d9b5 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] Lock "6296ba5d-bcc6-405a-a635-0e9aa6114f7b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:30:10 user nova-compute[72382]: INFO nova.compute.manager [None req-ab993759-8979-43fc-a46f-bfab9b21d9b5 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] [instance: 6296ba5d-bcc6-405a-a635-0e9aa6114f7b] Terminating instance
Aug 09 15:30:10 user nova-compute[72382]: DEBUG nova.compute.manager [None req-ab993759-8979-43fc-a46f-bfab9b21d9b5 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] [instance: 6296ba5d-bcc6-405a-a635-0e9aa6114f7b] Start destroying the instance on the hypervisor. {{(pid=72382) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 15:30:10 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:30:10 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:30:10 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:30:10 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:30:10 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:30:10 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:30:10 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:30:10 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:30:10 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Auditing locally available compute resources for user (node: user) {{(pid=72382) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 15:30:10 user nova-compute[72382]: DEBUG nova.compute.manager [req-2bbcd3b2-e627-4e95-b48b-75d29a21626f req-efa084a5-576c-4bba-b865-f8c659d8632d service nova] [instance: 6296ba5d-bcc6-405a-a635-0e9aa6114f7b] Received event network-vif-unplugged-dc2f667c-53dc-44b5-bd9d-55b4e9a4c86b {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:30:10 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-2bbcd3b2-e627-4e95-b48b-75d29a21626f req-efa084a5-576c-4bba-b865-f8c659d8632d service nova] Acquiring lock "6296ba5d-bcc6-405a-a635-0e9aa6114f7b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:30:10 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-2bbcd3b2-e627-4e95-b48b-75d29a21626f req-efa084a5-576c-4bba-b865-f8c659d8632d service nova] Lock "6296ba5d-bcc6-405a-a635-0e9aa6114f7b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:30:10 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-2bbcd3b2-e627-4e95-b48b-75d29a21626f req-efa084a5-576c-4bba-b865-f8c659d8632d service nova] Lock "6296ba5d-bcc6-405a-a635-0e9aa6114f7b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:30:10 user nova-compute[72382]: DEBUG nova.compute.manager [req-2bbcd3b2-e627-4e95-b48b-75d29a21626f req-efa084a5-576c-4bba-b865-f8c659d8632d service nova] [instance: 6296ba5d-bcc6-405a-a635-0e9aa6114f7b] No waiting events found dispatching network-vif-unplugged-dc2f667c-53dc-44b5-bd9d-55b4e9a4c86b {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:30:10 user nova-compute[72382]: DEBUG nova.compute.manager [req-2bbcd3b2-e627-4e95-b48b-75d29a21626f req-efa084a5-576c-4bba-b865-f8c659d8632d service nova] [instance: 6296ba5d-bcc6-405a-a635-0e9aa6114f7b] Received event network-vif-unplugged-dc2f667c-53dc-44b5-bd9d-55b4e9a4c86b for instance with task_state deleting. {{(pid=72382) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 15:30:11 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:30:11 user nova-compute[72382]: INFO nova.virt.libvirt.driver [-] [instance: 6296ba5d-bcc6-405a-a635-0e9aa6114f7b] Instance destroyed successfully.
Aug 09 15:30:11 user nova-compute[72382]: DEBUG nova.objects.instance [None req-ab993759-8979-43fc-a46f-bfab9b21d9b5 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] Lazy-loading 'resources' on Instance uuid 6296ba5d-bcc6-405a-a635-0e9aa6114f7b {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:30:11 user nova-compute[72382]: DEBUG nova.virt.libvirt.vif [None req-ab993759-8979-43fc-a46f-bfab9b21d9b5 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T15:22:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1382530191',display_name='tempest-SnapshotDataIntegrityTests-server-1382530191',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1382530191',id=20,image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAXrscAaQcP3TCPtMhZcwlkpYpDdX2ol+VJV7W2igYvedoFqYg+omg+CmJgtJvVz3nDO0ndBHXFEZrZn3ajiQurnkuFoLiOJw8LqTEUj237zSInajxY6YTrv7lsn1pr7IA==',key_name='tempest-keypair-877982537',keypairs=<?>,launch_index=0,launched_at=2023-08-09T15:22:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ca3091c1fc764326b65d9db6f1de9746',ramdisk_id='',reservation_id='r-5mw0syiv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-407285757',owner_user_name='tempest-SnapshotDataIntegrityTests-407285757-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T15:22:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e5a4e350207e43ea99f5f828990ff999',uuid=6296ba5d-bcc6-405a-a635-0e9aa6114f7b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dc2f667c-53dc-44b5-bd9d-55b4e9a4c86b", "address": "fa:16:3e:0b:83:7d", "network": {"id": "db8ab944-48c5-49d7-8f11-1216b54c6ea6", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1491766949-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca3091c1fc764326b65d9db6f1de9746", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc2f667c-53", "ovs_interfaceid": "dc2f667c-53dc-44b5-bd9d-55b4e9a4c86b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 15:30:11 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-ab993759-8979-43fc-a46f-bfab9b21d9b5 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] Converting VIF {"id": "dc2f667c-53dc-44b5-bd9d-55b4e9a4c86b", "address": "fa:16:3e:0b:83:7d", "network": {"id": "db8ab944-48c5-49d7-8f11-1216b54c6ea6", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1491766949-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca3091c1fc764326b65d9db6f1de9746", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc2f667c-53", "ovs_interfaceid": "dc2f667c-53dc-44b5-bd9d-55b4e9a4c86b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 15:30:11 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-ab993759-8979-43fc-a46f-bfab9b21d9b5 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0b:83:7d,bridge_name='br-int',has_traffic_filtering=True,id=dc2f667c-53dc-44b5-bd9d-55b4e9a4c86b,network=Network(db8ab944-48c5-49d7-8f11-1216b54c6ea6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc2f667c-53') {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 15:30:11 user nova-compute[72382]: DEBUG os_vif [None req-ab993759-8979-43fc-a46f-bfab9b21d9b5 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0b:83:7d,bridge_name='br-int',has_traffic_filtering=True,id=dc2f667c-53dc-44b5-bd9d-55b4e9a4c86b,network=Network(db8ab944-48c5-49d7-8f11-1216b54c6ea6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc2f667c-53') {{(pid=72382) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 15:30:11 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:30:11 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdc2f667c-53, bridge=br-int, if_exists=True) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:30:11 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:30:11 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:30:11 user nova-compute[72382]: INFO os_vif [None req-ab993759-8979-43fc-a46f-bfab9b21d9b5 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0b:83:7d,bridge_name='br-int',has_traffic_filtering=True,id=dc2f667c-53dc-44b5-bd9d-55b4e9a4c86b,network=Network(db8ab944-48c5-49d7-8f11-1216b54c6ea6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc2f667c-53')
Aug 09 15:30:11 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-ab993759-8979-43fc-a46f-bfab9b21d9b5 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] [instance: 6296ba5d-bcc6-405a-a635-0e9aa6114f7b] Deleting instance files /opt/stack/data/nova/instances/6296ba5d-bcc6-405a-a635-0e9aa6114f7b_del
Aug 09 15:30:11 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-ab993759-8979-43fc-a46f-bfab9b21d9b5 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] [instance: 6296ba5d-bcc6-405a-a635-0e9aa6114f7b] Deletion of /opt/stack/data/nova/instances/6296ba5d-bcc6-405a-a635-0e9aa6114f7b_del complete
Aug 09 15:30:11 user nova-compute[72382]: INFO nova.compute.manager [None req-ab993759-8979-43fc-a46f-bfab9b21d9b5 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] [instance: 6296ba5d-bcc6-405a-a635-0e9aa6114f7b] Took 0.88 seconds to destroy the instance on the hypervisor.
Aug 09 15:30:11 user nova-compute[72382]: DEBUG oslo.service.loopingcall [None req-ab993759-8979-43fc-a46f-bfab9b21d9b5 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72382) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 15:30:11 user nova-compute[72382]: DEBUG nova.compute.manager [-] [instance: 6296ba5d-bcc6-405a-a635-0e9aa6114f7b] Deallocating network for instance {{(pid=72382) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 15:30:11 user nova-compute[72382]: DEBUG nova.network.neutron [-] [instance: 6296ba5d-bcc6-405a-a635-0e9aa6114f7b] deallocate_for_instance() {{(pid=72382) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 15:30:11 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:30:11 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:30:11 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:30:11 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:30:11 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ea8f68c-3dc1-45ac-a7f3-bca32f929add/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:30:11 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ea8f68c-3dc1-45ac-a7f3-bca32f929add/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:30:11 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ea8f68c-3dc1-45ac-a7f3-bca32f929add/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:30:12 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ea8f68c-3dc1-45ac-a7f3-bca32f929add/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:30:12 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f780040f-b789-4b72-8986-813c7b9fe4a6/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:30:12 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f780040f-b789-4b72-8986-813c7b9fe4a6/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:30:12 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f780040f-b789-4b72-8986-813c7b9fe4a6/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:30:12 user nova-compute[72382]: DEBUG nova.network.neutron [-] [instance: 6296ba5d-bcc6-405a-a635-0e9aa6114f7b] Updating instance_info_cache with network_info: [] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:30:12 user nova-compute[72382]: INFO nova.compute.manager [-] [instance: 6296ba5d-bcc6-405a-a635-0e9aa6114f7b] Took 0.91 seconds to deallocate network for instance.
Aug 09 15:30:12 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f780040f-b789-4b72-8986-813c7b9fe4a6/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:30:12 user nova-compute[72382]: DEBUG nova.compute.manager [req-298c5619-bfa2-4c6f-9294-7a305f9222a7 req-1c49adb4-16ae-4989-b5a7-965282463130 service nova] [instance: 6296ba5d-bcc6-405a-a635-0e9aa6114f7b] Received event network-vif-deleted-dc2f667c-53dc-44b5-bd9d-55b4e9a4c86b {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:30:12 user nova-compute[72382]: INFO nova.compute.manager [req-298c5619-bfa2-4c6f-9294-7a305f9222a7 req-1c49adb4-16ae-4989-b5a7-965282463130 service nova] [instance: 6296ba5d-bcc6-405a-a635-0e9aa6114f7b] Neutron deleted interface dc2f667c-53dc-44b5-bd9d-55b4e9a4c86b; detaching it from the instance and deleting it from the info cache
Aug 09 15:30:12 user nova-compute[72382]: DEBUG nova.network.neutron [req-298c5619-bfa2-4c6f-9294-7a305f9222a7 req-1c49adb4-16ae-4989-b5a7-965282463130 service nova] [instance: 6296ba5d-bcc6-405a-a635-0e9aa6114f7b] Updating instance_info_cache with network_info: [] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:30:12 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/266be814-4a2b-4f8e-a0f6-e8821fdeb95d/disk.rescue --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:30:12 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-ab993759-8979-43fc-a46f-bfab9b21d9b5 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:30:12 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-ab993759-8979-43fc-a46f-bfab9b21d9b5 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:30:12 user nova-compute[72382]: DEBUG nova.compute.manager [req-298c5619-bfa2-4c6f-9294-7a305f9222a7 req-1c49adb4-16ae-4989-b5a7-965282463130 service nova] [instance: 6296ba5d-bcc6-405a-a635-0e9aa6114f7b] Detach interface failed, port_id=dc2f667c-53dc-44b5-bd9d-55b4e9a4c86b, reason: Instance 6296ba5d-bcc6-405a-a635-0e9aa6114f7b could not be found. {{(pid=72382) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 09 15:30:12 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/266be814-4a2b-4f8e-a0f6-e8821fdeb95d/disk.rescue --force-share --output=json" returned: 0 in 0.133s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:30:12 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/266be814-4a2b-4f8e-a0f6-e8821fdeb95d/disk.rescue --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:30:12 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/266be814-4a2b-4f8e-a0f6-e8821fdeb95d/disk.rescue --force-share --output=json" returned: 0 in 0.155s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:30:12 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/266be814-4a2b-4f8e-a0f6-e8821fdeb95d/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:30:12 user nova-compute[72382]: DEBUG nova.compute.provider_tree [None req-ab993759-8979-43fc-a46f-bfab9b21d9b5 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] Inventory has not changed in ProviderTree for provider: 7b15b0e5-df4d-49db-833b-2855d21d10ae {{(pid=72382) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 15:30:12 user nova-compute[72382]: DEBUG nova.scheduler.client.report [None req-ab993759-8979-43fc-a46f-bfab9b21d9b5 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] Inventory has not changed for provider 7b15b0e5-df4d-49db-833b-2855d21d10ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72382) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 15:30:12 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/266be814-4a2b-4f8e-a0f6-e8821fdeb95d/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:30:12 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/266be814-4a2b-4f8e-a0f6-e8821fdeb95d/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:30:12 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-ab993759-8979-43fc-a46f-bfab9b21d9b5 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.441s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:30:12 user nova-compute[72382]: INFO nova.scheduler.client.report [None req-ab993759-8979-43fc-a46f-bfab9b21d9b5 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] Deleted allocations for instance 6296ba5d-bcc6-405a-a635-0e9aa6114f7b
Aug 09 15:30:13 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/266be814-4a2b-4f8e-a0f6-e8821fdeb95d/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:30:13 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72382) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 15:30:13 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-ab993759-8979-43fc-a46f-bfab9b21d9b5 tempest-SnapshotDataIntegrityTests-407285757 tempest-SnapshotDataIntegrityTests-407285757-project-member] Lock "6296ba5d-bcc6-405a-a635-0e9aa6114f7b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.444s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:30:13 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14c97840-88c0-4a8e-96e8-2e7da318ad07/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:30:13 user nova-compute[72382]: DEBUG nova.compute.manager [req-f3b6e33d-3ef1-40d4-8097-d6a506eb8938 req-594f57fc-5b23-41bc-bd15-413ea283159e service nova] [instance: 6296ba5d-bcc6-405a-a635-0e9aa6114f7b] Received event network-vif-plugged-dc2f667c-53dc-44b5-bd9d-55b4e9a4c86b {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:30:13 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-f3b6e33d-3ef1-40d4-8097-d6a506eb8938 req-594f57fc-5b23-41bc-bd15-413ea283159e service nova] Acquiring lock "6296ba5d-bcc6-405a-a635-0e9aa6114f7b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:30:13 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-f3b6e33d-3ef1-40d4-8097-d6a506eb8938 req-594f57fc-5b23-41bc-bd15-413ea283159e service nova] Lock "6296ba5d-bcc6-405a-a635-0e9aa6114f7b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.007s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:30:13 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-f3b6e33d-3ef1-40d4-8097-d6a506eb8938 req-594f57fc-5b23-41bc-bd15-413ea283159e service nova] Lock "6296ba5d-bcc6-405a-a635-0e9aa6114f7b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:30:13 user nova-compute[72382]: DEBUG nova.compute.manager [req-f3b6e33d-3ef1-40d4-8097-d6a506eb8938 req-594f57fc-5b23-41bc-bd15-413ea283159e service nova] [instance: 6296ba5d-bcc6-405a-a635-0e9aa6114f7b] No waiting events found dispatching network-vif-plugged-dc2f667c-53dc-44b5-bd9d-55b4e9a4c86b {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:30:13 user nova-compute[72382]: WARNING nova.compute.manager [req-f3b6e33d-3ef1-40d4-8097-d6a506eb8938 req-594f57fc-5b23-41bc-bd15-413ea283159e service nova] [instance: 6296ba5d-bcc6-405a-a635-0e9aa6114f7b] Received unexpected event network-vif-plugged-dc2f667c-53dc-44b5-bd9d-55b4e9a4c86b for instance with vm_state deleted and task_state None.
Aug 09 15:30:13 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14c97840-88c0-4a8e-96e8-2e7da318ad07/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:30:13 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14c97840-88c0-4a8e-96e8-2e7da318ad07/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:30:13 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14c97840-88c0-4a8e-96e8-2e7da318ad07/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:30:13 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=72382) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 15:30:13 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44afd1bf-fa5c-4b3e-8752-b16853fef54e/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:30:13 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44afd1bf-fa5c-4b3e-8752-b16853fef54e/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:30:13 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44afd1bf-fa5c-4b3e-8752-b16853fef54e/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:30:13 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44afd1bf-fa5c-4b3e-8752-b16853fef54e/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:30:13 user nova-compute[72382]: WARNING nova.virt.libvirt.driver [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Error from libvirt while getting description of instance-00000014: [Error Code 42] Domain not found: no domain with matching uuid '6296ba5d-bcc6-405a-a635-0e9aa6114f7b' (instance-00000014): libvirt.libvirtError: Domain not found: no domain with matching uuid '6296ba5d-bcc6-405a-a635-0e9aa6114f7b' (instance-00000014)
Aug 09 15:30:13 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ccbfda2-8bcd-4ec1-972a-cf49a62b1583/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:30:13 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ccbfda2-8bcd-4ec1-972a-cf49a62b1583/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:30:13 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ccbfda2-8bcd-4ec1-972a-cf49a62b1583/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:30:13 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ccbfda2-8bcd-4ec1-972a-cf49a62b1583/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:30:13 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=72382) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 15:30:13 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f430d9a-9fbf-43cd-8c0d-e5dec162be71/disk.rescue --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:30:13 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-2443e16e-0417-48b6-af28-2f1dbc002741 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Acquiring lock "4ccbfda2-8bcd-4ec1-972a-cf49a62b1583" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:30:13 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-2443e16e-0417-48b6-af28-2f1dbc002741 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Lock "4ccbfda2-8bcd-4ec1-972a-cf49a62b1583" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.003s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:30:13 user nova-compute[72382]: DEBUG nova.objects.instance [None req-2443e16e-0417-48b6-af28-2f1dbc002741 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Lazy-loading 'flavor' on Instance uuid 4ccbfda2-8bcd-4ec1-972a-cf49a62b1583 {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:30:14 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-2443e16e-0417-48b6-af28-2f1dbc002741 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Lock "4ccbfda2-8bcd-4ec1-972a-cf49a62b1583" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:30:14 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f430d9a-9fbf-43cd-8c0d-e5dec162be71/disk.rescue --force-share --output=json" returned: 0 in 0.134s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:30:14 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f430d9a-9fbf-43cd-8c0d-e5dec162be71/disk.rescue --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:30:14 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-2443e16e-0417-48b6-af28-2f1dbc002741 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Acquiring lock "4ccbfda2-8bcd-4ec1-972a-cf49a62b1583" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:30:14 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-2443e16e-0417-48b6-af28-2f1dbc002741 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Lock "4ccbfda2-8bcd-4ec1-972a-cf49a62b1583" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:30:14 user nova-compute[72382]: INFO nova.compute.manager [None req-2443e16e-0417-48b6-af28-2f1dbc002741 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] [instance: 4ccbfda2-8bcd-4ec1-972a-cf49a62b1583] Attaching volume b5cfefdb-a454-494f-ab09-acf8644352a3 to /dev/vdb
Aug 09 15:30:14 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f430d9a-9fbf-43cd-8c0d-e5dec162be71/disk.rescue --force-share --output=json" returned: 0 in 0.171s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:30:14 user nova-compute[72382]: DEBUG os_brick.utils [None req-2443e16e-0417-48b6-af28-2f1dbc002741 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 15:30:14 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:30:14 user nova-compute[72382]: WARNING nova.virt.libvirt.driver [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 15:30:14 user nova-compute[72382]: WARNING nova.virt.libvirt.driver [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 15:30:14 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Hypervisor/Node resource view: name=user free_ram=7568MB free_disk=25.24030303955078GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72382) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 15:30:14 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:30:14 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:30:14 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:30:14 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[04d89aaa-b8ea-4bd7-b6c0-3cf7be1a518d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d2cfa7015fe\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:30:14 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:30:14 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:30:14 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[7de06717-adcc-4dba-8e8c-ae4384343528]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:30:14 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:30:14 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:30:14 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[3db8f50e-d87b-41cb-9ab8-5725973944a8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:30:14 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[59fc6399-9cd7-48af-b964-c72d7e3af4b3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:30:14 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-2443e16e-0417-48b6-af28-2f1dbc002741 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Running cmd (subprocess): nvme version {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:30:14 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-2443e16e-0417-48b6-af28-2f1dbc002741 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] 'nvme version' failed. Not Retrying. {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 15:30:14 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2443e16e-0417-48b6-af28-2f1dbc002741 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] nvme not present on system {{(pid=72382) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 15:30:14 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:30:14 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 15:30:14 user nova-compute[72382]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 15:30:14 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[afacd4dd-3ec9-4262-b92d-f912d0c8c47d]: (4, '') {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:30:14 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.lightos [None req-2443e16e-0417-48b6-af28-2f1dbc002741 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72382) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 15:30:14 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.lightos [None req-2443e16e-0417-48b6-af28-2f1dbc002741 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72382) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 15:30:14 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.lightos [None req-2443e16e-0417-48b6-af28-2f1dbc002741 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] LIGHTOS: no hostnqn found. {{(pid=72382) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 15:30:14 user nova-compute[72382]: DEBUG os_brick.utils [None req-2443e16e-0417-48b6-af28-2f1dbc002741 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d2cfa7015fe', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 15:30:14 user nova-compute[72382]: DEBUG nova.virt.block_device [None req-2443e16e-0417-48b6-af28-2f1dbc002741 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] [instance: 4ccbfda2-8bcd-4ec1-972a-cf49a62b1583] Updating existing volume attachment record: 72e4aed0-8872-4020-885e-0f37db41883e {{(pid=72382) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 15:30:14 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance f780040f-b789-4b72-8986-813c7b9fe4a6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:30:14 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance 44afd1bf-fa5c-4b3e-8752-b16853fef54e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:30:14 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance 266be814-4a2b-4f8e-a0f6-e8821fdeb95d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:30:14 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance 0f510d75-5d1e-4a5c-b38f-731c299f0f5a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:30:14 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance 6ea8f68c-3dc1-45ac-a7f3-bca32f929add actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:30:14 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:30:14 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance 14c97840-88c0-4a8e-96e8-2e7da318ad07 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:30:14 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance 4ccbfda2-8bcd-4ec1-972a-cf49a62b1583 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:30:14 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance 2f430d9a-9fbf-43cd-8c0d-e5dec162be71 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:30:14 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=72382) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 15:30:14 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=72382) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 15:30:15 user nova-compute[72382]: DEBUG nova.compute.provider_tree [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Inventory has not changed in ProviderTree for provider: 7b15b0e5-df4d-49db-833b-2855d21d10ae {{(pid=72382) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 15:30:15 user nova-compute[72382]: DEBUG nova.scheduler.client.report [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Inventory has not changed for provider 7b15b0e5-df4d-49db-833b-2855d21d10ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72382) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 15:30:15 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Compute_service record updated for user:user {{(pid=72382) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 15:30:15 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.462s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:30:16 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:30:16 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:30:16 user nova-compute[72382]: DEBUG nova.compute.manager [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Starting heal instance info cache {{(pid=72382) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 15:30:16 user nova-compute[72382]: DEBUG nova.compute.manager [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Rebuilding the list of instances to heal {{(pid=72382) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 09 15:30:16 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Acquiring lock "refresh_cache-f780040f-b789-4b72-8986-813c7b9fe4a6" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 15:30:16 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Acquired lock "refresh_cache-f780040f-b789-4b72-8986-813c7b9fe4a6" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 15:30:16 user nova-compute[72382]: DEBUG nova.network.neutron [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] [instance: f780040f-b789-4b72-8986-813c7b9fe4a6] Forcefully refreshing network info cache for instance {{(pid=72382) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 15:30:16 user nova-compute[72382]: DEBUG nova.objects.instance [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lazy-loading 'info_cache' on Instance uuid f780040f-b789-4b72-8986-813c7b9fe4a6 {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:30:16 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:30:16 user nova-compute[72382]: DEBUG nova.network.neutron [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] [instance: f780040f-b789-4b72-8986-813c7b9fe4a6] Updating instance_info_cache with network_info: [{"id": "3c9b6983-5682-4eaa-866c-1baf9f2ede26", "address": "fa:16:3e:20:d4:ea", "network": {"id": "d47e3749-fdff-4112-bd72-69ca584efe1f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-302967634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "080d1ded4cd94e5083ee0b7e691b7363", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c9b6983-56", "ovs_interfaceid": "3c9b6983-5682-4eaa-866c-1baf9f2ede26", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:30:16 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Releasing lock "refresh_cache-f780040f-b789-4b72-8986-813c7b9fe4a6" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 15:30:16 user nova-compute[72382]: DEBUG nova.compute.manager [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] [instance: f780040f-b789-4b72-8986-813c7b9fe4a6] Updated the network info_cache for instance {{(pid=72382) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 15:30:16 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:30:16 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:30:16 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:30:17 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:30:17 user nova-compute[72382]: DEBUG nova.compute.manager [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72382) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 15:30:18 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:30:20 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:30:21 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:30:26 user nova-compute[72382]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691595011.355999, 6296ba5d-bcc6-405a-a635-0e9aa6114f7b => Stopped> {{(pid=72382) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 15:30:26 user nova-compute[72382]: INFO nova.compute.manager [-] [instance: 6296ba5d-bcc6-405a-a635-0e9aa6114f7b] VM Stopped (Lifecycle Event)
Aug 09 15:30:26 user nova-compute[72382]: DEBUG nova.compute.manager [None req-f650873c-7033-4af2-92d3-15adc143bba5 None None] [instance: 6296ba5d-bcc6-405a-a635-0e9aa6114f7b] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:30:26 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:30:27 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-45029b36-de29-45b3-8ae5-2098fe3f770a tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Acquiring lock "d7c34b80-c2e9-43c1-8b8e-7c62eb8e73f4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:30:27 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-45029b36-de29-45b3-8ae5-2098fe3f770a tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Lock "d7c34b80-c2e9-43c1-8b8e-7c62eb8e73f4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:30:27 user nova-compute[72382]: DEBUG nova.compute.manager [None req-45029b36-de29-45b3-8ae5-2098fe3f770a tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] [instance: d7c34b80-c2e9-43c1-8b8e-7c62eb8e73f4] Starting instance... {{(pid=72382) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 15:30:27 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-45029b36-de29-45b3-8ae5-2098fe3f770a tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:30:27 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-45029b36-de29-45b3-8ae5-2098fe3f770a tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:30:27 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-45029b36-de29-45b3-8ae5-2098fe3f770a tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72382) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 15:30:27 user nova-compute[72382]: INFO nova.compute.claims [None req-45029b36-de29-45b3-8ae5-2098fe3f770a tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] [instance: d7c34b80-c2e9-43c1-8b8e-7c62eb8e73f4] Claim successful on node user
Aug 09 15:30:27 user nova-compute[72382]: DEBUG nova.compute.provider_tree [None req-45029b36-de29-45b3-8ae5-2098fe3f770a tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Inventory has not changed in ProviderTree for provider: 7b15b0e5-df4d-49db-833b-2855d21d10ae {{(pid=72382) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 15:30:27 user nova-compute[72382]: DEBUG nova.scheduler.client.report [None req-45029b36-de29-45b3-8ae5-2098fe3f770a tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Inventory has not changed for provider 7b15b0e5-df4d-49db-833b-2855d21d10ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72382) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 15:30:27 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-45029b36-de29-45b3-8ae5-2098fe3f770a tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.435s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:30:27 user nova-compute[72382]: DEBUG nova.compute.manager [None req-45029b36-de29-45b3-8ae5-2098fe3f770a tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] [instance: d7c34b80-c2e9-43c1-8b8e-7c62eb8e73f4] Start building networks asynchronously for instance. {{(pid=72382) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 15:30:27 user nova-compute[72382]: DEBUG nova.compute.manager [None req-45029b36-de29-45b3-8ae5-2098fe3f770a tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] [instance: d7c34b80-c2e9-43c1-8b8e-7c62eb8e73f4] Allocating IP information in the background. {{(pid=72382) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 15:30:27 user nova-compute[72382]: DEBUG nova.network.neutron [None req-45029b36-de29-45b3-8ae5-2098fe3f770a tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] [instance: d7c34b80-c2e9-43c1-8b8e-7c62eb8e73f4] allocate_for_instance() {{(pid=72382) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 15:30:27 user nova-compute[72382]: INFO nova.compute.manager [None req-a315155e-ef4a-4ff4-ade2-167c2e07a7fc tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] [instance: 2f430d9a-9fbf-43cd-8c0d-e5dec162be71] Unrescuing
Aug 09 15:30:27 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-a315155e-ef4a-4ff4-ade2-167c2e07a7fc tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Acquiring lock "refresh_cache-2f430d9a-9fbf-43cd-8c0d-e5dec162be71" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 15:30:27 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-a315155e-ef4a-4ff4-ade2-167c2e07a7fc tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Acquired lock "refresh_cache-2f430d9a-9fbf-43cd-8c0d-e5dec162be71" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 15:30:27 user nova-compute[72382]: DEBUG nova.network.neutron [None req-a315155e-ef4a-4ff4-ade2-167c2e07a7fc tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] [instance: 2f430d9a-9fbf-43cd-8c0d-e5dec162be71] Building network info cache for instance {{(pid=72382) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 15:30:27 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-45029b36-de29-45b3-8ae5-2098fe3f770a tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] [instance: d7c34b80-c2e9-43c1-8b8e-7c62eb8e73f4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 15:30:27 user nova-compute[72382]: DEBUG nova.compute.manager [None req-45029b36-de29-45b3-8ae5-2098fe3f770a tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] [instance: d7c34b80-c2e9-43c1-8b8e-7c62eb8e73f4] Start building block device mappings for instance. {{(pid=72382) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 15:30:27 user nova-compute[72382]: DEBUG nova.compute.manager [None req-45029b36-de29-45b3-8ae5-2098fe3f770a tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] [instance: d7c34b80-c2e9-43c1-8b8e-7c62eb8e73f4] Start spawning the instance on the hypervisor. {{(pid=72382) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 15:30:27 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-45029b36-de29-45b3-8ae5-2098fe3f770a tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] [instance: d7c34b80-c2e9-43c1-8b8e-7c62eb8e73f4] Creating instance directory {{(pid=72382) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 15:30:27 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-45029b36-de29-45b3-8ae5-2098fe3f770a tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] [instance: d7c34b80-c2e9-43c1-8b8e-7c62eb8e73f4] Creating image(s)
Aug 09 15:30:27 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-45029b36-de29-45b3-8ae5-2098fe3f770a tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Acquiring lock "/opt/stack/data/nova/instances/d7c34b80-c2e9-43c1-8b8e-7c62eb8e73f4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:30:27 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-45029b36-de29-45b3-8ae5-2098fe3f770a tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Lock "/opt/stack/data/nova/instances/d7c34b80-c2e9-43c1-8b8e-7c62eb8e73f4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:30:27 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-45029b36-de29-45b3-8ae5-2098fe3f770a tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Lock "/opt/stack/data/nova/instances/d7c34b80-c2e9-43c1-8b8e-7c62eb8e73f4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:30:27 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-45029b36-de29-45b3-8ae5-2098fe3f770a tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:30:27 user nova-compute[72382]: DEBUG nova.policy [None req-45029b36-de29-45b3-8ae5-2098fe3f770a tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '401c9df41f284c88a86557485d7d9537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98009994d9c74eb9b4fc6321e82440de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72382) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 15:30:27 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-45029b36-de29-45b3-8ae5-2098fe3f770a tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b --force-share --output=json" returned: 0 in 0.138s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:30:27 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-45029b36-de29-45b3-8ae5-2098fe3f770a tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Acquiring lock "383812ff437283e0191ed5b9ecc04c27f1162b0b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:30:27 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-45029b36-de29-45b3-8ae5-2098fe3f770a tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Lock "383812ff437283e0191ed5b9ecc04c27f1162b0b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:30:27 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-45029b36-de29-45b3-8ae5-2098fe3f770a tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:30:28 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-45029b36-de29-45b3-8ae5-2098fe3f770a tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b --force-share --output=json" returned: 0 in 0.135s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:30:28 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-45029b36-de29-45b3-8ae5-2098fe3f770a tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b,backing_fmt=raw /opt/stack/data/nova/instances/d7c34b80-c2e9-43c1-8b8e-7c62eb8e73f4/disk 1073741824 {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:30:28 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-45029b36-de29-45b3-8ae5-2098fe3f770a tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b,backing_fmt=raw /opt/stack/data/nova/instances/d7c34b80-c2e9-43c1-8b8e-7c62eb8e73f4/disk 1073741824" returned: 0 in 0.057s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:30:28 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-45029b36-de29-45b3-8ae5-2098fe3f770a tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Lock "383812ff437283e0191ed5b9ecc04c27f1162b0b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.198s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:30:28 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-45029b36-de29-45b3-8ae5-2098fe3f770a tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:30:28 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-45029b36-de29-45b3-8ae5-2098fe3f770a tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b --force-share --output=json" returned: 0 in 0.133s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:30:28 user nova-compute[72382]: DEBUG nova.virt.disk.api [None req-45029b36-de29-45b3-8ae5-2098fe3f770a tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d7c34b80-c2e9-43c1-8b8e-7c62eb8e73f4/disk. size=1073741824 {{(pid=72382) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 15:30:28 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-45029b36-de29-45b3-8ae5-2098fe3f770a tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7c34b80-c2e9-43c1-8b8e-7c62eb8e73f4/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:30:28 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-45029b36-de29-45b3-8ae5-2098fe3f770a tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7c34b80-c2e9-43c1-8b8e-7c62eb8e73f4/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:30:28 user nova-compute[72382]: DEBUG nova.virt.disk.api [None req-45029b36-de29-45b3-8ae5-2098fe3f770a tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Cannot resize image /opt/stack/data/nova/instances/d7c34b80-c2e9-43c1-8b8e-7c62eb8e73f4/disk to a smaller size. {{(pid=72382) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 15:30:28 user nova-compute[72382]: DEBUG nova.objects.instance [None req-45029b36-de29-45b3-8ae5-2098fe3f770a tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Lazy-loading 'migration_context' on Instance uuid d7c34b80-c2e9-43c1-8b8e-7c62eb8e73f4 {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:30:28 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-45029b36-de29-45b3-8ae5-2098fe3f770a tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] [instance: d7c34b80-c2e9-43c1-8b8e-7c62eb8e73f4] Created local disks {{(pid=72382) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 15:30:28 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-45029b36-de29-45b3-8ae5-2098fe3f770a tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] [instance: d7c34b80-c2e9-43c1-8b8e-7c62eb8e73f4] Ensure instance console log exists: /opt/stack/data/nova/instances/d7c34b80-c2e9-43c1-8b8e-7c62eb8e73f4/console.log {{(pid=72382) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 15:30:28 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-45029b36-de29-45b3-8ae5-2098fe3f770a tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:30:28 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-45029b36-de29-45b3-8ae5-2098fe3f770a tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:30:28 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-45029b36-de29-45b3-8ae5-2098fe3f770a tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:30:28 user nova-compute[72382]: DEBUG nova.network.neutron [None req-a315155e-ef4a-4ff4-ade2-167c2e07a7fc tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] [instance: 2f430d9a-9fbf-43cd-8c0d-e5dec162be71] Updating instance_info_cache with network_info: [{"id": "d13c4d4e-9004-4d4b-999d-619564a98542", "address": "fa:16:3e:10:88:6e", "network": {"id": "d47e3749-fdff-4112-bd72-69ca584efe1f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-302967634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "080d1ded4cd94e5083ee0b7e691b7363", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd13c4d4e-90", "ovs_interfaceid": "d13c4d4e-9004-4d4b-999d-619564a98542", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:30:28 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-a315155e-ef4a-4ff4-ade2-167c2e07a7fc tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Releasing lock "refresh_cache-2f430d9a-9fbf-43cd-8c0d-e5dec162be71" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 15:30:28 user nova-compute[72382]: DEBUG nova.objects.instance [None req-a315155e-ef4a-4ff4-ade2-167c2e07a7fc tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Lazy-loading 'flavor' on Instance uuid 2f430d9a-9fbf-43cd-8c0d-e5dec162be71 {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:30:28 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:30:28 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:30:28 user nova-compute[72382]: DEBUG nova.compute.manager [req-c12ed80f-09cd-4f58-9a7b-0ef8e440f29e req-485f75d5-deef-4ac9-a79d-99b77311008b service nova] [instance: 2f430d9a-9fbf-43cd-8c0d-e5dec162be71] Received event network-vif-unplugged-d13c4d4e-9004-4d4b-999d-619564a98542 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:30:28 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-c12ed80f-09cd-4f58-9a7b-0ef8e440f29e req-485f75d5-deef-4ac9-a79d-99b77311008b service nova] Acquiring lock "2f430d9a-9fbf-43cd-8c0d-e5dec162be71-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:30:28 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-c12ed80f-09cd-4f58-9a7b-0ef8e440f29e req-485f75d5-deef-4ac9-a79d-99b77311008b service nova] Lock "2f430d9a-9fbf-43cd-8c0d-e5dec162be71-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:30:28 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-c12ed80f-09cd-4f58-9a7b-0ef8e440f29e req-485f75d5-deef-4ac9-a79d-99b77311008b service nova] Lock "2f430d9a-9fbf-43cd-8c0d-e5dec162be71-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:30:28 user nova-compute[72382]: DEBUG nova.compute.manager [req-c12ed80f-09cd-4f58-9a7b-0ef8e440f29e req-485f75d5-deef-4ac9-a79d-99b77311008b service nova] [instance: 2f430d9a-9fbf-43cd-8c0d-e5dec162be71] No waiting events found dispatching network-vif-unplugged-d13c4d4e-9004-4d4b-999d-619564a98542 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:30:28 user nova-compute[72382]: WARNING nova.compute.manager [req-c12ed80f-09cd-4f58-9a7b-0ef8e440f29e req-485f75d5-deef-4ac9-a79d-99b77311008b service nova] [instance: 2f430d9a-9fbf-43cd-8c0d-e5dec162be71] Received unexpected event network-vif-unplugged-d13c4d4e-9004-4d4b-999d-619564a98542 for instance with vm_state rescued and task_state unrescuing.
Aug 09 15:30:28 user nova-compute[72382]: DEBUG nova.network.neutron [None req-45029b36-de29-45b3-8ae5-2098fe3f770a tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] [instance: d7c34b80-c2e9-43c1-8b8e-7c62eb8e73f4] Successfully created port: a0b8be03-4b4b-444f-ab4d-b7a78d18f799 {{(pid=72382) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 15:30:28 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:30:28 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:30:29 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2443e16e-0417-48b6-af28-2f1dbc002741 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] [instance: 4ccbfda2-8bcd-4ec1-972a-cf49a62b1583] Calling os-brick to attach iSCSI Volume {{(pid=72382) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 15:30:29 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-2443e16e-0417-48b6-af28-2f1dbc002741 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2a0c768340>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:b5cfefdb-a454-494f-ab09-acf8644352a3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VjpQFgdP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 15:30:29 user nova-compute[72382]: WARNING os_brick.initiator.connectors.base [None req-2443e16e-0417-48b6-af28-2f1dbc002741 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 15:30:29 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-2443e16e-0417-48b6-af28-2f1dbc002741 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 15:30:29 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-2443e16e-0417-48b6-af28-2f1dbc002741 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 15:30:29 user nova-compute[72382]: WARNING os_brick.initiator.connectors.base [None req-2443e16e-0417-48b6-af28-2f1dbc002741 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 15:30:29 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-2443e16e-0417-48b6-af28-2f1dbc002741 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b5cfefdb-a454-494f-ab09-acf8644352a3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 15:30:29 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-2443e16e-0417-48b6-af28-2f1dbc002741 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b5cfefdb-a454-494f-ab09-acf8644352a3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 15:30:29 user nova-compute[72382]: INFO os_brick.initiator.connectors.iscsi [None req-2443e16e-0417-48b6-af28-2f1dbc002741 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 15:30:29 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5cfefdb-a454-494f-ab09-acf8644352a3 -p 172.16.0.220:3260 {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:30:29 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5cfefdb-a454-494f-ab09-acf8644352a3 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:30:29 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1d49358-3718-4fb5-bebc-f5433fa73787]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:30:29 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-2443e16e-0417-48b6-af28-2f1dbc002741 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 15:30:29 user nova-compute[72382]:  {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:30:29 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5cfefdb-a454-494f-ab09-acf8644352a3 -p 172.16.0.220:3260 --interface default --op new {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:30:29 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5cfefdb-a454-494f-ab09-acf8644352a3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:30:29 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[2029f3eb-2aaa-4bec-beff-2f583e6cf47e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b5cfefdb-a454-494f-ab09-acf8644352a3] added\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:30:29 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-2443e16e-0417-48b6-af28-2f1dbc002741 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b5cfefdb-a454-494f-ab09-acf8644352a3] added
Aug 09 15:30:29 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:30:29 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5cfefdb-a454-494f-ab09-acf8644352a3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:30:29 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5cfefdb-a454-494f-ab09-acf8644352a3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:30:29 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[98c8181a-b629-40b3-b6cd-0ea92452bf3b]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:30:29 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-2443e16e-0417-48b6-af28-2f1dbc002741 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:30:29 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5cfefdb-a454-494f-ab09-acf8644352a3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:30:29 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5cfefdb-a454-494f-ab09-acf8644352a3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:30:29 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfac39e1-d89d-4c51-8e7c-362724fd57b5]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:30:29 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-2443e16e-0417-48b6-af28-2f1dbc002741 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:30:29 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5cfefdb-a454-494f-ab09-acf8644352a3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VjpQFgdP {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:30:29 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5cfefdb-a454-494f-ab09-acf8644352a3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VjpQFgdP" returned: 0 in 0.031s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:30:29 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[339de698-fd96-460a-810f-5f5781fe9ee0]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:30:29 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-2443e16e-0417-48b6-af28-2f1dbc002741 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VjpQFgdP'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:30:29 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5cfefdb-a454-494f-ab09-acf8644352a3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:30:29 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5cfefdb-a454-494f-ab09-acf8644352a3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:30:29 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f4f0c41-3b31-4866-aef5-fd9c210a750b]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:30:29 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-2443e16e-0417-48b6-af28-2f1dbc002741 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:30:29 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:30:29 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:30:29 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[0098c8c9-c632-44bd-8f3b-ef41e6260964]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25503c6e-bfc0-4008-846a-8cad783fc0fb (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e62d4416-be8c-4327-9a51-0cc509109c53 (non-flash)\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:30:29 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-2443e16e-0417-48b6-af28-2f1dbc002741 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)
Aug 09 15:30:29 user nova-compute[72382]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25503c6e-bfc0-4008-846a-8cad783fc0fb (non-flash)
Aug 09 15:30:29 user nova-compute[72382]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e62d4416-be8c-4327-9a51-0cc509109c53 (non-flash)
Aug 09 15:30:29 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 15:30:29 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-2443e16e-0417-48b6-af28-2f1dbc002741 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)
Aug 09 15:30:29 user nova-compute[72382]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25503c6e-bfc0-4008-846a-8cad783fc0fb (non-flash)
Aug 09 15:30:29 user nova-compute[72382]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e62d4416-be8c-4327-9a51-0cc509109c53 (non-flash)
Aug 09 15:30:29 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 15:30:29 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5cfefdb-a454-494f-ab09-acf8644352a3 -p 172.16.0.220:3260 --login {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:30:29 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5cfefdb-a454-494f-ab09-acf8644352a3 -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:30:29 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[6095213c-f727-4deb-951a-0a5f16e1defa]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b5cfefdb-a454-494f-ab09-acf8644352a3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b5cfefdb-a454-494f-ab09-acf8644352a3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:30:29 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-2443e16e-0417-48b6-af28-2f1dbc002741 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b5cfefdb-a454-494f-ab09-acf8644352a3, portal: 172.16.0.220,3260]
Aug 09 15:30:29 user nova-compute[72382]: Login to [iface: default, target: iqn.2010-10.org.openstack:b5cfefdb-a454-494f-ab09-acf8644352a3, portal: 172.16.0.220,3260] successful.
Aug 09 15:30:29 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:30:29 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5cfefdb-a454-494f-ab09-acf8644352a3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:30:29 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5cfefdb-a454-494f-ab09-acf8644352a3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:30:29 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5f5166b-60e7-4fec-8395-c8427bb49320]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:30:29 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-2443e16e-0417-48b6-af28-2f1dbc002741 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:30:29 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:30:29 user nova-compute[72382]: INFO nova.virt.libvirt.driver [-] [instance: 2f430d9a-9fbf-43cd-8c0d-e5dec162be71] Instance destroyed successfully.
Aug 09 15:30:29 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:30:29 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[d24f8cfd-c85f-428c-adba-f8caec92868a]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25503c6e-bfc0-4008-846a-8cad783fc0fb (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e62d4416-be8c-4327-9a51-0cc509109c53 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5cfefdb-a454-494f-ab09-acf8644352a3 (non-flash)\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:30:29 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-2443e16e-0417-48b6-af28-2f1dbc002741 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)
Aug 09 15:30:29 user nova-compute[72382]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25503c6e-bfc0-4008-846a-8cad783fc0fb (non-flash)
Aug 09 15:30:29 user nova-compute[72382]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e62d4416-be8c-4327-9a51-0cc509109c53 (non-flash)
Aug 09 15:30:29 user nova-compute[72382]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5cfefdb-a454-494f-ab09-acf8644352a3 (non-flash)
Aug 09 15:30:29 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 15:30:29 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-2443e16e-0417-48b6-af28-2f1dbc002741 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)
Aug 09 15:30:29 user nova-compute[72382]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25503c6e-bfc0-4008-846a-8cad783fc0fb (non-flash)
Aug 09 15:30:29 user nova-compute[72382]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e62d4416-be8c-4327-9a51-0cc509109c53 (non-flash)
Aug 09 15:30:29 user nova-compute[72382]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5cfefdb-a454-494f-ab09-acf8644352a3 (non-flash)
Aug 09 15:30:29 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 15:30:29 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-2443e16e-0417-48b6-af28-2f1dbc002741 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b5cfefdb-a454-494f-ab09-acf8644352a3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.352s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 15:30:29 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-2443e16e-0417-48b6-af28-2f1dbc002741 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Connected to 172.16.0.220:3260 {{(pid=72382) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 15:30:29 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-2443e16e-0417-48b6-af28-2f1dbc002741 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] HCTL ('33', '-', '-', 0) found on session 38 with lun 0 {{(pid=72382) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 15:30:29 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-2443e16e-0417-48b6-af28-2f1dbc002741 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72382) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 15:30:29 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:30:29 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:30:29 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1385f3a-2d17-4084-8b03-fedd8d01bafa]: (4, ('- - 0', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:30:29 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-2443e16e-0417-48b6-af28-2f1dbc002741 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Searching for a device in session 38 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72382) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 15:30:29 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-2443e16e-0417-48b6-af28-2f1dbc002741 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VjpQFgdP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72382) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 15:30:29 user nova-compute[72382]: DEBUG nova.network.neutron [None req-45029b36-de29-45b3-8ae5-2098fe3f770a tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] [instance: d7c34b80-c2e9-43c1-8b8e-7c62eb8e73f4] Successfully updated port: a0b8be03-4b4b-444f-ab4d-b7a78d18f799 {{(pid=72382) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 15:30:29 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-45029b36-de29-45b3-8ae5-2098fe3f770a tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Acquiring lock "refresh_cache-d7c34b80-c2e9-43c1-8b8e-7c62eb8e73f4" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 15:30:29 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-45029b36-de29-45b3-8ae5-2098fe3f770a tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Acquired lock "refresh_cache-d7c34b80-c2e9-43c1-8b8e-7c62eb8e73f4" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 15:30:29 user nova-compute[72382]: DEBUG nova.network.neutron [None req-45029b36-de29-45b3-8ae5-2098fe3f770a tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] [instance: d7c34b80-c2e9-43c1-8b8e-7c62eb8e73f4] Building network info cache for instance {{(pid=72382) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 15:30:29 user nova-compute[72382]: DEBUG nova.compute.manager [req-8ef21386-2404-4f1e-9a84-f1558159c079 req-e6ef6374-7fde-43c9-9043-62edcf140f96 service nova] [instance: d7c34b80-c2e9-43c1-8b8e-7c62eb8e73f4] Received event network-changed-a0b8be03-4b4b-444f-ab4d-b7a78d18f799 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:30:29 user nova-compute[72382]: DEBUG nova.compute.manager [req-8ef21386-2404-4f1e-9a84-f1558159c079 req-e6ef6374-7fde-43c9-9043-62edcf140f96 service nova] [instance: d7c34b80-c2e9-43c1-8b8e-7c62eb8e73f4] Refreshing instance network info cache due to event network-changed-a0b8be03-4b4b-444f-ab4d-b7a78d18f799. {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 15:30:29 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-8ef21386-2404-4f1e-9a84-f1558159c079 req-e6ef6374-7fde-43c9-9043-62edcf140f96 service nova] Acquiring lock "refresh_cache-d7c34b80-c2e9-43c1-8b8e-7c62eb8e73f4" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 15:30:29 user nova-compute[72382]: DEBUG nova.network.neutron [None req-45029b36-de29-45b3-8ae5-2098fe3f770a tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] [instance: d7c34b80-c2e9-43c1-8b8e-7c62eb8e73f4] Instance cache missing network info. {{(pid=72382) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 15:30:30 user nova-compute[72382]: DEBUG nova.network.neutron [None req-45029b36-de29-45b3-8ae5-2098fe3f770a tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] [instance: d7c34b80-c2e9-43c1-8b8e-7c62eb8e73f4] Updating instance_info_cache with network_info: [{"id": "a0b8be03-4b4b-444f-ab4d-b7a78d18f799", "address": "fa:16:3e:64:69:21", "network": {"id": "46eb5f03-e04d-43d1-96d6-0792bc7a94b1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1842512309-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98009994d9c74eb9b4fc6321e82440de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0b8be03-4b", "ovs_interfaceid": "a0b8be03-4b4b-444f-ab4d-b7a78d18f799", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:30:30 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-45029b36-de29-45b3-8ae5-2098fe3f770a tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Releasing lock "refresh_cache-d7c34b80-c2e9-43c1-8b8e-7c62eb8e73f4" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 15:30:30 user nova-compute[72382]: DEBUG nova.compute.manager [None req-45029b36-de29-45b3-8ae5-2098fe3f770a tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] [instance: d7c34b80-c2e9-43c1-8b8e-7c62eb8e73f4] Instance network_info: |[{"id": "a0b8be03-4b4b-444f-ab4d-b7a78d18f799", "address": "fa:16:3e:64:69:21", "network": {"id": "46eb5f03-e04d-43d1-96d6-0792bc7a94b1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1842512309-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98009994d9c74eb9b4fc6321e82440de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0b8be03-4b", "ovs_interfaceid": "a0b8be03-4b4b-444f-ab4d-b7a78d18f799", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72382) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 15:30:30 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-8ef21386-2404-4f1e-9a84-f1558159c079 req-e6ef6374-7fde-43c9-9043-62edcf140f96 service nova] Acquired lock "refresh_cache-d7c34b80-c2e9-43c1-8b8e-7c62eb8e73f4" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 15:30:30 user nova-compute[72382]: DEBUG nova.network.neutron [req-8ef21386-2404-4f1e-9a84-f1558159c079 req-e6ef6374-7fde-43c9-9043-62edcf140f96 service nova] [instance: d7c34b80-c2e9-43c1-8b8e-7c62eb8e73f4] Refreshing network info cache for port a0b8be03-4b4b-444f-ab4d-b7a78d18f799 {{(pid=72382) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 15:30:30 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-45029b36-de29-45b3-8ae5-2098fe3f770a tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] [instance: d7c34b80-c2e9-43c1-8b8e-7c62eb8e73f4] Start _get_guest_xml network_info=[{"id": "a0b8be03-4b4b-444f-ab4d-b7a78d18f799", "address": "fa:16:3e:64:69:21", "network": {"id": "46eb5f03-e04d-43d1-96d6-0792bc7a94b1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1842512309-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98009994d9c74eb9b4fc6321e82440de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0b8be03-4b", "ovs_interfaceid": "a0b8be03-4b4b-444f-ab4d-b7a78d18f799", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T15:11:25Z,direct_url=<?>,disk_format='qcow2',id=a79f2cea-eb27-4631-aaf3-05e7d9e411b4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a638990e12cc4d6eabb6d55e13be6bdf',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T15:11:27Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'a79f2cea-eb27-4631-aaf3-05e7d9e411b4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72382) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 15:30:30 user nova-compute[72382]: WARNING nova.virt.libvirt.driver [None req-45029b36-de29-45b3-8ae5-2098fe3f770a tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 15:30:30 user nova-compute[72382]: WARNING nova.virt.libvirt.driver [None req-45029b36-de29-45b3-8ae5-2098fe3f770a tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 15:30:30 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-45029b36-de29-45b3-8ae5-2098fe3f770a tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72382) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 15:30:30 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-45029b36-de29-45b3-8ae5-2098fe3f770a tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] CPU controller missing on host. {{(pid=72382) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 15:30:30 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-45029b36-de29-45b3-8ae5-2098fe3f770a tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72382) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 15:30:30 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-45029b36-de29-45b3-8ae5-2098fe3f770a tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] CPU controller found on host. {{(pid=72382) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 15:30:30 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-45029b36-de29-45b3-8ae5-2098fe3f770a tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72382) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 15:30:30 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-45029b36-de29-45b3-8ae5-2098fe3f770a tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T15:11:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T15:11:25Z,direct_url=<?>,disk_format='qcow2',id=a79f2cea-eb27-4631-aaf3-05e7d9e411b4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a638990e12cc4d6eabb6d55e13be6bdf',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T15:11:27Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 15:30:30 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-45029b36-de29-45b3-8ae5-2098fe3f770a tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Flavor limits 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 15:30:30 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-45029b36-de29-45b3-8ae5-2098fe3f770a tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Image limits 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 15:30:30 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-45029b36-de29-45b3-8ae5-2098fe3f770a tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Flavor pref 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 15:30:30 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-45029b36-de29-45b3-8ae5-2098fe3f770a tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Image pref 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 15:30:30 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-45029b36-de29-45b3-8ae5-2098fe3f770a tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 15:30:30 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-45029b36-de29-45b3-8ae5-2098fe3f770a tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 15:30:30 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-45029b36-de29-45b3-8ae5-2098fe3f770a tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72382) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 15:30:30 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-45029b36-de29-45b3-8ae5-2098fe3f770a tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Got 1 possible topologies {{(pid=72382) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 15:30:30 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-45029b36-de29-45b3-8ae5-2098fe3f770a tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 15:30:30 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-45029b36-de29-45b3-8ae5-2098fe3f770a tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 15:30:30 user nova-compute[72382]: DEBUG nova.virt.libvirt.vif [None req-45029b36-de29-45b3-8ae5-2098fe3f770a tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T15:30:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-959879230',display_name='tempest-AttachVolumeNegativeTest-server-959879230',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-959879230',id=32,image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEf3h2tk0+Xz7SAP6c+1mcJH8cXoTnRUqHOxRtY/fkTTgmsPi0nrf6AcDcfuRkR9pSlYNd7Xvp6iZsDSmBpJQCeKu5lfASm1Pr7a6hcbFw41p8S98ZJPJ9/AybwNU2yxvQ==',key_name='tempest-keypair-1963397104',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='98009994d9c74eb9b4fc6321e82440de',ramdisk_id='',reservation_id='r-1q8ndjce',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1325594356',owner_user_name='tempest-AttachVolumeNegativeTest-1325594356-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T15:30:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='401c9df41f284c88a86557485d7d9537',uuid=d7c34b80-c2e9-43c1-8b8e-7c62eb8e73f4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a0b8be03-4b4b-444f-ab4d-b7a78d18f799", "address": "fa:16:3e:64:69:21", "network": {"id": "46eb5f03-e04d-43d1-96d6-0792bc7a94b1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1842512309-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98009994d9c74eb9b4fc6321e82440de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0b8be03-4b", "ovs_interfaceid": "a0b8be03-4b4b-444f-ab4d-b7a78d18f799", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72382) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 15:30:30 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-45029b36-de29-45b3-8ae5-2098fe3f770a tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Converting VIF {"id": "a0b8be03-4b4b-444f-ab4d-b7a78d18f799", "address": "fa:16:3e:64:69:21", "network": {"id": "46eb5f03-e04d-43d1-96d6-0792bc7a94b1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1842512309-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98009994d9c74eb9b4fc6321e82440de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0b8be03-4b", "ovs_interfaceid": "a0b8be03-4b4b-444f-ab4d-b7a78d18f799", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 15:30:30 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-45029b36-de29-45b3-8ae5-2098fe3f770a tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:64:69:21,bridge_name='br-int',has_traffic_filtering=True,id=a0b8be03-4b4b-444f-ab4d-b7a78d18f799,network=Network(46eb5f03-e04d-43d1-96d6-0792bc7a94b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0b8be03-4b') {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 15:30:30 user nova-compute[72382]: DEBUG nova.objects.instance [None req-45029b36-de29-45b3-8ae5-2098fe3f770a tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Lazy-loading 'pci_devices' on Instance uuid d7c34b80-c2e9-43c1-8b8e-7c62eb8e73f4 {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:30:30 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-45029b36-de29-45b3-8ae5-2098fe3f770a tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] [instance: d7c34b80-c2e9-43c1-8b8e-7c62eb8e73f4] End _get_guest_xml xml=<domain type="kvm">
Aug 09 15:30:30 user nova-compute[72382]:   <uuid>d7c34b80-c2e9-43c1-8b8e-7c62eb8e73f4</uuid>
Aug 09 15:30:30 user nova-compute[72382]:   <name>instance-00000020</name>
Aug 09 15:30:30 user nova-compute[72382]:   <memory>524288</memory>
Aug 09 15:30:30 user nova-compute[72382]:   <vcpu>1</vcpu>
Aug 09 15:30:30 user nova-compute[72382]:   <metadata>
Aug 09 15:30:30 user nova-compute[72382]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 15:30:30 user nova-compute[72382]:       <nova:package version="0.0.0"/>
Aug 09 15:30:30 user nova-compute[72382]:       <nova:name>tempest-AttachVolumeNegativeTest-server-959879230</nova:name>
Aug 09 15:30:30 user nova-compute[72382]:       <nova:creationTime>2023-08-09 15:30:30</nova:creationTime>
Aug 09 15:30:30 user nova-compute[72382]:       <nova:flavor name="m1.tiny">
Aug 09 15:30:30 user nova-compute[72382]:         <nova:memory>512</nova:memory>
Aug 09 15:30:30 user nova-compute[72382]:         <nova:disk>1</nova:disk>
Aug 09 15:30:30 user nova-compute[72382]:         <nova:swap>0</nova:swap>
Aug 09 15:30:30 user nova-compute[72382]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 15:30:30 user nova-compute[72382]:         <nova:vcpus>1</nova:vcpus>
Aug 09 15:30:30 user nova-compute[72382]:       </nova:flavor>
Aug 09 15:30:30 user nova-compute[72382]:       <nova:owner>
Aug 09 15:30:30 user nova-compute[72382]:         <nova:user uuid="401c9df41f284c88a86557485d7d9537">tempest-AttachVolumeNegativeTest-1325594356-project-member</nova:user>
Aug 09 15:30:30 user nova-compute[72382]:         <nova:project uuid="98009994d9c74eb9b4fc6321e82440de">tempest-AttachVolumeNegativeTest-1325594356</nova:project>
Aug 09 15:30:30 user nova-compute[72382]:       </nova:owner>
Aug 09 15:30:30 user nova-compute[72382]:       <nova:root type="image" uuid="a79f2cea-eb27-4631-aaf3-05e7d9e411b4"/>
Aug 09 15:30:30 user nova-compute[72382]:       <nova:ports>
Aug 09 15:30:30 user nova-compute[72382]:         <nova:port uuid="a0b8be03-4b4b-444f-ab4d-b7a78d18f799">
Aug 09 15:30:30 user nova-compute[72382]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 09 15:30:30 user nova-compute[72382]:         </nova:port>
Aug 09 15:30:30 user nova-compute[72382]:       </nova:ports>
Aug 09 15:30:30 user nova-compute[72382]:     </nova:instance>
Aug 09 15:30:30 user nova-compute[72382]:   </metadata>
Aug 09 15:30:30 user nova-compute[72382]:   <sysinfo type="smbios">
Aug 09 15:30:30 user nova-compute[72382]:     <system>
Aug 09 15:30:30 user nova-compute[72382]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 15:30:30 user nova-compute[72382]:       <entry name="product">OpenStack Nova</entry>
Aug 09 15:30:30 user nova-compute[72382]:       <entry name="version">0.0.0</entry>
Aug 09 15:30:30 user nova-compute[72382]:       <entry name="serial">d7c34b80-c2e9-43c1-8b8e-7c62eb8e73f4</entry>
Aug 09 15:30:30 user nova-compute[72382]:       <entry name="uuid">d7c34b80-c2e9-43c1-8b8e-7c62eb8e73f4</entry>
Aug 09 15:30:30 user nova-compute[72382]:       <entry name="family">Virtual Machine</entry>
Aug 09 15:30:30 user nova-compute[72382]:     </system>
Aug 09 15:30:30 user nova-compute[72382]:   </sysinfo>
Aug 09 15:30:30 user nova-compute[72382]:   <os>
Aug 09 15:30:30 user nova-compute[72382]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 15:30:30 user nova-compute[72382]:     <boot dev="hd"/>
Aug 09 15:30:30 user nova-compute[72382]:     <smbios mode="sysinfo"/>
Aug 09 15:30:30 user nova-compute[72382]:   </os>
Aug 09 15:30:30 user nova-compute[72382]:   <features>
Aug 09 15:30:30 user nova-compute[72382]:     <acpi/>
Aug 09 15:30:30 user nova-compute[72382]:     <apic/>
Aug 09 15:30:30 user nova-compute[72382]:     <vmcoreinfo/>
Aug 09 15:30:30 user nova-compute[72382]:   </features>
Aug 09 15:30:30 user nova-compute[72382]:   <clock offset="utc">
Aug 09 15:30:30 user nova-compute[72382]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 15:30:30 user nova-compute[72382]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 15:30:30 user nova-compute[72382]:     <timer name="hpet" present="no"/>
Aug 09 15:30:30 user nova-compute[72382]:   </clock>
Aug 09 15:30:30 user nova-compute[72382]:   <cpu mode="custom" match="exact">
Aug 09 15:30:30 user nova-compute[72382]:     <model>Nehalem</model>
Aug 09 15:30:30 user nova-compute[72382]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 15:30:30 user nova-compute[72382]:   </cpu>
Aug 09 15:30:30 user nova-compute[72382]:   <devices>
Aug 09 15:30:30 user nova-compute[72382]:     <disk type="file" device="disk">
Aug 09 15:30:30 user nova-compute[72382]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 15:30:30 user nova-compute[72382]:       <source file="/opt/stack/data/nova/instances/d7c34b80-c2e9-43c1-8b8e-7c62eb8e73f4/disk"/>
Aug 09 15:30:30 user nova-compute[72382]:       <target dev="vda" bus="virtio"/>
Aug 09 15:30:30 user nova-compute[72382]:     </disk>
Aug 09 15:30:30 user nova-compute[72382]:     <interface type="ethernet">
Aug 09 15:30:30 user nova-compute[72382]:       <mac address="fa:16:3e:64:69:21"/>
Aug 09 15:30:30 user nova-compute[72382]:       <model type="virtio"/>
Aug 09 15:30:30 user nova-compute[72382]:       <mtu size="1442"/>
Aug 09 15:30:30 user nova-compute[72382]:       <target dev="tapa0b8be03-4b"/>
Aug 09 15:30:30 user nova-compute[72382]:     </interface>
Aug 09 15:30:30 user nova-compute[72382]:     <serial type="pty">
Aug 09 15:30:30 user nova-compute[72382]:       <log file="/opt/stack/data/nova/instances/d7c34b80-c2e9-43c1-8b8e-7c62eb8e73f4/console.log" append="off"/>
Aug 09 15:30:30 user nova-compute[72382]:     </serial>
Aug 09 15:30:30 user nova-compute[72382]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 15:30:30 user nova-compute[72382]:     <video>
Aug 09 15:30:30 user nova-compute[72382]:       <model type="virtio"/>
Aug 09 15:30:30 user nova-compute[72382]:     </video>
Aug 09 15:30:30 user nova-compute[72382]:     <rng model="virtio">
Aug 09 15:30:30 user nova-compute[72382]:       <backend model="random">/dev/urandom</backend>
Aug 09 15:30:30 user nova-compute[72382]:     </rng>
Aug 09 15:30:30 user nova-compute[72382]:     <controller type="usb" index="0" model="none"/>
Aug 09 15:30:30 user nova-compute[72382]:     <memballoon model="virtio">
Aug 09 15:30:30 user nova-compute[72382]:       <stats period="10"/>
Aug 09 15:30:30 user nova-compute[72382]:     </memballoon>
Aug 09 15:30:30 user nova-compute[72382]:   </devices>
Aug 09 15:30:30 user nova-compute[72382]: </domain>
Aug 09 15:30:30 user nova-compute[72382]:  {{(pid=72382) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 15:30:30 user nova-compute[72382]: DEBUG nova.virt.libvirt.vif [None req-45029b36-de29-45b3-8ae5-2098fe3f770a tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T15:30:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-959879230',display_name='tempest-AttachVolumeNegativeTest-server-959879230',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-959879230',id=32,image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEf3h2tk0+Xz7SAP6c+1mcJH8cXoTnRUqHOxRtY/fkTTgmsPi0nrf6AcDcfuRkR9pSlYNd7Xvp6iZsDSmBpJQCeKu5lfASm1Pr7a6hcbFw41p8S98ZJPJ9/AybwNU2yxvQ==',key_name='tempest-keypair-1963397104',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='98009994d9c74eb9b4fc6321e82440de',ramdisk_id='',reservation_id='r-1q8ndjce',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1325594356',owner_user_name='tempest-AttachVolumeNegativeTest-1325594356-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T15:30:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='401c9df41f284c88a86557485d7d9537',uuid=d7c34b80-c2e9-43c1-8b8e-7c62eb8e73f4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a0b8be03-4b4b-444f-ab4d-b7a78d18f799", "address": "fa:16:3e:64:69:21", "network": {"id": "46eb5f03-e04d-43d1-96d6-0792bc7a94b1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1842512309-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98009994d9c74eb9b4fc6321e82440de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0b8be03-4b", "ovs_interfaceid": "a0b8be03-4b4b-444f-ab4d-b7a78d18f799", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 15:30:30 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-45029b36-de29-45b3-8ae5-2098fe3f770a tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Converting VIF {"id": "a0b8be03-4b4b-444f-ab4d-b7a78d18f799", "address": "fa:16:3e:64:69:21", "network": {"id": "46eb5f03-e04d-43d1-96d6-0792bc7a94b1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1842512309-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98009994d9c74eb9b4fc6321e82440de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0b8be03-4b", "ovs_interfaceid": "a0b8be03-4b4b-444f-ab4d-b7a78d18f799", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 15:30:30 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-45029b36-de29-45b3-8ae5-2098fe3f770a tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:64:69:21,bridge_name='br-int',has_traffic_filtering=True,id=a0b8be03-4b4b-444f-ab4d-b7a78d18f799,network=Network(46eb5f03-e04d-43d1-96d6-0792bc7a94b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0b8be03-4b') {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 15:30:30 user nova-compute[72382]: DEBUG os_vif [None req-45029b36-de29-45b3-8ae5-2098fe3f770a tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:64:69:21,bridge_name='br-int',has_traffic_filtering=True,id=a0b8be03-4b4b-444f-ab4d-b7a78d18f799,network=Network(46eb5f03-e04d-43d1-96d6-0792bc7a94b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0b8be03-4b') {{(pid=72382) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 15:30:30 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:30:30 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:30:30 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 15:30:30 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:30:30 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa0b8be03-4b, may_exist=True, interface_attrs={}) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:30:30 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa0b8be03-4b, col_values=(('external_ids', {'iface-id': 'a0b8be03-4b4b-444f-ab4d-b7a78d18f799', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:64:69:21', 'vm-uuid': 'd7c34b80-c2e9-43c1-8b8e-7c62eb8e73f4'}),), if_exists=True) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:30:30 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:30:30 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:30:30 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:30:30 user nova-compute[72382]: INFO os_vif [None req-45029b36-de29-45b3-8ae5-2098fe3f770a tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:64:69:21,bridge_name='br-int',has_traffic_filtering=True,id=a0b8be03-4b4b-444f-ab4d-b7a78d18f799,network=Network(46eb5f03-e04d-43d1-96d6-0792bc7a94b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0b8be03-4b')
Aug 09 15:30:30 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-45029b36-de29-45b3-8ae5-2098fe3f770a tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] No BDM found with device name vda, not building metadata. {{(pid=72382) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 15:30:30 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-45029b36-de29-45b3-8ae5-2098fe3f770a tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] No VIF found with MAC fa:16:3e:64:69:21, not building metadata {{(pid=72382) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 15:30:30 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-2443e16e-0417-48b6-af28-2f1dbc002741 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.388s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 15:30:30 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-2443e16e-0417-48b6-af28-2f1dbc002741 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] <== connect_volume: return (1390ms) {'type': 'block', 'scsi_wwn': '23130386331336537', 'path': '/dev/sdb'} {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 15:30:30 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2443e16e-0417-48b6-af28-2f1dbc002741 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] [instance: 4ccbfda2-8bcd-4ec1-972a-cf49a62b1583] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23130386331336537', 'path': '/dev/sdb'} {{(pid=72382) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 15:30:30 user nova-compute[72382]: DEBUG nova.objects.instance [None req-2443e16e-0417-48b6-af28-2f1dbc002741 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Lazy-loading 'flavor' on Instance uuid 4ccbfda2-8bcd-4ec1-972a-cf49a62b1583 {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:30:30 user nova-compute[72382]: DEBUG nova.virt.libvirt.guest [None req-2443e16e-0417-48b6-af28-2f1dbc002741 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 15:30:30 user nova-compute[72382]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 15:30:30 user nova-compute[72382]:   <source dev="/dev/sdb"/>
Aug 09 15:30:30 user nova-compute[72382]:   <target dev="vdb" bus="virtio"/>
Aug 09 15:30:30 user nova-compute[72382]:   <serial>b5cfefdb-a454-494f-ab09-acf8644352a3</serial>
Aug 09 15:30:30 user nova-compute[72382]: </disk>
Aug 09 15:30:30 user nova-compute[72382]:  {{(pid=72382) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 15:30:30 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:30:30 user nova-compute[72382]: DEBUG nova.network.neutron [req-8ef21386-2404-4f1e-9a84-f1558159c079 req-e6ef6374-7fde-43c9-9043-62edcf140f96 service nova] [instance: d7c34b80-c2e9-43c1-8b8e-7c62eb8e73f4] Updated VIF entry in instance network info cache for port a0b8be03-4b4b-444f-ab4d-b7a78d18f799. {{(pid=72382) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 15:30:30 user nova-compute[72382]: DEBUG nova.network.neutron [req-8ef21386-2404-4f1e-9a84-f1558159c079 req-e6ef6374-7fde-43c9-9043-62edcf140f96 service nova] [instance: d7c34b80-c2e9-43c1-8b8e-7c62eb8e73f4] Updating instance_info_cache with network_info: [{"id": "a0b8be03-4b4b-444f-ab4d-b7a78d18f799", "address": "fa:16:3e:64:69:21", "network": {"id": "46eb5f03-e04d-43d1-96d6-0792bc7a94b1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1842512309-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98009994d9c74eb9b4fc6321e82440de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0b8be03-4b", "ovs_interfaceid": "a0b8be03-4b4b-444f-ab4d-b7a78d18f799", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:30:30 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:30:30 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-8ef21386-2404-4f1e-9a84-f1558159c079 req-e6ef6374-7fde-43c9-9043-62edcf140f96 service nova] Releasing lock "refresh_cache-d7c34b80-c2e9-43c1-8b8e-7c62eb8e73f4" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 15:30:30 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:30:30 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:30:30 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:30:30 user nova-compute[72382]: DEBUG nova.compute.manager [req-452adefd-a9aa-49db-9cab-fd9a623588b7 req-335c8673-ec6f-456e-a49d-318857ae5a83 service nova] [instance: 2f430d9a-9fbf-43cd-8c0d-e5dec162be71] Received event network-vif-plugged-d13c4d4e-9004-4d4b-999d-619564a98542 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:30:30 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-452adefd-a9aa-49db-9cab-fd9a623588b7 req-335c8673-ec6f-456e-a49d-318857ae5a83 service nova] Acquiring lock "2f430d9a-9fbf-43cd-8c0d-e5dec162be71-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:30:30 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-452adefd-a9aa-49db-9cab-fd9a623588b7 req-335c8673-ec6f-456e-a49d-318857ae5a83 service nova] Lock "2f430d9a-9fbf-43cd-8c0d-e5dec162be71-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:30:30 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-452adefd-a9aa-49db-9cab-fd9a623588b7 req-335c8673-ec6f-456e-a49d-318857ae5a83 service nova] Lock "2f430d9a-9fbf-43cd-8c0d-e5dec162be71-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:30:30 user nova-compute[72382]: DEBUG nova.compute.manager [req-452adefd-a9aa-49db-9cab-fd9a623588b7 req-335c8673-ec6f-456e-a49d-318857ae5a83 service nova] [instance: 2f430d9a-9fbf-43cd-8c0d-e5dec162be71] No waiting events found dispatching network-vif-plugged-d13c4d4e-9004-4d4b-999d-619564a98542 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:30:30 user nova-compute[72382]: WARNING nova.compute.manager [req-452adefd-a9aa-49db-9cab-fd9a623588b7 req-335c8673-ec6f-456e-a49d-318857ae5a83 service nova] [instance: 2f430d9a-9fbf-43cd-8c0d-e5dec162be71] Received unexpected event network-vif-plugged-d13c4d4e-9004-4d4b-999d-619564a98542 for instance with vm_state rescued and task_state unrescuing.
Aug 09 15:30:31 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:30:31 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:30:31 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-2443e16e-0417-48b6-af28-2f1dbc002741 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] No BDM found with device name vda, not building metadata. {{(pid=72382) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 15:30:31 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-2443e16e-0417-48b6-af28-2f1dbc002741 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72382) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 15:30:31 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-2443e16e-0417-48b6-af28-2f1dbc002741 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] No VIF found with MAC fa:16:3e:9a:d4:3a, not building metadata {{(pid=72382) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 15:30:31 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-2443e16e-0417-48b6-af28-2f1dbc002741 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Lock "4ccbfda2-8bcd-4ec1-972a-cf49a62b1583" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 17.402s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:30:32 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:30:32 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:30:32 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:30:32 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:30:32 user nova-compute[72382]: DEBUG nova.compute.manager [req-7b261a10-f8a4-436c-b2f2-67ab18582ab3 req-adf6783c-ec10-4b35-8a0f-51ebf328345f service nova] [instance: d7c34b80-c2e9-43c1-8b8e-7c62eb8e73f4] Received event network-vif-plugged-a0b8be03-4b4b-444f-ab4d-b7a78d18f799 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:30:32 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-7b261a10-f8a4-436c-b2f2-67ab18582ab3 req-adf6783c-ec10-4b35-8a0f-51ebf328345f service nova] Acquiring lock "d7c34b80-c2e9-43c1-8b8e-7c62eb8e73f4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:30:32 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-7b261a10-f8a4-436c-b2f2-67ab18582ab3 req-adf6783c-ec10-4b35-8a0f-51ebf328345f service nova] Lock "d7c34b80-c2e9-43c1-8b8e-7c62eb8e73f4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:30:32 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-7b261a10-f8a4-436c-b2f2-67ab18582ab3 req-adf6783c-ec10-4b35-8a0f-51ebf328345f service nova] Lock "d7c34b80-c2e9-43c1-8b8e-7c62eb8e73f4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:30:32 user nova-compute[72382]: DEBUG nova.compute.manager [req-7b261a10-f8a4-436c-b2f2-67ab18582ab3 req-adf6783c-ec10-4b35-8a0f-51ebf328345f service nova] [instance: d7c34b80-c2e9-43c1-8b8e-7c62eb8e73f4] No waiting events found dispatching network-vif-plugged-a0b8be03-4b4b-444f-ab4d-b7a78d18f799 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:30:32 user nova-compute[72382]: WARNING nova.compute.manager [req-7b261a10-f8a4-436c-b2f2-67ab18582ab3 req-adf6783c-ec10-4b35-8a0f-51ebf328345f service nova] [instance: d7c34b80-c2e9-43c1-8b8e-7c62eb8e73f4] Received unexpected event network-vif-plugged-a0b8be03-4b4b-444f-ab4d-b7a78d18f799 for instance with vm_state building and task_state spawning.
Aug 09 15:30:33 user nova-compute[72382]: DEBUG nova.compute.manager [req-8487ca82-416b-4240-a916-043e25d8a6d7 req-d7ae50ef-fa31-4900-babd-1072bbbf5487 service nova] [instance: 2f430d9a-9fbf-43cd-8c0d-e5dec162be71] Received event network-vif-plugged-d13c4d4e-9004-4d4b-999d-619564a98542 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:30:33 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-8487ca82-416b-4240-a916-043e25d8a6d7 req-d7ae50ef-fa31-4900-babd-1072bbbf5487 service nova] Acquiring lock "2f430d9a-9fbf-43cd-8c0d-e5dec162be71-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:30:33 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-8487ca82-416b-4240-a916-043e25d8a6d7 req-d7ae50ef-fa31-4900-babd-1072bbbf5487 service nova] Lock "2f430d9a-9fbf-43cd-8c0d-e5dec162be71-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:30:33 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-8487ca82-416b-4240-a916-043e25d8a6d7 req-d7ae50ef-fa31-4900-babd-1072bbbf5487 service nova] Lock "2f430d9a-9fbf-43cd-8c0d-e5dec162be71-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:30:33 user nova-compute[72382]: DEBUG nova.compute.manager [req-8487ca82-416b-4240-a916-043e25d8a6d7 req-d7ae50ef-fa31-4900-babd-1072bbbf5487 service nova] [instance: 2f430d9a-9fbf-43cd-8c0d-e5dec162be71] No waiting events found dispatching network-vif-plugged-d13c4d4e-9004-4d4b-999d-619564a98542 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:30:33 user nova-compute[72382]: WARNING nova.compute.manager [req-8487ca82-416b-4240-a916-043e25d8a6d7 req-d7ae50ef-fa31-4900-babd-1072bbbf5487 service nova] [instance: 2f430d9a-9fbf-43cd-8c0d-e5dec162be71] Received unexpected event network-vif-plugged-d13c4d4e-9004-4d4b-999d-619564a98542 for instance with vm_state rescued and task_state unrescuing.
Aug 09 15:30:33 user nova-compute[72382]: DEBUG nova.compute.manager [req-8487ca82-416b-4240-a916-043e25d8a6d7 req-d7ae50ef-fa31-4900-babd-1072bbbf5487 service nova] [instance: 2f430d9a-9fbf-43cd-8c0d-e5dec162be71] Received event network-vif-plugged-d13c4d4e-9004-4d4b-999d-619564a98542 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:30:33 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-8487ca82-416b-4240-a916-043e25d8a6d7 req-d7ae50ef-fa31-4900-babd-1072bbbf5487 service nova] Acquiring lock "2f430d9a-9fbf-43cd-8c0d-e5dec162be71-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:30:33 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-8487ca82-416b-4240-a916-043e25d8a6d7 req-d7ae50ef-fa31-4900-babd-1072bbbf5487 service nova] Lock "2f430d9a-9fbf-43cd-8c0d-e5dec162be71-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:30:33 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-8487ca82-416b-4240-a916-043e25d8a6d7 req-d7ae50ef-fa31-4900-babd-1072bbbf5487 service nova] Lock "2f430d9a-9fbf-43cd-8c0d-e5dec162be71-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:30:33 user nova-compute[72382]: DEBUG nova.compute.manager [req-8487ca82-416b-4240-a916-043e25d8a6d7 req-d7ae50ef-fa31-4900-babd-1072bbbf5487 service nova] [instance: 2f430d9a-9fbf-43cd-8c0d-e5dec162be71] No waiting events found dispatching network-vif-plugged-d13c4d4e-9004-4d4b-999d-619564a98542 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:30:33 user nova-compute[72382]: WARNING nova.compute.manager [req-8487ca82-416b-4240-a916-043e25d8a6d7 req-d7ae50ef-fa31-4900-babd-1072bbbf5487 service nova] [instance: 2f430d9a-9fbf-43cd-8c0d-e5dec162be71] Received unexpected event network-vif-plugged-d13c4d4e-9004-4d4b-999d-619564a98542 for instance with vm_state rescued and task_state unrescuing.
Aug 09 15:30:33 user nova-compute[72382]: INFO nova.compute.manager [None req-286a634f-19ad-4afb-b53d-04ce872d75dc tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] [instance: 4ccbfda2-8bcd-4ec1-972a-cf49a62b1583] Rebuilding instance
Aug 09 15:30:33 user nova-compute[72382]: DEBUG nova.objects.instance [None req-286a634f-19ad-4afb-b53d-04ce872d75dc tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Lazy-loading 'trusted_certs' on Instance uuid 4ccbfda2-8bcd-4ec1-972a-cf49a62b1583 {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:30:33 user nova-compute[72382]: DEBUG nova.compute.manager [None req-286a634f-19ad-4afb-b53d-04ce872d75dc tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] [instance: 4ccbfda2-8bcd-4ec1-972a-cf49a62b1583] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:30:33 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:30:33 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:30:33 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:30:33 user nova-compute[72382]: DEBUG nova.objects.instance [None req-286a634f-19ad-4afb-b53d-04ce872d75dc tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Lazy-loading 'pci_requests' on Instance uuid 4ccbfda2-8bcd-4ec1-972a-cf49a62b1583 {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:30:33 user nova-compute[72382]: DEBUG nova.objects.instance [None req-286a634f-19ad-4afb-b53d-04ce872d75dc tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Lazy-loading 'pci_devices' on Instance uuid 4ccbfda2-8bcd-4ec1-972a-cf49a62b1583 {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:30:33 user nova-compute[72382]: DEBUG nova.objects.instance [None req-286a634f-19ad-4afb-b53d-04ce872d75dc tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Lazy-loading 'resources' on Instance uuid 4ccbfda2-8bcd-4ec1-972a-cf49a62b1583 {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:30:33 user nova-compute[72382]: DEBUG nova.objects.instance [None req-286a634f-19ad-4afb-b53d-04ce872d75dc tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Lazy-loading 'migration_context' on Instance uuid 4ccbfda2-8bcd-4ec1-972a-cf49a62b1583 {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:30:33 user nova-compute[72382]: DEBUG nova.objects.instance [None req-286a634f-19ad-4afb-b53d-04ce872d75dc tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] [instance: 4ccbfda2-8bcd-4ec1-972a-cf49a62b1583] Trying to apply a migration context that does not seem to be set for this instance {{(pid=72382) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Aug 09 15:30:33 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:30:33 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:30:33 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:30:33 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:30:33 user nova-compute[72382]: DEBUG nova.compute.manager [req-1b163635-bad5-47cf-b4d1-165780a163d8 req-1cfc80cb-5d67-4bcc-84de-aadbe716e93d service nova] [instance: 4ccbfda2-8bcd-4ec1-972a-cf49a62b1583] Received event network-vif-unplugged-2d07e6a3-03b7-4035-bdd2-a95435b99852 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:30:33 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-1b163635-bad5-47cf-b4d1-165780a163d8 req-1cfc80cb-5d67-4bcc-84de-aadbe716e93d service nova] Acquiring lock "4ccbfda2-8bcd-4ec1-972a-cf49a62b1583-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:30:33 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-1b163635-bad5-47cf-b4d1-165780a163d8 req-1cfc80cb-5d67-4bcc-84de-aadbe716e93d service nova] Lock "4ccbfda2-8bcd-4ec1-972a-cf49a62b1583-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:30:33 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-1b163635-bad5-47cf-b4d1-165780a163d8 req-1cfc80cb-5d67-4bcc-84de-aadbe716e93d service nova] Lock "4ccbfda2-8bcd-4ec1-972a-cf49a62b1583-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:30:33 user nova-compute[72382]: DEBUG nova.compute.manager [req-1b163635-bad5-47cf-b4d1-165780a163d8 req-1cfc80cb-5d67-4bcc-84de-aadbe716e93d service nova] [instance: 4ccbfda2-8bcd-4ec1-972a-cf49a62b1583] No waiting events found dispatching network-vif-unplugged-2d07e6a3-03b7-4035-bdd2-a95435b99852 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:30:33 user nova-compute[72382]: WARNING nova.compute.manager [req-1b163635-bad5-47cf-b4d1-165780a163d8 req-1cfc80cb-5d67-4bcc-84de-aadbe716e93d service nova] [instance: 4ccbfda2-8bcd-4ec1-972a-cf49a62b1583] Received unexpected event network-vif-unplugged-2d07e6a3-03b7-4035-bdd2-a95435b99852 for instance with vm_state active and task_state rebuilding.
Aug 09 15:30:34 user nova-compute[72382]: INFO nova.virt.libvirt.driver [-] [instance: 4ccbfda2-8bcd-4ec1-972a-cf49a62b1583] Instance destroyed successfully.
Aug 09 15:30:34 user nova-compute[72382]: INFO nova.compute.manager [None req-286a634f-19ad-4afb-b53d-04ce872d75dc tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] [instance: 4ccbfda2-8bcd-4ec1-972a-cf49a62b1583] Detaching volume b5cfefdb-a454-494f-ab09-acf8644352a3
Aug 09 15:30:34 user nova-compute[72382]: INFO nova.virt.block_device [None req-286a634f-19ad-4afb-b53d-04ce872d75dc tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] [instance: 4ccbfda2-8bcd-4ec1-972a-cf49a62b1583] Attempting to driver detach volume b5cfefdb-a454-494f-ab09-acf8644352a3 from mountpoint /dev/vdb
Aug 09 15:30:34 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-286a634f-19ad-4afb-b53d-04ce872d75dc tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Attempting to detach device vdb from instance 4ccbfda2-8bcd-4ec1-972a-cf49a62b1583 from the persistent domain config. {{(pid=72382) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 15:30:34 user nova-compute[72382]: DEBUG nova.virt.libvirt.guest [None req-286a634f-19ad-4afb-b53d-04ce872d75dc tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 15:30:34 user nova-compute[72382]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 15:30:34 user nova-compute[72382]:   <source dev="/dev/sdb"/>
Aug 09 15:30:34 user nova-compute[72382]:   <target dev="vdb" bus="virtio"/>
Aug 09 15:30:34 user nova-compute[72382]:   <serial>b5cfefdb-a454-494f-ab09-acf8644352a3</serial>
Aug 09 15:30:34 user nova-compute[72382]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 15:30:34 user nova-compute[72382]: </disk>
Aug 09 15:30:34 user nova-compute[72382]:  {{(pid=72382) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 15:30:34 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:30:34 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-286a634f-19ad-4afb-b53d-04ce872d75dc tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Successfully detached device vdb from instance 4ccbfda2-8bcd-4ec1-972a-cf49a62b1583 from the persistent domain config.
Aug 09 15:30:34 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-286a634f-19ad-4afb-b53d-04ce872d75dc tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] [instance: 4ccbfda2-8bcd-4ec1-972a-cf49a62b1583] calling os-brick to detach iSCSI Volume {{(pid=72382) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 15:30:34 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-286a634f-19ad-4afb-b53d-04ce872d75dc tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2a0c768340>, {'target_iqns': ['iqn.2010-10.org.openstack:b5cfefdb-a454-494f-ab09-acf8644352a3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VjpQFgdP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 15:30:34 user nova-compute[72382]: WARNING os_brick.initiator.connectors.base [None req-286a634f-19ad-4afb-b53d-04ce872d75dc tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 09 15:30:34 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-286a634f-19ad-4afb-b53d-04ce872d75dc tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 15:30:34 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-286a634f-19ad-4afb-b53d-04ce872d75dc tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 15:30:34 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-286a634f-19ad-4afb-b53d-04ce872d75dc tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b5cfefdb-a454-494f-ab09-acf8644352a3', 0)] {{(pid=72382) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 15:30:34 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:30:34 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:30:34 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd1722b2-3dfc-4ab7-a7eb-84734aa3e3cb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:25503c6e-bfc0-4008-846a-8cad783fc0fb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b5cfefdb-a454-494f-ab09-acf8644352a3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e62d4416-be8c-4327-9a51-0cc509109c53\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:30:34 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:30:34 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:30:34 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[439b07af-1751-4f77-87e6-7589a836339a]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25503c6e-bfc0-4008-846a-8cad783fc0fb (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e62d4416-be8c-4327-9a51-0cc509109c53 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5cfefdb-a454-494f-ab09-acf8644352a3 (non-flash)\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:30:34 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-286a634f-19ad-4afb-b53d-04ce872d75dc tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)
Aug 09 15:30:34 user nova-compute[72382]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25503c6e-bfc0-4008-846a-8cad783fc0fb (non-flash)
Aug 09 15:30:34 user nova-compute[72382]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e62d4416-be8c-4327-9a51-0cc509109c53 (non-flash)
Aug 09 15:30:34 user nova-compute[72382]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5cfefdb-a454-494f-ab09-acf8644352a3 (non-flash)
Aug 09 15:30:34 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 15:30:34 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-286a634f-19ad-4afb-b53d-04ce872d75dc tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)
Aug 09 15:30:34 user nova-compute[72382]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25503c6e-bfc0-4008-846a-8cad783fc0fb (non-flash)
Aug 09 15:30:34 user nova-compute[72382]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e62d4416-be8c-4327-9a51-0cc509109c53 (non-flash)
Aug 09 15:30:34 user nova-compute[72382]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5cfefdb-a454-494f-ab09-acf8644352a3 (non-flash)
Aug 09 15:30:34 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 15:30:34 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-286a634f-19ad-4afb-b53d-04ce872d75dc tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2a0c3d68c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b5cfefdb-a454-494f-ab09-acf8644352a3'): ({'sdb'}, set())}) {{(pid=72382) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 15:30:34 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-286a634f-19ad-4afb-b53d-04ce872d75dc tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Removing single pathed devices sdb {{(pid=72382) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 15:30:34 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:30:34 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:30:34 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[968f5aa3-8a3f-48a0-9141-de6f7bd5a2d5]: (4, ('path checker states:\nup                  3\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:30:34 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:30:34 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:30:34 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[49a65505-1cb8-412d-a1bd-1cbed020f650]: (4, ('ok\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:30:34 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-286a634f-19ad-4afb-b53d-04ce872d75dc tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Flushing IO for device /dev/sdb {{(pid=72382) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 15:30:34 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:30:34 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:30:34 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[395bac6d-1f36-48a3-927f-76b3cd4e09bf]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:30:34 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-286a634f-19ad-4afb-b53d-04ce872d75dc tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72382) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 15:30:34 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:30:34 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.034s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:30:34 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[210e2953-dde2-471f-9168-efe6b25086b9]: (4, ('1', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:30:34 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-286a634f-19ad-4afb-b53d-04ce872d75dc tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72382) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 15:30:34 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-286a634f-19ad-4afb-b53d-04ce872d75dc tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] SCSI volumes sdb have been removed. {{(pid=72382) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 15:30:34 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-286a634f-19ad-4afb-b53d-04ce872d75dc tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b5cfefdb-a454-494f-ab09-acf8644352a3')] {{(pid=72382) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 15:30:34 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5cfefdb-a454-494f-ab09-acf8644352a3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:30:34 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5cfefdb-a454-494f-ab09-acf8644352a3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:30:34 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[163e8284-7f64-483f-bdfe-f1ab9671edb7]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:30:34 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-286a634f-19ad-4afb-b53d-04ce872d75dc tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:30:34 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5cfefdb-a454-494f-ab09-acf8644352a3 -p 172.16.0.220:3260 --logout {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:30:34 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5cfefdb-a454-494f-ab09-acf8644352a3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:30:34 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fa5b1dd-9cb7-4119-b223-c6a670844f4d]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:b5cfefdb-a454-494f-ab09-acf8644352a3, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:b5cfefdb-a454-494f-ab09-acf8644352a3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:30:34 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-286a634f-19ad-4afb-b53d-04ce872d75dc tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:b5cfefdb-a454-494f-ab09-acf8644352a3, portal: 172.16.0.220,3260]
Aug 09 15:30:34 user nova-compute[72382]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:b5cfefdb-a454-494f-ab09-acf8644352a3, portal: 172.16.0.220,3260] successful.
Aug 09 15:30:34 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:30:34 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5cfefdb-a454-494f-ab09-acf8644352a3 -p 172.16.0.220:3260 --op delete {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:30:34 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Removed pending event for 2f430d9a-9fbf-43cd-8c0d-e5dec162be71 due to event {{(pid=72382) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 09 15:30:34 user nova-compute[72382]: DEBUG nova.virt.driver [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Emitting event <LifecycleEvent: 1691595034.8265045, 2f430d9a-9fbf-43cd-8c0d-e5dec162be71 => Resumed> {{(pid=72382) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 15:30:34 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 2f430d9a-9fbf-43cd-8c0d-e5dec162be71] VM Resumed (Lifecycle Event)
Aug 09 15:30:34 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5cfefdb-a454-494f-ab09-acf8644352a3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:30:34 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bef0415-cb32-4114-87b2-8925e7636284]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:30:34 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-286a634f-19ad-4afb-b53d-04ce872d75dc tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:30:34 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-286a634f-19ad-4afb-b53d-04ce872d75dc tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.293s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 15:30:34 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-286a634f-19ad-4afb-b53d-04ce872d75dc tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] <== disconnect_volume: return (294ms) None {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 15:30:34 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-286a634f-19ad-4afb-b53d-04ce872d75dc tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] [instance: 4ccbfda2-8bcd-4ec1-972a-cf49a62b1583] Disconnected iSCSI Volume {{(pid=72382) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 15:30:34 user nova-compute[72382]: DEBUG nova.compute.manager [None req-a315155e-ef4a-4ff4-ade2-167c2e07a7fc tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] [instance: 2f430d9a-9fbf-43cd-8c0d-e5dec162be71] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:30:34 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 2f430d9a-9fbf-43cd-8c0d-e5dec162be71] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:30:34 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 2f430d9a-9fbf-43cd-8c0d-e5dec162be71] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72382) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 15:30:34 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 2f430d9a-9fbf-43cd-8c0d-e5dec162be71] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 09 15:30:34 user nova-compute[72382]: DEBUG nova.virt.driver [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Emitting event <LifecycleEvent: 1691595034.8382015, 2f430d9a-9fbf-43cd-8c0d-e5dec162be71 => Started> {{(pid=72382) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 15:30:34 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 2f430d9a-9fbf-43cd-8c0d-e5dec162be71] VM Started (Lifecycle Event)
Aug 09 15:30:34 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 2f430d9a-9fbf-43cd-8c0d-e5dec162be71] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:30:34 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 2f430d9a-9fbf-43cd-8c0d-e5dec162be71] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72382) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 15:30:34 user nova-compute[72382]: DEBUG nova.compute.manager [req-424ecbb5-c699-422b-ae57-f03104986c42 req-84a51ce2-6fb9-474e-b58b-9e895c6f0bad service nova] [instance: d7c34b80-c2e9-43c1-8b8e-7c62eb8e73f4] Received event network-vif-plugged-a0b8be03-4b4b-444f-ab4d-b7a78d18f799 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:30:34 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-424ecbb5-c699-422b-ae57-f03104986c42 req-84a51ce2-6fb9-474e-b58b-9e895c6f0bad service nova] Acquiring lock "d7c34b80-c2e9-43c1-8b8e-7c62eb8e73f4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:30:34 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-424ecbb5-c699-422b-ae57-f03104986c42 req-84a51ce2-6fb9-474e-b58b-9e895c6f0bad service nova] Lock "d7c34b80-c2e9-43c1-8b8e-7c62eb8e73f4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:30:34 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-424ecbb5-c699-422b-ae57-f03104986c42 req-84a51ce2-6fb9-474e-b58b-9e895c6f0bad service nova] Lock "d7c34b80-c2e9-43c1-8b8e-7c62eb8e73f4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:30:34 user nova-compute[72382]: DEBUG nova.compute.manager [req-424ecbb5-c699-422b-ae57-f03104986c42 req-84a51ce2-6fb9-474e-b58b-9e895c6f0bad service nova] [instance: d7c34b80-c2e9-43c1-8b8e-7c62eb8e73f4] No waiting events found dispatching network-vif-plugged-a0b8be03-4b4b-444f-ab4d-b7a78d18f799 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:30:34 user nova-compute[72382]: WARNING nova.compute.manager [req-424ecbb5-c699-422b-ae57-f03104986c42 req-84a51ce2-6fb9-474e-b58b-9e895c6f0bad service nova] [instance: d7c34b80-c2e9-43c1-8b8e-7c62eb8e73f4] Received unexpected event network-vif-plugged-a0b8be03-4b4b-444f-ab4d-b7a78d18f799 for instance with vm_state building and task_state spawning.
Aug 09 15:30:35 user nova-compute[72382]: DEBUG nova.virt.driver [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Emitting event <LifecycleEvent: 1691595035.1223094, d7c34b80-c2e9-43c1-8b8e-7c62eb8e73f4 => Resumed> {{(pid=72382) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 15:30:35 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: d7c34b80-c2e9-43c1-8b8e-7c62eb8e73f4] VM Resumed (Lifecycle Event)
Aug 09 15:30:35 user nova-compute[72382]: DEBUG nova.compute.manager [None req-45029b36-de29-45b3-8ae5-2098fe3f770a tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] [instance: d7c34b80-c2e9-43c1-8b8e-7c62eb8e73f4] Instance event wait completed in 0 seconds for  {{(pid=72382) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 15:30:35 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-45029b36-de29-45b3-8ae5-2098fe3f770a tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] [instance: d7c34b80-c2e9-43c1-8b8e-7c62eb8e73f4] Guest created on hypervisor {{(pid=72382) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 15:30:35 user nova-compute[72382]: INFO nova.virt.libvirt.driver [-] [instance: d7c34b80-c2e9-43c1-8b8e-7c62eb8e73f4] Instance spawned successfully.
Aug 09 15:30:35 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-45029b36-de29-45b3-8ae5-2098fe3f770a tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] [instance: d7c34b80-c2e9-43c1-8b8e-7c62eb8e73f4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 15:30:35 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: d7c34b80-c2e9-43c1-8b8e-7c62eb8e73f4] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:30:35 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-45029b36-de29-45b3-8ae5-2098fe3f770a tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] [instance: d7c34b80-c2e9-43c1-8b8e-7c62eb8e73f4] Found default for hw_cdrom_bus of ide {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:30:35 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-45029b36-de29-45b3-8ae5-2098fe3f770a tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] [instance: d7c34b80-c2e9-43c1-8b8e-7c62eb8e73f4] Found default for hw_disk_bus of virtio {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:30:35 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-45029b36-de29-45b3-8ae5-2098fe3f770a tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] [instance: d7c34b80-c2e9-43c1-8b8e-7c62eb8e73f4] Found default for hw_input_bus of None {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:30:35 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-45029b36-de29-45b3-8ae5-2098fe3f770a tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] [instance: d7c34b80-c2e9-43c1-8b8e-7c62eb8e73f4] Found default for hw_pointer_model of None {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:30:35 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-45029b36-de29-45b3-8ae5-2098fe3f770a tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] [instance: d7c34b80-c2e9-43c1-8b8e-7c62eb8e73f4] Found default for hw_video_model of virtio {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:30:35 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-45029b36-de29-45b3-8ae5-2098fe3f770a tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] [instance: d7c34b80-c2e9-43c1-8b8e-7c62eb8e73f4] Found default for hw_vif_model of virtio {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:30:35 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: d7c34b80-c2e9-43c1-8b8e-7c62eb8e73f4] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72382) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 15:30:35 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: d7c34b80-c2e9-43c1-8b8e-7c62eb8e73f4] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 15:30:35 user nova-compute[72382]: DEBUG nova.virt.driver [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Emitting event <LifecycleEvent: 1691595035.1265414, d7c34b80-c2e9-43c1-8b8e-7c62eb8e73f4 => Started> {{(pid=72382) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 15:30:35 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: d7c34b80-c2e9-43c1-8b8e-7c62eb8e73f4] VM Started (Lifecycle Event)
Aug 09 15:30:35 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: d7c34b80-c2e9-43c1-8b8e-7c62eb8e73f4] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:30:35 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: d7c34b80-c2e9-43c1-8b8e-7c62eb8e73f4] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72382) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 15:30:35 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: d7c34b80-c2e9-43c1-8b8e-7c62eb8e73f4] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 15:30:35 user nova-compute[72382]: INFO nova.compute.manager [None req-45029b36-de29-45b3-8ae5-2098fe3f770a tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] [instance: d7c34b80-c2e9-43c1-8b8e-7c62eb8e73f4] Took 7.46 seconds to spawn the instance on the hypervisor.
Aug 09 15:30:35 user nova-compute[72382]: DEBUG nova.compute.manager [None req-45029b36-de29-45b3-8ae5-2098fe3f770a tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] [instance: d7c34b80-c2e9-43c1-8b8e-7c62eb8e73f4] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:30:35 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:30:35 user nova-compute[72382]: INFO nova.compute.manager [None req-45029b36-de29-45b3-8ae5-2098fe3f770a tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] [instance: d7c34b80-c2e9-43c1-8b8e-7c62eb8e73f4] Took 8.25 seconds to build instance.
Aug 09 15:30:35 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-45029b36-de29-45b3-8ae5-2098fe3f770a tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Lock "d7c34b80-c2e9-43c1-8b8e-7c62eb8e73f4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.366s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:30:35 user nova-compute[72382]: INFO nova.virt.libvirt.driver [-] [instance: 4ccbfda2-8bcd-4ec1-972a-cf49a62b1583] Instance destroyed successfully.
Aug 09 15:30:35 user nova-compute[72382]: DEBUG nova.virt.libvirt.vif [None req-286a634f-19ad-4afb-b53d-04ce872d75dc tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T15:26:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-726596602',display_name='tempest-ServerActionsTestOtherA-server-662551681',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-726596602',id=27,image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCmuVV1ynikE+pH75fjLIal2KFmSgV7eQmOTfU0+P2w2YCXfBWnAu9n1cQQTYYTDt/aP+JsGjkRdlSPqvnnG5WbnlJT+9aj9SfyqprOo87kqF8CD2U4mVDTvv+6ADzXJvQ==',key_name='tempest-keypair-568328368',keypairs=<?>,launch_index=0,launched_at=2023-08-09T15:26:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='eb5bf3f95d2843af94dbcab2af932bd1',ramdisk_id='',reservation_id='r-169g26o6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1899577274',owner_user_name='tempest-ServerActionsTestOtherA-1899577274-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T15:30:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2cca9aef887b4b91a46ff4bd5cd32302',uuid=4ccbfda2-8bcd-4ec1-972a-cf49a62b1583,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2d07e6a3-03b7-4035-bdd2-a95435b99852", "address": "fa:16:3e:9a:d4:3a", "network": {"id": "308641dc-cc18-41db-9baa-7cc880e594ad", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1932973397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb5bf3f95d2843af94dbcab2af932bd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d07e6a3-03", "ovs_interfaceid": "2d07e6a3-03b7-4035-bdd2-a95435b99852", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 15:30:35 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-286a634f-19ad-4afb-b53d-04ce872d75dc tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Converting VIF {"id": "2d07e6a3-03b7-4035-bdd2-a95435b99852", "address": "fa:16:3e:9a:d4:3a", "network": {"id": "308641dc-cc18-41db-9baa-7cc880e594ad", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1932973397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb5bf3f95d2843af94dbcab2af932bd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d07e6a3-03", "ovs_interfaceid": "2d07e6a3-03b7-4035-bdd2-a95435b99852", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 15:30:35 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-286a634f-19ad-4afb-b53d-04ce872d75dc tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9a:d4:3a,bridge_name='br-int',has_traffic_filtering=True,id=2d07e6a3-03b7-4035-bdd2-a95435b99852,network=Network(308641dc-cc18-41db-9baa-7cc880e594ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d07e6a3-03') {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 15:30:35 user nova-compute[72382]: DEBUG os_vif [None req-286a634f-19ad-4afb-b53d-04ce872d75dc tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9a:d4:3a,bridge_name='br-int',has_traffic_filtering=True,id=2d07e6a3-03b7-4035-bdd2-a95435b99852,network=Network(308641dc-cc18-41db-9baa-7cc880e594ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d07e6a3-03') {{(pid=72382) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 15:30:35 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:30:35 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2d07e6a3-03, bridge=br-int, if_exists=True) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:30:35 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:30:35 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:30:35 user nova-compute[72382]: INFO os_vif [None req-286a634f-19ad-4afb-b53d-04ce872d75dc tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9a:d4:3a,bridge_name='br-int',has_traffic_filtering=True,id=2d07e6a3-03b7-4035-bdd2-a95435b99852,network=Network(308641dc-cc18-41db-9baa-7cc880e594ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d07e6a3-03')
Aug 09 15:30:35 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-286a634f-19ad-4afb-b53d-04ce872d75dc tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] [instance: 4ccbfda2-8bcd-4ec1-972a-cf49a62b1583] calling os-brick to detach iSCSI Volume {{(pid=72382) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 15:30:35 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-286a634f-19ad-4afb-b53d-04ce872d75dc tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2a0c768340>, {'target_iqns': ['iqn.2010-10.org.openstack:b5cfefdb-a454-494f-ab09-acf8644352a3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VjpQFgdP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 15:30:35 user nova-compute[72382]: WARNING os_brick.initiator.connectors.base [None req-286a634f-19ad-4afb-b53d-04ce872d75dc tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 09 15:30:35 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-286a634f-19ad-4afb-b53d-04ce872d75dc tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 15:30:35 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-286a634f-19ad-4afb-b53d-04ce872d75dc tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 15:30:35 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-286a634f-19ad-4afb-b53d-04ce872d75dc tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b5cfefdb-a454-494f-ab09-acf8644352a3', 0)] {{(pid=72382) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 15:30:35 user nova-compute[72382]: DEBUG nova.compute.manager [req-f1250e24-ccdd-4911-9c74-97f1092996e5 req-13a73dcf-6816-4670-89d1-0633700490fd service nova] [instance: 4ccbfda2-8bcd-4ec1-972a-cf49a62b1583] Received event network-vif-plugged-2d07e6a3-03b7-4035-bdd2-a95435b99852 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:30:35 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-f1250e24-ccdd-4911-9c74-97f1092996e5 req-13a73dcf-6816-4670-89d1-0633700490fd service nova] Acquiring lock "4ccbfda2-8bcd-4ec1-972a-cf49a62b1583-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:30:35 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-f1250e24-ccdd-4911-9c74-97f1092996e5 req-13a73dcf-6816-4670-89d1-0633700490fd service nova] Lock "4ccbfda2-8bcd-4ec1-972a-cf49a62b1583-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:30:35 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-f1250e24-ccdd-4911-9c74-97f1092996e5 req-13a73dcf-6816-4670-89d1-0633700490fd service nova] Lock "4ccbfda2-8bcd-4ec1-972a-cf49a62b1583-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:30:35 user nova-compute[72382]: DEBUG nova.compute.manager [req-f1250e24-ccdd-4911-9c74-97f1092996e5 req-13a73dcf-6816-4670-89d1-0633700490fd service nova] [instance: 4ccbfda2-8bcd-4ec1-972a-cf49a62b1583] No waiting events found dispatching network-vif-plugged-2d07e6a3-03b7-4035-bdd2-a95435b99852 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:30:35 user nova-compute[72382]: WARNING nova.compute.manager [req-f1250e24-ccdd-4911-9c74-97f1092996e5 req-13a73dcf-6816-4670-89d1-0633700490fd service nova] [instance: 4ccbfda2-8bcd-4ec1-972a-cf49a62b1583] Received unexpected event network-vif-plugged-2d07e6a3-03b7-4035-bdd2-a95435b99852 for instance with vm_state active and task_state rebuilding.
Aug 09 15:30:35 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:30:35 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:30:35 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a5af984-08e0-49e0-90d4-454352c3c645]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:25503c6e-bfc0-4008-846a-8cad783fc0fb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e62d4416-be8c-4327-9a51-0cc509109c53\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:30:35 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:30:35 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:30:35 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[6241051c-31ac-4558-9a80-a462e7abdde5]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25503c6e-bfc0-4008-846a-8cad783fc0fb (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e62d4416-be8c-4327-9a51-0cc509109c53 (non-flash)\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:30:35 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-286a634f-19ad-4afb-b53d-04ce872d75dc tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)
Aug 09 15:30:35 user nova-compute[72382]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25503c6e-bfc0-4008-846a-8cad783fc0fb (non-flash)
Aug 09 15:30:35 user nova-compute[72382]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e62d4416-be8c-4327-9a51-0cc509109c53 (non-flash)
Aug 09 15:30:35 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 15:30:35 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-286a634f-19ad-4afb-b53d-04ce872d75dc tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)
Aug 09 15:30:35 user nova-compute[72382]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25503c6e-bfc0-4008-846a-8cad783fc0fb (non-flash)
Aug 09 15:30:35 user nova-compute[72382]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e62d4416-be8c-4327-9a51-0cc509109c53 (non-flash)
Aug 09 15:30:35 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 15:30:35 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-286a634f-19ad-4afb-b53d-04ce872d75dc tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2a24146050>, {}) {{(pid=72382) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 15:30:35 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-286a634f-19ad-4afb-b53d-04ce872d75dc tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Disconnecting from: [] {{(pid=72382) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 15:30:35 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-286a634f-19ad-4afb-b53d-04ce872d75dc tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.068s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 15:30:35 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-286a634f-19ad-4afb-b53d-04ce872d75dc tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] <== disconnect_volume: return (70ms) None {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 15:30:35 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-286a634f-19ad-4afb-b53d-04ce872d75dc tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] [instance: 4ccbfda2-8bcd-4ec1-972a-cf49a62b1583] Disconnected iSCSI Volume {{(pid=72382) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 15:30:35 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-286a634f-19ad-4afb-b53d-04ce872d75dc tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] [instance: 4ccbfda2-8bcd-4ec1-972a-cf49a62b1583] Deleting instance files /opt/stack/data/nova/instances/4ccbfda2-8bcd-4ec1-972a-cf49a62b1583_del
Aug 09 15:30:35 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-286a634f-19ad-4afb-b53d-04ce872d75dc tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] [instance: 4ccbfda2-8bcd-4ec1-972a-cf49a62b1583] Deletion of /opt/stack/data/nova/instances/4ccbfda2-8bcd-4ec1-972a-cf49a62b1583_del complete
Aug 09 15:30:36 user nova-compute[72382]: INFO nova.virt.block_device [None req-286a634f-19ad-4afb-b53d-04ce872d75dc tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] [instance: 4ccbfda2-8bcd-4ec1-972a-cf49a62b1583] Booting with volume b5cfefdb-a454-494f-ab09-acf8644352a3 at /dev/vdb
Aug 09 15:30:36 user nova-compute[72382]: DEBUG os_brick.utils [None req-286a634f-19ad-4afb-b53d-04ce872d75dc tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 15:30:36 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:30:36 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:30:36 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[303a430f-cf89-44c6-85f8-287aa0cfbd73]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d2cfa7015fe\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:30:36 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:30:36 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.022s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:30:36 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[c09d0410-90b8-4638-9580-f21c7569c4c2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:30:36 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:30:36 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:30:36 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c002314-f344-4db5-885d-8ce0c7ed3f5c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:30:36 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[17809235-91fc-433b-bb23-d0c2858bc14c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:30:36 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-286a634f-19ad-4afb-b53d-04ce872d75dc tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Running cmd (subprocess): nvme version {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:30:36 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-286a634f-19ad-4afb-b53d-04ce872d75dc tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] 'nvme version' failed. Not Retrying. {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 15:30:36 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.nvmeof [None req-286a634f-19ad-4afb-b53d-04ce872d75dc tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] nvme not present on system {{(pid=72382) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 15:30:36 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:30:36 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 15:30:36 user nova-compute[72382]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 15:30:36 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f43a7ed-997b-4ce9-b3c8-ed3ea9a82a1e]: (4, '') {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:30:36 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.lightos [None req-286a634f-19ad-4afb-b53d-04ce872d75dc tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72382) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 15:30:36 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.lightos [None req-286a634f-19ad-4afb-b53d-04ce872d75dc tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72382) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 15:30:36 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.lightos [None req-286a634f-19ad-4afb-b53d-04ce872d75dc tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] LIGHTOS: no hostnqn found. {{(pid=72382) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 15:30:36 user nova-compute[72382]: DEBUG os_brick.utils [None req-286a634f-19ad-4afb-b53d-04ce872d75dc tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] <== get_connector_properties: return (166ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d2cfa7015fe', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 15:30:36 user nova-compute[72382]: DEBUG nova.virt.block_device [None req-286a634f-19ad-4afb-b53d-04ce872d75dc tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] [instance: 4ccbfda2-8bcd-4ec1-972a-cf49a62b1583] Updating existing volume attachment record: 30d40d18-c3e2-4193-a99a-d7b8c712759d {{(pid=72382) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 15:30:40 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:30:41 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-5ef21b39-d5f3-46e0-a4ab-2144e0cb12a6 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Acquiring lock "e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:30:41 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-5ef21b39-d5f3-46e0-a4ab-2144e0cb12a6 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Lock "e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:30:41 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-5ef21b39-d5f3-46e0-a4ab-2144e0cb12a6 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Acquiring lock "e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:30:41 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-5ef21b39-d5f3-46e0-a4ab-2144e0cb12a6 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Lock "e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:30:41 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-5ef21b39-d5f3-46e0-a4ab-2144e0cb12a6 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Lock "e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:30:41 user nova-compute[72382]: INFO nova.compute.manager [None req-5ef21b39-d5f3-46e0-a4ab-2144e0cb12a6 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] [instance: e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0] Terminating instance
Aug 09 15:30:41 user nova-compute[72382]: DEBUG nova.compute.manager [None req-5ef21b39-d5f3-46e0-a4ab-2144e0cb12a6 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] [instance: e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0] Start destroying the instance on the hypervisor. {{(pid=72382) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 15:30:41 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:30:41 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:30:41 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:30:41 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:30:41 user nova-compute[72382]: DEBUG nova.compute.manager [req-e4812912-2ed9-4511-8f06-eaa36fcdb0b5 req-db5234ab-477c-4d17-8d92-c281aac55ce5 service nova] [instance: e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0] Received event network-vif-unplugged-9513dc1d-79d5-482b-baaa-81f525e99de7 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:30:41 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-e4812912-2ed9-4511-8f06-eaa36fcdb0b5 req-db5234ab-477c-4d17-8d92-c281aac55ce5 service nova] Acquiring lock "e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:30:41 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-e4812912-2ed9-4511-8f06-eaa36fcdb0b5 req-db5234ab-477c-4d17-8d92-c281aac55ce5 service nova] Lock "e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:30:41 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-e4812912-2ed9-4511-8f06-eaa36fcdb0b5 req-db5234ab-477c-4d17-8d92-c281aac55ce5 service nova] Lock "e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:30:41 user nova-compute[72382]: DEBUG nova.compute.manager [req-e4812912-2ed9-4511-8f06-eaa36fcdb0b5 req-db5234ab-477c-4d17-8d92-c281aac55ce5 service nova] [instance: e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0] No waiting events found dispatching network-vif-unplugged-9513dc1d-79d5-482b-baaa-81f525e99de7 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:30:41 user nova-compute[72382]: DEBUG nova.compute.manager [req-e4812912-2ed9-4511-8f06-eaa36fcdb0b5 req-db5234ab-477c-4d17-8d92-c281aac55ce5 service nova] [instance: e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0] Received event network-vif-unplugged-9513dc1d-79d5-482b-baaa-81f525e99de7 for instance with task_state deleting. {{(pid=72382) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 15:30:42 user nova-compute[72382]: INFO nova.virt.libvirt.driver [-] [instance: e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0] Instance destroyed successfully.
Aug 09 15:30:42 user nova-compute[72382]: DEBUG nova.objects.instance [None req-5ef21b39-d5f3-46e0-a4ab-2144e0cb12a6 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Lazy-loading 'resources' on Instance uuid e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0 {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:30:42 user nova-compute[72382]: DEBUG nova.virt.libvirt.vif [None req-5ef21b39-d5f3-46e0-a4ab-2144e0cb12a6 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T15:23:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-254167293',display_name='tempest-ServerRescueNegativeTestJSON-server-254167293',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-254167293',id=24,image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAaMCyNBQb3ylRgcQrIdw3Y84mRNrknOzJTzHyXWYqKGNSX5MBMhw93vJCCFehVKV4spG2iiG6YuL+cWRa1bzzVUXWVZYbOxKXYJ/onpVtDMdN4JhVqCK0JO3eF4bmbVSg==',key_name='tempest-keypair-1084909994',keypairs=<?>,launch_index=0,launched_at=2023-08-09T15:26:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='990ba791030940d38360af5879c853c5',ramdisk_id='',reservation_id='r-tk8hunpk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-867522113',owner_user_name='tempest-ServerRescueNegativeTestJSON-867522113-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T15:28:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f94ca386a2be42cfbc2407bb7520cd25',uuid=e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9513dc1d-79d5-482b-baaa-81f525e99de7", "address": "fa:16:3e:6f:6b:41", "network": {"id": "46ef00c7-17ee-4e45-ba1d-dcc0a417ea85", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1360012261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.24", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "990ba791030940d38360af5879c853c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9513dc1d-79", "ovs_interfaceid": "9513dc1d-79d5-482b-baaa-81f525e99de7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 15:30:42 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-5ef21b39-d5f3-46e0-a4ab-2144e0cb12a6 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Converting VIF {"id": "9513dc1d-79d5-482b-baaa-81f525e99de7", "address": "fa:16:3e:6f:6b:41", "network": {"id": "46ef00c7-17ee-4e45-ba1d-dcc0a417ea85", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1360012261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.24", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "990ba791030940d38360af5879c853c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9513dc1d-79", "ovs_interfaceid": "9513dc1d-79d5-482b-baaa-81f525e99de7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 15:30:42 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-5ef21b39-d5f3-46e0-a4ab-2144e0cb12a6 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6f:6b:41,bridge_name='br-int',has_traffic_filtering=True,id=9513dc1d-79d5-482b-baaa-81f525e99de7,network=Network(46ef00c7-17ee-4e45-ba1d-dcc0a417ea85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9513dc1d-79') {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 15:30:42 user nova-compute[72382]: DEBUG os_vif [None req-5ef21b39-d5f3-46e0-a4ab-2144e0cb12a6 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6f:6b:41,bridge_name='br-int',has_traffic_filtering=True,id=9513dc1d-79d5-482b-baaa-81f525e99de7,network=Network(46ef00c7-17ee-4e45-ba1d-dcc0a417ea85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9513dc1d-79') {{(pid=72382) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 15:30:42 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:30:42 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9513dc1d-79, bridge=br-int, if_exists=True) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:30:42 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:30:42 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:30:42 user nova-compute[72382]: INFO os_vif [None req-5ef21b39-d5f3-46e0-a4ab-2144e0cb12a6 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6f:6b:41,bridge_name='br-int',has_traffic_filtering=True,id=9513dc1d-79d5-482b-baaa-81f525e99de7,network=Network(46ef00c7-17ee-4e45-ba1d-dcc0a417ea85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9513dc1d-79')
Aug 09 15:30:42 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-5ef21b39-d5f3-46e0-a4ab-2144e0cb12a6 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] [instance: e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0] Deleting instance files /opt/stack/data/nova/instances/e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0_del
Aug 09 15:30:42 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-5ef21b39-d5f3-46e0-a4ab-2144e0cb12a6 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] [instance: e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0] Deletion of /opt/stack/data/nova/instances/e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0_del complete
Aug 09 15:30:42 user nova-compute[72382]: INFO nova.compute.manager [None req-5ef21b39-d5f3-46e0-a4ab-2144e0cb12a6 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] [instance: e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0] Took 1.05 seconds to destroy the instance on the hypervisor.
Aug 09 15:30:42 user nova-compute[72382]: DEBUG oslo.service.loopingcall [None req-5ef21b39-d5f3-46e0-a4ab-2144e0cb12a6 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72382) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 15:30:42 user nova-compute[72382]: DEBUG nova.compute.manager [-] [instance: e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0] Deallocating network for instance {{(pid=72382) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 15:30:42 user nova-compute[72382]: DEBUG nova.network.neutron [-] [instance: e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0] deallocate_for_instance() {{(pid=72382) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 15:30:43 user nova-compute[72382]: DEBUG nova.network.neutron [-] [instance: e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0] Updating instance_info_cache with network_info: [] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:30:43 user nova-compute[72382]: INFO nova.compute.manager [-] [instance: e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0] Took 1.07 seconds to deallocate network for instance.
Aug 09 15:30:43 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-5ef21b39-d5f3-46e0-a4ab-2144e0cb12a6 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:30:43 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-5ef21b39-d5f3-46e0-a4ab-2144e0cb12a6 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:30:43 user nova-compute[72382]: DEBUG nova.compute.provider_tree [None req-5ef21b39-d5f3-46e0-a4ab-2144e0cb12a6 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Inventory has not changed in ProviderTree for provider: 7b15b0e5-df4d-49db-833b-2855d21d10ae {{(pid=72382) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 15:30:43 user nova-compute[72382]: DEBUG nova.scheduler.client.report [None req-5ef21b39-d5f3-46e0-a4ab-2144e0cb12a6 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Inventory has not changed for provider 7b15b0e5-df4d-49db-833b-2855d21d10ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72382) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 15:30:43 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-5ef21b39-d5f3-46e0-a4ab-2144e0cb12a6 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.341s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:30:43 user nova-compute[72382]: INFO nova.scheduler.client.report [None req-5ef21b39-d5f3-46e0-a4ab-2144e0cb12a6 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Deleted allocations for instance e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0
Aug 09 15:30:43 user nova-compute[72382]: DEBUG nova.compute.manager [req-816edb42-ef19-42bf-849e-3e310b98cac4 req-76bbc8c6-89b0-488b-acbe-5c3c1746a80e service nova] [instance: e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0] Received event network-vif-plugged-9513dc1d-79d5-482b-baaa-81f525e99de7 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:30:43 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-816edb42-ef19-42bf-849e-3e310b98cac4 req-76bbc8c6-89b0-488b-acbe-5c3c1746a80e service nova] Acquiring lock "e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:30:43 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-816edb42-ef19-42bf-849e-3e310b98cac4 req-76bbc8c6-89b0-488b-acbe-5c3c1746a80e service nova] Lock "e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:30:43 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-816edb42-ef19-42bf-849e-3e310b98cac4 req-76bbc8c6-89b0-488b-acbe-5c3c1746a80e service nova] Lock "e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:30:43 user nova-compute[72382]: DEBUG nova.compute.manager [req-816edb42-ef19-42bf-849e-3e310b98cac4 req-76bbc8c6-89b0-488b-acbe-5c3c1746a80e service nova] [instance: e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0] No waiting events found dispatching network-vif-plugged-9513dc1d-79d5-482b-baaa-81f525e99de7 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:30:43 user nova-compute[72382]: WARNING nova.compute.manager [req-816edb42-ef19-42bf-849e-3e310b98cac4 req-76bbc8c6-89b0-488b-acbe-5c3c1746a80e service nova] [instance: e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0] Received unexpected event network-vif-plugged-9513dc1d-79d5-482b-baaa-81f525e99de7 for instance with vm_state deleted and task_state None.
Aug 09 15:30:43 user nova-compute[72382]: DEBUG nova.compute.manager [req-816edb42-ef19-42bf-849e-3e310b98cac4 req-76bbc8c6-89b0-488b-acbe-5c3c1746a80e service nova] [instance: e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0] Received event network-vif-deleted-9513dc1d-79d5-482b-baaa-81f525e99de7 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:30:43 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-5ef21b39-d5f3-46e0-a4ab-2144e0cb12a6 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Lock "e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.720s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:30:46 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-286a634f-19ad-4afb-b53d-04ce872d75dc tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] [instance: 4ccbfda2-8bcd-4ec1-972a-cf49a62b1583] Creating instance directory {{(pid=72382) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 15:30:46 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-286a634f-19ad-4afb-b53d-04ce872d75dc tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] [instance: 4ccbfda2-8bcd-4ec1-972a-cf49a62b1583] Creating image(s)
Aug 09 15:30:46 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-286a634f-19ad-4afb-b53d-04ce872d75dc tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Acquiring lock "/opt/stack/data/nova/instances/4ccbfda2-8bcd-4ec1-972a-cf49a62b1583/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:30:46 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-286a634f-19ad-4afb-b53d-04ce872d75dc tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Lock "/opt/stack/data/nova/instances/4ccbfda2-8bcd-4ec1-972a-cf49a62b1583/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:30:46 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-286a634f-19ad-4afb-b53d-04ce872d75dc tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Lock "/opt/stack/data/nova/instances/4ccbfda2-8bcd-4ec1-972a-cf49a62b1583/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:30:46 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-286a634f-19ad-4afb-b53d-04ce872d75dc tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:30:46 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-286a634f-19ad-4afb-b53d-04ce872d75dc tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b --force-share --output=json" returned: 0 in 0.159s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:30:46 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-286a634f-19ad-4afb-b53d-04ce872d75dc tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Acquiring lock "383812ff437283e0191ed5b9ecc04c27f1162b0b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:30:46 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-286a634f-19ad-4afb-b53d-04ce872d75dc tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Lock "383812ff437283e0191ed5b9ecc04c27f1162b0b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:30:46 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-286a634f-19ad-4afb-b53d-04ce872d75dc tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:30:46 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-286a634f-19ad-4afb-b53d-04ce872d75dc tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b --force-share --output=json" returned: 0 in 0.134s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:30:46 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-286a634f-19ad-4afb-b53d-04ce872d75dc tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b,backing_fmt=raw /opt/stack/data/nova/instances/4ccbfda2-8bcd-4ec1-972a-cf49a62b1583/disk 1073741824 {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:30:46 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-286a634f-19ad-4afb-b53d-04ce872d75dc tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b,backing_fmt=raw /opt/stack/data/nova/instances/4ccbfda2-8bcd-4ec1-972a-cf49a62b1583/disk 1073741824" returned: 0 in 0.055s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:30:46 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-286a634f-19ad-4afb-b53d-04ce872d75dc tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Lock "383812ff437283e0191ed5b9ecc04c27f1162b0b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.196s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:30:46 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-286a634f-19ad-4afb-b53d-04ce872d75dc tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:30:46 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-286a634f-19ad-4afb-b53d-04ce872d75dc tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b --force-share --output=json" returned: 0 in 0.134s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:30:46 user nova-compute[72382]: DEBUG nova.virt.disk.api [None req-286a634f-19ad-4afb-b53d-04ce872d75dc tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4ccbfda2-8bcd-4ec1-972a-cf49a62b1583/disk. size=1073741824 {{(pid=72382) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 15:30:46 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-286a634f-19ad-4afb-b53d-04ce872d75dc tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ccbfda2-8bcd-4ec1-972a-cf49a62b1583/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:30:46 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-286a634f-19ad-4afb-b53d-04ce872d75dc tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ccbfda2-8bcd-4ec1-972a-cf49a62b1583/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:30:46 user nova-compute[72382]: DEBUG nova.virt.disk.api [None req-286a634f-19ad-4afb-b53d-04ce872d75dc tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Cannot resize image /opt/stack/data/nova/instances/4ccbfda2-8bcd-4ec1-972a-cf49a62b1583/disk to a smaller size. {{(pid=72382) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 15:30:46 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-286a634f-19ad-4afb-b53d-04ce872d75dc tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] [instance: 4ccbfda2-8bcd-4ec1-972a-cf49a62b1583] Created local disks {{(pid=72382) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 15:30:46 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-286a634f-19ad-4afb-b53d-04ce872d75dc tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] [instance: 4ccbfda2-8bcd-4ec1-972a-cf49a62b1583] Ensure instance console log exists: /opt/stack/data/nova/instances/4ccbfda2-8bcd-4ec1-972a-cf49a62b1583/console.log {{(pid=72382) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 15:30:46 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-286a634f-19ad-4afb-b53d-04ce872d75dc tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:30:46 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-286a634f-19ad-4afb-b53d-04ce872d75dc tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:30:47 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-286a634f-19ad-4afb-b53d-04ce872d75dc tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:30:47 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-286a634f-19ad-4afb-b53d-04ce872d75dc tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] [instance: 4ccbfda2-8bcd-4ec1-972a-cf49a62b1583] Start _get_guest_xml network_info=[{"id": "2d07e6a3-03b7-4035-bdd2-a95435b99852", "address": "fa:16:3e:9a:d4:3a", "network": {"id": "308641dc-cc18-41db-9baa-7cc880e594ad", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1932973397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb5bf3f95d2843af94dbcab2af932bd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d07e6a3-03", "ovs_interfaceid": "2d07e6a3-03b7-4035-bdd2-a95435b99852", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T15:11:25Z,direct_url=<?>,disk_format='qcow2',id=a79f2cea-eb27-4631-aaf3-05e7d9e411b4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a638990e12cc4d6eabb6d55e13be6bdf',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T15:11:27Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'a79f2cea-eb27-4631-aaf3-05e7d9e411b4'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'boot_index': None, 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:b5cfefdb-a454-494f-ab09-acf8644352a3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VjpQFgdP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '4ccbfda2-8bcd-4ec1-972a-cf49a62b1583', 'attached_at': '', 'detached_at': '', 'volume_id': 'b5cfefdb-a454-494f-ab09-acf8644352a3', 'serial': 'b5cfefdb-a454-494f-ab09-acf8644352a3'}, 'disk_bus': 'virtio', 'attachment_id': '30d40d18-c3e2-4193-a99a-d7b8c712759d', 'delete_on_termination': False, 'volume_type': None} {{(pid=72382) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 15:30:47 user nova-compute[72382]: WARNING nova.virt.libvirt.driver [None req-286a634f-19ad-4afb-b53d-04ce872d75dc tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 09 15:30:47 user nova-compute[72382]: WARNING nova.virt.libvirt.driver [None req-286a634f-19ad-4afb-b53d-04ce872d75dc tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 09 15:30:47 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-286a634f-19ad-4afb-b53d-04ce872d75dc tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72382) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 15:30:47 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-286a634f-19ad-4afb-b53d-04ce872d75dc tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] CPU controller missing on host. {{(pid=72382) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 15:30:47 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-286a634f-19ad-4afb-b53d-04ce872d75dc tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72382) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 15:30:47 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-286a634f-19ad-4afb-b53d-04ce872d75dc tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] CPU controller found on host. {{(pid=72382) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 15:30:47 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-286a634f-19ad-4afb-b53d-04ce872d75dc tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72382) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 15:30:47 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-286a634f-19ad-4afb-b53d-04ce872d75dc tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T15:11:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T15:11:25Z,direct_url=<?>,disk_format='qcow2',id=a79f2cea-eb27-4631-aaf3-05e7d9e411b4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a638990e12cc4d6eabb6d55e13be6bdf',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T15:11:27Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 15:30:47 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-286a634f-19ad-4afb-b53d-04ce872d75dc tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Flavor limits 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 15:30:47 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-286a634f-19ad-4afb-b53d-04ce872d75dc tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Image limits 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 15:30:47 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-286a634f-19ad-4afb-b53d-04ce872d75dc tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Flavor pref 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 15:30:47 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-286a634f-19ad-4afb-b53d-04ce872d75dc tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Image pref 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 15:30:47 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-286a634f-19ad-4afb-b53d-04ce872d75dc tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 15:30:47 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-286a634f-19ad-4afb-b53d-04ce872d75dc tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 15:30:47 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-286a634f-19ad-4afb-b53d-04ce872d75dc tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72382) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 15:30:47 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-286a634f-19ad-4afb-b53d-04ce872d75dc tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Got 1 possible topologies {{(pid=72382) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 15:30:47 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-286a634f-19ad-4afb-b53d-04ce872d75dc tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 15:30:47 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-286a634f-19ad-4afb-b53d-04ce872d75dc tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 15:30:47 user nova-compute[72382]: DEBUG nova.objects.instance [None req-286a634f-19ad-4afb-b53d-04ce872d75dc tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Lazy-loading 'vcpu_model' on Instance uuid 4ccbfda2-8bcd-4ec1-972a-cf49a62b1583 {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:30:47 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-286a634f-19ad-4afb-b53d-04ce872d75dc tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] [instance: 4ccbfda2-8bcd-4ec1-972a-cf49a62b1583] Calling os-brick to attach iSCSI Volume {{(pid=72382) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 15:30:47 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-286a634f-19ad-4afb-b53d-04ce872d75dc tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2a0c768340>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:b5cfefdb-a454-494f-ab09-acf8644352a3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VjpQFgdP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 15:30:47 user nova-compute[72382]: WARNING os_brick.initiator.connectors.base [None req-286a634f-19ad-4afb-b53d-04ce872d75dc tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 09 15:30:47 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-286a634f-19ad-4afb-b53d-04ce872d75dc tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 15:30:47 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-286a634f-19ad-4afb-b53d-04ce872d75dc tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 15:30:47 user nova-compute[72382]: WARNING os_brick.initiator.connectors.base [None req-286a634f-19ad-4afb-b53d-04ce872d75dc tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 09 15:30:47 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-286a634f-19ad-4afb-b53d-04ce872d75dc tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b5cfefdb-a454-494f-ab09-acf8644352a3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 15:30:47 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-286a634f-19ad-4afb-b53d-04ce872d75dc tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b5cfefdb-a454-494f-ab09-acf8644352a3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 15:30:47 user nova-compute[72382]: INFO os_brick.initiator.connectors.iscsi [None req-286a634f-19ad-4afb-b53d-04ce872d75dc tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 15:30:47 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:30:47 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5cfefdb-a454-494f-ab09-acf8644352a3 -p 172.16.0.220:3260 {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:30:47 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5cfefdb-a454-494f-ab09-acf8644352a3 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:30:47 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a9aeac6-0272-4ad6-84bf-2a5b27d51296]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:30:47 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-286a634f-19ad-4afb-b53d-04ce872d75dc tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 15:30:47 user nova-compute[72382]:  {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:30:47 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5cfefdb-a454-494f-ab09-acf8644352a3 -p 172.16.0.220:3260 --interface default --op new {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:30:47 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5cfefdb-a454-494f-ab09-acf8644352a3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:30:47 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[00fc4a3b-daf9-4e24-8531-2694889c922c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b5cfefdb-a454-494f-ab09-acf8644352a3] added\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:30:47 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-286a634f-19ad-4afb-b53d-04ce872d75dc tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b5cfefdb-a454-494f-ab09-acf8644352a3] added
Aug 09 15:30:47 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:30:47 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5cfefdb-a454-494f-ab09-acf8644352a3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:30:47 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5cfefdb-a454-494f-ab09-acf8644352a3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:30:47 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[438a051d-8235-48b5-be41-3457dd5595d0]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:30:47 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-286a634f-19ad-4afb-b53d-04ce872d75dc tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:30:47 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5cfefdb-a454-494f-ab09-acf8644352a3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:30:47 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5cfefdb-a454-494f-ab09-acf8644352a3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.029s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:30:47 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f2698f0-1ffe-4f2e-b0a7-75c60b9b9a16]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:30:47 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-286a634f-19ad-4afb-b53d-04ce872d75dc tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:30:47 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5cfefdb-a454-494f-ab09-acf8644352a3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VjpQFgdP {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:30:47 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5cfefdb-a454-494f-ab09-acf8644352a3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VjpQFgdP" returned: 0 in 0.019s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:30:47 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[239a8edd-0bbf-4a65-a868-fc6e891fe3a1]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:30:47 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-286a634f-19ad-4afb-b53d-04ce872d75dc tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VjpQFgdP'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:30:47 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5cfefdb-a454-494f-ab09-acf8644352a3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:30:47 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5cfefdb-a454-494f-ab09-acf8644352a3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:30:47 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[08f2f704-6e8d-4bed-9523-07c7223ea8fe]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:30:47 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-286a634f-19ad-4afb-b53d-04ce872d75dc tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:30:47 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:30:47 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:30:47 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[3df02c59-a3c5-4063-a78e-91f71896760d]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25503c6e-bfc0-4008-846a-8cad783fc0fb (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e62d4416-be8c-4327-9a51-0cc509109c53 (non-flash)\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:30:47 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-286a634f-19ad-4afb-b53d-04ce872d75dc tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)
Aug 09 15:30:47 user nova-compute[72382]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25503c6e-bfc0-4008-846a-8cad783fc0fb (non-flash)
Aug 09 15:30:47 user nova-compute[72382]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e62d4416-be8c-4327-9a51-0cc509109c53 (non-flash)
Aug 09 15:30:47 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 15:30:47 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-286a634f-19ad-4afb-b53d-04ce872d75dc tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)
Aug 09 15:30:47 user nova-compute[72382]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25503c6e-bfc0-4008-846a-8cad783fc0fb (non-flash)
Aug 09 15:30:47 user nova-compute[72382]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e62d4416-be8c-4327-9a51-0cc509109c53 (non-flash)
Aug 09 15:30:47 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 15:30:47 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5cfefdb-a454-494f-ab09-acf8644352a3 -p 172.16.0.220:3260 --login {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:30:47 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5cfefdb-a454-494f-ab09-acf8644352a3 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:30:47 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[d41dbc25-7a4d-4944-8c1e-001edd826628]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b5cfefdb-a454-494f-ab09-acf8644352a3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b5cfefdb-a454-494f-ab09-acf8644352a3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:30:47 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-286a634f-19ad-4afb-b53d-04ce872d75dc tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b5cfefdb-a454-494f-ab09-acf8644352a3, portal: 172.16.0.220,3260]
Aug 09 15:30:47 user nova-compute[72382]: Login to [iface: default, target: iqn.2010-10.org.openstack:b5cfefdb-a454-494f-ab09-acf8644352a3, portal: 172.16.0.220,3260] successful.
Aug 09 15:30:47 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:30:47 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5cfefdb-a454-494f-ab09-acf8644352a3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:30:47 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5cfefdb-a454-494f-ab09-acf8644352a3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:30:47 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[b00f969c-3e91-44da-b4a6-d38563e3613b]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:30:47 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-286a634f-19ad-4afb-b53d-04ce872d75dc tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:30:47 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:30:47 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:30:47 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee94248e-4403-4aac-99f9-8c83002f7d09]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25503c6e-bfc0-4008-846a-8cad783fc0fb (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e62d4416-be8c-4327-9a51-0cc509109c53 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5cfefdb-a454-494f-ab09-acf8644352a3 (non-flash)\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:30:47 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-286a634f-19ad-4afb-b53d-04ce872d75dc tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)
Aug 09 15:30:47 user nova-compute[72382]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25503c6e-bfc0-4008-846a-8cad783fc0fb (non-flash)
Aug 09 15:30:47 user nova-compute[72382]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e62d4416-be8c-4327-9a51-0cc509109c53 (non-flash)
Aug 09 15:30:47 user nova-compute[72382]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5cfefdb-a454-494f-ab09-acf8644352a3 (non-flash)
Aug 09 15:30:47 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 15:30:47 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-286a634f-19ad-4afb-b53d-04ce872d75dc tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)
Aug 09 15:30:47 user nova-compute[72382]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25503c6e-bfc0-4008-846a-8cad783fc0fb (non-flash)
Aug 09 15:30:47 user nova-compute[72382]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e62d4416-be8c-4327-9a51-0cc509109c53 (non-flash)
Aug 09 15:30:47 user nova-compute[72382]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5cfefdb-a454-494f-ab09-acf8644352a3 (non-flash)
Aug 09 15:30:47 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 15:30:47 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-286a634f-19ad-4afb-b53d-04ce872d75dc tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b5cfefdb-a454-494f-ab09-acf8644352a3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.311s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 15:30:47 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-286a634f-19ad-4afb-b53d-04ce872d75dc tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Connected to 172.16.0.220:3260 {{(pid=72382) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 15:30:47 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-286a634f-19ad-4afb-b53d-04ce872d75dc tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] HCTL ('33', '-', '-', 0) found on session 39 with lun 0 {{(pid=72382) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 15:30:47 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-286a634f-19ad-4afb-b53d-04ce872d75dc tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72382) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 15:30:47 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:30:47 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:30:47 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3d5222c-4d15-4d56-87b8-ddcda0cd00f0]: (4, ('- - 0', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:30:47 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-286a634f-19ad-4afb-b53d-04ce872d75dc tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Searching for a device in session 39 and hctl ['33', '*', '*', 0] yield: None {{(pid=72382) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 15:30:48 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-286a634f-19ad-4afb-b53d-04ce872d75dc tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Searching for a device in session 39 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72382) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 15:30:48 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-286a634f-19ad-4afb-b53d-04ce872d75dc tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VjpQFgdP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72382) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 15:30:48 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-286a634f-19ad-4afb-b53d-04ce872d75dc tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.343s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 15:30:48 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-286a634f-19ad-4afb-b53d-04ce872d75dc tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] <== connect_volume: return (1344ms) {'type': 'block', 'scsi_wwn': '23130386331336537', 'path': '/dev/sdb'} {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 15:30:48 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-286a634f-19ad-4afb-b53d-04ce872d75dc tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] [instance: 4ccbfda2-8bcd-4ec1-972a-cf49a62b1583] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23130386331336537', 'path': '/dev/sdb'} {{(pid=72382) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 15:30:48 user nova-compute[72382]: DEBUG nova.virt.libvirt.vif [None req-286a634f-19ad-4afb-b53d-04ce872d75dc tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-09T15:26:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-726596602',display_name='tempest-ServerActionsTestOtherA-server-662551681',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-726596602',id=27,image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCmuVV1ynikE+pH75fjLIal2KFmSgV7eQmOTfU0+P2w2YCXfBWnAu9n1cQQTYYTDt/aP+JsGjkRdlSPqvnnG5WbnlJT+9aj9SfyqprOo87kqF8CD2U4mVDTvv+6ADzXJvQ==',key_name='tempest-keypair-568328368',keypairs=<?>,launch_index=0,launched_at=2023-08-09T15:26:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='eb5bf3f95d2843af94dbcab2af932bd1',ramdisk_id='',reservation_id='r-169g26o6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1899577274',owner_user_name='tempest-ServerActionsTestOtherA-1899577274-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T15:30:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2cca9aef887b4b91a46ff4bd5cd32302',uuid=4ccbfda2-8bcd-4ec1-972a-cf49a62b1583,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2d07e6a3-03b7-4035-bdd2-a95435b99852", "address": "fa:16:3e:9a:d4:3a", "network": {"id": "308641dc-cc18-41db-9baa-7cc880e594ad", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1932973397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb5bf3f95d2843af94dbcab2af932bd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d07e6a3-03", "ovs_interfaceid": "2d07e6a3-03b7-4035-bdd2-a95435b99852", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72382) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 15:30:48 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-286a634f-19ad-4afb-b53d-04ce872d75dc tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Converting VIF {"id": "2d07e6a3-03b7-4035-bdd2-a95435b99852", "address": "fa:16:3e:9a:d4:3a", "network": {"id": "308641dc-cc18-41db-9baa-7cc880e594ad", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1932973397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb5bf3f95d2843af94dbcab2af932bd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d07e6a3-03", "ovs_interfaceid": "2d07e6a3-03b7-4035-bdd2-a95435b99852", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 15:30:48 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-286a634f-19ad-4afb-b53d-04ce872d75dc tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9a:d4:3a,bridge_name='br-int',has_traffic_filtering=True,id=2d07e6a3-03b7-4035-bdd2-a95435b99852,network=Network(308641dc-cc18-41db-9baa-7cc880e594ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d07e6a3-03') {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 15:30:48 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-286a634f-19ad-4afb-b53d-04ce872d75dc tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] [instance: 4ccbfda2-8bcd-4ec1-972a-cf49a62b1583] End _get_guest_xml xml=<domain type="kvm">
Aug 09 15:30:48 user nova-compute[72382]:   <uuid>4ccbfda2-8bcd-4ec1-972a-cf49a62b1583</uuid>
Aug 09 15:30:48 user nova-compute[72382]:   <name>instance-0000001b</name>
Aug 09 15:30:48 user nova-compute[72382]:   <memory>524288</memory>
Aug 09 15:30:48 user nova-compute[72382]:   <vcpu>1</vcpu>
Aug 09 15:30:48 user nova-compute[72382]:   <metadata>
Aug 09 15:30:48 user nova-compute[72382]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 15:30:48 user nova-compute[72382]:       <nova:package version="0.0.0"/>
Aug 09 15:30:48 user nova-compute[72382]:       <nova:name>tempest-ServerActionsTestOtherA-server-662551681</nova:name>
Aug 09 15:30:48 user nova-compute[72382]:       <nova:creationTime>2023-08-09 15:30:47</nova:creationTime>
Aug 09 15:30:48 user nova-compute[72382]:       <nova:flavor name="m1.tiny">
Aug 09 15:30:48 user nova-compute[72382]:         <nova:memory>512</nova:memory>
Aug 09 15:30:48 user nova-compute[72382]:         <nova:disk>1</nova:disk>
Aug 09 15:30:48 user nova-compute[72382]:         <nova:swap>0</nova:swap>
Aug 09 15:30:48 user nova-compute[72382]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 15:30:48 user nova-compute[72382]:         <nova:vcpus>1</nova:vcpus>
Aug 09 15:30:48 user nova-compute[72382]:       </nova:flavor>
Aug 09 15:30:48 user nova-compute[72382]:       <nova:owner>
Aug 09 15:30:48 user nova-compute[72382]:         <nova:user uuid="2cca9aef887b4b91a46ff4bd5cd32302">tempest-ServerActionsTestOtherA-1899577274-project-member</nova:user>
Aug 09 15:30:48 user nova-compute[72382]:         <nova:project uuid="eb5bf3f95d2843af94dbcab2af932bd1">tempest-ServerActionsTestOtherA-1899577274</nova:project>
Aug 09 15:30:48 user nova-compute[72382]:       </nova:owner>
Aug 09 15:30:48 user nova-compute[72382]:       <nova:root type="image" uuid="a79f2cea-eb27-4631-aaf3-05e7d9e411b4"/>
Aug 09 15:30:48 user nova-compute[72382]:       <nova:ports>
Aug 09 15:30:48 user nova-compute[72382]:         <nova:port uuid="2d07e6a3-03b7-4035-bdd2-a95435b99852">
Aug 09 15:30:48 user nova-compute[72382]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 09 15:30:48 user nova-compute[72382]:         </nova:port>
Aug 09 15:30:48 user nova-compute[72382]:       </nova:ports>
Aug 09 15:30:48 user nova-compute[72382]:     </nova:instance>
Aug 09 15:30:48 user nova-compute[72382]:   </metadata>
Aug 09 15:30:48 user nova-compute[72382]:   <sysinfo type="smbios">
Aug 09 15:30:48 user nova-compute[72382]:     <system>
Aug 09 15:30:48 user nova-compute[72382]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 15:30:48 user nova-compute[72382]:       <entry name="product">OpenStack Nova</entry>
Aug 09 15:30:48 user nova-compute[72382]:       <entry name="version">0.0.0</entry>
Aug 09 15:30:48 user nova-compute[72382]:       <entry name="serial">4ccbfda2-8bcd-4ec1-972a-cf49a62b1583</entry>
Aug 09 15:30:48 user nova-compute[72382]:       <entry name="uuid">4ccbfda2-8bcd-4ec1-972a-cf49a62b1583</entry>
Aug 09 15:30:48 user nova-compute[72382]:       <entry name="family">Virtual Machine</entry>
Aug 09 15:30:48 user nova-compute[72382]:     </system>
Aug 09 15:30:48 user nova-compute[72382]:   </sysinfo>
Aug 09 15:30:48 user nova-compute[72382]:   <os>
Aug 09 15:30:48 user nova-compute[72382]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 15:30:48 user nova-compute[72382]:     <boot dev="hd"/>
Aug 09 15:30:48 user nova-compute[72382]:     <smbios mode="sysinfo"/>
Aug 09 15:30:48 user nova-compute[72382]:   </os>
Aug 09 15:30:48 user nova-compute[72382]:   <features>
Aug 09 15:30:48 user nova-compute[72382]:     <acpi/>
Aug 09 15:30:48 user nova-compute[72382]:     <apic/>
Aug 09 15:30:48 user nova-compute[72382]:     <vmcoreinfo/>
Aug 09 15:30:48 user nova-compute[72382]:   </features>
Aug 09 15:30:48 user nova-compute[72382]:   <clock offset="utc">
Aug 09 15:30:48 user nova-compute[72382]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 15:30:48 user nova-compute[72382]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 15:30:48 user nova-compute[72382]:     <timer name="hpet" present="no"/>
Aug 09 15:30:48 user nova-compute[72382]:   </clock>
Aug 09 15:30:48 user nova-compute[72382]:   <cpu mode="custom" match="exact">
Aug 09 15:30:48 user nova-compute[72382]:     <model>Nehalem</model>
Aug 09 15:30:48 user nova-compute[72382]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 15:30:48 user nova-compute[72382]:   </cpu>
Aug 09 15:30:48 user nova-compute[72382]:   <devices>
Aug 09 15:30:48 user nova-compute[72382]:     <disk type="file" device="disk">
Aug 09 15:30:48 user nova-compute[72382]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 15:30:48 user nova-compute[72382]:       <source file="/opt/stack/data/nova/instances/4ccbfda2-8bcd-4ec1-972a-cf49a62b1583/disk"/>
Aug 09 15:30:48 user nova-compute[72382]:       <target dev="vda" bus="virtio"/>
Aug 09 15:30:48 user nova-compute[72382]:     </disk>
Aug 09 15:30:48 user nova-compute[72382]:     <disk type="block" device="disk">
Aug 09 15:30:48 user nova-compute[72382]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 15:30:48 user nova-compute[72382]:       <source dev="/dev/sdb"/>
Aug 09 15:30:48 user nova-compute[72382]:       <target dev="vdb" bus="virtio"/>
Aug 09 15:30:48 user nova-compute[72382]:       <serial>b5cfefdb-a454-494f-ab09-acf8644352a3</serial>
Aug 09 15:30:48 user nova-compute[72382]:     </disk>
Aug 09 15:30:48 user nova-compute[72382]:     <interface type="ethernet">
Aug 09 15:30:48 user nova-compute[72382]:       <mac address="fa:16:3e:9a:d4:3a"/>
Aug 09 15:30:48 user nova-compute[72382]:       <model type="virtio"/>
Aug 09 15:30:48 user nova-compute[72382]:       <mtu size="1442"/>
Aug 09 15:30:48 user nova-compute[72382]:       <target dev="tap2d07e6a3-03"/>
Aug 09 15:30:48 user nova-compute[72382]:     </interface>
Aug 09 15:30:48 user nova-compute[72382]:     <serial type="pty">
Aug 09 15:30:48 user nova-compute[72382]:       <log file="/opt/stack/data/nova/instances/4ccbfda2-8bcd-4ec1-972a-cf49a62b1583/console.log" append="off"/>
Aug 09 15:30:48 user nova-compute[72382]:     </serial>
Aug 09 15:30:48 user nova-compute[72382]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 15:30:48 user nova-compute[72382]:     <video>
Aug 09 15:30:48 user nova-compute[72382]:       <model type="virtio"/>
Aug 09 15:30:48 user nova-compute[72382]:     </video>
Aug 09 15:30:48 user nova-compute[72382]:     <rng model="virtio">
Aug 09 15:30:48 user nova-compute[72382]:       <backend model="random">/dev/urandom</backend>
Aug 09 15:30:48 user nova-compute[72382]:     </rng>
Aug 09 15:30:48 user nova-compute[72382]:     <controller type="usb" index="0" model="none"/>
Aug 09 15:30:48 user nova-compute[72382]:     <memballoon model="virtio">
Aug 09 15:30:48 user nova-compute[72382]:       <stats period="10"/>
Aug 09 15:30:48 user nova-compute[72382]:     </memballoon>
Aug 09 15:30:48 user nova-compute[72382]:   </devices>
Aug 09 15:30:48 user nova-compute[72382]: </domain>
Aug 09 15:30:48 user nova-compute[72382]:  {{(pid=72382) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 15:30:48 user nova-compute[72382]: DEBUG nova.virt.libvirt.vif [None req-286a634f-19ad-4afb-b53d-04ce872d75dc tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-09T15:26:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-726596602',display_name='tempest-ServerActionsTestOtherA-server-662551681',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-726596602',id=27,image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCmuVV1ynikE+pH75fjLIal2KFmSgV7eQmOTfU0+P2w2YCXfBWnAu9n1cQQTYYTDt/aP+JsGjkRdlSPqvnnG5WbnlJT+9aj9SfyqprOo87kqF8CD2U4mVDTvv+6ADzXJvQ==',key_name='tempest-keypair-568328368',keypairs=<?>,launch_index=0,launched_at=2023-08-09T15:26:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='eb5bf3f95d2843af94dbcab2af932bd1',ramdisk_id='',reservation_id='r-169g26o6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1899577274',owner_user_name='tempest-ServerActionsTestOtherA-1899577274-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T15:30:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2cca9aef887b4b91a46ff4bd5cd32302',uuid=4ccbfda2-8bcd-4ec1-972a-cf49a62b1583,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2d07e6a3-03b7-4035-bdd2-a95435b99852", "address": "fa:16:3e:9a:d4:3a", "network": {"id": "308641dc-cc18-41db-9baa-7cc880e594ad", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1932973397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb5bf3f95d2843af94dbcab2af932bd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d07e6a3-03", "ovs_interfaceid": "2d07e6a3-03b7-4035-bdd2-a95435b99852", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 15:30:48 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-286a634f-19ad-4afb-b53d-04ce872d75dc tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Converting VIF {"id": "2d07e6a3-03b7-4035-bdd2-a95435b99852", "address": "fa:16:3e:9a:d4:3a", "network": {"id": "308641dc-cc18-41db-9baa-7cc880e594ad", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1932973397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb5bf3f95d2843af94dbcab2af932bd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d07e6a3-03", "ovs_interfaceid": "2d07e6a3-03b7-4035-bdd2-a95435b99852", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 15:30:48 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-286a634f-19ad-4afb-b53d-04ce872d75dc tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9a:d4:3a,bridge_name='br-int',has_traffic_filtering=True,id=2d07e6a3-03b7-4035-bdd2-a95435b99852,network=Network(308641dc-cc18-41db-9baa-7cc880e594ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d07e6a3-03') {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 15:30:48 user nova-compute[72382]: DEBUG os_vif [None req-286a634f-19ad-4afb-b53d-04ce872d75dc tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9a:d4:3a,bridge_name='br-int',has_traffic_filtering=True,id=2d07e6a3-03b7-4035-bdd2-a95435b99852,network=Network(308641dc-cc18-41db-9baa-7cc880e594ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d07e6a3-03') {{(pid=72382) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 15:30:48 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:30:48 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:30:48 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 15:30:48 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:30:48 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2d07e6a3-03, may_exist=True, interface_attrs={}) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:30:48 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2d07e6a3-03, col_values=(('external_ids', {'iface-id': '2d07e6a3-03b7-4035-bdd2-a95435b99852', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9a:d4:3a', 'vm-uuid': '4ccbfda2-8bcd-4ec1-972a-cf49a62b1583'}),), if_exists=True) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:30:48 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:30:48 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:30:48 user nova-compute[72382]: INFO os_vif [None req-286a634f-19ad-4afb-b53d-04ce872d75dc tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9a:d4:3a,bridge_name='br-int',has_traffic_filtering=True,id=2d07e6a3-03b7-4035-bdd2-a95435b99852,network=Network(308641dc-cc18-41db-9baa-7cc880e594ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d07e6a3-03')
Aug 09 15:30:48 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:30:48 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-286a634f-19ad-4afb-b53d-04ce872d75dc tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] No BDM found with device name vda, not building metadata. {{(pid=72382) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 15:30:48 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-286a634f-19ad-4afb-b53d-04ce872d75dc tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72382) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 15:30:48 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-286a634f-19ad-4afb-b53d-04ce872d75dc tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] No VIF found with MAC fa:16:3e:9a:d4:3a, not building metadata {{(pid=72382) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 15:30:49 user nova-compute[72382]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691595034.3022387, 4ccbfda2-8bcd-4ec1-972a-cf49a62b1583 => Stopped> {{(pid=72382) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 15:30:49 user nova-compute[72382]: INFO nova.compute.manager [-] [instance: 4ccbfda2-8bcd-4ec1-972a-cf49a62b1583] VM Stopped (Lifecycle Event)
Aug 09 15:30:49 user nova-compute[72382]: DEBUG nova.compute.manager [None req-b4370f65-c43b-42fb-9607-0e476594594f None None] [instance: 4ccbfda2-8bcd-4ec1-972a-cf49a62b1583] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:30:49 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:30:49 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:30:49 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:30:49 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:30:49 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:30:50 user nova-compute[72382]: DEBUG nova.compute.manager [req-bdd37b57-3257-454a-ae11-ed9c1e7db262 req-cb1927ee-aabe-4aa0-9bd2-8a1c8e86efec service nova] [instance: 4ccbfda2-8bcd-4ec1-972a-cf49a62b1583] Received event network-vif-plugged-2d07e6a3-03b7-4035-bdd2-a95435b99852 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:30:50 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-bdd37b57-3257-454a-ae11-ed9c1e7db262 req-cb1927ee-aabe-4aa0-9bd2-8a1c8e86efec service nova] Acquiring lock "4ccbfda2-8bcd-4ec1-972a-cf49a62b1583-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:30:50 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-bdd37b57-3257-454a-ae11-ed9c1e7db262 req-cb1927ee-aabe-4aa0-9bd2-8a1c8e86efec service nova] Lock "4ccbfda2-8bcd-4ec1-972a-cf49a62b1583-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:30:50 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-bdd37b57-3257-454a-ae11-ed9c1e7db262 req-cb1927ee-aabe-4aa0-9bd2-8a1c8e86efec service nova] Lock "4ccbfda2-8bcd-4ec1-972a-cf49a62b1583-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:30:50 user nova-compute[72382]: DEBUG nova.compute.manager [req-bdd37b57-3257-454a-ae11-ed9c1e7db262 req-cb1927ee-aabe-4aa0-9bd2-8a1c8e86efec service nova] [instance: 4ccbfda2-8bcd-4ec1-972a-cf49a62b1583] No waiting events found dispatching network-vif-plugged-2d07e6a3-03b7-4035-bdd2-a95435b99852 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:30:50 user nova-compute[72382]: WARNING nova.compute.manager [req-bdd37b57-3257-454a-ae11-ed9c1e7db262 req-cb1927ee-aabe-4aa0-9bd2-8a1c8e86efec service nova] [instance: 4ccbfda2-8bcd-4ec1-972a-cf49a62b1583] Received unexpected event network-vif-plugged-2d07e6a3-03b7-4035-bdd2-a95435b99852 for instance with vm_state active and task_state rebuild_spawning.
Aug 09 15:30:50 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:30:50 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:30:50 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:30:50 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:30:51 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-d429602e-e6b7-4d94-866c-523e1be5ccb1 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Acquiring lock "94c8cc29-3300-475f-aca0-40fa0e58cd66" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:30:51 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-d429602e-e6b7-4d94-866c-523e1be5ccb1 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Lock "94c8cc29-3300-475f-aca0-40fa0e58cd66" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:30:51 user nova-compute[72382]: DEBUG nova.compute.manager [None req-d429602e-e6b7-4d94-866c-523e1be5ccb1 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: 94c8cc29-3300-475f-aca0-40fa0e58cd66] Starting instance... {{(pid=72382) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 15:30:51 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-d429602e-e6b7-4d94-866c-523e1be5ccb1 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:30:51 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-d429602e-e6b7-4d94-866c-523e1be5ccb1 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:30:51 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-d429602e-e6b7-4d94-866c-523e1be5ccb1 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72382) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 15:30:51 user nova-compute[72382]: INFO nova.compute.claims [None req-d429602e-e6b7-4d94-866c-523e1be5ccb1 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: 94c8cc29-3300-475f-aca0-40fa0e58cd66] Claim successful on node user
Aug 09 15:30:51 user nova-compute[72382]: DEBUG nova.compute.provider_tree [None req-d429602e-e6b7-4d94-866c-523e1be5ccb1 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Inventory has not changed in ProviderTree for provider: 7b15b0e5-df4d-49db-833b-2855d21d10ae {{(pid=72382) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 15:30:51 user nova-compute[72382]: DEBUG nova.scheduler.client.report [None req-d429602e-e6b7-4d94-866c-523e1be5ccb1 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Inventory has not changed for provider 7b15b0e5-df4d-49db-833b-2855d21d10ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72382) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 15:30:51 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-d429602e-e6b7-4d94-866c-523e1be5ccb1 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.432s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:30:51 user nova-compute[72382]: DEBUG nova.compute.manager [None req-d429602e-e6b7-4d94-866c-523e1be5ccb1 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: 94c8cc29-3300-475f-aca0-40fa0e58cd66] Start building networks asynchronously for instance. {{(pid=72382) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 15:30:51 user nova-compute[72382]: DEBUG nova.compute.manager [None req-d429602e-e6b7-4d94-866c-523e1be5ccb1 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: 94c8cc29-3300-475f-aca0-40fa0e58cd66] Allocating IP information in the background. {{(pid=72382) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 15:30:51 user nova-compute[72382]: DEBUG nova.network.neutron [None req-d429602e-e6b7-4d94-866c-523e1be5ccb1 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: 94c8cc29-3300-475f-aca0-40fa0e58cd66] allocate_for_instance() {{(pid=72382) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 15:30:51 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-d429602e-e6b7-4d94-866c-523e1be5ccb1 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: 94c8cc29-3300-475f-aca0-40fa0e58cd66] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 15:30:51 user nova-compute[72382]: DEBUG nova.compute.manager [None req-d429602e-e6b7-4d94-866c-523e1be5ccb1 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: 94c8cc29-3300-475f-aca0-40fa0e58cd66] Start building block device mappings for instance. {{(pid=72382) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 15:30:51 user nova-compute[72382]: INFO nova.virt.block_device [None req-d429602e-e6b7-4d94-866c-523e1be5ccb1 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: 94c8cc29-3300-475f-aca0-40fa0e58cd66] Booting with volume 59852df5-d4c8-4f25-8693-36181ff6a447 at /dev/vda
Aug 09 15:30:51 user nova-compute[72382]: DEBUG nova.policy [None req-d429602e-e6b7-4d94-866c-523e1be5ccb1 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '280bcf2afd7245a7bcd605e0db79c569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70310b1af40b4d239fe5ea362972554b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72382) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 15:30:51 user nova-compute[72382]: DEBUG os_brick.utils [None req-d429602e-e6b7-4d94-866c-523e1be5ccb1 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 15:30:51 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:30:51 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:30:51 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4cdc6ec-f166-4941-ac88-dcc19c06d6a5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d2cfa7015fe\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:30:51 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:30:51 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.023s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:30:51 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[f82eaa2e-c31b-4996-88f1-18d7209c165f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:30:51 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:30:51 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:30:51 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bdfd3f8-a6a1-4c5c-9245-19836edd9997]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:30:51 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e7939e9-0583-42a7-9187-9f01bdfb97fa]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:30:51 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-d429602e-e6b7-4d94-866c-523e1be5ccb1 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Running cmd (subprocess): nvme version {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:30:51 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-d429602e-e6b7-4d94-866c-523e1be5ccb1 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] 'nvme version' failed. Not Retrying. {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 15:30:51 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d429602e-e6b7-4d94-866c-523e1be5ccb1 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] nvme not present on system {{(pid=72382) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 15:30:51 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:30:51 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 15:30:51 user nova-compute[72382]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 15:30:51 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fa26389-f3cc-4be0-8e9d-17a1d1c120af]: (4, '') {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:30:51 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.lightos [None req-d429602e-e6b7-4d94-866c-523e1be5ccb1 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72382) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 15:30:51 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.lightos [None req-d429602e-e6b7-4d94-866c-523e1be5ccb1 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72382) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 15:30:51 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.lightos [None req-d429602e-e6b7-4d94-866c-523e1be5ccb1 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] LIGHTOS: no hostnqn found. {{(pid=72382) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 15:30:51 user nova-compute[72382]: DEBUG os_brick.utils [None req-d429602e-e6b7-4d94-866c-523e1be5ccb1 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d2cfa7015fe', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 15:30:51 user nova-compute[72382]: DEBUG nova.virt.block_device [None req-d429602e-e6b7-4d94-866c-523e1be5ccb1 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: 94c8cc29-3300-475f-aca0-40fa0e58cd66] Updating existing volume attachment record: 88d66d37-8992-42ad-9ced-71500c7f0128 {{(pid=72382) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 15:30:52 user nova-compute[72382]: DEBUG nova.virt.driver [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Emitting event <LifecycleEvent: 1691595052.1186373, 4ccbfda2-8bcd-4ec1-972a-cf49a62b1583 => Resumed> {{(pid=72382) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 15:30:52 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 4ccbfda2-8bcd-4ec1-972a-cf49a62b1583] VM Resumed (Lifecycle Event)
Aug 09 15:30:52 user nova-compute[72382]: DEBUG nova.compute.manager [None req-286a634f-19ad-4afb-b53d-04ce872d75dc tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] [instance: 4ccbfda2-8bcd-4ec1-972a-cf49a62b1583] Instance event wait completed in 0 seconds for  {{(pid=72382) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 15:30:52 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-286a634f-19ad-4afb-b53d-04ce872d75dc tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] [instance: 4ccbfda2-8bcd-4ec1-972a-cf49a62b1583] Guest created on hypervisor {{(pid=72382) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 15:30:52 user nova-compute[72382]: INFO nova.virt.libvirt.driver [-] [instance: 4ccbfda2-8bcd-4ec1-972a-cf49a62b1583] Instance spawned successfully.
Aug 09 15:30:52 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-286a634f-19ad-4afb-b53d-04ce872d75dc tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] [instance: 4ccbfda2-8bcd-4ec1-972a-cf49a62b1583] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 15:30:52 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 4ccbfda2-8bcd-4ec1-972a-cf49a62b1583] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:30:52 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 4ccbfda2-8bcd-4ec1-972a-cf49a62b1583] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=72382) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 15:30:52 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 4ccbfda2-8bcd-4ec1-972a-cf49a62b1583] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 09 15:30:52 user nova-compute[72382]: DEBUG nova.virt.driver [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Emitting event <LifecycleEvent: 1691595052.1250021, 4ccbfda2-8bcd-4ec1-972a-cf49a62b1583 => Started> {{(pid=72382) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 15:30:52 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 4ccbfda2-8bcd-4ec1-972a-cf49a62b1583] VM Started (Lifecycle Event)
Aug 09 15:30:52 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-286a634f-19ad-4afb-b53d-04ce872d75dc tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] [instance: 4ccbfda2-8bcd-4ec1-972a-cf49a62b1583] Found default for hw_cdrom_bus of ide {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:30:52 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-286a634f-19ad-4afb-b53d-04ce872d75dc tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] [instance: 4ccbfda2-8bcd-4ec1-972a-cf49a62b1583] Found default for hw_disk_bus of virtio {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:30:52 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-286a634f-19ad-4afb-b53d-04ce872d75dc tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] [instance: 4ccbfda2-8bcd-4ec1-972a-cf49a62b1583] Found default for hw_input_bus of None {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:30:52 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-286a634f-19ad-4afb-b53d-04ce872d75dc tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] [instance: 4ccbfda2-8bcd-4ec1-972a-cf49a62b1583] Found default for hw_pointer_model of None {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:30:52 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-286a634f-19ad-4afb-b53d-04ce872d75dc tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] [instance: 4ccbfda2-8bcd-4ec1-972a-cf49a62b1583] Found default for hw_video_model of virtio {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:30:52 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-286a634f-19ad-4afb-b53d-04ce872d75dc tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] [instance: 4ccbfda2-8bcd-4ec1-972a-cf49a62b1583] Found default for hw_vif_model of virtio {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:30:52 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 4ccbfda2-8bcd-4ec1-972a-cf49a62b1583] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:30:52 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 4ccbfda2-8bcd-4ec1-972a-cf49a62b1583] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=72382) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 15:30:52 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 4ccbfda2-8bcd-4ec1-972a-cf49a62b1583] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 09 15:30:52 user nova-compute[72382]: DEBUG nova.compute.manager [None req-286a634f-19ad-4afb-b53d-04ce872d75dc tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] [instance: 4ccbfda2-8bcd-4ec1-972a-cf49a62b1583] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:30:52 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-286a634f-19ad-4afb-b53d-04ce872d75dc tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:30:52 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-286a634f-19ad-4afb-b53d-04ce872d75dc tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:30:52 user nova-compute[72382]: DEBUG nova.objects.instance [None req-286a634f-19ad-4afb-b53d-04ce872d75dc tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] [instance: 4ccbfda2-8bcd-4ec1-972a-cf49a62b1583] Trying to apply a migration context that does not seem to be set for this instance {{(pid=72382) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Aug 09 15:30:52 user nova-compute[72382]: DEBUG nova.compute.manager [req-0b5b0ae5-efc8-49cf-8718-2368802fc0f4 req-fab6214a-634f-4b7d-8460-1723adb3a028 service nova] [instance: 4ccbfda2-8bcd-4ec1-972a-cf49a62b1583] Received event network-vif-plugged-2d07e6a3-03b7-4035-bdd2-a95435b99852 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:30:52 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-0b5b0ae5-efc8-49cf-8718-2368802fc0f4 req-fab6214a-634f-4b7d-8460-1723adb3a028 service nova] Acquiring lock "4ccbfda2-8bcd-4ec1-972a-cf49a62b1583-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:30:52 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-0b5b0ae5-efc8-49cf-8718-2368802fc0f4 req-fab6214a-634f-4b7d-8460-1723adb3a028 service nova] Lock "4ccbfda2-8bcd-4ec1-972a-cf49a62b1583-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:30:52 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-0b5b0ae5-efc8-49cf-8718-2368802fc0f4 req-fab6214a-634f-4b7d-8460-1723adb3a028 service nova] Lock "4ccbfda2-8bcd-4ec1-972a-cf49a62b1583-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:30:52 user nova-compute[72382]: DEBUG nova.compute.manager [req-0b5b0ae5-efc8-49cf-8718-2368802fc0f4 req-fab6214a-634f-4b7d-8460-1723adb3a028 service nova] [instance: 4ccbfda2-8bcd-4ec1-972a-cf49a62b1583] No waiting events found dispatching network-vif-plugged-2d07e6a3-03b7-4035-bdd2-a95435b99852 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:30:52 user nova-compute[72382]: WARNING nova.compute.manager [req-0b5b0ae5-efc8-49cf-8718-2368802fc0f4 req-fab6214a-634f-4b7d-8460-1723adb3a028 service nova] [instance: 4ccbfda2-8bcd-4ec1-972a-cf49a62b1583] Received unexpected event network-vif-plugged-2d07e6a3-03b7-4035-bdd2-a95435b99852 for instance with vm_state active and task_state None.
Aug 09 15:30:52 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-286a634f-19ad-4afb-b53d-04ce872d75dc tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.078s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:30:52 user nova-compute[72382]: DEBUG nova.network.neutron [None req-d429602e-e6b7-4d94-866c-523e1be5ccb1 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: 94c8cc29-3300-475f-aca0-40fa0e58cd66] Successfully created port: ae7204a8-8b63-4d77-933c-00e37a89a187 {{(pid=72382) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 15:30:53 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:30:53 user nova-compute[72382]: DEBUG nova.network.neutron [None req-d429602e-e6b7-4d94-866c-523e1be5ccb1 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: 94c8cc29-3300-475f-aca0-40fa0e58cd66] Successfully updated port: ae7204a8-8b63-4d77-933c-00e37a89a187 {{(pid=72382) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 15:30:53 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-d429602e-e6b7-4d94-866c-523e1be5ccb1 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Acquiring lock "refresh_cache-94c8cc29-3300-475f-aca0-40fa0e58cd66" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 15:30:53 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-d429602e-e6b7-4d94-866c-523e1be5ccb1 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Acquired lock "refresh_cache-94c8cc29-3300-475f-aca0-40fa0e58cd66" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 15:30:53 user nova-compute[72382]: DEBUG nova.network.neutron [None req-d429602e-e6b7-4d94-866c-523e1be5ccb1 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: 94c8cc29-3300-475f-aca0-40fa0e58cd66] Building network info cache for instance {{(pid=72382) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 15:30:53 user nova-compute[72382]: DEBUG nova.network.neutron [None req-d429602e-e6b7-4d94-866c-523e1be5ccb1 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: 94c8cc29-3300-475f-aca0-40fa0e58cd66] Instance cache missing network info. {{(pid=72382) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 15:30:54 user nova-compute[72382]: DEBUG nova.network.neutron [None req-d429602e-e6b7-4d94-866c-523e1be5ccb1 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: 94c8cc29-3300-475f-aca0-40fa0e58cd66] Updating instance_info_cache with network_info: [{"id": "ae7204a8-8b63-4d77-933c-00e37a89a187", "address": "fa:16:3e:a9:9b:f8", "network": {"id": "a78e6cb6-feb7-4f64-a3c0-4900594b6e37", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-338007968-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70310b1af40b4d239fe5ea362972554b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae7204a8-8b", "ovs_interfaceid": "ae7204a8-8b63-4d77-933c-00e37a89a187", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:30:54 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-d429602e-e6b7-4d94-866c-523e1be5ccb1 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Releasing lock "refresh_cache-94c8cc29-3300-475f-aca0-40fa0e58cd66" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 15:30:54 user nova-compute[72382]: DEBUG nova.compute.manager [None req-d429602e-e6b7-4d94-866c-523e1be5ccb1 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: 94c8cc29-3300-475f-aca0-40fa0e58cd66] Instance network_info: |[{"id": "ae7204a8-8b63-4d77-933c-00e37a89a187", "address": "fa:16:3e:a9:9b:f8", "network": {"id": "a78e6cb6-feb7-4f64-a3c0-4900594b6e37", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-338007968-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70310b1af40b4d239fe5ea362972554b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae7204a8-8b", "ovs_interfaceid": "ae7204a8-8b63-4d77-933c-00e37a89a187", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72382) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 15:30:54 user nova-compute[72382]: DEBUG nova.compute.manager [req-c187e369-a117-4c1f-9f37-0d8d19856190 req-eec2bfef-9874-44ab-98a8-436a3a940e00 service nova] [instance: 94c8cc29-3300-475f-aca0-40fa0e58cd66] Received event network-changed-ae7204a8-8b63-4d77-933c-00e37a89a187 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:30:54 user nova-compute[72382]: DEBUG nova.compute.manager [req-c187e369-a117-4c1f-9f37-0d8d19856190 req-eec2bfef-9874-44ab-98a8-436a3a940e00 service nova] [instance: 94c8cc29-3300-475f-aca0-40fa0e58cd66] Refreshing instance network info cache due to event network-changed-ae7204a8-8b63-4d77-933c-00e37a89a187. {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 15:30:54 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-c187e369-a117-4c1f-9f37-0d8d19856190 req-eec2bfef-9874-44ab-98a8-436a3a940e00 service nova] Acquiring lock "refresh_cache-94c8cc29-3300-475f-aca0-40fa0e58cd66" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 15:30:54 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-c187e369-a117-4c1f-9f37-0d8d19856190 req-eec2bfef-9874-44ab-98a8-436a3a940e00 service nova] Acquired lock "refresh_cache-94c8cc29-3300-475f-aca0-40fa0e58cd66" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 15:30:54 user nova-compute[72382]: DEBUG nova.network.neutron [req-c187e369-a117-4c1f-9f37-0d8d19856190 req-eec2bfef-9874-44ab-98a8-436a3a940e00 service nova] [instance: 94c8cc29-3300-475f-aca0-40fa0e58cd66] Refreshing network info cache for port ae7204a8-8b63-4d77-933c-00e37a89a187 {{(pid=72382) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 15:30:54 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:30:54 user nova-compute[72382]: DEBUG nova.network.neutron [req-c187e369-a117-4c1f-9f37-0d8d19856190 req-eec2bfef-9874-44ab-98a8-436a3a940e00 service nova] [instance: 94c8cc29-3300-475f-aca0-40fa0e58cd66] Updated VIF entry in instance network info cache for port ae7204a8-8b63-4d77-933c-00e37a89a187. {{(pid=72382) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 15:30:54 user nova-compute[72382]: DEBUG nova.network.neutron [req-c187e369-a117-4c1f-9f37-0d8d19856190 req-eec2bfef-9874-44ab-98a8-436a3a940e00 service nova] [instance: 94c8cc29-3300-475f-aca0-40fa0e58cd66] Updating instance_info_cache with network_info: [{"id": "ae7204a8-8b63-4d77-933c-00e37a89a187", "address": "fa:16:3e:a9:9b:f8", "network": {"id": "a78e6cb6-feb7-4f64-a3c0-4900594b6e37", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-338007968-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70310b1af40b4d239fe5ea362972554b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae7204a8-8b", "ovs_interfaceid": "ae7204a8-8b63-4d77-933c-00e37a89a187", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:30:54 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-c187e369-a117-4c1f-9f37-0d8d19856190 req-eec2bfef-9874-44ab-98a8-436a3a940e00 service nova] Releasing lock "refresh_cache-94c8cc29-3300-475f-aca0-40fa0e58cd66" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 15:30:57 user nova-compute[72382]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691595042.0367942, e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0 => Stopped> {{(pid=72382) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 15:30:57 user nova-compute[72382]: INFO nova.compute.manager [-] [instance: e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0] VM Stopped (Lifecycle Event)
Aug 09 15:30:57 user nova-compute[72382]: DEBUG nova.compute.manager [None req-a68bdcc0-ba49-4d80-be28-2397778f18d5 None None] [instance: e3b12a96-1d5e-46f3-9d28-bee6ba58e6b0] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:30:58 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-1f71d7c1-3a6b-4c05-adc9-fc0c53630a2f tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] Acquiring lock "8f744a7d-9eed-40e1-9422-670970c209ce" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:30:58 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-1f71d7c1-3a6b-4c05-adc9-fc0c53630a2f tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] Lock "8f744a7d-9eed-40e1-9422-670970c209ce" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:30:58 user nova-compute[72382]: DEBUG nova.compute.manager [None req-1f71d7c1-3a6b-4c05-adc9-fc0c53630a2f tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] [instance: 8f744a7d-9eed-40e1-9422-670970c209ce] Starting instance... {{(pid=72382) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 15:30:58 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-1f71d7c1-3a6b-4c05-adc9-fc0c53630a2f tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:30:58 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-1f71d7c1-3a6b-4c05-adc9-fc0c53630a2f tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:30:58 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-1f71d7c1-3a6b-4c05-adc9-fc0c53630a2f tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72382) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 15:30:58 user nova-compute[72382]: INFO nova.compute.claims [None req-1f71d7c1-3a6b-4c05-adc9-fc0c53630a2f tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] [instance: 8f744a7d-9eed-40e1-9422-670970c209ce] Claim successful on node user
Aug 09 15:30:58 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:30:58 user nova-compute[72382]: DEBUG nova.compute.provider_tree [None req-1f71d7c1-3a6b-4c05-adc9-fc0c53630a2f tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] Inventory has not changed in ProviderTree for provider: 7b15b0e5-df4d-49db-833b-2855d21d10ae {{(pid=72382) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 15:30:58 user nova-compute[72382]: DEBUG nova.scheduler.client.report [None req-1f71d7c1-3a6b-4c05-adc9-fc0c53630a2f tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] Inventory has not changed for provider 7b15b0e5-df4d-49db-833b-2855d21d10ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72382) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 15:30:58 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-1f71d7c1-3a6b-4c05-adc9-fc0c53630a2f tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.411s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:30:58 user nova-compute[72382]: DEBUG nova.compute.manager [None req-1f71d7c1-3a6b-4c05-adc9-fc0c53630a2f tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] [instance: 8f744a7d-9eed-40e1-9422-670970c209ce] Start building networks asynchronously for instance. {{(pid=72382) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 15:30:58 user nova-compute[72382]: DEBUG nova.compute.manager [None req-1f71d7c1-3a6b-4c05-adc9-fc0c53630a2f tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] [instance: 8f744a7d-9eed-40e1-9422-670970c209ce] Allocating IP information in the background. {{(pid=72382) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 15:30:58 user nova-compute[72382]: DEBUG nova.network.neutron [None req-1f71d7c1-3a6b-4c05-adc9-fc0c53630a2f tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] [instance: 8f744a7d-9eed-40e1-9422-670970c209ce] allocate_for_instance() {{(pid=72382) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 15:30:58 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-1f71d7c1-3a6b-4c05-adc9-fc0c53630a2f tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] [instance: 8f744a7d-9eed-40e1-9422-670970c209ce] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 15:30:58 user nova-compute[72382]: DEBUG nova.compute.manager [None req-1f71d7c1-3a6b-4c05-adc9-fc0c53630a2f tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] [instance: 8f744a7d-9eed-40e1-9422-670970c209ce] Start building block device mappings for instance. {{(pid=72382) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 15:30:58 user nova-compute[72382]: DEBUG nova.policy [None req-1f71d7c1-3a6b-4c05-adc9-fc0c53630a2f tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '04ecf94b76144c64b2ca5ecc7932dd32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9949fc5e9167457d8c7a455350936255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72382) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 15:30:58 user nova-compute[72382]: DEBUG nova.compute.manager [None req-1f71d7c1-3a6b-4c05-adc9-fc0c53630a2f tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] [instance: 8f744a7d-9eed-40e1-9422-670970c209ce] Start spawning the instance on the hypervisor. {{(pid=72382) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 15:30:58 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-1f71d7c1-3a6b-4c05-adc9-fc0c53630a2f tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] [instance: 8f744a7d-9eed-40e1-9422-670970c209ce] Creating instance directory {{(pid=72382) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 15:30:58 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-1f71d7c1-3a6b-4c05-adc9-fc0c53630a2f tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] [instance: 8f744a7d-9eed-40e1-9422-670970c209ce] Creating image(s)
Aug 09 15:30:58 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-1f71d7c1-3a6b-4c05-adc9-fc0c53630a2f tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] Acquiring lock "/opt/stack/data/nova/instances/8f744a7d-9eed-40e1-9422-670970c209ce/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:30:58 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-1f71d7c1-3a6b-4c05-adc9-fc0c53630a2f tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] Lock "/opt/stack/data/nova/instances/8f744a7d-9eed-40e1-9422-670970c209ce/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:30:58 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-1f71d7c1-3a6b-4c05-adc9-fc0c53630a2f tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] Lock "/opt/stack/data/nova/instances/8f744a7d-9eed-40e1-9422-670970c209ce/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:30:58 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-1f71d7c1-3a6b-4c05-adc9-fc0c53630a2f tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:30:59 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-1f71d7c1-3a6b-4c05-adc9-fc0c53630a2f tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b --force-share --output=json" returned: 0 in 0.145s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:30:59 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-1f71d7c1-3a6b-4c05-adc9-fc0c53630a2f tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] Acquiring lock "383812ff437283e0191ed5b9ecc04c27f1162b0b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:30:59 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-1f71d7c1-3a6b-4c05-adc9-fc0c53630a2f tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] Lock "383812ff437283e0191ed5b9ecc04c27f1162b0b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:30:59 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-1f71d7c1-3a6b-4c05-adc9-fc0c53630a2f tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:30:59 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-1f71d7c1-3a6b-4c05-adc9-fc0c53630a2f tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b --force-share --output=json" returned: 0 in 0.166s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:30:59 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-1f71d7c1-3a6b-4c05-adc9-fc0c53630a2f tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b,backing_fmt=raw /opt/stack/data/nova/instances/8f744a7d-9eed-40e1-9422-670970c209ce/disk 1073741824 {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:30:59 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-1f71d7c1-3a6b-4c05-adc9-fc0c53630a2f tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b,backing_fmt=raw /opt/stack/data/nova/instances/8f744a7d-9eed-40e1-9422-670970c209ce/disk 1073741824" returned: 0 in 0.055s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:30:59 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-1f71d7c1-3a6b-4c05-adc9-fc0c53630a2f tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] Lock "383812ff437283e0191ed5b9ecc04c27f1162b0b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.229s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:30:59 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-1f71d7c1-3a6b-4c05-adc9-fc0c53630a2f tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:30:59 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-1f71d7c1-3a6b-4c05-adc9-fc0c53630a2f tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b --force-share --output=json" returned: 0 in 0.154s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:30:59 user nova-compute[72382]: DEBUG nova.virt.disk.api [None req-1f71d7c1-3a6b-4c05-adc9-fc0c53630a2f tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8f744a7d-9eed-40e1-9422-670970c209ce/disk. size=1073741824 {{(pid=72382) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 15:30:59 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-1f71d7c1-3a6b-4c05-adc9-fc0c53630a2f tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f744a7d-9eed-40e1-9422-670970c209ce/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:30:59 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:30:59 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-1f71d7c1-3a6b-4c05-adc9-fc0c53630a2f tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f744a7d-9eed-40e1-9422-670970c209ce/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:30:59 user nova-compute[72382]: DEBUG nova.virt.disk.api [None req-1f71d7c1-3a6b-4c05-adc9-fc0c53630a2f tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] Cannot resize image /opt/stack/data/nova/instances/8f744a7d-9eed-40e1-9422-670970c209ce/disk to a smaller size. {{(pid=72382) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 15:30:59 user nova-compute[72382]: DEBUG nova.objects.instance [None req-1f71d7c1-3a6b-4c05-adc9-fc0c53630a2f tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] Lazy-loading 'migration_context' on Instance uuid 8f744a7d-9eed-40e1-9422-670970c209ce {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:30:59 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-1f71d7c1-3a6b-4c05-adc9-fc0c53630a2f tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] [instance: 8f744a7d-9eed-40e1-9422-670970c209ce] Created local disks {{(pid=72382) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 15:30:59 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-1f71d7c1-3a6b-4c05-adc9-fc0c53630a2f tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] [instance: 8f744a7d-9eed-40e1-9422-670970c209ce] Ensure instance console log exists: /opt/stack/data/nova/instances/8f744a7d-9eed-40e1-9422-670970c209ce/console.log {{(pid=72382) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 15:30:59 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-1f71d7c1-3a6b-4c05-adc9-fc0c53630a2f tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:30:59 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-1f71d7c1-3a6b-4c05-adc9-fc0c53630a2f tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:30:59 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-1f71d7c1-3a6b-4c05-adc9-fc0c53630a2f tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:30:59 user nova-compute[72382]: DEBUG nova.network.neutron [None req-1f71d7c1-3a6b-4c05-adc9-fc0c53630a2f tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] [instance: 8f744a7d-9eed-40e1-9422-670970c209ce] Successfully created port: d16436a7-9589-443b-be99-e54349a50e25 {{(pid=72382) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 15:31:00 user nova-compute[72382]: DEBUG nova.network.neutron [None req-1f71d7c1-3a6b-4c05-adc9-fc0c53630a2f tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] [instance: 8f744a7d-9eed-40e1-9422-670970c209ce] Successfully updated port: d16436a7-9589-443b-be99-e54349a50e25 {{(pid=72382) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 15:31:00 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-1f71d7c1-3a6b-4c05-adc9-fc0c53630a2f tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] Acquiring lock "refresh_cache-8f744a7d-9eed-40e1-9422-670970c209ce" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 15:31:00 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-1f71d7c1-3a6b-4c05-adc9-fc0c53630a2f tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] Acquired lock "refresh_cache-8f744a7d-9eed-40e1-9422-670970c209ce" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 15:31:00 user nova-compute[72382]: DEBUG nova.network.neutron [None req-1f71d7c1-3a6b-4c05-adc9-fc0c53630a2f tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] [instance: 8f744a7d-9eed-40e1-9422-670970c209ce] Building network info cache for instance {{(pid=72382) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 15:31:00 user nova-compute[72382]: DEBUG nova.compute.manager [req-4f43c20c-990f-4a7a-84dd-4c963fb4204c req-bef1725a-1e8c-4e47-912a-bedf9e1b2fdd service nova] [instance: 8f744a7d-9eed-40e1-9422-670970c209ce] Received event network-changed-d16436a7-9589-443b-be99-e54349a50e25 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:31:00 user nova-compute[72382]: DEBUG nova.compute.manager [req-4f43c20c-990f-4a7a-84dd-4c963fb4204c req-bef1725a-1e8c-4e47-912a-bedf9e1b2fdd service nova] [instance: 8f744a7d-9eed-40e1-9422-670970c209ce] Refreshing instance network info cache due to event network-changed-d16436a7-9589-443b-be99-e54349a50e25. {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 15:31:00 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-4f43c20c-990f-4a7a-84dd-4c963fb4204c req-bef1725a-1e8c-4e47-912a-bedf9e1b2fdd service nova] Acquiring lock "refresh_cache-8f744a7d-9eed-40e1-9422-670970c209ce" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 15:31:00 user nova-compute[72382]: DEBUG nova.network.neutron [None req-1f71d7c1-3a6b-4c05-adc9-fc0c53630a2f tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] [instance: 8f744a7d-9eed-40e1-9422-670970c209ce] Instance cache missing network info. {{(pid=72382) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 15:31:00 user nova-compute[72382]: DEBUG nova.network.neutron [None req-1f71d7c1-3a6b-4c05-adc9-fc0c53630a2f tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] [instance: 8f744a7d-9eed-40e1-9422-670970c209ce] Updating instance_info_cache with network_info: [{"id": "d16436a7-9589-443b-be99-e54349a50e25", "address": "fa:16:3e:fe:d6:7a", "network": {"id": "1b9920a2-9613-4741-a0c0-72172380b365", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-455407214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9949fc5e9167457d8c7a455350936255", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd16436a7-95", "ovs_interfaceid": "d16436a7-9589-443b-be99-e54349a50e25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:31:00 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-1f71d7c1-3a6b-4c05-adc9-fc0c53630a2f tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] Releasing lock "refresh_cache-8f744a7d-9eed-40e1-9422-670970c209ce" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 15:31:00 user nova-compute[72382]: DEBUG nova.compute.manager [None req-1f71d7c1-3a6b-4c05-adc9-fc0c53630a2f tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] [instance: 8f744a7d-9eed-40e1-9422-670970c209ce] Instance network_info: |[{"id": "d16436a7-9589-443b-be99-e54349a50e25", "address": "fa:16:3e:fe:d6:7a", "network": {"id": "1b9920a2-9613-4741-a0c0-72172380b365", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-455407214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9949fc5e9167457d8c7a455350936255", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd16436a7-95", "ovs_interfaceid": "d16436a7-9589-443b-be99-e54349a50e25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72382) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 15:31:00 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-4f43c20c-990f-4a7a-84dd-4c963fb4204c req-bef1725a-1e8c-4e47-912a-bedf9e1b2fdd service nova] Acquired lock "refresh_cache-8f744a7d-9eed-40e1-9422-670970c209ce" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 15:31:00 user nova-compute[72382]: DEBUG nova.network.neutron [req-4f43c20c-990f-4a7a-84dd-4c963fb4204c req-bef1725a-1e8c-4e47-912a-bedf9e1b2fdd service nova] [instance: 8f744a7d-9eed-40e1-9422-670970c209ce] Refreshing network info cache for port d16436a7-9589-443b-be99-e54349a50e25 {{(pid=72382) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 15:31:00 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-1f71d7c1-3a6b-4c05-adc9-fc0c53630a2f tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] [instance: 8f744a7d-9eed-40e1-9422-670970c209ce] Start _get_guest_xml network_info=[{"id": "d16436a7-9589-443b-be99-e54349a50e25", "address": "fa:16:3e:fe:d6:7a", "network": {"id": "1b9920a2-9613-4741-a0c0-72172380b365", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-455407214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9949fc5e9167457d8c7a455350936255", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd16436a7-95", "ovs_interfaceid": "d16436a7-9589-443b-be99-e54349a50e25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T15:11:25Z,direct_url=<?>,disk_format='qcow2',id=a79f2cea-eb27-4631-aaf3-05e7d9e411b4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a638990e12cc4d6eabb6d55e13be6bdf',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T15:11:27Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'a79f2cea-eb27-4631-aaf3-05e7d9e411b4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72382) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 15:31:00 user nova-compute[72382]: WARNING nova.virt.libvirt.driver [None req-1f71d7c1-3a6b-4c05-adc9-fc0c53630a2f tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 15:31:00 user nova-compute[72382]: WARNING nova.virt.libvirt.driver [None req-1f71d7c1-3a6b-4c05-adc9-fc0c53630a2f tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 15:31:00 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-1f71d7c1-3a6b-4c05-adc9-fc0c53630a2f tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72382) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 15:31:00 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-1f71d7c1-3a6b-4c05-adc9-fc0c53630a2f tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] CPU controller missing on host. {{(pid=72382) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 15:31:00 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-1f71d7c1-3a6b-4c05-adc9-fc0c53630a2f tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72382) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 15:31:00 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-1f71d7c1-3a6b-4c05-adc9-fc0c53630a2f tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] CPU controller found on host. {{(pid=72382) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 15:31:00 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-1f71d7c1-3a6b-4c05-adc9-fc0c53630a2f tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72382) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 15:31:00 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-1f71d7c1-3a6b-4c05-adc9-fc0c53630a2f tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T15:11:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T15:11:25Z,direct_url=<?>,disk_format='qcow2',id=a79f2cea-eb27-4631-aaf3-05e7d9e411b4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a638990e12cc4d6eabb6d55e13be6bdf',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T15:11:27Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 15:31:00 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-1f71d7c1-3a6b-4c05-adc9-fc0c53630a2f tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] Flavor limits 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 15:31:00 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-1f71d7c1-3a6b-4c05-adc9-fc0c53630a2f tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] Image limits 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 15:31:00 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-1f71d7c1-3a6b-4c05-adc9-fc0c53630a2f tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] Flavor pref 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 15:31:00 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-1f71d7c1-3a6b-4c05-adc9-fc0c53630a2f tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] Image pref 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 15:31:00 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-1f71d7c1-3a6b-4c05-adc9-fc0c53630a2f tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 15:31:00 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-1f71d7c1-3a6b-4c05-adc9-fc0c53630a2f tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 15:31:00 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-1f71d7c1-3a6b-4c05-adc9-fc0c53630a2f tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72382) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 15:31:00 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-1f71d7c1-3a6b-4c05-adc9-fc0c53630a2f tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] Got 1 possible topologies {{(pid=72382) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 15:31:00 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-1f71d7c1-3a6b-4c05-adc9-fc0c53630a2f tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 15:31:00 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-1f71d7c1-3a6b-4c05-adc9-fc0c53630a2f tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 15:31:00 user nova-compute[72382]: DEBUG nova.virt.libvirt.vif [None req-1f71d7c1-3a6b-4c05-adc9-fc0c53630a2f tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T15:30:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1655341398',display_name='tempest-VolumesSnapshotTestJSON-instance-1655341398',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1655341398',id=34,image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCx3FVtbsUX6VoJeSGntdLRg8iTXCOkOWfQ4VtB6Jg47p7YN/YqgfESqGNRCUR+ihiyAScbyBAWinxQ5X4NrK/6rPoWezJxHK2M/LLOuirATIm5AXGMrQ5gpVYExq/BUUg==',key_name='tempest-keypair-1331055543',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9949fc5e9167457d8c7a455350936255',ramdisk_id='',reservation_id='r-jp0ercp7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-985960330',owner_user_name='tempest-VolumesSnapshotTestJSON-985960330-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T15:30:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='04ecf94b76144c64b2ca5ecc7932dd32',uuid=8f744a7d-9eed-40e1-9422-670970c209ce,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d16436a7-9589-443b-be99-e54349a50e25", "address": "fa:16:3e:fe:d6:7a", "network": {"id": "1b9920a2-9613-4741-a0c0-72172380b365", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-455407214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9949fc5e9167457d8c7a455350936255", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd16436a7-95", "ovs_interfaceid": "d16436a7-9589-443b-be99-e54349a50e25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72382) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 15:31:00 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-1f71d7c1-3a6b-4c05-adc9-fc0c53630a2f tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] Converting VIF {"id": "d16436a7-9589-443b-be99-e54349a50e25", "address": "fa:16:3e:fe:d6:7a", "network": {"id": "1b9920a2-9613-4741-a0c0-72172380b365", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-455407214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9949fc5e9167457d8c7a455350936255", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd16436a7-95", "ovs_interfaceid": "d16436a7-9589-443b-be99-e54349a50e25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 15:31:00 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-1f71d7c1-3a6b-4c05-adc9-fc0c53630a2f tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fe:d6:7a,bridge_name='br-int',has_traffic_filtering=True,id=d16436a7-9589-443b-be99-e54349a50e25,network=Network(1b9920a2-9613-4741-a0c0-72172380b365),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd16436a7-95') {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 15:31:00 user nova-compute[72382]: DEBUG nova.objects.instance [None req-1f71d7c1-3a6b-4c05-adc9-fc0c53630a2f tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] Lazy-loading 'pci_devices' on Instance uuid 8f744a7d-9eed-40e1-9422-670970c209ce {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:31:00 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-1f71d7c1-3a6b-4c05-adc9-fc0c53630a2f tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] [instance: 8f744a7d-9eed-40e1-9422-670970c209ce] End _get_guest_xml xml=<domain type="kvm">
Aug 09 15:31:00 user nova-compute[72382]:   <uuid>8f744a7d-9eed-40e1-9422-670970c209ce</uuid>
Aug 09 15:31:00 user nova-compute[72382]:   <name>instance-00000022</name>
Aug 09 15:31:00 user nova-compute[72382]:   <memory>524288</memory>
Aug 09 15:31:00 user nova-compute[72382]:   <vcpu>1</vcpu>
Aug 09 15:31:00 user nova-compute[72382]:   <metadata>
Aug 09 15:31:00 user nova-compute[72382]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 15:31:00 user nova-compute[72382]:       <nova:package version="0.0.0"/>
Aug 09 15:31:00 user nova-compute[72382]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1655341398</nova:name>
Aug 09 15:31:00 user nova-compute[72382]:       <nova:creationTime>2023-08-09 15:31:00</nova:creationTime>
Aug 09 15:31:00 user nova-compute[72382]:       <nova:flavor name="m1.tiny">
Aug 09 15:31:00 user nova-compute[72382]:         <nova:memory>512</nova:memory>
Aug 09 15:31:00 user nova-compute[72382]:         <nova:disk>1</nova:disk>
Aug 09 15:31:00 user nova-compute[72382]:         <nova:swap>0</nova:swap>
Aug 09 15:31:00 user nova-compute[72382]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 15:31:00 user nova-compute[72382]:         <nova:vcpus>1</nova:vcpus>
Aug 09 15:31:00 user nova-compute[72382]:       </nova:flavor>
Aug 09 15:31:00 user nova-compute[72382]:       <nova:owner>
Aug 09 15:31:00 user nova-compute[72382]:         <nova:user uuid="04ecf94b76144c64b2ca5ecc7932dd32">tempest-VolumesSnapshotTestJSON-985960330-project-member</nova:user>
Aug 09 15:31:00 user nova-compute[72382]:         <nova:project uuid="9949fc5e9167457d8c7a455350936255">tempest-VolumesSnapshotTestJSON-985960330</nova:project>
Aug 09 15:31:00 user nova-compute[72382]:       </nova:owner>
Aug 09 15:31:00 user nova-compute[72382]:       <nova:root type="image" uuid="a79f2cea-eb27-4631-aaf3-05e7d9e411b4"/>
Aug 09 15:31:00 user nova-compute[72382]:       <nova:ports>
Aug 09 15:31:00 user nova-compute[72382]:         <nova:port uuid="d16436a7-9589-443b-be99-e54349a50e25">
Aug 09 15:31:00 user nova-compute[72382]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 09 15:31:00 user nova-compute[72382]:         </nova:port>
Aug 09 15:31:00 user nova-compute[72382]:       </nova:ports>
Aug 09 15:31:00 user nova-compute[72382]:     </nova:instance>
Aug 09 15:31:00 user nova-compute[72382]:   </metadata>
Aug 09 15:31:00 user nova-compute[72382]:   <sysinfo type="smbios">
Aug 09 15:31:00 user nova-compute[72382]:     <system>
Aug 09 15:31:00 user nova-compute[72382]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 15:31:00 user nova-compute[72382]:       <entry name="product">OpenStack Nova</entry>
Aug 09 15:31:00 user nova-compute[72382]:       <entry name="version">0.0.0</entry>
Aug 09 15:31:00 user nova-compute[72382]:       <entry name="serial">8f744a7d-9eed-40e1-9422-670970c209ce</entry>
Aug 09 15:31:00 user nova-compute[72382]:       <entry name="uuid">8f744a7d-9eed-40e1-9422-670970c209ce</entry>
Aug 09 15:31:00 user nova-compute[72382]:       <entry name="family">Virtual Machine</entry>
Aug 09 15:31:00 user nova-compute[72382]:     </system>
Aug 09 15:31:00 user nova-compute[72382]:   </sysinfo>
Aug 09 15:31:00 user nova-compute[72382]:   <os>
Aug 09 15:31:00 user nova-compute[72382]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 15:31:00 user nova-compute[72382]:     <boot dev="hd"/>
Aug 09 15:31:00 user nova-compute[72382]:     <smbios mode="sysinfo"/>
Aug 09 15:31:00 user nova-compute[72382]:   </os>
Aug 09 15:31:00 user nova-compute[72382]:   <features>
Aug 09 15:31:00 user nova-compute[72382]:     <acpi/>
Aug 09 15:31:00 user nova-compute[72382]:     <apic/>
Aug 09 15:31:00 user nova-compute[72382]:     <vmcoreinfo/>
Aug 09 15:31:00 user nova-compute[72382]:   </features>
Aug 09 15:31:00 user nova-compute[72382]:   <clock offset="utc">
Aug 09 15:31:00 user nova-compute[72382]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 15:31:00 user nova-compute[72382]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 15:31:00 user nova-compute[72382]:     <timer name="hpet" present="no"/>
Aug 09 15:31:00 user nova-compute[72382]:   </clock>
Aug 09 15:31:00 user nova-compute[72382]:   <cpu mode="custom" match="exact">
Aug 09 15:31:00 user nova-compute[72382]:     <model>Nehalem</model>
Aug 09 15:31:00 user nova-compute[72382]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 15:31:00 user nova-compute[72382]:   </cpu>
Aug 09 15:31:00 user nova-compute[72382]:   <devices>
Aug 09 15:31:00 user nova-compute[72382]:     <disk type="file" device="disk">
Aug 09 15:31:00 user nova-compute[72382]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 15:31:00 user nova-compute[72382]:       <source file="/opt/stack/data/nova/instances/8f744a7d-9eed-40e1-9422-670970c209ce/disk"/>
Aug 09 15:31:00 user nova-compute[72382]:       <target dev="vda" bus="virtio"/>
Aug 09 15:31:00 user nova-compute[72382]:     </disk>
Aug 09 15:31:00 user nova-compute[72382]:     <interface type="ethernet">
Aug 09 15:31:00 user nova-compute[72382]:       <mac address="fa:16:3e:fe:d6:7a"/>
Aug 09 15:31:00 user nova-compute[72382]:       <model type="virtio"/>
Aug 09 15:31:00 user nova-compute[72382]:       <mtu size="1442"/>
Aug 09 15:31:00 user nova-compute[72382]:       <target dev="tapd16436a7-95"/>
Aug 09 15:31:00 user nova-compute[72382]:     </interface>
Aug 09 15:31:00 user nova-compute[72382]:     <serial type="pty">
Aug 09 15:31:00 user nova-compute[72382]:       <log file="/opt/stack/data/nova/instances/8f744a7d-9eed-40e1-9422-670970c209ce/console.log" append="off"/>
Aug 09 15:31:00 user nova-compute[72382]:     </serial>
Aug 09 15:31:00 user nova-compute[72382]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 15:31:00 user nova-compute[72382]:     <video>
Aug 09 15:31:00 user nova-compute[72382]:       <model type="virtio"/>
Aug 09 15:31:00 user nova-compute[72382]:     </video>
Aug 09 15:31:00 user nova-compute[72382]:     <rng model="virtio">
Aug 09 15:31:00 user nova-compute[72382]:       <backend model="random">/dev/urandom</backend>
Aug 09 15:31:00 user nova-compute[72382]:     </rng>
Aug 09 15:31:00 user nova-compute[72382]:     <controller type="usb" index="0" model="none"/>
Aug 09 15:31:00 user nova-compute[72382]:     <memballoon model="virtio">
Aug 09 15:31:00 user nova-compute[72382]:       <stats period="10"/>
Aug 09 15:31:00 user nova-compute[72382]:     </memballoon>
Aug 09 15:31:00 user nova-compute[72382]:   </devices>
Aug 09 15:31:00 user nova-compute[72382]: </domain>
Aug 09 15:31:00 user nova-compute[72382]:  {{(pid=72382) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 15:31:00 user nova-compute[72382]: DEBUG nova.virt.libvirt.vif [None req-1f71d7c1-3a6b-4c05-adc9-fc0c53630a2f tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T15:30:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1655341398',display_name='tempest-VolumesSnapshotTestJSON-instance-1655341398',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1655341398',id=34,image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCx3FVtbsUX6VoJeSGntdLRg8iTXCOkOWfQ4VtB6Jg47p7YN/YqgfESqGNRCUR+ihiyAScbyBAWinxQ5X4NrK/6rPoWezJxHK2M/LLOuirATIm5AXGMrQ5gpVYExq/BUUg==',key_name='tempest-keypair-1331055543',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9949fc5e9167457d8c7a455350936255',ramdisk_id='',reservation_id='r-jp0ercp7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-985960330',owner_user_name='tempest-VolumesSnapshotTestJSON-985960330-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T15:30:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='04ecf94b76144c64b2ca5ecc7932dd32',uuid=8f744a7d-9eed-40e1-9422-670970c209ce,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d16436a7-9589-443b-be99-e54349a50e25", "address": "fa:16:3e:fe:d6:7a", "network": {"id": "1b9920a2-9613-4741-a0c0-72172380b365", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-455407214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9949fc5e9167457d8c7a455350936255", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd16436a7-95", "ovs_interfaceid": "d16436a7-9589-443b-be99-e54349a50e25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 15:31:00 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-1f71d7c1-3a6b-4c05-adc9-fc0c53630a2f tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] Converting VIF {"id": "d16436a7-9589-443b-be99-e54349a50e25", "address": "fa:16:3e:fe:d6:7a", "network": {"id": "1b9920a2-9613-4741-a0c0-72172380b365", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-455407214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9949fc5e9167457d8c7a455350936255", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd16436a7-95", "ovs_interfaceid": "d16436a7-9589-443b-be99-e54349a50e25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 15:31:00 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-1f71d7c1-3a6b-4c05-adc9-fc0c53630a2f tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fe:d6:7a,bridge_name='br-int',has_traffic_filtering=True,id=d16436a7-9589-443b-be99-e54349a50e25,network=Network(1b9920a2-9613-4741-a0c0-72172380b365),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd16436a7-95') {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 15:31:00 user nova-compute[72382]: DEBUG os_vif [None req-1f71d7c1-3a6b-4c05-adc9-fc0c53630a2f tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fe:d6:7a,bridge_name='br-int',has_traffic_filtering=True,id=d16436a7-9589-443b-be99-e54349a50e25,network=Network(1b9920a2-9613-4741-a0c0-72172380b365),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd16436a7-95') {{(pid=72382) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 15:31:00 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:31:00 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:31:00 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 15:31:00 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:31:00 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd16436a7-95, may_exist=True, interface_attrs={}) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:31:00 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd16436a7-95, col_values=(('external_ids', {'iface-id': 'd16436a7-9589-443b-be99-e54349a50e25', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fe:d6:7a', 'vm-uuid': '8f744a7d-9eed-40e1-9422-670970c209ce'}),), if_exists=True) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:31:00 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:31:00 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:31:00 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:31:00 user nova-compute[72382]: INFO os_vif [None req-1f71d7c1-3a6b-4c05-adc9-fc0c53630a2f tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fe:d6:7a,bridge_name='br-int',has_traffic_filtering=True,id=d16436a7-9589-443b-be99-e54349a50e25,network=Network(1b9920a2-9613-4741-a0c0-72172380b365),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd16436a7-95')
Aug 09 15:31:01 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-1f71d7c1-3a6b-4c05-adc9-fc0c53630a2f tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] No BDM found with device name vda, not building metadata. {{(pid=72382) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 15:31:01 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-1f71d7c1-3a6b-4c05-adc9-fc0c53630a2f tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] No VIF found with MAC fa:16:3e:fe:d6:7a, not building metadata {{(pid=72382) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 15:31:01 user nova-compute[72382]: DEBUG nova.compute.manager [None req-d429602e-e6b7-4d94-866c-523e1be5ccb1 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: 94c8cc29-3300-475f-aca0-40fa0e58cd66] Start spawning the instance on the hypervisor. {{(pid=72382) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 15:31:01 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-d429602e-e6b7-4d94-866c-523e1be5ccb1 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: 94c8cc29-3300-475f-aca0-40fa0e58cd66] Creating instance directory {{(pid=72382) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 15:31:01 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-d429602e-e6b7-4d94-866c-523e1be5ccb1 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: 94c8cc29-3300-475f-aca0-40fa0e58cd66] Creating image(s)
Aug 09 15:31:01 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-d429602e-e6b7-4d94-866c-523e1be5ccb1 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: 94c8cc29-3300-475f-aca0-40fa0e58cd66] Did not create local disks {{(pid=72382) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 09 15:31:01 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-d429602e-e6b7-4d94-866c-523e1be5ccb1 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: 94c8cc29-3300-475f-aca0-40fa0e58cd66] Ensure instance console log exists: /opt/stack/data/nova/instances/94c8cc29-3300-475f-aca0-40fa0e58cd66/console.log {{(pid=72382) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 15:31:01 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-d429602e-e6b7-4d94-866c-523e1be5ccb1 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:31:01 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-d429602e-e6b7-4d94-866c-523e1be5ccb1 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:31:01 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-d429602e-e6b7-4d94-866c-523e1be5ccb1 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:31:01 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-d429602e-e6b7-4d94-866c-523e1be5ccb1 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: 94c8cc29-3300-475f-aca0-40fa0e58cd66] Start _get_guest_xml network_info=[{"id": "ae7204a8-8b63-4d77-933c-00e37a89a187", "address": "fa:16:3e:a9:9b:f8", "network": {"id": "a78e6cb6-feb7-4f64-a3c0-4900594b6e37", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-338007968-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70310b1af40b4d239fe5ea362972554b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae7204a8-8b", "ovs_interfaceid": "ae7204a8-8b63-4d77-933c-00e37a89a187", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:59852df5-d4c8-4f25-8693-36181ff6a447'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wtDgMKZf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '94c8cc29-3300-475f-aca0-40fa0e58cd66', 'attached_at': '', 'detached_at': '', 'volume_id': '59852df5-d4c8-4f25-8693-36181ff6a447', 'serial': '59852df5-d4c8-4f25-8693-36181ff6a447'}, 'disk_bus': 'virtio', 'attachment_id': '88d66d37-8992-42ad-9ced-71500c7f0128', 'delete_on_termination': True, 'volume_type': None} {{(pid=72382) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 15:31:01 user nova-compute[72382]: WARNING nova.virt.libvirt.driver [None req-d429602e-e6b7-4d94-866c-523e1be5ccb1 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 15:31:01 user nova-compute[72382]: WARNING nova.virt.libvirt.driver [None req-d429602e-e6b7-4d94-866c-523e1be5ccb1 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 15:31:01 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-d429602e-e6b7-4d94-866c-523e1be5ccb1 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72382) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 15:31:01 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-d429602e-e6b7-4d94-866c-523e1be5ccb1 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] CPU controller missing on host. {{(pid=72382) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 15:31:01 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-d429602e-e6b7-4d94-866c-523e1be5ccb1 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72382) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 15:31:01 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-d429602e-e6b7-4d94-866c-523e1be5ccb1 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] CPU controller found on host. {{(pid=72382) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 15:31:01 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-d429602e-e6b7-4d94-866c-523e1be5ccb1 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72382) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 15:31:01 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-d429602e-e6b7-4d94-866c-523e1be5ccb1 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T15:11:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 15:31:01 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-d429602e-e6b7-4d94-866c-523e1be5ccb1 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Flavor limits 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 15:31:01 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-d429602e-e6b7-4d94-866c-523e1be5ccb1 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Image limits 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 15:31:01 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-d429602e-e6b7-4d94-866c-523e1be5ccb1 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Flavor pref 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 15:31:01 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-d429602e-e6b7-4d94-866c-523e1be5ccb1 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Image pref 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 15:31:01 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-d429602e-e6b7-4d94-866c-523e1be5ccb1 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 15:31:01 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-d429602e-e6b7-4d94-866c-523e1be5ccb1 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 15:31:01 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-d429602e-e6b7-4d94-866c-523e1be5ccb1 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72382) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 15:31:01 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-d429602e-e6b7-4d94-866c-523e1be5ccb1 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Got 1 possible topologies {{(pid=72382) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 15:31:01 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-d429602e-e6b7-4d94-866c-523e1be5ccb1 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 15:31:01 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-d429602e-e6b7-4d94-866c-523e1be5ccb1 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 15:31:01 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d429602e-e6b7-4d94-866c-523e1be5ccb1 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: 94c8cc29-3300-475f-aca0-40fa0e58cd66] Calling os-brick to attach iSCSI Volume {{(pid=72382) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 15:31:01 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-d429602e-e6b7-4d94-866c-523e1be5ccb1 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2a0c768340>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:59852df5-d4c8-4f25-8693-36181ff6a447'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wtDgMKZf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 15:31:01 user nova-compute[72382]: WARNING os_brick.initiator.connectors.base [None req-d429602e-e6b7-4d94-866c-523e1be5ccb1 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 15:31:01 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-d429602e-e6b7-4d94-866c-523e1be5ccb1 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 15:31:01 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-d429602e-e6b7-4d94-866c-523e1be5ccb1 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 15:31:01 user nova-compute[72382]: WARNING os_brick.initiator.connectors.base [None req-d429602e-e6b7-4d94-866c-523e1be5ccb1 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 15:31:01 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-d429602e-e6b7-4d94-866c-523e1be5ccb1 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:59852df5-d4c8-4f25-8693-36181ff6a447" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 15:31:01 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-d429602e-e6b7-4d94-866c-523e1be5ccb1 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:59852df5-d4c8-4f25-8693-36181ff6a447" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 15:31:01 user nova-compute[72382]: INFO os_brick.initiator.connectors.iscsi [None req-d429602e-e6b7-4d94-866c-523e1be5ccb1 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 15:31:01 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59852df5-d4c8-4f25-8693-36181ff6a447 -p 172.16.0.220:3260 {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:31:01 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59852df5-d4c8-4f25-8693-36181ff6a447 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:31:01 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c3b9cde-01f5-4545-8fcd-541c16f69c2a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:31:01 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-d429602e-e6b7-4d94-866c-523e1be5ccb1 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 15:31:01 user nova-compute[72382]:  {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:31:01 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59852df5-d4c8-4f25-8693-36181ff6a447 -p 172.16.0.220:3260 --interface default --op new {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:31:01 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59852df5-d4c8-4f25-8693-36181ff6a447 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:31:01 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d78bf65-2e12-4d1e-a8eb-5b9f6613a054]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:59852df5-d4c8-4f25-8693-36181ff6a447] added\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:31:01 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-d429602e-e6b7-4d94-866c-523e1be5ccb1 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:59852df5-d4c8-4f25-8693-36181ff6a447] added
Aug 09 15:31:01 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:31:01 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59852df5-d4c8-4f25-8693-36181ff6a447 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:31:01 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59852df5-d4c8-4f25-8693-36181ff6a447 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:31:01 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[8606440c-355d-4b4c-9430-a29b8cdf7ac7]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:31:01 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-d429602e-e6b7-4d94-866c-523e1be5ccb1 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:31:01 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59852df5-d4c8-4f25-8693-36181ff6a447 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:31:01 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59852df5-d4c8-4f25-8693-36181ff6a447 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:31:01 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[da5d5d8a-1883-4195-ad5a-fd41ac4191ab]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:31:01 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-d429602e-e6b7-4d94-866c-523e1be5ccb1 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:31:01 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59852df5-d4c8-4f25-8693-36181ff6a447 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wtDgMKZf {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:31:01 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59852df5-d4c8-4f25-8693-36181ff6a447 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wtDgMKZf" returned: 0 in 0.018s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:31:01 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[898cbaef-2ae8-425d-83b2-4108f508b578]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:31:01 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-d429602e-e6b7-4d94-866c-523e1be5ccb1 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wtDgMKZf'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:31:01 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59852df5-d4c8-4f25-8693-36181ff6a447 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:31:01 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59852df5-d4c8-4f25-8693-36181ff6a447 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:31:01 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[65ca256d-1930-458b-9f3b-fd37a3e47ada]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:31:01 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-d429602e-e6b7-4d94-866c-523e1be5ccb1 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:31:01 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:31:01 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:31:01 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[a44f0741-0af0-4be0-ab51-d945463896b0]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25503c6e-bfc0-4008-846a-8cad783fc0fb (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e62d4416-be8c-4327-9a51-0cc509109c53 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5cfefdb-a454-494f-ab09-acf8644352a3 (non-flash)\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:31:01 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-d429602e-e6b7-4d94-866c-523e1be5ccb1 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)
Aug 09 15:31:01 user nova-compute[72382]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25503c6e-bfc0-4008-846a-8cad783fc0fb (non-flash)
Aug 09 15:31:01 user nova-compute[72382]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e62d4416-be8c-4327-9a51-0cc509109c53 (non-flash)
Aug 09 15:31:01 user nova-compute[72382]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5cfefdb-a454-494f-ab09-acf8644352a3 (non-flash)
Aug 09 15:31:01 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 15:31:01 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-d429602e-e6b7-4d94-866c-523e1be5ccb1 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)
Aug 09 15:31:01 user nova-compute[72382]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25503c6e-bfc0-4008-846a-8cad783fc0fb (non-flash)
Aug 09 15:31:01 user nova-compute[72382]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e62d4416-be8c-4327-9a51-0cc509109c53 (non-flash)
Aug 09 15:31:01 user nova-compute[72382]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5cfefdb-a454-494f-ab09-acf8644352a3 (non-flash)
Aug 09 15:31:01 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 15:31:01 user nova-compute[72382]: DEBUG nova.network.neutron [req-4f43c20c-990f-4a7a-84dd-4c963fb4204c req-bef1725a-1e8c-4e47-912a-bedf9e1b2fdd service nova] [instance: 8f744a7d-9eed-40e1-9422-670970c209ce] Updated VIF entry in instance network info cache for port d16436a7-9589-443b-be99-e54349a50e25. {{(pid=72382) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 15:31:01 user nova-compute[72382]: DEBUG nova.network.neutron [req-4f43c20c-990f-4a7a-84dd-4c963fb4204c req-bef1725a-1e8c-4e47-912a-bedf9e1b2fdd service nova] [instance: 8f744a7d-9eed-40e1-9422-670970c209ce] Updating instance_info_cache with network_info: [{"id": "d16436a7-9589-443b-be99-e54349a50e25", "address": "fa:16:3e:fe:d6:7a", "network": {"id": "1b9920a2-9613-4741-a0c0-72172380b365", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-455407214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9949fc5e9167457d8c7a455350936255", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd16436a7-95", "ovs_interfaceid": "d16436a7-9589-443b-be99-e54349a50e25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:31:01 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-4f43c20c-990f-4a7a-84dd-4c963fb4204c req-bef1725a-1e8c-4e47-912a-bedf9e1b2fdd service nova] Releasing lock "refresh_cache-8f744a7d-9eed-40e1-9422-670970c209ce" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 15:31:01 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59852df5-d4c8-4f25-8693-36181ff6a447 -p 172.16.0.220:3260 --login {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:31:01 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59852df5-d4c8-4f25-8693-36181ff6a447 -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:31:01 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b51d52f-c073-4abc-a251-b39ea9ff5415]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:59852df5-d4c8-4f25-8693-36181ff6a447, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:59852df5-d4c8-4f25-8693-36181ff6a447, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:31:01 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-d429602e-e6b7-4d94-866c-523e1be5ccb1 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:59852df5-d4c8-4f25-8693-36181ff6a447, portal: 172.16.0.220,3260]
Aug 09 15:31:01 user nova-compute[72382]: Login to [iface: default, target: iqn.2010-10.org.openstack:59852df5-d4c8-4f25-8693-36181ff6a447, portal: 172.16.0.220,3260] successful.
Aug 09 15:31:01 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:31:01 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59852df5-d4c8-4f25-8693-36181ff6a447 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:31:01 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59852df5-d4c8-4f25-8693-36181ff6a447 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:31:01 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[03b5adb2-e21f-4f4e-aee3-d4a6c35d7337]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:31:01 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-d429602e-e6b7-4d94-866c-523e1be5ccb1 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:31:01 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:31:01 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:31:01 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c5547d0-6e32-4e56-ba20-3d7283523569]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25503c6e-bfc0-4008-846a-8cad783fc0fb (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e62d4416-be8c-4327-9a51-0cc509109c53 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5cfefdb-a454-494f-ab09-acf8644352a3 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59852df5-d4c8-4f25-8693-36181ff6a447 (non-flash)\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:31:01 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-d429602e-e6b7-4d94-866c-523e1be5ccb1 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)
Aug 09 15:31:01 user nova-compute[72382]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25503c6e-bfc0-4008-846a-8cad783fc0fb (non-flash)
Aug 09 15:31:01 user nova-compute[72382]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e62d4416-be8c-4327-9a51-0cc509109c53 (non-flash)
Aug 09 15:31:01 user nova-compute[72382]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5cfefdb-a454-494f-ab09-acf8644352a3 (non-flash)
Aug 09 15:31:01 user nova-compute[72382]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59852df5-d4c8-4f25-8693-36181ff6a447 (non-flash)
Aug 09 15:31:01 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 15:31:01 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-d429602e-e6b7-4d94-866c-523e1be5ccb1 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)
Aug 09 15:31:01 user nova-compute[72382]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25503c6e-bfc0-4008-846a-8cad783fc0fb (non-flash)
Aug 09 15:31:01 user nova-compute[72382]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e62d4416-be8c-4327-9a51-0cc509109c53 (non-flash)
Aug 09 15:31:01 user nova-compute[72382]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5cfefdb-a454-494f-ab09-acf8644352a3 (non-flash)
Aug 09 15:31:01 user nova-compute[72382]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59852df5-d4c8-4f25-8693-36181ff6a447 (non-flash)
Aug 09 15:31:01 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 15:31:01 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-d429602e-e6b7-4d94-866c-523e1be5ccb1 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:59852df5-d4c8-4f25-8693-36181ff6a447" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.469s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 15:31:01 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-d429602e-e6b7-4d94-866c-523e1be5ccb1 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Connected to 172.16.0.220:3260 {{(pid=72382) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 15:31:01 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-d429602e-e6b7-4d94-866c-523e1be5ccb1 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] HCTL ('34', '-', '-', 0) found on session 40 with lun 0 {{(pid=72382) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 15:31:01 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-d429602e-e6b7-4d94-866c-523e1be5ccb1 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72382) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 15:31:01 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:31:01 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:31:01 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[8691b880-b404-441e-b72c-538f866adc6f]: (4, ('- - 0', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:31:01 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-d429602e-e6b7-4d94-866c-523e1be5ccb1 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Searching for a device in session 40 and hctl ['34', '*', '*', 0] yield: None {{(pid=72382) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 15:31:02 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:31:02 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:31:02 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:31:02 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-d429602e-e6b7-4d94-866c-523e1be5ccb1 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Searching for a device in session 40 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72382) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 15:31:02 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-d429602e-e6b7-4d94-866c-523e1be5ccb1 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wtDgMKZf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72382) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 15:31:02 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-d429602e-e6b7-4d94-866c-523e1be5ccb1 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.499s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 15:31:02 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-d429602e-e6b7-4d94-866c-523e1be5ccb1 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] <== connect_volume: return (1501ms) {'type': 'block', 'scsi_wwn': '26632623536346435', 'path': '/dev/sdc'} {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 15:31:02 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d429602e-e6b7-4d94-866c-523e1be5ccb1 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: 94c8cc29-3300-475f-aca0-40fa0e58cd66] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26632623536346435', 'path': '/dev/sdc'} {{(pid=72382) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 15:31:02 user nova-compute[72382]: DEBUG nova.virt.libvirt.vif [None req-d429602e-e6b7-4d94-866c-523e1be5ccb1 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T15:30:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-2037810923',display_name='tempest-TestVolumeBootPattern-volume-backed-server-2037810923',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-2037810923',id=33,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBYb5plrKxPSfm6Wek6JUI6+qscloW+iqcYwCWmqaqgcxdDsdYEdQ+ksS+DfwVOUC/EjNnbb4/cc1FYVv+816sDXt53uKzsShXxIe1A2eeK7gVUpSjVgPUO8NSbQTaXymg==',key_name='tempest-keypair-519794732',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='70310b1af40b4d239fe5ea362972554b',ramdisk_id='',reservation_id='r-ylx9id1a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-451643589',owner_user_name='tempest-TestVolumeBootPattern-451643589-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T15:30:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='280bcf2afd7245a7bcd605e0db79c569',uuid=94c8cc29-3300-475f-aca0-40fa0e58cd66,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ae7204a8-8b63-4d77-933c-00e37a89a187", "address": "fa:16:3e:a9:9b:f8", "network": {"id": "a78e6cb6-feb7-4f64-a3c0-4900594b6e37", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-338007968-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70310b1af40b4d239fe5ea362972554b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae7204a8-8b", "ovs_interfaceid": "ae7204a8-8b63-4d77-933c-00e37a89a187", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72382) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 15:31:02 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-d429602e-e6b7-4d94-866c-523e1be5ccb1 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Converting VIF {"id": "ae7204a8-8b63-4d77-933c-00e37a89a187", "address": "fa:16:3e:a9:9b:f8", "network": {"id": "a78e6cb6-feb7-4f64-a3c0-4900594b6e37", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-338007968-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70310b1af40b4d239fe5ea362972554b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae7204a8-8b", "ovs_interfaceid": "ae7204a8-8b63-4d77-933c-00e37a89a187", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 15:31:02 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-d429602e-e6b7-4d94-866c-523e1be5ccb1 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a9:9b:f8,bridge_name='br-int',has_traffic_filtering=True,id=ae7204a8-8b63-4d77-933c-00e37a89a187,network=Network(a78e6cb6-feb7-4f64-a3c0-4900594b6e37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae7204a8-8b') {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 15:31:02 user nova-compute[72382]: DEBUG nova.objects.instance [None req-d429602e-e6b7-4d94-866c-523e1be5ccb1 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Lazy-loading 'pci_devices' on Instance uuid 94c8cc29-3300-475f-aca0-40fa0e58cd66 {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:31:02 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-d429602e-e6b7-4d94-866c-523e1be5ccb1 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: 94c8cc29-3300-475f-aca0-40fa0e58cd66] End _get_guest_xml xml=<domain type="kvm">
Aug 09 15:31:02 user nova-compute[72382]:   <uuid>94c8cc29-3300-475f-aca0-40fa0e58cd66</uuid>
Aug 09 15:31:02 user nova-compute[72382]:   <name>instance-00000021</name>
Aug 09 15:31:02 user nova-compute[72382]:   <memory>524288</memory>
Aug 09 15:31:02 user nova-compute[72382]:   <vcpu>1</vcpu>
Aug 09 15:31:02 user nova-compute[72382]:   <metadata>
Aug 09 15:31:02 user nova-compute[72382]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 15:31:02 user nova-compute[72382]:       <nova:package version="0.0.0"/>
Aug 09 15:31:02 user nova-compute[72382]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-2037810923</nova:name>
Aug 09 15:31:02 user nova-compute[72382]:       <nova:creationTime>2023-08-09 15:31:01</nova:creationTime>
Aug 09 15:31:02 user nova-compute[72382]:       <nova:flavor name="m1.tiny">
Aug 09 15:31:02 user nova-compute[72382]:         <nova:memory>512</nova:memory>
Aug 09 15:31:02 user nova-compute[72382]:         <nova:disk>1</nova:disk>
Aug 09 15:31:02 user nova-compute[72382]:         <nova:swap>0</nova:swap>
Aug 09 15:31:02 user nova-compute[72382]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 15:31:02 user nova-compute[72382]:         <nova:vcpus>1</nova:vcpus>
Aug 09 15:31:02 user nova-compute[72382]:       </nova:flavor>
Aug 09 15:31:02 user nova-compute[72382]:       <nova:owner>
Aug 09 15:31:02 user nova-compute[72382]:         <nova:user uuid="280bcf2afd7245a7bcd605e0db79c569">tempest-TestVolumeBootPattern-451643589-project-member</nova:user>
Aug 09 15:31:02 user nova-compute[72382]:         <nova:project uuid="70310b1af40b4d239fe5ea362972554b">tempest-TestVolumeBootPattern-451643589</nova:project>
Aug 09 15:31:02 user nova-compute[72382]:       </nova:owner>
Aug 09 15:31:02 user nova-compute[72382]:       <nova:ports>
Aug 09 15:31:02 user nova-compute[72382]:         <nova:port uuid="ae7204a8-8b63-4d77-933c-00e37a89a187">
Aug 09 15:31:02 user nova-compute[72382]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 09 15:31:02 user nova-compute[72382]:         </nova:port>
Aug 09 15:31:02 user nova-compute[72382]:       </nova:ports>
Aug 09 15:31:02 user nova-compute[72382]:     </nova:instance>
Aug 09 15:31:02 user nova-compute[72382]:   </metadata>
Aug 09 15:31:02 user nova-compute[72382]:   <sysinfo type="smbios">
Aug 09 15:31:02 user nova-compute[72382]:     <system>
Aug 09 15:31:02 user nova-compute[72382]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 15:31:02 user nova-compute[72382]:       <entry name="product">OpenStack Nova</entry>
Aug 09 15:31:02 user nova-compute[72382]:       <entry name="version">0.0.0</entry>
Aug 09 15:31:02 user nova-compute[72382]:       <entry name="serial">94c8cc29-3300-475f-aca0-40fa0e58cd66</entry>
Aug 09 15:31:02 user nova-compute[72382]:       <entry name="uuid">94c8cc29-3300-475f-aca0-40fa0e58cd66</entry>
Aug 09 15:31:02 user nova-compute[72382]:       <entry name="family">Virtual Machine</entry>
Aug 09 15:31:02 user nova-compute[72382]:     </system>
Aug 09 15:31:02 user nova-compute[72382]:   </sysinfo>
Aug 09 15:31:02 user nova-compute[72382]:   <os>
Aug 09 15:31:02 user nova-compute[72382]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 15:31:02 user nova-compute[72382]:     <boot dev="hd"/>
Aug 09 15:31:02 user nova-compute[72382]:     <smbios mode="sysinfo"/>
Aug 09 15:31:02 user nova-compute[72382]:   </os>
Aug 09 15:31:02 user nova-compute[72382]:   <features>
Aug 09 15:31:02 user nova-compute[72382]:     <acpi/>
Aug 09 15:31:02 user nova-compute[72382]:     <apic/>
Aug 09 15:31:02 user nova-compute[72382]:     <vmcoreinfo/>
Aug 09 15:31:02 user nova-compute[72382]:   </features>
Aug 09 15:31:02 user nova-compute[72382]:   <clock offset="utc">
Aug 09 15:31:02 user nova-compute[72382]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 15:31:02 user nova-compute[72382]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 15:31:02 user nova-compute[72382]:     <timer name="hpet" present="no"/>
Aug 09 15:31:02 user nova-compute[72382]:   </clock>
Aug 09 15:31:02 user nova-compute[72382]:   <cpu mode="custom" match="exact">
Aug 09 15:31:02 user nova-compute[72382]:     <model>Nehalem</model>
Aug 09 15:31:02 user nova-compute[72382]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 15:31:02 user nova-compute[72382]:   </cpu>
Aug 09 15:31:02 user nova-compute[72382]:   <devices>
Aug 09 15:31:02 user nova-compute[72382]:     <disk type="block" device="disk">
Aug 09 15:31:02 user nova-compute[72382]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 15:31:02 user nova-compute[72382]:       <source dev="/dev/sdc"/>
Aug 09 15:31:02 user nova-compute[72382]:       <target dev="vda" bus="virtio"/>
Aug 09 15:31:02 user nova-compute[72382]:       <serial>59852df5-d4c8-4f25-8693-36181ff6a447</serial>
Aug 09 15:31:02 user nova-compute[72382]:     </disk>
Aug 09 15:31:02 user nova-compute[72382]:     <interface type="ethernet">
Aug 09 15:31:02 user nova-compute[72382]:       <mac address="fa:16:3e:a9:9b:f8"/>
Aug 09 15:31:02 user nova-compute[72382]:       <model type="virtio"/>
Aug 09 15:31:02 user nova-compute[72382]:       <mtu size="1442"/>
Aug 09 15:31:02 user nova-compute[72382]:       <target dev="tapae7204a8-8b"/>
Aug 09 15:31:02 user nova-compute[72382]:     </interface>
Aug 09 15:31:02 user nova-compute[72382]:     <serial type="pty">
Aug 09 15:31:02 user nova-compute[72382]:       <log file="/opt/stack/data/nova/instances/94c8cc29-3300-475f-aca0-40fa0e58cd66/console.log" append="off"/>
Aug 09 15:31:02 user nova-compute[72382]:     </serial>
Aug 09 15:31:02 user nova-compute[72382]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 15:31:02 user nova-compute[72382]:     <video>
Aug 09 15:31:02 user nova-compute[72382]:       <model type="virtio"/>
Aug 09 15:31:02 user nova-compute[72382]:     </video>
Aug 09 15:31:02 user nova-compute[72382]:     <rng model="virtio">
Aug 09 15:31:02 user nova-compute[72382]:       <backend model="random">/dev/urandom</backend>
Aug 09 15:31:02 user nova-compute[72382]:     </rng>
Aug 09 15:31:02 user nova-compute[72382]:     <controller type="usb" index="0" model="none"/>
Aug 09 15:31:02 user nova-compute[72382]:     <memballoon model="virtio">
Aug 09 15:31:02 user nova-compute[72382]:       <stats period="10"/>
Aug 09 15:31:02 user nova-compute[72382]:     </memballoon>
Aug 09 15:31:02 user nova-compute[72382]:   </devices>
Aug 09 15:31:02 user nova-compute[72382]: </domain>
Aug 09 15:31:02 user nova-compute[72382]:  {{(pid=72382) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 15:31:02 user nova-compute[72382]: DEBUG nova.virt.libvirt.vif [None req-d429602e-e6b7-4d94-866c-523e1be5ccb1 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T15:30:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-2037810923',display_name='tempest-TestVolumeBootPattern-volume-backed-server-2037810923',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-2037810923',id=33,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBYb5plrKxPSfm6Wek6JUI6+qscloW+iqcYwCWmqaqgcxdDsdYEdQ+ksS+DfwVOUC/EjNnbb4/cc1FYVv+816sDXt53uKzsShXxIe1A2eeK7gVUpSjVgPUO8NSbQTaXymg==',key_name='tempest-keypair-519794732',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='70310b1af40b4d239fe5ea362972554b',ramdisk_id='',reservation_id='r-ylx9id1a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-451643589',owner_user_name='tempest-TestVolumeBootPattern-451643589-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T15:30:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='280bcf2afd7245a7bcd605e0db79c569',uuid=94c8cc29-3300-475f-aca0-40fa0e58cd66,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ae7204a8-8b63-4d77-933c-00e37a89a187", "address": "fa:16:3e:a9:9b:f8", "network": {"id": "a78e6cb6-feb7-4f64-a3c0-4900594b6e37", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-338007968-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70310b1af40b4d239fe5ea362972554b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae7204a8-8b", "ovs_interfaceid": "ae7204a8-8b63-4d77-933c-00e37a89a187", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 15:31:02 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-d429602e-e6b7-4d94-866c-523e1be5ccb1 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Converting VIF {"id": "ae7204a8-8b63-4d77-933c-00e37a89a187", "address": "fa:16:3e:a9:9b:f8", "network": {"id": "a78e6cb6-feb7-4f64-a3c0-4900594b6e37", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-338007968-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70310b1af40b4d239fe5ea362972554b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae7204a8-8b", "ovs_interfaceid": "ae7204a8-8b63-4d77-933c-00e37a89a187", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 15:31:02 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-d429602e-e6b7-4d94-866c-523e1be5ccb1 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a9:9b:f8,bridge_name='br-int',has_traffic_filtering=True,id=ae7204a8-8b63-4d77-933c-00e37a89a187,network=Network(a78e6cb6-feb7-4f64-a3c0-4900594b6e37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae7204a8-8b') {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 15:31:02 user nova-compute[72382]: DEBUG os_vif [None req-d429602e-e6b7-4d94-866c-523e1be5ccb1 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a9:9b:f8,bridge_name='br-int',has_traffic_filtering=True,id=ae7204a8-8b63-4d77-933c-00e37a89a187,network=Network(a78e6cb6-feb7-4f64-a3c0-4900594b6e37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae7204a8-8b') {{(pid=72382) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 15:31:02 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:31:02 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:31:02 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 15:31:02 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:31:02 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapae7204a8-8b, may_exist=True, interface_attrs={}) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:31:02 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapae7204a8-8b, col_values=(('external_ids', {'iface-id': 'ae7204a8-8b63-4d77-933c-00e37a89a187', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a9:9b:f8', 'vm-uuid': '94c8cc29-3300-475f-aca0-40fa0e58cd66'}),), if_exists=True) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:31:02 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:31:02 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:31:02 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:31:02 user nova-compute[72382]: INFO os_vif [None req-d429602e-e6b7-4d94-866c-523e1be5ccb1 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a9:9b:f8,bridge_name='br-int',has_traffic_filtering=True,id=ae7204a8-8b63-4d77-933c-00e37a89a187,network=Network(a78e6cb6-feb7-4f64-a3c0-4900594b6e37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae7204a8-8b')
Aug 09 15:31:02 user nova-compute[72382]: DEBUG nova.compute.manager [req-6f069c8b-0fc4-4059-81ac-d673d079de4e req-adf5d15b-7d05-497f-9ebf-cc622434155f service nova] [instance: 8f744a7d-9eed-40e1-9422-670970c209ce] Received event network-vif-plugged-d16436a7-9589-443b-be99-e54349a50e25 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:31:02 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-6f069c8b-0fc4-4059-81ac-d673d079de4e req-adf5d15b-7d05-497f-9ebf-cc622434155f service nova] Acquiring lock "8f744a7d-9eed-40e1-9422-670970c209ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:31:02 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-6f069c8b-0fc4-4059-81ac-d673d079de4e req-adf5d15b-7d05-497f-9ebf-cc622434155f service nova] Lock "8f744a7d-9eed-40e1-9422-670970c209ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:31:02 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-6f069c8b-0fc4-4059-81ac-d673d079de4e req-adf5d15b-7d05-497f-9ebf-cc622434155f service nova] Lock "8f744a7d-9eed-40e1-9422-670970c209ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:31:02 user nova-compute[72382]: DEBUG nova.compute.manager [req-6f069c8b-0fc4-4059-81ac-d673d079de4e req-adf5d15b-7d05-497f-9ebf-cc622434155f service nova] [instance: 8f744a7d-9eed-40e1-9422-670970c209ce] No waiting events found dispatching network-vif-plugged-d16436a7-9589-443b-be99-e54349a50e25 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:31:02 user nova-compute[72382]: WARNING nova.compute.manager [req-6f069c8b-0fc4-4059-81ac-d673d079de4e req-adf5d15b-7d05-497f-9ebf-cc622434155f service nova] [instance: 8f744a7d-9eed-40e1-9422-670970c209ce] Received unexpected event network-vif-plugged-d16436a7-9589-443b-be99-e54349a50e25 for instance with vm_state building and task_state spawning.
Aug 09 15:31:02 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-d429602e-e6b7-4d94-866c-523e1be5ccb1 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] No BDM found with device name vda, not building metadata. {{(pid=72382) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 15:31:02 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-d429602e-e6b7-4d94-866c-523e1be5ccb1 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] No VIF found with MAC fa:16:3e:a9:9b:f8, not building metadata {{(pid=72382) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 15:31:03 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:31:03 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:31:03 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:31:03 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:31:03 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:31:04 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:31:04 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:31:04 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:31:04 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:31:04 user nova-compute[72382]: DEBUG nova.compute.manager [req-53f23d45-a2cb-4ba3-bfda-46e27aa635c3 req-b95e6dd9-eff3-4fb3-81ae-e2b6e98c044d service nova] [instance: 94c8cc29-3300-475f-aca0-40fa0e58cd66] Received event network-vif-plugged-ae7204a8-8b63-4d77-933c-00e37a89a187 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:31:04 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-53f23d45-a2cb-4ba3-bfda-46e27aa635c3 req-b95e6dd9-eff3-4fb3-81ae-e2b6e98c044d service nova] Acquiring lock "94c8cc29-3300-475f-aca0-40fa0e58cd66-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:31:04 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-53f23d45-a2cb-4ba3-bfda-46e27aa635c3 req-b95e6dd9-eff3-4fb3-81ae-e2b6e98c044d service nova] Lock "94c8cc29-3300-475f-aca0-40fa0e58cd66-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:31:04 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-53f23d45-a2cb-4ba3-bfda-46e27aa635c3 req-b95e6dd9-eff3-4fb3-81ae-e2b6e98c044d service nova] Lock "94c8cc29-3300-475f-aca0-40fa0e58cd66-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:31:04 user nova-compute[72382]: DEBUG nova.compute.manager [req-53f23d45-a2cb-4ba3-bfda-46e27aa635c3 req-b95e6dd9-eff3-4fb3-81ae-e2b6e98c044d service nova] [instance: 94c8cc29-3300-475f-aca0-40fa0e58cd66] No waiting events found dispatching network-vif-plugged-ae7204a8-8b63-4d77-933c-00e37a89a187 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:31:04 user nova-compute[72382]: WARNING nova.compute.manager [req-53f23d45-a2cb-4ba3-bfda-46e27aa635c3 req-b95e6dd9-eff3-4fb3-81ae-e2b6e98c044d service nova] [instance: 94c8cc29-3300-475f-aca0-40fa0e58cd66] Received unexpected event network-vif-plugged-ae7204a8-8b63-4d77-933c-00e37a89a187 for instance with vm_state building and task_state spawning.
Aug 09 15:31:04 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:31:04 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:31:04 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:31:04 user nova-compute[72382]: DEBUG nova.compute.manager [req-614f1305-5e9b-42cb-b9bc-33a37b04fbe3 req-e244c6cc-4e29-4753-8268-f74640a5303b service nova] [instance: 8f744a7d-9eed-40e1-9422-670970c209ce] Received event network-vif-plugged-d16436a7-9589-443b-be99-e54349a50e25 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:31:04 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-614f1305-5e9b-42cb-b9bc-33a37b04fbe3 req-e244c6cc-4e29-4753-8268-f74640a5303b service nova] Acquiring lock "8f744a7d-9eed-40e1-9422-670970c209ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:31:04 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-614f1305-5e9b-42cb-b9bc-33a37b04fbe3 req-e244c6cc-4e29-4753-8268-f74640a5303b service nova] Lock "8f744a7d-9eed-40e1-9422-670970c209ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:31:04 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-614f1305-5e9b-42cb-b9bc-33a37b04fbe3 req-e244c6cc-4e29-4753-8268-f74640a5303b service nova] Lock "8f744a7d-9eed-40e1-9422-670970c209ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:31:04 user nova-compute[72382]: DEBUG nova.compute.manager [req-614f1305-5e9b-42cb-b9bc-33a37b04fbe3 req-e244c6cc-4e29-4753-8268-f74640a5303b service nova] [instance: 8f744a7d-9eed-40e1-9422-670970c209ce] No waiting events found dispatching network-vif-plugged-d16436a7-9589-443b-be99-e54349a50e25 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:31:04 user nova-compute[72382]: WARNING nova.compute.manager [req-614f1305-5e9b-42cb-b9bc-33a37b04fbe3 req-e244c6cc-4e29-4753-8268-f74640a5303b service nova] [instance: 8f744a7d-9eed-40e1-9422-670970c209ce] Received unexpected event network-vif-plugged-d16436a7-9589-443b-be99-e54349a50e25 for instance with vm_state building and task_state spawning.
Aug 09 15:31:04 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:31:05 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:31:05 user nova-compute[72382]: DEBUG nova.virt.driver [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Emitting event <LifecycleEvent: 1691595065.9923048, 8f744a7d-9eed-40e1-9422-670970c209ce => Resumed> {{(pid=72382) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 15:31:05 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 8f744a7d-9eed-40e1-9422-670970c209ce] VM Resumed (Lifecycle Event)
Aug 09 15:31:05 user nova-compute[72382]: DEBUG nova.compute.manager [None req-1f71d7c1-3a6b-4c05-adc9-fc0c53630a2f tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] [instance: 8f744a7d-9eed-40e1-9422-670970c209ce] Instance event wait completed in 0 seconds for  {{(pid=72382) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 15:31:05 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-1f71d7c1-3a6b-4c05-adc9-fc0c53630a2f tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] [instance: 8f744a7d-9eed-40e1-9422-670970c209ce] Guest created on hypervisor {{(pid=72382) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 15:31:06 user nova-compute[72382]: INFO nova.virt.libvirt.driver [-] [instance: 8f744a7d-9eed-40e1-9422-670970c209ce] Instance spawned successfully.
Aug 09 15:31:06 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-1f71d7c1-3a6b-4c05-adc9-fc0c53630a2f tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] [instance: 8f744a7d-9eed-40e1-9422-670970c209ce] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 15:31:06 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 8f744a7d-9eed-40e1-9422-670970c209ce] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:31:06 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 8f744a7d-9eed-40e1-9422-670970c209ce] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72382) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 15:31:06 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-1f71d7c1-3a6b-4c05-adc9-fc0c53630a2f tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] [instance: 8f744a7d-9eed-40e1-9422-670970c209ce] Found default for hw_cdrom_bus of ide {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:31:06 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-1f71d7c1-3a6b-4c05-adc9-fc0c53630a2f tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] [instance: 8f744a7d-9eed-40e1-9422-670970c209ce] Found default for hw_disk_bus of virtio {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:31:06 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-1f71d7c1-3a6b-4c05-adc9-fc0c53630a2f tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] [instance: 8f744a7d-9eed-40e1-9422-670970c209ce] Found default for hw_input_bus of None {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:31:06 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-1f71d7c1-3a6b-4c05-adc9-fc0c53630a2f tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] [instance: 8f744a7d-9eed-40e1-9422-670970c209ce] Found default for hw_pointer_model of None {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:31:06 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-1f71d7c1-3a6b-4c05-adc9-fc0c53630a2f tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] [instance: 8f744a7d-9eed-40e1-9422-670970c209ce] Found default for hw_video_model of virtio {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:31:06 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-1f71d7c1-3a6b-4c05-adc9-fc0c53630a2f tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] [instance: 8f744a7d-9eed-40e1-9422-670970c209ce] Found default for hw_vif_model of virtio {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:31:06 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 8f744a7d-9eed-40e1-9422-670970c209ce] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 15:31:06 user nova-compute[72382]: DEBUG nova.virt.driver [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Emitting event <LifecycleEvent: 1691595065.9934962, 8f744a7d-9eed-40e1-9422-670970c209ce => Started> {{(pid=72382) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 15:31:06 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 8f744a7d-9eed-40e1-9422-670970c209ce] VM Started (Lifecycle Event)
Aug 09 15:31:06 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 8f744a7d-9eed-40e1-9422-670970c209ce] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:31:06 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 8f744a7d-9eed-40e1-9422-670970c209ce] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72382) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 15:31:06 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 8f744a7d-9eed-40e1-9422-670970c209ce] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 15:31:06 user nova-compute[72382]: INFO nova.compute.manager [None req-1f71d7c1-3a6b-4c05-adc9-fc0c53630a2f tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] [instance: 8f744a7d-9eed-40e1-9422-670970c209ce] Took 7.15 seconds to spawn the instance on the hypervisor.
Aug 09 15:31:06 user nova-compute[72382]: DEBUG nova.compute.manager [None req-1f71d7c1-3a6b-4c05-adc9-fc0c53630a2f tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] [instance: 8f744a7d-9eed-40e1-9422-670970c209ce] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:31:06 user nova-compute[72382]: INFO nova.compute.manager [None req-1f71d7c1-3a6b-4c05-adc9-fc0c53630a2f tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] [instance: 8f744a7d-9eed-40e1-9422-670970c209ce] Took 7.89 seconds to build instance.
Aug 09 15:31:06 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-1f71d7c1-3a6b-4c05-adc9-fc0c53630a2f tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] Lock "8f744a7d-9eed-40e1-9422-670970c209ce" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.082s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:31:06 user nova-compute[72382]: DEBUG nova.virt.driver [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Emitting event <LifecycleEvent: 1691595066.5996327, 94c8cc29-3300-475f-aca0-40fa0e58cd66 => Resumed> {{(pid=72382) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 15:31:06 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 94c8cc29-3300-475f-aca0-40fa0e58cd66] VM Resumed (Lifecycle Event)
Aug 09 15:31:06 user nova-compute[72382]: DEBUG nova.compute.manager [None req-d429602e-e6b7-4d94-866c-523e1be5ccb1 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: 94c8cc29-3300-475f-aca0-40fa0e58cd66] Instance event wait completed in 0 seconds for  {{(pid=72382) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 15:31:06 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-d429602e-e6b7-4d94-866c-523e1be5ccb1 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: 94c8cc29-3300-475f-aca0-40fa0e58cd66] Guest created on hypervisor {{(pid=72382) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 15:31:06 user nova-compute[72382]: INFO nova.virt.libvirt.driver [-] [instance: 94c8cc29-3300-475f-aca0-40fa0e58cd66] Instance spawned successfully.
Aug 09 15:31:06 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-d429602e-e6b7-4d94-866c-523e1be5ccb1 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: 94c8cc29-3300-475f-aca0-40fa0e58cd66] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 15:31:06 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 94c8cc29-3300-475f-aca0-40fa0e58cd66] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:31:06 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 94c8cc29-3300-475f-aca0-40fa0e58cd66] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72382) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 15:31:06 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-d429602e-e6b7-4d94-866c-523e1be5ccb1 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: 94c8cc29-3300-475f-aca0-40fa0e58cd66] Found default for hw_cdrom_bus of ide {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:31:06 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-d429602e-e6b7-4d94-866c-523e1be5ccb1 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: 94c8cc29-3300-475f-aca0-40fa0e58cd66] Found default for hw_disk_bus of virtio {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:31:06 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-d429602e-e6b7-4d94-866c-523e1be5ccb1 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: 94c8cc29-3300-475f-aca0-40fa0e58cd66] Found default for hw_input_bus of None {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:31:06 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-d429602e-e6b7-4d94-866c-523e1be5ccb1 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: 94c8cc29-3300-475f-aca0-40fa0e58cd66] Found default for hw_pointer_model of None {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:31:06 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-d429602e-e6b7-4d94-866c-523e1be5ccb1 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: 94c8cc29-3300-475f-aca0-40fa0e58cd66] Found default for hw_video_model of virtio {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:31:06 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-d429602e-e6b7-4d94-866c-523e1be5ccb1 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: 94c8cc29-3300-475f-aca0-40fa0e58cd66] Found default for hw_vif_model of virtio {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:31:06 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 94c8cc29-3300-475f-aca0-40fa0e58cd66] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 15:31:06 user nova-compute[72382]: DEBUG nova.virt.driver [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Emitting event <LifecycleEvent: 1691595066.6015985, 94c8cc29-3300-475f-aca0-40fa0e58cd66 => Started> {{(pid=72382) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 15:31:06 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 94c8cc29-3300-475f-aca0-40fa0e58cd66] VM Started (Lifecycle Event)
Aug 09 15:31:06 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 94c8cc29-3300-475f-aca0-40fa0e58cd66] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:31:06 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 94c8cc29-3300-475f-aca0-40fa0e58cd66] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72382) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 15:31:06 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 94c8cc29-3300-475f-aca0-40fa0e58cd66] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 15:31:06 user nova-compute[72382]: INFO nova.compute.manager [None req-d429602e-e6b7-4d94-866c-523e1be5ccb1 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: 94c8cc29-3300-475f-aca0-40fa0e58cd66] Took 5.62 seconds to spawn the instance on the hypervisor.
Aug 09 15:31:06 user nova-compute[72382]: DEBUG nova.compute.manager [None req-d429602e-e6b7-4d94-866c-523e1be5ccb1 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: 94c8cc29-3300-475f-aca0-40fa0e58cd66] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:31:06 user nova-compute[72382]: DEBUG nova.compute.manager [req-96a51ae5-fcd3-4d22-88cc-a1c93d35f88c req-8c40aec5-0c43-4217-b8da-9d8162d0d27f service nova] [instance: 94c8cc29-3300-475f-aca0-40fa0e58cd66] Received event network-vif-plugged-ae7204a8-8b63-4d77-933c-00e37a89a187 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:31:06 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-96a51ae5-fcd3-4d22-88cc-a1c93d35f88c req-8c40aec5-0c43-4217-b8da-9d8162d0d27f service nova] Acquiring lock "94c8cc29-3300-475f-aca0-40fa0e58cd66-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:31:06 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-96a51ae5-fcd3-4d22-88cc-a1c93d35f88c req-8c40aec5-0c43-4217-b8da-9d8162d0d27f service nova] Lock "94c8cc29-3300-475f-aca0-40fa0e58cd66-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:31:06 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-96a51ae5-fcd3-4d22-88cc-a1c93d35f88c req-8c40aec5-0c43-4217-b8da-9d8162d0d27f service nova] Lock "94c8cc29-3300-475f-aca0-40fa0e58cd66-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:31:06 user nova-compute[72382]: DEBUG nova.compute.manager [req-96a51ae5-fcd3-4d22-88cc-a1c93d35f88c req-8c40aec5-0c43-4217-b8da-9d8162d0d27f service nova] [instance: 94c8cc29-3300-475f-aca0-40fa0e58cd66] No waiting events found dispatching network-vif-plugged-ae7204a8-8b63-4d77-933c-00e37a89a187 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:31:06 user nova-compute[72382]: WARNING nova.compute.manager [req-96a51ae5-fcd3-4d22-88cc-a1c93d35f88c req-8c40aec5-0c43-4217-b8da-9d8162d0d27f service nova] [instance: 94c8cc29-3300-475f-aca0-40fa0e58cd66] Received unexpected event network-vif-plugged-ae7204a8-8b63-4d77-933c-00e37a89a187 for instance with vm_state building and task_state spawning.
Aug 09 15:31:06 user nova-compute[72382]: INFO nova.compute.manager [None req-d429602e-e6b7-4d94-866c-523e1be5ccb1 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: 94c8cc29-3300-475f-aca0-40fa0e58cd66] Took 15.66 seconds to build instance.
Aug 09 15:31:06 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-d429602e-e6b7-4d94-866c-523e1be5ccb1 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Lock "94c8cc29-3300-475f-aca0-40fa0e58cd66" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.752s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:31:07 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:31:08 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:31:09 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:31:09 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:31:10 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:31:10 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:31:10 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:31:10 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:31:10 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Auditing locally available compute resources for user (node: user) {{(pid=72382) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 15:31:11 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ea8f68c-3dc1-45ac-a7f3-bca32f929add/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:31:11 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ea8f68c-3dc1-45ac-a7f3-bca32f929add/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:31:11 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ea8f68c-3dc1-45ac-a7f3-bca32f929add/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:31:11 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ea8f68c-3dc1-45ac-a7f3-bca32f929add/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:31:11 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f780040f-b789-4b72-8986-813c7b9fe4a6/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:31:11 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f780040f-b789-4b72-8986-813c7b9fe4a6/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:31:11 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f780040f-b789-4b72-8986-813c7b9fe4a6/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:31:11 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f780040f-b789-4b72-8986-813c7b9fe4a6/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:31:11 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/266be814-4a2b-4f8e-a0f6-e8821fdeb95d/disk.rescue --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:31:11 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/266be814-4a2b-4f8e-a0f6-e8821fdeb95d/disk.rescue --force-share --output=json" returned: 0 in 0.143s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:31:11 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/266be814-4a2b-4f8e-a0f6-e8821fdeb95d/disk.rescue --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:31:12 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/266be814-4a2b-4f8e-a0f6-e8821fdeb95d/disk.rescue --force-share --output=json" returned: 0 in 0.157s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:31:12 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/266be814-4a2b-4f8e-a0f6-e8821fdeb95d/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:31:12 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/266be814-4a2b-4f8e-a0f6-e8821fdeb95d/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:31:12 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/266be814-4a2b-4f8e-a0f6-e8821fdeb95d/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:31:12 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/266be814-4a2b-4f8e-a0f6-e8821fdeb95d/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:31:12 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72382) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 15:31:12 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14c97840-88c0-4a8e-96e8-2e7da318ad07/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:31:12 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14c97840-88c0-4a8e-96e8-2e7da318ad07/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:31:12 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14c97840-88c0-4a8e-96e8-2e7da318ad07/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:31:12 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14c97840-88c0-4a8e-96e8-2e7da318ad07/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:31:12 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=72382) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 15:31:12 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44afd1bf-fa5c-4b3e-8752-b16853fef54e/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:31:12 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:31:12 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44afd1bf-fa5c-4b3e-8752-b16853fef54e/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:31:12 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44afd1bf-fa5c-4b3e-8752-b16853fef54e/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:31:12 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44afd1bf-fa5c-4b3e-8752-b16853fef54e/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:31:13 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ccbfda2-8bcd-4ec1-972a-cf49a62b1583/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:31:13 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ccbfda2-8bcd-4ec1-972a-cf49a62b1583/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:31:13 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ccbfda2-8bcd-4ec1-972a-cf49a62b1583/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:31:13 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ccbfda2-8bcd-4ec1-972a-cf49a62b1583/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:31:13 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72382) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 15:31:13 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7c34b80-c2e9-43c1-8b8e-7c62eb8e73f4/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:31:13 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7c34b80-c2e9-43c1-8b8e-7c62eb8e73f4/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:31:13 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7c34b80-c2e9-43c1-8b8e-7c62eb8e73f4/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:31:13 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7c34b80-c2e9-43c1-8b8e-7c62eb8e73f4/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:31:13 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f744a7d-9eed-40e1-9422-670970c209ce/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:31:13 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f744a7d-9eed-40e1-9422-670970c209ce/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:31:13 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f744a7d-9eed-40e1-9422-670970c209ce/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:31:14 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f744a7d-9eed-40e1-9422-670970c209ce/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:31:14 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=72382) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 15:31:14 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72382) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 15:31:14 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:31:14 user nova-compute[72382]: WARNING nova.virt.libvirt.driver [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 15:31:14 user nova-compute[72382]: WARNING nova.virt.libvirt.driver [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 15:31:14 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Hypervisor/Node resource view: name=user free_ram=7338MB free_disk=25.255908966064453GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72382) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 15:31:14 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:31:14 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:31:14 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance f780040f-b789-4b72-8986-813c7b9fe4a6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:31:14 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance 44afd1bf-fa5c-4b3e-8752-b16853fef54e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:31:14 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance 266be814-4a2b-4f8e-a0f6-e8821fdeb95d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:31:14 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance 0f510d75-5d1e-4a5c-b38f-731c299f0f5a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:31:14 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance 6ea8f68c-3dc1-45ac-a7f3-bca32f929add actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:31:14 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance 14c97840-88c0-4a8e-96e8-2e7da318ad07 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:31:14 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance 4ccbfda2-8bcd-4ec1-972a-cf49a62b1583 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:31:14 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance 2f430d9a-9fbf-43cd-8c0d-e5dec162be71 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:31:14 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance d7c34b80-c2e9-43c1-8b8e-7c62eb8e73f4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:31:14 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance 94c8cc29-3300-475f-aca0-40fa0e58cd66 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:31:14 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance 8f744a7d-9eed-40e1-9422-670970c209ce actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:31:14 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=72382) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 15:31:14 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=72382) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 15:31:15 user nova-compute[72382]: DEBUG nova.compute.provider_tree [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Inventory has not changed in ProviderTree for provider: 7b15b0e5-df4d-49db-833b-2855d21d10ae {{(pid=72382) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 15:31:15 user nova-compute[72382]: DEBUG nova.scheduler.client.report [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Inventory has not changed for provider 7b15b0e5-df4d-49db-833b-2855d21d10ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72382) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 15:31:15 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Compute_service record updated for user:user {{(pid=72382) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 15:31:15 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.552s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:31:16 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:31:16 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:31:16 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:31:16 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:31:16 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:31:16 user nova-compute[72382]: DEBUG nova.compute.manager [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Starting heal instance info cache {{(pid=72382) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 15:31:16 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Acquiring lock "refresh_cache-44afd1bf-fa5c-4b3e-8752-b16853fef54e" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 15:31:16 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Acquired lock "refresh_cache-44afd1bf-fa5c-4b3e-8752-b16853fef54e" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 15:31:16 user nova-compute[72382]: DEBUG nova.network.neutron [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] [instance: 44afd1bf-fa5c-4b3e-8752-b16853fef54e] Forcefully refreshing network info cache for instance {{(pid=72382) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 15:31:17 user nova-compute[72382]: DEBUG nova.network.neutron [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] [instance: 44afd1bf-fa5c-4b3e-8752-b16853fef54e] Updating instance_info_cache with network_info: [{"id": "2a1d4c60-bc2a-4530-b3bd-2a12ae2d2098", "address": "fa:16:3e:6c:50:29", "network": {"id": "46ef00c7-17ee-4e45-ba1d-dcc0a417ea85", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1360012261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "990ba791030940d38360af5879c853c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a1d4c60-bc", "ovs_interfaceid": "2a1d4c60-bc2a-4530-b3bd-2a12ae2d2098", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:31:17 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Releasing lock "refresh_cache-44afd1bf-fa5c-4b3e-8752-b16853fef54e" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 15:31:17 user nova-compute[72382]: DEBUG nova.compute.manager [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] [instance: 44afd1bf-fa5c-4b3e-8752-b16853fef54e] Updated the network info_cache for instance {{(pid=72382) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 15:31:17 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:31:17 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:31:17 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:31:17 user nova-compute[72382]: DEBUG nova.compute.manager [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72382) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 15:31:17 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:31:17 user nova-compute[72382]: DEBUG nova.compute.manager [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Cleaning up deleted instances {{(pid=72382) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 09 15:31:17 user nova-compute[72382]: DEBUG nova.compute.manager [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] There are 0 instances to clean {{(pid=72382) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 09 15:31:19 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:31:19 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:31:20 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-795ce887-04ed-4f58-9f1d-9ea4172b2203 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Acquiring lock "14c97840-88c0-4a8e-96e8-2e7da318ad07" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:31:20 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-795ce887-04ed-4f58-9f1d-9ea4172b2203 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Lock "14c97840-88c0-4a8e-96e8-2e7da318ad07" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:31:20 user nova-compute[72382]: INFO nova.compute.manager [None req-795ce887-04ed-4f58-9f1d-9ea4172b2203 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] [instance: 14c97840-88c0-4a8e-96e8-2e7da318ad07] Detaching volume e62d4416-be8c-4327-9a51-0cc509109c53
Aug 09 15:31:20 user nova-compute[72382]: INFO nova.virt.block_device [None req-795ce887-04ed-4f58-9f1d-9ea4172b2203 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] [instance: 14c97840-88c0-4a8e-96e8-2e7da318ad07] Attempting to driver detach volume e62d4416-be8c-4327-9a51-0cc509109c53 from mountpoint /dev/vdb
Aug 09 15:31:20 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-795ce887-04ed-4f58-9f1d-9ea4172b2203 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Attempting to detach device vdb from instance 14c97840-88c0-4a8e-96e8-2e7da318ad07 from the persistent domain config. {{(pid=72382) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 15:31:20 user nova-compute[72382]: DEBUG nova.virt.libvirt.guest [None req-795ce887-04ed-4f58-9f1d-9ea4172b2203 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 15:31:20 user nova-compute[72382]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 15:31:20 user nova-compute[72382]:   <source dev="/dev/sdf"/>
Aug 09 15:31:20 user nova-compute[72382]:   <target dev="vdb" bus="virtio"/>
Aug 09 15:31:20 user nova-compute[72382]:   <serial>e62d4416-be8c-4327-9a51-0cc509109c53</serial>
Aug 09 15:31:20 user nova-compute[72382]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 09 15:31:20 user nova-compute[72382]: </disk>
Aug 09 15:31:20 user nova-compute[72382]:  {{(pid=72382) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 15:31:20 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-795ce887-04ed-4f58-9f1d-9ea4172b2203 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Successfully detached device vdb from instance 14c97840-88c0-4a8e-96e8-2e7da318ad07 from the persistent domain config.
Aug 09 15:31:20 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-795ce887-04ed-4f58-9f1d-9ea4172b2203 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 14c97840-88c0-4a8e-96e8-2e7da318ad07 from the live domain config. {{(pid=72382) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 15:31:20 user nova-compute[72382]: DEBUG nova.virt.libvirt.guest [None req-795ce887-04ed-4f58-9f1d-9ea4172b2203 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 15:31:20 user nova-compute[72382]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 15:31:20 user nova-compute[72382]:   <source dev="/dev/sdf"/>
Aug 09 15:31:20 user nova-compute[72382]:   <target dev="vdb" bus="virtio"/>
Aug 09 15:31:20 user nova-compute[72382]:   <serial>e62d4416-be8c-4327-9a51-0cc509109c53</serial>
Aug 09 15:31:20 user nova-compute[72382]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 09 15:31:20 user nova-compute[72382]: </disk>
Aug 09 15:31:20 user nova-compute[72382]:  {{(pid=72382) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 15:31:20 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:31:21 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Received event <DeviceRemovedEvent: 1691595081.207131, 14c97840-88c0-4a8e-96e8-2e7da318ad07 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72382) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 15:31:21 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-795ce887-04ed-4f58-9f1d-9ea4172b2203 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 14c97840-88c0-4a8e-96e8-2e7da318ad07 {{(pid=72382) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 15:31:21 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-795ce887-04ed-4f58-9f1d-9ea4172b2203 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Successfully detached device vdb from instance 14c97840-88c0-4a8e-96e8-2e7da318ad07 from the live domain config.
Aug 09 15:31:21 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-795ce887-04ed-4f58-9f1d-9ea4172b2203 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] [instance: 14c97840-88c0-4a8e-96e8-2e7da318ad07] calling os-brick to detach iSCSI Volume {{(pid=72382) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 15:31:21 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-795ce887-04ed-4f58-9f1d-9ea4172b2203 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2a0c768340>, {'target_iqns': ['iqn.2010-10.org.openstack:e62d4416-be8c-4327-9a51-0cc509109c53'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cxDzGkfS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 15:31:21 user nova-compute[72382]: WARNING os_brick.initiator.connectors.base [None req-795ce887-04ed-4f58-9f1d-9ea4172b2203 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 15:31:21 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-795ce887-04ed-4f58-9f1d-9ea4172b2203 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 15:31:21 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-795ce887-04ed-4f58-9f1d-9ea4172b2203 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 15:31:21 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-795ce887-04ed-4f58-9f1d-9ea4172b2203 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e62d4416-be8c-4327-9a51-0cc509109c53', 0)] {{(pid=72382) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 15:31:21 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:31:21 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:31:21 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[55e11ad3-21b0-4a54-be69-ff5ce2a307be]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:25503c6e-bfc0-4008-846a-8cad783fc0fb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:59852df5-d4c8-4f25-8693-36181ff6a447\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b5cfefdb-a454-494f-ab09-acf8644352a3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e62d4416-be8c-4327-9a51-0cc509109c53\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:31:21 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:31:21 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:31:21 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3007bfc-ffc9-4523-b05c-ff99731bf449]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25503c6e-bfc0-4008-846a-8cad783fc0fb (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e62d4416-be8c-4327-9a51-0cc509109c53 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5cfefdb-a454-494f-ab09-acf8644352a3 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59852df5-d4c8-4f25-8693-36181ff6a447 (non-flash)\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:31:21 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-795ce887-04ed-4f58-9f1d-9ea4172b2203 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)
Aug 09 15:31:21 user nova-compute[72382]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25503c6e-bfc0-4008-846a-8cad783fc0fb (non-flash)
Aug 09 15:31:21 user nova-compute[72382]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e62d4416-be8c-4327-9a51-0cc509109c53 (non-flash)
Aug 09 15:31:21 user nova-compute[72382]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5cfefdb-a454-494f-ab09-acf8644352a3 (non-flash)
Aug 09 15:31:21 user nova-compute[72382]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59852df5-d4c8-4f25-8693-36181ff6a447 (non-flash)
Aug 09 15:31:21 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 15:31:21 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-795ce887-04ed-4f58-9f1d-9ea4172b2203 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)
Aug 09 15:31:21 user nova-compute[72382]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25503c6e-bfc0-4008-846a-8cad783fc0fb (non-flash)
Aug 09 15:31:21 user nova-compute[72382]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e62d4416-be8c-4327-9a51-0cc509109c53 (non-flash)
Aug 09 15:31:21 user nova-compute[72382]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5cfefdb-a454-494f-ab09-acf8644352a3 (non-flash)
Aug 09 15:31:21 user nova-compute[72382]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59852df5-d4c8-4f25-8693-36181ff6a447 (non-flash)
Aug 09 15:31:21 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 15:31:21 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-795ce887-04ed-4f58-9f1d-9ea4172b2203 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2a0c211a20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e62d4416-be8c-4327-9a51-0cc509109c53'): ({'sdf'}, set())}) {{(pid=72382) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 15:31:21 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-795ce887-04ed-4f58-9f1d-9ea4172b2203 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Removing single pathed devices sdf {{(pid=72382) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 15:31:21 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:31:21 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:31:21 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb4e6551-96bd-472a-b4b3-f06b21131483]: (4, ('path checker states:\nup                  4\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:31:21 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:31:21 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:31:21 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c87789a-6951-4cc8-aa28-58ee17f77481]: (4, ('ok\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:31:21 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-795ce887-04ed-4f58-9f1d-9ea4172b2203 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Flushing IO for device /dev/sdf {{(pid=72382) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 15:31:21 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:31:21 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:31:21 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[f38e7e28-e40f-4a13-9da8-9ed30abf6aca]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:31:21 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-795ce887-04ed-4f58-9f1d-9ea4172b2203 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=72382) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 15:31:21 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:31:21 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.039s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:31:21 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[31434b21-7de3-4193-8168-d5b90963ba89]: (4, ('1', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:31:21 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-795ce887-04ed-4f58-9f1d-9ea4172b2203 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=72382) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 15:31:21 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-795ce887-04ed-4f58-9f1d-9ea4172b2203 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] SCSI volumes sdf have been removed. {{(pid=72382) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 15:31:21 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-795ce887-04ed-4f58-9f1d-9ea4172b2203 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e62d4416-be8c-4327-9a51-0cc509109c53')] {{(pid=72382) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 15:31:21 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e62d4416-be8c-4327-9a51-0cc509109c53 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:31:21 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e62d4416-be8c-4327-9a51-0cc509109c53 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:31:21 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6329ba5-3c82-401c-b4c2-c5050ad44332]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:31:21 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-795ce887-04ed-4f58-9f1d-9ea4172b2203 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:31:21 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e62d4416-be8c-4327-9a51-0cc509109c53 -p 172.16.0.220:3260 --logout {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:31:21 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e62d4416-be8c-4327-9a51-0cc509109c53 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:31:21 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad3408e9-7b2f-4775-8368-1658f06de756]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:e62d4416-be8c-4327-9a51-0cc509109c53, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:e62d4416-be8c-4327-9a51-0cc509109c53, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:31:21 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-795ce887-04ed-4f58-9f1d-9ea4172b2203 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:e62d4416-be8c-4327-9a51-0cc509109c53, portal: 172.16.0.220,3260]
Aug 09 15:31:21 user nova-compute[72382]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:e62d4416-be8c-4327-9a51-0cc509109c53, portal: 172.16.0.220,3260] successful.
Aug 09 15:31:21 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:31:21 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e62d4416-be8c-4327-9a51-0cc509109c53 -p 172.16.0.220:3260 --op delete {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:31:21 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e62d4416-be8c-4327-9a51-0cc509109c53 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:31:21 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f796bd4-7e95-4645-bd6c-9d0e26d5395b]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:31:21 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-795ce887-04ed-4f58-9f1d-9ea4172b2203 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:31:21 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-795ce887-04ed-4f58-9f1d-9ea4172b2203 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.288s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 15:31:21 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-795ce887-04ed-4f58-9f1d-9ea4172b2203 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] <== disconnect_volume: return (289ms) None {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 15:31:21 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-795ce887-04ed-4f58-9f1d-9ea4172b2203 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] [instance: 14c97840-88c0-4a8e-96e8-2e7da318ad07] Disconnected iSCSI Volume {{(pid=72382) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 15:31:22 user nova-compute[72382]: DEBUG nova.objects.instance [None req-795ce887-04ed-4f58-9f1d-9ea4172b2203 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Lazy-loading 'flavor' on Instance uuid 14c97840-88c0-4a8e-96e8-2e7da318ad07 {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:31:22 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-795ce887-04ed-4f58-9f1d-9ea4172b2203 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Lock "14c97840-88c0-4a8e-96e8-2e7da318ad07" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.691s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:31:22 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:31:22 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-bebab398-9fec-4174-8b1d-63d7e19529aa tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Acquiring lock "14c97840-88c0-4a8e-96e8-2e7da318ad07" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:31:22 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-bebab398-9fec-4174-8b1d-63d7e19529aa tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Lock "14c97840-88c0-4a8e-96e8-2e7da318ad07" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:31:22 user nova-compute[72382]: DEBUG nova.compute.manager [None req-bebab398-9fec-4174-8b1d-63d7e19529aa tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] [instance: 14c97840-88c0-4a8e-96e8-2e7da318ad07] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:31:22 user nova-compute[72382]: DEBUG nova.compute.manager [None req-bebab398-9fec-4174-8b1d-63d7e19529aa tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] [instance: 14c97840-88c0-4a8e-96e8-2e7da318ad07] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=72382) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3342}}
Aug 09 15:31:22 user nova-compute[72382]: DEBUG nova.objects.instance [None req-bebab398-9fec-4174-8b1d-63d7e19529aa tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Lazy-loading 'flavor' on Instance uuid 14c97840-88c0-4a8e-96e8-2e7da318ad07 {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:31:23 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:31:23 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:31:23 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:31:23 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:31:23 user nova-compute[72382]: DEBUG nova.compute.manager [req-68054e8d-1464-43cb-b432-2946544ef6a8 req-b2da33dc-000b-41d0-8359-90dc0c7a12a4 service nova] [instance: 14c97840-88c0-4a8e-96e8-2e7da318ad07] Received event network-vif-unplugged-f22c0d53-f0da-4bc9-bf7b-c10fe61e2e1f {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:31:23 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-68054e8d-1464-43cb-b432-2946544ef6a8 req-b2da33dc-000b-41d0-8359-90dc0c7a12a4 service nova] Acquiring lock "14c97840-88c0-4a8e-96e8-2e7da318ad07-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:31:23 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-68054e8d-1464-43cb-b432-2946544ef6a8 req-b2da33dc-000b-41d0-8359-90dc0c7a12a4 service nova] Lock "14c97840-88c0-4a8e-96e8-2e7da318ad07-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:31:23 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-68054e8d-1464-43cb-b432-2946544ef6a8 req-b2da33dc-000b-41d0-8359-90dc0c7a12a4 service nova] Lock "14c97840-88c0-4a8e-96e8-2e7da318ad07-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:31:23 user nova-compute[72382]: DEBUG nova.compute.manager [req-68054e8d-1464-43cb-b432-2946544ef6a8 req-b2da33dc-000b-41d0-8359-90dc0c7a12a4 service nova] [instance: 14c97840-88c0-4a8e-96e8-2e7da318ad07] No waiting events found dispatching network-vif-unplugged-f22c0d53-f0da-4bc9-bf7b-c10fe61e2e1f {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:31:23 user nova-compute[72382]: WARNING nova.compute.manager [req-68054e8d-1464-43cb-b432-2946544ef6a8 req-b2da33dc-000b-41d0-8359-90dc0c7a12a4 service nova] [instance: 14c97840-88c0-4a8e-96e8-2e7da318ad07] Received unexpected event network-vif-unplugged-f22c0d53-f0da-4bc9-bf7b-c10fe61e2e1f for instance with vm_state active and task_state powering-off.
Aug 09 15:31:23 user nova-compute[72382]: INFO nova.virt.libvirt.driver [-] [instance: 14c97840-88c0-4a8e-96e8-2e7da318ad07] Instance destroyed successfully.
Aug 09 15:31:23 user nova-compute[72382]: DEBUG nova.compute.manager [None req-bebab398-9fec-4174-8b1d-63d7e19529aa tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] [instance: 14c97840-88c0-4a8e-96e8-2e7da318ad07] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:31:23 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-bebab398-9fec-4174-8b1d-63d7e19529aa tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Lock "14c97840-88c0-4a8e-96e8-2e7da318ad07" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.836s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:31:24 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:31:25 user nova-compute[72382]: DEBUG nova.compute.manager [req-23be45bd-41a2-4e6b-b43d-be6390f318db req-f9b9f8d4-c0b5-4eab-acb2-08aec2ba63b3 service nova] [instance: 14c97840-88c0-4a8e-96e8-2e7da318ad07] Received event network-vif-plugged-f22c0d53-f0da-4bc9-bf7b-c10fe61e2e1f {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:31:25 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-23be45bd-41a2-4e6b-b43d-be6390f318db req-f9b9f8d4-c0b5-4eab-acb2-08aec2ba63b3 service nova] Acquiring lock "14c97840-88c0-4a8e-96e8-2e7da318ad07-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:31:25 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-23be45bd-41a2-4e6b-b43d-be6390f318db req-f9b9f8d4-c0b5-4eab-acb2-08aec2ba63b3 service nova] Lock "14c97840-88c0-4a8e-96e8-2e7da318ad07-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:31:25 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-23be45bd-41a2-4e6b-b43d-be6390f318db req-f9b9f8d4-c0b5-4eab-acb2-08aec2ba63b3 service nova] Lock "14c97840-88c0-4a8e-96e8-2e7da318ad07-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:31:25 user nova-compute[72382]: DEBUG nova.compute.manager [req-23be45bd-41a2-4e6b-b43d-be6390f318db req-f9b9f8d4-c0b5-4eab-acb2-08aec2ba63b3 service nova] [instance: 14c97840-88c0-4a8e-96e8-2e7da318ad07] No waiting events found dispatching network-vif-plugged-f22c0d53-f0da-4bc9-bf7b-c10fe61e2e1f {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:31:25 user nova-compute[72382]: WARNING nova.compute.manager [req-23be45bd-41a2-4e6b-b43d-be6390f318db req-f9b9f8d4-c0b5-4eab-acb2-08aec2ba63b3 service nova] [instance: 14c97840-88c0-4a8e-96e8-2e7da318ad07] Received unexpected event network-vif-plugged-f22c0d53-f0da-4bc9-bf7b-c10fe61e2e1f for instance with vm_state stopped and task_state None.
Aug 09 15:31:27 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:31:27 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:31:27 user nova-compute[72382]: DEBUG nova.compute.manager [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Cleaning up deleted instances with incomplete migration  {{(pid=72382) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 09 15:31:28 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-1ade1212-df45-4e00-9a57-dd3782bea141 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Acquiring lock "b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:31:28 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-1ade1212-df45-4e00-9a57-dd3782bea141 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Lock "b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:31:28 user nova-compute[72382]: INFO nova.compute.manager [None req-1ade1212-df45-4e00-9a57-dd3782bea141 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] [instance: b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d] Unshelving
Aug 09 15:31:28 user nova-compute[72382]: INFO nova.virt.block_device [None req-1ade1212-df45-4e00-9a57-dd3782bea141 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] [instance: b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d] Booting with volume 8516df70-0781-4493-b04f-417dfdfd5365 at /dev/vdc
Aug 09 15:31:28 user nova-compute[72382]: DEBUG os_brick.utils [None req-1ade1212-df45-4e00-9a57-dd3782bea141 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 15:31:28 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:31:28 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:31:28 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[7af0c432-a43d-4fb9-9a97-f5aef109710f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d2cfa7015fe\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:31:28 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:31:28 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:31:28 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef487238-22d3-44b8-87e8-220d2ee09d18]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:31:28 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:31:28 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:31:28 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[66788210-7c14-4a22-8b0d-5259751bca46]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:31:28 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c54f390-92d5-4457-a26d-6436d5cf9d80]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:31:28 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-1ade1212-df45-4e00-9a57-dd3782bea141 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Running cmd (subprocess): nvme version {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:31:28 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-1ade1212-df45-4e00-9a57-dd3782bea141 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] 'nvme version' failed. Not Retrying. {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 15:31:28 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1ade1212-df45-4e00-9a57-dd3782bea141 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] nvme not present on system {{(pid=72382) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 15:31:28 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:31:28 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 15:31:28 user nova-compute[72382]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 15:31:28 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c56f01b-7737-4c56-a022-54b59da63209]: (4, '') {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:31:28 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.lightos [None req-1ade1212-df45-4e00-9a57-dd3782bea141 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72382) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 15:31:28 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.lightos [None req-1ade1212-df45-4e00-9a57-dd3782bea141 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72382) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 15:31:28 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.lightos [None req-1ade1212-df45-4e00-9a57-dd3782bea141 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] LIGHTOS: no hostnqn found. {{(pid=72382) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 15:31:28 user nova-compute[72382]: DEBUG os_brick.utils [None req-1ade1212-df45-4e00-9a57-dd3782bea141 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d2cfa7015fe', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 15:31:28 user nova-compute[72382]: DEBUG nova.virt.block_device [None req-1ade1212-df45-4e00-9a57-dd3782bea141 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] [instance: b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d] Updating existing volume attachment record: d0905442-3624-4388-9c97-28aaa9e63f40 {{(pid=72382) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 15:31:29 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:31:31 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:31:32 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:31:34 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:31:37 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-1ade1212-df45-4e00-9a57-dd3782bea141 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:31:37 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-1ade1212-df45-4e00-9a57-dd3782bea141 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:31:37 user nova-compute[72382]: DEBUG nova.objects.instance [None req-1ade1212-df45-4e00-9a57-dd3782bea141 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Lazy-loading 'pci_requests' on Instance uuid b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:31:37 user nova-compute[72382]: DEBUG nova.objects.instance [None req-1ade1212-df45-4e00-9a57-dd3782bea141 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Lazy-loading 'numa_topology' on Instance uuid b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:31:37 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-1ade1212-df45-4e00-9a57-dd3782bea141 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72382) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 15:31:37 user nova-compute[72382]: INFO nova.compute.claims [None req-1ade1212-df45-4e00-9a57-dd3782bea141 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] [instance: b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d] Claim successful on node user
Aug 09 15:31:37 user nova-compute[72382]: DEBUG nova.scheduler.client.report [None req-1ade1212-df45-4e00-9a57-dd3782bea141 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Refreshing inventories for resource provider 7b15b0e5-df4d-49db-833b-2855d21d10ae {{(pid=72382) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 09 15:31:37 user nova-compute[72382]: DEBUG nova.scheduler.client.report [None req-1ade1212-df45-4e00-9a57-dd3782bea141 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Updating ProviderTree inventory for provider 7b15b0e5-df4d-49db-833b-2855d21d10ae from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72382) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 09 15:31:37 user nova-compute[72382]: DEBUG nova.compute.provider_tree [None req-1ade1212-df45-4e00-9a57-dd3782bea141 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Updating inventory in ProviderTree for provider 7b15b0e5-df4d-49db-833b-2855d21d10ae with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72382) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 09 15:31:37 user nova-compute[72382]: DEBUG nova.scheduler.client.report [None req-1ade1212-df45-4e00-9a57-dd3782bea141 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Refreshing aggregate associations for resource provider 7b15b0e5-df4d-49db-833b-2855d21d10ae, aggregates: None {{(pid=72382) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 09 15:31:37 user nova-compute[72382]: DEBUG nova.scheduler.client.report [None req-1ade1212-df45-4e00-9a57-dd3782bea141 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Refreshing trait associations for resource provider 7b15b0e5-df4d-49db-833b-2855d21d10ae, traits: COMPUTE_DEVICE_TAGGING,COMPUTE_NODE,COMPUTE_VOLUME_EXTEND,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE42,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_MMX,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE2 {{(pid=72382) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 09 15:31:37 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:31:37 user nova-compute[72382]: DEBUG nova.compute.provider_tree [None req-1ade1212-df45-4e00-9a57-dd3782bea141 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Inventory has not changed in ProviderTree for provider: 7b15b0e5-df4d-49db-833b-2855d21d10ae {{(pid=72382) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 15:31:37 user nova-compute[72382]: DEBUG nova.scheduler.client.report [None req-1ade1212-df45-4e00-9a57-dd3782bea141 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Inventory has not changed for provider 7b15b0e5-df4d-49db-833b-2855d21d10ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72382) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 15:31:37 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-1ade1212-df45-4e00-9a57-dd3782bea141 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.628s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:31:38 user nova-compute[72382]: INFO nova.network.neutron [None req-1ade1212-df45-4e00-9a57-dd3782bea141 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] [instance: b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d] Updating port 99b65ca7-d891-4625-917d-460e7fb69654 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Aug 09 15:31:38 user nova-compute[72382]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691595083.6668046, 14c97840-88c0-4a8e-96e8-2e7da318ad07 => Stopped> {{(pid=72382) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 15:31:38 user nova-compute[72382]: INFO nova.compute.manager [-] [instance: 14c97840-88c0-4a8e-96e8-2e7da318ad07] VM Stopped (Lifecycle Event)
Aug 09 15:31:38 user nova-compute[72382]: DEBUG nova.compute.manager [None req-f2ef1e06-a90a-4559-a423-fbc599b761ae None None] [instance: 14c97840-88c0-4a8e-96e8-2e7da318ad07] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:31:38 user nova-compute[72382]: DEBUG nova.compute.manager [None req-f2ef1e06-a90a-4559-a423-fbc599b761ae None None] [instance: 14c97840-88c0-4a8e-96e8-2e7da318ad07] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=72382) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 15:31:38 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-1ade1212-df45-4e00-9a57-dd3782bea141 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Acquiring lock "refresh_cache-b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 15:31:38 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-1ade1212-df45-4e00-9a57-dd3782bea141 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Acquired lock "refresh_cache-b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 15:31:38 user nova-compute[72382]: DEBUG nova.network.neutron [None req-1ade1212-df45-4e00-9a57-dd3782bea141 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] [instance: b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d] Building network info cache for instance {{(pid=72382) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 15:31:38 user nova-compute[72382]: DEBUG nova.compute.manager [req-6b9297d4-54ac-4163-ac49-d12adebfaa5f req-13e00992-e89c-4ec4-8343-a19763700d3a service nova] [instance: b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d] Received event network-changed-99b65ca7-d891-4625-917d-460e7fb69654 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:31:38 user nova-compute[72382]: DEBUG nova.compute.manager [req-6b9297d4-54ac-4163-ac49-d12adebfaa5f req-13e00992-e89c-4ec4-8343-a19763700d3a service nova] [instance: b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d] Refreshing instance network info cache due to event network-changed-99b65ca7-d891-4625-917d-460e7fb69654. {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 15:31:38 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-6b9297d4-54ac-4163-ac49-d12adebfaa5f req-13e00992-e89c-4ec4-8343-a19763700d3a service nova] Acquiring lock "refresh_cache-b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 15:31:39 user nova-compute[72382]: DEBUG nova.network.neutron [None req-1ade1212-df45-4e00-9a57-dd3782bea141 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] [instance: b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d] Updating instance_info_cache with network_info: [{"id": "99b65ca7-d891-4625-917d-460e7fb69654", "address": "fa:16:3e:98:b9:f2", "network": {"id": "643703fd-46b7-4309-862c-109141cb008c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-512918576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.131", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa6db5fd3ce24c1cadbedd64757e219b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99b65ca7-d8", "ovs_interfaceid": "99b65ca7-d891-4625-917d-460e7fb69654", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:31:39 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-1ade1212-df45-4e00-9a57-dd3782bea141 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Releasing lock "refresh_cache-b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 15:31:39 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-1ade1212-df45-4e00-9a57-dd3782bea141 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] [instance: b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d] Creating instance directory {{(pid=72382) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 15:31:39 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-1ade1212-df45-4e00-9a57-dd3782bea141 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] [instance: b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d] Creating image(s)
Aug 09 15:31:39 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-1ade1212-df45-4e00-9a57-dd3782bea141 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Acquiring lock "/opt/stack/data/nova/instances/b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:31:39 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-1ade1212-df45-4e00-9a57-dd3782bea141 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Lock "/opt/stack/data/nova/instances/b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:31:39 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-1ade1212-df45-4e00-9a57-dd3782bea141 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Lock "/opt/stack/data/nova/instances/b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:31:39 user nova-compute[72382]: DEBUG nova.objects.instance [None req-1ade1212-df45-4e00-9a57-dd3782bea141 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Lazy-loading 'trusted_certs' on Instance uuid b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:31:39 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-6b9297d4-54ac-4163-ac49-d12adebfaa5f req-13e00992-e89c-4ec4-8343-a19763700d3a service nova] Acquired lock "refresh_cache-b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 15:31:39 user nova-compute[72382]: DEBUG nova.network.neutron [req-6b9297d4-54ac-4163-ac49-d12adebfaa5f req-13e00992-e89c-4ec4-8343-a19763700d3a service nova] [instance: b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d] Refreshing network info cache for port 99b65ca7-d891-4625-917d-460e7fb69654 {{(pid=72382) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 15:31:39 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-1ade1212-df45-4e00-9a57-dd3782bea141 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Acquiring lock "eeff274e00b96a48abd49754175a87239faf62c7" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:31:39 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-1ade1212-df45-4e00-9a57-dd3782bea141 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Lock "eeff274e00b96a48abd49754175a87239faf62c7" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.004s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:31:39 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:31:40 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-1ade1212-df45-4e00-9a57-dd3782bea141 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eeff274e00b96a48abd49754175a87239faf62c7.part --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:31:40 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-1ade1212-df45-4e00-9a57-dd3782bea141 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eeff274e00b96a48abd49754175a87239faf62c7.part --force-share --output=json" returned: 0 in 0.167s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:31:40 user nova-compute[72382]: DEBUG nova.virt.images [None req-1ade1212-df45-4e00-9a57-dd3782bea141 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] 1abdf598-2e0e-40ba-a420-05440167d4ed was qcow2, converting to raw {{(pid=72382) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 09 15:31:40 user nova-compute[72382]: DEBUG nova.privsep.utils [None req-1ade1212-df45-4e00-9a57-dd3782bea141 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72382) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 09 15:31:40 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-1ade1212-df45-4e00-9a57-dd3782bea141 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/eeff274e00b96a48abd49754175a87239faf62c7.part /opt/stack/data/nova/instances/_base/eeff274e00b96a48abd49754175a87239faf62c7.converted {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:31:41 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-1ade1212-df45-4e00-9a57-dd3782bea141 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/eeff274e00b96a48abd49754175a87239faf62c7.part /opt/stack/data/nova/instances/_base/eeff274e00b96a48abd49754175a87239faf62c7.converted" returned: 0 in 0.365s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:31:41 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-1ade1212-df45-4e00-9a57-dd3782bea141 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eeff274e00b96a48abd49754175a87239faf62c7.converted --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:31:41 user nova-compute[72382]: DEBUG nova.network.neutron [req-6b9297d4-54ac-4163-ac49-d12adebfaa5f req-13e00992-e89c-4ec4-8343-a19763700d3a service nova] [instance: b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d] Updated VIF entry in instance network info cache for port 99b65ca7-d891-4625-917d-460e7fb69654. {{(pid=72382) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 15:31:41 user nova-compute[72382]: DEBUG nova.network.neutron [req-6b9297d4-54ac-4163-ac49-d12adebfaa5f req-13e00992-e89c-4ec4-8343-a19763700d3a service nova] [instance: b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d] Updating instance_info_cache with network_info: [{"id": "99b65ca7-d891-4625-917d-460e7fb69654", "address": "fa:16:3e:98:b9:f2", "network": {"id": "643703fd-46b7-4309-862c-109141cb008c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-512918576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.131", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa6db5fd3ce24c1cadbedd64757e219b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99b65ca7-d8", "ovs_interfaceid": "99b65ca7-d891-4625-917d-460e7fb69654", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:31:41 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-6b9297d4-54ac-4163-ac49-d12adebfaa5f req-13e00992-e89c-4ec4-8343-a19763700d3a service nova] Releasing lock "refresh_cache-b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 15:31:41 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-1ade1212-df45-4e00-9a57-dd3782bea141 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eeff274e00b96a48abd49754175a87239faf62c7.converted --force-share --output=json" returned: 0 in 0.145s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:31:41 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-1ade1212-df45-4e00-9a57-dd3782bea141 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Lock "eeff274e00b96a48abd49754175a87239faf62c7" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.850s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:31:41 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-1ade1212-df45-4e00-9a57-dd3782bea141 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eeff274e00b96a48abd49754175a87239faf62c7 --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:31:41 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-1ade1212-df45-4e00-9a57-dd3782bea141 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eeff274e00b96a48abd49754175a87239faf62c7 --force-share --output=json" returned: 0 in 0.136s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:31:41 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-1ade1212-df45-4e00-9a57-dd3782bea141 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Acquiring lock "eeff274e00b96a48abd49754175a87239faf62c7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:31:41 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-1ade1212-df45-4e00-9a57-dd3782bea141 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Lock "eeff274e00b96a48abd49754175a87239faf62c7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:31:41 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-1ade1212-df45-4e00-9a57-dd3782bea141 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eeff274e00b96a48abd49754175a87239faf62c7 --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:31:41 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-1ade1212-df45-4e00-9a57-dd3782bea141 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eeff274e00b96a48abd49754175a87239faf62c7 --force-share --output=json" returned: 0 in 0.136s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:31:41 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-1ade1212-df45-4e00-9a57-dd3782bea141 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eeff274e00b96a48abd49754175a87239faf62c7,backing_fmt=raw /opt/stack/data/nova/instances/b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d/disk 1073741824 {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:31:41 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-1ade1212-df45-4e00-9a57-dd3782bea141 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eeff274e00b96a48abd49754175a87239faf62c7,backing_fmt=raw /opt/stack/data/nova/instances/b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d/disk 1073741824" returned: 0 in 0.062s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:31:41 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-1ade1212-df45-4e00-9a57-dd3782bea141 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Lock "eeff274e00b96a48abd49754175a87239faf62c7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.205s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:31:41 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-1ade1212-df45-4e00-9a57-dd3782bea141 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eeff274e00b96a48abd49754175a87239faf62c7 --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:31:41 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-1ade1212-df45-4e00-9a57-dd3782bea141 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eeff274e00b96a48abd49754175a87239faf62c7 --force-share --output=json" returned: 0 in 0.139s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:31:41 user nova-compute[72382]: DEBUG nova.objects.instance [None req-1ade1212-df45-4e00-9a57-dd3782bea141 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Lazy-loading 'migration_context' on Instance uuid b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:31:41 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-1ade1212-df45-4e00-9a57-dd3782bea141 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] [instance: b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d] Rebasing disk image.
Aug 09 15:31:41 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-1ade1212-df45-4e00-9a57-dd3782bea141 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:31:41 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-1ade1212-df45-4e00-9a57-dd3782bea141 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b --force-share --output=json" returned: 0 in 0.138s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:31:41 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-1ade1212-df45-4e00-9a57-dd3782bea141 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b -F raw /opt/stack/data/nova/instances/b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d/disk {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:31:42 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:31:44 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-7d3bed69-fedc-4470-89d2-ad61dd6be96f tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Acquiring lock "266be814-4a2b-4f8e-a0f6-e8821fdeb95d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:31:44 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-7d3bed69-fedc-4470-89d2-ad61dd6be96f tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Lock "266be814-4a2b-4f8e-a0f6-e8821fdeb95d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:31:44 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-7d3bed69-fedc-4470-89d2-ad61dd6be96f tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Acquiring lock "266be814-4a2b-4f8e-a0f6-e8821fdeb95d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:31:44 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-7d3bed69-fedc-4470-89d2-ad61dd6be96f tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Lock "266be814-4a2b-4f8e-a0f6-e8821fdeb95d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:31:44 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-7d3bed69-fedc-4470-89d2-ad61dd6be96f tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Lock "266be814-4a2b-4f8e-a0f6-e8821fdeb95d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:31:44 user nova-compute[72382]: INFO nova.compute.manager [None req-7d3bed69-fedc-4470-89d2-ad61dd6be96f tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] [instance: 266be814-4a2b-4f8e-a0f6-e8821fdeb95d] Terminating instance
Aug 09 15:31:44 user nova-compute[72382]: DEBUG nova.compute.manager [None req-7d3bed69-fedc-4470-89d2-ad61dd6be96f tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] [instance: 266be814-4a2b-4f8e-a0f6-e8821fdeb95d] Start destroying the instance on the hypervisor. {{(pid=72382) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 15:31:44 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-1ade1212-df45-4e00-9a57-dd3782bea141 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b -F raw /opt/stack/data/nova/instances/b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d/disk" returned: 0 in 2.542s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:31:44 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-1ade1212-df45-4e00-9a57-dd3782bea141 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] [instance: b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d] Created local disks {{(pid=72382) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 15:31:44 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-1ade1212-df45-4e00-9a57-dd3782bea141 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] [instance: b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d] Ensure instance console log exists: /opt/stack/data/nova/instances/b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d/console.log {{(pid=72382) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 15:31:44 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-1ade1212-df45-4e00-9a57-dd3782bea141 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:31:44 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-1ade1212-df45-4e00-9a57-dd3782bea141 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:31:44 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-1ade1212-df45-4e00-9a57-dd3782bea141 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:31:44 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-1ade1212-df45-4e00-9a57-dd3782bea141 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] [instance: b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d] Start _get_guest_xml network_info=[{"id": "99b65ca7-d891-4625-917d-460e7fb69654", "address": "fa:16:3e:98:b9:f2", "network": {"id": "643703fd-46b7-4309-862c-109141cb008c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-512918576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.131", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa6db5fd3ce24c1cadbedd64757e219b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99b65ca7-d8", "ovs_interfaceid": "99b65ca7-d891-4625-917d-460e7fb69654", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='d7e7205a074d15100c558962411c635c',container_format='bare',created_at=2023-08-09T15:29:35Z,direct_url=<?>,disk_format='qcow2',id=1abdf598-2e0e-40ba-a420-05440167d4ed,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1040530269-shelved',owner='aa6db5fd3ce24c1cadbedd64757e219b',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-09T15:29:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'a79f2cea-eb27-4631-aaf3-05e7d9e411b4'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'boot_index': None, 'mount_device': '/dev/vdc', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:8516df70-0781-4493-b04f-417dfdfd5365'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MTNfcoAF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': 'b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d', 'attached_at': '', 'detached_at': '', 'volume_id': '8516df70-0781-4493-b04f-417dfdfd5365', 'serial': '8516df70-0781-4493-b04f-417dfdfd5365'}, 'disk_bus': 'virtio', 'attachment_id': 'd0905442-3624-4388-9c97-28aaa9e63f40', 'delete_on_termination': False, 'volume_type': None} {{(pid=72382) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 15:31:44 user nova-compute[72382]: WARNING nova.virt.libvirt.driver [None req-1ade1212-df45-4e00-9a57-dd3782bea141 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 15:31:44 user nova-compute[72382]: WARNING nova.virt.libvirt.driver [None req-1ade1212-df45-4e00-9a57-dd3782bea141 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 15:31:44 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-1ade1212-df45-4e00-9a57-dd3782bea141 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72382) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 15:31:44 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-1ade1212-df45-4e00-9a57-dd3782bea141 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] CPU controller missing on host. {{(pid=72382) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 15:31:44 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-1ade1212-df45-4e00-9a57-dd3782bea141 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72382) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 15:31:44 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-1ade1212-df45-4e00-9a57-dd3782bea141 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] CPU controller found on host. {{(pid=72382) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 15:31:44 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-1ade1212-df45-4e00-9a57-dd3782bea141 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72382) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 15:31:44 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-1ade1212-df45-4e00-9a57-dd3782bea141 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T15:11:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d7e7205a074d15100c558962411c635c',container_format='bare',created_at=2023-08-09T15:29:35Z,direct_url=<?>,disk_format='qcow2',id=1abdf598-2e0e-40ba-a420-05440167d4ed,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1040530269-shelved',owner='aa6db5fd3ce24c1cadbedd64757e219b',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-09T15:29:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 15:31:44 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-1ade1212-df45-4e00-9a57-dd3782bea141 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Flavor limits 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 15:31:44 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-1ade1212-df45-4e00-9a57-dd3782bea141 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Image limits 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 15:31:44 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-1ade1212-df45-4e00-9a57-dd3782bea141 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Flavor pref 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 15:31:44 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-1ade1212-df45-4e00-9a57-dd3782bea141 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Image pref 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 15:31:44 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-1ade1212-df45-4e00-9a57-dd3782bea141 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 15:31:44 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-1ade1212-df45-4e00-9a57-dd3782bea141 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 15:31:44 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-1ade1212-df45-4e00-9a57-dd3782bea141 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72382) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 15:31:44 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-1ade1212-df45-4e00-9a57-dd3782bea141 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Got 1 possible topologies {{(pid=72382) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 15:31:44 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-1ade1212-df45-4e00-9a57-dd3782bea141 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 15:31:44 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-1ade1212-df45-4e00-9a57-dd3782bea141 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 15:31:44 user nova-compute[72382]: DEBUG nova.objects.instance [None req-1ade1212-df45-4e00-9a57-dd3782bea141 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Lazy-loading 'vcpu_model' on Instance uuid b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:31:44 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1ade1212-df45-4e00-9a57-dd3782bea141 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] [instance: b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d] Calling os-brick to attach iSCSI Volume {{(pid=72382) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 15:31:44 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ade1212-df45-4e00-9a57-dd3782bea141 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2a0c768340>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:8516df70-0781-4493-b04f-417dfdfd5365'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MTNfcoAF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 15:31:44 user nova-compute[72382]: WARNING os_brick.initiator.connectors.base [None req-1ade1212-df45-4e00-9a57-dd3782bea141 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 15:31:44 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-1ade1212-df45-4e00-9a57-dd3782bea141 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 15:31:44 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-1ade1212-df45-4e00-9a57-dd3782bea141 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 15:31:44 user nova-compute[72382]: WARNING os_brick.initiator.connectors.base [None req-1ade1212-df45-4e00-9a57-dd3782bea141 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 15:31:44 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-1ade1212-df45-4e00-9a57-dd3782bea141 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8516df70-0781-4493-b04f-417dfdfd5365" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 15:31:44 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-1ade1212-df45-4e00-9a57-dd3782bea141 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8516df70-0781-4493-b04f-417dfdfd5365" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 15:31:44 user nova-compute[72382]: INFO os_brick.initiator.connectors.iscsi [None req-1ade1212-df45-4e00-9a57-dd3782bea141 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 15:31:44 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8516df70-0781-4493-b04f-417dfdfd5365 -p 172.16.0.220:3260 {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:31:44 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8516df70-0781-4493-b04f-417dfdfd5365 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:31:44 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc4f1e2c-7701-4a9e-a5d5-1af2047380d8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:31:44 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ade1212-df45-4e00-9a57-dd3782bea141 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 15:31:44 user nova-compute[72382]:  {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:31:44 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8516df70-0781-4493-b04f-417dfdfd5365 -p 172.16.0.220:3260 --interface default --op new {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:31:44 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:31:44 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8516df70-0781-4493-b04f-417dfdfd5365 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.031s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:31:44 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e873598-ed58-4347-bb5f-f29993c290c5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8516df70-0781-4493-b04f-417dfdfd5365] added\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:31:44 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ade1212-df45-4e00-9a57-dd3782bea141 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8516df70-0781-4493-b04f-417dfdfd5365] added
Aug 09 15:31:44 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:31:44 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8516df70-0781-4493-b04f-417dfdfd5365 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:31:44 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:31:44 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8516df70-0781-4493-b04f-417dfdfd5365 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.030s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:31:44 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[758c855a-e037-479f-8715-a1666ff5ac05]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:31:44 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ade1212-df45-4e00-9a57-dd3782bea141 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:31:44 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8516df70-0781-4493-b04f-417dfdfd5365 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:31:44 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8516df70-0781-4493-b04f-417dfdfd5365 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:31:44 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[423d4f43-c86b-433e-8bb4-bf1ad552ab74]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:31:44 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ade1212-df45-4e00-9a57-dd3782bea141 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:31:44 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8516df70-0781-4493-b04f-417dfdfd5365 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MTNfcoAF {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:31:44 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8516df70-0781-4493-b04f-417dfdfd5365 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MTNfcoAF" returned: 0 in 0.020s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:31:44 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[f95b8cde-d4da-4908-bb00-5c697fdc1b2a]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:31:44 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ade1212-df45-4e00-9a57-dd3782bea141 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MTNfcoAF'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:31:44 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8516df70-0781-4493-b04f-417dfdfd5365 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:31:44 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8516df70-0781-4493-b04f-417dfdfd5365 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:31:44 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[938e0953-4abf-4721-b24b-ff997c3c18b7]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:31:44 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ade1212-df45-4e00-9a57-dd3782bea141 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:31:44 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:31:44 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:31:44 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[d00565c0-874c-4d59-ac80-14848fa9116f]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25503c6e-bfc0-4008-846a-8cad783fc0fb (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5cfefdb-a454-494f-ab09-acf8644352a3 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59852df5-d4c8-4f25-8693-36181ff6a447 (non-flash)\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:31:44 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ade1212-df45-4e00-9a57-dd3782bea141 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)
Aug 09 15:31:44 user nova-compute[72382]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25503c6e-bfc0-4008-846a-8cad783fc0fb (non-flash)
Aug 09 15:31:44 user nova-compute[72382]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5cfefdb-a454-494f-ab09-acf8644352a3 (non-flash)
Aug 09 15:31:44 user nova-compute[72382]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59852df5-d4c8-4f25-8693-36181ff6a447 (non-flash)
Aug 09 15:31:44 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 15:31:44 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ade1212-df45-4e00-9a57-dd3782bea141 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)
Aug 09 15:31:44 user nova-compute[72382]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25503c6e-bfc0-4008-846a-8cad783fc0fb (non-flash)
Aug 09 15:31:44 user nova-compute[72382]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5cfefdb-a454-494f-ab09-acf8644352a3 (non-flash)
Aug 09 15:31:44 user nova-compute[72382]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59852df5-d4c8-4f25-8693-36181ff6a447 (non-flash)
Aug 09 15:31:44 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 15:31:44 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8516df70-0781-4493-b04f-417dfdfd5365 -p 172.16.0.220:3260 --login {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:31:44 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8516df70-0781-4493-b04f-417dfdfd5365 -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:31:44 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[347644e5-d2ad-4732-9cec-7874daf66ced]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8516df70-0781-4493-b04f-417dfdfd5365, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8516df70-0781-4493-b04f-417dfdfd5365, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:31:44 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ade1212-df45-4e00-9a57-dd3782bea141 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8516df70-0781-4493-b04f-417dfdfd5365, portal: 172.16.0.220,3260]
Aug 09 15:31:44 user nova-compute[72382]: Login to [iface: default, target: iqn.2010-10.org.openstack:8516df70-0781-4493-b04f-417dfdfd5365, portal: 172.16.0.220,3260] successful.
Aug 09 15:31:44 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:31:44 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8516df70-0781-4493-b04f-417dfdfd5365 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:31:44 user nova-compute[72382]: DEBUG nova.compute.manager [req-fc8e906d-5f60-4901-84b5-f50884a1eaa1 req-d63dbadf-5927-47cf-b923-e076555010d5 service nova] [instance: 266be814-4a2b-4f8e-a0f6-e8821fdeb95d] Received event network-vif-unplugged-48650c01-c5a9-44f2-a481-5120c429a5a5 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:31:44 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-fc8e906d-5f60-4901-84b5-f50884a1eaa1 req-d63dbadf-5927-47cf-b923-e076555010d5 service nova] Acquiring lock "266be814-4a2b-4f8e-a0f6-e8821fdeb95d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:31:44 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-fc8e906d-5f60-4901-84b5-f50884a1eaa1 req-d63dbadf-5927-47cf-b923-e076555010d5 service nova] Lock "266be814-4a2b-4f8e-a0f6-e8821fdeb95d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:31:44 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-fc8e906d-5f60-4901-84b5-f50884a1eaa1 req-d63dbadf-5927-47cf-b923-e076555010d5 service nova] Lock "266be814-4a2b-4f8e-a0f6-e8821fdeb95d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:31:44 user nova-compute[72382]: DEBUG nova.compute.manager [req-fc8e906d-5f60-4901-84b5-f50884a1eaa1 req-d63dbadf-5927-47cf-b923-e076555010d5 service nova] [instance: 266be814-4a2b-4f8e-a0f6-e8821fdeb95d] No waiting events found dispatching network-vif-unplugged-48650c01-c5a9-44f2-a481-5120c429a5a5 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:31:44 user nova-compute[72382]: DEBUG nova.compute.manager [req-fc8e906d-5f60-4901-84b5-f50884a1eaa1 req-d63dbadf-5927-47cf-b923-e076555010d5 service nova] [instance: 266be814-4a2b-4f8e-a0f6-e8821fdeb95d] Received event network-vif-unplugged-48650c01-c5a9-44f2-a481-5120c429a5a5 for instance with task_state deleting. {{(pid=72382) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 15:31:44 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8516df70-0781-4493-b04f-417dfdfd5365 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:31:44 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e73904b-3b94-4114-b7dc-11f1e02a1252]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:31:44 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ade1212-df45-4e00-9a57-dd3782bea141 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:31:44 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:31:44 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:31:44 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:31:44 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:31:44 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[f238008b-e52e-4689-9ca6-a2f5e4f70624]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25503c6e-bfc0-4008-846a-8cad783fc0fb (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5cfefdb-a454-494f-ab09-acf8644352a3 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59852df5-d4c8-4f25-8693-36181ff6a447 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8516df70-0781-4493-b04f-417dfdfd5365 (non-flash)\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:31:44 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ade1212-df45-4e00-9a57-dd3782bea141 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)
Aug 09 15:31:44 user nova-compute[72382]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25503c6e-bfc0-4008-846a-8cad783fc0fb (non-flash)
Aug 09 15:31:44 user nova-compute[72382]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5cfefdb-a454-494f-ab09-acf8644352a3 (non-flash)
Aug 09 15:31:44 user nova-compute[72382]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59852df5-d4c8-4f25-8693-36181ff6a447 (non-flash)
Aug 09 15:31:44 user nova-compute[72382]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8516df70-0781-4493-b04f-417dfdfd5365 (non-flash)
Aug 09 15:31:44 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 15:31:44 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ade1212-df45-4e00-9a57-dd3782bea141 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)
Aug 09 15:31:44 user nova-compute[72382]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25503c6e-bfc0-4008-846a-8cad783fc0fb (non-flash)
Aug 09 15:31:44 user nova-compute[72382]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5cfefdb-a454-494f-ab09-acf8644352a3 (non-flash)
Aug 09 15:31:44 user nova-compute[72382]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59852df5-d4c8-4f25-8693-36181ff6a447 (non-flash)
Aug 09 15:31:44 user nova-compute[72382]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8516df70-0781-4493-b04f-417dfdfd5365 (non-flash)
Aug 09 15:31:44 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 15:31:44 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-1ade1212-df45-4e00-9a57-dd3782bea141 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8516df70-0781-4493-b04f-417dfdfd5365" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.342s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 15:31:44 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ade1212-df45-4e00-9a57-dd3782bea141 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Connected to 172.16.0.220:3260 {{(pid=72382) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 15:31:44 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-1ade1212-df45-4e00-9a57-dd3782bea141 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] HCTL ('37', '-', '-', 0) found on session 41 with lun 0 {{(pid=72382) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 15:31:44 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-1ade1212-df45-4e00-9a57-dd3782bea141 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=72382) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 15:31:44 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:31:44 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.021s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:31:44 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[74c21416-12a2-44d5-9b48-81a77a7fe51f]: (4, ('- - 0', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:31:44 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-1ade1212-df45-4e00-9a57-dd3782bea141 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Searching for a device in session 41 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=72382) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 15:31:44 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ade1212-df45-4e00-9a57-dd3782bea141 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MTNfcoAF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72382) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 15:31:45 user nova-compute[72382]: INFO nova.virt.libvirt.driver [-] [instance: 266be814-4a2b-4f8e-a0f6-e8821fdeb95d] Instance destroyed successfully.
Aug 09 15:31:45 user nova-compute[72382]: DEBUG nova.objects.instance [None req-7d3bed69-fedc-4470-89d2-ad61dd6be96f tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Lazy-loading 'resources' on Instance uuid 266be814-4a2b-4f8e-a0f6-e8821fdeb95d {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:31:45 user nova-compute[72382]: DEBUG nova.virt.libvirt.vif [None req-7d3bed69-fedc-4470-89d2-ad61dd6be96f tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T15:15:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1904336264',display_name='tempest-ServerRescueNegativeTestJSON-server-1904336264',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1904336264',id=4,image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-09T15:17:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='990ba791030940d38360af5879c853c5',ramdisk_id='',reservation_id='r-odim6gvi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-867522113',owner_user_name='tempest-ServerRescueNegativeTestJSON-867522113-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T15:17:14Z,user_data=None,user_id='f94ca386a2be42cfbc2407bb7520cd25',uuid=266be814-4a2b-4f8e-a0f6-e8821fdeb95d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "48650c01-c5a9-44f2-a481-5120c429a5a5", "address": "fa:16:3e:25:0d:d4", "network": {"id": "46ef00c7-17ee-4e45-ba1d-dcc0a417ea85", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1360012261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "990ba791030940d38360af5879c853c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48650c01-c5", "ovs_interfaceid": "48650c01-c5a9-44f2-a481-5120c429a5a5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 15:31:45 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-7d3bed69-fedc-4470-89d2-ad61dd6be96f tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Converting VIF {"id": "48650c01-c5a9-44f2-a481-5120c429a5a5", "address": "fa:16:3e:25:0d:d4", "network": {"id": "46ef00c7-17ee-4e45-ba1d-dcc0a417ea85", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1360012261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "990ba791030940d38360af5879c853c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48650c01-c5", "ovs_interfaceid": "48650c01-c5a9-44f2-a481-5120c429a5a5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 15:31:45 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-7d3bed69-fedc-4470-89d2-ad61dd6be96f tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:25:0d:d4,bridge_name='br-int',has_traffic_filtering=True,id=48650c01-c5a9-44f2-a481-5120c429a5a5,network=Network(46ef00c7-17ee-4e45-ba1d-dcc0a417ea85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48650c01-c5') {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 15:31:45 user nova-compute[72382]: DEBUG os_vif [None req-7d3bed69-fedc-4470-89d2-ad61dd6be96f tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:25:0d:d4,bridge_name='br-int',has_traffic_filtering=True,id=48650c01-c5a9-44f2-a481-5120c429a5a5,network=Network(46ef00c7-17ee-4e45-ba1d-dcc0a417ea85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48650c01-c5') {{(pid=72382) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 15:31:45 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:31:45 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap48650c01-c5, bridge=br-int, if_exists=True) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:31:45 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:31:45 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:31:45 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:31:45 user nova-compute[72382]: INFO os_vif [None req-7d3bed69-fedc-4470-89d2-ad61dd6be96f tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:25:0d:d4,bridge_name='br-int',has_traffic_filtering=True,id=48650c01-c5a9-44f2-a481-5120c429a5a5,network=Network(46ef00c7-17ee-4e45-ba1d-dcc0a417ea85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48650c01-c5')
Aug 09 15:31:45 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-7d3bed69-fedc-4470-89d2-ad61dd6be96f tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] [instance: 266be814-4a2b-4f8e-a0f6-e8821fdeb95d] Deleting instance files /opt/stack/data/nova/instances/266be814-4a2b-4f8e-a0f6-e8821fdeb95d_del
Aug 09 15:31:45 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-7d3bed69-fedc-4470-89d2-ad61dd6be96f tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] [instance: 266be814-4a2b-4f8e-a0f6-e8821fdeb95d] Deletion of /opt/stack/data/nova/instances/266be814-4a2b-4f8e-a0f6-e8821fdeb95d_del complete
Aug 09 15:31:45 user nova-compute[72382]: INFO nova.compute.manager [None req-7d3bed69-fedc-4470-89d2-ad61dd6be96f tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] [instance: 266be814-4a2b-4f8e-a0f6-e8821fdeb95d] Took 0.84 seconds to destroy the instance on the hypervisor.
Aug 09 15:31:45 user nova-compute[72382]: DEBUG oslo.service.loopingcall [None req-7d3bed69-fedc-4470-89d2-ad61dd6be96f tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72382) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 15:31:45 user nova-compute[72382]: DEBUG nova.compute.manager [-] [instance: 266be814-4a2b-4f8e-a0f6-e8821fdeb95d] Deallocating network for instance {{(pid=72382) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 15:31:45 user nova-compute[72382]: DEBUG nova.network.neutron [-] [instance: 266be814-4a2b-4f8e-a0f6-e8821fdeb95d] deallocate_for_instance() {{(pid=72382) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 15:31:45 user nova-compute[72382]: DEBUG nova.network.neutron [-] [instance: 266be814-4a2b-4f8e-a0f6-e8821fdeb95d] Updating instance_info_cache with network_info: [] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:31:45 user nova-compute[72382]: INFO nova.compute.manager [-] [instance: 266be814-4a2b-4f8e-a0f6-e8821fdeb95d] Took 0.62 seconds to deallocate network for instance.
Aug 09 15:31:45 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-1ade1212-df45-4e00-9a57-dd3782bea141 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.388s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 15:31:45 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ade1212-df45-4e00-9a57-dd3782bea141 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] <== connect_volume: return (1389ms) {'type': 'block', 'scsi_wwn': '23539343338306364', 'path': '/dev/sdf'} {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 15:31:45 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1ade1212-df45-4e00-9a57-dd3782bea141 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] [instance: b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23539343338306364', 'path': '/dev/sdf'} {{(pid=72382) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 15:31:46 user nova-compute[72382]: DEBUG nova.compute.manager [req-06315b86-c035-4546-8e1c-b0de17591ab0 req-c07e1ca6-275e-43a5-9355-55acf117d008 service nova] [instance: 266be814-4a2b-4f8e-a0f6-e8821fdeb95d] Received event network-vif-deleted-48650c01-c5a9-44f2-a481-5120c429a5a5 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:31:46 user nova-compute[72382]: DEBUG nova.virt.libvirt.vif [None req-1ade1212-df45-4e00-9a57-dd3782bea141 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-09T15:27:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1040530269',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1040530269',id=30,image_ref='1abdf598-2e0e-40ba-a420-05440167d4ed',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1139327477',keypairs=<?>,launch_index=0,launched_at=2023-08-09T15:27:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='aa6db5fd3ce24c1cadbedd64757e219b',ramdisk_id='',reservation_id='r-ydxxngnu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1817688709',owner_user_name='tempest-AttachVolumeShelveTestJSON-1817688709-project-member',shelved_at='2023-08-09T15:29:41.490901',shelved_host='user',shelved_image_id='1abdf598-2e0e-40ba-a420-05440167d4ed'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T15:31:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9f95e50aa6194e778dfaee31e6e2fa68',uuid=b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "99b65ca7-d891-4625-917d-460e7fb69654", "address": "fa:16:3e:98:b9:f2", "network": {"id": "643703fd-46b7-4309-862c-109141cb008c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-512918576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.131", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa6db5fd3ce24c1cadbedd64757e219b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99b65ca7-d8", "ovs_interfaceid": "99b65ca7-d891-4625-917d-460e7fb69654", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72382) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 15:31:46 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-1ade1212-df45-4e00-9a57-dd3782bea141 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Converting VIF {"id": "99b65ca7-d891-4625-917d-460e7fb69654", "address": "fa:16:3e:98:b9:f2", "network": {"id": "643703fd-46b7-4309-862c-109141cb008c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-512918576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.131", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa6db5fd3ce24c1cadbedd64757e219b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99b65ca7-d8", "ovs_interfaceid": "99b65ca7-d891-4625-917d-460e7fb69654", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 15:31:46 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-1ade1212-df45-4e00-9a57-dd3782bea141 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:98:b9:f2,bridge_name='br-int',has_traffic_filtering=True,id=99b65ca7-d891-4625-917d-460e7fb69654,network=Network(643703fd-46b7-4309-862c-109141cb008c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99b65ca7-d8') {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 15:31:46 user nova-compute[72382]: DEBUG nova.objects.instance [None req-1ade1212-df45-4e00-9a57-dd3782bea141 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Lazy-loading 'pci_devices' on Instance uuid b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:31:46 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-7d3bed69-fedc-4470-89d2-ad61dd6be96f tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:31:46 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-7d3bed69-fedc-4470-89d2-ad61dd6be96f tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:31:46 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-1ade1212-df45-4e00-9a57-dd3782bea141 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] [instance: b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d] End _get_guest_xml xml=<domain type="kvm">
Aug 09 15:31:46 user nova-compute[72382]:   <uuid>b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d</uuid>
Aug 09 15:31:46 user nova-compute[72382]:   <name>instance-0000001e</name>
Aug 09 15:31:46 user nova-compute[72382]:   <memory>524288</memory>
Aug 09 15:31:46 user nova-compute[72382]:   <vcpu>1</vcpu>
Aug 09 15:31:46 user nova-compute[72382]:   <metadata>
Aug 09 15:31:46 user nova-compute[72382]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 15:31:46 user nova-compute[72382]:       <nova:package version="0.0.0"/>
Aug 09 15:31:46 user nova-compute[72382]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1040530269</nova:name>
Aug 09 15:31:46 user nova-compute[72382]:       <nova:creationTime>2023-08-09 15:31:44</nova:creationTime>
Aug 09 15:31:46 user nova-compute[72382]:       <nova:flavor name="m1.tiny">
Aug 09 15:31:46 user nova-compute[72382]:         <nova:memory>512</nova:memory>
Aug 09 15:31:46 user nova-compute[72382]:         <nova:disk>1</nova:disk>
Aug 09 15:31:46 user nova-compute[72382]:         <nova:swap>0</nova:swap>
Aug 09 15:31:46 user nova-compute[72382]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 15:31:46 user nova-compute[72382]:         <nova:vcpus>1</nova:vcpus>
Aug 09 15:31:46 user nova-compute[72382]:       </nova:flavor>
Aug 09 15:31:46 user nova-compute[72382]:       <nova:owner>
Aug 09 15:31:46 user nova-compute[72382]:         <nova:user uuid="9f95e50aa6194e778dfaee31e6e2fa68">tempest-AttachVolumeShelveTestJSON-1817688709-project-member</nova:user>
Aug 09 15:31:46 user nova-compute[72382]:         <nova:project uuid="aa6db5fd3ce24c1cadbedd64757e219b">tempest-AttachVolumeShelveTestJSON-1817688709</nova:project>
Aug 09 15:31:46 user nova-compute[72382]:       </nova:owner>
Aug 09 15:31:46 user nova-compute[72382]:       <nova:root type="image" uuid="1abdf598-2e0e-40ba-a420-05440167d4ed"/>
Aug 09 15:31:46 user nova-compute[72382]:       <nova:ports>
Aug 09 15:31:46 user nova-compute[72382]:         <nova:port uuid="99b65ca7-d891-4625-917d-460e7fb69654">
Aug 09 15:31:46 user nova-compute[72382]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 09 15:31:46 user nova-compute[72382]:         </nova:port>
Aug 09 15:31:46 user nova-compute[72382]:       </nova:ports>
Aug 09 15:31:46 user nova-compute[72382]:     </nova:instance>
Aug 09 15:31:46 user nova-compute[72382]:   </metadata>
Aug 09 15:31:46 user nova-compute[72382]:   <sysinfo type="smbios">
Aug 09 15:31:46 user nova-compute[72382]:     <system>
Aug 09 15:31:46 user nova-compute[72382]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 15:31:46 user nova-compute[72382]:       <entry name="product">OpenStack Nova</entry>
Aug 09 15:31:46 user nova-compute[72382]:       <entry name="version">0.0.0</entry>
Aug 09 15:31:46 user nova-compute[72382]:       <entry name="serial">b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d</entry>
Aug 09 15:31:46 user nova-compute[72382]:       <entry name="uuid">b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d</entry>
Aug 09 15:31:46 user nova-compute[72382]:       <entry name="family">Virtual Machine</entry>
Aug 09 15:31:46 user nova-compute[72382]:     </system>
Aug 09 15:31:46 user nova-compute[72382]:   </sysinfo>
Aug 09 15:31:46 user nova-compute[72382]:   <os>
Aug 09 15:31:46 user nova-compute[72382]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 15:31:46 user nova-compute[72382]:     <boot dev="hd"/>
Aug 09 15:31:46 user nova-compute[72382]:     <smbios mode="sysinfo"/>
Aug 09 15:31:46 user nova-compute[72382]:   </os>
Aug 09 15:31:46 user nova-compute[72382]:   <features>
Aug 09 15:31:46 user nova-compute[72382]:     <acpi/>
Aug 09 15:31:46 user nova-compute[72382]:     <apic/>
Aug 09 15:31:46 user nova-compute[72382]:     <vmcoreinfo/>
Aug 09 15:31:46 user nova-compute[72382]:   </features>
Aug 09 15:31:46 user nova-compute[72382]:   <clock offset="utc">
Aug 09 15:31:46 user nova-compute[72382]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 15:31:46 user nova-compute[72382]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 15:31:46 user nova-compute[72382]:     <timer name="hpet" present="no"/>
Aug 09 15:31:46 user nova-compute[72382]:   </clock>
Aug 09 15:31:46 user nova-compute[72382]:   <cpu mode="custom" match="exact">
Aug 09 15:31:46 user nova-compute[72382]:     <model>Nehalem</model>
Aug 09 15:31:46 user nova-compute[72382]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 15:31:46 user nova-compute[72382]:   </cpu>
Aug 09 15:31:46 user nova-compute[72382]:   <devices>
Aug 09 15:31:46 user nova-compute[72382]:     <disk type="file" device="disk">
Aug 09 15:31:46 user nova-compute[72382]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 15:31:46 user nova-compute[72382]:       <source file="/opt/stack/data/nova/instances/b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d/disk"/>
Aug 09 15:31:46 user nova-compute[72382]:       <target dev="vda" bus="virtio"/>
Aug 09 15:31:46 user nova-compute[72382]:     </disk>
Aug 09 15:31:46 user nova-compute[72382]:     <disk type="block" device="disk">
Aug 09 15:31:46 user nova-compute[72382]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 15:31:46 user nova-compute[72382]:       <source dev="/dev/sdf"/>
Aug 09 15:31:46 user nova-compute[72382]:       <target dev="vdc" bus="virtio"/>
Aug 09 15:31:46 user nova-compute[72382]:       <serial>8516df70-0781-4493-b04f-417dfdfd5365</serial>
Aug 09 15:31:46 user nova-compute[72382]:     </disk>
Aug 09 15:31:46 user nova-compute[72382]:     <interface type="ethernet">
Aug 09 15:31:46 user nova-compute[72382]:       <mac address="fa:16:3e:98:b9:f2"/>
Aug 09 15:31:46 user nova-compute[72382]:       <model type="virtio"/>
Aug 09 15:31:46 user nova-compute[72382]:       <mtu size="1442"/>
Aug 09 15:31:46 user nova-compute[72382]:       <target dev="tap99b65ca7-d8"/>
Aug 09 15:31:46 user nova-compute[72382]:     </interface>
Aug 09 15:31:46 user nova-compute[72382]:     <serial type="pty">
Aug 09 15:31:46 user nova-compute[72382]:       <log file="/opt/stack/data/nova/instances/b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d/console.log" append="off"/>
Aug 09 15:31:46 user nova-compute[72382]:     </serial>
Aug 09 15:31:46 user nova-compute[72382]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 15:31:46 user nova-compute[72382]:     <video>
Aug 09 15:31:46 user nova-compute[72382]:       <model type="virtio"/>
Aug 09 15:31:46 user nova-compute[72382]:     </video>
Aug 09 15:31:46 user nova-compute[72382]:     <rng model="virtio">
Aug 09 15:31:46 user nova-compute[72382]:       <backend model="random">/dev/urandom</backend>
Aug 09 15:31:46 user nova-compute[72382]:     </rng>
Aug 09 15:31:46 user nova-compute[72382]:     <controller type="usb" index="0" model="none"/>
Aug 09 15:31:46 user nova-compute[72382]:     <memballoon model="virtio">
Aug 09 15:31:46 user nova-compute[72382]:       <stats period="10"/>
Aug 09 15:31:46 user nova-compute[72382]:     </memballoon>
Aug 09 15:31:46 user nova-compute[72382]:   </devices>
Aug 09 15:31:46 user nova-compute[72382]: </domain>
Aug 09 15:31:46 user nova-compute[72382]:  {{(pid=72382) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 15:31:46 user nova-compute[72382]: DEBUG nova.virt.libvirt.vif [None req-1ade1212-df45-4e00-9a57-dd3782bea141 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-09T15:27:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1040530269',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1040530269',id=30,image_ref='1abdf598-2e0e-40ba-a420-05440167d4ed',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1139327477',keypairs=<?>,launch_index=0,launched_at=2023-08-09T15:27:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='aa6db5fd3ce24c1cadbedd64757e219b',ramdisk_id='',reservation_id='r-ydxxngnu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1817688709',owner_user_name='tempest-AttachVolumeShelveTestJSON-1817688709-project-member',shelved_at='2023-08-09T15:29:41.490901',shelved_host='user',shelved_image_id='1abdf598-2e0e-40ba-a420-05440167d4ed'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T15:31:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9f95e50aa6194e778dfaee31e6e2fa68',uuid=b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "99b65ca7-d891-4625-917d-460e7fb69654", "address": "fa:16:3e:98:b9:f2", "network": {"id": "643703fd-46b7-4309-862c-109141cb008c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-512918576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.131", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa6db5fd3ce24c1cadbedd64757e219b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99b65ca7-d8", "ovs_interfaceid": "99b65ca7-d891-4625-917d-460e7fb69654", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 15:31:46 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-1ade1212-df45-4e00-9a57-dd3782bea141 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Converting VIF {"id": "99b65ca7-d891-4625-917d-460e7fb69654", "address": "fa:16:3e:98:b9:f2", "network": {"id": "643703fd-46b7-4309-862c-109141cb008c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-512918576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.131", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa6db5fd3ce24c1cadbedd64757e219b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99b65ca7-d8", "ovs_interfaceid": "99b65ca7-d891-4625-917d-460e7fb69654", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 15:31:46 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-1ade1212-df45-4e00-9a57-dd3782bea141 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:98:b9:f2,bridge_name='br-int',has_traffic_filtering=True,id=99b65ca7-d891-4625-917d-460e7fb69654,network=Network(643703fd-46b7-4309-862c-109141cb008c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99b65ca7-d8') {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 15:31:46 user nova-compute[72382]: DEBUG os_vif [None req-1ade1212-df45-4e00-9a57-dd3782bea141 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:b9:f2,bridge_name='br-int',has_traffic_filtering=True,id=99b65ca7-d891-4625-917d-460e7fb69654,network=Network(643703fd-46b7-4309-862c-109141cb008c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99b65ca7-d8') {{(pid=72382) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 15:31:46 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:31:46 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:31:46 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 15:31:46 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:31:46 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap99b65ca7-d8, may_exist=True, interface_attrs={}) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:31:46 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap99b65ca7-d8, col_values=(('external_ids', {'iface-id': '99b65ca7-d891-4625-917d-460e7fb69654', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:98:b9:f2', 'vm-uuid': 'b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d'}),), if_exists=True) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:31:46 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:31:46 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:31:46 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:31:46 user nova-compute[72382]: INFO os_vif [None req-1ade1212-df45-4e00-9a57-dd3782bea141 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:b9:f2,bridge_name='br-int',has_traffic_filtering=True,id=99b65ca7-d891-4625-917d-460e7fb69654,network=Network(643703fd-46b7-4309-862c-109141cb008c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99b65ca7-d8')
Aug 09 15:31:46 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-1ade1212-df45-4e00-9a57-dd3782bea141 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] No BDM found with device name vda, not building metadata. {{(pid=72382) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 15:31:46 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-1ade1212-df45-4e00-9a57-dd3782bea141 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72382) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 15:31:46 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-1ade1212-df45-4e00-9a57-dd3782bea141 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] No VIF found with MAC fa:16:3e:98:b9:f2, not building metadata {{(pid=72382) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 15:31:46 user nova-compute[72382]: DEBUG nova.compute.provider_tree [None req-7d3bed69-fedc-4470-89d2-ad61dd6be96f tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Inventory has not changed in ProviderTree for provider: 7b15b0e5-df4d-49db-833b-2855d21d10ae {{(pid=72382) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 15:31:46 user nova-compute[72382]: DEBUG nova.scheduler.client.report [None req-7d3bed69-fedc-4470-89d2-ad61dd6be96f tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Inventory has not changed for provider 7b15b0e5-df4d-49db-833b-2855d21d10ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72382) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 15:31:46 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-7d3bed69-fedc-4470-89d2-ad61dd6be96f tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.363s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:31:46 user nova-compute[72382]: INFO nova.scheduler.client.report [None req-7d3bed69-fedc-4470-89d2-ad61dd6be96f tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Deleted allocations for instance 266be814-4a2b-4f8e-a0f6-e8821fdeb95d
Aug 09 15:31:46 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-7d3bed69-fedc-4470-89d2-ad61dd6be96f tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Lock "266be814-4a2b-4f8e-a0f6-e8821fdeb95d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.022s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:31:46 user nova-compute[72382]: DEBUG nova.compute.manager [req-a05c9fae-265a-44d2-9306-6e9cfd9eed85 req-4be33fa1-30c3-4378-9a4b-110d8cadbf68 service nova] [instance: 266be814-4a2b-4f8e-a0f6-e8821fdeb95d] Received event network-vif-plugged-48650c01-c5a9-44f2-a481-5120c429a5a5 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:31:46 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-a05c9fae-265a-44d2-9306-6e9cfd9eed85 req-4be33fa1-30c3-4378-9a4b-110d8cadbf68 service nova] Acquiring lock "266be814-4a2b-4f8e-a0f6-e8821fdeb95d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:31:46 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-a05c9fae-265a-44d2-9306-6e9cfd9eed85 req-4be33fa1-30c3-4378-9a4b-110d8cadbf68 service nova] Lock "266be814-4a2b-4f8e-a0f6-e8821fdeb95d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:31:46 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-a05c9fae-265a-44d2-9306-6e9cfd9eed85 req-4be33fa1-30c3-4378-9a4b-110d8cadbf68 service nova] Lock "266be814-4a2b-4f8e-a0f6-e8821fdeb95d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:31:46 user nova-compute[72382]: DEBUG nova.compute.manager [req-a05c9fae-265a-44d2-9306-6e9cfd9eed85 req-4be33fa1-30c3-4378-9a4b-110d8cadbf68 service nova] [instance: 266be814-4a2b-4f8e-a0f6-e8821fdeb95d] No waiting events found dispatching network-vif-plugged-48650c01-c5a9-44f2-a481-5120c429a5a5 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:31:46 user nova-compute[72382]: WARNING nova.compute.manager [req-a05c9fae-265a-44d2-9306-6e9cfd9eed85 req-4be33fa1-30c3-4378-9a4b-110d8cadbf68 service nova] [instance: 266be814-4a2b-4f8e-a0f6-e8821fdeb95d] Received unexpected event network-vif-plugged-48650c01-c5a9-44f2-a481-5120c429a5a5 for instance with vm_state deleted and task_state None.
Aug 09 15:31:47 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:31:47 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:31:47 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:31:47 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:31:47 user nova-compute[72382]: DEBUG nova.compute.manager [req-697ca15c-6a17-4afd-b527-d8e57d1ccd84 req-13244a8c-d51b-4929-8bf9-5e9024b82bf4 service nova] [instance: b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d] Received event network-vif-plugged-99b65ca7-d891-4625-917d-460e7fb69654 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:31:47 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-697ca15c-6a17-4afd-b527-d8e57d1ccd84 req-13244a8c-d51b-4929-8bf9-5e9024b82bf4 service nova] Acquiring lock "b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:31:47 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-697ca15c-6a17-4afd-b527-d8e57d1ccd84 req-13244a8c-d51b-4929-8bf9-5e9024b82bf4 service nova] Lock "b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:31:47 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-697ca15c-6a17-4afd-b527-d8e57d1ccd84 req-13244a8c-d51b-4929-8bf9-5e9024b82bf4 service nova] Lock "b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:31:47 user nova-compute[72382]: DEBUG nova.compute.manager [req-697ca15c-6a17-4afd-b527-d8e57d1ccd84 req-13244a8c-d51b-4929-8bf9-5e9024b82bf4 service nova] [instance: b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d] No waiting events found dispatching network-vif-plugged-99b65ca7-d891-4625-917d-460e7fb69654 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:31:47 user nova-compute[72382]: WARNING nova.compute.manager [req-697ca15c-6a17-4afd-b527-d8e57d1ccd84 req-13244a8c-d51b-4929-8bf9-5e9024b82bf4 service nova] [instance: b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d] Received unexpected event network-vif-plugged-99b65ca7-d891-4625-917d-460e7fb69654 for instance with vm_state shelved_offloaded and task_state spawning.
Aug 09 15:31:48 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:31:48 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:31:48 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:31:48 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:31:48 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:31:49 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:31:49 user nova-compute[72382]: DEBUG nova.virt.driver [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Emitting event <LifecycleEvent: 1691595109.7616205, b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d => Resumed> {{(pid=72382) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 15:31:49 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d] VM Resumed (Lifecycle Event)
Aug 09 15:31:49 user nova-compute[72382]: DEBUG nova.compute.manager [None req-1ade1212-df45-4e00-9a57-dd3782bea141 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] [instance: b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d] Instance event wait completed in 0 seconds for  {{(pid=72382) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 15:31:49 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-1ade1212-df45-4e00-9a57-dd3782bea141 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] [instance: b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d] Guest created on hypervisor {{(pid=72382) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 15:31:49 user nova-compute[72382]: INFO nova.virt.libvirt.driver [-] [instance: b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d] Instance spawned successfully.
Aug 09 15:31:49 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:31:49 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=72382) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 15:31:49 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 15:31:49 user nova-compute[72382]: DEBUG nova.virt.driver [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Emitting event <LifecycleEvent: 1691595109.7631037, b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d => Started> {{(pid=72382) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 15:31:49 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d] VM Started (Lifecycle Event)
Aug 09 15:31:49 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:31:49 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=72382) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 15:31:49 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 15:31:50 user nova-compute[72382]: DEBUG nova.compute.manager [req-3987a388-de3e-4967-9864-84f74f3ac34a req-300f1db8-72ca-4278-a859-790578979955 service nova] [instance: b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d] Received event network-vif-plugged-99b65ca7-d891-4625-917d-460e7fb69654 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:31:50 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-3987a388-de3e-4967-9864-84f74f3ac34a req-300f1db8-72ca-4278-a859-790578979955 service nova] Acquiring lock "b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:31:50 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-3987a388-de3e-4967-9864-84f74f3ac34a req-300f1db8-72ca-4278-a859-790578979955 service nova] Lock "b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:31:50 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-3987a388-de3e-4967-9864-84f74f3ac34a req-300f1db8-72ca-4278-a859-790578979955 service nova] Lock "b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:31:50 user nova-compute[72382]: DEBUG nova.compute.manager [req-3987a388-de3e-4967-9864-84f74f3ac34a req-300f1db8-72ca-4278-a859-790578979955 service nova] [instance: b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d] No waiting events found dispatching network-vif-plugged-99b65ca7-d891-4625-917d-460e7fb69654 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:31:50 user nova-compute[72382]: WARNING nova.compute.manager [req-3987a388-de3e-4967-9864-84f74f3ac34a req-300f1db8-72ca-4278-a859-790578979955 service nova] [instance: b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d] Received unexpected event network-vif-plugged-99b65ca7-d891-4625-917d-460e7fb69654 for instance with vm_state shelved_offloaded and task_state spawning.
Aug 09 15:31:50 user nova-compute[72382]: DEBUG nova.compute.manager [None req-1ade1212-df45-4e00-9a57-dd3782bea141 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] [instance: b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:31:50 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-1ade1212-df45-4e00-9a57-dd3782bea141 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Lock "b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 21.873s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:31:51 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:31:54 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:31:56 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:32:00 user nova-compute[72382]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691595105.1858294, 266be814-4a2b-4f8e-a0f6-e8821fdeb95d => Stopped> {{(pid=72382) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 15:32:00 user nova-compute[72382]: INFO nova.compute.manager [-] [instance: 266be814-4a2b-4f8e-a0f6-e8821fdeb95d] VM Stopped (Lifecycle Event)
Aug 09 15:32:00 user nova-compute[72382]: DEBUG nova.compute.manager [None req-5265494a-ba80-448c-ab35-45889146e420 None None] [instance: 266be814-4a2b-4f8e-a0f6-e8821fdeb95d] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:32:01 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:32:01 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:32:01 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72382) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 15:32:01 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72382) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 15:32:01 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72382) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 15:32:01 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:32:04 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._sync_power_states {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:32:04 user nova-compute[72382]: DEBUG nova.compute.manager [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Triggering sync for uuid f780040f-b789-4b72-8986-813c7b9fe4a6 {{(pid=72382) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 09 15:32:04 user nova-compute[72382]: DEBUG nova.compute.manager [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Triggering sync for uuid 44afd1bf-fa5c-4b3e-8752-b16853fef54e {{(pid=72382) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 09 15:32:04 user nova-compute[72382]: DEBUG nova.compute.manager [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Triggering sync for uuid 0f510d75-5d1e-4a5c-b38f-731c299f0f5a {{(pid=72382) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 09 15:32:04 user nova-compute[72382]: DEBUG nova.compute.manager [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Triggering sync for uuid 6ea8f68c-3dc1-45ac-a7f3-bca32f929add {{(pid=72382) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 09 15:32:04 user nova-compute[72382]: DEBUG nova.compute.manager [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Triggering sync for uuid 14c97840-88c0-4a8e-96e8-2e7da318ad07 {{(pid=72382) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 09 15:32:04 user nova-compute[72382]: DEBUG nova.compute.manager [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Triggering sync for uuid 4ccbfda2-8bcd-4ec1-972a-cf49a62b1583 {{(pid=72382) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 09 15:32:04 user nova-compute[72382]: DEBUG nova.compute.manager [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Triggering sync for uuid 2f430d9a-9fbf-43cd-8c0d-e5dec162be71 {{(pid=72382) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 09 15:32:04 user nova-compute[72382]: DEBUG nova.compute.manager [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Triggering sync for uuid b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d {{(pid=72382) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 09 15:32:04 user nova-compute[72382]: DEBUG nova.compute.manager [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Triggering sync for uuid d7c34b80-c2e9-43c1-8b8e-7c62eb8e73f4 {{(pid=72382) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 09 15:32:04 user nova-compute[72382]: DEBUG nova.compute.manager [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Triggering sync for uuid 94c8cc29-3300-475f-aca0-40fa0e58cd66 {{(pid=72382) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 09 15:32:04 user nova-compute[72382]: DEBUG nova.compute.manager [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Triggering sync for uuid 8f744a7d-9eed-40e1-9422-670970c209ce {{(pid=72382) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 09 15:32:04 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Acquiring lock "f780040f-b789-4b72-8986-813c7b9fe4a6" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:32:04 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "f780040f-b789-4b72-8986-813c7b9fe4a6" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:32:04 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Acquiring lock "44afd1bf-fa5c-4b3e-8752-b16853fef54e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:32:04 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "44afd1bf-fa5c-4b3e-8752-b16853fef54e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:32:04 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Acquiring lock "0f510d75-5d1e-4a5c-b38f-731c299f0f5a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:32:04 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "0f510d75-5d1e-4a5c-b38f-731c299f0f5a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:32:04 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Acquiring lock "6ea8f68c-3dc1-45ac-a7f3-bca32f929add" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:32:04 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "6ea8f68c-3dc1-45ac-a7f3-bca32f929add" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:32:04 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Acquiring lock "14c97840-88c0-4a8e-96e8-2e7da318ad07" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:32:04 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "14c97840-88c0-4a8e-96e8-2e7da318ad07" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:32:04 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Acquiring lock "4ccbfda2-8bcd-4ec1-972a-cf49a62b1583" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:32:04 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "4ccbfda2-8bcd-4ec1-972a-cf49a62b1583" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:32:04 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Acquiring lock "2f430d9a-9fbf-43cd-8c0d-e5dec162be71" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:32:04 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "2f430d9a-9fbf-43cd-8c0d-e5dec162be71" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:32:04 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Acquiring lock "b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:32:04 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:32:04 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Acquiring lock "d7c34b80-c2e9-43c1-8b8e-7c62eb8e73f4" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:32:04 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "d7c34b80-c2e9-43c1-8b8e-7c62eb8e73f4" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:32:04 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Acquiring lock "94c8cc29-3300-475f-aca0-40fa0e58cd66" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:32:04 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "94c8cc29-3300-475f-aca0-40fa0e58cd66" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:32:04 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Acquiring lock "8f744a7d-9eed-40e1-9422-670970c209ce" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:32:04 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "8f744a7d-9eed-40e1-9422-670970c209ce" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:32:04 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "44afd1bf-fa5c-4b3e-8752-b16853fef54e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.038s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:32:04 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "f780040f-b789-4b72-8986-813c7b9fe4a6" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.045s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:32:04 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "14c97840-88c0-4a8e-96e8-2e7da318ad07" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.049s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:32:04 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "0f510d75-5d1e-4a5c-b38f-731c299f0f5a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.056s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:32:04 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "6ea8f68c-3dc1-45ac-a7f3-bca32f929add" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.059s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:32:04 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.060s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:32:04 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "2f430d9a-9fbf-43cd-8c0d-e5dec162be71" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.067s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:32:04 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "4ccbfda2-8bcd-4ec1-972a-cf49a62b1583" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.068s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:32:04 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "8f744a7d-9eed-40e1-9422-670970c209ce" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.072s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:32:04 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "d7c34b80-c2e9-43c1-8b8e-7c62eb8e73f4" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.074s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:32:04 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "94c8cc29-3300-475f-aca0-40fa0e58cd66" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.075s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:32:04 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:32:06 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:32:09 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:32:10 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:32:10 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:32:10 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:32:10 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:32:10 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Auditing locally available compute resources for user (node: user) {{(pid=72382) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 15:32:11 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:32:11 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:32:11 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:32:11 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:32:11 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:32:11 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] skipping disk /dev/sdf (vdc) as it is a volume {{(pid=72382) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 15:32:11 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ea8f68c-3dc1-45ac-a7f3-bca32f929add/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:32:11 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ea8f68c-3dc1-45ac-a7f3-bca32f929add/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:32:11 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ea8f68c-3dc1-45ac-a7f3-bca32f929add/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:32:11 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ea8f68c-3dc1-45ac-a7f3-bca32f929add/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:32:11 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f780040f-b789-4b72-8986-813c7b9fe4a6/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:32:11 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f780040f-b789-4b72-8986-813c7b9fe4a6/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:32:11 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f780040f-b789-4b72-8986-813c7b9fe4a6/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:32:11 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f780040f-b789-4b72-8986-813c7b9fe4a6/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:32:11 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72382) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 15:32:11 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14c97840-88c0-4a8e-96e8-2e7da318ad07/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:32:12 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14c97840-88c0-4a8e-96e8-2e7da318ad07/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:32:12 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14c97840-88c0-4a8e-96e8-2e7da318ad07/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:32:12 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14c97840-88c0-4a8e-96e8-2e7da318ad07/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:32:12 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44afd1bf-fa5c-4b3e-8752-b16853fef54e/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:32:12 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44afd1bf-fa5c-4b3e-8752-b16853fef54e/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:32:12 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44afd1bf-fa5c-4b3e-8752-b16853fef54e/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:32:12 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44afd1bf-fa5c-4b3e-8752-b16853fef54e/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:32:12 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ccbfda2-8bcd-4ec1-972a-cf49a62b1583/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:32:12 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ccbfda2-8bcd-4ec1-972a-cf49a62b1583/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:32:12 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ccbfda2-8bcd-4ec1-972a-cf49a62b1583/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:32:12 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ccbfda2-8bcd-4ec1-972a-cf49a62b1583/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:32:12 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72382) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 15:32:12 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7c34b80-c2e9-43c1-8b8e-7c62eb8e73f4/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:32:12 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7c34b80-c2e9-43c1-8b8e-7c62eb8e73f4/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:32:12 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7c34b80-c2e9-43c1-8b8e-7c62eb8e73f4/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:32:13 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7c34b80-c2e9-43c1-8b8e-7c62eb8e73f4/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:32:13 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f744a7d-9eed-40e1-9422-670970c209ce/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:32:13 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f744a7d-9eed-40e1-9422-670970c209ce/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:32:13 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f744a7d-9eed-40e1-9422-670970c209ce/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:32:13 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f744a7d-9eed-40e1-9422-670970c209ce/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:32:13 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=72382) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 15:32:13 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72382) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 15:32:13 user nova-compute[72382]: WARNING nova.virt.libvirt.driver [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 15:32:13 user nova-compute[72382]: WARNING nova.virt.libvirt.driver [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 15:32:13 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Hypervisor/Node resource view: name=user free_ram=7436MB free_disk=25.227603912353516GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72382) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 15:32:13 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:32:13 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:32:14 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance f780040f-b789-4b72-8986-813c7b9fe4a6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:32:14 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance 44afd1bf-fa5c-4b3e-8752-b16853fef54e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:32:14 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance 0f510d75-5d1e-4a5c-b38f-731c299f0f5a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:32:14 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance 6ea8f68c-3dc1-45ac-a7f3-bca32f929add actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:32:14 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance 14c97840-88c0-4a8e-96e8-2e7da318ad07 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:32:14 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance 4ccbfda2-8bcd-4ec1-972a-cf49a62b1583 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:32:14 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance 2f430d9a-9fbf-43cd-8c0d-e5dec162be71 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:32:14 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance d7c34b80-c2e9-43c1-8b8e-7c62eb8e73f4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:32:14 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance 94c8cc29-3300-475f-aca0-40fa0e58cd66 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:32:14 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance 8f744a7d-9eed-40e1-9422-670970c209ce actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:32:14 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:32:14 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=72382) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 15:32:14 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=72382) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 15:32:14 user nova-compute[72382]: DEBUG nova.compute.provider_tree [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Inventory has not changed in ProviderTree for provider: 7b15b0e5-df4d-49db-833b-2855d21d10ae {{(pid=72382) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 15:32:14 user nova-compute[72382]: DEBUG nova.scheduler.client.report [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Inventory has not changed for provider 7b15b0e5-df4d-49db-833b-2855d21d10ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72382) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 15:32:14 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Compute_service record updated for user:user {{(pid=72382) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 15:32:14 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.483s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:32:14 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:32:16 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:32:16 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:32:16 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:32:16 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:32:16 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:32:17 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:32:17 user nova-compute[72382]: DEBUG nova.compute.manager [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Starting heal instance info cache {{(pid=72382) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 15:32:18 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Acquiring lock "refresh_cache-0f510d75-5d1e-4a5c-b38f-731c299f0f5a" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 15:32:18 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Acquired lock "refresh_cache-0f510d75-5d1e-4a5c-b38f-731c299f0f5a" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 15:32:18 user nova-compute[72382]: DEBUG nova.network.neutron [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] [instance: 0f510d75-5d1e-4a5c-b38f-731c299f0f5a] Forcefully refreshing network info cache for instance {{(pid=72382) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 15:32:18 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-be63297d-7c0c-45da-aeeb-53e0ebb52305 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Acquiring lock "2f430d9a-9fbf-43cd-8c0d-e5dec162be71" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:32:18 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-be63297d-7c0c-45da-aeeb-53e0ebb52305 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Lock "2f430d9a-9fbf-43cd-8c0d-e5dec162be71" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:32:18 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-be63297d-7c0c-45da-aeeb-53e0ebb52305 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Acquiring lock "2f430d9a-9fbf-43cd-8c0d-e5dec162be71-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:32:18 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-be63297d-7c0c-45da-aeeb-53e0ebb52305 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Lock "2f430d9a-9fbf-43cd-8c0d-e5dec162be71-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:32:18 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-be63297d-7c0c-45da-aeeb-53e0ebb52305 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Lock "2f430d9a-9fbf-43cd-8c0d-e5dec162be71-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:32:18 user nova-compute[72382]: INFO nova.compute.manager [None req-be63297d-7c0c-45da-aeeb-53e0ebb52305 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] [instance: 2f430d9a-9fbf-43cd-8c0d-e5dec162be71] Terminating instance
Aug 09 15:32:18 user nova-compute[72382]: DEBUG nova.compute.manager [None req-be63297d-7c0c-45da-aeeb-53e0ebb52305 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] [instance: 2f430d9a-9fbf-43cd-8c0d-e5dec162be71] Start destroying the instance on the hypervisor. {{(pid=72382) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 15:32:18 user nova-compute[72382]: DEBUG nova.compute.manager [req-704b1e57-8162-49f5-b4be-3e019ee67f0d req-dde38db5-b6f2-47e8-99d5-164f4c928c2a service nova] [instance: d7c34b80-c2e9-43c1-8b8e-7c62eb8e73f4] Received event network-changed-a0b8be03-4b4b-444f-ab4d-b7a78d18f799 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:32:18 user nova-compute[72382]: DEBUG nova.compute.manager [req-704b1e57-8162-49f5-b4be-3e019ee67f0d req-dde38db5-b6f2-47e8-99d5-164f4c928c2a service nova] [instance: d7c34b80-c2e9-43c1-8b8e-7c62eb8e73f4] Refreshing instance network info cache due to event network-changed-a0b8be03-4b4b-444f-ab4d-b7a78d18f799. {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 15:32:18 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-704b1e57-8162-49f5-b4be-3e019ee67f0d req-dde38db5-b6f2-47e8-99d5-164f4c928c2a service nova] Acquiring lock "refresh_cache-d7c34b80-c2e9-43c1-8b8e-7c62eb8e73f4" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 15:32:18 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-704b1e57-8162-49f5-b4be-3e019ee67f0d req-dde38db5-b6f2-47e8-99d5-164f4c928c2a service nova] Acquired lock "refresh_cache-d7c34b80-c2e9-43c1-8b8e-7c62eb8e73f4" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 15:32:18 user nova-compute[72382]: DEBUG nova.network.neutron [req-704b1e57-8162-49f5-b4be-3e019ee67f0d req-dde38db5-b6f2-47e8-99d5-164f4c928c2a service nova] [instance: d7c34b80-c2e9-43c1-8b8e-7c62eb8e73f4] Refreshing network info cache for port a0b8be03-4b4b-444f-ab4d-b7a78d18f799 {{(pid=72382) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 15:32:18 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:32:18 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:32:18 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:32:18 user nova-compute[72382]: DEBUG nova.network.neutron [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] [instance: 0f510d75-5d1e-4a5c-b38f-731c299f0f5a] Updating instance_info_cache with network_info: [{"id": "c67a8d45-c4ba-4302-940f-c05799ecc732", "address": "fa:16:3e:02:6d:5d", "network": {"id": "d47e3749-fdff-4112-bd72-69ca584efe1f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-302967634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "080d1ded4cd94e5083ee0b7e691b7363", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc67a8d45-c4", "ovs_interfaceid": "c67a8d45-c4ba-4302-940f-c05799ecc732", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:32:18 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:32:18 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Releasing lock "refresh_cache-0f510d75-5d1e-4a5c-b38f-731c299f0f5a" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 15:32:18 user nova-compute[72382]: DEBUG nova.compute.manager [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] [instance: 0f510d75-5d1e-4a5c-b38f-731c299f0f5a] Updated the network info_cache for instance {{(pid=72382) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 15:32:18 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:32:18 user nova-compute[72382]: DEBUG nova.compute.manager [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72382) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 15:32:18 user nova-compute[72382]: DEBUG nova.compute.manager [req-c33b087d-3785-4401-b260-5c60bd3c9d05 req-4527a3e3-3f09-45e1-926a-3adfc5908f0f service nova] [instance: 2f430d9a-9fbf-43cd-8c0d-e5dec162be71] Received event network-vif-unplugged-d13c4d4e-9004-4d4b-999d-619564a98542 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:32:18 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-c33b087d-3785-4401-b260-5c60bd3c9d05 req-4527a3e3-3f09-45e1-926a-3adfc5908f0f service nova] Acquiring lock "2f430d9a-9fbf-43cd-8c0d-e5dec162be71-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:32:18 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-c33b087d-3785-4401-b260-5c60bd3c9d05 req-4527a3e3-3f09-45e1-926a-3adfc5908f0f service nova] Lock "2f430d9a-9fbf-43cd-8c0d-e5dec162be71-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:32:18 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-c33b087d-3785-4401-b260-5c60bd3c9d05 req-4527a3e3-3f09-45e1-926a-3adfc5908f0f service nova] Lock "2f430d9a-9fbf-43cd-8c0d-e5dec162be71-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:32:18 user nova-compute[72382]: DEBUG nova.compute.manager [req-c33b087d-3785-4401-b260-5c60bd3c9d05 req-4527a3e3-3f09-45e1-926a-3adfc5908f0f service nova] [instance: 2f430d9a-9fbf-43cd-8c0d-e5dec162be71] No waiting events found dispatching network-vif-unplugged-d13c4d4e-9004-4d4b-999d-619564a98542 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:32:18 user nova-compute[72382]: DEBUG nova.compute.manager [req-c33b087d-3785-4401-b260-5c60bd3c9d05 req-4527a3e3-3f09-45e1-926a-3adfc5908f0f service nova] [instance: 2f430d9a-9fbf-43cd-8c0d-e5dec162be71] Received event network-vif-unplugged-d13c4d4e-9004-4d4b-999d-619564a98542 for instance with task_state deleting. {{(pid=72382) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 15:32:19 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:32:19 user nova-compute[72382]: INFO nova.virt.libvirt.driver [-] [instance: 2f430d9a-9fbf-43cd-8c0d-e5dec162be71] Instance destroyed successfully.
Aug 09 15:32:19 user nova-compute[72382]: DEBUG nova.objects.instance [None req-be63297d-7c0c-45da-aeeb-53e0ebb52305 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Lazy-loading 'resources' on Instance uuid 2f430d9a-9fbf-43cd-8c0d-e5dec162be71 {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:32:19 user nova-compute[72382]: DEBUG nova.virt.libvirt.vif [None req-be63297d-7c0c-45da-aeeb-53e0ebb52305 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T15:26:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-193859421',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-193859421',id=28,image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-09T15:28:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='080d1ded4cd94e5083ee0b7e691b7363',ramdisk_id='',reservation_id='r-7lwplflb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1187177274',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T15:30:35Z,user_data=None,user_id='e71af7a4912147cd9fab070cb77b275c',uuid=2f430d9a-9fbf-43cd-8c0d-e5dec162be71,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d13c4d4e-9004-4d4b-999d-619564a98542", "address": "fa:16:3e:10:88:6e", "network": {"id": "d47e3749-fdff-4112-bd72-69ca584efe1f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-302967634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "080d1ded4cd94e5083ee0b7e691b7363", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd13c4d4e-90", "ovs_interfaceid": "d13c4d4e-9004-4d4b-999d-619564a98542", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 15:32:19 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-be63297d-7c0c-45da-aeeb-53e0ebb52305 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Converting VIF {"id": "d13c4d4e-9004-4d4b-999d-619564a98542", "address": "fa:16:3e:10:88:6e", "network": {"id": "d47e3749-fdff-4112-bd72-69ca584efe1f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-302967634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "080d1ded4cd94e5083ee0b7e691b7363", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd13c4d4e-90", "ovs_interfaceid": "d13c4d4e-9004-4d4b-999d-619564a98542", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 15:32:19 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-be63297d-7c0c-45da-aeeb-53e0ebb52305 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:10:88:6e,bridge_name='br-int',has_traffic_filtering=True,id=d13c4d4e-9004-4d4b-999d-619564a98542,network=Network(d47e3749-fdff-4112-bd72-69ca584efe1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd13c4d4e-90') {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 15:32:19 user nova-compute[72382]: DEBUG os_vif [None req-be63297d-7c0c-45da-aeeb-53e0ebb52305 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:10:88:6e,bridge_name='br-int',has_traffic_filtering=True,id=d13c4d4e-9004-4d4b-999d-619564a98542,network=Network(d47e3749-fdff-4112-bd72-69ca584efe1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd13c4d4e-90') {{(pid=72382) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 15:32:19 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:32:19 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd13c4d4e-90, bridge=br-int, if_exists=True) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:32:19 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:32:19 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:32:19 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:32:19 user nova-compute[72382]: INFO os_vif [None req-be63297d-7c0c-45da-aeeb-53e0ebb52305 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:10:88:6e,bridge_name='br-int',has_traffic_filtering=True,id=d13c4d4e-9004-4d4b-999d-619564a98542,network=Network(d47e3749-fdff-4112-bd72-69ca584efe1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd13c4d4e-90')
Aug 09 15:32:19 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-be63297d-7c0c-45da-aeeb-53e0ebb52305 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] [instance: 2f430d9a-9fbf-43cd-8c0d-e5dec162be71] calling os-brick to detach iSCSI Volume {{(pid=72382) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 15:32:19 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-be63297d-7c0c-45da-aeeb-53e0ebb52305 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2a0c768340>, {'target_iqns': ['iqn.2010-10.org.openstack:25503c6e-bfc0-4008-846a-8cad783fc0fb'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DpcMQIwC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 15:32:19 user nova-compute[72382]: WARNING os_brick.initiator.connectors.base [None req-be63297d-7c0c-45da-aeeb-53e0ebb52305 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 15:32:19 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-be63297d-7c0c-45da-aeeb-53e0ebb52305 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 15:32:19 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-be63297d-7c0c-45da-aeeb-53e0ebb52305 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 15:32:19 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-be63297d-7c0c-45da-aeeb-53e0ebb52305 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:25503c6e-bfc0-4008-846a-8cad783fc0fb', 0)] {{(pid=72382) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 15:32:19 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:32:19 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:32:19 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[66393d3c-a468-4695-aab4-867a66bcb65f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:25503c6e-bfc0-4008-846a-8cad783fc0fb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:59852df5-d4c8-4f25-8693-36181ff6a447\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8516df70-0781-4493-b04f-417dfdfd5365\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b5cfefdb-a454-494f-ab09-acf8644352a3\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:32:19 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:32:19 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:32:19 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f517b64-a41e-4761-988e-559c8bedbec2]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25503c6e-bfc0-4008-846a-8cad783fc0fb (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5cfefdb-a454-494f-ab09-acf8644352a3 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59852df5-d4c8-4f25-8693-36181ff6a447 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8516df70-0781-4493-b04f-417dfdfd5365 (non-flash)\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:32:19 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-be63297d-7c0c-45da-aeeb-53e0ebb52305 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)
Aug 09 15:32:19 user nova-compute[72382]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25503c6e-bfc0-4008-846a-8cad783fc0fb (non-flash)
Aug 09 15:32:19 user nova-compute[72382]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5cfefdb-a454-494f-ab09-acf8644352a3 (non-flash)
Aug 09 15:32:19 user nova-compute[72382]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59852df5-d4c8-4f25-8693-36181ff6a447 (non-flash)
Aug 09 15:32:19 user nova-compute[72382]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8516df70-0781-4493-b04f-417dfdfd5365 (non-flash)
Aug 09 15:32:19 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 15:32:19 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-be63297d-7c0c-45da-aeeb-53e0ebb52305 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)
Aug 09 15:32:19 user nova-compute[72382]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25503c6e-bfc0-4008-846a-8cad783fc0fb (non-flash)
Aug 09 15:32:19 user nova-compute[72382]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5cfefdb-a454-494f-ab09-acf8644352a3 (non-flash)
Aug 09 15:32:19 user nova-compute[72382]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59852df5-d4c8-4f25-8693-36181ff6a447 (non-flash)
Aug 09 15:32:19 user nova-compute[72382]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8516df70-0781-4493-b04f-417dfdfd5365 (non-flash)
Aug 09 15:32:19 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 15:32:19 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-be63297d-7c0c-45da-aeeb-53e0ebb52305 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2a0c37ab90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:25503c6e-bfc0-4008-846a-8cad783fc0fb'): ({'sde'}, set())}) {{(pid=72382) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 15:32:19 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-be63297d-7c0c-45da-aeeb-53e0ebb52305 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Removing single pathed devices sde {{(pid=72382) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 15:32:19 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:32:19 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.036s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:32:19 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3dc1dba-7862-4fe6-aff6-d418b18ec18c]: (4, ('path checker states:\nup                  4\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:32:19 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:32:19 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.024s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:32:19 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd2238f4-6ad6-406c-8af4-2979c1fc82ec]: (4, ('ok\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:32:19 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-be63297d-7c0c-45da-aeeb-53e0ebb52305 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Flushing IO for device /dev/sde {{(pid=72382) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 15:32:19 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:32:19 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.020s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:32:19 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[db2cf076-6305-4306-b5d5-7e4bb43c4711]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:32:19 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-be63297d-7c0c-45da-aeeb-53e0ebb52305 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72382) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 15:32:19 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:32:19 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.098s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:32:19 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e1bfd7c-947e-4efb-b666-f3a1ddef63a1]: (4, ('1', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:32:19 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-be63297d-7c0c-45da-aeeb-53e0ebb52305 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72382) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 15:32:19 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-be63297d-7c0c-45da-aeeb-53e0ebb52305 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] SCSI volumes sde have been removed. {{(pid=72382) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 15:32:19 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:32:19 user nova-compute[72382]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIOe1c2ddc8-4ea31443ee2d4600', '/dev/disk/by-id/scsi-23465613331343433', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_e1c2ddc8') {{(pid=83725) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Aug 09 15:32:19 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[02645b33-da44-4c45-aa6c-fb5a7e344017]: (4, None) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:32:19 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-be63297d-7c0c-45da-aeeb-53e0ebb52305 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:25503c6e-bfc0-4008-846a-8cad783fc0fb')] {{(pid=72382) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 15:32:19 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25503c6e-bfc0-4008-846a-8cad783fc0fb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:32:19 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25503c6e-bfc0-4008-846a-8cad783fc0fb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:32:19 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[552f0beb-5fdb-4192-9f6e-cb1fae72d704]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:32:19 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-be63297d-7c0c-45da-aeeb-53e0ebb52305 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:32:19 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25503c6e-bfc0-4008-846a-8cad783fc0fb -p 172.16.0.220:3260 --logout {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:32:19 user nova-compute[72382]: DEBUG nova.network.neutron [req-704b1e57-8162-49f5-b4be-3e019ee67f0d req-dde38db5-b6f2-47e8-99d5-164f4c928c2a service nova] [instance: d7c34b80-c2e9-43c1-8b8e-7c62eb8e73f4] Updated VIF entry in instance network info cache for port a0b8be03-4b4b-444f-ab4d-b7a78d18f799. {{(pid=72382) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 15:32:19 user nova-compute[72382]: DEBUG nova.network.neutron [req-704b1e57-8162-49f5-b4be-3e019ee67f0d req-dde38db5-b6f2-47e8-99d5-164f4c928c2a service nova] [instance: d7c34b80-c2e9-43c1-8b8e-7c62eb8e73f4] Updating instance_info_cache with network_info: [{"id": "a0b8be03-4b4b-444f-ab4d-b7a78d18f799", "address": "fa:16:3e:64:69:21", "network": {"id": "46eb5f03-e04d-43d1-96d6-0792bc7a94b1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1842512309-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.81", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98009994d9c74eb9b4fc6321e82440de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0b8be03-4b", "ovs_interfaceid": "a0b8be03-4b4b-444f-ab4d-b7a78d18f799", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:32:19 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25503c6e-bfc0-4008-846a-8cad783fc0fb -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:32:19 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bb71134-0fc8-4202-957e-a81ae0c08019]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:25503c6e-bfc0-4008-846a-8cad783fc0fb, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:25503c6e-bfc0-4008-846a-8cad783fc0fb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:32:19 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-be63297d-7c0c-45da-aeeb-53e0ebb52305 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:25503c6e-bfc0-4008-846a-8cad783fc0fb, portal: 172.16.0.220,3260]
Aug 09 15:32:19 user nova-compute[72382]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:25503c6e-bfc0-4008-846a-8cad783fc0fb, portal: 172.16.0.220,3260] successful.
Aug 09 15:32:19 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:32:19 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25503c6e-bfc0-4008-846a-8cad783fc0fb -p 172.16.0.220:3260 --op delete {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:32:19 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-704b1e57-8162-49f5-b4be-3e019ee67f0d req-dde38db5-b6f2-47e8-99d5-164f4c928c2a service nova] Releasing lock "refresh_cache-d7c34b80-c2e9-43c1-8b8e-7c62eb8e73f4" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 15:32:19 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25503c6e-bfc0-4008-846a-8cad783fc0fb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:32:19 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f932dde-46ce-4784-97fd-b6e5002d0db6]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:32:19 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-be63297d-7c0c-45da-aeeb-53e0ebb52305 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:32:19 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-be63297d-7c0c-45da-aeeb-53e0ebb52305 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.382s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 15:32:19 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-be63297d-7c0c-45da-aeeb-53e0ebb52305 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] <== disconnect_volume: return (384ms) None {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 15:32:19 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-be63297d-7c0c-45da-aeeb-53e0ebb52305 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] [instance: 2f430d9a-9fbf-43cd-8c0d-e5dec162be71] Disconnected iSCSI Volume {{(pid=72382) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 15:32:19 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-be63297d-7c0c-45da-aeeb-53e0ebb52305 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] [instance: 2f430d9a-9fbf-43cd-8c0d-e5dec162be71] Deleting instance files /opt/stack/data/nova/instances/2f430d9a-9fbf-43cd-8c0d-e5dec162be71_del
Aug 09 15:32:19 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-be63297d-7c0c-45da-aeeb-53e0ebb52305 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] [instance: 2f430d9a-9fbf-43cd-8c0d-e5dec162be71] Deletion of /opt/stack/data/nova/instances/2f430d9a-9fbf-43cd-8c0d-e5dec162be71_del complete
Aug 09 15:32:19 user nova-compute[72382]: INFO nova.compute.manager [None req-be63297d-7c0c-45da-aeeb-53e0ebb52305 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] [instance: 2f430d9a-9fbf-43cd-8c0d-e5dec162be71] Took 1.26 seconds to destroy the instance on the hypervisor.
Aug 09 15:32:19 user nova-compute[72382]: DEBUG oslo.service.loopingcall [None req-be63297d-7c0c-45da-aeeb-53e0ebb52305 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72382) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 15:32:19 user nova-compute[72382]: DEBUG nova.compute.manager [-] [instance: 2f430d9a-9fbf-43cd-8c0d-e5dec162be71] Deallocating network for instance {{(pid=72382) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 15:32:19 user nova-compute[72382]: DEBUG nova.network.neutron [-] [instance: 2f430d9a-9fbf-43cd-8c0d-e5dec162be71] deallocate_for_instance() {{(pid=72382) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 15:32:19 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:32:20 user nova-compute[72382]: DEBUG nova.network.neutron [-] [instance: 2f430d9a-9fbf-43cd-8c0d-e5dec162be71] Updating instance_info_cache with network_info: [] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:32:20 user nova-compute[72382]: INFO nova.compute.manager [-] [instance: 2f430d9a-9fbf-43cd-8c0d-e5dec162be71] Took 0.52 seconds to deallocate network for instance.
Aug 09 15:32:20 user nova-compute[72382]: DEBUG nova.compute.manager [req-2be0638a-7e9e-4f7f-b091-a2f9e3cb62b2 req-c7682721-4234-4945-97e2-4b79afbf088b service nova] [instance: 2f430d9a-9fbf-43cd-8c0d-e5dec162be71] Received event network-vif-deleted-d13c4d4e-9004-4d4b-999d-619564a98542 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:32:20 user nova-compute[72382]: DEBUG nova.compute.manager [req-57e1b080-da41-4057-8cce-721fd309d897 req-e0fe119b-bd2f-4d5d-a593-6cb27a75062d service nova] [instance: 2f430d9a-9fbf-43cd-8c0d-e5dec162be71] Received event network-vif-plugged-d13c4d4e-9004-4d4b-999d-619564a98542 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:32:20 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-57e1b080-da41-4057-8cce-721fd309d897 req-e0fe119b-bd2f-4d5d-a593-6cb27a75062d service nova] Acquiring lock "2f430d9a-9fbf-43cd-8c0d-e5dec162be71-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:32:20 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-57e1b080-da41-4057-8cce-721fd309d897 req-e0fe119b-bd2f-4d5d-a593-6cb27a75062d service nova] Lock "2f430d9a-9fbf-43cd-8c0d-e5dec162be71-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:32:20 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-57e1b080-da41-4057-8cce-721fd309d897 req-e0fe119b-bd2f-4d5d-a593-6cb27a75062d service nova] Lock "2f430d9a-9fbf-43cd-8c0d-e5dec162be71-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:32:20 user nova-compute[72382]: DEBUG nova.compute.manager [req-57e1b080-da41-4057-8cce-721fd309d897 req-e0fe119b-bd2f-4d5d-a593-6cb27a75062d service nova] [instance: 2f430d9a-9fbf-43cd-8c0d-e5dec162be71] No waiting events found dispatching network-vif-plugged-d13c4d4e-9004-4d4b-999d-619564a98542 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:32:20 user nova-compute[72382]: WARNING nova.compute.manager [req-57e1b080-da41-4057-8cce-721fd309d897 req-e0fe119b-bd2f-4d5d-a593-6cb27a75062d service nova] [instance: 2f430d9a-9fbf-43cd-8c0d-e5dec162be71] Received unexpected event network-vif-plugged-d13c4d4e-9004-4d4b-999d-619564a98542 for instance with vm_state active and task_state deleting.
Aug 09 15:32:21 user nova-compute[72382]: INFO nova.compute.manager [None req-be63297d-7c0c-45da-aeeb-53e0ebb52305 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] [instance: 2f430d9a-9fbf-43cd-8c0d-e5dec162be71] Took 0.77 seconds to detach 1 volumes for instance.
Aug 09 15:32:21 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-be63297d-7c0c-45da-aeeb-53e0ebb52305 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:32:21 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-be63297d-7c0c-45da-aeeb-53e0ebb52305 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:32:21 user nova-compute[72382]: DEBUG nova.compute.provider_tree [None req-be63297d-7c0c-45da-aeeb-53e0ebb52305 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Inventory has not changed in ProviderTree for provider: 7b15b0e5-df4d-49db-833b-2855d21d10ae {{(pid=72382) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 15:32:21 user nova-compute[72382]: DEBUG nova.scheduler.client.report [None req-be63297d-7c0c-45da-aeeb-53e0ebb52305 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Inventory has not changed for provider 7b15b0e5-df4d-49db-833b-2855d21d10ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72382) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 15:32:21 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-be63297d-7c0c-45da-aeeb-53e0ebb52305 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.321s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:32:21 user nova-compute[72382]: INFO nova.scheduler.client.report [None req-be63297d-7c0c-45da-aeeb-53e0ebb52305 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Deleted allocations for instance 2f430d9a-9fbf-43cd-8c0d-e5dec162be71
Aug 09 15:32:21 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-be63297d-7c0c-45da-aeeb-53e0ebb52305 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Lock "2f430d9a-9fbf-43cd-8c0d-e5dec162be71" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.053s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:32:22 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e9330677-8ba4-42ad-a33e-5e28683788f1 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Acquiring lock "d7c34b80-c2e9-43c1-8b8e-7c62eb8e73f4" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:32:22 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e9330677-8ba4-42ad-a33e-5e28683788f1 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Lock "d7c34b80-c2e9-43c1-8b8e-7c62eb8e73f4" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:32:22 user nova-compute[72382]: DEBUG nova.objects.instance [None req-e9330677-8ba4-42ad-a33e-5e28683788f1 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Lazy-loading 'flavor' on Instance uuid d7c34b80-c2e9-43c1-8b8e-7c62eb8e73f4 {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:32:22 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e9330677-8ba4-42ad-a33e-5e28683788f1 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Lock "d7c34b80-c2e9-43c1-8b8e-7c62eb8e73f4" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:32:22 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e9330677-8ba4-42ad-a33e-5e28683788f1 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Acquiring lock "d7c34b80-c2e9-43c1-8b8e-7c62eb8e73f4" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:32:22 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e9330677-8ba4-42ad-a33e-5e28683788f1 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Lock "d7c34b80-c2e9-43c1-8b8e-7c62eb8e73f4" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:32:22 user nova-compute[72382]: INFO nova.compute.manager [None req-e9330677-8ba4-42ad-a33e-5e28683788f1 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] [instance: d7c34b80-c2e9-43c1-8b8e-7c62eb8e73f4] Attaching volume e395d6a1-d7ce-4bf1-ab20-4b087defb56a to /dev/vdb
Aug 09 15:32:22 user nova-compute[72382]: DEBUG os_brick.utils [None req-e9330677-8ba4-42ad-a33e-5e28683788f1 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 15:32:22 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:32:22 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:32:22 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3012d02-d4ae-4909-a7d6-c8a2a058d928]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d2cfa7015fe\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:32:22 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:32:22 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:32:22 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[26f0ac87-c236-41e5-a6f4-0abb055ad21b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:32:22 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:32:22 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:32:22 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd72ca70-5a48-40c5-8f16-efca5a08516b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:32:22 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[9016aff3-e698-420c-af4a-41feac9e8194]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:32:22 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e9330677-8ba4-42ad-a33e-5e28683788f1 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Running cmd (subprocess): nvme version {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:32:22 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e9330677-8ba4-42ad-a33e-5e28683788f1 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] 'nvme version' failed. Not Retrying. {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 15:32:22 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e9330677-8ba4-42ad-a33e-5e28683788f1 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] nvme not present on system {{(pid=72382) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 15:32:22 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:32:22 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 15:32:22 user nova-compute[72382]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 15:32:22 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8900576-4347-46ad-bfa9-2a2ecd0c4fd7]: (4, '') {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:32:22 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.lightos [None req-e9330677-8ba4-42ad-a33e-5e28683788f1 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72382) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 15:32:22 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.lightos [None req-e9330677-8ba4-42ad-a33e-5e28683788f1 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72382) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 15:32:22 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.lightos [None req-e9330677-8ba4-42ad-a33e-5e28683788f1 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] LIGHTOS: no hostnqn found. {{(pid=72382) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 15:32:22 user nova-compute[72382]: DEBUG os_brick.utils [None req-e9330677-8ba4-42ad-a33e-5e28683788f1 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] <== get_connector_properties: return (143ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d2cfa7015fe', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 15:32:22 user nova-compute[72382]: DEBUG nova.virt.block_device [None req-e9330677-8ba4-42ad-a33e-5e28683788f1 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] [instance: d7c34b80-c2e9-43c1-8b8e-7c62eb8e73f4] Updating existing volume attachment record: d04ebd5e-e164-47ec-ad7a-3ed707c1bbbd {{(pid=72382) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 15:32:22 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:32:24 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:32:24 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:32:29 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:32:29 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:32:31 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e9330677-8ba4-42ad-a33e-5e28683788f1 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] [instance: d7c34b80-c2e9-43c1-8b8e-7c62eb8e73f4] Calling os-brick to attach iSCSI Volume {{(pid=72382) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 15:32:31 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9330677-8ba4-42ad-a33e-5e28683788f1 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2a0c768340>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:e395d6a1-d7ce-4bf1-ab20-4b087defb56a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LFIDymAf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 15:32:31 user nova-compute[72382]: WARNING os_brick.initiator.connectors.base [None req-e9330677-8ba4-42ad-a33e-5e28683788f1 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 15:32:31 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-e9330677-8ba4-42ad-a33e-5e28683788f1 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 15:32:31 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-e9330677-8ba4-42ad-a33e-5e28683788f1 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 15:32:31 user nova-compute[72382]: WARNING os_brick.initiator.connectors.base [None req-e9330677-8ba4-42ad-a33e-5e28683788f1 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 15:32:31 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-e9330677-8ba4-42ad-a33e-5e28683788f1 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e395d6a1-d7ce-4bf1-ab20-4b087defb56a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 15:32:31 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-e9330677-8ba4-42ad-a33e-5e28683788f1 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e395d6a1-d7ce-4bf1-ab20-4b087defb56a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 15:32:31 user nova-compute[72382]: INFO os_brick.initiator.connectors.iscsi [None req-e9330677-8ba4-42ad-a33e-5e28683788f1 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 15:32:31 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e395d6a1-d7ce-4bf1-ab20-4b087defb56a -p 172.16.0.220:3260 {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:32:31 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e395d6a1-d7ce-4bf1-ab20-4b087defb56a -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:32:31 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c24cc9b-6791-4d79-9beb-5bd45955ae58]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:32:31 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9330677-8ba4-42ad-a33e-5e28683788f1 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 15:32:31 user nova-compute[72382]:  {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:32:31 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e395d6a1-d7ce-4bf1-ab20-4b087defb56a -p 172.16.0.220:3260 --interface default --op new {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:32:31 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e395d6a1-d7ce-4bf1-ab20-4b087defb56a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:32:31 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[94e8d924-6d81-49f8-9e41-431ff3f3b537]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e395d6a1-d7ce-4bf1-ab20-4b087defb56a] added\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:32:31 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9330677-8ba4-42ad-a33e-5e28683788f1 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e395d6a1-d7ce-4bf1-ab20-4b087defb56a] added
Aug 09 15:32:31 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:32:31 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e395d6a1-d7ce-4bf1-ab20-4b087defb56a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:32:31 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e395d6a1-d7ce-4bf1-ab20-4b087defb56a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:32:31 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[da6b2a33-081a-4ac1-9609-6de8982008d8]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:32:31 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9330677-8ba4-42ad-a33e-5e28683788f1 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:32:31 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e395d6a1-d7ce-4bf1-ab20-4b087defb56a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:32:31 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e395d6a1-d7ce-4bf1-ab20-4b087defb56a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:32:31 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8361a41-aa19-4ae4-b843-fdf9470566b9]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:32:31 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9330677-8ba4-42ad-a33e-5e28683788f1 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:32:31 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e395d6a1-d7ce-4bf1-ab20-4b087defb56a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LFIDymAf {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:32:31 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e395d6a1-d7ce-4bf1-ab20-4b087defb56a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LFIDymAf" returned: 0 in 0.018s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:32:31 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8033fc7-2795-48bd-9453-9a9ffedbb451]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:32:31 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9330677-8ba4-42ad-a33e-5e28683788f1 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LFIDymAf'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:32:31 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e395d6a1-d7ce-4bf1-ab20-4b087defb56a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:32:31 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e395d6a1-d7ce-4bf1-ab20-4b087defb56a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:32:31 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ff3a02b-b92d-4eb4-9f8a-0f310fe3091c]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:32:31 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9330677-8ba4-42ad-a33e-5e28683788f1 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:32:31 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:32:31 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:32:31 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[c313ffde-8403-4167-aa75-55fa8d28620e]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5cfefdb-a454-494f-ab09-acf8644352a3 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59852df5-d4c8-4f25-8693-36181ff6a447 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8516df70-0781-4493-b04f-417dfdfd5365 (non-flash)\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:32:31 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9330677-8ba4-42ad-a33e-5e28683788f1 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)
Aug 09 15:32:31 user nova-compute[72382]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5cfefdb-a454-494f-ab09-acf8644352a3 (non-flash)
Aug 09 15:32:31 user nova-compute[72382]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59852df5-d4c8-4f25-8693-36181ff6a447 (non-flash)
Aug 09 15:32:31 user nova-compute[72382]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8516df70-0781-4493-b04f-417dfdfd5365 (non-flash)
Aug 09 15:32:31 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 15:32:31 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9330677-8ba4-42ad-a33e-5e28683788f1 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)
Aug 09 15:32:31 user nova-compute[72382]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5cfefdb-a454-494f-ab09-acf8644352a3 (non-flash)
Aug 09 15:32:31 user nova-compute[72382]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59852df5-d4c8-4f25-8693-36181ff6a447 (non-flash)
Aug 09 15:32:31 user nova-compute[72382]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8516df70-0781-4493-b04f-417dfdfd5365 (non-flash)
Aug 09 15:32:31 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 15:32:31 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e395d6a1-d7ce-4bf1-ab20-4b087defb56a -p 172.16.0.220:3260 --login {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:32:31 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e395d6a1-d7ce-4bf1-ab20-4b087defb56a -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:32:31 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea2c0515-a801-43a4-ab20-534134eff421]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e395d6a1-d7ce-4bf1-ab20-4b087defb56a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e395d6a1-d7ce-4bf1-ab20-4b087defb56a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:32:31 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9330677-8ba4-42ad-a33e-5e28683788f1 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e395d6a1-d7ce-4bf1-ab20-4b087defb56a, portal: 172.16.0.220,3260]
Aug 09 15:32:31 user nova-compute[72382]: Login to [iface: default, target: iqn.2010-10.org.openstack:e395d6a1-d7ce-4bf1-ab20-4b087defb56a, portal: 172.16.0.220,3260] successful.
Aug 09 15:32:31 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:32:31 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e395d6a1-d7ce-4bf1-ab20-4b087defb56a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:32:31 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e395d6a1-d7ce-4bf1-ab20-4b087defb56a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:32:31 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ec8b902-de7e-40ea-8462-0a9ae49f5824]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:32:31 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9330677-8ba4-42ad-a33e-5e28683788f1 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:32:31 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:32:31 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:32:31 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2a90db0-cb1e-4004-9a4f-e4dc82bb208f]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5cfefdb-a454-494f-ab09-acf8644352a3 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59852df5-d4c8-4f25-8693-36181ff6a447 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8516df70-0781-4493-b04f-417dfdfd5365 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e395d6a1-d7ce-4bf1-ab20-4b087defb56a (non-flash)\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:32:31 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9330677-8ba4-42ad-a33e-5e28683788f1 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)
Aug 09 15:32:31 user nova-compute[72382]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5cfefdb-a454-494f-ab09-acf8644352a3 (non-flash)
Aug 09 15:32:31 user nova-compute[72382]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59852df5-d4c8-4f25-8693-36181ff6a447 (non-flash)
Aug 09 15:32:31 user nova-compute[72382]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8516df70-0781-4493-b04f-417dfdfd5365 (non-flash)
Aug 09 15:32:31 user nova-compute[72382]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e395d6a1-d7ce-4bf1-ab20-4b087defb56a (non-flash)
Aug 09 15:32:31 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 15:32:31 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9330677-8ba4-42ad-a33e-5e28683788f1 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)
Aug 09 15:32:31 user nova-compute[72382]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5cfefdb-a454-494f-ab09-acf8644352a3 (non-flash)
Aug 09 15:32:31 user nova-compute[72382]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59852df5-d4c8-4f25-8693-36181ff6a447 (non-flash)
Aug 09 15:32:31 user nova-compute[72382]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8516df70-0781-4493-b04f-417dfdfd5365 (non-flash)
Aug 09 15:32:31 user nova-compute[72382]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e395d6a1-d7ce-4bf1-ab20-4b087defb56a (non-flash)
Aug 09 15:32:31 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 15:32:31 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-e9330677-8ba4-42ad-a33e-5e28683788f1 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e395d6a1-d7ce-4bf1-ab20-4b087defb56a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.293s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 15:32:31 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9330677-8ba4-42ad-a33e-5e28683788f1 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Connected to 172.16.0.220:3260 {{(pid=72382) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 15:32:31 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-e9330677-8ba4-42ad-a33e-5e28683788f1 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] HCTL ('36', '-', '-', 0) found on session 42 with lun 0 {{(pid=72382) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 15:32:31 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-e9330677-8ba4-42ad-a33e-5e28683788f1 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72382) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 15:32:31 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:32:31 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.020s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:32:31 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[8195d1b1-3907-487a-95c8-11446ad8fe49]: (4, ('- - 0', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:32:31 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-e9330677-8ba4-42ad-a33e-5e28683788f1 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Searching for a device in session 42 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72382) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 15:32:31 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9330677-8ba4-42ad-a33e-5e28683788f1 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LFIDymAf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72382) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 15:32:32 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-e9330677-8ba4-42ad-a33e-5e28683788f1 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.329s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 15:32:32 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9330677-8ba4-42ad-a33e-5e28683788f1 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] <== connect_volume: return (1330ms) {'type': 'block', 'scsi_wwn': '23830373331663833', 'path': '/dev/sde'} {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 15:32:32 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e9330677-8ba4-42ad-a33e-5e28683788f1 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] [instance: d7c34b80-c2e9-43c1-8b8e-7c62eb8e73f4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23830373331663833', 'path': '/dev/sde'} {{(pid=72382) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 15:32:32 user nova-compute[72382]: DEBUG nova.objects.instance [None req-e9330677-8ba4-42ad-a33e-5e28683788f1 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Lazy-loading 'flavor' on Instance uuid d7c34b80-c2e9-43c1-8b8e-7c62eb8e73f4 {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:32:32 user nova-compute[72382]: DEBUG nova.virt.libvirt.guest [None req-e9330677-8ba4-42ad-a33e-5e28683788f1 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 15:32:32 user nova-compute[72382]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 15:32:32 user nova-compute[72382]:   <source dev="/dev/sde"/>
Aug 09 15:32:32 user nova-compute[72382]:   <target dev="vdb" bus="virtio"/>
Aug 09 15:32:32 user nova-compute[72382]:   <serial>e395d6a1-d7ce-4bf1-ab20-4b087defb56a</serial>
Aug 09 15:32:32 user nova-compute[72382]: </disk>
Aug 09 15:32:32 user nova-compute[72382]:  {{(pid=72382) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 15:32:32 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-e9330677-8ba4-42ad-a33e-5e28683788f1 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] No BDM found with device name vda, not building metadata. {{(pid=72382) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 15:32:32 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-e9330677-8ba4-42ad-a33e-5e28683788f1 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72382) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 15:32:32 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-e9330677-8ba4-42ad-a33e-5e28683788f1 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] No VIF found with MAC fa:16:3e:64:69:21, not building metadata {{(pid=72382) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 15:32:33 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e9330677-8ba4-42ad-a33e-5e28683788f1 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Lock "d7c34b80-c2e9-43c1-8b8e-7c62eb8e73f4" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.506s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:32:33 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-69b6f6f9-c603-40d3-8af4-dcd3a9c94ff8 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Acquiring lock "d7c34b80-c2e9-43c1-8b8e-7c62eb8e73f4" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:32:33 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-69b6f6f9-c603-40d3-8af4-dcd3a9c94ff8 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Lock "d7c34b80-c2e9-43c1-8b8e-7c62eb8e73f4" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:32:33 user nova-compute[72382]: INFO nova.compute.manager [None req-69b6f6f9-c603-40d3-8af4-dcd3a9c94ff8 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] [instance: d7c34b80-c2e9-43c1-8b8e-7c62eb8e73f4] Detaching volume e395d6a1-d7ce-4bf1-ab20-4b087defb56a
Aug 09 15:32:33 user nova-compute[72382]: INFO nova.virt.block_device [None req-69b6f6f9-c603-40d3-8af4-dcd3a9c94ff8 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] [instance: d7c34b80-c2e9-43c1-8b8e-7c62eb8e73f4] Attempting to driver detach volume e395d6a1-d7ce-4bf1-ab20-4b087defb56a from mountpoint /dev/vdb
Aug 09 15:32:33 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-69b6f6f9-c603-40d3-8af4-dcd3a9c94ff8 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Attempting to detach device vdb from instance d7c34b80-c2e9-43c1-8b8e-7c62eb8e73f4 from the persistent domain config. {{(pid=72382) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 15:32:33 user nova-compute[72382]: DEBUG nova.virt.libvirt.guest [None req-69b6f6f9-c603-40d3-8af4-dcd3a9c94ff8 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 15:32:33 user nova-compute[72382]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 15:32:33 user nova-compute[72382]:   <source dev="/dev/sde"/>
Aug 09 15:32:33 user nova-compute[72382]:   <target dev="vdb" bus="virtio"/>
Aug 09 15:32:33 user nova-compute[72382]:   <serial>e395d6a1-d7ce-4bf1-ab20-4b087defb56a</serial>
Aug 09 15:32:33 user nova-compute[72382]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 15:32:33 user nova-compute[72382]: </disk>
Aug 09 15:32:33 user nova-compute[72382]:  {{(pid=72382) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 15:32:33 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-69b6f6f9-c603-40d3-8af4-dcd3a9c94ff8 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Successfully detached device vdb from instance d7c34b80-c2e9-43c1-8b8e-7c62eb8e73f4 from the persistent domain config.
Aug 09 15:32:33 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-69b6f6f9-c603-40d3-8af4-dcd3a9c94ff8 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d7c34b80-c2e9-43c1-8b8e-7c62eb8e73f4 from the live domain config. {{(pid=72382) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 15:32:33 user nova-compute[72382]: DEBUG nova.virt.libvirt.guest [None req-69b6f6f9-c603-40d3-8af4-dcd3a9c94ff8 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 15:32:33 user nova-compute[72382]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 15:32:33 user nova-compute[72382]:   <source dev="/dev/sde"/>
Aug 09 15:32:33 user nova-compute[72382]:   <target dev="vdb" bus="virtio"/>
Aug 09 15:32:33 user nova-compute[72382]:   <serial>e395d6a1-d7ce-4bf1-ab20-4b087defb56a</serial>
Aug 09 15:32:33 user nova-compute[72382]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 15:32:33 user nova-compute[72382]: </disk>
Aug 09 15:32:33 user nova-compute[72382]:  {{(pid=72382) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 15:32:34 user nova-compute[72382]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691595139.2512045, 2f430d9a-9fbf-43cd-8c0d-e5dec162be71 => Stopped> {{(pid=72382) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 15:32:34 user nova-compute[72382]: INFO nova.compute.manager [-] [instance: 2f430d9a-9fbf-43cd-8c0d-e5dec162be71] VM Stopped (Lifecycle Event)
Aug 09 15:32:34 user nova-compute[72382]: DEBUG nova.compute.manager [None req-c00da8d2-6cf5-4f04-a95c-3cb784672a85 None None] [instance: 2f430d9a-9fbf-43cd-8c0d-e5dec162be71] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:32:34 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:32:34 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Received event <DeviceRemovedEvent: 1691595154.316758, d7c34b80-c2e9-43c1-8b8e-7c62eb8e73f4 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72382) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 15:32:34 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-69b6f6f9-c603-40d3-8af4-dcd3a9c94ff8 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d7c34b80-c2e9-43c1-8b8e-7c62eb8e73f4 {{(pid=72382) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 15:32:34 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-69b6f6f9-c603-40d3-8af4-dcd3a9c94ff8 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Successfully detached device vdb from instance d7c34b80-c2e9-43c1-8b8e-7c62eb8e73f4 from the live domain config.
Aug 09 15:32:34 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-69b6f6f9-c603-40d3-8af4-dcd3a9c94ff8 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] [instance: d7c34b80-c2e9-43c1-8b8e-7c62eb8e73f4] calling os-brick to detach iSCSI Volume {{(pid=72382) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 15:32:34 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-69b6f6f9-c603-40d3-8af4-dcd3a9c94ff8 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2a0c768340>, {'target_iqns': ['iqn.2010-10.org.openstack:e395d6a1-d7ce-4bf1-ab20-4b087defb56a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LFIDymAf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 15:32:34 user nova-compute[72382]: WARNING os_brick.initiator.connectors.base [None req-69b6f6f9-c603-40d3-8af4-dcd3a9c94ff8 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 15:32:34 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-69b6f6f9-c603-40d3-8af4-dcd3a9c94ff8 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 15:32:34 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-69b6f6f9-c603-40d3-8af4-dcd3a9c94ff8 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 15:32:34 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-69b6f6f9-c603-40d3-8af4-dcd3a9c94ff8 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e395d6a1-d7ce-4bf1-ab20-4b087defb56a', 0)] {{(pid=72382) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 15:32:34 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:32:34 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:32:34 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fe8d15e-a42c-4515-9a8a-287af3cb143e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:59852df5-d4c8-4f25-8693-36181ff6a447\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8516df70-0781-4493-b04f-417dfdfd5365\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b5cfefdb-a454-494f-ab09-acf8644352a3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e395d6a1-d7ce-4bf1-ab20-4b087defb56a\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:32:34 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:32:34 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:32:34 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cc660a8-a743-46ba-b307-e6eeb6859d6e]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5cfefdb-a454-494f-ab09-acf8644352a3 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59852df5-d4c8-4f25-8693-36181ff6a447 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8516df70-0781-4493-b04f-417dfdfd5365 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e395d6a1-d7ce-4bf1-ab20-4b087defb56a (non-flash)\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:32:34 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-69b6f6f9-c603-40d3-8af4-dcd3a9c94ff8 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)
Aug 09 15:32:34 user nova-compute[72382]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5cfefdb-a454-494f-ab09-acf8644352a3 (non-flash)
Aug 09 15:32:34 user nova-compute[72382]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59852df5-d4c8-4f25-8693-36181ff6a447 (non-flash)
Aug 09 15:32:34 user nova-compute[72382]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8516df70-0781-4493-b04f-417dfdfd5365 (non-flash)
Aug 09 15:32:34 user nova-compute[72382]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e395d6a1-d7ce-4bf1-ab20-4b087defb56a (non-flash)
Aug 09 15:32:34 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 15:32:34 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-69b6f6f9-c603-40d3-8af4-dcd3a9c94ff8 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)
Aug 09 15:32:34 user nova-compute[72382]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5cfefdb-a454-494f-ab09-acf8644352a3 (non-flash)
Aug 09 15:32:34 user nova-compute[72382]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59852df5-d4c8-4f25-8693-36181ff6a447 (non-flash)
Aug 09 15:32:34 user nova-compute[72382]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8516df70-0781-4493-b04f-417dfdfd5365 (non-flash)
Aug 09 15:32:34 user nova-compute[72382]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e395d6a1-d7ce-4bf1-ab20-4b087defb56a (non-flash)
Aug 09 15:32:34 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 15:32:34 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-69b6f6f9-c603-40d3-8af4-dcd3a9c94ff8 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2a0c2a17e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e395d6a1-d7ce-4bf1-ab20-4b087defb56a'): ({'sde'}, set())}) {{(pid=72382) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 15:32:34 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-69b6f6f9-c603-40d3-8af4-dcd3a9c94ff8 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Removing single pathed devices sde {{(pid=72382) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 15:32:34 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:32:34 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:32:34 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[aab7ebcc-238c-4299-a00c-847f7d612f06]: (4, ('path checker states:\nup                  4\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:32:34 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:32:34 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.021s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:32:34 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5122b38-d89c-48b4-9a2d-b8a3a7442980]: (4, ('ok\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:32:34 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-69b6f6f9-c603-40d3-8af4-dcd3a9c94ff8 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Flushing IO for device /dev/sde {{(pid=72382) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 15:32:34 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:32:34 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.017s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:32:34 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a6e594e-7236-42f8-a248-878da16c143b]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:32:34 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-69b6f6f9-c603-40d3-8af4-dcd3a9c94ff8 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72382) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 15:32:34 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:32:34 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.041s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:32:34 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4c7eb14-02f6-462a-ad82-4d2ed0d72a4e]: (4, ('1', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:32:34 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-69b6f6f9-c603-40d3-8af4-dcd3a9c94ff8 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72382) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 15:32:34 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-69b6f6f9-c603-40d3-8af4-dcd3a9c94ff8 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] SCSI volumes sde have been removed. {{(pid=72382) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 15:32:34 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-69b6f6f9-c603-40d3-8af4-dcd3a9c94ff8 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e395d6a1-d7ce-4bf1-ab20-4b087defb56a')] {{(pid=72382) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 15:32:34 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e395d6a1-d7ce-4bf1-ab20-4b087defb56a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:32:34 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e395d6a1-d7ce-4bf1-ab20-4b087defb56a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:32:34 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[fedd5ddb-907d-4a48-b443-55d9499706d9]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:32:34 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-69b6f6f9-c603-40d3-8af4-dcd3a9c94ff8 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:32:34 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e395d6a1-d7ce-4bf1-ab20-4b087defb56a -p 172.16.0.220:3260 --logout {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:32:34 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:32:34 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e395d6a1-d7ce-4bf1-ab20-4b087defb56a -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:32:34 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[94ef7aed-dd69-4f4a-9312-edf8d141159d]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:e395d6a1-d7ce-4bf1-ab20-4b087defb56a, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:e395d6a1-d7ce-4bf1-ab20-4b087defb56a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:32:34 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-69b6f6f9-c603-40d3-8af4-dcd3a9c94ff8 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:e395d6a1-d7ce-4bf1-ab20-4b087defb56a, portal: 172.16.0.220,3260]
Aug 09 15:32:34 user nova-compute[72382]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:e395d6a1-d7ce-4bf1-ab20-4b087defb56a, portal: 172.16.0.220,3260] successful.
Aug 09 15:32:34 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:32:34 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e395d6a1-d7ce-4bf1-ab20-4b087defb56a -p 172.16.0.220:3260 --op delete {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:32:34 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e395d6a1-d7ce-4bf1-ab20-4b087defb56a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:32:34 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[96a1d90b-77f6-431f-a974-8dc4988557b1]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:32:34 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-69b6f6f9-c603-40d3-8af4-dcd3a9c94ff8 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:32:34 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-69b6f6f9-c603-40d3-8af4-dcd3a9c94ff8 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.295s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 15:32:34 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-69b6f6f9-c603-40d3-8af4-dcd3a9c94ff8 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] <== disconnect_volume: return (296ms) None {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 15:32:34 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-69b6f6f9-c603-40d3-8af4-dcd3a9c94ff8 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] [instance: d7c34b80-c2e9-43c1-8b8e-7c62eb8e73f4] Disconnected iSCSI Volume {{(pid=72382) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 15:32:35 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-6b3c4668-fdaa-487d-86b4-acf97ac0b560 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Acquiring lock "44afd1bf-fa5c-4b3e-8752-b16853fef54e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:32:35 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-6b3c4668-fdaa-487d-86b4-acf97ac0b560 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Lock "44afd1bf-fa5c-4b3e-8752-b16853fef54e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:32:35 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-6b3c4668-fdaa-487d-86b4-acf97ac0b560 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Acquiring lock "44afd1bf-fa5c-4b3e-8752-b16853fef54e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:32:35 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-6b3c4668-fdaa-487d-86b4-acf97ac0b560 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Lock "44afd1bf-fa5c-4b3e-8752-b16853fef54e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:32:35 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-6b3c4668-fdaa-487d-86b4-acf97ac0b560 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Lock "44afd1bf-fa5c-4b3e-8752-b16853fef54e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:32:35 user nova-compute[72382]: INFO nova.compute.manager [None req-6b3c4668-fdaa-487d-86b4-acf97ac0b560 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] [instance: 44afd1bf-fa5c-4b3e-8752-b16853fef54e] Terminating instance
Aug 09 15:32:35 user nova-compute[72382]: DEBUG nova.compute.manager [None req-6b3c4668-fdaa-487d-86b4-acf97ac0b560 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] [instance: 44afd1bf-fa5c-4b3e-8752-b16853fef54e] Start destroying the instance on the hypervisor. {{(pid=72382) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 15:32:35 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:32:35 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:32:35 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:32:35 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:32:35 user nova-compute[72382]: DEBUG nova.compute.manager [req-9e62f810-807a-449f-aaab-99f190f81bde req-e71e47d1-d328-41cc-8d58-fcd1ec995fc1 service nova] [instance: 44afd1bf-fa5c-4b3e-8752-b16853fef54e] Received event network-vif-unplugged-2a1d4c60-bc2a-4530-b3bd-2a12ae2d2098 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:32:35 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-9e62f810-807a-449f-aaab-99f190f81bde req-e71e47d1-d328-41cc-8d58-fcd1ec995fc1 service nova] Acquiring lock "44afd1bf-fa5c-4b3e-8752-b16853fef54e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:32:35 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-9e62f810-807a-449f-aaab-99f190f81bde req-e71e47d1-d328-41cc-8d58-fcd1ec995fc1 service nova] Lock "44afd1bf-fa5c-4b3e-8752-b16853fef54e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:32:35 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-9e62f810-807a-449f-aaab-99f190f81bde req-e71e47d1-d328-41cc-8d58-fcd1ec995fc1 service nova] Lock "44afd1bf-fa5c-4b3e-8752-b16853fef54e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:32:35 user nova-compute[72382]: DEBUG nova.compute.manager [req-9e62f810-807a-449f-aaab-99f190f81bde req-e71e47d1-d328-41cc-8d58-fcd1ec995fc1 service nova] [instance: 44afd1bf-fa5c-4b3e-8752-b16853fef54e] No waiting events found dispatching network-vif-unplugged-2a1d4c60-bc2a-4530-b3bd-2a12ae2d2098 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:32:35 user nova-compute[72382]: DEBUG nova.compute.manager [req-9e62f810-807a-449f-aaab-99f190f81bde req-e71e47d1-d328-41cc-8d58-fcd1ec995fc1 service nova] [instance: 44afd1bf-fa5c-4b3e-8752-b16853fef54e] Received event network-vif-unplugged-2a1d4c60-bc2a-4530-b3bd-2a12ae2d2098 for instance with task_state deleting. {{(pid=72382) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 15:32:35 user nova-compute[72382]: DEBUG nova.objects.instance [None req-69b6f6f9-c603-40d3-8af4-dcd3a9c94ff8 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Lazy-loading 'flavor' on Instance uuid d7c34b80-c2e9-43c1-8b8e-7c62eb8e73f4 {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:32:35 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-69b6f6f9-c603-40d3-8af4-dcd3a9c94ff8 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Lock "d7c34b80-c2e9-43c1-8b8e-7c62eb8e73f4" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.648s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:32:35 user nova-compute[72382]: INFO nova.virt.libvirt.driver [-] [instance: 44afd1bf-fa5c-4b3e-8752-b16853fef54e] Instance destroyed successfully.
Aug 09 15:32:35 user nova-compute[72382]: DEBUG nova.objects.instance [None req-6b3c4668-fdaa-487d-86b4-acf97ac0b560 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Lazy-loading 'resources' on Instance uuid 44afd1bf-fa5c-4b3e-8752-b16853fef54e {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:32:35 user nova-compute[72382]: DEBUG nova.virt.libvirt.vif [None req-6b3c4668-fdaa-487d-86b4-acf97ac0b560 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T15:15:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-201849157',display_name='tempest-ServerRescueNegativeTestJSON-server-201849157',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-201849157',id=3,image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-09T15:20:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='990ba791030940d38360af5879c853c5',ramdisk_id='',reservation_id='r-fqm5h5sw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-867522113',owner_user_name='tempest-ServerRescueNegativeTestJSON-867522113-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T15:22:00Z,user_data=None,user_id='f94ca386a2be42cfbc2407bb7520cd25',uuid=44afd1bf-fa5c-4b3e-8752-b16853fef54e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2a1d4c60-bc2a-4530-b3bd-2a12ae2d2098", "address": "fa:16:3e:6c:50:29", "network": {"id": "46ef00c7-17ee-4e45-ba1d-dcc0a417ea85", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1360012261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "990ba791030940d38360af5879c853c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a1d4c60-bc", "ovs_interfaceid": "2a1d4c60-bc2a-4530-b3bd-2a12ae2d2098", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 15:32:35 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-6b3c4668-fdaa-487d-86b4-acf97ac0b560 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Converting VIF {"id": "2a1d4c60-bc2a-4530-b3bd-2a12ae2d2098", "address": "fa:16:3e:6c:50:29", "network": {"id": "46ef00c7-17ee-4e45-ba1d-dcc0a417ea85", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1360012261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "990ba791030940d38360af5879c853c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a1d4c60-bc", "ovs_interfaceid": "2a1d4c60-bc2a-4530-b3bd-2a12ae2d2098", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 15:32:35 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-6b3c4668-fdaa-487d-86b4-acf97ac0b560 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6c:50:29,bridge_name='br-int',has_traffic_filtering=True,id=2a1d4c60-bc2a-4530-b3bd-2a12ae2d2098,network=Network(46ef00c7-17ee-4e45-ba1d-dcc0a417ea85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a1d4c60-bc') {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 15:32:35 user nova-compute[72382]: DEBUG os_vif [None req-6b3c4668-fdaa-487d-86b4-acf97ac0b560 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6c:50:29,bridge_name='br-int',has_traffic_filtering=True,id=2a1d4c60-bc2a-4530-b3bd-2a12ae2d2098,network=Network(46ef00c7-17ee-4e45-ba1d-dcc0a417ea85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a1d4c60-bc') {{(pid=72382) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 15:32:35 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:32:35 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2a1d4c60-bc, bridge=br-int, if_exists=True) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:32:35 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:32:35 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:32:35 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:32:35 user nova-compute[72382]: INFO os_vif [None req-6b3c4668-fdaa-487d-86b4-acf97ac0b560 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6c:50:29,bridge_name='br-int',has_traffic_filtering=True,id=2a1d4c60-bc2a-4530-b3bd-2a12ae2d2098,network=Network(46ef00c7-17ee-4e45-ba1d-dcc0a417ea85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a1d4c60-bc')
Aug 09 15:32:35 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-6b3c4668-fdaa-487d-86b4-acf97ac0b560 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] [instance: 44afd1bf-fa5c-4b3e-8752-b16853fef54e] Deleting instance files /opt/stack/data/nova/instances/44afd1bf-fa5c-4b3e-8752-b16853fef54e_del
Aug 09 15:32:35 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-6b3c4668-fdaa-487d-86b4-acf97ac0b560 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] [instance: 44afd1bf-fa5c-4b3e-8752-b16853fef54e] Deletion of /opt/stack/data/nova/instances/44afd1bf-fa5c-4b3e-8752-b16853fef54e_del complete
Aug 09 15:32:35 user nova-compute[72382]: INFO nova.compute.manager [None req-6b3c4668-fdaa-487d-86b4-acf97ac0b560 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] [instance: 44afd1bf-fa5c-4b3e-8752-b16853fef54e] Took 0.87 seconds to destroy the instance on the hypervisor.
Aug 09 15:32:35 user nova-compute[72382]: DEBUG oslo.service.loopingcall [None req-6b3c4668-fdaa-487d-86b4-acf97ac0b560 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72382) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 15:32:35 user nova-compute[72382]: DEBUG nova.compute.manager [-] [instance: 44afd1bf-fa5c-4b3e-8752-b16853fef54e] Deallocating network for instance {{(pid=72382) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 15:32:35 user nova-compute[72382]: DEBUG nova.network.neutron [-] [instance: 44afd1bf-fa5c-4b3e-8752-b16853fef54e] deallocate_for_instance() {{(pid=72382) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 15:32:36 user nova-compute[72382]: DEBUG nova.network.neutron [-] [instance: 44afd1bf-fa5c-4b3e-8752-b16853fef54e] Updating instance_info_cache with network_info: [] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:32:36 user nova-compute[72382]: INFO nova.compute.manager [-] [instance: 44afd1bf-fa5c-4b3e-8752-b16853fef54e] Took 0.56 seconds to deallocate network for instance.
Aug 09 15:32:36 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-6b3c4668-fdaa-487d-86b4-acf97ac0b560 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:32:36 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-6b3c4668-fdaa-487d-86b4-acf97ac0b560 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:32:36 user nova-compute[72382]: DEBUG nova.compute.provider_tree [None req-6b3c4668-fdaa-487d-86b4-acf97ac0b560 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Inventory has not changed in ProviderTree for provider: 7b15b0e5-df4d-49db-833b-2855d21d10ae {{(pid=72382) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 15:32:36 user nova-compute[72382]: DEBUG nova.scheduler.client.report [None req-6b3c4668-fdaa-487d-86b4-acf97ac0b560 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Inventory has not changed for provider 7b15b0e5-df4d-49db-833b-2855d21d10ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72382) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 15:32:36 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-6b3c4668-fdaa-487d-86b4-acf97ac0b560 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.281s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:32:36 user nova-compute[72382]: INFO nova.scheduler.client.report [None req-6b3c4668-fdaa-487d-86b4-acf97ac0b560 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Deleted allocations for instance 44afd1bf-fa5c-4b3e-8752-b16853fef54e
Aug 09 15:32:36 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-6b3c4668-fdaa-487d-86b4-acf97ac0b560 tempest-ServerRescueNegativeTestJSON-867522113 tempest-ServerRescueNegativeTestJSON-867522113-project-member] Lock "44afd1bf-fa5c-4b3e-8752-b16853fef54e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.917s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:32:37 user nova-compute[72382]: DEBUG nova.compute.manager [req-9e7c456d-9611-42e5-bcd4-a10bfaddf7ea req-b02a8bd6-8b5a-4b69-b64d-6ace400fc1c4 service nova] [instance: 44afd1bf-fa5c-4b3e-8752-b16853fef54e] Received event network-vif-plugged-2a1d4c60-bc2a-4530-b3bd-2a12ae2d2098 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:32:37 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-9e7c456d-9611-42e5-bcd4-a10bfaddf7ea req-b02a8bd6-8b5a-4b69-b64d-6ace400fc1c4 service nova] Acquiring lock "44afd1bf-fa5c-4b3e-8752-b16853fef54e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:32:37 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-9e7c456d-9611-42e5-bcd4-a10bfaddf7ea req-b02a8bd6-8b5a-4b69-b64d-6ace400fc1c4 service nova] Lock "44afd1bf-fa5c-4b3e-8752-b16853fef54e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:32:37 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-9e7c456d-9611-42e5-bcd4-a10bfaddf7ea req-b02a8bd6-8b5a-4b69-b64d-6ace400fc1c4 service nova] Lock "44afd1bf-fa5c-4b3e-8752-b16853fef54e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:32:37 user nova-compute[72382]: DEBUG nova.compute.manager [req-9e7c456d-9611-42e5-bcd4-a10bfaddf7ea req-b02a8bd6-8b5a-4b69-b64d-6ace400fc1c4 service nova] [instance: 44afd1bf-fa5c-4b3e-8752-b16853fef54e] No waiting events found dispatching network-vif-plugged-2a1d4c60-bc2a-4530-b3bd-2a12ae2d2098 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:32:37 user nova-compute[72382]: WARNING nova.compute.manager [req-9e7c456d-9611-42e5-bcd4-a10bfaddf7ea req-b02a8bd6-8b5a-4b69-b64d-6ace400fc1c4 service nova] [instance: 44afd1bf-fa5c-4b3e-8752-b16853fef54e] Received unexpected event network-vif-plugged-2a1d4c60-bc2a-4530-b3bd-2a12ae2d2098 for instance with vm_state deleted and task_state None.
Aug 09 15:32:37 user nova-compute[72382]: DEBUG nova.compute.manager [req-9e7c456d-9611-42e5-bcd4-a10bfaddf7ea req-b02a8bd6-8b5a-4b69-b64d-6ace400fc1c4 service nova] [instance: 44afd1bf-fa5c-4b3e-8752-b16853fef54e] Received event network-vif-deleted-2a1d4c60-bc2a-4530-b3bd-2a12ae2d2098 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:32:40 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:32:42 user nova-compute[72382]: DEBUG nova.compute.manager [req-937513f5-385c-44f9-92da-1e1870522f59 req-f9af5dc3-40e0-48d1-97c7-7e104818cd7a service nova] [instance: 94c8cc29-3300-475f-aca0-40fa0e58cd66] Received event network-changed-ae7204a8-8b63-4d77-933c-00e37a89a187 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:32:42 user nova-compute[72382]: DEBUG nova.compute.manager [req-937513f5-385c-44f9-92da-1e1870522f59 req-f9af5dc3-40e0-48d1-97c7-7e104818cd7a service nova] [instance: 94c8cc29-3300-475f-aca0-40fa0e58cd66] Refreshing instance network info cache due to event network-changed-ae7204a8-8b63-4d77-933c-00e37a89a187. {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 15:32:42 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-937513f5-385c-44f9-92da-1e1870522f59 req-f9af5dc3-40e0-48d1-97c7-7e104818cd7a service nova] Acquiring lock "refresh_cache-94c8cc29-3300-475f-aca0-40fa0e58cd66" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 15:32:42 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-937513f5-385c-44f9-92da-1e1870522f59 req-f9af5dc3-40e0-48d1-97c7-7e104818cd7a service nova] Acquired lock "refresh_cache-94c8cc29-3300-475f-aca0-40fa0e58cd66" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 15:32:42 user nova-compute[72382]: DEBUG nova.network.neutron [req-937513f5-385c-44f9-92da-1e1870522f59 req-f9af5dc3-40e0-48d1-97c7-7e104818cd7a service nova] [instance: 94c8cc29-3300-475f-aca0-40fa0e58cd66] Refreshing network info cache for port ae7204a8-8b63-4d77-933c-00e37a89a187 {{(pid=72382) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 15:32:43 user nova-compute[72382]: DEBUG nova.network.neutron [req-937513f5-385c-44f9-92da-1e1870522f59 req-f9af5dc3-40e0-48d1-97c7-7e104818cd7a service nova] [instance: 94c8cc29-3300-475f-aca0-40fa0e58cd66] Updated VIF entry in instance network info cache for port ae7204a8-8b63-4d77-933c-00e37a89a187. {{(pid=72382) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 15:32:43 user nova-compute[72382]: DEBUG nova.network.neutron [req-937513f5-385c-44f9-92da-1e1870522f59 req-f9af5dc3-40e0-48d1-97c7-7e104818cd7a service nova] [instance: 94c8cc29-3300-475f-aca0-40fa0e58cd66] Updating instance_info_cache with network_info: [{"id": "ae7204a8-8b63-4d77-933c-00e37a89a187", "address": "fa:16:3e:a9:9b:f8", "network": {"id": "a78e6cb6-feb7-4f64-a3c0-4900594b6e37", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-338007968-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70310b1af40b4d239fe5ea362972554b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae7204a8-8b", "ovs_interfaceid": "ae7204a8-8b63-4d77-933c-00e37a89a187", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:32:43 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-937513f5-385c-44f9-92da-1e1870522f59 req-f9af5dc3-40e0-48d1-97c7-7e104818cd7a service nova] Releasing lock "refresh_cache-94c8cc29-3300-475f-aca0-40fa0e58cd66" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 15:32:44 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:32:45 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:32:49 user nova-compute[72382]: DEBUG nova.compute.manager [req-220aae8a-1fab-4a66-8910-f836b7906654 req-5d23f15d-1956-4134-b327-2f38c7dd94ad service nova] [instance: 8f744a7d-9eed-40e1-9422-670970c209ce] Received event network-changed-d16436a7-9589-443b-be99-e54349a50e25 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:32:49 user nova-compute[72382]: DEBUG nova.compute.manager [req-220aae8a-1fab-4a66-8910-f836b7906654 req-5d23f15d-1956-4134-b327-2f38c7dd94ad service nova] [instance: 8f744a7d-9eed-40e1-9422-670970c209ce] Refreshing instance network info cache due to event network-changed-d16436a7-9589-443b-be99-e54349a50e25. {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 15:32:49 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-220aae8a-1fab-4a66-8910-f836b7906654 req-5d23f15d-1956-4134-b327-2f38c7dd94ad service nova] Acquiring lock "refresh_cache-8f744a7d-9eed-40e1-9422-670970c209ce" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 15:32:49 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-220aae8a-1fab-4a66-8910-f836b7906654 req-5d23f15d-1956-4134-b327-2f38c7dd94ad service nova] Acquired lock "refresh_cache-8f744a7d-9eed-40e1-9422-670970c209ce" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 15:32:49 user nova-compute[72382]: DEBUG nova.network.neutron [req-220aae8a-1fab-4a66-8910-f836b7906654 req-5d23f15d-1956-4134-b327-2f38c7dd94ad service nova] [instance: 8f744a7d-9eed-40e1-9422-670970c209ce] Refreshing network info cache for port d16436a7-9589-443b-be99-e54349a50e25 {{(pid=72382) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 15:32:49 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:32:49 user nova-compute[72382]: DEBUG nova.network.neutron [req-220aae8a-1fab-4a66-8910-f836b7906654 req-5d23f15d-1956-4134-b327-2f38c7dd94ad service nova] [instance: 8f744a7d-9eed-40e1-9422-670970c209ce] Updated VIF entry in instance network info cache for port d16436a7-9589-443b-be99-e54349a50e25. {{(pid=72382) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 15:32:49 user nova-compute[72382]: DEBUG nova.network.neutron [req-220aae8a-1fab-4a66-8910-f836b7906654 req-5d23f15d-1956-4134-b327-2f38c7dd94ad service nova] [instance: 8f744a7d-9eed-40e1-9422-670970c209ce] Updating instance_info_cache with network_info: [{"id": "d16436a7-9589-443b-be99-e54349a50e25", "address": "fa:16:3e:fe:d6:7a", "network": {"id": "1b9920a2-9613-4741-a0c0-72172380b365", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-455407214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9949fc5e9167457d8c7a455350936255", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd16436a7-95", "ovs_interfaceid": "d16436a7-9589-443b-be99-e54349a50e25", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:32:49 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-220aae8a-1fab-4a66-8910-f836b7906654 req-5d23f15d-1956-4134-b327-2f38c7dd94ad service nova] Releasing lock "refresh_cache-8f744a7d-9eed-40e1-9422-670970c209ce" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 15:32:50 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-f588112d-c0b7-460f-a63d-63fea1d4e3c5 tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] Acquiring lock "8f744a7d-9eed-40e1-9422-670970c209ce" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:32:50 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-f588112d-c0b7-460f-a63d-63fea1d4e3c5 tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] Lock "8f744a7d-9eed-40e1-9422-670970c209ce" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:32:50 user nova-compute[72382]: DEBUG nova.objects.instance [None req-f588112d-c0b7-460f-a63d-63fea1d4e3c5 tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] Lazy-loading 'flavor' on Instance uuid 8f744a7d-9eed-40e1-9422-670970c209ce {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:32:50 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-f588112d-c0b7-460f-a63d-63fea1d4e3c5 tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] [instance: 8f744a7d-9eed-40e1-9422-670970c209ce] Ignoring supplied device name: /dev/vdb
Aug 09 15:32:50 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-f588112d-c0b7-460f-a63d-63fea1d4e3c5 tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] Lock "8f744a7d-9eed-40e1-9422-670970c209ce" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:32:50 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-f588112d-c0b7-460f-a63d-63fea1d4e3c5 tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] Acquiring lock "8f744a7d-9eed-40e1-9422-670970c209ce" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:32:50 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-f588112d-c0b7-460f-a63d-63fea1d4e3c5 tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] Lock "8f744a7d-9eed-40e1-9422-670970c209ce" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:32:50 user nova-compute[72382]: INFO nova.compute.manager [None req-f588112d-c0b7-460f-a63d-63fea1d4e3c5 tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] [instance: 8f744a7d-9eed-40e1-9422-670970c209ce] Attaching volume 84966571-0ed8-4b55-ae0c-a5e07dfa3152 to /dev/vdb
Aug 09 15:32:50 user nova-compute[72382]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691595155.8492684, 44afd1bf-fa5c-4b3e-8752-b16853fef54e => Stopped> {{(pid=72382) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 15:32:50 user nova-compute[72382]: INFO nova.compute.manager [-] [instance: 44afd1bf-fa5c-4b3e-8752-b16853fef54e] VM Stopped (Lifecycle Event)
Aug 09 15:32:50 user nova-compute[72382]: DEBUG os_brick.utils [None req-f588112d-c0b7-460f-a63d-63fea1d4e3c5 tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 15:32:50 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:32:50 user nova-compute[72382]: DEBUG nova.compute.manager [None req-5dcb734b-ceb8-4907-8346-e2f94b445572 None None] [instance: 44afd1bf-fa5c-4b3e-8752-b16853fef54e] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:32:50 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:32:50 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[55f2edda-53cc-4f3d-a2bb-2f63f2dbe84b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d2cfa7015fe\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:32:50 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:32:50 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:32:50 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:32:50 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e71eb72-25d6-448e-b413-427b20123853]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:32:50 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:32:50 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:32:50 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec398c94-5ccc-45cb-9cd8-cdaf6f096160]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:32:50 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[67a88942-94f2-4f89-b7c5-55cb5f3483e0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:32:50 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-f588112d-c0b7-460f-a63d-63fea1d4e3c5 tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] Running cmd (subprocess): nvme version {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:32:50 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-f588112d-c0b7-460f-a63d-63fea1d4e3c5 tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] 'nvme version' failed. Not Retrying. {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 15:32:50 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f588112d-c0b7-460f-a63d-63fea1d4e3c5 tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] nvme not present on system {{(pid=72382) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 15:32:50 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:32:50 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 15:32:50 user nova-compute[72382]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 15:32:50 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[63086786-6ef4-415a-a6ca-6f3222c24c4d]: (4, '') {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:32:50 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.lightos [None req-f588112d-c0b7-460f-a63d-63fea1d4e3c5 tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72382) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 15:32:50 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.lightos [None req-f588112d-c0b7-460f-a63d-63fea1d4e3c5 tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72382) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 15:32:50 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.lightos [None req-f588112d-c0b7-460f-a63d-63fea1d4e3c5 tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] LIGHTOS: no hostnqn found. {{(pid=72382) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 15:32:50 user nova-compute[72382]: DEBUG os_brick.utils [None req-f588112d-c0b7-460f-a63d-63fea1d4e3c5 tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d2cfa7015fe', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 15:32:50 user nova-compute[72382]: DEBUG nova.virt.block_device [None req-f588112d-c0b7-460f-a63d-63fea1d4e3c5 tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] [instance: 8f744a7d-9eed-40e1-9422-670970c209ce] Updating existing volume attachment record: 5b0699a0-a403-4016-b35d-e9487dbf17a2 {{(pid=72382) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 15:32:52 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-3654f991-2f30-4645-8347-159a0f989e62 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Acquiring lock "765eb553-6c1c-4d5a-a1cf-6ac8b348ac8e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:32:52 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-3654f991-2f30-4645-8347-159a0f989e62 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Lock "765eb553-6c1c-4d5a-a1cf-6ac8b348ac8e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:32:52 user nova-compute[72382]: DEBUG nova.compute.manager [None req-3654f991-2f30-4645-8347-159a0f989e62 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: 765eb553-6c1c-4d5a-a1cf-6ac8b348ac8e] Starting instance... {{(pid=72382) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 15:32:52 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-3654f991-2f30-4645-8347-159a0f989e62 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:32:52 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-3654f991-2f30-4645-8347-159a0f989e62 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:32:52 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-3654f991-2f30-4645-8347-159a0f989e62 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72382) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 15:32:52 user nova-compute[72382]: INFO nova.compute.claims [None req-3654f991-2f30-4645-8347-159a0f989e62 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: 765eb553-6c1c-4d5a-a1cf-6ac8b348ac8e] Claim successful on node user
Aug 09 15:32:52 user nova-compute[72382]: DEBUG nova.compute.provider_tree [None req-3654f991-2f30-4645-8347-159a0f989e62 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Inventory has not changed in ProviderTree for provider: 7b15b0e5-df4d-49db-833b-2855d21d10ae {{(pid=72382) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 15:32:52 user nova-compute[72382]: DEBUG nova.scheduler.client.report [None req-3654f991-2f30-4645-8347-159a0f989e62 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Inventory has not changed for provider 7b15b0e5-df4d-49db-833b-2855d21d10ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72382) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 15:32:52 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-3654f991-2f30-4645-8347-159a0f989e62 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.420s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:32:52 user nova-compute[72382]: DEBUG nova.compute.manager [None req-3654f991-2f30-4645-8347-159a0f989e62 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: 765eb553-6c1c-4d5a-a1cf-6ac8b348ac8e] Start building networks asynchronously for instance. {{(pid=72382) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 15:32:52 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-3654f991-2f30-4645-8347-159a0f989e62 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: 765eb553-6c1c-4d5a-a1cf-6ac8b348ac8e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 15:32:52 user nova-compute[72382]: DEBUG nova.compute.manager [None req-3654f991-2f30-4645-8347-159a0f989e62 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: 765eb553-6c1c-4d5a-a1cf-6ac8b348ac8e] Allocating IP information in the background. {{(pid=72382) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 15:32:52 user nova-compute[72382]: DEBUG nova.network.neutron [None req-3654f991-2f30-4645-8347-159a0f989e62 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: 765eb553-6c1c-4d5a-a1cf-6ac8b348ac8e] allocate_for_instance() {{(pid=72382) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 15:32:52 user nova-compute[72382]: DEBUG nova.compute.manager [None req-3654f991-2f30-4645-8347-159a0f989e62 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: 765eb553-6c1c-4d5a-a1cf-6ac8b348ac8e] Start building block device mappings for instance. {{(pid=72382) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 15:32:52 user nova-compute[72382]: INFO nova.virt.block_device [None req-3654f991-2f30-4645-8347-159a0f989e62 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: 765eb553-6c1c-4d5a-a1cf-6ac8b348ac8e] Booting with volume snapshot 2f46a7ef-f5f9-42a5-aa1a-efe658a5f210 at /dev/vda
Aug 09 15:32:52 user nova-compute[72382]: DEBUG nova.policy [None req-3654f991-2f30-4645-8347-159a0f989e62 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '280bcf2afd7245a7bcd605e0db79c569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70310b1af40b4d239fe5ea362972554b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72382) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 15:32:53 user nova-compute[72382]: DEBUG nova.network.neutron [None req-3654f991-2f30-4645-8347-159a0f989e62 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: 765eb553-6c1c-4d5a-a1cf-6ac8b348ac8e] Successfully created port: 4936f05e-b54a-4219-aa37-681330955e94 {{(pid=72382) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 15:32:54 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:32:54 user nova-compute[72382]: DEBUG nova.network.neutron [None req-3654f991-2f30-4645-8347-159a0f989e62 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: 765eb553-6c1c-4d5a-a1cf-6ac8b348ac8e] Successfully updated port: 4936f05e-b54a-4219-aa37-681330955e94 {{(pid=72382) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 15:32:54 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-3654f991-2f30-4645-8347-159a0f989e62 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Acquiring lock "refresh_cache-765eb553-6c1c-4d5a-a1cf-6ac8b348ac8e" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 15:32:54 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-3654f991-2f30-4645-8347-159a0f989e62 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Acquired lock "refresh_cache-765eb553-6c1c-4d5a-a1cf-6ac8b348ac8e" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 15:32:54 user nova-compute[72382]: DEBUG nova.network.neutron [None req-3654f991-2f30-4645-8347-159a0f989e62 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: 765eb553-6c1c-4d5a-a1cf-6ac8b348ac8e] Building network info cache for instance {{(pid=72382) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 15:32:54 user nova-compute[72382]: DEBUG nova.compute.manager [req-785cb936-51c1-451b-ba7e-2da3748611c4 req-d7177075-eb5c-413d-a6de-f17e1e54ff3d service nova] [instance: 765eb553-6c1c-4d5a-a1cf-6ac8b348ac8e] Received event network-changed-4936f05e-b54a-4219-aa37-681330955e94 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:32:54 user nova-compute[72382]: DEBUG nova.compute.manager [req-785cb936-51c1-451b-ba7e-2da3748611c4 req-d7177075-eb5c-413d-a6de-f17e1e54ff3d service nova] [instance: 765eb553-6c1c-4d5a-a1cf-6ac8b348ac8e] Refreshing instance network info cache due to event network-changed-4936f05e-b54a-4219-aa37-681330955e94. {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 15:32:54 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-785cb936-51c1-451b-ba7e-2da3748611c4 req-d7177075-eb5c-413d-a6de-f17e1e54ff3d service nova] Acquiring lock "refresh_cache-765eb553-6c1c-4d5a-a1cf-6ac8b348ac8e" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 15:32:54 user nova-compute[72382]: DEBUG nova.network.neutron [None req-3654f991-2f30-4645-8347-159a0f989e62 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: 765eb553-6c1c-4d5a-a1cf-6ac8b348ac8e] Instance cache missing network info. {{(pid=72382) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 15:32:55 user nova-compute[72382]: DEBUG nova.network.neutron [None req-3654f991-2f30-4645-8347-159a0f989e62 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: 765eb553-6c1c-4d5a-a1cf-6ac8b348ac8e] Updating instance_info_cache with network_info: [{"id": "4936f05e-b54a-4219-aa37-681330955e94", "address": "fa:16:3e:86:c1:69", "network": {"id": "a78e6cb6-feb7-4f64-a3c0-4900594b6e37", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-338007968-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70310b1af40b4d239fe5ea362972554b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4936f05e-b5", "ovs_interfaceid": "4936f05e-b54a-4219-aa37-681330955e94", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:32:55 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-3654f991-2f30-4645-8347-159a0f989e62 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Releasing lock "refresh_cache-765eb553-6c1c-4d5a-a1cf-6ac8b348ac8e" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 15:32:55 user nova-compute[72382]: DEBUG nova.compute.manager [None req-3654f991-2f30-4645-8347-159a0f989e62 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: 765eb553-6c1c-4d5a-a1cf-6ac8b348ac8e] Instance network_info: |[{"id": "4936f05e-b54a-4219-aa37-681330955e94", "address": "fa:16:3e:86:c1:69", "network": {"id": "a78e6cb6-feb7-4f64-a3c0-4900594b6e37", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-338007968-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70310b1af40b4d239fe5ea362972554b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4936f05e-b5", "ovs_interfaceid": "4936f05e-b54a-4219-aa37-681330955e94", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72382) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 15:32:55 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-785cb936-51c1-451b-ba7e-2da3748611c4 req-d7177075-eb5c-413d-a6de-f17e1e54ff3d service nova] Acquired lock "refresh_cache-765eb553-6c1c-4d5a-a1cf-6ac8b348ac8e" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 15:32:55 user nova-compute[72382]: DEBUG nova.network.neutron [req-785cb936-51c1-451b-ba7e-2da3748611c4 req-d7177075-eb5c-413d-a6de-f17e1e54ff3d service nova] [instance: 765eb553-6c1c-4d5a-a1cf-6ac8b348ac8e] Refreshing network info cache for port 4936f05e-b54a-4219-aa37-681330955e94 {{(pid=72382) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 15:32:55 user nova-compute[72382]: DEBUG nova.network.neutron [req-785cb936-51c1-451b-ba7e-2da3748611c4 req-d7177075-eb5c-413d-a6de-f17e1e54ff3d service nova] [instance: 765eb553-6c1c-4d5a-a1cf-6ac8b348ac8e] Updated VIF entry in instance network info cache for port 4936f05e-b54a-4219-aa37-681330955e94. {{(pid=72382) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 15:32:55 user nova-compute[72382]: DEBUG nova.network.neutron [req-785cb936-51c1-451b-ba7e-2da3748611c4 req-d7177075-eb5c-413d-a6de-f17e1e54ff3d service nova] [instance: 765eb553-6c1c-4d5a-a1cf-6ac8b348ac8e] Updating instance_info_cache with network_info: [{"id": "4936f05e-b54a-4219-aa37-681330955e94", "address": "fa:16:3e:86:c1:69", "network": {"id": "a78e6cb6-feb7-4f64-a3c0-4900594b6e37", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-338007968-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70310b1af40b4d239fe5ea362972554b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4936f05e-b5", "ovs_interfaceid": "4936f05e-b54a-4219-aa37-681330955e94", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:32:55 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-785cb936-51c1-451b-ba7e-2da3748611c4 req-d7177075-eb5c-413d-a6de-f17e1e54ff3d service nova] Releasing lock "refresh_cache-765eb553-6c1c-4d5a-a1cf-6ac8b348ac8e" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 15:32:55 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:32:58 user nova-compute[72382]: DEBUG os_brick.utils [None req-3654f991-2f30-4645-8347-159a0f989e62 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 15:32:58 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:32:58 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:32:58 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[7148d78d-4f5d-4167-b507-5917992884f5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d2cfa7015fe\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:32:58 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:32:58 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:32:58 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[deda301c-4d4d-4702-a4e0-d4cd2b2ce19c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:32:58 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:32:58 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:32:58 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[233254d2-c7cd-46d5-9c5b-125441fc219d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:32:58 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1bd9a23-00fc-482c-99ae-f13a0a6d4c1e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:32:58 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-3654f991-2f30-4645-8347-159a0f989e62 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Running cmd (subprocess): nvme version {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:32:58 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-3654f991-2f30-4645-8347-159a0f989e62 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] 'nvme version' failed. Not Retrying. {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 15:32:58 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3654f991-2f30-4645-8347-159a0f989e62 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] nvme not present on system {{(pid=72382) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 15:32:58 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:32:58 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 15:32:58 user nova-compute[72382]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 15:32:58 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b3d8ceb-f3d9-4762-b239-a3a71d4ced99]: (4, '') {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:32:58 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.lightos [None req-3654f991-2f30-4645-8347-159a0f989e62 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72382) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 15:32:58 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.lightos [None req-3654f991-2f30-4645-8347-159a0f989e62 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72382) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 15:32:58 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.lightos [None req-3654f991-2f30-4645-8347-159a0f989e62 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] LIGHTOS: no hostnqn found. {{(pid=72382) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 15:32:58 user nova-compute[72382]: DEBUG os_brick.utils [None req-3654f991-2f30-4645-8347-159a0f989e62 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d2cfa7015fe', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 15:32:58 user nova-compute[72382]: DEBUG nova.virt.block_device [None req-3654f991-2f30-4645-8347-159a0f989e62 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: 765eb553-6c1c-4d5a-a1cf-6ac8b348ac8e] Updating existing volume attachment record: 5c16681d-cacc-4126-b678-f19b37bd439d {{(pid=72382) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 15:32:59 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:32:59 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f588112d-c0b7-460f-a63d-63fea1d4e3c5 tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] [instance: 8f744a7d-9eed-40e1-9422-670970c209ce] Calling os-brick to attach iSCSI Volume {{(pid=72382) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 15:32:59 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-f588112d-c0b7-460f-a63d-63fea1d4e3c5 tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2a0c768340>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:84966571-0ed8-4b55-ae0c-a5e07dfa3152'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DUGyZifM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 15:32:59 user nova-compute[72382]: WARNING os_brick.initiator.connectors.base [None req-f588112d-c0b7-460f-a63d-63fea1d4e3c5 tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 15:32:59 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-f588112d-c0b7-460f-a63d-63fea1d4e3c5 tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 15:32:59 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-f588112d-c0b7-460f-a63d-63fea1d4e3c5 tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 15:32:59 user nova-compute[72382]: WARNING os_brick.initiator.connectors.base [None req-f588112d-c0b7-460f-a63d-63fea1d4e3c5 tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 15:32:59 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-f588112d-c0b7-460f-a63d-63fea1d4e3c5 tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:84966571-0ed8-4b55-ae0c-a5e07dfa3152" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 15:32:59 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-f588112d-c0b7-460f-a63d-63fea1d4e3c5 tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:84966571-0ed8-4b55-ae0c-a5e07dfa3152" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 15:32:59 user nova-compute[72382]: INFO os_brick.initiator.connectors.iscsi [None req-f588112d-c0b7-460f-a63d-63fea1d4e3c5 tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 15:32:59 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84966571-0ed8-4b55-ae0c-a5e07dfa3152 -p 172.16.0.220:3260 {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:32:59 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84966571-0ed8-4b55-ae0c-a5e07dfa3152 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:32:59 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3fed656-9107-4c6d-8fe6-10b584c54673]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:32:59 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-f588112d-c0b7-460f-a63d-63fea1d4e3c5 tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 15:32:59 user nova-compute[72382]:  {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:32:59 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84966571-0ed8-4b55-ae0c-a5e07dfa3152 -p 172.16.0.220:3260 --interface default --op new {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:32:59 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84966571-0ed8-4b55-ae0c-a5e07dfa3152 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:32:59 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f288a54-d544-4c4e-a4ff-a4ba324622ec]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:84966571-0ed8-4b55-ae0c-a5e07dfa3152] added\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:32:59 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-f588112d-c0b7-460f-a63d-63fea1d4e3c5 tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:84966571-0ed8-4b55-ae0c-a5e07dfa3152] added
Aug 09 15:32:59 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:32:59 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84966571-0ed8-4b55-ae0c-a5e07dfa3152 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:32:59 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84966571-0ed8-4b55-ae0c-a5e07dfa3152 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:32:59 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7b7b6ec-e409-4417-afb2-69af99026a8e]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:32:59 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-f588112d-c0b7-460f-a63d-63fea1d4e3c5 tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:32:59 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84966571-0ed8-4b55-ae0c-a5e07dfa3152 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:32:59 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84966571-0ed8-4b55-ae0c-a5e07dfa3152 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:32:59 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[beb121e6-fd41-4834-9f7d-419dc24eb557]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:32:59 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-f588112d-c0b7-460f-a63d-63fea1d4e3c5 tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:32:59 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84966571-0ed8-4b55-ae0c-a5e07dfa3152 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DUGyZifM {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:32:59 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84966571-0ed8-4b55-ae0c-a5e07dfa3152 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DUGyZifM" returned: 0 in 0.019s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:32:59 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fc65e32-1bf8-40c0-9052-2ebaac2d5412]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:32:59 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-f588112d-c0b7-460f-a63d-63fea1d4e3c5 tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DUGyZifM'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:32:59 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84966571-0ed8-4b55-ae0c-a5e07dfa3152 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:32:59 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84966571-0ed8-4b55-ae0c-a5e07dfa3152 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:32:59 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[f764198f-7026-4f9f-9762-122346cfcb23]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:32:59 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-f588112d-c0b7-460f-a63d-63fea1d4e3c5 tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:32:59 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:33:00 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:33:00 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[d80949c9-3f22-49f7-9e4e-9ff73247f4d0]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5cfefdb-a454-494f-ab09-acf8644352a3 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59852df5-d4c8-4f25-8693-36181ff6a447 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8516df70-0781-4493-b04f-417dfdfd5365 (non-flash)\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:33:00 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-f588112d-c0b7-460f-a63d-63fea1d4e3c5 tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)
Aug 09 15:33:00 user nova-compute[72382]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5cfefdb-a454-494f-ab09-acf8644352a3 (non-flash)
Aug 09 15:33:00 user nova-compute[72382]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59852df5-d4c8-4f25-8693-36181ff6a447 (non-flash)
Aug 09 15:33:00 user nova-compute[72382]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8516df70-0781-4493-b04f-417dfdfd5365 (non-flash)
Aug 09 15:33:00 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 15:33:00 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-f588112d-c0b7-460f-a63d-63fea1d4e3c5 tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)
Aug 09 15:33:00 user nova-compute[72382]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5cfefdb-a454-494f-ab09-acf8644352a3 (non-flash)
Aug 09 15:33:00 user nova-compute[72382]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59852df5-d4c8-4f25-8693-36181ff6a447 (non-flash)
Aug 09 15:33:00 user nova-compute[72382]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8516df70-0781-4493-b04f-417dfdfd5365 (non-flash)
Aug 09 15:33:00 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 15:33:00 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84966571-0ed8-4b55-ae0c-a5e07dfa3152 -p 172.16.0.220:3260 --login {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:33:00 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84966571-0ed8-4b55-ae0c-a5e07dfa3152 -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:33:00 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2ebb2da-dd48-4d8c-8cc6-fa6b829b9559]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:84966571-0ed8-4b55-ae0c-a5e07dfa3152, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:84966571-0ed8-4b55-ae0c-a5e07dfa3152, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:33:00 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-f588112d-c0b7-460f-a63d-63fea1d4e3c5 tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:84966571-0ed8-4b55-ae0c-a5e07dfa3152, portal: 172.16.0.220,3260]
Aug 09 15:33:00 user nova-compute[72382]: Login to [iface: default, target: iqn.2010-10.org.openstack:84966571-0ed8-4b55-ae0c-a5e07dfa3152, portal: 172.16.0.220,3260] successful.
Aug 09 15:33:00 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:33:00 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84966571-0ed8-4b55-ae0c-a5e07dfa3152 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:33:00 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84966571-0ed8-4b55-ae0c-a5e07dfa3152 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:33:00 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[eae7f708-7b50-4967-9d18-c1dbde429fff]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:33:00 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-f588112d-c0b7-460f-a63d-63fea1d4e3c5 tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:33:00 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:33:00 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:33:00 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[89628e12-aff0-422b-9940-bf1c87ef0746]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5cfefdb-a454-494f-ab09-acf8644352a3 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59852df5-d4c8-4f25-8693-36181ff6a447 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8516df70-0781-4493-b04f-417dfdfd5365 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84966571-0ed8-4b55-ae0c-a5e07dfa3152 (non-flash)\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:33:00 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-f588112d-c0b7-460f-a63d-63fea1d4e3c5 tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)
Aug 09 15:33:00 user nova-compute[72382]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5cfefdb-a454-494f-ab09-acf8644352a3 (non-flash)
Aug 09 15:33:00 user nova-compute[72382]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59852df5-d4c8-4f25-8693-36181ff6a447 (non-flash)
Aug 09 15:33:00 user nova-compute[72382]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8516df70-0781-4493-b04f-417dfdfd5365 (non-flash)
Aug 09 15:33:00 user nova-compute[72382]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84966571-0ed8-4b55-ae0c-a5e07dfa3152 (non-flash)
Aug 09 15:33:00 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 15:33:00 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-f588112d-c0b7-460f-a63d-63fea1d4e3c5 tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)
Aug 09 15:33:00 user nova-compute[72382]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5cfefdb-a454-494f-ab09-acf8644352a3 (non-flash)
Aug 09 15:33:00 user nova-compute[72382]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59852df5-d4c8-4f25-8693-36181ff6a447 (non-flash)
Aug 09 15:33:00 user nova-compute[72382]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8516df70-0781-4493-b04f-417dfdfd5365 (non-flash)
Aug 09 15:33:00 user nova-compute[72382]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84966571-0ed8-4b55-ae0c-a5e07dfa3152 (non-flash)
Aug 09 15:33:00 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 15:33:00 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-f588112d-c0b7-460f-a63d-63fea1d4e3c5 tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:84966571-0ed8-4b55-ae0c-a5e07dfa3152" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.305s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 15:33:00 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-f588112d-c0b7-460f-a63d-63fea1d4e3c5 tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] Connected to 172.16.0.220:3260 {{(pid=72382) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 15:33:00 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-f588112d-c0b7-460f-a63d-63fea1d4e3c5 tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] HCTL ('36', '-', '-', 0) found on session 43 with lun 0 {{(pid=72382) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 15:33:00 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-f588112d-c0b7-460f-a63d-63fea1d4e3c5 tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72382) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 15:33:00 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:33:00 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:33:00 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b3bd788-6bab-4781-bc81-e903b8ab577e]: (4, ('- - 0', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:33:00 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-f588112d-c0b7-460f-a63d-63fea1d4e3c5 tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] Searching for a device in session 43 and hctl ['36', '*', '*', 0] yield: None {{(pid=72382) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 15:33:00 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:33:01 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-f588112d-c0b7-460f-a63d-63fea1d4e3c5 tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] Searching for a device in session 43 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72382) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 15:33:01 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-f588112d-c0b7-460f-a63d-63fea1d4e3c5 tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DUGyZifM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72382) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 15:33:01 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-f588112d-c0b7-460f-a63d-63fea1d4e3c5 tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.337s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 15:33:01 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-f588112d-c0b7-460f-a63d-63fea1d4e3c5 tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] <== connect_volume: return (1339ms) {'type': 'block', 'scsi_wwn': '26266623861626433', 'path': '/dev/sde'} {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 15:33:01 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f588112d-c0b7-460f-a63d-63fea1d4e3c5 tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] [instance: 8f744a7d-9eed-40e1-9422-670970c209ce] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26266623861626433', 'path': '/dev/sde'} {{(pid=72382) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 15:33:01 user nova-compute[72382]: DEBUG nova.objects.instance [None req-f588112d-c0b7-460f-a63d-63fea1d4e3c5 tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] Lazy-loading 'flavor' on Instance uuid 8f744a7d-9eed-40e1-9422-670970c209ce {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:33:01 user nova-compute[72382]: DEBUG nova.virt.libvirt.guest [None req-f588112d-c0b7-460f-a63d-63fea1d4e3c5 tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 15:33:01 user nova-compute[72382]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 15:33:01 user nova-compute[72382]:   <source dev="/dev/sde"/>
Aug 09 15:33:01 user nova-compute[72382]:   <target dev="vdb" bus="virtio"/>
Aug 09 15:33:01 user nova-compute[72382]:   <serial>84966571-0ed8-4b55-ae0c-a5e07dfa3152</serial>
Aug 09 15:33:01 user nova-compute[72382]: </disk>
Aug 09 15:33:01 user nova-compute[72382]:  {{(pid=72382) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 15:33:01 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-f588112d-c0b7-460f-a63d-63fea1d4e3c5 tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] No BDM found with device name vda, not building metadata. {{(pid=72382) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 15:33:01 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-f588112d-c0b7-460f-a63d-63fea1d4e3c5 tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72382) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 15:33:01 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-f588112d-c0b7-460f-a63d-63fea1d4e3c5 tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] No VIF found with MAC fa:16:3e:fe:d6:7a, not building metadata {{(pid=72382) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 15:33:01 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-f588112d-c0b7-460f-a63d-63fea1d4e3c5 tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] Lock "8f744a7d-9eed-40e1-9422-670970c209ce" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.936s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:33:04 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:33:05 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:33:07 user nova-compute[72382]: DEBUG nova.compute.manager [None req-3654f991-2f30-4645-8347-159a0f989e62 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: 765eb553-6c1c-4d5a-a1cf-6ac8b348ac8e] Start spawning the instance on the hypervisor. {{(pid=72382) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 15:33:07 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-3654f991-2f30-4645-8347-159a0f989e62 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: 765eb553-6c1c-4d5a-a1cf-6ac8b348ac8e] Creating instance directory {{(pid=72382) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 15:33:07 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-3654f991-2f30-4645-8347-159a0f989e62 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: 765eb553-6c1c-4d5a-a1cf-6ac8b348ac8e] Creating image(s)
Aug 09 15:33:07 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-3654f991-2f30-4645-8347-159a0f989e62 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: 765eb553-6c1c-4d5a-a1cf-6ac8b348ac8e] Did not create local disks {{(pid=72382) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 09 15:33:07 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-3654f991-2f30-4645-8347-159a0f989e62 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: 765eb553-6c1c-4d5a-a1cf-6ac8b348ac8e] Ensure instance console log exists: /opt/stack/data/nova/instances/765eb553-6c1c-4d5a-a1cf-6ac8b348ac8e/console.log {{(pid=72382) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 15:33:07 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-3654f991-2f30-4645-8347-159a0f989e62 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:33:07 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-3654f991-2f30-4645-8347-159a0f989e62 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:33:07 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-3654f991-2f30-4645-8347-159a0f989e62 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:33:07 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-3654f991-2f30-4645-8347-159a0f989e62 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: 765eb553-6c1c-4d5a-a1cf-6ac8b348ac8e] Start _get_guest_xml network_info=[{"id": "4936f05e-b54a-4219-aa37-681330955e94", "address": "fa:16:3e:86:c1:69", "network": {"id": "a78e6cb6-feb7-4f64-a3c0-4900594b6e37", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-338007968-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70310b1af40b4d239fe5ea362972554b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4936f05e-b5", "ovs_interfaceid": "4936f05e-b54a-4219-aa37-681330955e94", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-08-09T15:32:44Z,direct_url=<?>,disk_format='qcow2',id=517344be-3709-4576-9bc3-25515ae59215,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-558959328',owner='70310b1af40b4d239fe5ea362972554b',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-08-09T15:32:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:9b93bb40-75bb-4387-aa01-c839f97e3432'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'anqFGEkv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '765eb553-6c1c-4d5a-a1cf-6ac8b348ac8e', 'attached_at': '', 'detached_at': '', 'volume_id': '9b93bb40-75bb-4387-aa01-c839f97e3432', 'serial': '9b93bb40-75bb-4387-aa01-c839f97e3432'}, 'disk_bus': 'virtio', 'attachment_id': '5c16681d-cacc-4126-b678-f19b37bd439d', 'delete_on_termination': True, 'volume_type': None} {{(pid=72382) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 15:33:07 user nova-compute[72382]: WARNING nova.virt.libvirt.driver [None req-3654f991-2f30-4645-8347-159a0f989e62 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 15:33:07 user nova-compute[72382]: WARNING nova.virt.libvirt.driver [None req-3654f991-2f30-4645-8347-159a0f989e62 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 15:33:07 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-3654f991-2f30-4645-8347-159a0f989e62 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72382) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 15:33:07 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-3654f991-2f30-4645-8347-159a0f989e62 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] CPU controller missing on host. {{(pid=72382) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 15:33:07 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-3654f991-2f30-4645-8347-159a0f989e62 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72382) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 15:33:07 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-3654f991-2f30-4645-8347-159a0f989e62 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] CPU controller found on host. {{(pid=72382) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 15:33:07 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-3654f991-2f30-4645-8347-159a0f989e62 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72382) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 15:33:07 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-3654f991-2f30-4645-8347-159a0f989e62 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T15:11:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-08-09T15:32:44Z,direct_url=<?>,disk_format='qcow2',id=517344be-3709-4576-9bc3-25515ae59215,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-558959328',owner='70310b1af40b4d239fe5ea362972554b',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-08-09T15:32:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 15:33:07 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-3654f991-2f30-4645-8347-159a0f989e62 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Flavor limits 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 15:33:07 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-3654f991-2f30-4645-8347-159a0f989e62 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Image limits 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 15:33:07 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-3654f991-2f30-4645-8347-159a0f989e62 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Flavor pref 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 15:33:07 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-3654f991-2f30-4645-8347-159a0f989e62 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Image pref 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 15:33:07 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-3654f991-2f30-4645-8347-159a0f989e62 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 15:33:07 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-3654f991-2f30-4645-8347-159a0f989e62 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 15:33:07 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-3654f991-2f30-4645-8347-159a0f989e62 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72382) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 15:33:07 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-3654f991-2f30-4645-8347-159a0f989e62 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Got 1 possible topologies {{(pid=72382) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 15:33:07 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-3654f991-2f30-4645-8347-159a0f989e62 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 15:33:07 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-3654f991-2f30-4645-8347-159a0f989e62 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 15:33:07 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3654f991-2f30-4645-8347-159a0f989e62 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: 765eb553-6c1c-4d5a-a1cf-6ac8b348ac8e] Calling os-brick to attach iSCSI Volume {{(pid=72382) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 15:33:07 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-3654f991-2f30-4645-8347-159a0f989e62 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2a0c768340>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:9b93bb40-75bb-4387-aa01-c839f97e3432'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'anqFGEkv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 15:33:07 user nova-compute[72382]: WARNING os_brick.initiator.connectors.base [None req-3654f991-2f30-4645-8347-159a0f989e62 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 15:33:07 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-3654f991-2f30-4645-8347-159a0f989e62 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 15:33:07 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-3654f991-2f30-4645-8347-159a0f989e62 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 15:33:07 user nova-compute[72382]: WARNING os_brick.initiator.connectors.base [None req-3654f991-2f30-4645-8347-159a0f989e62 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 15:33:07 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-3654f991-2f30-4645-8347-159a0f989e62 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9b93bb40-75bb-4387-aa01-c839f97e3432" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 15:33:07 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-3654f991-2f30-4645-8347-159a0f989e62 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9b93bb40-75bb-4387-aa01-c839f97e3432" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 15:33:07 user nova-compute[72382]: INFO os_brick.initiator.connectors.iscsi [None req-3654f991-2f30-4645-8347-159a0f989e62 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 15:33:07 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b93bb40-75bb-4387-aa01-c839f97e3432 -p 172.16.0.220:3260 {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:33:07 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b93bb40-75bb-4387-aa01-c839f97e3432 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:33:07 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4c31f1f-744f-4b86-8721-a231cd196e89]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:33:07 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-3654f991-2f30-4645-8347-159a0f989e62 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 15:33:07 user nova-compute[72382]:  {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:33:07 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b93bb40-75bb-4387-aa01-c839f97e3432 -p 172.16.0.220:3260 --interface default --op new {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:33:07 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b93bb40-75bb-4387-aa01-c839f97e3432 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:33:07 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7a40104-44b2-443c-89cb-a8a092653bd5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9b93bb40-75bb-4387-aa01-c839f97e3432] added\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:33:07 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-3654f991-2f30-4645-8347-159a0f989e62 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9b93bb40-75bb-4387-aa01-c839f97e3432] added
Aug 09 15:33:07 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:33:07 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b93bb40-75bb-4387-aa01-c839f97e3432 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:33:07 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b93bb40-75bb-4387-aa01-c839f97e3432 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:33:07 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd348fa1-0c8b-4bac-aa5a-45c6ad6b181d]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:33:07 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-3654f991-2f30-4645-8347-159a0f989e62 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:33:07 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b93bb40-75bb-4387-aa01-c839f97e3432 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:33:07 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b93bb40-75bb-4387-aa01-c839f97e3432 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:33:07 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[021f9b43-5429-45eb-ae21-9ef447a670c8]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:33:07 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-3654f991-2f30-4645-8347-159a0f989e62 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:33:07 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b93bb40-75bb-4387-aa01-c839f97e3432 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v anqFGEkv {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:33:07 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b93bb40-75bb-4387-aa01-c839f97e3432 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v anqFGEkv" returned: 0 in 0.019s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:33:07 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[d36a904f-0711-485b-9e6a-055e836dcee7]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:33:07 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-3654f991-2f30-4645-8347-159a0f989e62 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'anqFGEkv'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:33:07 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b93bb40-75bb-4387-aa01-c839f97e3432 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:33:07 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b93bb40-75bb-4387-aa01-c839f97e3432 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:33:07 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ed2f773-6b55-4f69-a110-aefff0305405]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:33:07 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-3654f991-2f30-4645-8347-159a0f989e62 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:33:07 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:33:07 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:33:07 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[390afa0d-7428-417b-8130-a41e878300a1]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5cfefdb-a454-494f-ab09-acf8644352a3 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59852df5-d4c8-4f25-8693-36181ff6a447 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8516df70-0781-4493-b04f-417dfdfd5365 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84966571-0ed8-4b55-ae0c-a5e07dfa3152 (non-flash)\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:33:07 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-3654f991-2f30-4645-8347-159a0f989e62 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)
Aug 09 15:33:07 user nova-compute[72382]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5cfefdb-a454-494f-ab09-acf8644352a3 (non-flash)
Aug 09 15:33:07 user nova-compute[72382]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59852df5-d4c8-4f25-8693-36181ff6a447 (non-flash)
Aug 09 15:33:07 user nova-compute[72382]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8516df70-0781-4493-b04f-417dfdfd5365 (non-flash)
Aug 09 15:33:07 user nova-compute[72382]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84966571-0ed8-4b55-ae0c-a5e07dfa3152 (non-flash)
Aug 09 15:33:07 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 15:33:07 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-3654f991-2f30-4645-8347-159a0f989e62 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)
Aug 09 15:33:07 user nova-compute[72382]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5cfefdb-a454-494f-ab09-acf8644352a3 (non-flash)
Aug 09 15:33:07 user nova-compute[72382]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59852df5-d4c8-4f25-8693-36181ff6a447 (non-flash)
Aug 09 15:33:07 user nova-compute[72382]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8516df70-0781-4493-b04f-417dfdfd5365 (non-flash)
Aug 09 15:33:07 user nova-compute[72382]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84966571-0ed8-4b55-ae0c-a5e07dfa3152 (non-flash)
Aug 09 15:33:07 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 15:33:07 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b93bb40-75bb-4387-aa01-c839f97e3432 -p 172.16.0.220:3260 --login {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:33:07 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b93bb40-75bb-4387-aa01-c839f97e3432 -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:33:07 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[227704ab-1030-453d-9aa9-841e706b2ebb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9b93bb40-75bb-4387-aa01-c839f97e3432, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9b93bb40-75bb-4387-aa01-c839f97e3432, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:33:07 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-3654f991-2f30-4645-8347-159a0f989e62 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9b93bb40-75bb-4387-aa01-c839f97e3432, portal: 172.16.0.220,3260]
Aug 09 15:33:07 user nova-compute[72382]: Login to [iface: default, target: iqn.2010-10.org.openstack:9b93bb40-75bb-4387-aa01-c839f97e3432, portal: 172.16.0.220,3260] successful.
Aug 09 15:33:07 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:33:07 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b93bb40-75bb-4387-aa01-c839f97e3432 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:33:07 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b93bb40-75bb-4387-aa01-c839f97e3432 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:33:07 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bd87c8f-3374-4b41-baa0-f78d60af6290]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:33:07 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-3654f991-2f30-4645-8347-159a0f989e62 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:33:07 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:33:07 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:33:07 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab3311c1-fff7-4e28-ada6-2574b2ba742c]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5cfefdb-a454-494f-ab09-acf8644352a3 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59852df5-d4c8-4f25-8693-36181ff6a447 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8516df70-0781-4493-b04f-417dfdfd5365 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84966571-0ed8-4b55-ae0c-a5e07dfa3152 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b93bb40-75bb-4387-aa01-c839f97e3432 (non-flash)\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:33:07 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-3654f991-2f30-4645-8347-159a0f989e62 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)
Aug 09 15:33:07 user nova-compute[72382]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5cfefdb-a454-494f-ab09-acf8644352a3 (non-flash)
Aug 09 15:33:07 user nova-compute[72382]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59852df5-d4c8-4f25-8693-36181ff6a447 (non-flash)
Aug 09 15:33:07 user nova-compute[72382]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8516df70-0781-4493-b04f-417dfdfd5365 (non-flash)
Aug 09 15:33:07 user nova-compute[72382]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84966571-0ed8-4b55-ae0c-a5e07dfa3152 (non-flash)
Aug 09 15:33:07 user nova-compute[72382]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b93bb40-75bb-4387-aa01-c839f97e3432 (non-flash)
Aug 09 15:33:07 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 15:33:07 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-3654f991-2f30-4645-8347-159a0f989e62 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)
Aug 09 15:33:07 user nova-compute[72382]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5cfefdb-a454-494f-ab09-acf8644352a3 (non-flash)
Aug 09 15:33:07 user nova-compute[72382]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59852df5-d4c8-4f25-8693-36181ff6a447 (non-flash)
Aug 09 15:33:07 user nova-compute[72382]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8516df70-0781-4493-b04f-417dfdfd5365 (non-flash)
Aug 09 15:33:07 user nova-compute[72382]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84966571-0ed8-4b55-ae0c-a5e07dfa3152 (non-flash)
Aug 09 15:33:07 user nova-compute[72382]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b93bb40-75bb-4387-aa01-c839f97e3432 (non-flash)
Aug 09 15:33:07 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 15:33:07 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-3654f991-2f30-4645-8347-159a0f989e62 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9b93bb40-75bb-4387-aa01-c839f97e3432" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.293s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 15:33:07 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-3654f991-2f30-4645-8347-159a0f989e62 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Connected to 172.16.0.220:3260 {{(pid=72382) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 15:33:07 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-3654f991-2f30-4645-8347-159a0f989e62 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] HCTL ('38', '-', '-', 0) found on session 44 with lun 0 {{(pid=72382) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 15:33:07 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-3654f991-2f30-4645-8347-159a0f989e62 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=72382) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 15:33:07 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:33:07 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.016s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:33:07 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fd78db3-8087-46a7-b99a-a6d637b9d990]: (4, ('- - 0', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:33:07 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-3654f991-2f30-4645-8347-159a0f989e62 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Searching for a device in session 44 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=72382) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 15:33:07 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-3654f991-2f30-4645-8347-159a0f989e62 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Connected to sdg using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'anqFGEkv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72382) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 15:33:08 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-3654f991-2f30-4645-8347-159a0f989e62 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.325s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 15:33:08 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-3654f991-2f30-4645-8347-159a0f989e62 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] <== connect_volume: return (1326ms) {'type': 'block', 'scsi_wwn': '23437303763303364', 'path': '/dev/sdg'} {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 15:33:08 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3654f991-2f30-4645-8347-159a0f989e62 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: 765eb553-6c1c-4d5a-a1cf-6ac8b348ac8e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23437303763303364', 'path': '/dev/sdg'} {{(pid=72382) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 15:33:08 user nova-compute[72382]: DEBUG nova.virt.libvirt.vif [None req-3654f991-2f30-4645-8347-159a0f989e62 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T15:32:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1314691970',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1314691970',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1314691970',id=35,image_ref='517344be-3709-4576-9bc3-25515ae59215',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEvAABBE0ImmPJHlhvG+ei5Kpw6Q9p/nD7wB8dehbmgx9OM5jAZZul+5YZCixv3LdKlkCUxp5t9OpV7dAlvRztw/Wi+KSm1ZN4c585plDdkzEWW7DGuI89HS5TTVZNYfgg==',key_name='tempest-keypair-978880427',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='70310b1af40b4d239fe5ea362972554b',ramdisk_id='',reservation_id='r-incmwery',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-451643589',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-451643589-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-451643589',owner_user_name='tempest-TestVolumeBootPattern-451643589-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T15:32:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='280bcf2afd7245a7bcd605e0db79c569',uuid=765eb553-6c1c-4d5a-a1cf-6ac8b348ac8e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4936f05e-b54a-4219-aa37-681330955e94", "address": "fa:16:3e:86:c1:69", "network": {"id": "a78e6cb6-feb7-4f64-a3c0-4900594b6e37", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-338007968-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70310b1af40b4d239fe5ea362972554b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4936f05e-b5", "ovs_interfaceid": "4936f05e-b54a-4219-aa37-681330955e94", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72382) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 15:33:08 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-3654f991-2f30-4645-8347-159a0f989e62 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Converting VIF {"id": "4936f05e-b54a-4219-aa37-681330955e94", "address": "fa:16:3e:86:c1:69", "network": {"id": "a78e6cb6-feb7-4f64-a3c0-4900594b6e37", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-338007968-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70310b1af40b4d239fe5ea362972554b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4936f05e-b5", "ovs_interfaceid": "4936f05e-b54a-4219-aa37-681330955e94", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 15:33:08 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-3654f991-2f30-4645-8347-159a0f989e62 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:c1:69,bridge_name='br-int',has_traffic_filtering=True,id=4936f05e-b54a-4219-aa37-681330955e94,network=Network(a78e6cb6-feb7-4f64-a3c0-4900594b6e37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4936f05e-b5') {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 15:33:08 user nova-compute[72382]: DEBUG nova.objects.instance [None req-3654f991-2f30-4645-8347-159a0f989e62 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Lazy-loading 'pci_devices' on Instance uuid 765eb553-6c1c-4d5a-a1cf-6ac8b348ac8e {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:33:08 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-3654f991-2f30-4645-8347-159a0f989e62 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: 765eb553-6c1c-4d5a-a1cf-6ac8b348ac8e] End _get_guest_xml xml=<domain type="kvm">
Aug 09 15:33:08 user nova-compute[72382]:   <uuid>765eb553-6c1c-4d5a-a1cf-6ac8b348ac8e</uuid>
Aug 09 15:33:08 user nova-compute[72382]:   <name>instance-00000023</name>
Aug 09 15:33:08 user nova-compute[72382]:   <memory>524288</memory>
Aug 09 15:33:08 user nova-compute[72382]:   <vcpu>1</vcpu>
Aug 09 15:33:08 user nova-compute[72382]:   <metadata>
Aug 09 15:33:08 user nova-compute[72382]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 15:33:08 user nova-compute[72382]:       <nova:package version="0.0.0"/>
Aug 09 15:33:08 user nova-compute[72382]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-1314691970</nova:name>
Aug 09 15:33:08 user nova-compute[72382]:       <nova:creationTime>2023-08-09 15:33:07</nova:creationTime>
Aug 09 15:33:08 user nova-compute[72382]:       <nova:flavor name="m1.tiny">
Aug 09 15:33:08 user nova-compute[72382]:         <nova:memory>512</nova:memory>
Aug 09 15:33:08 user nova-compute[72382]:         <nova:disk>1</nova:disk>
Aug 09 15:33:08 user nova-compute[72382]:         <nova:swap>0</nova:swap>
Aug 09 15:33:08 user nova-compute[72382]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 15:33:08 user nova-compute[72382]:         <nova:vcpus>1</nova:vcpus>
Aug 09 15:33:08 user nova-compute[72382]:       </nova:flavor>
Aug 09 15:33:08 user nova-compute[72382]:       <nova:owner>
Aug 09 15:33:08 user nova-compute[72382]:         <nova:user uuid="280bcf2afd7245a7bcd605e0db79c569">tempest-TestVolumeBootPattern-451643589-project-member</nova:user>
Aug 09 15:33:08 user nova-compute[72382]:         <nova:project uuid="70310b1af40b4d239fe5ea362972554b">tempest-TestVolumeBootPattern-451643589</nova:project>
Aug 09 15:33:08 user nova-compute[72382]:       </nova:owner>
Aug 09 15:33:08 user nova-compute[72382]:       <nova:root type="image" uuid="517344be-3709-4576-9bc3-25515ae59215"/>
Aug 09 15:33:08 user nova-compute[72382]:       <nova:ports>
Aug 09 15:33:08 user nova-compute[72382]:         <nova:port uuid="4936f05e-b54a-4219-aa37-681330955e94">
Aug 09 15:33:08 user nova-compute[72382]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 09 15:33:08 user nova-compute[72382]:         </nova:port>
Aug 09 15:33:08 user nova-compute[72382]:       </nova:ports>
Aug 09 15:33:08 user nova-compute[72382]:     </nova:instance>
Aug 09 15:33:08 user nova-compute[72382]:   </metadata>
Aug 09 15:33:08 user nova-compute[72382]:   <sysinfo type="smbios">
Aug 09 15:33:08 user nova-compute[72382]:     <system>
Aug 09 15:33:08 user nova-compute[72382]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 15:33:08 user nova-compute[72382]:       <entry name="product">OpenStack Nova</entry>
Aug 09 15:33:08 user nova-compute[72382]:       <entry name="version">0.0.0</entry>
Aug 09 15:33:08 user nova-compute[72382]:       <entry name="serial">765eb553-6c1c-4d5a-a1cf-6ac8b348ac8e</entry>
Aug 09 15:33:08 user nova-compute[72382]:       <entry name="uuid">765eb553-6c1c-4d5a-a1cf-6ac8b348ac8e</entry>
Aug 09 15:33:08 user nova-compute[72382]:       <entry name="family">Virtual Machine</entry>
Aug 09 15:33:08 user nova-compute[72382]:     </system>
Aug 09 15:33:08 user nova-compute[72382]:   </sysinfo>
Aug 09 15:33:08 user nova-compute[72382]:   <os>
Aug 09 15:33:08 user nova-compute[72382]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 15:33:08 user nova-compute[72382]:     <boot dev="hd"/>
Aug 09 15:33:08 user nova-compute[72382]:     <smbios mode="sysinfo"/>
Aug 09 15:33:08 user nova-compute[72382]:   </os>
Aug 09 15:33:08 user nova-compute[72382]:   <features>
Aug 09 15:33:08 user nova-compute[72382]:     <acpi/>
Aug 09 15:33:08 user nova-compute[72382]:     <apic/>
Aug 09 15:33:08 user nova-compute[72382]:     <vmcoreinfo/>
Aug 09 15:33:08 user nova-compute[72382]:   </features>
Aug 09 15:33:08 user nova-compute[72382]:   <clock offset="utc">
Aug 09 15:33:08 user nova-compute[72382]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 15:33:08 user nova-compute[72382]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 15:33:08 user nova-compute[72382]:     <timer name="hpet" present="no"/>
Aug 09 15:33:08 user nova-compute[72382]:   </clock>
Aug 09 15:33:08 user nova-compute[72382]:   <cpu mode="custom" match="exact">
Aug 09 15:33:08 user nova-compute[72382]:     <model>Nehalem</model>
Aug 09 15:33:08 user nova-compute[72382]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 15:33:08 user nova-compute[72382]:   </cpu>
Aug 09 15:33:08 user nova-compute[72382]:   <devices>
Aug 09 15:33:08 user nova-compute[72382]:     <disk type="block" device="disk">
Aug 09 15:33:08 user nova-compute[72382]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 15:33:08 user nova-compute[72382]:       <source dev="/dev/sdg"/>
Aug 09 15:33:08 user nova-compute[72382]:       <target dev="vda" bus="virtio"/>
Aug 09 15:33:08 user nova-compute[72382]:       <serial>9b93bb40-75bb-4387-aa01-c839f97e3432</serial>
Aug 09 15:33:08 user nova-compute[72382]:     </disk>
Aug 09 15:33:08 user nova-compute[72382]:     <interface type="ethernet">
Aug 09 15:33:08 user nova-compute[72382]:       <mac address="fa:16:3e:86:c1:69"/>
Aug 09 15:33:08 user nova-compute[72382]:       <model type="virtio"/>
Aug 09 15:33:08 user nova-compute[72382]:       <mtu size="1442"/>
Aug 09 15:33:08 user nova-compute[72382]:       <target dev="tap4936f05e-b5"/>
Aug 09 15:33:08 user nova-compute[72382]:     </interface>
Aug 09 15:33:08 user nova-compute[72382]:     <serial type="pty">
Aug 09 15:33:08 user nova-compute[72382]:       <log file="/opt/stack/data/nova/instances/765eb553-6c1c-4d5a-a1cf-6ac8b348ac8e/console.log" append="off"/>
Aug 09 15:33:08 user nova-compute[72382]:     </serial>
Aug 09 15:33:08 user nova-compute[72382]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 15:33:08 user nova-compute[72382]:     <video>
Aug 09 15:33:08 user nova-compute[72382]:       <model type="virtio"/>
Aug 09 15:33:08 user nova-compute[72382]:     </video>
Aug 09 15:33:08 user nova-compute[72382]:     <rng model="virtio">
Aug 09 15:33:08 user nova-compute[72382]:       <backend model="random">/dev/urandom</backend>
Aug 09 15:33:08 user nova-compute[72382]:     </rng>
Aug 09 15:33:08 user nova-compute[72382]:     <controller type="usb" index="0" model="none"/>
Aug 09 15:33:08 user nova-compute[72382]:     <memballoon model="virtio">
Aug 09 15:33:08 user nova-compute[72382]:       <stats period="10"/>
Aug 09 15:33:08 user nova-compute[72382]:     </memballoon>
Aug 09 15:33:08 user nova-compute[72382]:   </devices>
Aug 09 15:33:08 user nova-compute[72382]: </domain>
Aug 09 15:33:08 user nova-compute[72382]:  {{(pid=72382) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 15:33:08 user nova-compute[72382]: DEBUG nova.virt.libvirt.vif [None req-3654f991-2f30-4645-8347-159a0f989e62 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T15:32:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1314691970',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1314691970',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1314691970',id=35,image_ref='517344be-3709-4576-9bc3-25515ae59215',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEvAABBE0ImmPJHlhvG+ei5Kpw6Q9p/nD7wB8dehbmgx9OM5jAZZul+5YZCixv3LdKlkCUxp5t9OpV7dAlvRztw/Wi+KSm1ZN4c585plDdkzEWW7DGuI89HS5TTVZNYfgg==',key_name='tempest-keypair-978880427',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='70310b1af40b4d239fe5ea362972554b',ramdisk_id='',reservation_id='r-incmwery',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-451643589',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-451643589-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-451643589',owner_user_name='tempest-TestVolumeBootPattern-451643589-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T15:32:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='280bcf2afd7245a7bcd605e0db79c569',uuid=765eb553-6c1c-4d5a-a1cf-6ac8b348ac8e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4936f05e-b54a-4219-aa37-681330955e94", "address": "fa:16:3e:86:c1:69", "network": {"id": "a78e6cb6-feb7-4f64-a3c0-4900594b6e37", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-338007968-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70310b1af40b4d239fe5ea362972554b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4936f05e-b5", "ovs_interfaceid": "4936f05e-b54a-4219-aa37-681330955e94", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 15:33:08 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-3654f991-2f30-4645-8347-159a0f989e62 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Converting VIF {"id": "4936f05e-b54a-4219-aa37-681330955e94", "address": "fa:16:3e:86:c1:69", "network": {"id": "a78e6cb6-feb7-4f64-a3c0-4900594b6e37", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-338007968-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70310b1af40b4d239fe5ea362972554b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4936f05e-b5", "ovs_interfaceid": "4936f05e-b54a-4219-aa37-681330955e94", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 15:33:08 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-3654f991-2f30-4645-8347-159a0f989e62 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:c1:69,bridge_name='br-int',has_traffic_filtering=True,id=4936f05e-b54a-4219-aa37-681330955e94,network=Network(a78e6cb6-feb7-4f64-a3c0-4900594b6e37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4936f05e-b5') {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 15:33:08 user nova-compute[72382]: DEBUG os_vif [None req-3654f991-2f30-4645-8347-159a0f989e62 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:c1:69,bridge_name='br-int',has_traffic_filtering=True,id=4936f05e-b54a-4219-aa37-681330955e94,network=Network(a78e6cb6-feb7-4f64-a3c0-4900594b6e37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4936f05e-b5') {{(pid=72382) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 15:33:08 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:33:08 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:33:08 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 15:33:08 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:33:08 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4936f05e-b5, may_exist=True, interface_attrs={}) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:33:08 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4936f05e-b5, col_values=(('external_ids', {'iface-id': '4936f05e-b54a-4219-aa37-681330955e94', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:86:c1:69', 'vm-uuid': '765eb553-6c1c-4d5a-a1cf-6ac8b348ac8e'}),), if_exists=True) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:33:08 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:33:08 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:33:09 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:33:09 user nova-compute[72382]: INFO os_vif [None req-3654f991-2f30-4645-8347-159a0f989e62 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:c1:69,bridge_name='br-int',has_traffic_filtering=True,id=4936f05e-b54a-4219-aa37-681330955e94,network=Network(a78e6cb6-feb7-4f64-a3c0-4900594b6e37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4936f05e-b5')
Aug 09 15:33:09 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-3654f991-2f30-4645-8347-159a0f989e62 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] No BDM found with device name vda, not building metadata. {{(pid=72382) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 15:33:09 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-3654f991-2f30-4645-8347-159a0f989e62 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] No VIF found with MAC fa:16:3e:86:c1:69, not building metadata {{(pid=72382) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 15:33:09 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-a442ab0f-c676-4b6d-819e-4de41c71573c tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Acquiring lock "6ea8f68c-3dc1-45ac-a7f3-bca32f929add" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:33:09 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-a442ab0f-c676-4b6d-819e-4de41c71573c tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Lock "6ea8f68c-3dc1-45ac-a7f3-bca32f929add" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:33:09 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-a442ab0f-c676-4b6d-819e-4de41c71573c tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Acquiring lock "6ea8f68c-3dc1-45ac-a7f3-bca32f929add-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:33:09 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-a442ab0f-c676-4b6d-819e-4de41c71573c tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Lock "6ea8f68c-3dc1-45ac-a7f3-bca32f929add-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:33:09 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-a442ab0f-c676-4b6d-819e-4de41c71573c tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Lock "6ea8f68c-3dc1-45ac-a7f3-bca32f929add-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:33:09 user nova-compute[72382]: INFO nova.compute.manager [None req-a442ab0f-c676-4b6d-819e-4de41c71573c tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] [instance: 6ea8f68c-3dc1-45ac-a7f3-bca32f929add] Terminating instance
Aug 09 15:33:09 user nova-compute[72382]: DEBUG nova.compute.manager [None req-a442ab0f-c676-4b6d-819e-4de41c71573c tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] [instance: 6ea8f68c-3dc1-45ac-a7f3-bca32f929add] Start destroying the instance on the hypervisor. {{(pid=72382) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 15:33:09 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:33:09 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:33:09 user nova-compute[72382]: DEBUG nova.compute.manager [req-7dfca385-03ed-4555-a9fd-7a2ee193a9df req-27db35b2-1aa6-4292-9f73-4be415659f01 service nova] [instance: 6ea8f68c-3dc1-45ac-a7f3-bca32f929add] Received event network-vif-unplugged-360a451a-7760-4c79-99b0-7b2b04618443 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:33:09 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-7dfca385-03ed-4555-a9fd-7a2ee193a9df req-27db35b2-1aa6-4292-9f73-4be415659f01 service nova] Acquiring lock "6ea8f68c-3dc1-45ac-a7f3-bca32f929add-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:33:09 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-7dfca385-03ed-4555-a9fd-7a2ee193a9df req-27db35b2-1aa6-4292-9f73-4be415659f01 service nova] Lock "6ea8f68c-3dc1-45ac-a7f3-bca32f929add-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:33:09 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-7dfca385-03ed-4555-a9fd-7a2ee193a9df req-27db35b2-1aa6-4292-9f73-4be415659f01 service nova] Lock "6ea8f68c-3dc1-45ac-a7f3-bca32f929add-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:33:09 user nova-compute[72382]: DEBUG nova.compute.manager [req-7dfca385-03ed-4555-a9fd-7a2ee193a9df req-27db35b2-1aa6-4292-9f73-4be415659f01 service nova] [instance: 6ea8f68c-3dc1-45ac-a7f3-bca32f929add] No waiting events found dispatching network-vif-unplugged-360a451a-7760-4c79-99b0-7b2b04618443 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:33:09 user nova-compute[72382]: DEBUG nova.compute.manager [req-7dfca385-03ed-4555-a9fd-7a2ee193a9df req-27db35b2-1aa6-4292-9f73-4be415659f01 service nova] [instance: 6ea8f68c-3dc1-45ac-a7f3-bca32f929add] Received event network-vif-unplugged-360a451a-7760-4c79-99b0-7b2b04618443 for instance with task_state deleting. {{(pid=72382) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 15:33:09 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:33:09 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:33:10 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:33:10 user nova-compute[72382]: INFO nova.virt.libvirt.driver [-] [instance: 6ea8f68c-3dc1-45ac-a7f3-bca32f929add] Instance destroyed successfully.
Aug 09 15:33:10 user nova-compute[72382]: DEBUG nova.objects.instance [None req-a442ab0f-c676-4b6d-819e-4de41c71573c tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Lazy-loading 'resources' on Instance uuid 6ea8f68c-3dc1-45ac-a7f3-bca32f929add {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:33:10 user nova-compute[72382]: DEBUG nova.virt.libvirt.vif [None req-a442ab0f-c676-4b6d-819e-4de41c71573c tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T15:23:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-914657746',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-914657746',id=22,image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-09T15:23:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='080d1ded4cd94e5083ee0b7e691b7363',ramdisk_id='',reservation_id='r-cbl54nkn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1187177274',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T15:25:42Z,user_data=None,user_id='e71af7a4912147cd9fab070cb77b275c',uuid=6ea8f68c-3dc1-45ac-a7f3-bca32f929add,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "360a451a-7760-4c79-99b0-7b2b04618443", "address": "fa:16:3e:84:ac:d8", "network": {"id": "d47e3749-fdff-4112-bd72-69ca584efe1f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-302967634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "080d1ded4cd94e5083ee0b7e691b7363", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap360a451a-77", "ovs_interfaceid": "360a451a-7760-4c79-99b0-7b2b04618443", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 15:33:10 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-a442ab0f-c676-4b6d-819e-4de41c71573c tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Converting VIF {"id": "360a451a-7760-4c79-99b0-7b2b04618443", "address": "fa:16:3e:84:ac:d8", "network": {"id": "d47e3749-fdff-4112-bd72-69ca584efe1f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-302967634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "080d1ded4cd94e5083ee0b7e691b7363", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap360a451a-77", "ovs_interfaceid": "360a451a-7760-4c79-99b0-7b2b04618443", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 15:33:10 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-a442ab0f-c676-4b6d-819e-4de41c71573c tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:84:ac:d8,bridge_name='br-int',has_traffic_filtering=True,id=360a451a-7760-4c79-99b0-7b2b04618443,network=Network(d47e3749-fdff-4112-bd72-69ca584efe1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap360a451a-77') {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 15:33:10 user nova-compute[72382]: DEBUG os_vif [None req-a442ab0f-c676-4b6d-819e-4de41c71573c tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:84:ac:d8,bridge_name='br-int',has_traffic_filtering=True,id=360a451a-7760-4c79-99b0-7b2b04618443,network=Network(d47e3749-fdff-4112-bd72-69ca584efe1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap360a451a-77') {{(pid=72382) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 15:33:10 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:33:10 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap360a451a-77, bridge=br-int, if_exists=True) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:33:10 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:33:10 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:33:10 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:33:10 user nova-compute[72382]: INFO os_vif [None req-a442ab0f-c676-4b6d-819e-4de41c71573c tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:84:ac:d8,bridge_name='br-int',has_traffic_filtering=True,id=360a451a-7760-4c79-99b0-7b2b04618443,network=Network(d47e3749-fdff-4112-bd72-69ca584efe1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap360a451a-77')
Aug 09 15:33:10 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-a442ab0f-c676-4b6d-819e-4de41c71573c tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] [instance: 6ea8f68c-3dc1-45ac-a7f3-bca32f929add] Deleting instance files /opt/stack/data/nova/instances/6ea8f68c-3dc1-45ac-a7f3-bca32f929add_del
Aug 09 15:33:10 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-a442ab0f-c676-4b6d-819e-4de41c71573c tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] [instance: 6ea8f68c-3dc1-45ac-a7f3-bca32f929add] Deletion of /opt/stack/data/nova/instances/6ea8f68c-3dc1-45ac-a7f3-bca32f929add_del complete
Aug 09 15:33:10 user nova-compute[72382]: INFO nova.compute.manager [None req-a442ab0f-c676-4b6d-819e-4de41c71573c tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] [instance: 6ea8f68c-3dc1-45ac-a7f3-bca32f929add] Took 1.04 seconds to destroy the instance on the hypervisor.
Aug 09 15:33:10 user nova-compute[72382]: DEBUG oslo.service.loopingcall [None req-a442ab0f-c676-4b6d-819e-4de41c71573c tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72382) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 15:33:10 user nova-compute[72382]: DEBUG nova.compute.manager [-] [instance: 6ea8f68c-3dc1-45ac-a7f3-bca32f929add] Deallocating network for instance {{(pid=72382) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 15:33:10 user nova-compute[72382]: DEBUG nova.network.neutron [-] [instance: 6ea8f68c-3dc1-45ac-a7f3-bca32f929add] deallocate_for_instance() {{(pid=72382) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 15:33:10 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:33:10 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:33:10 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:33:10 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:33:10 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:33:10 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:33:10 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:33:10 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:33:10 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Auditing locally available compute resources for user (node: user) {{(pid=72382) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 15:33:10 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:33:10 user nova-compute[72382]: DEBUG nova.network.neutron [-] [instance: 6ea8f68c-3dc1-45ac-a7f3-bca32f929add] Updating instance_info_cache with network_info: [] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:33:10 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:33:10 user nova-compute[72382]: INFO nova.compute.manager [-] [instance: 6ea8f68c-3dc1-45ac-a7f3-bca32f929add] Took 0.49 seconds to deallocate network for instance.
Aug 09 15:33:10 user nova-compute[72382]: DEBUG nova.compute.manager [req-1db18d07-3926-4113-8c55-1fc4f517c694 req-5bfa96a8-750a-47fe-b89a-4199dc7d6de2 service nova] [instance: 6ea8f68c-3dc1-45ac-a7f3-bca32f929add] Received event network-vif-deleted-360a451a-7760-4c79-99b0-7b2b04618443 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:33:11 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-a442ab0f-c676-4b6d-819e-4de41c71573c tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:33:11 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-a442ab0f-c676-4b6d-819e-4de41c71573c tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:33:11 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:33:11 user nova-compute[72382]: DEBUG nova.compute.manager [req-c9db4986-e9a2-47f4-9c67-e8c25afc39ef req-3e1da06a-8d03-4e42-8b1b-ac0e052a5105 service nova] [instance: 765eb553-6c1c-4d5a-a1cf-6ac8b348ac8e] Received event network-vif-plugged-4936f05e-b54a-4219-aa37-681330955e94 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:33:11 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-c9db4986-e9a2-47f4-9c67-e8c25afc39ef req-3e1da06a-8d03-4e42-8b1b-ac0e052a5105 service nova] Acquiring lock "765eb553-6c1c-4d5a-a1cf-6ac8b348ac8e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:33:11 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-c9db4986-e9a2-47f4-9c67-e8c25afc39ef req-3e1da06a-8d03-4e42-8b1b-ac0e052a5105 service nova] Lock "765eb553-6c1c-4d5a-a1cf-6ac8b348ac8e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:33:11 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-c9db4986-e9a2-47f4-9c67-e8c25afc39ef req-3e1da06a-8d03-4e42-8b1b-ac0e052a5105 service nova] Lock "765eb553-6c1c-4d5a-a1cf-6ac8b348ac8e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:33:11 user nova-compute[72382]: DEBUG nova.compute.manager [req-c9db4986-e9a2-47f4-9c67-e8c25afc39ef req-3e1da06a-8d03-4e42-8b1b-ac0e052a5105 service nova] [instance: 765eb553-6c1c-4d5a-a1cf-6ac8b348ac8e] No waiting events found dispatching network-vif-plugged-4936f05e-b54a-4219-aa37-681330955e94 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:33:11 user nova-compute[72382]: WARNING nova.compute.manager [req-c9db4986-e9a2-47f4-9c67-e8c25afc39ef req-3e1da06a-8d03-4e42-8b1b-ac0e052a5105 service nova] [instance: 765eb553-6c1c-4d5a-a1cf-6ac8b348ac8e] Received unexpected event network-vif-plugged-4936f05e-b54a-4219-aa37-681330955e94 for instance with vm_state building and task_state spawning.
Aug 09 15:33:11 user nova-compute[72382]: DEBUG nova.compute.provider_tree [None req-a442ab0f-c676-4b6d-819e-4de41c71573c tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Inventory has not changed in ProviderTree for provider: 7b15b0e5-df4d-49db-833b-2855d21d10ae {{(pid=72382) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 15:33:11 user nova-compute[72382]: DEBUG nova.scheduler.client.report [None req-a442ab0f-c676-4b6d-819e-4de41c71573c tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Inventory has not changed for provider 7b15b0e5-df4d-49db-833b-2855d21d10ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72382) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 15:33:11 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:33:11 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:33:11 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-a442ab0f-c676-4b6d-819e-4de41c71573c tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.466s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:33:11 user nova-compute[72382]: INFO nova.scheduler.client.report [None req-a442ab0f-c676-4b6d-819e-4de41c71573c tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Deleted allocations for instance 6ea8f68c-3dc1-45ac-a7f3-bca32f929add
Aug 09 15:33:11 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:33:11 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] skipping disk /dev/sdf (vdc) as it is a volume {{(pid=72382) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 15:33:11 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f780040f-b789-4b72-8986-813c7b9fe4a6/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:33:11 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-a442ab0f-c676-4b6d-819e-4de41c71573c tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Lock "6ea8f68c-3dc1-45ac-a7f3-bca32f929add" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.231s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:33:11 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f780040f-b789-4b72-8986-813c7b9fe4a6/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:33:11 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f780040f-b789-4b72-8986-813c7b9fe4a6/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:33:11 user nova-compute[72382]: DEBUG nova.compute.manager [req-a652367b-ea51-49bd-abda-b3ac5756e85d req-ffec3442-07de-413b-b922-009b3b56b37f service nova] [instance: 6ea8f68c-3dc1-45ac-a7f3-bca32f929add] Received event network-vif-plugged-360a451a-7760-4c79-99b0-7b2b04618443 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:33:11 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-a652367b-ea51-49bd-abda-b3ac5756e85d req-ffec3442-07de-413b-b922-009b3b56b37f service nova] Acquiring lock "6ea8f68c-3dc1-45ac-a7f3-bca32f929add-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:33:11 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-a652367b-ea51-49bd-abda-b3ac5756e85d req-ffec3442-07de-413b-b922-009b3b56b37f service nova] Lock "6ea8f68c-3dc1-45ac-a7f3-bca32f929add-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:33:11 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-a652367b-ea51-49bd-abda-b3ac5756e85d req-ffec3442-07de-413b-b922-009b3b56b37f service nova] Lock "6ea8f68c-3dc1-45ac-a7f3-bca32f929add-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:33:11 user nova-compute[72382]: DEBUG nova.compute.manager [req-a652367b-ea51-49bd-abda-b3ac5756e85d req-ffec3442-07de-413b-b922-009b3b56b37f service nova] [instance: 6ea8f68c-3dc1-45ac-a7f3-bca32f929add] No waiting events found dispatching network-vif-plugged-360a451a-7760-4c79-99b0-7b2b04618443 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:33:11 user nova-compute[72382]: WARNING nova.compute.manager [req-a652367b-ea51-49bd-abda-b3ac5756e85d req-ffec3442-07de-413b-b922-009b3b56b37f service nova] [instance: 6ea8f68c-3dc1-45ac-a7f3-bca32f929add] Received unexpected event network-vif-plugged-360a451a-7760-4c79-99b0-7b2b04618443 for instance with vm_state deleted and task_state None.
Aug 09 15:33:11 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f780040f-b789-4b72-8986-813c7b9fe4a6/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:33:11 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72382) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 15:33:11 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14c97840-88c0-4a8e-96e8-2e7da318ad07/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:33:12 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14c97840-88c0-4a8e-96e8-2e7da318ad07/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:33:12 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14c97840-88c0-4a8e-96e8-2e7da318ad07/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:33:12 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14c97840-88c0-4a8e-96e8-2e7da318ad07/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:33:12 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=72382) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 15:33:12 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ccbfda2-8bcd-4ec1-972a-cf49a62b1583/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:33:12 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ccbfda2-8bcd-4ec1-972a-cf49a62b1583/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:33:12 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ccbfda2-8bcd-4ec1-972a-cf49a62b1583/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:33:12 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ccbfda2-8bcd-4ec1-972a-cf49a62b1583/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:33:12 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72382) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 15:33:12 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7c34b80-c2e9-43c1-8b8e-7c62eb8e73f4/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:33:12 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7c34b80-c2e9-43c1-8b8e-7c62eb8e73f4/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:33:12 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7c34b80-c2e9-43c1-8b8e-7c62eb8e73f4/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:33:12 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7c34b80-c2e9-43c1-8b8e-7c62eb8e73f4/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:33:12 user nova-compute[72382]: DEBUG nova.compute.manager [None req-3654f991-2f30-4645-8347-159a0f989e62 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: 765eb553-6c1c-4d5a-a1cf-6ac8b348ac8e] Instance event wait completed in 0 seconds for  {{(pid=72382) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 15:33:12 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-3654f991-2f30-4645-8347-159a0f989e62 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: 765eb553-6c1c-4d5a-a1cf-6ac8b348ac8e] Guest created on hypervisor {{(pid=72382) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 15:33:12 user nova-compute[72382]: DEBUG nova.virt.driver [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Emitting event <LifecycleEvent: 1691595192.829814, 765eb553-6c1c-4d5a-a1cf-6ac8b348ac8e => Resumed> {{(pid=72382) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 15:33:12 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 765eb553-6c1c-4d5a-a1cf-6ac8b348ac8e] VM Resumed (Lifecycle Event)
Aug 09 15:33:12 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f744a7d-9eed-40e1-9422-670970c209ce/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:33:12 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 765eb553-6c1c-4d5a-a1cf-6ac8b348ac8e] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:33:12 user nova-compute[72382]: INFO nova.virt.libvirt.driver [-] [instance: 765eb553-6c1c-4d5a-a1cf-6ac8b348ac8e] Instance spawned successfully.
Aug 09 15:33:12 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-3654f991-2f30-4645-8347-159a0f989e62 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: 765eb553-6c1c-4d5a-a1cf-6ac8b348ac8e] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 15:33:12 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 765eb553-6c1c-4d5a-a1cf-6ac8b348ac8e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72382) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 15:33:12 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-3654f991-2f30-4645-8347-159a0f989e62 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: 765eb553-6c1c-4d5a-a1cf-6ac8b348ac8e] Found default for hw_input_bus of None {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:33:12 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-3654f991-2f30-4645-8347-159a0f989e62 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: 765eb553-6c1c-4d5a-a1cf-6ac8b348ac8e] Found default for hw_pointer_model of None {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:33:12 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 765eb553-6c1c-4d5a-a1cf-6ac8b348ac8e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 15:33:12 user nova-compute[72382]: DEBUG nova.virt.driver [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Emitting event <LifecycleEvent: 1691595192.8316314, 765eb553-6c1c-4d5a-a1cf-6ac8b348ac8e => Started> {{(pid=72382) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 15:33:12 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 765eb553-6c1c-4d5a-a1cf-6ac8b348ac8e] VM Started (Lifecycle Event)
Aug 09 15:33:12 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 765eb553-6c1c-4d5a-a1cf-6ac8b348ac8e] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:33:12 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 765eb553-6c1c-4d5a-a1cf-6ac8b348ac8e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72382) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 15:33:12 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 765eb553-6c1c-4d5a-a1cf-6ac8b348ac8e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 15:33:12 user nova-compute[72382]: INFO nova.compute.manager [None req-3654f991-2f30-4645-8347-159a0f989e62 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: 765eb553-6c1c-4d5a-a1cf-6ac8b348ac8e] Took 5.44 seconds to spawn the instance on the hypervisor.
Aug 09 15:33:12 user nova-compute[72382]: DEBUG nova.compute.manager [None req-3654f991-2f30-4645-8347-159a0f989e62 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: 765eb553-6c1c-4d5a-a1cf-6ac8b348ac8e] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:33:12 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f744a7d-9eed-40e1-9422-670970c209ce/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:33:12 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f744a7d-9eed-40e1-9422-670970c209ce/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:33:13 user nova-compute[72382]: INFO nova.compute.manager [None req-3654f991-2f30-4645-8347-159a0f989e62 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: 765eb553-6c1c-4d5a-a1cf-6ac8b348ac8e] Took 20.81 seconds to build instance.
Aug 09 15:33:13 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f744a7d-9eed-40e1-9422-670970c209ce/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:33:13 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=72382) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 15:33:13 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-3654f991-2f30-4645-8347-159a0f989e62 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Lock "765eb553-6c1c-4d5a-a1cf-6ac8b348ac8e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.922s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:33:13 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72382) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 15:33:13 user nova-compute[72382]: DEBUG nova.compute.manager [req-32d59760-7d7d-41ea-8caf-53ab9ba96fdc req-d04b32ee-fa0f-4ee1-8a68-701ee26f3980 service nova] [instance: 765eb553-6c1c-4d5a-a1cf-6ac8b348ac8e] Received event network-vif-plugged-4936f05e-b54a-4219-aa37-681330955e94 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:33:13 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-32d59760-7d7d-41ea-8caf-53ab9ba96fdc req-d04b32ee-fa0f-4ee1-8a68-701ee26f3980 service nova] Acquiring lock "765eb553-6c1c-4d5a-a1cf-6ac8b348ac8e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:33:13 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-32d59760-7d7d-41ea-8caf-53ab9ba96fdc req-d04b32ee-fa0f-4ee1-8a68-701ee26f3980 service nova] Lock "765eb553-6c1c-4d5a-a1cf-6ac8b348ac8e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:33:13 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-32d59760-7d7d-41ea-8caf-53ab9ba96fdc req-d04b32ee-fa0f-4ee1-8a68-701ee26f3980 service nova] Lock "765eb553-6c1c-4d5a-a1cf-6ac8b348ac8e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:33:13 user nova-compute[72382]: DEBUG nova.compute.manager [req-32d59760-7d7d-41ea-8caf-53ab9ba96fdc req-d04b32ee-fa0f-4ee1-8a68-701ee26f3980 service nova] [instance: 765eb553-6c1c-4d5a-a1cf-6ac8b348ac8e] No waiting events found dispatching network-vif-plugged-4936f05e-b54a-4219-aa37-681330955e94 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:33:13 user nova-compute[72382]: WARNING nova.compute.manager [req-32d59760-7d7d-41ea-8caf-53ab9ba96fdc req-d04b32ee-fa0f-4ee1-8a68-701ee26f3980 service nova] [instance: 765eb553-6c1c-4d5a-a1cf-6ac8b348ac8e] Received unexpected event network-vif-plugged-4936f05e-b54a-4219-aa37-681330955e94 for instance with vm_state active and task_state None.
Aug 09 15:33:13 user nova-compute[72382]: WARNING nova.virt.libvirt.driver [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 15:33:13 user nova-compute[72382]: WARNING nova.virt.libvirt.driver [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 15:33:13 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Hypervisor/Node resource view: name=user free_ram=7841MB free_disk=25.370067596435547GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72382) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 15:33:13 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:33:13 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:33:13 user nova-compute[72382]: DEBUG nova.objects.instance [None req-b8771b6b-6113-44be-bcbe-d4f82bd4d106 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Lazy-loading 'flavor' on Instance uuid 14c97840-88c0-4a8e-96e8-2e7da318ad07 {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:33:13 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-b8771b6b-6113-44be-bcbe-d4f82bd4d106 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Acquiring lock "refresh_cache-14c97840-88c0-4a8e-96e8-2e7da318ad07" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 15:33:13 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-b8771b6b-6113-44be-bcbe-d4f82bd4d106 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Acquired lock "refresh_cache-14c97840-88c0-4a8e-96e8-2e7da318ad07" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 15:33:13 user nova-compute[72382]: DEBUG nova.network.neutron [None req-b8771b6b-6113-44be-bcbe-d4f82bd4d106 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] [instance: 14c97840-88c0-4a8e-96e8-2e7da318ad07] Building network info cache for instance {{(pid=72382) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 15:33:13 user nova-compute[72382]: DEBUG nova.objects.instance [None req-b8771b6b-6113-44be-bcbe-d4f82bd4d106 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Lazy-loading 'info_cache' on Instance uuid 14c97840-88c0-4a8e-96e8-2e7da318ad07 {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:33:13 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance f780040f-b789-4b72-8986-813c7b9fe4a6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:33:13 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance 0f510d75-5d1e-4a5c-b38f-731c299f0f5a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:33:13 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance 14c97840-88c0-4a8e-96e8-2e7da318ad07 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:33:13 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance 4ccbfda2-8bcd-4ec1-972a-cf49a62b1583 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:33:13 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance d7c34b80-c2e9-43c1-8b8e-7c62eb8e73f4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:33:13 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance 94c8cc29-3300-475f-aca0-40fa0e58cd66 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:33:13 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance 8f744a7d-9eed-40e1-9422-670970c209ce actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:33:13 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:33:13 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance 765eb553-6c1c-4d5a-a1cf-6ac8b348ac8e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:33:13 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=72382) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 15:33:13 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=72382) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 15:33:14 user nova-compute[72382]: DEBUG nova.compute.provider_tree [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Inventory has not changed in ProviderTree for provider: 7b15b0e5-df4d-49db-833b-2855d21d10ae {{(pid=72382) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 15:33:14 user nova-compute[72382]: DEBUG nova.scheduler.client.report [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Inventory has not changed for provider 7b15b0e5-df4d-49db-833b-2855d21d10ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72382) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 15:33:14 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Compute_service record updated for user:user {{(pid=72382) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 15:33:14 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.577s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:33:14 user nova-compute[72382]: DEBUG nova.network.neutron [None req-b8771b6b-6113-44be-bcbe-d4f82bd4d106 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] [instance: 14c97840-88c0-4a8e-96e8-2e7da318ad07] Updating instance_info_cache with network_info: [{"id": "f22c0d53-f0da-4bc9-bf7b-c10fe61e2e1f", "address": "fa:16:3e:72:44:b1", "network": {"id": "a85a6e1f-20f5-4719-90d2-0dc23ce525cd", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-780716970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c1a50eacfd0414bbc13e3fd4087e998", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf22c0d53-f0", "ovs_interfaceid": "f22c0d53-f0da-4bc9-bf7b-c10fe61e2e1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:33:14 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-b8771b6b-6113-44be-bcbe-d4f82bd4d106 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Releasing lock "refresh_cache-14c97840-88c0-4a8e-96e8-2e7da318ad07" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 15:33:14 user nova-compute[72382]: INFO nova.virt.libvirt.driver [-] [instance: 14c97840-88c0-4a8e-96e8-2e7da318ad07] Instance destroyed successfully.
Aug 09 15:33:14 user nova-compute[72382]: DEBUG nova.objects.instance [None req-b8771b6b-6113-44be-bcbe-d4f82bd4d106 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Lazy-loading 'resources' on Instance uuid 14c97840-88c0-4a8e-96e8-2e7da318ad07 {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:33:14 user nova-compute[72382]: DEBUG nova.virt.libvirt.vif [None req-b8771b6b-6113-44be-bcbe-d4f82bd4d106 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T15:25:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1065057662',display_name='tempest-AttachVolumeTestJSON-server-1065057662',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1065057662',id=25,image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDpgWhLPGWY2ElRglFQBqLuKZWglAfFVsofJemv1+kc4sKM1iZJZQ3Zp8fFAbw72Xaat0sVYwxhfDdHsZAI0ReSI/gfbVL6O5P/l5QvCIWZ9WBMY/UBAwONL1kUKiqSY5Q==',key_name='tempest-keypair-138739448',keypairs=<?>,launch_index=0,launched_at=2023-08-09T15:25:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='8c1a50eacfd0414bbc13e3fd4087e998',ramdisk_id='',reservation_id='r-p2h4ne70',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-502043064',owner_user_name='tempest-AttachVolumeTestJSON-502043064-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T15:31:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='13c67153e9ec44029e8d80c09d405175',uuid=14c97840-88c0-4a8e-96e8-2e7da318ad07,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "f22c0d53-f0da-4bc9-bf7b-c10fe61e2e1f", "address": "fa:16:3e:72:44:b1", "network": {"id": "a85a6e1f-20f5-4719-90d2-0dc23ce525cd", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-780716970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c1a50eacfd0414bbc13e3fd4087e998", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf22c0d53-f0", "ovs_interfaceid": "f22c0d53-f0da-4bc9-bf7b-c10fe61e2e1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 15:33:14 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-b8771b6b-6113-44be-bcbe-d4f82bd4d106 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Converting VIF {"id": "f22c0d53-f0da-4bc9-bf7b-c10fe61e2e1f", "address": "fa:16:3e:72:44:b1", "network": {"id": "a85a6e1f-20f5-4719-90d2-0dc23ce525cd", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-780716970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c1a50eacfd0414bbc13e3fd4087e998", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf22c0d53-f0", "ovs_interfaceid": "f22c0d53-f0da-4bc9-bf7b-c10fe61e2e1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 15:33:14 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-b8771b6b-6113-44be-bcbe-d4f82bd4d106 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:72:44:b1,bridge_name='br-int',has_traffic_filtering=True,id=f22c0d53-f0da-4bc9-bf7b-c10fe61e2e1f,network=Network(a85a6e1f-20f5-4719-90d2-0dc23ce525cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf22c0d53-f0') {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 15:33:14 user nova-compute[72382]: DEBUG os_vif [None req-b8771b6b-6113-44be-bcbe-d4f82bd4d106 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:44:b1,bridge_name='br-int',has_traffic_filtering=True,id=f22c0d53-f0da-4bc9-bf7b-c10fe61e2e1f,network=Network(a85a6e1f-20f5-4719-90d2-0dc23ce525cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf22c0d53-f0') {{(pid=72382) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 15:33:14 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:33:14 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf22c0d53-f0, bridge=br-int, if_exists=True) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:33:14 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:33:14 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:33:14 user nova-compute[72382]: INFO os_vif [None req-b8771b6b-6113-44be-bcbe-d4f82bd4d106 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:44:b1,bridge_name='br-int',has_traffic_filtering=True,id=f22c0d53-f0da-4bc9-bf7b-c10fe61e2e1f,network=Network(a85a6e1f-20f5-4719-90d2-0dc23ce525cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf22c0d53-f0')
Aug 09 15:33:14 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-b8771b6b-6113-44be-bcbe-d4f82bd4d106 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] [instance: 14c97840-88c0-4a8e-96e8-2e7da318ad07] Start _get_guest_xml network_info=[{"id": "f22c0d53-f0da-4bc9-bf7b-c10fe61e2e1f", "address": "fa:16:3e:72:44:b1", "network": {"id": "a85a6e1f-20f5-4719-90d2-0dc23ce525cd", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-780716970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c1a50eacfd0414bbc13e3fd4087e998", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf22c0d53-f0", "ovs_interfaceid": "f22c0d53-f0da-4bc9-bf7b-c10fe61e2e1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=a79f2cea-eb27-4631-aaf3-05e7d9e411b4,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'a79f2cea-eb27-4631-aaf3-05e7d9e411b4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72382) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 15:33:14 user nova-compute[72382]: DEBUG nova.objects.instance [None req-b8771b6b-6113-44be-bcbe-d4f82bd4d106 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Lazy-loading 'numa_topology' on Instance uuid 14c97840-88c0-4a8e-96e8-2e7da318ad07 {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:33:14 user nova-compute[72382]: WARNING nova.virt.libvirt.driver [None req-b8771b6b-6113-44be-bcbe-d4f82bd4d106 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 15:33:14 user nova-compute[72382]: WARNING nova.virt.libvirt.driver [None req-b8771b6b-6113-44be-bcbe-d4f82bd4d106 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 15:33:14 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-b8771b6b-6113-44be-bcbe-d4f82bd4d106 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72382) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 15:33:14 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-b8771b6b-6113-44be-bcbe-d4f82bd4d106 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] CPU controller missing on host. {{(pid=72382) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 15:33:14 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-b8771b6b-6113-44be-bcbe-d4f82bd4d106 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72382) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 15:33:14 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-b8771b6b-6113-44be-bcbe-d4f82bd4d106 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] CPU controller found on host. {{(pid=72382) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 15:33:14 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-b8771b6b-6113-44be-bcbe-d4f82bd4d106 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72382) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 15:33:14 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-b8771b6b-6113-44be-bcbe-d4f82bd4d106 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T15:11:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=a79f2cea-eb27-4631-aaf3-05e7d9e411b4,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 15:33:14 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-b8771b6b-6113-44be-bcbe-d4f82bd4d106 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Flavor limits 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 15:33:14 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-b8771b6b-6113-44be-bcbe-d4f82bd4d106 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Image limits 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 15:33:14 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-b8771b6b-6113-44be-bcbe-d4f82bd4d106 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Flavor pref 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 15:33:14 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-b8771b6b-6113-44be-bcbe-d4f82bd4d106 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Image pref 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 15:33:14 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-b8771b6b-6113-44be-bcbe-d4f82bd4d106 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 15:33:14 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-b8771b6b-6113-44be-bcbe-d4f82bd4d106 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 15:33:14 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-b8771b6b-6113-44be-bcbe-d4f82bd4d106 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72382) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 15:33:14 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-b8771b6b-6113-44be-bcbe-d4f82bd4d106 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Got 1 possible topologies {{(pid=72382) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 15:33:14 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-b8771b6b-6113-44be-bcbe-d4f82bd4d106 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 15:33:14 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-b8771b6b-6113-44be-bcbe-d4f82bd4d106 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 15:33:14 user nova-compute[72382]: DEBUG nova.objects.instance [None req-b8771b6b-6113-44be-bcbe-d4f82bd4d106 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Lazy-loading 'vcpu_model' on Instance uuid 14c97840-88c0-4a8e-96e8-2e7da318ad07 {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:33:14 user nova-compute[72382]: DEBUG nova.virt.libvirt.vif [None req-b8771b6b-6113-44be-bcbe-d4f82bd4d106 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T15:25:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1065057662',display_name='tempest-AttachVolumeTestJSON-server-1065057662',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1065057662',id=25,image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDpgWhLPGWY2ElRglFQBqLuKZWglAfFVsofJemv1+kc4sKM1iZJZQ3Zp8fFAbw72Xaat0sVYwxhfDdHsZAI0ReSI/gfbVL6O5P/l5QvCIWZ9WBMY/UBAwONL1kUKiqSY5Q==',key_name='tempest-keypair-138739448',keypairs=<?>,launch_index=0,launched_at=2023-08-09T15:25:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='8c1a50eacfd0414bbc13e3fd4087e998',ramdisk_id='',reservation_id='r-p2h4ne70',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-502043064',owner_user_name='tempest-AttachVolumeTestJSON-502043064-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T15:31:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='13c67153e9ec44029e8d80c09d405175',uuid=14c97840-88c0-4a8e-96e8-2e7da318ad07,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "f22c0d53-f0da-4bc9-bf7b-c10fe61e2e1f", "address": "fa:16:3e:72:44:b1", "network": {"id": "a85a6e1f-20f5-4719-90d2-0dc23ce525cd", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-780716970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c1a50eacfd0414bbc13e3fd4087e998", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf22c0d53-f0", "ovs_interfaceid": "f22c0d53-f0da-4bc9-bf7b-c10fe61e2e1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72382) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 15:33:14 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-b8771b6b-6113-44be-bcbe-d4f82bd4d106 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Converting VIF {"id": "f22c0d53-f0da-4bc9-bf7b-c10fe61e2e1f", "address": "fa:16:3e:72:44:b1", "network": {"id": "a85a6e1f-20f5-4719-90d2-0dc23ce525cd", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-780716970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c1a50eacfd0414bbc13e3fd4087e998", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf22c0d53-f0", "ovs_interfaceid": "f22c0d53-f0da-4bc9-bf7b-c10fe61e2e1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 15:33:14 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-b8771b6b-6113-44be-bcbe-d4f82bd4d106 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:72:44:b1,bridge_name='br-int',has_traffic_filtering=True,id=f22c0d53-f0da-4bc9-bf7b-c10fe61e2e1f,network=Network(a85a6e1f-20f5-4719-90d2-0dc23ce525cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf22c0d53-f0') {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 15:33:14 user nova-compute[72382]: DEBUG nova.objects.instance [None req-b8771b6b-6113-44be-bcbe-d4f82bd4d106 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Lazy-loading 'pci_devices' on Instance uuid 14c97840-88c0-4a8e-96e8-2e7da318ad07 {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:33:14 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-b8771b6b-6113-44be-bcbe-d4f82bd4d106 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] [instance: 14c97840-88c0-4a8e-96e8-2e7da318ad07] End _get_guest_xml xml=<domain type="kvm">
Aug 09 15:33:14 user nova-compute[72382]:   <uuid>14c97840-88c0-4a8e-96e8-2e7da318ad07</uuid>
Aug 09 15:33:14 user nova-compute[72382]:   <name>instance-00000019</name>
Aug 09 15:33:14 user nova-compute[72382]:   <memory>524288</memory>
Aug 09 15:33:14 user nova-compute[72382]:   <vcpu>1</vcpu>
Aug 09 15:33:14 user nova-compute[72382]:   <metadata>
Aug 09 15:33:14 user nova-compute[72382]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 15:33:14 user nova-compute[72382]:       <nova:package version="0.0.0"/>
Aug 09 15:33:14 user nova-compute[72382]:       <nova:name>tempest-AttachVolumeTestJSON-server-1065057662</nova:name>
Aug 09 15:33:14 user nova-compute[72382]:       <nova:creationTime>2023-08-09 15:33:14</nova:creationTime>
Aug 09 15:33:14 user nova-compute[72382]:       <nova:flavor name="m1.tiny">
Aug 09 15:33:14 user nova-compute[72382]:         <nova:memory>512</nova:memory>
Aug 09 15:33:14 user nova-compute[72382]:         <nova:disk>1</nova:disk>
Aug 09 15:33:14 user nova-compute[72382]:         <nova:swap>0</nova:swap>
Aug 09 15:33:14 user nova-compute[72382]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 15:33:14 user nova-compute[72382]:         <nova:vcpus>1</nova:vcpus>
Aug 09 15:33:14 user nova-compute[72382]:       </nova:flavor>
Aug 09 15:33:14 user nova-compute[72382]:       <nova:owner>
Aug 09 15:33:14 user nova-compute[72382]:         <nova:user uuid="13c67153e9ec44029e8d80c09d405175">tempest-AttachVolumeTestJSON-502043064-project-member</nova:user>
Aug 09 15:33:14 user nova-compute[72382]:         <nova:project uuid="8c1a50eacfd0414bbc13e3fd4087e998">tempest-AttachVolumeTestJSON-502043064</nova:project>
Aug 09 15:33:14 user nova-compute[72382]:       </nova:owner>
Aug 09 15:33:14 user nova-compute[72382]:       <nova:root type="image" uuid="a79f2cea-eb27-4631-aaf3-05e7d9e411b4"/>
Aug 09 15:33:14 user nova-compute[72382]:       <nova:ports>
Aug 09 15:33:14 user nova-compute[72382]:         <nova:port uuid="f22c0d53-f0da-4bc9-bf7b-c10fe61e2e1f">
Aug 09 15:33:14 user nova-compute[72382]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 09 15:33:14 user nova-compute[72382]:         </nova:port>
Aug 09 15:33:14 user nova-compute[72382]:       </nova:ports>
Aug 09 15:33:14 user nova-compute[72382]:     </nova:instance>
Aug 09 15:33:14 user nova-compute[72382]:   </metadata>
Aug 09 15:33:14 user nova-compute[72382]:   <sysinfo type="smbios">
Aug 09 15:33:14 user nova-compute[72382]:     <system>
Aug 09 15:33:14 user nova-compute[72382]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 15:33:14 user nova-compute[72382]:       <entry name="product">OpenStack Nova</entry>
Aug 09 15:33:14 user nova-compute[72382]:       <entry name="version">0.0.0</entry>
Aug 09 15:33:14 user nova-compute[72382]:       <entry name="serial">14c97840-88c0-4a8e-96e8-2e7da318ad07</entry>
Aug 09 15:33:14 user nova-compute[72382]:       <entry name="uuid">14c97840-88c0-4a8e-96e8-2e7da318ad07</entry>
Aug 09 15:33:14 user nova-compute[72382]:       <entry name="family">Virtual Machine</entry>
Aug 09 15:33:14 user nova-compute[72382]:     </system>
Aug 09 15:33:14 user nova-compute[72382]:   </sysinfo>
Aug 09 15:33:14 user nova-compute[72382]:   <os>
Aug 09 15:33:14 user nova-compute[72382]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 15:33:14 user nova-compute[72382]:     <boot dev="hd"/>
Aug 09 15:33:14 user nova-compute[72382]:     <smbios mode="sysinfo"/>
Aug 09 15:33:14 user nova-compute[72382]:   </os>
Aug 09 15:33:14 user nova-compute[72382]:   <features>
Aug 09 15:33:14 user nova-compute[72382]:     <acpi/>
Aug 09 15:33:14 user nova-compute[72382]:     <apic/>
Aug 09 15:33:14 user nova-compute[72382]:     <vmcoreinfo/>
Aug 09 15:33:14 user nova-compute[72382]:   </features>
Aug 09 15:33:14 user nova-compute[72382]:   <clock offset="utc">
Aug 09 15:33:14 user nova-compute[72382]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 15:33:14 user nova-compute[72382]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 15:33:14 user nova-compute[72382]:     <timer name="hpet" present="no"/>
Aug 09 15:33:14 user nova-compute[72382]:   </clock>
Aug 09 15:33:14 user nova-compute[72382]:   <cpu mode="custom" match="exact">
Aug 09 15:33:14 user nova-compute[72382]:     <model>Nehalem</model>
Aug 09 15:33:14 user nova-compute[72382]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 15:33:14 user nova-compute[72382]:   </cpu>
Aug 09 15:33:14 user nova-compute[72382]:   <devices>
Aug 09 15:33:14 user nova-compute[72382]:     <disk type="file" device="disk">
Aug 09 15:33:14 user nova-compute[72382]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 15:33:14 user nova-compute[72382]:       <source file="/opt/stack/data/nova/instances/14c97840-88c0-4a8e-96e8-2e7da318ad07/disk"/>
Aug 09 15:33:14 user nova-compute[72382]:       <target dev="vda" bus="virtio"/>
Aug 09 15:33:14 user nova-compute[72382]:     </disk>
Aug 09 15:33:14 user nova-compute[72382]:     <interface type="ethernet">
Aug 09 15:33:14 user nova-compute[72382]:       <mac address="fa:16:3e:72:44:b1"/>
Aug 09 15:33:14 user nova-compute[72382]:       <model type="virtio"/>
Aug 09 15:33:14 user nova-compute[72382]:       <mtu size="1442"/>
Aug 09 15:33:14 user nova-compute[72382]:       <target dev="tapf22c0d53-f0"/>
Aug 09 15:33:14 user nova-compute[72382]:     </interface>
Aug 09 15:33:14 user nova-compute[72382]:     <serial type="pty">
Aug 09 15:33:14 user nova-compute[72382]:       <log file="/opt/stack/data/nova/instances/14c97840-88c0-4a8e-96e8-2e7da318ad07/console.log" append="off"/>
Aug 09 15:33:14 user nova-compute[72382]:     </serial>
Aug 09 15:33:14 user nova-compute[72382]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 15:33:14 user nova-compute[72382]:     <video>
Aug 09 15:33:14 user nova-compute[72382]:       <model type="virtio"/>
Aug 09 15:33:14 user nova-compute[72382]:     </video>
Aug 09 15:33:14 user nova-compute[72382]:     <rng model="virtio">
Aug 09 15:33:14 user nova-compute[72382]:       <backend model="random">/dev/urandom</backend>
Aug 09 15:33:14 user nova-compute[72382]:     </rng>
Aug 09 15:33:14 user nova-compute[72382]:     <controller type="usb" index="0" model="none"/>
Aug 09 15:33:14 user nova-compute[72382]:     <memballoon model="virtio">
Aug 09 15:33:14 user nova-compute[72382]:       <stats period="10"/>
Aug 09 15:33:14 user nova-compute[72382]:     </memballoon>
Aug 09 15:33:14 user nova-compute[72382]:   </devices>
Aug 09 15:33:14 user nova-compute[72382]: </domain>
Aug 09 15:33:14 user nova-compute[72382]:  {{(pid=72382) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 15:33:14 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-b8771b6b-6113-44be-bcbe-d4f82bd4d106 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14c97840-88c0-4a8e-96e8-2e7da318ad07/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:33:14 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:33:14 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-b8771b6b-6113-44be-bcbe-d4f82bd4d106 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14c97840-88c0-4a8e-96e8-2e7da318ad07/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:33:14 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-b8771b6b-6113-44be-bcbe-d4f82bd4d106 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14c97840-88c0-4a8e-96e8-2e7da318ad07/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:33:14 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-b8771b6b-6113-44be-bcbe-d4f82bd4d106 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14c97840-88c0-4a8e-96e8-2e7da318ad07/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:33:14 user nova-compute[72382]: DEBUG nova.objects.instance [None req-b8771b6b-6113-44be-bcbe-d4f82bd4d106 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Lazy-loading 'trusted_certs' on Instance uuid 14c97840-88c0-4a8e-96e8-2e7da318ad07 {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:33:14 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-b8771b6b-6113-44be-bcbe-d4f82bd4d106 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:33:14 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-b8771b6b-6113-44be-bcbe-d4f82bd4d106 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b --force-share --output=json" returned: 0 in 0.194s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:33:14 user nova-compute[72382]: DEBUG nova.virt.disk.api [None req-b8771b6b-6113-44be-bcbe-d4f82bd4d106 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Checking if we can resize image /opt/stack/data/nova/instances/14c97840-88c0-4a8e-96e8-2e7da318ad07/disk. size=1073741824 {{(pid=72382) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 15:33:14 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-b8771b6b-6113-44be-bcbe-d4f82bd4d106 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14c97840-88c0-4a8e-96e8-2e7da318ad07/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:33:15 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-b8771b6b-6113-44be-bcbe-d4f82bd4d106 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14c97840-88c0-4a8e-96e8-2e7da318ad07/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:33:15 user nova-compute[72382]: DEBUG nova.virt.disk.api [None req-b8771b6b-6113-44be-bcbe-d4f82bd4d106 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Cannot resize image /opt/stack/data/nova/instances/14c97840-88c0-4a8e-96e8-2e7da318ad07/disk to a smaller size. {{(pid=72382) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 15:33:15 user nova-compute[72382]: DEBUG nova.objects.instance [None req-b8771b6b-6113-44be-bcbe-d4f82bd4d106 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Lazy-loading 'migration_context' on Instance uuid 14c97840-88c0-4a8e-96e8-2e7da318ad07 {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:33:15 user nova-compute[72382]: DEBUG nova.virt.libvirt.vif [None req-b8771b6b-6113-44be-bcbe-d4f82bd4d106 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T15:25:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1065057662',display_name='tempest-AttachVolumeTestJSON-server-1065057662',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1065057662',id=25,image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDpgWhLPGWY2ElRglFQBqLuKZWglAfFVsofJemv1+kc4sKM1iZJZQ3Zp8fFAbw72Xaat0sVYwxhfDdHsZAI0ReSI/gfbVL6O5P/l5QvCIWZ9WBMY/UBAwONL1kUKiqSY5Q==',key_name='tempest-keypair-138739448',keypairs=<?>,launch_index=0,launched_at=2023-08-09T15:25:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='8c1a50eacfd0414bbc13e3fd4087e998',ramdisk_id='',reservation_id='r-p2h4ne70',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-502043064',owner_user_name='tempest-AttachVolumeTestJSON-502043064-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T15:31:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='13c67153e9ec44029e8d80c09d405175',uuid=14c97840-88c0-4a8e-96e8-2e7da318ad07,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "f22c0d53-f0da-4bc9-bf7b-c10fe61e2e1f", "address": "fa:16:3e:72:44:b1", "network": {"id": "a85a6e1f-20f5-4719-90d2-0dc23ce525cd", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-780716970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c1a50eacfd0414bbc13e3fd4087e998", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf22c0d53-f0", "ovs_interfaceid": "f22c0d53-f0da-4bc9-bf7b-c10fe61e2e1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 15:33:15 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-b8771b6b-6113-44be-bcbe-d4f82bd4d106 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Converting VIF {"id": "f22c0d53-f0da-4bc9-bf7b-c10fe61e2e1f", "address": "fa:16:3e:72:44:b1", "network": {"id": "a85a6e1f-20f5-4719-90d2-0dc23ce525cd", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-780716970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c1a50eacfd0414bbc13e3fd4087e998", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf22c0d53-f0", "ovs_interfaceid": "f22c0d53-f0da-4bc9-bf7b-c10fe61e2e1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 15:33:15 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-b8771b6b-6113-44be-bcbe-d4f82bd4d106 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:72:44:b1,bridge_name='br-int',has_traffic_filtering=True,id=f22c0d53-f0da-4bc9-bf7b-c10fe61e2e1f,network=Network(a85a6e1f-20f5-4719-90d2-0dc23ce525cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf22c0d53-f0') {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 15:33:15 user nova-compute[72382]: DEBUG os_vif [None req-b8771b6b-6113-44be-bcbe-d4f82bd4d106 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:44:b1,bridge_name='br-int',has_traffic_filtering=True,id=f22c0d53-f0da-4bc9-bf7b-c10fe61e2e1f,network=Network(a85a6e1f-20f5-4719-90d2-0dc23ce525cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf22c0d53-f0') {{(pid=72382) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 15:33:15 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:33:15 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:33:15 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 15:33:15 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:33:15 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf22c0d53-f0, may_exist=True, interface_attrs={}) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:33:15 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf22c0d53-f0, col_values=(('external_ids', {'iface-id': 'f22c0d53-f0da-4bc9-bf7b-c10fe61e2e1f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:72:44:b1', 'vm-uuid': '14c97840-88c0-4a8e-96e8-2e7da318ad07'}),), if_exists=True) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:33:15 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:33:15 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:33:15 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:33:15 user nova-compute[72382]: INFO os_vif [None req-b8771b6b-6113-44be-bcbe-d4f82bd4d106 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:44:b1,bridge_name='br-int',has_traffic_filtering=True,id=f22c0d53-f0da-4bc9-bf7b-c10fe61e2e1f,network=Network(a85a6e1f-20f5-4719-90d2-0dc23ce525cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf22c0d53-f0')
Aug 09 15:33:16 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:33:16 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:33:16 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:33:16 user nova-compute[72382]: DEBUG nova.compute.manager [req-8c973d1e-e42a-4a9d-b21b-ae0bfc497699 req-29ca328a-f9c3-4a2b-86a3-ec172b9b4ded service nova] [instance: 14c97840-88c0-4a8e-96e8-2e7da318ad07] Received event network-vif-plugged-f22c0d53-f0da-4bc9-bf7b-c10fe61e2e1f {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:33:16 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-8c973d1e-e42a-4a9d-b21b-ae0bfc497699 req-29ca328a-f9c3-4a2b-86a3-ec172b9b4ded service nova] Acquiring lock "14c97840-88c0-4a8e-96e8-2e7da318ad07-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:33:16 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-8c973d1e-e42a-4a9d-b21b-ae0bfc497699 req-29ca328a-f9c3-4a2b-86a3-ec172b9b4ded service nova] Lock "14c97840-88c0-4a8e-96e8-2e7da318ad07-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:33:16 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-8c973d1e-e42a-4a9d-b21b-ae0bfc497699 req-29ca328a-f9c3-4a2b-86a3-ec172b9b4ded service nova] Lock "14c97840-88c0-4a8e-96e8-2e7da318ad07-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:33:16 user nova-compute[72382]: DEBUG nova.compute.manager [req-8c973d1e-e42a-4a9d-b21b-ae0bfc497699 req-29ca328a-f9c3-4a2b-86a3-ec172b9b4ded service nova] [instance: 14c97840-88c0-4a8e-96e8-2e7da318ad07] No waiting events found dispatching network-vif-plugged-f22c0d53-f0da-4bc9-bf7b-c10fe61e2e1f {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:33:16 user nova-compute[72382]: WARNING nova.compute.manager [req-8c973d1e-e42a-4a9d-b21b-ae0bfc497699 req-29ca328a-f9c3-4a2b-86a3-ec172b9b4ded service nova] [instance: 14c97840-88c0-4a8e-96e8-2e7da318ad07] Received unexpected event network-vif-plugged-f22c0d53-f0da-4bc9-bf7b-c10fe61e2e1f for instance with vm_state stopped and task_state powering-on.
Aug 09 15:33:17 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:33:17 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:33:17 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:33:17 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:33:18 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-4b518ce4-d0a8-4608-b6fe-15ef09b5946b tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Acquiring lock "b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:33:18 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-4b518ce4-d0a8-4608-b6fe-15ef09b5946b tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Lock "b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:33:18 user nova-compute[72382]: INFO nova.compute.manager [None req-4b518ce4-d0a8-4608-b6fe-15ef09b5946b tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] [instance: b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d] Detaching volume 8516df70-0781-4493-b04f-417dfdfd5365
Aug 09 15:33:18 user nova-compute[72382]: INFO nova.virt.block_device [None req-4b518ce4-d0a8-4608-b6fe-15ef09b5946b tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] [instance: b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d] Attempting to driver detach volume 8516df70-0781-4493-b04f-417dfdfd5365 from mountpoint /dev/vdc
Aug 09 15:33:18 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-4b518ce4-d0a8-4608-b6fe-15ef09b5946b tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Attempting to detach device vdc from instance b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d from the persistent domain config. {{(pid=72382) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 15:33:18 user nova-compute[72382]: DEBUG nova.virt.libvirt.guest [None req-4b518ce4-d0a8-4608-b6fe-15ef09b5946b tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 15:33:18 user nova-compute[72382]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 15:33:18 user nova-compute[72382]:   <source dev="/dev/sdf"/>
Aug 09 15:33:18 user nova-compute[72382]:   <target dev="vdc" bus="virtio"/>
Aug 09 15:33:18 user nova-compute[72382]:   <serial>8516df70-0781-4493-b04f-417dfdfd5365</serial>
Aug 09 15:33:18 user nova-compute[72382]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 09 15:33:18 user nova-compute[72382]: </disk>
Aug 09 15:33:18 user nova-compute[72382]:  {{(pid=72382) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 15:33:18 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-4b518ce4-d0a8-4608-b6fe-15ef09b5946b tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Successfully detached device vdc from instance b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d from the persistent domain config.
Aug 09 15:33:18 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-4b518ce4-d0a8-4608-b6fe-15ef09b5946b tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d from the live domain config. {{(pid=72382) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 15:33:18 user nova-compute[72382]: DEBUG nova.virt.libvirt.guest [None req-4b518ce4-d0a8-4608-b6fe-15ef09b5946b tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 15:33:18 user nova-compute[72382]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 15:33:18 user nova-compute[72382]:   <source dev="/dev/sdf"/>
Aug 09 15:33:18 user nova-compute[72382]:   <target dev="vdc" bus="virtio"/>
Aug 09 15:33:18 user nova-compute[72382]:   <serial>8516df70-0781-4493-b04f-417dfdfd5365</serial>
Aug 09 15:33:18 user nova-compute[72382]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 09 15:33:18 user nova-compute[72382]: </disk>
Aug 09 15:33:18 user nova-compute[72382]:  {{(pid=72382) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 15:33:18 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:33:18 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:33:18 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:33:18 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:33:18 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:33:18 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Received event <DeviceRemovedEvent: 1691595198.7223415, b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=72382) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 15:33:18 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-4b518ce4-d0a8-4608-b6fe-15ef09b5946b tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d {{(pid=72382) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 15:33:18 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-4b518ce4-d0a8-4608-b6fe-15ef09b5946b tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Successfully detached device vdc from instance b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d from the live domain config.
Aug 09 15:33:18 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4b518ce4-d0a8-4608-b6fe-15ef09b5946b tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] [instance: b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d] calling os-brick to detach iSCSI Volume {{(pid=72382) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 15:33:18 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b518ce4-d0a8-4608-b6fe-15ef09b5946b tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2a0c768340>, {'target_iqns': ['iqn.2010-10.org.openstack:8516df70-0781-4493-b04f-417dfdfd5365'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MTNfcoAF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 15:33:18 user nova-compute[72382]: WARNING os_brick.initiator.connectors.base [None req-4b518ce4-d0a8-4608-b6fe-15ef09b5946b tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 15:33:18 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-4b518ce4-d0a8-4608-b6fe-15ef09b5946b tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 15:33:18 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-4b518ce4-d0a8-4608-b6fe-15ef09b5946b tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 15:33:18 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b518ce4-d0a8-4608-b6fe-15ef09b5946b tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8516df70-0781-4493-b04f-417dfdfd5365', 0)] {{(pid=72382) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 15:33:18 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:33:18 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:33:18 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed8cc70d-c515-4aeb-9a95-dd349ebfca55]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:59852df5-d4c8-4f25-8693-36181ff6a447\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:84966571-0ed8-4b55-ae0c-a5e07dfa3152\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8516df70-0781-4493-b04f-417dfdfd5365\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9b93bb40-75bb-4387-aa01-c839f97e3432\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b5cfefdb-a454-494f-ab09-acf8644352a3\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:33:18 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:33:18 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:33:18 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[812e62b7-2623-44e0-a642-649a3eab5264]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5cfefdb-a454-494f-ab09-acf8644352a3 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59852df5-d4c8-4f25-8693-36181ff6a447 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8516df70-0781-4493-b04f-417dfdfd5365 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84966571-0ed8-4b55-ae0c-a5e07dfa3152 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b93bb40-75bb-4387-aa01-c839f97e3432 (non-flash)\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:33:18 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b518ce4-d0a8-4608-b6fe-15ef09b5946b tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)
Aug 09 15:33:18 user nova-compute[72382]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5cfefdb-a454-494f-ab09-acf8644352a3 (non-flash)
Aug 09 15:33:18 user nova-compute[72382]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59852df5-d4c8-4f25-8693-36181ff6a447 (non-flash)
Aug 09 15:33:18 user nova-compute[72382]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8516df70-0781-4493-b04f-417dfdfd5365 (non-flash)
Aug 09 15:33:18 user nova-compute[72382]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84966571-0ed8-4b55-ae0c-a5e07dfa3152 (non-flash)
Aug 09 15:33:18 user nova-compute[72382]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b93bb40-75bb-4387-aa01-c839f97e3432 (non-flash)
Aug 09 15:33:18 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 15:33:18 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b518ce4-d0a8-4608-b6fe-15ef09b5946b tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)
Aug 09 15:33:18 user nova-compute[72382]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5cfefdb-a454-494f-ab09-acf8644352a3 (non-flash)
Aug 09 15:33:18 user nova-compute[72382]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59852df5-d4c8-4f25-8693-36181ff6a447 (non-flash)
Aug 09 15:33:18 user nova-compute[72382]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8516df70-0781-4493-b04f-417dfdfd5365 (non-flash)
Aug 09 15:33:18 user nova-compute[72382]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84966571-0ed8-4b55-ae0c-a5e07dfa3152 (non-flash)
Aug 09 15:33:18 user nova-compute[72382]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b93bb40-75bb-4387-aa01-c839f97e3432 (non-flash)
Aug 09 15:33:18 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 15:33:18 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b518ce4-d0a8-4608-b6fe-15ef09b5946b tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2a0c187ac0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8516df70-0781-4493-b04f-417dfdfd5365'): ({'sdf'}, set())}) {{(pid=72382) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 15:33:18 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-4b518ce4-d0a8-4608-b6fe-15ef09b5946b tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Removing single pathed devices sdf {{(pid=72382) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 15:33:18 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:33:18 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:33:18 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a1b8940-f8b9-41e0-ab5d-718ecf7f1900]: (4, ('path checker states:\nup                  5\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:33:18 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:33:18 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:33:18 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bd1fe48-710e-4cc1-a6d1-f8f08fce5a4c]: (4, ('ok\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:33:18 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-4b518ce4-d0a8-4608-b6fe-15ef09b5946b tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Flushing IO for device /dev/sdf {{(pid=72382) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 15:33:18 user nova-compute[72382]: DEBUG nova.compute.manager [req-325c016e-d34b-4efe-bc9c-a4aee33fce5d req-481a12a2-6a32-49f7-958f-9514ce7f2f09 service nova] [instance: 14c97840-88c0-4a8e-96e8-2e7da318ad07] Received event network-vif-plugged-f22c0d53-f0da-4bc9-bf7b-c10fe61e2e1f {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:33:18 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-325c016e-d34b-4efe-bc9c-a4aee33fce5d req-481a12a2-6a32-49f7-958f-9514ce7f2f09 service nova] Acquiring lock "14c97840-88c0-4a8e-96e8-2e7da318ad07-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:33:18 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-325c016e-d34b-4efe-bc9c-a4aee33fce5d req-481a12a2-6a32-49f7-958f-9514ce7f2f09 service nova] Lock "14c97840-88c0-4a8e-96e8-2e7da318ad07-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:33:18 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-325c016e-d34b-4efe-bc9c-a4aee33fce5d req-481a12a2-6a32-49f7-958f-9514ce7f2f09 service nova] Lock "14c97840-88c0-4a8e-96e8-2e7da318ad07-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:33:18 user nova-compute[72382]: DEBUG nova.compute.manager [req-325c016e-d34b-4efe-bc9c-a4aee33fce5d req-481a12a2-6a32-49f7-958f-9514ce7f2f09 service nova] [instance: 14c97840-88c0-4a8e-96e8-2e7da318ad07] No waiting events found dispatching network-vif-plugged-f22c0d53-f0da-4bc9-bf7b-c10fe61e2e1f {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:33:18 user nova-compute[72382]: WARNING nova.compute.manager [req-325c016e-d34b-4efe-bc9c-a4aee33fce5d req-481a12a2-6a32-49f7-958f-9514ce7f2f09 service nova] [instance: 14c97840-88c0-4a8e-96e8-2e7da318ad07] Received unexpected event network-vif-plugged-f22c0d53-f0da-4bc9-bf7b-c10fe61e2e1f for instance with vm_state stopped and task_state powering-on.
Aug 09 15:33:18 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:33:18 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.015s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:33:18 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1a02c6a-6481-4133-8cfe-55d918f08163]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:33:18 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-4b518ce4-d0a8-4608-b6fe-15ef09b5946b tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=72382) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 15:33:18 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:33:18 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:33:18 user nova-compute[72382]: DEBUG nova.compute.manager [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Starting heal instance info cache {{(pid=72382) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 15:33:18 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.043s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:33:18 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[9acd0bf1-8896-44f0-923c-121bfc93bdeb]: (4, ('1', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:33:18 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-4b518ce4-d0a8-4608-b6fe-15ef09b5946b tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=72382) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 15:33:18 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-4b518ce4-d0a8-4608-b6fe-15ef09b5946b tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] SCSI volumes sdf have been removed. {{(pid=72382) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 15:33:18 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b518ce4-d0a8-4608-b6fe-15ef09b5946b tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8516df70-0781-4493-b04f-417dfdfd5365')] {{(pid=72382) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 15:33:18 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8516df70-0781-4493-b04f-417dfdfd5365 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:33:18 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8516df70-0781-4493-b04f-417dfdfd5365 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:33:18 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[77512a5f-7c0f-4f35-8c67-56b84e177921]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:33:18 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b518ce4-d0a8-4608-b6fe-15ef09b5946b tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:33:18 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8516df70-0781-4493-b04f-417dfdfd5365 -p 172.16.0.220:3260 --logout {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:33:18 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Acquiring lock "refresh_cache-14c97840-88c0-4a8e-96e8-2e7da318ad07" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 15:33:18 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Acquired lock "refresh_cache-14c97840-88c0-4a8e-96e8-2e7da318ad07" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 15:33:18 user nova-compute[72382]: DEBUG nova.network.neutron [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] [instance: 14c97840-88c0-4a8e-96e8-2e7da318ad07] Forcefully refreshing network info cache for instance {{(pid=72382) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 15:33:18 user nova-compute[72382]: DEBUG nova.virt.driver [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Emitting event <LifecycleEvent: 1691595198.9950154, 14c97840-88c0-4a8e-96e8-2e7da318ad07 => Resumed> {{(pid=72382) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 15:33:18 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 14c97840-88c0-4a8e-96e8-2e7da318ad07] VM Resumed (Lifecycle Event)
Aug 09 15:33:18 user nova-compute[72382]: DEBUG nova.compute.manager [None req-b8771b6b-6113-44be-bcbe-d4f82bd4d106 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] [instance: 14c97840-88c0-4a8e-96e8-2e7da318ad07] Instance event wait completed in 0 seconds for  {{(pid=72382) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 15:33:19 user nova-compute[72382]: INFO nova.virt.libvirt.driver [-] [instance: 14c97840-88c0-4a8e-96e8-2e7da318ad07] Instance rebooted successfully.
Aug 09 15:33:19 user nova-compute[72382]: DEBUG nova.compute.manager [None req-b8771b6b-6113-44be-bcbe-d4f82bd4d106 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] [instance: 14c97840-88c0-4a8e-96e8-2e7da318ad07] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:33:19 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 14c97840-88c0-4a8e-96e8-2e7da318ad07] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:33:19 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8516df70-0781-4493-b04f-417dfdfd5365 -p 172.16.0.220:3260 --logout" returned: 0 in 0.078s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:33:19 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[04be3a1f-4552-4726-893e-d5d7ec8daf3e]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:8516df70-0781-4493-b04f-417dfdfd5365, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:8516df70-0781-4493-b04f-417dfdfd5365, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:33:19 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b518ce4-d0a8-4608-b6fe-15ef09b5946b tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:8516df70-0781-4493-b04f-417dfdfd5365, portal: 172.16.0.220,3260]
Aug 09 15:33:19 user nova-compute[72382]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:8516df70-0781-4493-b04f-417dfdfd5365, portal: 172.16.0.220,3260] successful.
Aug 09 15:33:19 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:33:19 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8516df70-0781-4493-b04f-417dfdfd5365 -p 172.16.0.220:3260 --op delete {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:33:19 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 14c97840-88c0-4a8e-96e8-2e7da318ad07] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=72382) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 15:33:19 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8516df70-0781-4493-b04f-417dfdfd5365 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:33:19 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[0782d9b0-0f80-4a75-8738-305f1bd7b958]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:33:19 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b518ce4-d0a8-4608-b6fe-15ef09b5946b tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:33:19 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-4b518ce4-d0a8-4608-b6fe-15ef09b5946b tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.324s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 15:33:19 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b518ce4-d0a8-4608-b6fe-15ef09b5946b tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] <== disconnect_volume: return (325ms) None {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 15:33:19 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4b518ce4-d0a8-4608-b6fe-15ef09b5946b tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] [instance: b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d] Disconnected iSCSI Volume {{(pid=72382) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 15:33:19 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 14c97840-88c0-4a8e-96e8-2e7da318ad07] During sync_power_state the instance has a pending task (powering-on). Skip.
Aug 09 15:33:19 user nova-compute[72382]: DEBUG nova.virt.driver [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Emitting event <LifecycleEvent: 1691595198.9988189, 14c97840-88c0-4a8e-96e8-2e7da318ad07 => Started> {{(pid=72382) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 15:33:19 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 14c97840-88c0-4a8e-96e8-2e7da318ad07] VM Started (Lifecycle Event)
Aug 09 15:33:19 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 14c97840-88c0-4a8e-96e8-2e7da318ad07] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:33:19 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 14c97840-88c0-4a8e-96e8-2e7da318ad07] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=72382) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 15:33:19 user nova-compute[72382]: DEBUG nova.network.neutron [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] [instance: 14c97840-88c0-4a8e-96e8-2e7da318ad07] Updating instance_info_cache with network_info: [{"id": "f22c0d53-f0da-4bc9-bf7b-c10fe61e2e1f", "address": "fa:16:3e:72:44:b1", "network": {"id": "a85a6e1f-20f5-4719-90d2-0dc23ce525cd", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-780716970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c1a50eacfd0414bbc13e3fd4087e998", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf22c0d53-f0", "ovs_interfaceid": "f22c0d53-f0da-4bc9-bf7b-c10fe61e2e1f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:33:19 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Releasing lock "refresh_cache-14c97840-88c0-4a8e-96e8-2e7da318ad07" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 15:33:19 user nova-compute[72382]: DEBUG nova.compute.manager [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] [instance: 14c97840-88c0-4a8e-96e8-2e7da318ad07] Updated the network info_cache for instance {{(pid=72382) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 15:33:19 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:33:19 user nova-compute[72382]: DEBUG nova.compute.manager [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72382) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 15:33:19 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:33:19 user nova-compute[72382]: DEBUG nova.objects.instance [None req-4b518ce4-d0a8-4608-b6fe-15ef09b5946b tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Lazy-loading 'flavor' on Instance uuid b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:33:19 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:33:19 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-4b518ce4-d0a8-4608-b6fe-15ef09b5946b tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Lock "b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.854s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:33:20 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:33:23 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:33:24 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-8ea2ce17-24fd-45e3-9ac2-829c5c5816fc tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Acquiring lock "d7c34b80-c2e9-43c1-8b8e-7c62eb8e73f4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:33:24 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-8ea2ce17-24fd-45e3-9ac2-829c5c5816fc tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Lock "d7c34b80-c2e9-43c1-8b8e-7c62eb8e73f4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:33:24 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-8ea2ce17-24fd-45e3-9ac2-829c5c5816fc tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Acquiring lock "d7c34b80-c2e9-43c1-8b8e-7c62eb8e73f4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:33:24 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-8ea2ce17-24fd-45e3-9ac2-829c5c5816fc tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Lock "d7c34b80-c2e9-43c1-8b8e-7c62eb8e73f4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:33:24 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-8ea2ce17-24fd-45e3-9ac2-829c5c5816fc tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Lock "d7c34b80-c2e9-43c1-8b8e-7c62eb8e73f4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:33:24 user nova-compute[72382]: INFO nova.compute.manager [None req-8ea2ce17-24fd-45e3-9ac2-829c5c5816fc tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] [instance: d7c34b80-c2e9-43c1-8b8e-7c62eb8e73f4] Terminating instance
Aug 09 15:33:24 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8ea2ce17-24fd-45e3-9ac2-829c5c5816fc tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] [instance: d7c34b80-c2e9-43c1-8b8e-7c62eb8e73f4] Start destroying the instance on the hypervisor. {{(pid=72382) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 15:33:24 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:33:24 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:33:24 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:33:24 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:33:24 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:33:24 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:33:24 user nova-compute[72382]: DEBUG nova.compute.manager [req-dafcae1f-e6be-4d69-b98d-235a04a3230c req-dc70705e-7716-409f-96ab-6bb7b56492c0 service nova] [instance: d7c34b80-c2e9-43c1-8b8e-7c62eb8e73f4] Received event network-vif-unplugged-a0b8be03-4b4b-444f-ab4d-b7a78d18f799 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:33:24 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-dafcae1f-e6be-4d69-b98d-235a04a3230c req-dc70705e-7716-409f-96ab-6bb7b56492c0 service nova] Acquiring lock "d7c34b80-c2e9-43c1-8b8e-7c62eb8e73f4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:33:24 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-dafcae1f-e6be-4d69-b98d-235a04a3230c req-dc70705e-7716-409f-96ab-6bb7b56492c0 service nova] Lock "d7c34b80-c2e9-43c1-8b8e-7c62eb8e73f4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:33:24 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-dafcae1f-e6be-4d69-b98d-235a04a3230c req-dc70705e-7716-409f-96ab-6bb7b56492c0 service nova] Lock "d7c34b80-c2e9-43c1-8b8e-7c62eb8e73f4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:33:24 user nova-compute[72382]: DEBUG nova.compute.manager [req-dafcae1f-e6be-4d69-b98d-235a04a3230c req-dc70705e-7716-409f-96ab-6bb7b56492c0 service nova] [instance: d7c34b80-c2e9-43c1-8b8e-7c62eb8e73f4] No waiting events found dispatching network-vif-unplugged-a0b8be03-4b4b-444f-ab4d-b7a78d18f799 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:33:24 user nova-compute[72382]: DEBUG nova.compute.manager [req-dafcae1f-e6be-4d69-b98d-235a04a3230c req-dc70705e-7716-409f-96ab-6bb7b56492c0 service nova] [instance: d7c34b80-c2e9-43c1-8b8e-7c62eb8e73f4] Received event network-vif-unplugged-a0b8be03-4b4b-444f-ab4d-b7a78d18f799 for instance with task_state deleting. {{(pid=72382) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 15:33:25 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:33:25 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-d3c23c1e-0fc5-4528-81f0-f4d553d2d759 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Acquiring lock "4ccbfda2-8bcd-4ec1-972a-cf49a62b1583" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:33:25 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-d3c23c1e-0fc5-4528-81f0-f4d553d2d759 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Lock "4ccbfda2-8bcd-4ec1-972a-cf49a62b1583" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.004s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:33:25 user nova-compute[72382]: INFO nova.compute.manager [None req-d3c23c1e-0fc5-4528-81f0-f4d553d2d759 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] [instance: 4ccbfda2-8bcd-4ec1-972a-cf49a62b1583] Detaching volume b5cfefdb-a454-494f-ab09-acf8644352a3
Aug 09 15:33:25 user nova-compute[72382]: INFO nova.virt.libvirt.driver [-] [instance: d7c34b80-c2e9-43c1-8b8e-7c62eb8e73f4] Instance destroyed successfully.
Aug 09 15:33:25 user nova-compute[72382]: DEBUG nova.objects.instance [None req-8ea2ce17-24fd-45e3-9ac2-829c5c5816fc tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Lazy-loading 'resources' on Instance uuid d7c34b80-c2e9-43c1-8b8e-7c62eb8e73f4 {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:33:25 user nova-compute[72382]: DEBUG nova.virt.libvirt.vif [None req-8ea2ce17-24fd-45e3-9ac2-829c5c5816fc tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T15:30:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-959879230',display_name='tempest-AttachVolumeNegativeTest-server-959879230',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-959879230',id=32,image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEf3h2tk0+Xz7SAP6c+1mcJH8cXoTnRUqHOxRtY/fkTTgmsPi0nrf6AcDcfuRkR9pSlYNd7Xvp6iZsDSmBpJQCeKu5lfASm1Pr7a6hcbFw41p8S98ZJPJ9/AybwNU2yxvQ==',key_name='tempest-keypair-1963397104',keypairs=<?>,launch_index=0,launched_at=2023-08-09T15:30:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='98009994d9c74eb9b4fc6321e82440de',ramdisk_id='',reservation_id='r-1q8ndjce',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1325594356',owner_user_name='tempest-AttachVolumeNegativeTest-1325594356-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T15:30:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='401c9df41f284c88a86557485d7d9537',uuid=d7c34b80-c2e9-43c1-8b8e-7c62eb8e73f4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a0b8be03-4b4b-444f-ab4d-b7a78d18f799", "address": "fa:16:3e:64:69:21", "network": {"id": "46eb5f03-e04d-43d1-96d6-0792bc7a94b1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1842512309-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.81", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98009994d9c74eb9b4fc6321e82440de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0b8be03-4b", "ovs_interfaceid": "a0b8be03-4b4b-444f-ab4d-b7a78d18f799", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 15:33:25 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-8ea2ce17-24fd-45e3-9ac2-829c5c5816fc tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Converting VIF {"id": "a0b8be03-4b4b-444f-ab4d-b7a78d18f799", "address": "fa:16:3e:64:69:21", "network": {"id": "46eb5f03-e04d-43d1-96d6-0792bc7a94b1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1842512309-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.81", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98009994d9c74eb9b4fc6321e82440de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0b8be03-4b", "ovs_interfaceid": "a0b8be03-4b4b-444f-ab4d-b7a78d18f799", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 15:33:25 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-8ea2ce17-24fd-45e3-9ac2-829c5c5816fc tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:64:69:21,bridge_name='br-int',has_traffic_filtering=True,id=a0b8be03-4b4b-444f-ab4d-b7a78d18f799,network=Network(46eb5f03-e04d-43d1-96d6-0792bc7a94b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0b8be03-4b') {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 15:33:25 user nova-compute[72382]: DEBUG os_vif [None req-8ea2ce17-24fd-45e3-9ac2-829c5c5816fc tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:64:69:21,bridge_name='br-int',has_traffic_filtering=True,id=a0b8be03-4b4b-444f-ab4d-b7a78d18f799,network=Network(46eb5f03-e04d-43d1-96d6-0792bc7a94b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0b8be03-4b') {{(pid=72382) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 15:33:25 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:33:25 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa0b8be03-4b, bridge=br-int, if_exists=True) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:33:25 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:33:25 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:33:25 user nova-compute[72382]: INFO os_vif [None req-8ea2ce17-24fd-45e3-9ac2-829c5c5816fc tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:64:69:21,bridge_name='br-int',has_traffic_filtering=True,id=a0b8be03-4b4b-444f-ab4d-b7a78d18f799,network=Network(46eb5f03-e04d-43d1-96d6-0792bc7a94b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0b8be03-4b')
Aug 09 15:33:25 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-8ea2ce17-24fd-45e3-9ac2-829c5c5816fc tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] [instance: d7c34b80-c2e9-43c1-8b8e-7c62eb8e73f4] Deleting instance files /opt/stack/data/nova/instances/d7c34b80-c2e9-43c1-8b8e-7c62eb8e73f4_del
Aug 09 15:33:25 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-8ea2ce17-24fd-45e3-9ac2-829c5c5816fc tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] [instance: d7c34b80-c2e9-43c1-8b8e-7c62eb8e73f4] Deletion of /opt/stack/data/nova/instances/d7c34b80-c2e9-43c1-8b8e-7c62eb8e73f4_del complete
Aug 09 15:33:25 user nova-compute[72382]: INFO nova.virt.block_device [None req-d3c23c1e-0fc5-4528-81f0-f4d553d2d759 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] [instance: 4ccbfda2-8bcd-4ec1-972a-cf49a62b1583] Attempting to driver detach volume b5cfefdb-a454-494f-ab09-acf8644352a3 from mountpoint /dev/vdb
Aug 09 15:33:25 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-d3c23c1e-0fc5-4528-81f0-f4d553d2d759 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Attempting to detach device vdb from instance 4ccbfda2-8bcd-4ec1-972a-cf49a62b1583 from the persistent domain config. {{(pid=72382) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 15:33:25 user nova-compute[72382]: DEBUG nova.virt.libvirt.guest [None req-d3c23c1e-0fc5-4528-81f0-f4d553d2d759 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 15:33:25 user nova-compute[72382]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 15:33:25 user nova-compute[72382]:   <source dev="/dev/sdb"/>
Aug 09 15:33:25 user nova-compute[72382]:   <target dev="vdb" bus="virtio"/>
Aug 09 15:33:25 user nova-compute[72382]:   <serial>b5cfefdb-a454-494f-ab09-acf8644352a3</serial>
Aug 09 15:33:25 user nova-compute[72382]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 09 15:33:25 user nova-compute[72382]: </disk>
Aug 09 15:33:25 user nova-compute[72382]:  {{(pid=72382) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 15:33:25 user nova-compute[72382]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691595190.3453066, 6ea8f68c-3dc1-45ac-a7f3-bca32f929add => Stopped> {{(pid=72382) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 15:33:25 user nova-compute[72382]: INFO nova.compute.manager [-] [instance: 6ea8f68c-3dc1-45ac-a7f3-bca32f929add] VM Stopped (Lifecycle Event)
Aug 09 15:33:25 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-d3c23c1e-0fc5-4528-81f0-f4d553d2d759 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Successfully detached device vdb from instance 4ccbfda2-8bcd-4ec1-972a-cf49a62b1583 from the persistent domain config.
Aug 09 15:33:25 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-d3c23c1e-0fc5-4528-81f0-f4d553d2d759 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 4ccbfda2-8bcd-4ec1-972a-cf49a62b1583 from the live domain config. {{(pid=72382) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 15:33:25 user nova-compute[72382]: DEBUG nova.virt.libvirt.guest [None req-d3c23c1e-0fc5-4528-81f0-f4d553d2d759 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 15:33:25 user nova-compute[72382]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 15:33:25 user nova-compute[72382]:   <source dev="/dev/sdb"/>
Aug 09 15:33:25 user nova-compute[72382]:   <target dev="vdb" bus="virtio"/>
Aug 09 15:33:25 user nova-compute[72382]:   <serial>b5cfefdb-a454-494f-ab09-acf8644352a3</serial>
Aug 09 15:33:25 user nova-compute[72382]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 09 15:33:25 user nova-compute[72382]: </disk>
Aug 09 15:33:25 user nova-compute[72382]:  {{(pid=72382) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 15:33:25 user nova-compute[72382]: INFO nova.compute.manager [None req-8ea2ce17-24fd-45e3-9ac2-829c5c5816fc tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] [instance: d7c34b80-c2e9-43c1-8b8e-7c62eb8e73f4] Took 0.90 seconds to destroy the instance on the hypervisor.
Aug 09 15:33:25 user nova-compute[72382]: DEBUG oslo.service.loopingcall [None req-8ea2ce17-24fd-45e3-9ac2-829c5c5816fc tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72382) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 15:33:25 user nova-compute[72382]: DEBUG nova.compute.manager [None req-51086c2a-40f3-4013-ab4c-44fa69de5cd0 None None] [instance: 6ea8f68c-3dc1-45ac-a7f3-bca32f929add] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:33:25 user nova-compute[72382]: DEBUG nova.compute.manager [-] [instance: d7c34b80-c2e9-43c1-8b8e-7c62eb8e73f4] Deallocating network for instance {{(pid=72382) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 15:33:25 user nova-compute[72382]: DEBUG nova.network.neutron [-] [instance: d7c34b80-c2e9-43c1-8b8e-7c62eb8e73f4] deallocate_for_instance() {{(pid=72382) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 15:33:25 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Received event <DeviceRemovedEvent: 1691595205.8047228, 4ccbfda2-8bcd-4ec1-972a-cf49a62b1583 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72382) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 15:33:25 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-d3c23c1e-0fc5-4528-81f0-f4d553d2d759 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 4ccbfda2-8bcd-4ec1-972a-cf49a62b1583 {{(pid=72382) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 15:33:25 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-d3c23c1e-0fc5-4528-81f0-f4d553d2d759 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Successfully detached device vdb from instance 4ccbfda2-8bcd-4ec1-972a-cf49a62b1583 from the live domain config.
Aug 09 15:33:25 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d3c23c1e-0fc5-4528-81f0-f4d553d2d759 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] [instance: 4ccbfda2-8bcd-4ec1-972a-cf49a62b1583] calling os-brick to detach iSCSI Volume {{(pid=72382) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 15:33:25 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3c23c1e-0fc5-4528-81f0-f4d553d2d759 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2a0c768340>, {'target_iqns': ['iqn.2010-10.org.openstack:b5cfefdb-a454-494f-ab09-acf8644352a3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VjpQFgdP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 15:33:25 user nova-compute[72382]: WARNING os_brick.initiator.connectors.base [None req-d3c23c1e-0fc5-4528-81f0-f4d553d2d759 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 15:33:25 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-d3c23c1e-0fc5-4528-81f0-f4d553d2d759 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 15:33:25 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-d3c23c1e-0fc5-4528-81f0-f4d553d2d759 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 15:33:25 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3c23c1e-0fc5-4528-81f0-f4d553d2d759 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b5cfefdb-a454-494f-ab09-acf8644352a3', 0)] {{(pid=72382) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 15:33:25 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:33:25 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:33:25 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[f28e365c-23b5-491c-ac6c-e22076946e88]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:59852df5-d4c8-4f25-8693-36181ff6a447\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:84966571-0ed8-4b55-ae0c-a5e07dfa3152\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9b93bb40-75bb-4387-aa01-c839f97e3432\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b5cfefdb-a454-494f-ab09-acf8644352a3\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:33:25 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:33:25 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:33:25 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[3aedc8c2-4e6f-49da-950e-c68157280feb]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5cfefdb-a454-494f-ab09-acf8644352a3 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59852df5-d4c8-4f25-8693-36181ff6a447 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84966571-0ed8-4b55-ae0c-a5e07dfa3152 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b93bb40-75bb-4387-aa01-c839f97e3432 (non-flash)\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:33:25 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3c23c1e-0fc5-4528-81f0-f4d553d2d759 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)
Aug 09 15:33:25 user nova-compute[72382]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5cfefdb-a454-494f-ab09-acf8644352a3 (non-flash)
Aug 09 15:33:25 user nova-compute[72382]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59852df5-d4c8-4f25-8693-36181ff6a447 (non-flash)
Aug 09 15:33:25 user nova-compute[72382]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84966571-0ed8-4b55-ae0c-a5e07dfa3152 (non-flash)
Aug 09 15:33:25 user nova-compute[72382]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b93bb40-75bb-4387-aa01-c839f97e3432 (non-flash)
Aug 09 15:33:25 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 15:33:25 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3c23c1e-0fc5-4528-81f0-f4d553d2d759 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)
Aug 09 15:33:25 user nova-compute[72382]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5cfefdb-a454-494f-ab09-acf8644352a3 (non-flash)
Aug 09 15:33:25 user nova-compute[72382]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59852df5-d4c8-4f25-8693-36181ff6a447 (non-flash)
Aug 09 15:33:25 user nova-compute[72382]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84966571-0ed8-4b55-ae0c-a5e07dfa3152 (non-flash)
Aug 09 15:33:25 user nova-compute[72382]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b93bb40-75bb-4387-aa01-c839f97e3432 (non-flash)
Aug 09 15:33:25 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 15:33:25 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3c23c1e-0fc5-4528-81f0-f4d553d2d759 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2a3289c310>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b5cfefdb-a454-494f-ab09-acf8644352a3'): ({'sdb'}, set())}) {{(pid=72382) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 15:33:25 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-d3c23c1e-0fc5-4528-81f0-f4d553d2d759 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Removing single pathed devices sdb {{(pid=72382) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 15:33:25 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:33:25 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:33:25 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b374391-65dd-49e1-a7a3-ae32774f3490]: (4, ('path checker states:\nup                  4\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:33:25 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:33:25 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:33:25 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[96a5f200-2b5a-4eb7-8ca4-fba5012bdf57]: (4, ('ok\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:33:25 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-d3c23c1e-0fc5-4528-81f0-f4d553d2d759 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Flushing IO for device /dev/sdb {{(pid=72382) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 15:33:25 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:33:25 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:33:25 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdddde8d-df11-4cbe-81d5-c09b53a6378e]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:33:25 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-d3c23c1e-0fc5-4528-81f0-f4d553d2d759 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72382) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 15:33:25 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:33:26 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:33:26 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[431987d0-beca-4167-8b78-fd1ed6b42336]: (4, ('1', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:33:26 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-d3c23c1e-0fc5-4528-81f0-f4d553d2d759 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72382) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 15:33:26 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-d3c23c1e-0fc5-4528-81f0-f4d553d2d759 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] SCSI volumes sdb have been removed. {{(pid=72382) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 15:33:26 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3c23c1e-0fc5-4528-81f0-f4d553d2d759 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b5cfefdb-a454-494f-ab09-acf8644352a3')] {{(pid=72382) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 15:33:26 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5cfefdb-a454-494f-ab09-acf8644352a3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:33:26 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5cfefdb-a454-494f-ab09-acf8644352a3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:33:26 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a3b0754-f806-4c3f-a232-7c9e33fe5f40]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:33:26 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3c23c1e-0fc5-4528-81f0-f4d553d2d759 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:33:26 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5cfefdb-a454-494f-ab09-acf8644352a3 -p 172.16.0.220:3260 --logout {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:33:26 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5cfefdb-a454-494f-ab09-acf8644352a3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:33:26 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[47e61d4a-5f6d-4377-8057-b2e6f9c17760]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:b5cfefdb-a454-494f-ab09-acf8644352a3, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:b5cfefdb-a454-494f-ab09-acf8644352a3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:33:26 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3c23c1e-0fc5-4528-81f0-f4d553d2d759 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:b5cfefdb-a454-494f-ab09-acf8644352a3, portal: 172.16.0.220,3260]
Aug 09 15:33:26 user nova-compute[72382]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:b5cfefdb-a454-494f-ab09-acf8644352a3, portal: 172.16.0.220,3260] successful.
Aug 09 15:33:26 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:33:26 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5cfefdb-a454-494f-ab09-acf8644352a3 -p 172.16.0.220:3260 --op delete {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:33:26 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5cfefdb-a454-494f-ab09-acf8644352a3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:33:26 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[55ce86c6-c44e-4c22-a1d3-4902d6475ceb]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:33:26 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3c23c1e-0fc5-4528-81f0-f4d553d2d759 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:33:26 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-d3c23c1e-0fc5-4528-81f0-f4d553d2d759 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.323s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 15:33:26 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3c23c1e-0fc5-4528-81f0-f4d553d2d759 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] <== disconnect_volume: return (324ms) None {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 15:33:26 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d3c23c1e-0fc5-4528-81f0-f4d553d2d759 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] [instance: 4ccbfda2-8bcd-4ec1-972a-cf49a62b1583] Disconnected iSCSI Volume {{(pid=72382) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 15:33:26 user nova-compute[72382]: DEBUG nova.compute.manager [req-acd5ae95-adde-4693-b418-434278be7300 req-b01de867-412d-4ec7-90c9-d41dad845c45 service nova] [instance: d7c34b80-c2e9-43c1-8b8e-7c62eb8e73f4] Received event network-vif-plugged-a0b8be03-4b4b-444f-ab4d-b7a78d18f799 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:33:26 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-acd5ae95-adde-4693-b418-434278be7300 req-b01de867-412d-4ec7-90c9-d41dad845c45 service nova] Acquiring lock "d7c34b80-c2e9-43c1-8b8e-7c62eb8e73f4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:33:26 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-acd5ae95-adde-4693-b418-434278be7300 req-b01de867-412d-4ec7-90c9-d41dad845c45 service nova] Lock "d7c34b80-c2e9-43c1-8b8e-7c62eb8e73f4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:33:26 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-acd5ae95-adde-4693-b418-434278be7300 req-b01de867-412d-4ec7-90c9-d41dad845c45 service nova] Lock "d7c34b80-c2e9-43c1-8b8e-7c62eb8e73f4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:33:26 user nova-compute[72382]: DEBUG nova.compute.manager [req-acd5ae95-adde-4693-b418-434278be7300 req-b01de867-412d-4ec7-90c9-d41dad845c45 service nova] [instance: d7c34b80-c2e9-43c1-8b8e-7c62eb8e73f4] No waiting events found dispatching network-vif-plugged-a0b8be03-4b4b-444f-ab4d-b7a78d18f799 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:33:26 user nova-compute[72382]: WARNING nova.compute.manager [req-acd5ae95-adde-4693-b418-434278be7300 req-b01de867-412d-4ec7-90c9-d41dad845c45 service nova] [instance: d7c34b80-c2e9-43c1-8b8e-7c62eb8e73f4] Received unexpected event network-vif-plugged-a0b8be03-4b4b-444f-ab4d-b7a78d18f799 for instance with vm_state active and task_state deleting.
Aug 09 15:33:26 user nova-compute[72382]: DEBUG nova.network.neutron [-] [instance: d7c34b80-c2e9-43c1-8b8e-7c62eb8e73f4] Updating instance_info_cache with network_info: [] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:33:26 user nova-compute[72382]: DEBUG nova.objects.instance [None req-d3c23c1e-0fc5-4528-81f0-f4d553d2d759 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Lazy-loading 'flavor' on Instance uuid 4ccbfda2-8bcd-4ec1-972a-cf49a62b1583 {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:33:27 user nova-compute[72382]: INFO nova.compute.manager [-] [instance: d7c34b80-c2e9-43c1-8b8e-7c62eb8e73f4] Took 1.61 seconds to deallocate network for instance.
Aug 09 15:33:27 user nova-compute[72382]: DEBUG nova.compute.manager [req-dafc9fa0-4f8f-403e-bbc2-f310db296f7c req-5a5f3473-d34d-490f-bd4d-edb1b02e4d6d service nova] [instance: d7c34b80-c2e9-43c1-8b8e-7c62eb8e73f4] Received event network-vif-deleted-a0b8be03-4b4b-444f-ab4d-b7a78d18f799 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:33:27 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-d3c23c1e-0fc5-4528-81f0-f4d553d2d759 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Lock "4ccbfda2-8bcd-4ec1-972a-cf49a62b1583" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.853s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:33:27 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-8ea2ce17-24fd-45e3-9ac2-829c5c5816fc tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:33:27 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-8ea2ce17-24fd-45e3-9ac2-829c5c5816fc tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:33:27 user nova-compute[72382]: DEBUG nova.compute.provider_tree [None req-8ea2ce17-24fd-45e3-9ac2-829c5c5816fc tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Inventory has not changed in ProviderTree for provider: 7b15b0e5-df4d-49db-833b-2855d21d10ae {{(pid=72382) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 15:33:27 user nova-compute[72382]: DEBUG nova.scheduler.client.report [None req-8ea2ce17-24fd-45e3-9ac2-829c5c5816fc tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Inventory has not changed for provider 7b15b0e5-df4d-49db-833b-2855d21d10ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72382) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 15:33:27 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-8ea2ce17-24fd-45e3-9ac2-829c5c5816fc tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.314s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:33:27 user nova-compute[72382]: INFO nova.scheduler.client.report [None req-8ea2ce17-24fd-45e3-9ac2-829c5c5816fc tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Deleted allocations for instance d7c34b80-c2e9-43c1-8b8e-7c62eb8e73f4
Aug 09 15:33:27 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-8ea2ce17-24fd-45e3-9ac2-829c5c5816fc tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Lock "d7c34b80-c2e9-43c1-8b8e-7c62eb8e73f4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.318s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:33:29 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:33:29 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:33:30 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:33:31 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-4e0050a5-ad1c-4a08-af2d-903e3e888871 tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] Acquiring lock "8f744a7d-9eed-40e1-9422-670970c209ce" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:33:31 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-4e0050a5-ad1c-4a08-af2d-903e3e888871 tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] Lock "8f744a7d-9eed-40e1-9422-670970c209ce" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:33:31 user nova-compute[72382]: INFO nova.compute.manager [None req-4e0050a5-ad1c-4a08-af2d-903e3e888871 tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] [instance: 8f744a7d-9eed-40e1-9422-670970c209ce] Detaching volume 84966571-0ed8-4b55-ae0c-a5e07dfa3152
Aug 09 15:33:31 user nova-compute[72382]: INFO nova.virt.block_device [None req-4e0050a5-ad1c-4a08-af2d-903e3e888871 tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] [instance: 8f744a7d-9eed-40e1-9422-670970c209ce] Attempting to driver detach volume 84966571-0ed8-4b55-ae0c-a5e07dfa3152 from mountpoint /dev/vdb
Aug 09 15:33:31 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-4e0050a5-ad1c-4a08-af2d-903e3e888871 tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] Attempting to detach device vdb from instance 8f744a7d-9eed-40e1-9422-670970c209ce from the persistent domain config. {{(pid=72382) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 15:33:31 user nova-compute[72382]: DEBUG nova.virt.libvirt.guest [None req-4e0050a5-ad1c-4a08-af2d-903e3e888871 tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 15:33:31 user nova-compute[72382]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 15:33:31 user nova-compute[72382]:   <source dev="/dev/sde"/>
Aug 09 15:33:31 user nova-compute[72382]:   <target dev="vdb" bus="virtio"/>
Aug 09 15:33:31 user nova-compute[72382]:   <serial>84966571-0ed8-4b55-ae0c-a5e07dfa3152</serial>
Aug 09 15:33:31 user nova-compute[72382]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 15:33:31 user nova-compute[72382]: </disk>
Aug 09 15:33:31 user nova-compute[72382]:  {{(pid=72382) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 15:33:31 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-4e0050a5-ad1c-4a08-af2d-903e3e888871 tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] Successfully detached device vdb from instance 8f744a7d-9eed-40e1-9422-670970c209ce from the persistent domain config.
Aug 09 15:33:31 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-4e0050a5-ad1c-4a08-af2d-903e3e888871 tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 8f744a7d-9eed-40e1-9422-670970c209ce from the live domain config. {{(pid=72382) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 15:33:31 user nova-compute[72382]: DEBUG nova.virt.libvirt.guest [None req-4e0050a5-ad1c-4a08-af2d-903e3e888871 tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 15:33:31 user nova-compute[72382]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 15:33:31 user nova-compute[72382]:   <source dev="/dev/sde"/>
Aug 09 15:33:31 user nova-compute[72382]:   <target dev="vdb" bus="virtio"/>
Aug 09 15:33:31 user nova-compute[72382]:   <serial>84966571-0ed8-4b55-ae0c-a5e07dfa3152</serial>
Aug 09 15:33:31 user nova-compute[72382]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 15:33:31 user nova-compute[72382]: </disk>
Aug 09 15:33:31 user nova-compute[72382]:  {{(pid=72382) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 15:33:31 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-7ff52ed3-98c8-467c-904c-70e6a1a6d710 tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] Acquiring lock "8f744a7d-9eed-40e1-9422-670970c209ce" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:33:32 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Received event <DeviceRemovedEvent: 1691595212.1517174, 8f744a7d-9eed-40e1-9422-670970c209ce => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72382) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 15:33:32 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-4e0050a5-ad1c-4a08-af2d-903e3e888871 tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 8f744a7d-9eed-40e1-9422-670970c209ce {{(pid=72382) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 15:33:32 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-4e0050a5-ad1c-4a08-af2d-903e3e888871 tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] Successfully detached device vdb from instance 8f744a7d-9eed-40e1-9422-670970c209ce from the live domain config.
Aug 09 15:33:32 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4e0050a5-ad1c-4a08-af2d-903e3e888871 tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] [instance: 8f744a7d-9eed-40e1-9422-670970c209ce] calling os-brick to detach iSCSI Volume {{(pid=72382) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 15:33:32 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e0050a5-ad1c-4a08-af2d-903e3e888871 tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2a0c768340>, {'target_iqns': ['iqn.2010-10.org.openstack:84966571-0ed8-4b55-ae0c-a5e07dfa3152'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DUGyZifM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 15:33:32 user nova-compute[72382]: WARNING os_brick.initiator.connectors.base [None req-4e0050a5-ad1c-4a08-af2d-903e3e888871 tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 15:33:32 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-4e0050a5-ad1c-4a08-af2d-903e3e888871 tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 15:33:32 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-4e0050a5-ad1c-4a08-af2d-903e3e888871 tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 15:33:32 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e0050a5-ad1c-4a08-af2d-903e3e888871 tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:84966571-0ed8-4b55-ae0c-a5e07dfa3152', 0)] {{(pid=72382) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 15:33:32 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:33:32 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:33:32 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[8241a39a-1b7c-4d1f-9355-91eccbd2624d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:59852df5-d4c8-4f25-8693-36181ff6a447\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:84966571-0ed8-4b55-ae0c-a5e07dfa3152\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9b93bb40-75bb-4387-aa01-c839f97e3432\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:33:32 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:33:32 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:33:32 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9a69e9f-3268-4218-a8b5-a080e7f73354]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59852df5-d4c8-4f25-8693-36181ff6a447 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84966571-0ed8-4b55-ae0c-a5e07dfa3152 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b93bb40-75bb-4387-aa01-c839f97e3432 (non-flash)\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:33:32 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e0050a5-ad1c-4a08-af2d-903e3e888871 tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)
Aug 09 15:33:32 user nova-compute[72382]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59852df5-d4c8-4f25-8693-36181ff6a447 (non-flash)
Aug 09 15:33:32 user nova-compute[72382]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84966571-0ed8-4b55-ae0c-a5e07dfa3152 (non-flash)
Aug 09 15:33:32 user nova-compute[72382]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b93bb40-75bb-4387-aa01-c839f97e3432 (non-flash)
Aug 09 15:33:32 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 15:33:32 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e0050a5-ad1c-4a08-af2d-903e3e888871 tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)
Aug 09 15:33:32 user nova-compute[72382]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59852df5-d4c8-4f25-8693-36181ff6a447 (non-flash)
Aug 09 15:33:32 user nova-compute[72382]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84966571-0ed8-4b55-ae0c-a5e07dfa3152 (non-flash)
Aug 09 15:33:32 user nova-compute[72382]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b93bb40-75bb-4387-aa01-c839f97e3432 (non-flash)
Aug 09 15:33:32 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 15:33:32 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e0050a5-ad1c-4a08-af2d-903e3e888871 tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2a0c3d5510>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:84966571-0ed8-4b55-ae0c-a5e07dfa3152'): ({'sde'}, set())}) {{(pid=72382) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 15:33:32 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-4e0050a5-ad1c-4a08-af2d-903e3e888871 tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] Removing single pathed devices sde {{(pid=72382) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 15:33:32 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:33:32 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:33:32 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0b76365-990a-4a28-bd34-10cebb2ea1b6]: (4, ('path checker states:\nup                  3\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:33:32 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:33:32 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.022s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:33:32 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[f30b4b3c-0f82-4a59-a6e1-2e08bea9f621]: (4, ('ok\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:33:32 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-4e0050a5-ad1c-4a08-af2d-903e3e888871 tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] Flushing IO for device /dev/sde {{(pid=72382) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 15:33:32 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:33:32 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:33:32 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[2626035f-280a-4146-ae6a-842456b4ee87]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:33:32 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-4e0050a5-ad1c-4a08-af2d-903e3e888871 tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72382) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 15:33:32 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:33:32 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.045s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:33:32 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[f378f71d-a889-49d5-a4d1-86a9c21b704c]: (4, ('1', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:33:32 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-4e0050a5-ad1c-4a08-af2d-903e3e888871 tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72382) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 15:33:32 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-4e0050a5-ad1c-4a08-af2d-903e3e888871 tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] SCSI volumes sde have been removed. {{(pid=72382) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 15:33:32 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e0050a5-ad1c-4a08-af2d-903e3e888871 tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:84966571-0ed8-4b55-ae0c-a5e07dfa3152')] {{(pid=72382) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 15:33:32 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84966571-0ed8-4b55-ae0c-a5e07dfa3152 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:33:32 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84966571-0ed8-4b55-ae0c-a5e07dfa3152 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:33:32 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a8db4a4-c7dd-4d0f-86fe-b325350bdbf1]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:33:32 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e0050a5-ad1c-4a08-af2d-903e3e888871 tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:33:32 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84966571-0ed8-4b55-ae0c-a5e07dfa3152 -p 172.16.0.220:3260 --logout {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:33:32 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84966571-0ed8-4b55-ae0c-a5e07dfa3152 -p 172.16.0.220:3260 --logout" returned: 0 in 0.085s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:33:32 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[5271abe6-09bf-4705-90c4-fbd31cd836b4]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:84966571-0ed8-4b55-ae0c-a5e07dfa3152, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:84966571-0ed8-4b55-ae0c-a5e07dfa3152, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:33:32 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e0050a5-ad1c-4a08-af2d-903e3e888871 tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:84966571-0ed8-4b55-ae0c-a5e07dfa3152, portal: 172.16.0.220,3260]
Aug 09 15:33:32 user nova-compute[72382]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:84966571-0ed8-4b55-ae0c-a5e07dfa3152, portal: 172.16.0.220,3260] successful.
Aug 09 15:33:32 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:33:32 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84966571-0ed8-4b55-ae0c-a5e07dfa3152 -p 172.16.0.220:3260 --op delete {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:33:32 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84966571-0ed8-4b55-ae0c-a5e07dfa3152 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:33:32 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[cccd2921-e4a9-4f20-9a56-cc11302f6d9b]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:33:32 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e0050a5-ad1c-4a08-af2d-903e3e888871 tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:33:32 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-4e0050a5-ad1c-4a08-af2d-903e3e888871 tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.320s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 15:33:32 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e0050a5-ad1c-4a08-af2d-903e3e888871 tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] <== disconnect_volume: return (321ms) None {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 15:33:32 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4e0050a5-ad1c-4a08-af2d-903e3e888871 tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] [instance: 8f744a7d-9eed-40e1-9422-670970c209ce] Disconnected iSCSI Volume {{(pid=72382) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 15:33:33 user nova-compute[72382]: DEBUG nova.objects.instance [None req-4e0050a5-ad1c-4a08-af2d-903e3e888871 tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] Lazy-loading 'flavor' on Instance uuid 8f744a7d-9eed-40e1-9422-670970c209ce {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:33:33 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-4e0050a5-ad1c-4a08-af2d-903e3e888871 tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] Lock "8f744a7d-9eed-40e1-9422-670970c209ce" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.781s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:33:33 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-7ff52ed3-98c8-467c-904c-70e6a1a6d710 tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] Lock "8f744a7d-9eed-40e1-9422-670970c209ce" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 1.558s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:33:33 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-7ff52ed3-98c8-467c-904c-70e6a1a6d710 tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] Acquiring lock "8f744a7d-9eed-40e1-9422-670970c209ce-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:33:33 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-7ff52ed3-98c8-467c-904c-70e6a1a6d710 tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] Lock "8f744a7d-9eed-40e1-9422-670970c209ce-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:33:33 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-7ff52ed3-98c8-467c-904c-70e6a1a6d710 tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] Lock "8f744a7d-9eed-40e1-9422-670970c209ce-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:33:33 user nova-compute[72382]: INFO nova.compute.manager [None req-7ff52ed3-98c8-467c-904c-70e6a1a6d710 tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] [instance: 8f744a7d-9eed-40e1-9422-670970c209ce] Terminating instance
Aug 09 15:33:33 user nova-compute[72382]: DEBUG nova.compute.manager [None req-7ff52ed3-98c8-467c-904c-70e6a1a6d710 tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] [instance: 8f744a7d-9eed-40e1-9422-670970c209ce] Start destroying the instance on the hypervisor. {{(pid=72382) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 15:33:33 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:33:33 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:33:33 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:33:33 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:33:33 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:33:33 user nova-compute[72382]: DEBUG nova.compute.manager [req-312f90ee-73f5-4041-8cb6-0b1295f2441c req-614f5c8e-3ed8-4e0b-b43c-5e7e89eea0a1 service nova] [instance: 8f744a7d-9eed-40e1-9422-670970c209ce] Received event network-vif-unplugged-d16436a7-9589-443b-be99-e54349a50e25 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:33:33 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-312f90ee-73f5-4041-8cb6-0b1295f2441c req-614f5c8e-3ed8-4e0b-b43c-5e7e89eea0a1 service nova] Acquiring lock "8f744a7d-9eed-40e1-9422-670970c209ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:33:33 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-312f90ee-73f5-4041-8cb6-0b1295f2441c req-614f5c8e-3ed8-4e0b-b43c-5e7e89eea0a1 service nova] Lock "8f744a7d-9eed-40e1-9422-670970c209ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:33:33 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-312f90ee-73f5-4041-8cb6-0b1295f2441c req-614f5c8e-3ed8-4e0b-b43c-5e7e89eea0a1 service nova] Lock "8f744a7d-9eed-40e1-9422-670970c209ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:33:33 user nova-compute[72382]: DEBUG nova.compute.manager [req-312f90ee-73f5-4041-8cb6-0b1295f2441c req-614f5c8e-3ed8-4e0b-b43c-5e7e89eea0a1 service nova] [instance: 8f744a7d-9eed-40e1-9422-670970c209ce] No waiting events found dispatching network-vif-unplugged-d16436a7-9589-443b-be99-e54349a50e25 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:33:33 user nova-compute[72382]: DEBUG nova.compute.manager [req-312f90ee-73f5-4041-8cb6-0b1295f2441c req-614f5c8e-3ed8-4e0b-b43c-5e7e89eea0a1 service nova] [instance: 8f744a7d-9eed-40e1-9422-670970c209ce] Received event network-vif-unplugged-d16436a7-9589-443b-be99-e54349a50e25 for instance with task_state deleting. {{(pid=72382) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 15:33:34 user nova-compute[72382]: INFO nova.virt.libvirt.driver [-] [instance: 8f744a7d-9eed-40e1-9422-670970c209ce] Instance destroyed successfully.
Aug 09 15:33:34 user nova-compute[72382]: DEBUG nova.objects.instance [None req-7ff52ed3-98c8-467c-904c-70e6a1a6d710 tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] Lazy-loading 'resources' on Instance uuid 8f744a7d-9eed-40e1-9422-670970c209ce {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:33:34 user nova-compute[72382]: DEBUG nova.virt.libvirt.vif [None req-7ff52ed3-98c8-467c-904c-70e6a1a6d710 tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T15:30:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1655341398',display_name='tempest-VolumesSnapshotTestJSON-instance-1655341398',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1655341398',id=34,image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCx3FVtbsUX6VoJeSGntdLRg8iTXCOkOWfQ4VtB6Jg47p7YN/YqgfESqGNRCUR+ihiyAScbyBAWinxQ5X4NrK/6rPoWezJxHK2M/LLOuirATIm5AXGMrQ5gpVYExq/BUUg==',key_name='tempest-keypair-1331055543',keypairs=<?>,launch_index=0,launched_at=2023-08-09T15:31:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9949fc5e9167457d8c7a455350936255',ramdisk_id='',reservation_id='r-jp0ercp7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-985960330',owner_user_name='tempest-VolumesSnapshotTestJSON-985960330-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T15:31:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='04ecf94b76144c64b2ca5ecc7932dd32',uuid=8f744a7d-9eed-40e1-9422-670970c209ce,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d16436a7-9589-443b-be99-e54349a50e25", "address": "fa:16:3e:fe:d6:7a", "network": {"id": "1b9920a2-9613-4741-a0c0-72172380b365", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-455407214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9949fc5e9167457d8c7a455350936255", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd16436a7-95", "ovs_interfaceid": "d16436a7-9589-443b-be99-e54349a50e25", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 15:33:34 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-7ff52ed3-98c8-467c-904c-70e6a1a6d710 tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] Converting VIF {"id": "d16436a7-9589-443b-be99-e54349a50e25", "address": "fa:16:3e:fe:d6:7a", "network": {"id": "1b9920a2-9613-4741-a0c0-72172380b365", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-455407214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9949fc5e9167457d8c7a455350936255", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd16436a7-95", "ovs_interfaceid": "d16436a7-9589-443b-be99-e54349a50e25", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 15:33:34 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-7ff52ed3-98c8-467c-904c-70e6a1a6d710 tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fe:d6:7a,bridge_name='br-int',has_traffic_filtering=True,id=d16436a7-9589-443b-be99-e54349a50e25,network=Network(1b9920a2-9613-4741-a0c0-72172380b365),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd16436a7-95') {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 15:33:34 user nova-compute[72382]: DEBUG os_vif [None req-7ff52ed3-98c8-467c-904c-70e6a1a6d710 tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fe:d6:7a,bridge_name='br-int',has_traffic_filtering=True,id=d16436a7-9589-443b-be99-e54349a50e25,network=Network(1b9920a2-9613-4741-a0c0-72172380b365),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd16436a7-95') {{(pid=72382) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 15:33:34 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:33:34 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd16436a7-95, bridge=br-int, if_exists=True) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:33:34 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:33:34 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:33:34 user nova-compute[72382]: INFO os_vif [None req-7ff52ed3-98c8-467c-904c-70e6a1a6d710 tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fe:d6:7a,bridge_name='br-int',has_traffic_filtering=True,id=d16436a7-9589-443b-be99-e54349a50e25,network=Network(1b9920a2-9613-4741-a0c0-72172380b365),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd16436a7-95')
Aug 09 15:33:34 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7ff52ed3-98c8-467c-904c-70e6a1a6d710 tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] [instance: 8f744a7d-9eed-40e1-9422-670970c209ce] calling os-brick to detach iSCSI Volume {{(pid=72382) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 15:33:34 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ff52ed3-98c8-467c-904c-70e6a1a6d710 tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2a0c768340>, {'target_iqns': ['iqn.2010-10.org.openstack:84966571-0ed8-4b55-ae0c-a5e07dfa3152'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DUGyZifM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 15:33:34 user nova-compute[72382]: WARNING os_brick.initiator.connectors.base [None req-7ff52ed3-98c8-467c-904c-70e6a1a6d710 tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 15:33:34 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-7ff52ed3-98c8-467c-904c-70e6a1a6d710 tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 15:33:34 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-7ff52ed3-98c8-467c-904c-70e6a1a6d710 tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.007s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 15:33:34 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ff52ed3-98c8-467c-904c-70e6a1a6d710 tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:84966571-0ed8-4b55-ae0c-a5e07dfa3152', 0)] {{(pid=72382) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 15:33:34 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:33:34 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:33:34 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[0620eea5-072c-4d55-b9f0-30ec6954db0f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:59852df5-d4c8-4f25-8693-36181ff6a447\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9b93bb40-75bb-4387-aa01-c839f97e3432\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:33:34 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:33:34 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:33:34 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bf904d5-dac4-48a6-9c1a-8dc55042f854]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59852df5-d4c8-4f25-8693-36181ff6a447 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b93bb40-75bb-4387-aa01-c839f97e3432 (non-flash)\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:33:34 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ff52ed3-98c8-467c-904c-70e6a1a6d710 tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)
Aug 09 15:33:34 user nova-compute[72382]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59852df5-d4c8-4f25-8693-36181ff6a447 (non-flash)
Aug 09 15:33:34 user nova-compute[72382]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b93bb40-75bb-4387-aa01-c839f97e3432 (non-flash)
Aug 09 15:33:34 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 15:33:34 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ff52ed3-98c8-467c-904c-70e6a1a6d710 tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)
Aug 09 15:33:34 user nova-compute[72382]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59852df5-d4c8-4f25-8693-36181ff6a447 (non-flash)
Aug 09 15:33:34 user nova-compute[72382]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b93bb40-75bb-4387-aa01-c839f97e3432 (non-flash)
Aug 09 15:33:34 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 15:33:34 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ff52ed3-98c8-467c-904c-70e6a1a6d710 tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2a0c3d5510>, {}) {{(pid=72382) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 15:33:34 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ff52ed3-98c8-467c-904c-70e6a1a6d710 tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] Disconnecting from: [] {{(pid=72382) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 15:33:34 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-7ff52ed3-98c8-467c-904c-70e6a1a6d710 tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.053s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 15:33:34 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ff52ed3-98c8-467c-904c-70e6a1a6d710 tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] <== disconnect_volume: return (60ms) None {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 15:33:34 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7ff52ed3-98c8-467c-904c-70e6a1a6d710 tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] [instance: 8f744a7d-9eed-40e1-9422-670970c209ce] Disconnected iSCSI Volume {{(pid=72382) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 15:33:34 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-7ff52ed3-98c8-467c-904c-70e6a1a6d710 tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] [instance: 8f744a7d-9eed-40e1-9422-670970c209ce] Deleting instance files /opt/stack/data/nova/instances/8f744a7d-9eed-40e1-9422-670970c209ce_del
Aug 09 15:33:34 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-7ff52ed3-98c8-467c-904c-70e6a1a6d710 tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] [instance: 8f744a7d-9eed-40e1-9422-670970c209ce] Deletion of /opt/stack/data/nova/instances/8f744a7d-9eed-40e1-9422-670970c209ce_del complete
Aug 09 15:33:34 user nova-compute[72382]: INFO nova.compute.manager [None req-7ff52ed3-98c8-467c-904c-70e6a1a6d710 tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] [instance: 8f744a7d-9eed-40e1-9422-670970c209ce] Took 0.90 seconds to destroy the instance on the hypervisor.
Aug 09 15:33:34 user nova-compute[72382]: DEBUG oslo.service.loopingcall [None req-7ff52ed3-98c8-467c-904c-70e6a1a6d710 tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72382) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 15:33:34 user nova-compute[72382]: DEBUG nova.compute.manager [-] [instance: 8f744a7d-9eed-40e1-9422-670970c209ce] Deallocating network for instance {{(pid=72382) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 15:33:34 user nova-compute[72382]: DEBUG nova.network.neutron [-] [instance: 8f744a7d-9eed-40e1-9422-670970c209ce] deallocate_for_instance() {{(pid=72382) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 15:33:34 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:33:35 user nova-compute[72382]: DEBUG nova.network.neutron [-] [instance: 8f744a7d-9eed-40e1-9422-670970c209ce] Updating instance_info_cache with network_info: [] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:33:35 user nova-compute[72382]: INFO nova.compute.manager [-] [instance: 8f744a7d-9eed-40e1-9422-670970c209ce] Took 0.86 seconds to deallocate network for instance.
Aug 09 15:33:35 user nova-compute[72382]: DEBUG nova.compute.manager [req-d08017ce-f82a-4019-ad40-6211af182b0f req-ea0c69b3-7993-44e1-86de-661b6aa13e3d service nova] [instance: 8f744a7d-9eed-40e1-9422-670970c209ce] Received event network-vif-deleted-d16436a7-9589-443b-be99-e54349a50e25 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:33:35 user nova-compute[72382]: WARNING nova.volume.cinder [None req-7ff52ed3-98c8-467c-904c-70e6a1a6d710 tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] Attachment 5b0699a0-a403-4016-b35d-e9487dbf17a2 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 5b0699a0-a403-4016-b35d-e9487dbf17a2. (HTTP 404) (Request-ID: req-2fc53d0b-7287-419b-88d6-344cb2e83d5b)
Aug 09 15:33:35 user nova-compute[72382]: INFO nova.compute.manager [None req-7ff52ed3-98c8-467c-904c-70e6a1a6d710 tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] [instance: 8f744a7d-9eed-40e1-9422-670970c209ce] Took 0.02 seconds to detach 1 volumes for instance.
Aug 09 15:33:35 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-7ff52ed3-98c8-467c-904c-70e6a1a6d710 tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:33:35 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-7ff52ed3-98c8-467c-904c-70e6a1a6d710 tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:33:35 user nova-compute[72382]: DEBUG nova.compute.provider_tree [None req-7ff52ed3-98c8-467c-904c-70e6a1a6d710 tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] Inventory has not changed in ProviderTree for provider: 7b15b0e5-df4d-49db-833b-2855d21d10ae {{(pid=72382) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 15:33:35 user nova-compute[72382]: DEBUG nova.scheduler.client.report [None req-7ff52ed3-98c8-467c-904c-70e6a1a6d710 tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] Inventory has not changed for provider 7b15b0e5-df4d-49db-833b-2855d21d10ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72382) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 15:33:35 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-7ff52ed3-98c8-467c-904c-70e6a1a6d710 tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.292s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:33:35 user nova-compute[72382]: INFO nova.scheduler.client.report [None req-7ff52ed3-98c8-467c-904c-70e6a1a6d710 tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] Deleted allocations for instance 8f744a7d-9eed-40e1-9422-670970c209ce
Aug 09 15:33:35 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-7ff52ed3-98c8-467c-904c-70e6a1a6d710 tempest-VolumesSnapshotTestJSON-985960330 tempest-VolumesSnapshotTestJSON-985960330-project-member] Lock "8f744a7d-9eed-40e1-9422-670970c209ce" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.247s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:33:35 user nova-compute[72382]: DEBUG nova.compute.manager [req-a080a822-8f27-4195-9283-d6c85eac6fd8 req-31e3ce71-42ec-4bf3-b64f-cf5c75b5e065 service nova] [instance: 8f744a7d-9eed-40e1-9422-670970c209ce] Received event network-vif-plugged-d16436a7-9589-443b-be99-e54349a50e25 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:33:35 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-a080a822-8f27-4195-9283-d6c85eac6fd8 req-31e3ce71-42ec-4bf3-b64f-cf5c75b5e065 service nova] Acquiring lock "8f744a7d-9eed-40e1-9422-670970c209ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:33:35 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-a080a822-8f27-4195-9283-d6c85eac6fd8 req-31e3ce71-42ec-4bf3-b64f-cf5c75b5e065 service nova] Lock "8f744a7d-9eed-40e1-9422-670970c209ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:33:35 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-a080a822-8f27-4195-9283-d6c85eac6fd8 req-31e3ce71-42ec-4bf3-b64f-cf5c75b5e065 service nova] Lock "8f744a7d-9eed-40e1-9422-670970c209ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:33:35 user nova-compute[72382]: DEBUG nova.compute.manager [req-a080a822-8f27-4195-9283-d6c85eac6fd8 req-31e3ce71-42ec-4bf3-b64f-cf5c75b5e065 service nova] [instance: 8f744a7d-9eed-40e1-9422-670970c209ce] No waiting events found dispatching network-vif-plugged-d16436a7-9589-443b-be99-e54349a50e25 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:33:35 user nova-compute[72382]: WARNING nova.compute.manager [req-a080a822-8f27-4195-9283-d6c85eac6fd8 req-31e3ce71-42ec-4bf3-b64f-cf5c75b5e065 service nova] [instance: 8f744a7d-9eed-40e1-9422-670970c209ce] Received unexpected event network-vif-plugged-d16436a7-9589-443b-be99-e54349a50e25 for instance with vm_state deleted and task_state None.
Aug 09 15:33:39 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:33:39 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:33:40 user nova-compute[72382]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691595205.25261, d7c34b80-c2e9-43c1-8b8e-7c62eb8e73f4 => Stopped> {{(pid=72382) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 15:33:40 user nova-compute[72382]: INFO nova.compute.manager [-] [instance: d7c34b80-c2e9-43c1-8b8e-7c62eb8e73f4] VM Stopped (Lifecycle Event)
Aug 09 15:33:40 user nova-compute[72382]: DEBUG nova.compute.manager [None req-40c72d16-655f-40fb-a5c5-e1e8ae2ac40e None None] [instance: d7c34b80-c2e9-43c1-8b8e-7c62eb8e73f4] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:33:44 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:33:44 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:33:49 user nova-compute[72382]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691595214.013339, 8f744a7d-9eed-40e1-9422-670970c209ce => Stopped> {{(pid=72382) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 15:33:49 user nova-compute[72382]: INFO nova.compute.manager [-] [instance: 8f744a7d-9eed-40e1-9422-670970c209ce] VM Stopped (Lifecycle Event)
Aug 09 15:33:49 user nova-compute[72382]: DEBUG nova.compute.manager [None req-e47f1dee-96dd-4450-93a2-d84478c9b8e2 None None] [instance: 8f744a7d-9eed-40e1-9422-670970c209ce] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:33:49 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:33:49 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:33:54 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:33:59 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:33:59 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:33:59 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72382) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 15:33:59 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72382) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 15:33:59 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72382) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 15:33:59 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:34:00 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-0bf05c41-05e1-48ae-a737-5a56f2d61300 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Acquiring lock "0f510d75-5d1e-4a5c-b38f-731c299f0f5a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:34:00 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-0bf05c41-05e1-48ae-a737-5a56f2d61300 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Lock "0f510d75-5d1e-4a5c-b38f-731c299f0f5a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:34:00 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-0bf05c41-05e1-48ae-a737-5a56f2d61300 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Acquiring lock "0f510d75-5d1e-4a5c-b38f-731c299f0f5a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:34:00 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-0bf05c41-05e1-48ae-a737-5a56f2d61300 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Lock "0f510d75-5d1e-4a5c-b38f-731c299f0f5a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:34:00 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-0bf05c41-05e1-48ae-a737-5a56f2d61300 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Lock "0f510d75-5d1e-4a5c-b38f-731c299f0f5a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:34:00 user nova-compute[72382]: INFO nova.compute.manager [None req-0bf05c41-05e1-48ae-a737-5a56f2d61300 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] [instance: 0f510d75-5d1e-4a5c-b38f-731c299f0f5a] Terminating instance
Aug 09 15:34:00 user nova-compute[72382]: DEBUG nova.compute.manager [None req-0bf05c41-05e1-48ae-a737-5a56f2d61300 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] [instance: 0f510d75-5d1e-4a5c-b38f-731c299f0f5a] Start destroying the instance on the hypervisor. {{(pid=72382) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 15:34:00 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:34:00 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:34:00 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:34:00 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:34:00 user nova-compute[72382]: DEBUG nova.compute.manager [req-740534b5-e566-4bd4-944f-210da27e8a6e req-be373d86-687d-4ed8-8b61-686154072cce service nova] [instance: 0f510d75-5d1e-4a5c-b38f-731c299f0f5a] Received event network-vif-unplugged-c67a8d45-c4ba-4302-940f-c05799ecc732 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:34:00 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-740534b5-e566-4bd4-944f-210da27e8a6e req-be373d86-687d-4ed8-8b61-686154072cce service nova] Acquiring lock "0f510d75-5d1e-4a5c-b38f-731c299f0f5a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:34:00 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-740534b5-e566-4bd4-944f-210da27e8a6e req-be373d86-687d-4ed8-8b61-686154072cce service nova] Lock "0f510d75-5d1e-4a5c-b38f-731c299f0f5a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:34:00 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-740534b5-e566-4bd4-944f-210da27e8a6e req-be373d86-687d-4ed8-8b61-686154072cce service nova] Lock "0f510d75-5d1e-4a5c-b38f-731c299f0f5a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:34:00 user nova-compute[72382]: DEBUG nova.compute.manager [req-740534b5-e566-4bd4-944f-210da27e8a6e req-be373d86-687d-4ed8-8b61-686154072cce service nova] [instance: 0f510d75-5d1e-4a5c-b38f-731c299f0f5a] No waiting events found dispatching network-vif-unplugged-c67a8d45-c4ba-4302-940f-c05799ecc732 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:34:00 user nova-compute[72382]: DEBUG nova.compute.manager [req-740534b5-e566-4bd4-944f-210da27e8a6e req-be373d86-687d-4ed8-8b61-686154072cce service nova] [instance: 0f510d75-5d1e-4a5c-b38f-731c299f0f5a] Received event network-vif-unplugged-c67a8d45-c4ba-4302-940f-c05799ecc732 for instance with task_state deleting. {{(pid=72382) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 15:34:00 user nova-compute[72382]: INFO nova.virt.libvirt.driver [-] [instance: 0f510d75-5d1e-4a5c-b38f-731c299f0f5a] Instance destroyed successfully.
Aug 09 15:34:00 user nova-compute[72382]: DEBUG nova.objects.instance [None req-0bf05c41-05e1-48ae-a737-5a56f2d61300 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Lazy-loading 'resources' on Instance uuid 0f510d75-5d1e-4a5c-b38f-731c299f0f5a {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:34:00 user nova-compute[72382]: DEBUG nova.virt.libvirt.vif [None req-0bf05c41-05e1-48ae-a737-5a56f2d61300 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T15:18:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1329934953',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1329934953',id=14,image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-09T15:20:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='080d1ded4cd94e5083ee0b7e691b7363',ramdisk_id='',reservation_id='r-r90gykan',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1187177274',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T15:21:56Z,user_data=None,user_id='e71af7a4912147cd9fab070cb77b275c',uuid=0f510d75-5d1e-4a5c-b38f-731c299f0f5a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c67a8d45-c4ba-4302-940f-c05799ecc732", "address": "fa:16:3e:02:6d:5d", "network": {"id": "d47e3749-fdff-4112-bd72-69ca584efe1f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-302967634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "080d1ded4cd94e5083ee0b7e691b7363", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc67a8d45-c4", "ovs_interfaceid": "c67a8d45-c4ba-4302-940f-c05799ecc732", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 15:34:00 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-0bf05c41-05e1-48ae-a737-5a56f2d61300 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Converting VIF {"id": "c67a8d45-c4ba-4302-940f-c05799ecc732", "address": "fa:16:3e:02:6d:5d", "network": {"id": "d47e3749-fdff-4112-bd72-69ca584efe1f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-302967634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "080d1ded4cd94e5083ee0b7e691b7363", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc67a8d45-c4", "ovs_interfaceid": "c67a8d45-c4ba-4302-940f-c05799ecc732", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 15:34:00 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-0bf05c41-05e1-48ae-a737-5a56f2d61300 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:02:6d:5d,bridge_name='br-int',has_traffic_filtering=True,id=c67a8d45-c4ba-4302-940f-c05799ecc732,network=Network(d47e3749-fdff-4112-bd72-69ca584efe1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc67a8d45-c4') {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 15:34:00 user nova-compute[72382]: DEBUG os_vif [None req-0bf05c41-05e1-48ae-a737-5a56f2d61300 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:02:6d:5d,bridge_name='br-int',has_traffic_filtering=True,id=c67a8d45-c4ba-4302-940f-c05799ecc732,network=Network(d47e3749-fdff-4112-bd72-69ca584efe1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc67a8d45-c4') {{(pid=72382) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 15:34:00 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:34:00 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc67a8d45-c4, bridge=br-int, if_exists=True) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:34:00 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:34:00 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:34:00 user nova-compute[72382]: INFO os_vif [None req-0bf05c41-05e1-48ae-a737-5a56f2d61300 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:02:6d:5d,bridge_name='br-int',has_traffic_filtering=True,id=c67a8d45-c4ba-4302-940f-c05799ecc732,network=Network(d47e3749-fdff-4112-bd72-69ca584efe1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc67a8d45-c4')
Aug 09 15:34:00 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0bf05c41-05e1-48ae-a737-5a56f2d61300 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] [instance: 0f510d75-5d1e-4a5c-b38f-731c299f0f5a] calling os-brick to detach iSCSI Volume {{(pid=72382) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 15:34:00 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bf05c41-05e1-48ae-a737-5a56f2d61300 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2a0c768340>, {'target_iqns': ['iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QpOYqIyf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 15:34:00 user nova-compute[72382]: WARNING os_brick.initiator.connectors.base [None req-0bf05c41-05e1-48ae-a737-5a56f2d61300 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 15:34:00 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-0bf05c41-05e1-48ae-a737-5a56f2d61300 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 15:34:00 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-0bf05c41-05e1-48ae-a737-5a56f2d61300 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 15:34:00 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bf05c41-05e1-48ae-a737-5a56f2d61300 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457', 0)] {{(pid=72382) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 15:34:00 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:34:00 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:34:00 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6646f64-70fe-4289-be6b-b3859f2ad78f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:59852df5-d4c8-4f25-8693-36181ff6a447\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9b93bb40-75bb-4387-aa01-c839f97e3432\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:34:00 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:34:00 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:34:00 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf814984-7df8-4b5e-a150-79c5c3b94d71]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59852df5-d4c8-4f25-8693-36181ff6a447 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b93bb40-75bb-4387-aa01-c839f97e3432 (non-flash)\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:34:00 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bf05c41-05e1-48ae-a737-5a56f2d61300 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)
Aug 09 15:34:00 user nova-compute[72382]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59852df5-d4c8-4f25-8693-36181ff6a447 (non-flash)
Aug 09 15:34:00 user nova-compute[72382]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b93bb40-75bb-4387-aa01-c839f97e3432 (non-flash)
Aug 09 15:34:00 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 15:34:00 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bf05c41-05e1-48ae-a737-5a56f2d61300 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 (non-flash)
Aug 09 15:34:00 user nova-compute[72382]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59852df5-d4c8-4f25-8693-36181ff6a447 (non-flash)
Aug 09 15:34:00 user nova-compute[72382]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b93bb40-75bb-4387-aa01-c839f97e3432 (non-flash)
Aug 09 15:34:00 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 15:34:00 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bf05c41-05e1-48ae-a737-5a56f2d61300 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2a0c2a0ee0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457'): ({'sdd'}, set())}) {{(pid=72382) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 15:34:00 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-0bf05c41-05e1-48ae-a737-5a56f2d61300 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Removing single pathed devices sdd {{(pid=72382) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 15:34:00 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:34:00 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:34:00 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[8db99641-652c-4673-8057-d3ca41dce2ac]: (4, ('path checker states:\nup                  2\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:34:00 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:34:00 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:34:00 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[13c8a215-cc54-4606-8bf3-4637d840b0d1]: (4, ('ok\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:34:00 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-0bf05c41-05e1-48ae-a737-5a56f2d61300 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Flushing IO for device /dev/sdd {{(pid=72382) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 15:34:00 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:34:00 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:34:00 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d2b5ba1-7931-4704-b8fc-376909a1bc79]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:34:00 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-0bf05c41-05e1-48ae-a737-5a56f2d61300 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72382) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 15:34:00 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:34:01 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.046s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:34:01 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[35868900-1948-4287-9670-13b6c33141be]: (4, ('1', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:34:01 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-0bf05c41-05e1-48ae-a737-5a56f2d61300 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72382) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 15:34:01 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-0bf05c41-05e1-48ae-a737-5a56f2d61300 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] SCSI volumes sdd have been removed. {{(pid=72382) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 15:34:01 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bf05c41-05e1-48ae-a737-5a56f2d61300 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457')] {{(pid=72382) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 15:34:01 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:34:01 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:34:01 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[364b5c85-4a89-44e6-bcc5-3abdcdfb1ef7]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:34:01 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bf05c41-05e1-48ae-a737-5a56f2d61300 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:34:01 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 -p 172.16.0.220:3260 --logout {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:34:01 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:34:01 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[69ebb157-a066-4bd2-ae34-f76fa2f58d58]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:34:01 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bf05c41-05e1-48ae-a737-5a56f2d61300 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457, portal: 172.16.0.220,3260]
Aug 09 15:34:01 user nova-compute[72382]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457, portal: 172.16.0.220,3260] successful.
Aug 09 15:34:01 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:34:01 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 -p 172.16.0.220:3260 --op delete {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:34:01 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05583e93-152e-49cd-8466-12d60f49c457 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:34:01 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[f88e354f-a356-4fa9-a97c-5e637ba60ad3]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:34:01 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bf05c41-05e1-48ae-a737-5a56f2d61300 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:34:01 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-0bf05c41-05e1-48ae-a737-5a56f2d61300 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.277s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 15:34:01 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bf05c41-05e1-48ae-a737-5a56f2d61300 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] <== disconnect_volume: return (278ms) None {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 15:34:01 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0bf05c41-05e1-48ae-a737-5a56f2d61300 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] [instance: 0f510d75-5d1e-4a5c-b38f-731c299f0f5a] Disconnected iSCSI Volume {{(pid=72382) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 15:34:01 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-0bf05c41-05e1-48ae-a737-5a56f2d61300 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] [instance: 0f510d75-5d1e-4a5c-b38f-731c299f0f5a] Deleting instance files /opt/stack/data/nova/instances/0f510d75-5d1e-4a5c-b38f-731c299f0f5a_del
Aug 09 15:34:01 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-0bf05c41-05e1-48ae-a737-5a56f2d61300 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] [instance: 0f510d75-5d1e-4a5c-b38f-731c299f0f5a] Deletion of /opt/stack/data/nova/instances/0f510d75-5d1e-4a5c-b38f-731c299f0f5a_del complete
Aug 09 15:34:01 user nova-compute[72382]: INFO nova.compute.manager [None req-0bf05c41-05e1-48ae-a737-5a56f2d61300 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] [instance: 0f510d75-5d1e-4a5c-b38f-731c299f0f5a] Took 1.14 seconds to destroy the instance on the hypervisor.
Aug 09 15:34:01 user nova-compute[72382]: DEBUG oslo.service.loopingcall [None req-0bf05c41-05e1-48ae-a737-5a56f2d61300 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72382) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 15:34:01 user nova-compute[72382]: DEBUG nova.compute.manager [-] [instance: 0f510d75-5d1e-4a5c-b38f-731c299f0f5a] Deallocating network for instance {{(pid=72382) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 15:34:01 user nova-compute[72382]: DEBUG nova.network.neutron [-] [instance: 0f510d75-5d1e-4a5c-b38f-731c299f0f5a] deallocate_for_instance() {{(pid=72382) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 15:34:01 user nova-compute[72382]: DEBUG nova.network.neutron [-] [instance: 0f510d75-5d1e-4a5c-b38f-731c299f0f5a] Updating instance_info_cache with network_info: [] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:34:01 user nova-compute[72382]: INFO nova.compute.manager [-] [instance: 0f510d75-5d1e-4a5c-b38f-731c299f0f5a] Took 0.45 seconds to deallocate network for instance.
Aug 09 15:34:02 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:34:02 user nova-compute[72382]: INFO nova.compute.manager [None req-0bf05c41-05e1-48ae-a737-5a56f2d61300 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] [instance: 0f510d75-5d1e-4a5c-b38f-731c299f0f5a] Took 0.85 seconds to detach 1 volumes for instance.
Aug 09 15:34:02 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-0bf05c41-05e1-48ae-a737-5a56f2d61300 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:34:02 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-0bf05c41-05e1-48ae-a737-5a56f2d61300 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:34:02 user nova-compute[72382]: DEBUG nova.compute.manager [req-9e1453f6-ade0-4fb3-918d-192adb50f522 req-b602e3d0-50dc-44e0-9ef7-d2fbc1746d78 service nova] [instance: 0f510d75-5d1e-4a5c-b38f-731c299f0f5a] Received event network-vif-plugged-c67a8d45-c4ba-4302-940f-c05799ecc732 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:34:02 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-9e1453f6-ade0-4fb3-918d-192adb50f522 req-b602e3d0-50dc-44e0-9ef7-d2fbc1746d78 service nova] Acquiring lock "0f510d75-5d1e-4a5c-b38f-731c299f0f5a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:34:02 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-9e1453f6-ade0-4fb3-918d-192adb50f522 req-b602e3d0-50dc-44e0-9ef7-d2fbc1746d78 service nova] Lock "0f510d75-5d1e-4a5c-b38f-731c299f0f5a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:34:02 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-9e1453f6-ade0-4fb3-918d-192adb50f522 req-b602e3d0-50dc-44e0-9ef7-d2fbc1746d78 service nova] Lock "0f510d75-5d1e-4a5c-b38f-731c299f0f5a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:34:02 user nova-compute[72382]: DEBUG nova.compute.manager [req-9e1453f6-ade0-4fb3-918d-192adb50f522 req-b602e3d0-50dc-44e0-9ef7-d2fbc1746d78 service nova] [instance: 0f510d75-5d1e-4a5c-b38f-731c299f0f5a] No waiting events found dispatching network-vif-plugged-c67a8d45-c4ba-4302-940f-c05799ecc732 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:34:02 user nova-compute[72382]: WARNING nova.compute.manager [req-9e1453f6-ade0-4fb3-918d-192adb50f522 req-b602e3d0-50dc-44e0-9ef7-d2fbc1746d78 service nova] [instance: 0f510d75-5d1e-4a5c-b38f-731c299f0f5a] Received unexpected event network-vif-plugged-c67a8d45-c4ba-4302-940f-c05799ecc732 for instance with vm_state deleted and task_state None.
Aug 09 15:34:02 user nova-compute[72382]: DEBUG nova.compute.manager [req-9e1453f6-ade0-4fb3-918d-192adb50f522 req-b602e3d0-50dc-44e0-9ef7-d2fbc1746d78 service nova] [instance: 0f510d75-5d1e-4a5c-b38f-731c299f0f5a] Received event network-vif-deleted-c67a8d45-c4ba-4302-940f-c05799ecc732 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:34:02 user nova-compute[72382]: DEBUG nova.compute.provider_tree [None req-0bf05c41-05e1-48ae-a737-5a56f2d61300 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Inventory has not changed in ProviderTree for provider: 7b15b0e5-df4d-49db-833b-2855d21d10ae {{(pid=72382) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 15:34:02 user nova-compute[72382]: DEBUG nova.scheduler.client.report [None req-0bf05c41-05e1-48ae-a737-5a56f2d61300 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Inventory has not changed for provider 7b15b0e5-df4d-49db-833b-2855d21d10ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72382) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 15:34:02 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-0bf05c41-05e1-48ae-a737-5a56f2d61300 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.257s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:34:02 user nova-compute[72382]: INFO nova.scheduler.client.report [None req-0bf05c41-05e1-48ae-a737-5a56f2d61300 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Deleted allocations for instance 0f510d75-5d1e-4a5c-b38f-731c299f0f5a
Aug 09 15:34:02 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-0bf05c41-05e1-48ae-a737-5a56f2d61300 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Lock "0f510d75-5d1e-4a5c-b38f-731c299f0f5a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.867s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:34:04 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:34:05 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:34:05 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:34:08 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-7363eb6a-b104-4e48-b908-0c97714d3f64 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Acquiring lock "b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:34:08 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-7363eb6a-b104-4e48-b908-0c97714d3f64 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Lock "b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:34:08 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-7363eb6a-b104-4e48-b908-0c97714d3f64 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Acquiring lock "b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:34:08 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-7363eb6a-b104-4e48-b908-0c97714d3f64 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Lock "b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:34:08 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-7363eb6a-b104-4e48-b908-0c97714d3f64 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Lock "b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:34:08 user nova-compute[72382]: INFO nova.compute.manager [None req-7363eb6a-b104-4e48-b908-0c97714d3f64 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] [instance: b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d] Terminating instance
Aug 09 15:34:08 user nova-compute[72382]: DEBUG nova.compute.manager [None req-7363eb6a-b104-4e48-b908-0c97714d3f64 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] [instance: b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d] Start destroying the instance on the hypervisor. {{(pid=72382) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 15:34:08 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:34:08 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:34:08 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:34:08 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:34:08 user nova-compute[72382]: DEBUG nova.compute.manager [req-1193ba16-35d4-4f20-8c4e-bafb8a596d1d req-a16f16e2-0429-458b-8dca-a715f101ac32 service nova] [instance: b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d] Received event network-vif-unplugged-99b65ca7-d891-4625-917d-460e7fb69654 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:34:08 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-1193ba16-35d4-4f20-8c4e-bafb8a596d1d req-a16f16e2-0429-458b-8dca-a715f101ac32 service nova] Acquiring lock "b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:34:08 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-1193ba16-35d4-4f20-8c4e-bafb8a596d1d req-a16f16e2-0429-458b-8dca-a715f101ac32 service nova] Lock "b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:34:08 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-1193ba16-35d4-4f20-8c4e-bafb8a596d1d req-a16f16e2-0429-458b-8dca-a715f101ac32 service nova] Lock "b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:34:08 user nova-compute[72382]: DEBUG nova.compute.manager [req-1193ba16-35d4-4f20-8c4e-bafb8a596d1d req-a16f16e2-0429-458b-8dca-a715f101ac32 service nova] [instance: b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d] No waiting events found dispatching network-vif-unplugged-99b65ca7-d891-4625-917d-460e7fb69654 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:34:08 user nova-compute[72382]: DEBUG nova.compute.manager [req-1193ba16-35d4-4f20-8c4e-bafb8a596d1d req-a16f16e2-0429-458b-8dca-a715f101ac32 service nova] [instance: b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d] Received event network-vif-unplugged-99b65ca7-d891-4625-917d-460e7fb69654 for instance with task_state deleting. {{(pid=72382) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 15:34:09 user nova-compute[72382]: INFO nova.virt.libvirt.driver [-] [instance: b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d] Instance destroyed successfully.
Aug 09 15:34:09 user nova-compute[72382]: DEBUG nova.objects.instance [None req-7363eb6a-b104-4e48-b908-0c97714d3f64 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Lazy-loading 'resources' on Instance uuid b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:34:09 user nova-compute[72382]: DEBUG nova.virt.libvirt.vif [None req-7363eb6a-b104-4e48-b908-0c97714d3f64 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-09T15:27:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1040530269',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1040530269',id=30,image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMiQiccBAZbSGjl9sbSNKnQGJNN64201drRNdzHrfy2kYoUIkJ4KB4xuR2qLyVMxz2GHt6tPPGyITCyus9o+6b9G1oDw0H1d1ZWMxnk3TgYZXztCoqRxXenLA44cFa0yrg==',key_name='tempest-keypair-1139327477',keypairs=<?>,launch_index=0,launched_at=2023-08-09T15:31:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='aa6db5fd3ce24c1cadbedd64757e219b',ramdisk_id='',reservation_id='r-ydxxngnu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1817688709',owner_user_name='tempest-AttachVolumeShelveTestJSON-1817688709-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T15:31:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9f95e50aa6194e778dfaee31e6e2fa68',uuid=b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "99b65ca7-d891-4625-917d-460e7fb69654", "address": "fa:16:3e:98:b9:f2", "network": {"id": "643703fd-46b7-4309-862c-109141cb008c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-512918576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.131", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa6db5fd3ce24c1cadbedd64757e219b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99b65ca7-d8", "ovs_interfaceid": "99b65ca7-d891-4625-917d-460e7fb69654", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 15:34:09 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-7363eb6a-b104-4e48-b908-0c97714d3f64 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Converting VIF {"id": "99b65ca7-d891-4625-917d-460e7fb69654", "address": "fa:16:3e:98:b9:f2", "network": {"id": "643703fd-46b7-4309-862c-109141cb008c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-512918576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.131", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa6db5fd3ce24c1cadbedd64757e219b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99b65ca7-d8", "ovs_interfaceid": "99b65ca7-d891-4625-917d-460e7fb69654", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 15:34:09 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-7363eb6a-b104-4e48-b908-0c97714d3f64 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:98:b9:f2,bridge_name='br-int',has_traffic_filtering=True,id=99b65ca7-d891-4625-917d-460e7fb69654,network=Network(643703fd-46b7-4309-862c-109141cb008c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99b65ca7-d8') {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 15:34:09 user nova-compute[72382]: DEBUG os_vif [None req-7363eb6a-b104-4e48-b908-0c97714d3f64 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:b9:f2,bridge_name='br-int',has_traffic_filtering=True,id=99b65ca7-d891-4625-917d-460e7fb69654,network=Network(643703fd-46b7-4309-862c-109141cb008c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99b65ca7-d8') {{(pid=72382) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 15:34:09 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:34:09 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap99b65ca7-d8, bridge=br-int, if_exists=True) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:34:09 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:34:09 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:34:09 user nova-compute[72382]: INFO os_vif [None req-7363eb6a-b104-4e48-b908-0c97714d3f64 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:b9:f2,bridge_name='br-int',has_traffic_filtering=True,id=99b65ca7-d891-4625-917d-460e7fb69654,network=Network(643703fd-46b7-4309-862c-109141cb008c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99b65ca7-d8')
Aug 09 15:34:09 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-7363eb6a-b104-4e48-b908-0c97714d3f64 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] [instance: b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d] Deleting instance files /opt/stack/data/nova/instances/b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d_del
Aug 09 15:34:09 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-7363eb6a-b104-4e48-b908-0c97714d3f64 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] [instance: b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d] Deletion of /opt/stack/data/nova/instances/b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d_del complete
Aug 09 15:34:09 user nova-compute[72382]: INFO nova.compute.manager [None req-7363eb6a-b104-4e48-b908-0c97714d3f64 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] [instance: b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d] Took 0.85 seconds to destroy the instance on the hypervisor.
Aug 09 15:34:09 user nova-compute[72382]: DEBUG oslo.service.loopingcall [None req-7363eb6a-b104-4e48-b908-0c97714d3f64 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72382) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 15:34:09 user nova-compute[72382]: DEBUG nova.compute.manager [-] [instance: b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d] Deallocating network for instance {{(pid=72382) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 15:34:09 user nova-compute[72382]: DEBUG nova.network.neutron [-] [instance: b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d] deallocate_for_instance() {{(pid=72382) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 15:34:09 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:34:09 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:34:09 user nova-compute[72382]: DEBUG nova.network.neutron [-] [instance: b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d] Updating instance_info_cache with network_info: [] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:34:09 user nova-compute[72382]: DEBUG nova.compute.manager [req-1a4eee6c-6230-4a36-9779-6cb90042ae7e req-5bc986ed-5150-49af-8bec-18d4b598de8a service nova] [instance: b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d] Received event network-vif-deleted-99b65ca7-d891-4625-917d-460e7fb69654 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:34:09 user nova-compute[72382]: INFO nova.compute.manager [req-1a4eee6c-6230-4a36-9779-6cb90042ae7e req-5bc986ed-5150-49af-8bec-18d4b598de8a service nova] [instance: b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d] Neutron deleted interface 99b65ca7-d891-4625-917d-460e7fb69654; detaching it from the instance and deleting it from the info cache
Aug 09 15:34:09 user nova-compute[72382]: DEBUG nova.network.neutron [req-1a4eee6c-6230-4a36-9779-6cb90042ae7e req-5bc986ed-5150-49af-8bec-18d4b598de8a service nova] [instance: b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d] Updating instance_info_cache with network_info: [] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:34:09 user nova-compute[72382]: INFO nova.compute.manager [-] [instance: b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d] Took 0.78 seconds to deallocate network for instance.
Aug 09 15:34:10 user nova-compute[72382]: DEBUG nova.compute.manager [req-1a4eee6c-6230-4a36-9779-6cb90042ae7e req-5bc986ed-5150-49af-8bec-18d4b598de8a service nova] [instance: b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d] Detach interface failed, port_id=99b65ca7-d891-4625-917d-460e7fb69654, reason: Instance b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d could not be found. {{(pid=72382) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 09 15:34:10 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-7363eb6a-b104-4e48-b908-0c97714d3f64 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:34:10 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-7363eb6a-b104-4e48-b908-0c97714d3f64 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:34:10 user nova-compute[72382]: DEBUG nova.compute.provider_tree [None req-7363eb6a-b104-4e48-b908-0c97714d3f64 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Inventory has not changed in ProviderTree for provider: 7b15b0e5-df4d-49db-833b-2855d21d10ae {{(pid=72382) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 15:34:10 user nova-compute[72382]: DEBUG nova.scheduler.client.report [None req-7363eb6a-b104-4e48-b908-0c97714d3f64 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Inventory has not changed for provider 7b15b0e5-df4d-49db-833b-2855d21d10ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72382) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 15:34:10 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-7363eb6a-b104-4e48-b908-0c97714d3f64 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.236s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:34:10 user nova-compute[72382]: INFO nova.scheduler.client.report [None req-7363eb6a-b104-4e48-b908-0c97714d3f64 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Deleted allocations for instance b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d
Aug 09 15:34:10 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-7363eb6a-b104-4e48-b908-0c97714d3f64 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Lock "b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.051s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:34:10 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:34:10 user nova-compute[72382]: DEBUG nova.compute.manager [req-b9bc4f84-4003-4330-9467-db3ab50c5dcf req-ab890ff4-b60a-44f4-b7cb-d2c3eaddd073 service nova] [instance: b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d] Received event network-vif-plugged-99b65ca7-d891-4625-917d-460e7fb69654 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:34:10 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-b9bc4f84-4003-4330-9467-db3ab50c5dcf req-ab890ff4-b60a-44f4-b7cb-d2c3eaddd073 service nova] Acquiring lock "b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:34:10 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-b9bc4f84-4003-4330-9467-db3ab50c5dcf req-ab890ff4-b60a-44f4-b7cb-d2c3eaddd073 service nova] Lock "b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:34:10 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-b9bc4f84-4003-4330-9467-db3ab50c5dcf req-ab890ff4-b60a-44f4-b7cb-d2c3eaddd073 service nova] Lock "b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:34:10 user nova-compute[72382]: DEBUG nova.compute.manager [req-b9bc4f84-4003-4330-9467-db3ab50c5dcf req-ab890ff4-b60a-44f4-b7cb-d2c3eaddd073 service nova] [instance: b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d] No waiting events found dispatching network-vif-plugged-99b65ca7-d891-4625-917d-460e7fb69654 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:34:10 user nova-compute[72382]: WARNING nova.compute.manager [req-b9bc4f84-4003-4330-9467-db3ab50c5dcf req-ab890ff4-b60a-44f4-b7cb-d2c3eaddd073 service nova] [instance: b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d] Received unexpected event network-vif-plugged-99b65ca7-d891-4625-917d-460e7fb69654 for instance with vm_state deleted and task_state None.
Aug 09 15:34:10 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:34:10 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:34:10 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:34:10 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:34:10 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Auditing locally available compute resources for user (node: user) {{(pid=72382) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 15:34:11 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f780040f-b789-4b72-8986-813c7b9fe4a6/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:34:11 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f780040f-b789-4b72-8986-813c7b9fe4a6/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:34:11 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f780040f-b789-4b72-8986-813c7b9fe4a6/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:34:11 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f780040f-b789-4b72-8986-813c7b9fe4a6/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:34:11 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14c97840-88c0-4a8e-96e8-2e7da318ad07/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:34:11 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14c97840-88c0-4a8e-96e8-2e7da318ad07/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:34:11 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14c97840-88c0-4a8e-96e8-2e7da318ad07/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:34:11 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14c97840-88c0-4a8e-96e8-2e7da318ad07/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:34:11 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=72382) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 15:34:11 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ccbfda2-8bcd-4ec1-972a-cf49a62b1583/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:34:11 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ccbfda2-8bcd-4ec1-972a-cf49a62b1583/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:34:11 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ccbfda2-8bcd-4ec1-972a-cf49a62b1583/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:34:11 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ccbfda2-8bcd-4ec1-972a-cf49a62b1583/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:34:11 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72382) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 15:34:12 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:34:12 user nova-compute[72382]: WARNING nova.virt.libvirt.driver [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 15:34:12 user nova-compute[72382]: WARNING nova.virt.libvirt.driver [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 15:34:12 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Hypervisor/Node resource view: name=user free_ram=7973MB free_disk=25.43341064453125GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72382) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 15:34:12 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:34:12 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:34:12 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance f780040f-b789-4b72-8986-813c7b9fe4a6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:34:12 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance 14c97840-88c0-4a8e-96e8-2e7da318ad07 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:34:12 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance 4ccbfda2-8bcd-4ec1-972a-cf49a62b1583 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:34:12 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance 94c8cc29-3300-475f-aca0-40fa0e58cd66 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:34:12 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance 765eb553-6c1c-4d5a-a1cf-6ac8b348ac8e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:34:12 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=72382) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 15:34:12 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=72382) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 15:34:12 user nova-compute[72382]: DEBUG nova.compute.provider_tree [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Inventory has not changed in ProviderTree for provider: 7b15b0e5-df4d-49db-833b-2855d21d10ae {{(pid=72382) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 15:34:12 user nova-compute[72382]: DEBUG nova.scheduler.client.report [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Inventory has not changed for provider 7b15b0e5-df4d-49db-833b-2855d21d10ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72382) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 15:34:12 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Compute_service record updated for user:user {{(pid=72382) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 15:34:12 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.295s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:34:14 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:34:14 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:34:15 user nova-compute[72382]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691595240.798966, 0f510d75-5d1e-4a5c-b38f-731c299f0f5a => Stopped> {{(pid=72382) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 15:34:15 user nova-compute[72382]: INFO nova.compute.manager [-] [instance: 0f510d75-5d1e-4a5c-b38f-731c299f0f5a] VM Stopped (Lifecycle Event)
Aug 09 15:34:15 user nova-compute[72382]: DEBUG nova.compute.manager [None req-448a6bb8-eda7-4f7f-8517-facaa1bed6fb None None] [instance: 0f510d75-5d1e-4a5c-b38f-731c299f0f5a] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:34:16 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:34:16 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:34:17 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:34:18 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:34:18 user nova-compute[72382]: DEBUG nova.compute.manager [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Starting heal instance info cache {{(pid=72382) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 15:34:18 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Acquiring lock "refresh_cache-4ccbfda2-8bcd-4ec1-972a-cf49a62b1583" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 15:34:18 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Acquired lock "refresh_cache-4ccbfda2-8bcd-4ec1-972a-cf49a62b1583" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 15:34:18 user nova-compute[72382]: DEBUG nova.network.neutron [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] [instance: 4ccbfda2-8bcd-4ec1-972a-cf49a62b1583] Forcefully refreshing network info cache for instance {{(pid=72382) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 15:34:19 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:34:19 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-bf2c57ff-553b-4d21-b5c7-5403c9b79b7f tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Acquiring lock "429ebe93-dd7a-41c4-b80a-0379d3816402" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:34:19 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-bf2c57ff-553b-4d21-b5c7-5403c9b79b7f tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Lock "429ebe93-dd7a-41c4-b80a-0379d3816402" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:34:19 user nova-compute[72382]: DEBUG nova.compute.manager [None req-bf2c57ff-553b-4d21-b5c7-5403c9b79b7f tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] [instance: 429ebe93-dd7a-41c4-b80a-0379d3816402] Starting instance... {{(pid=72382) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 15:34:19 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-bf2c57ff-553b-4d21-b5c7-5403c9b79b7f tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:34:19 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-bf2c57ff-553b-4d21-b5c7-5403c9b79b7f tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:34:19 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-bf2c57ff-553b-4d21-b5c7-5403c9b79b7f tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72382) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 15:34:19 user nova-compute[72382]: INFO nova.compute.claims [None req-bf2c57ff-553b-4d21-b5c7-5403c9b79b7f tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] [instance: 429ebe93-dd7a-41c4-b80a-0379d3816402] Claim successful on node user
Aug 09 15:34:19 user nova-compute[72382]: DEBUG nova.network.neutron [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] [instance: 4ccbfda2-8bcd-4ec1-972a-cf49a62b1583] Updating instance_info_cache with network_info: [{"id": "2d07e6a3-03b7-4035-bdd2-a95435b99852", "address": "fa:16:3e:9a:d4:3a", "network": {"id": "308641dc-cc18-41db-9baa-7cc880e594ad", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1932973397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb5bf3f95d2843af94dbcab2af932bd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d07e6a3-03", "ovs_interfaceid": "2d07e6a3-03b7-4035-bdd2-a95435b99852", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:34:19 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Releasing lock "refresh_cache-4ccbfda2-8bcd-4ec1-972a-cf49a62b1583" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 15:34:19 user nova-compute[72382]: DEBUG nova.compute.manager [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] [instance: 4ccbfda2-8bcd-4ec1-972a-cf49a62b1583] Updated the network info_cache for instance {{(pid=72382) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 15:34:19 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:34:19 user nova-compute[72382]: DEBUG nova.compute.manager [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72382) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 15:34:19 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:34:19 user nova-compute[72382]: DEBUG nova.compute.provider_tree [None req-bf2c57ff-553b-4d21-b5c7-5403c9b79b7f tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Inventory has not changed in ProviderTree for provider: 7b15b0e5-df4d-49db-833b-2855d21d10ae {{(pid=72382) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 15:34:19 user nova-compute[72382]: DEBUG nova.scheduler.client.report [None req-bf2c57ff-553b-4d21-b5c7-5403c9b79b7f tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Inventory has not changed for provider 7b15b0e5-df4d-49db-833b-2855d21d10ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72382) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 15:34:19 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-bf2c57ff-553b-4d21-b5c7-5403c9b79b7f tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.404s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:34:19 user nova-compute[72382]: DEBUG nova.compute.manager [None req-bf2c57ff-553b-4d21-b5c7-5403c9b79b7f tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] [instance: 429ebe93-dd7a-41c4-b80a-0379d3816402] Start building networks asynchronously for instance. {{(pid=72382) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 15:34:19 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:34:19 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:34:19 user nova-compute[72382]: DEBUG nova.compute.manager [None req-bf2c57ff-553b-4d21-b5c7-5403c9b79b7f tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] [instance: 429ebe93-dd7a-41c4-b80a-0379d3816402] Allocating IP information in the background. {{(pid=72382) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 15:34:19 user nova-compute[72382]: DEBUG nova.network.neutron [None req-bf2c57ff-553b-4d21-b5c7-5403c9b79b7f tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] [instance: 429ebe93-dd7a-41c4-b80a-0379d3816402] allocate_for_instance() {{(pid=72382) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 15:34:19 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-bf2c57ff-553b-4d21-b5c7-5403c9b79b7f tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] [instance: 429ebe93-dd7a-41c4-b80a-0379d3816402] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 15:34:19 user nova-compute[72382]: DEBUG nova.compute.manager [None req-bf2c57ff-553b-4d21-b5c7-5403c9b79b7f tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] [instance: 429ebe93-dd7a-41c4-b80a-0379d3816402] Start building block device mappings for instance. {{(pid=72382) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 15:34:20 user nova-compute[72382]: DEBUG nova.policy [None req-bf2c57ff-553b-4d21-b5c7-5403c9b79b7f tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '401c9df41f284c88a86557485d7d9537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98009994d9c74eb9b4fc6321e82440de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72382) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 15:34:20 user nova-compute[72382]: DEBUG nova.compute.manager [None req-bf2c57ff-553b-4d21-b5c7-5403c9b79b7f tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] [instance: 429ebe93-dd7a-41c4-b80a-0379d3816402] Start spawning the instance on the hypervisor. {{(pid=72382) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 15:34:20 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-bf2c57ff-553b-4d21-b5c7-5403c9b79b7f tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] [instance: 429ebe93-dd7a-41c4-b80a-0379d3816402] Creating instance directory {{(pid=72382) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 15:34:20 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-bf2c57ff-553b-4d21-b5c7-5403c9b79b7f tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] [instance: 429ebe93-dd7a-41c4-b80a-0379d3816402] Creating image(s)
Aug 09 15:34:20 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-bf2c57ff-553b-4d21-b5c7-5403c9b79b7f tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Acquiring lock "/opt/stack/data/nova/instances/429ebe93-dd7a-41c4-b80a-0379d3816402/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:34:20 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-bf2c57ff-553b-4d21-b5c7-5403c9b79b7f tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Lock "/opt/stack/data/nova/instances/429ebe93-dd7a-41c4-b80a-0379d3816402/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:34:20 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-bf2c57ff-553b-4d21-b5c7-5403c9b79b7f tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Lock "/opt/stack/data/nova/instances/429ebe93-dd7a-41c4-b80a-0379d3816402/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:34:20 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-bf2c57ff-553b-4d21-b5c7-5403c9b79b7f tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:34:20 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-bf2c57ff-553b-4d21-b5c7-5403c9b79b7f tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b --force-share --output=json" returned: 0 in 0.146s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:34:20 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-bf2c57ff-553b-4d21-b5c7-5403c9b79b7f tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Acquiring lock "383812ff437283e0191ed5b9ecc04c27f1162b0b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:34:20 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-bf2c57ff-553b-4d21-b5c7-5403c9b79b7f tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Lock "383812ff437283e0191ed5b9ecc04c27f1162b0b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:34:20 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-bf2c57ff-553b-4d21-b5c7-5403c9b79b7f tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:34:20 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-bf2c57ff-553b-4d21-b5c7-5403c9b79b7f tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b --force-share --output=json" returned: 0 in 0.151s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:34:20 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-bf2c57ff-553b-4d21-b5c7-5403c9b79b7f tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b,backing_fmt=raw /opt/stack/data/nova/instances/429ebe93-dd7a-41c4-b80a-0379d3816402/disk 1073741824 {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:34:20 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-bf2c57ff-553b-4d21-b5c7-5403c9b79b7f tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b,backing_fmt=raw /opt/stack/data/nova/instances/429ebe93-dd7a-41c4-b80a-0379d3816402/disk 1073741824" returned: 0 in 0.047s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:34:20 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-bf2c57ff-553b-4d21-b5c7-5403c9b79b7f tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Lock "383812ff437283e0191ed5b9ecc04c27f1162b0b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.204s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:34:20 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-bf2c57ff-553b-4d21-b5c7-5403c9b79b7f tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:34:20 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-bf2c57ff-553b-4d21-b5c7-5403c9b79b7f tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b --force-share --output=json" returned: 0 in 0.152s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:34:20 user nova-compute[72382]: DEBUG nova.virt.disk.api [None req-bf2c57ff-553b-4d21-b5c7-5403c9b79b7f tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Checking if we can resize image /opt/stack/data/nova/instances/429ebe93-dd7a-41c4-b80a-0379d3816402/disk. size=1073741824 {{(pid=72382) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 15:34:20 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-bf2c57ff-553b-4d21-b5c7-5403c9b79b7f tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/429ebe93-dd7a-41c4-b80a-0379d3816402/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:34:20 user nova-compute[72382]: DEBUG nova.network.neutron [None req-bf2c57ff-553b-4d21-b5c7-5403c9b79b7f tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] [instance: 429ebe93-dd7a-41c4-b80a-0379d3816402] Successfully created port: d7669ab9-996e-4cf6-82a3-0083fbb7fa5c {{(pid=72382) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 15:34:20 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-bf2c57ff-553b-4d21-b5c7-5403c9b79b7f tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/429ebe93-dd7a-41c4-b80a-0379d3816402/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:34:20 user nova-compute[72382]: DEBUG nova.virt.disk.api [None req-bf2c57ff-553b-4d21-b5c7-5403c9b79b7f tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Cannot resize image /opt/stack/data/nova/instances/429ebe93-dd7a-41c4-b80a-0379d3816402/disk to a smaller size. {{(pid=72382) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 15:34:20 user nova-compute[72382]: DEBUG nova.objects.instance [None req-bf2c57ff-553b-4d21-b5c7-5403c9b79b7f tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Lazy-loading 'migration_context' on Instance uuid 429ebe93-dd7a-41c4-b80a-0379d3816402 {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:34:20 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-bf2c57ff-553b-4d21-b5c7-5403c9b79b7f tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] [instance: 429ebe93-dd7a-41c4-b80a-0379d3816402] Created local disks {{(pid=72382) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 15:34:20 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-bf2c57ff-553b-4d21-b5c7-5403c9b79b7f tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] [instance: 429ebe93-dd7a-41c4-b80a-0379d3816402] Ensure instance console log exists: /opt/stack/data/nova/instances/429ebe93-dd7a-41c4-b80a-0379d3816402/console.log {{(pid=72382) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 15:34:20 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-bf2c57ff-553b-4d21-b5c7-5403c9b79b7f tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:34:20 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-bf2c57ff-553b-4d21-b5c7-5403c9b79b7f tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:34:20 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-bf2c57ff-553b-4d21-b5c7-5403c9b79b7f tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:34:21 user nova-compute[72382]: DEBUG nova.network.neutron [None req-bf2c57ff-553b-4d21-b5c7-5403c9b79b7f tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] [instance: 429ebe93-dd7a-41c4-b80a-0379d3816402] Successfully updated port: d7669ab9-996e-4cf6-82a3-0083fbb7fa5c {{(pid=72382) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 15:34:21 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-bf2c57ff-553b-4d21-b5c7-5403c9b79b7f tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Acquiring lock "refresh_cache-429ebe93-dd7a-41c4-b80a-0379d3816402" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 15:34:21 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-bf2c57ff-553b-4d21-b5c7-5403c9b79b7f tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Acquired lock "refresh_cache-429ebe93-dd7a-41c4-b80a-0379d3816402" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 15:34:21 user nova-compute[72382]: DEBUG nova.network.neutron [None req-bf2c57ff-553b-4d21-b5c7-5403c9b79b7f tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] [instance: 429ebe93-dd7a-41c4-b80a-0379d3816402] Building network info cache for instance {{(pid=72382) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 15:34:21 user nova-compute[72382]: DEBUG nova.compute.manager [req-28c1f620-3380-4bf5-8dd9-00a49d361c2a req-173197b3-c8b5-468f-80e3-75a9d6b0b7f5 service nova] [instance: 429ebe93-dd7a-41c4-b80a-0379d3816402] Received event network-changed-d7669ab9-996e-4cf6-82a3-0083fbb7fa5c {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:34:21 user nova-compute[72382]: DEBUG nova.compute.manager [req-28c1f620-3380-4bf5-8dd9-00a49d361c2a req-173197b3-c8b5-468f-80e3-75a9d6b0b7f5 service nova] [instance: 429ebe93-dd7a-41c4-b80a-0379d3816402] Refreshing instance network info cache due to event network-changed-d7669ab9-996e-4cf6-82a3-0083fbb7fa5c. {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 15:34:21 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-28c1f620-3380-4bf5-8dd9-00a49d361c2a req-173197b3-c8b5-468f-80e3-75a9d6b0b7f5 service nova] Acquiring lock "refresh_cache-429ebe93-dd7a-41c4-b80a-0379d3816402" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 15:34:21 user nova-compute[72382]: DEBUG nova.network.neutron [None req-bf2c57ff-553b-4d21-b5c7-5403c9b79b7f tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] [instance: 429ebe93-dd7a-41c4-b80a-0379d3816402] Instance cache missing network info. {{(pid=72382) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 15:34:22 user nova-compute[72382]: DEBUG nova.network.neutron [None req-bf2c57ff-553b-4d21-b5c7-5403c9b79b7f tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] [instance: 429ebe93-dd7a-41c4-b80a-0379d3816402] Updating instance_info_cache with network_info: [{"id": "d7669ab9-996e-4cf6-82a3-0083fbb7fa5c", "address": "fa:16:3e:18:b4:42", "network": {"id": "46eb5f03-e04d-43d1-96d6-0792bc7a94b1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1842512309-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98009994d9c74eb9b4fc6321e82440de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7669ab9-99", "ovs_interfaceid": "d7669ab9-996e-4cf6-82a3-0083fbb7fa5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:34:22 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-bf2c57ff-553b-4d21-b5c7-5403c9b79b7f tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Releasing lock "refresh_cache-429ebe93-dd7a-41c4-b80a-0379d3816402" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 15:34:22 user nova-compute[72382]: DEBUG nova.compute.manager [None req-bf2c57ff-553b-4d21-b5c7-5403c9b79b7f tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] [instance: 429ebe93-dd7a-41c4-b80a-0379d3816402] Instance network_info: |[{"id": "d7669ab9-996e-4cf6-82a3-0083fbb7fa5c", "address": "fa:16:3e:18:b4:42", "network": {"id": "46eb5f03-e04d-43d1-96d6-0792bc7a94b1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1842512309-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98009994d9c74eb9b4fc6321e82440de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7669ab9-99", "ovs_interfaceid": "d7669ab9-996e-4cf6-82a3-0083fbb7fa5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72382) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 15:34:22 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-28c1f620-3380-4bf5-8dd9-00a49d361c2a req-173197b3-c8b5-468f-80e3-75a9d6b0b7f5 service nova] Acquired lock "refresh_cache-429ebe93-dd7a-41c4-b80a-0379d3816402" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 15:34:22 user nova-compute[72382]: DEBUG nova.network.neutron [req-28c1f620-3380-4bf5-8dd9-00a49d361c2a req-173197b3-c8b5-468f-80e3-75a9d6b0b7f5 service nova] [instance: 429ebe93-dd7a-41c4-b80a-0379d3816402] Refreshing network info cache for port d7669ab9-996e-4cf6-82a3-0083fbb7fa5c {{(pid=72382) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 15:34:22 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-bf2c57ff-553b-4d21-b5c7-5403c9b79b7f tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] [instance: 429ebe93-dd7a-41c4-b80a-0379d3816402] Start _get_guest_xml network_info=[{"id": "d7669ab9-996e-4cf6-82a3-0083fbb7fa5c", "address": "fa:16:3e:18:b4:42", "network": {"id": "46eb5f03-e04d-43d1-96d6-0792bc7a94b1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1842512309-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98009994d9c74eb9b4fc6321e82440de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7669ab9-99", "ovs_interfaceid": "d7669ab9-996e-4cf6-82a3-0083fbb7fa5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T15:11:25Z,direct_url=<?>,disk_format='qcow2',id=a79f2cea-eb27-4631-aaf3-05e7d9e411b4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a638990e12cc4d6eabb6d55e13be6bdf',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T15:11:27Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'a79f2cea-eb27-4631-aaf3-05e7d9e411b4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72382) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 15:34:22 user nova-compute[72382]: WARNING nova.virt.libvirt.driver [None req-bf2c57ff-553b-4d21-b5c7-5403c9b79b7f tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 15:34:22 user nova-compute[72382]: WARNING nova.virt.libvirt.driver [None req-bf2c57ff-553b-4d21-b5c7-5403c9b79b7f tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 15:34:22 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-bf2c57ff-553b-4d21-b5c7-5403c9b79b7f tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72382) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 15:34:22 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-bf2c57ff-553b-4d21-b5c7-5403c9b79b7f tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] CPU controller missing on host. {{(pid=72382) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 15:34:22 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-bf2c57ff-553b-4d21-b5c7-5403c9b79b7f tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72382) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 15:34:22 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-bf2c57ff-553b-4d21-b5c7-5403c9b79b7f tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] CPU controller found on host. {{(pid=72382) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 15:34:22 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-bf2c57ff-553b-4d21-b5c7-5403c9b79b7f tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72382) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 15:34:22 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-bf2c57ff-553b-4d21-b5c7-5403c9b79b7f tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T15:11:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T15:11:25Z,direct_url=<?>,disk_format='qcow2',id=a79f2cea-eb27-4631-aaf3-05e7d9e411b4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a638990e12cc4d6eabb6d55e13be6bdf',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T15:11:27Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 15:34:22 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-bf2c57ff-553b-4d21-b5c7-5403c9b79b7f tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Flavor limits 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 15:34:22 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-bf2c57ff-553b-4d21-b5c7-5403c9b79b7f tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Image limits 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 15:34:22 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-bf2c57ff-553b-4d21-b5c7-5403c9b79b7f tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Flavor pref 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 15:34:22 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-bf2c57ff-553b-4d21-b5c7-5403c9b79b7f tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Image pref 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 15:34:22 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-bf2c57ff-553b-4d21-b5c7-5403c9b79b7f tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 15:34:22 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-bf2c57ff-553b-4d21-b5c7-5403c9b79b7f tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 15:34:22 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-bf2c57ff-553b-4d21-b5c7-5403c9b79b7f tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72382) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 15:34:22 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-bf2c57ff-553b-4d21-b5c7-5403c9b79b7f tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Got 1 possible topologies {{(pid=72382) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 15:34:22 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-bf2c57ff-553b-4d21-b5c7-5403c9b79b7f tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 15:34:22 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-bf2c57ff-553b-4d21-b5c7-5403c9b79b7f tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 15:34:22 user nova-compute[72382]: DEBUG nova.virt.libvirt.vif [None req-bf2c57ff-553b-4d21-b5c7-5403c9b79b7f tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T15:34:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-554390021',display_name='tempest-AttachVolumeNegativeTest-server-554390021',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-554390021',id=36,image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPr9UKLHRdNpgLNg1y/Qg5MQvxAflbKswHUG5+9EhnkuIACQbwD4DtPjuy/KhcLwWGdSuifIZaH2x296ZeqXrcCbIeVsn4VdvhRheyfe1WPiSZsf3ywZ+N4qEbGvdtwrYg==',key_name='tempest-keypair-1273601612',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='98009994d9c74eb9b4fc6321e82440de',ramdisk_id='',reservation_id='r-rcnmt08c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1325594356',owner_user_name='tempest-AttachVolumeNegativeTest-1325594356-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T15:34:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='401c9df41f284c88a86557485d7d9537',uuid=429ebe93-dd7a-41c4-b80a-0379d3816402,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d7669ab9-996e-4cf6-82a3-0083fbb7fa5c", "address": "fa:16:3e:18:b4:42", "network": {"id": "46eb5f03-e04d-43d1-96d6-0792bc7a94b1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1842512309-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98009994d9c74eb9b4fc6321e82440de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7669ab9-99", "ovs_interfaceid": "d7669ab9-996e-4cf6-82a3-0083fbb7fa5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72382) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 15:34:22 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-bf2c57ff-553b-4d21-b5c7-5403c9b79b7f tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Converting VIF {"id": "d7669ab9-996e-4cf6-82a3-0083fbb7fa5c", "address": "fa:16:3e:18:b4:42", "network": {"id": "46eb5f03-e04d-43d1-96d6-0792bc7a94b1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1842512309-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98009994d9c74eb9b4fc6321e82440de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7669ab9-99", "ovs_interfaceid": "d7669ab9-996e-4cf6-82a3-0083fbb7fa5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 15:34:22 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-bf2c57ff-553b-4d21-b5c7-5403c9b79b7f tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:18:b4:42,bridge_name='br-int',has_traffic_filtering=True,id=d7669ab9-996e-4cf6-82a3-0083fbb7fa5c,network=Network(46eb5f03-e04d-43d1-96d6-0792bc7a94b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7669ab9-99') {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 15:34:22 user nova-compute[72382]: DEBUG nova.objects.instance [None req-bf2c57ff-553b-4d21-b5c7-5403c9b79b7f tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Lazy-loading 'pci_devices' on Instance uuid 429ebe93-dd7a-41c4-b80a-0379d3816402 {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:34:22 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-bf2c57ff-553b-4d21-b5c7-5403c9b79b7f tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] [instance: 429ebe93-dd7a-41c4-b80a-0379d3816402] End _get_guest_xml xml=<domain type="kvm">
Aug 09 15:34:22 user nova-compute[72382]:   <uuid>429ebe93-dd7a-41c4-b80a-0379d3816402</uuid>
Aug 09 15:34:22 user nova-compute[72382]:   <name>instance-00000024</name>
Aug 09 15:34:22 user nova-compute[72382]:   <memory>524288</memory>
Aug 09 15:34:22 user nova-compute[72382]:   <vcpu>1</vcpu>
Aug 09 15:34:22 user nova-compute[72382]:   <metadata>
Aug 09 15:34:22 user nova-compute[72382]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 15:34:22 user nova-compute[72382]:       <nova:package version="0.0.0"/>
Aug 09 15:34:22 user nova-compute[72382]:       <nova:name>tempest-AttachVolumeNegativeTest-server-554390021</nova:name>
Aug 09 15:34:22 user nova-compute[72382]:       <nova:creationTime>2023-08-09 15:34:22</nova:creationTime>
Aug 09 15:34:22 user nova-compute[72382]:       <nova:flavor name="m1.tiny">
Aug 09 15:34:22 user nova-compute[72382]:         <nova:memory>512</nova:memory>
Aug 09 15:34:22 user nova-compute[72382]:         <nova:disk>1</nova:disk>
Aug 09 15:34:22 user nova-compute[72382]:         <nova:swap>0</nova:swap>
Aug 09 15:34:22 user nova-compute[72382]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 15:34:22 user nova-compute[72382]:         <nova:vcpus>1</nova:vcpus>
Aug 09 15:34:22 user nova-compute[72382]:       </nova:flavor>
Aug 09 15:34:22 user nova-compute[72382]:       <nova:owner>
Aug 09 15:34:22 user nova-compute[72382]:         <nova:user uuid="401c9df41f284c88a86557485d7d9537">tempest-AttachVolumeNegativeTest-1325594356-project-member</nova:user>
Aug 09 15:34:22 user nova-compute[72382]:         <nova:project uuid="98009994d9c74eb9b4fc6321e82440de">tempest-AttachVolumeNegativeTest-1325594356</nova:project>
Aug 09 15:34:22 user nova-compute[72382]:       </nova:owner>
Aug 09 15:34:22 user nova-compute[72382]:       <nova:root type="image" uuid="a79f2cea-eb27-4631-aaf3-05e7d9e411b4"/>
Aug 09 15:34:22 user nova-compute[72382]:       <nova:ports>
Aug 09 15:34:22 user nova-compute[72382]:         <nova:port uuid="d7669ab9-996e-4cf6-82a3-0083fbb7fa5c">
Aug 09 15:34:22 user nova-compute[72382]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 09 15:34:22 user nova-compute[72382]:         </nova:port>
Aug 09 15:34:22 user nova-compute[72382]:       </nova:ports>
Aug 09 15:34:22 user nova-compute[72382]:     </nova:instance>
Aug 09 15:34:22 user nova-compute[72382]:   </metadata>
Aug 09 15:34:22 user nova-compute[72382]:   <sysinfo type="smbios">
Aug 09 15:34:22 user nova-compute[72382]:     <system>
Aug 09 15:34:22 user nova-compute[72382]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 15:34:22 user nova-compute[72382]:       <entry name="product">OpenStack Nova</entry>
Aug 09 15:34:22 user nova-compute[72382]:       <entry name="version">0.0.0</entry>
Aug 09 15:34:22 user nova-compute[72382]:       <entry name="serial">429ebe93-dd7a-41c4-b80a-0379d3816402</entry>
Aug 09 15:34:22 user nova-compute[72382]:       <entry name="uuid">429ebe93-dd7a-41c4-b80a-0379d3816402</entry>
Aug 09 15:34:22 user nova-compute[72382]:       <entry name="family">Virtual Machine</entry>
Aug 09 15:34:22 user nova-compute[72382]:     </system>
Aug 09 15:34:22 user nova-compute[72382]:   </sysinfo>
Aug 09 15:34:22 user nova-compute[72382]:   <os>
Aug 09 15:34:22 user nova-compute[72382]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 15:34:22 user nova-compute[72382]:     <boot dev="hd"/>
Aug 09 15:34:22 user nova-compute[72382]:     <smbios mode="sysinfo"/>
Aug 09 15:34:22 user nova-compute[72382]:   </os>
Aug 09 15:34:22 user nova-compute[72382]:   <features>
Aug 09 15:34:22 user nova-compute[72382]:     <acpi/>
Aug 09 15:34:22 user nova-compute[72382]:     <apic/>
Aug 09 15:34:22 user nova-compute[72382]:     <vmcoreinfo/>
Aug 09 15:34:22 user nova-compute[72382]:   </features>
Aug 09 15:34:22 user nova-compute[72382]:   <clock offset="utc">
Aug 09 15:34:22 user nova-compute[72382]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 15:34:22 user nova-compute[72382]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 15:34:22 user nova-compute[72382]:     <timer name="hpet" present="no"/>
Aug 09 15:34:22 user nova-compute[72382]:   </clock>
Aug 09 15:34:22 user nova-compute[72382]:   <cpu mode="custom" match="exact">
Aug 09 15:34:22 user nova-compute[72382]:     <model>Nehalem</model>
Aug 09 15:34:22 user nova-compute[72382]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 15:34:22 user nova-compute[72382]:   </cpu>
Aug 09 15:34:22 user nova-compute[72382]:   <devices>
Aug 09 15:34:22 user nova-compute[72382]:     <disk type="file" device="disk">
Aug 09 15:34:22 user nova-compute[72382]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 15:34:22 user nova-compute[72382]:       <source file="/opt/stack/data/nova/instances/429ebe93-dd7a-41c4-b80a-0379d3816402/disk"/>
Aug 09 15:34:22 user nova-compute[72382]:       <target dev="vda" bus="virtio"/>
Aug 09 15:34:22 user nova-compute[72382]:     </disk>
Aug 09 15:34:22 user nova-compute[72382]:     <interface type="ethernet">
Aug 09 15:34:22 user nova-compute[72382]:       <mac address="fa:16:3e:18:b4:42"/>
Aug 09 15:34:22 user nova-compute[72382]:       <model type="virtio"/>
Aug 09 15:34:22 user nova-compute[72382]:       <mtu size="1442"/>
Aug 09 15:34:22 user nova-compute[72382]:       <target dev="tapd7669ab9-99"/>
Aug 09 15:34:22 user nova-compute[72382]:     </interface>
Aug 09 15:34:22 user nova-compute[72382]:     <serial type="pty">
Aug 09 15:34:22 user nova-compute[72382]:       <log file="/opt/stack/data/nova/instances/429ebe93-dd7a-41c4-b80a-0379d3816402/console.log" append="off"/>
Aug 09 15:34:22 user nova-compute[72382]:     </serial>
Aug 09 15:34:22 user nova-compute[72382]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 15:34:22 user nova-compute[72382]:     <video>
Aug 09 15:34:22 user nova-compute[72382]:       <model type="virtio"/>
Aug 09 15:34:22 user nova-compute[72382]:     </video>
Aug 09 15:34:22 user nova-compute[72382]:     <rng model="virtio">
Aug 09 15:34:22 user nova-compute[72382]:       <backend model="random">/dev/urandom</backend>
Aug 09 15:34:22 user nova-compute[72382]:     </rng>
Aug 09 15:34:22 user nova-compute[72382]:     <controller type="usb" index="0" model="none"/>
Aug 09 15:34:22 user nova-compute[72382]:     <memballoon model="virtio">
Aug 09 15:34:22 user nova-compute[72382]:       <stats period="10"/>
Aug 09 15:34:22 user nova-compute[72382]:     </memballoon>
Aug 09 15:34:22 user nova-compute[72382]:   </devices>
Aug 09 15:34:22 user nova-compute[72382]: </domain>
Aug 09 15:34:22 user nova-compute[72382]:  {{(pid=72382) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 15:34:22 user nova-compute[72382]: DEBUG nova.virt.libvirt.vif [None req-bf2c57ff-553b-4d21-b5c7-5403c9b79b7f tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T15:34:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-554390021',display_name='tempest-AttachVolumeNegativeTest-server-554390021',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-554390021',id=36,image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPr9UKLHRdNpgLNg1y/Qg5MQvxAflbKswHUG5+9EhnkuIACQbwD4DtPjuy/KhcLwWGdSuifIZaH2x296ZeqXrcCbIeVsn4VdvhRheyfe1WPiSZsf3ywZ+N4qEbGvdtwrYg==',key_name='tempest-keypair-1273601612',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='98009994d9c74eb9b4fc6321e82440de',ramdisk_id='',reservation_id='r-rcnmt08c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1325594356',owner_user_name='tempest-AttachVolumeNegativeTest-1325594356-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T15:34:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='401c9df41f284c88a86557485d7d9537',uuid=429ebe93-dd7a-41c4-b80a-0379d3816402,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d7669ab9-996e-4cf6-82a3-0083fbb7fa5c", "address": "fa:16:3e:18:b4:42", "network": {"id": "46eb5f03-e04d-43d1-96d6-0792bc7a94b1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1842512309-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98009994d9c74eb9b4fc6321e82440de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7669ab9-99", "ovs_interfaceid": "d7669ab9-996e-4cf6-82a3-0083fbb7fa5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 15:34:22 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-bf2c57ff-553b-4d21-b5c7-5403c9b79b7f tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Converting VIF {"id": "d7669ab9-996e-4cf6-82a3-0083fbb7fa5c", "address": "fa:16:3e:18:b4:42", "network": {"id": "46eb5f03-e04d-43d1-96d6-0792bc7a94b1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1842512309-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98009994d9c74eb9b4fc6321e82440de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7669ab9-99", "ovs_interfaceid": "d7669ab9-996e-4cf6-82a3-0083fbb7fa5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 15:34:22 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-bf2c57ff-553b-4d21-b5c7-5403c9b79b7f tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:18:b4:42,bridge_name='br-int',has_traffic_filtering=True,id=d7669ab9-996e-4cf6-82a3-0083fbb7fa5c,network=Network(46eb5f03-e04d-43d1-96d6-0792bc7a94b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7669ab9-99') {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 15:34:22 user nova-compute[72382]: DEBUG os_vif [None req-bf2c57ff-553b-4d21-b5c7-5403c9b79b7f tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:b4:42,bridge_name='br-int',has_traffic_filtering=True,id=d7669ab9-996e-4cf6-82a3-0083fbb7fa5c,network=Network(46eb5f03-e04d-43d1-96d6-0792bc7a94b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7669ab9-99') {{(pid=72382) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 15:34:22 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:34:22 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:34:22 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 15:34:22 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:34:22 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd7669ab9-99, may_exist=True, interface_attrs={}) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:34:22 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd7669ab9-99, col_values=(('external_ids', {'iface-id': 'd7669ab9-996e-4cf6-82a3-0083fbb7fa5c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:18:b4:42', 'vm-uuid': '429ebe93-dd7a-41c4-b80a-0379d3816402'}),), if_exists=True) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:34:22 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:34:22 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:34:22 user nova-compute[72382]: INFO os_vif [None req-bf2c57ff-553b-4d21-b5c7-5403c9b79b7f tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:b4:42,bridge_name='br-int',has_traffic_filtering=True,id=d7669ab9-996e-4cf6-82a3-0083fbb7fa5c,network=Network(46eb5f03-e04d-43d1-96d6-0792bc7a94b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7669ab9-99')
Aug 09 15:34:22 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-bf2c57ff-553b-4d21-b5c7-5403c9b79b7f tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] No BDM found with device name vda, not building metadata. {{(pid=72382) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 15:34:22 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-bf2c57ff-553b-4d21-b5c7-5403c9b79b7f tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] No VIF found with MAC fa:16:3e:18:b4:42, not building metadata {{(pid=72382) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 15:34:22 user nova-compute[72382]: DEBUG nova.network.neutron [req-28c1f620-3380-4bf5-8dd9-00a49d361c2a req-173197b3-c8b5-468f-80e3-75a9d6b0b7f5 service nova] [instance: 429ebe93-dd7a-41c4-b80a-0379d3816402] Updated VIF entry in instance network info cache for port d7669ab9-996e-4cf6-82a3-0083fbb7fa5c. {{(pid=72382) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 15:34:22 user nova-compute[72382]: DEBUG nova.network.neutron [req-28c1f620-3380-4bf5-8dd9-00a49d361c2a req-173197b3-c8b5-468f-80e3-75a9d6b0b7f5 service nova] [instance: 429ebe93-dd7a-41c4-b80a-0379d3816402] Updating instance_info_cache with network_info: [{"id": "d7669ab9-996e-4cf6-82a3-0083fbb7fa5c", "address": "fa:16:3e:18:b4:42", "network": {"id": "46eb5f03-e04d-43d1-96d6-0792bc7a94b1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1842512309-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98009994d9c74eb9b4fc6321e82440de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7669ab9-99", "ovs_interfaceid": "d7669ab9-996e-4cf6-82a3-0083fbb7fa5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:34:22 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-28c1f620-3380-4bf5-8dd9-00a49d361c2a req-173197b3-c8b5-468f-80e3-75a9d6b0b7f5 service nova] Releasing lock "refresh_cache-429ebe93-dd7a-41c4-b80a-0379d3816402" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 15:34:23 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-3cdc9f6b-a292-40b4-bce9-b1179124bfa6 tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] Acquiring lock "c88a5ff2-9789-4ee8-8283-6248bba6d66a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:34:23 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-3cdc9f6b-a292-40b4-bce9-b1179124bfa6 tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] Lock "c88a5ff2-9789-4ee8-8283-6248bba6d66a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:34:23 user nova-compute[72382]: DEBUG nova.compute.manager [None req-3cdc9f6b-a292-40b4-bce9-b1179124bfa6 tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] [instance: c88a5ff2-9789-4ee8-8283-6248bba6d66a] Starting instance... {{(pid=72382) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 15:34:23 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-3cdc9f6b-a292-40b4-bce9-b1179124bfa6 tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:34:23 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-3cdc9f6b-a292-40b4-bce9-b1179124bfa6 tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:34:23 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-3cdc9f6b-a292-40b4-bce9-b1179124bfa6 tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72382) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 15:34:23 user nova-compute[72382]: INFO nova.compute.claims [None req-3cdc9f6b-a292-40b4-bce9-b1179124bfa6 tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] [instance: c88a5ff2-9789-4ee8-8283-6248bba6d66a] Claim successful on node user
Aug 09 15:34:23 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:34:23 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:34:23 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:34:23 user nova-compute[72382]: DEBUG nova.compute.provider_tree [None req-3cdc9f6b-a292-40b4-bce9-b1179124bfa6 tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] Inventory has not changed in ProviderTree for provider: 7b15b0e5-df4d-49db-833b-2855d21d10ae {{(pid=72382) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 15:34:23 user nova-compute[72382]: DEBUG nova.scheduler.client.report [None req-3cdc9f6b-a292-40b4-bce9-b1179124bfa6 tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] Inventory has not changed for provider 7b15b0e5-df4d-49db-833b-2855d21d10ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72382) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 15:34:23 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-3cdc9f6b-a292-40b4-bce9-b1179124bfa6 tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.365s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:34:23 user nova-compute[72382]: DEBUG nova.compute.manager [None req-3cdc9f6b-a292-40b4-bce9-b1179124bfa6 tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] [instance: c88a5ff2-9789-4ee8-8283-6248bba6d66a] Start building networks asynchronously for instance. {{(pid=72382) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 15:34:23 user nova-compute[72382]: DEBUG nova.compute.manager [None req-3cdc9f6b-a292-40b4-bce9-b1179124bfa6 tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] [instance: c88a5ff2-9789-4ee8-8283-6248bba6d66a] Allocating IP information in the background. {{(pid=72382) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 15:34:23 user nova-compute[72382]: DEBUG nova.network.neutron [None req-3cdc9f6b-a292-40b4-bce9-b1179124bfa6 tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] [instance: c88a5ff2-9789-4ee8-8283-6248bba6d66a] allocate_for_instance() {{(pid=72382) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 15:34:23 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-3cdc9f6b-a292-40b4-bce9-b1179124bfa6 tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] [instance: c88a5ff2-9789-4ee8-8283-6248bba6d66a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 15:34:23 user nova-compute[72382]: DEBUG nova.compute.manager [req-74adf0b4-2bf6-4ca3-bc47-ac3a3f77eabc req-0b256be7-a09b-48bb-a7df-76dc92738303 service nova] [instance: 429ebe93-dd7a-41c4-b80a-0379d3816402] Received event network-vif-plugged-d7669ab9-996e-4cf6-82a3-0083fbb7fa5c {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:34:23 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-74adf0b4-2bf6-4ca3-bc47-ac3a3f77eabc req-0b256be7-a09b-48bb-a7df-76dc92738303 service nova] Acquiring lock "429ebe93-dd7a-41c4-b80a-0379d3816402-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:34:23 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-74adf0b4-2bf6-4ca3-bc47-ac3a3f77eabc req-0b256be7-a09b-48bb-a7df-76dc92738303 service nova] Lock "429ebe93-dd7a-41c4-b80a-0379d3816402-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:34:23 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-74adf0b4-2bf6-4ca3-bc47-ac3a3f77eabc req-0b256be7-a09b-48bb-a7df-76dc92738303 service nova] Lock "429ebe93-dd7a-41c4-b80a-0379d3816402-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:34:23 user nova-compute[72382]: DEBUG nova.compute.manager [req-74adf0b4-2bf6-4ca3-bc47-ac3a3f77eabc req-0b256be7-a09b-48bb-a7df-76dc92738303 service nova] [instance: 429ebe93-dd7a-41c4-b80a-0379d3816402] No waiting events found dispatching network-vif-plugged-d7669ab9-996e-4cf6-82a3-0083fbb7fa5c {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:34:23 user nova-compute[72382]: WARNING nova.compute.manager [req-74adf0b4-2bf6-4ca3-bc47-ac3a3f77eabc req-0b256be7-a09b-48bb-a7df-76dc92738303 service nova] [instance: 429ebe93-dd7a-41c4-b80a-0379d3816402] Received unexpected event network-vif-plugged-d7669ab9-996e-4cf6-82a3-0083fbb7fa5c for instance with vm_state building and task_state spawning.
Aug 09 15:34:23 user nova-compute[72382]: DEBUG nova.compute.manager [None req-3cdc9f6b-a292-40b4-bce9-b1179124bfa6 tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] [instance: c88a5ff2-9789-4ee8-8283-6248bba6d66a] Start building block device mappings for instance. {{(pid=72382) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 15:34:23 user nova-compute[72382]: DEBUG nova.policy [None req-3cdc9f6b-a292-40b4-bce9-b1179124bfa6 tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '827f726259fb452aad32077e24ec4fc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '108a420b4c6e451d8429d21665e12fb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72382) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 15:34:23 user nova-compute[72382]: INFO nova.virt.block_device [None req-3cdc9f6b-a292-40b4-bce9-b1179124bfa6 tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] [instance: c88a5ff2-9789-4ee8-8283-6248bba6d66a] Booting with volume d2f5dbb5-f862-4389-b42a-872d5c94aa55 at /dev/vda
Aug 09 15:34:23 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:34:23 user nova-compute[72382]: DEBUG os_brick.utils [None req-3cdc9f6b-a292-40b4-bce9-b1179124bfa6 tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 15:34:23 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:34:23 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:34:23 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[4232212d-306a-4d4c-b9e0-a578696952f9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d2cfa7015fe\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:34:23 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:34:23 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:34:23 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[58f2a65f-16bd-4abb-8aa4-cfbe34355242]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:34:23 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:34:24 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:34:24 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[c503840a-d812-4c7c-b4ef-1446dba4139a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:34:24 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[f06b6aa7-dbf9-484b-a563-d2b673cf5bf5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:34:24 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-3cdc9f6b-a292-40b4-bce9-b1179124bfa6 tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] Running cmd (subprocess): nvme version {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:34:24 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-3cdc9f6b-a292-40b4-bce9-b1179124bfa6 tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] 'nvme version' failed. Not Retrying. {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 15:34:24 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3cdc9f6b-a292-40b4-bce9-b1179124bfa6 tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] nvme not present on system {{(pid=72382) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 15:34:24 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:34:24 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 15:34:24 user nova-compute[72382]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 15:34:24 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[c48175b1-8b2e-4238-8ba2-25485cb60463]: (4, '') {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:34:24 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.lightos [None req-3cdc9f6b-a292-40b4-bce9-b1179124bfa6 tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72382) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 15:34:24 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.lightos [None req-3cdc9f6b-a292-40b4-bce9-b1179124bfa6 tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72382) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 15:34:24 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.lightos [None req-3cdc9f6b-a292-40b4-bce9-b1179124bfa6 tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] LIGHTOS: no hostnqn found. {{(pid=72382) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 15:34:24 user nova-compute[72382]: DEBUG os_brick.utils [None req-3cdc9f6b-a292-40b4-bce9-b1179124bfa6 tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] <== get_connector_properties: return (161ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d2cfa7015fe', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 15:34:24 user nova-compute[72382]: DEBUG nova.virt.block_device [None req-3cdc9f6b-a292-40b4-bce9-b1179124bfa6 tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] [instance: c88a5ff2-9789-4ee8-8283-6248bba6d66a] Updating existing volume attachment record: e9af754a-4e78-4ce9-8395-f84cb448b9ae {{(pid=72382) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 15:34:24 user nova-compute[72382]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691595249.0976415, b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d => Stopped> {{(pid=72382) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 15:34:24 user nova-compute[72382]: INFO nova.compute.manager [-] [instance: b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d] VM Stopped (Lifecycle Event)
Aug 09 15:34:24 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:34:24 user nova-compute[72382]: DEBUG nova.compute.manager [None req-70209b6a-4159-4a12-ad0f-0c3072635351 None None] [instance: b4c08d2a-e155-4e38-8982-a4ee3ca9bf2d] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:34:24 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:34:24 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:34:24 user nova-compute[72382]: DEBUG nova.network.neutron [None req-3cdc9f6b-a292-40b4-bce9-b1179124bfa6 tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] [instance: c88a5ff2-9789-4ee8-8283-6248bba6d66a] Successfully created port: 4f9e0eae-81c7-4a91-8ac1-51459e231532 {{(pid=72382) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 15:34:24 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:34:25 user nova-compute[72382]: DEBUG nova.network.neutron [None req-3cdc9f6b-a292-40b4-bce9-b1179124bfa6 tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] [instance: c88a5ff2-9789-4ee8-8283-6248bba6d66a] Successfully updated port: 4f9e0eae-81c7-4a91-8ac1-51459e231532 {{(pid=72382) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 15:34:25 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-3cdc9f6b-a292-40b4-bce9-b1179124bfa6 tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] Acquiring lock "refresh_cache-c88a5ff2-9789-4ee8-8283-6248bba6d66a" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 15:34:25 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-3cdc9f6b-a292-40b4-bce9-b1179124bfa6 tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] Acquired lock "refresh_cache-c88a5ff2-9789-4ee8-8283-6248bba6d66a" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 15:34:25 user nova-compute[72382]: DEBUG nova.network.neutron [None req-3cdc9f6b-a292-40b4-bce9-b1179124bfa6 tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] [instance: c88a5ff2-9789-4ee8-8283-6248bba6d66a] Building network info cache for instance {{(pid=72382) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 15:34:25 user nova-compute[72382]: DEBUG nova.compute.manager [req-a0e582bb-256a-4e4c-b3ba-ae3b15216ffc req-93ad0b7f-57e0-48eb-a239-9ec45aa26c76 service nova] [instance: 429ebe93-dd7a-41c4-b80a-0379d3816402] Received event network-vif-plugged-d7669ab9-996e-4cf6-82a3-0083fbb7fa5c {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:34:25 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-a0e582bb-256a-4e4c-b3ba-ae3b15216ffc req-93ad0b7f-57e0-48eb-a239-9ec45aa26c76 service nova] Acquiring lock "429ebe93-dd7a-41c4-b80a-0379d3816402-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:34:25 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-a0e582bb-256a-4e4c-b3ba-ae3b15216ffc req-93ad0b7f-57e0-48eb-a239-9ec45aa26c76 service nova] Lock "429ebe93-dd7a-41c4-b80a-0379d3816402-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:34:25 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-a0e582bb-256a-4e4c-b3ba-ae3b15216ffc req-93ad0b7f-57e0-48eb-a239-9ec45aa26c76 service nova] Lock "429ebe93-dd7a-41c4-b80a-0379d3816402-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:34:25 user nova-compute[72382]: DEBUG nova.compute.manager [req-a0e582bb-256a-4e4c-b3ba-ae3b15216ffc req-93ad0b7f-57e0-48eb-a239-9ec45aa26c76 service nova] [instance: 429ebe93-dd7a-41c4-b80a-0379d3816402] No waiting events found dispatching network-vif-plugged-d7669ab9-996e-4cf6-82a3-0083fbb7fa5c {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:34:25 user nova-compute[72382]: WARNING nova.compute.manager [req-a0e582bb-256a-4e4c-b3ba-ae3b15216ffc req-93ad0b7f-57e0-48eb-a239-9ec45aa26c76 service nova] [instance: 429ebe93-dd7a-41c4-b80a-0379d3816402] Received unexpected event network-vif-plugged-d7669ab9-996e-4cf6-82a3-0083fbb7fa5c for instance with vm_state building and task_state spawning.
Aug 09 15:34:25 user nova-compute[72382]: DEBUG nova.compute.manager [req-d63a842e-8504-4328-bc90-93c08da22b81 req-03487377-72e7-48ec-b26b-6040769e64b5 service nova] [instance: c88a5ff2-9789-4ee8-8283-6248bba6d66a] Received event network-changed-4f9e0eae-81c7-4a91-8ac1-51459e231532 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:34:25 user nova-compute[72382]: DEBUG nova.compute.manager [req-d63a842e-8504-4328-bc90-93c08da22b81 req-03487377-72e7-48ec-b26b-6040769e64b5 service nova] [instance: c88a5ff2-9789-4ee8-8283-6248bba6d66a] Refreshing instance network info cache due to event network-changed-4f9e0eae-81c7-4a91-8ac1-51459e231532. {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 15:34:25 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-d63a842e-8504-4328-bc90-93c08da22b81 req-03487377-72e7-48ec-b26b-6040769e64b5 service nova] Acquiring lock "refresh_cache-c88a5ff2-9789-4ee8-8283-6248bba6d66a" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 15:34:25 user nova-compute[72382]: DEBUG nova.network.neutron [None req-3cdc9f6b-a292-40b4-bce9-b1179124bfa6 tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] [instance: c88a5ff2-9789-4ee8-8283-6248bba6d66a] Instance cache missing network info. {{(pid=72382) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 15:34:25 user nova-compute[72382]: DEBUG nova.compute.manager [None req-bf2c57ff-553b-4d21-b5c7-5403c9b79b7f tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] [instance: 429ebe93-dd7a-41c4-b80a-0379d3816402] Instance event wait completed in 0 seconds for  {{(pid=72382) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 15:34:25 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-bf2c57ff-553b-4d21-b5c7-5403c9b79b7f tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] [instance: 429ebe93-dd7a-41c4-b80a-0379d3816402] Guest created on hypervisor {{(pid=72382) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 15:34:25 user nova-compute[72382]: DEBUG nova.virt.driver [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Emitting event <LifecycleEvent: 1691595265.970175, 429ebe93-dd7a-41c4-b80a-0379d3816402 => Resumed> {{(pid=72382) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 15:34:25 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 429ebe93-dd7a-41c4-b80a-0379d3816402] VM Resumed (Lifecycle Event)
Aug 09 15:34:25 user nova-compute[72382]: INFO nova.virt.libvirt.driver [-] [instance: 429ebe93-dd7a-41c4-b80a-0379d3816402] Instance spawned successfully.
Aug 09 15:34:25 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-bf2c57ff-553b-4d21-b5c7-5403c9b79b7f tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] [instance: 429ebe93-dd7a-41c4-b80a-0379d3816402] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 15:34:25 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 429ebe93-dd7a-41c4-b80a-0379d3816402] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:34:26 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-bf2c57ff-553b-4d21-b5c7-5403c9b79b7f tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] [instance: 429ebe93-dd7a-41c4-b80a-0379d3816402] Found default for hw_cdrom_bus of ide {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:34:26 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-bf2c57ff-553b-4d21-b5c7-5403c9b79b7f tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] [instance: 429ebe93-dd7a-41c4-b80a-0379d3816402] Found default for hw_disk_bus of virtio {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:34:26 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-bf2c57ff-553b-4d21-b5c7-5403c9b79b7f tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] [instance: 429ebe93-dd7a-41c4-b80a-0379d3816402] Found default for hw_input_bus of None {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:34:26 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-bf2c57ff-553b-4d21-b5c7-5403c9b79b7f tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] [instance: 429ebe93-dd7a-41c4-b80a-0379d3816402] Found default for hw_pointer_model of None {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:34:26 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-bf2c57ff-553b-4d21-b5c7-5403c9b79b7f tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] [instance: 429ebe93-dd7a-41c4-b80a-0379d3816402] Found default for hw_video_model of virtio {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:34:26 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-bf2c57ff-553b-4d21-b5c7-5403c9b79b7f tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] [instance: 429ebe93-dd7a-41c4-b80a-0379d3816402] Found default for hw_vif_model of virtio {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:34:26 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 429ebe93-dd7a-41c4-b80a-0379d3816402] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72382) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 15:34:26 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 429ebe93-dd7a-41c4-b80a-0379d3816402] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 15:34:26 user nova-compute[72382]: DEBUG nova.virt.driver [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Emitting event <LifecycleEvent: 1691595265.970815, 429ebe93-dd7a-41c4-b80a-0379d3816402 => Started> {{(pid=72382) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 15:34:26 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 429ebe93-dd7a-41c4-b80a-0379d3816402] VM Started (Lifecycle Event)
Aug 09 15:34:26 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 429ebe93-dd7a-41c4-b80a-0379d3816402] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:34:26 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 429ebe93-dd7a-41c4-b80a-0379d3816402] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72382) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 15:34:26 user nova-compute[72382]: INFO nova.compute.manager [None req-bf2c57ff-553b-4d21-b5c7-5403c9b79b7f tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] [instance: 429ebe93-dd7a-41c4-b80a-0379d3816402] Took 5.94 seconds to spawn the instance on the hypervisor.
Aug 09 15:34:26 user nova-compute[72382]: DEBUG nova.compute.manager [None req-bf2c57ff-553b-4d21-b5c7-5403c9b79b7f tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] [instance: 429ebe93-dd7a-41c4-b80a-0379d3816402] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:34:26 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 429ebe93-dd7a-41c4-b80a-0379d3816402] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 15:34:26 user nova-compute[72382]: INFO nova.compute.manager [None req-bf2c57ff-553b-4d21-b5c7-5403c9b79b7f tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] [instance: 429ebe93-dd7a-41c4-b80a-0379d3816402] Took 6.86 seconds to build instance.
Aug 09 15:34:26 user nova-compute[72382]: DEBUG nova.network.neutron [None req-3cdc9f6b-a292-40b4-bce9-b1179124bfa6 tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] [instance: c88a5ff2-9789-4ee8-8283-6248bba6d66a] Updating instance_info_cache with network_info: [{"id": "4f9e0eae-81c7-4a91-8ac1-51459e231532", "address": "fa:16:3e:b2:aa:71", "network": {"id": "5f3f6e0f-94b3-4a66-9839-763a2e2d259c", "bridge": "br-int", "label": "tempest-TestShelveInstance-338163972-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "108a420b4c6e451d8429d21665e12fb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f9e0eae-81", "ovs_interfaceid": "4f9e0eae-81c7-4a91-8ac1-51459e231532", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:34:26 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-bf2c57ff-553b-4d21-b5c7-5403c9b79b7f tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Lock "429ebe93-dd7a-41c4-b80a-0379d3816402" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.989s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:34:26 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-3cdc9f6b-a292-40b4-bce9-b1179124bfa6 tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] Releasing lock "refresh_cache-c88a5ff2-9789-4ee8-8283-6248bba6d66a" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 15:34:26 user nova-compute[72382]: DEBUG nova.compute.manager [None req-3cdc9f6b-a292-40b4-bce9-b1179124bfa6 tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] [instance: c88a5ff2-9789-4ee8-8283-6248bba6d66a] Instance network_info: |[{"id": "4f9e0eae-81c7-4a91-8ac1-51459e231532", "address": "fa:16:3e:b2:aa:71", "network": {"id": "5f3f6e0f-94b3-4a66-9839-763a2e2d259c", "bridge": "br-int", "label": "tempest-TestShelveInstance-338163972-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "108a420b4c6e451d8429d21665e12fb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f9e0eae-81", "ovs_interfaceid": "4f9e0eae-81c7-4a91-8ac1-51459e231532", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72382) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 15:34:26 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-d63a842e-8504-4328-bc90-93c08da22b81 req-03487377-72e7-48ec-b26b-6040769e64b5 service nova] Acquired lock "refresh_cache-c88a5ff2-9789-4ee8-8283-6248bba6d66a" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 15:34:26 user nova-compute[72382]: DEBUG nova.network.neutron [req-d63a842e-8504-4328-bc90-93c08da22b81 req-03487377-72e7-48ec-b26b-6040769e64b5 service nova] [instance: c88a5ff2-9789-4ee8-8283-6248bba6d66a] Refreshing network info cache for port 4f9e0eae-81c7-4a91-8ac1-51459e231532 {{(pid=72382) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 15:34:26 user nova-compute[72382]: DEBUG nova.network.neutron [req-d63a842e-8504-4328-bc90-93c08da22b81 req-03487377-72e7-48ec-b26b-6040769e64b5 service nova] [instance: c88a5ff2-9789-4ee8-8283-6248bba6d66a] Updated VIF entry in instance network info cache for port 4f9e0eae-81c7-4a91-8ac1-51459e231532. {{(pid=72382) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 15:34:26 user nova-compute[72382]: DEBUG nova.network.neutron [req-d63a842e-8504-4328-bc90-93c08da22b81 req-03487377-72e7-48ec-b26b-6040769e64b5 service nova] [instance: c88a5ff2-9789-4ee8-8283-6248bba6d66a] Updating instance_info_cache with network_info: [{"id": "4f9e0eae-81c7-4a91-8ac1-51459e231532", "address": "fa:16:3e:b2:aa:71", "network": {"id": "5f3f6e0f-94b3-4a66-9839-763a2e2d259c", "bridge": "br-int", "label": "tempest-TestShelveInstance-338163972-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "108a420b4c6e451d8429d21665e12fb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f9e0eae-81", "ovs_interfaceid": "4f9e0eae-81c7-4a91-8ac1-51459e231532", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:34:26 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-d63a842e-8504-4328-bc90-93c08da22b81 req-03487377-72e7-48ec-b26b-6040769e64b5 service nova] Releasing lock "refresh_cache-c88a5ff2-9789-4ee8-8283-6248bba6d66a" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 15:34:27 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:34:29 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:34:32 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:34:32 user nova-compute[72382]: DEBUG nova.compute.manager [None req-3cdc9f6b-a292-40b4-bce9-b1179124bfa6 tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] [instance: c88a5ff2-9789-4ee8-8283-6248bba6d66a] Start spawning the instance on the hypervisor. {{(pid=72382) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 15:34:32 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-3cdc9f6b-a292-40b4-bce9-b1179124bfa6 tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] [instance: c88a5ff2-9789-4ee8-8283-6248bba6d66a] Creating instance directory {{(pid=72382) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 15:34:32 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-3cdc9f6b-a292-40b4-bce9-b1179124bfa6 tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] [instance: c88a5ff2-9789-4ee8-8283-6248bba6d66a] Creating image(s)
Aug 09 15:34:32 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-3cdc9f6b-a292-40b4-bce9-b1179124bfa6 tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] [instance: c88a5ff2-9789-4ee8-8283-6248bba6d66a] Did not create local disks {{(pid=72382) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 09 15:34:32 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-3cdc9f6b-a292-40b4-bce9-b1179124bfa6 tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] [instance: c88a5ff2-9789-4ee8-8283-6248bba6d66a] Ensure instance console log exists: /opt/stack/data/nova/instances/c88a5ff2-9789-4ee8-8283-6248bba6d66a/console.log {{(pid=72382) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 15:34:32 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-3cdc9f6b-a292-40b4-bce9-b1179124bfa6 tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:34:32 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-3cdc9f6b-a292-40b4-bce9-b1179124bfa6 tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:34:32 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-3cdc9f6b-a292-40b4-bce9-b1179124bfa6 tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:34:32 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-3cdc9f6b-a292-40b4-bce9-b1179124bfa6 tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] [instance: c88a5ff2-9789-4ee8-8283-6248bba6d66a] Start _get_guest_xml network_info=[{"id": "4f9e0eae-81c7-4a91-8ac1-51459e231532", "address": "fa:16:3e:b2:aa:71", "network": {"id": "5f3f6e0f-94b3-4a66-9839-763a2e2d259c", "bridge": "br-int", "label": "tempest-TestShelveInstance-338163972-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "108a420b4c6e451d8429d21665e12fb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f9e0eae-81", "ovs_interfaceid": "4f9e0eae-81c7-4a91-8ac1-51459e231532", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:d2f5dbb5-f862-4389-b42a-872d5c94aa55'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JoLXOIMx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'c88a5ff2-9789-4ee8-8283-6248bba6d66a', 'attached_at': '', 'detached_at': '', 'volume_id': 'd2f5dbb5-f862-4389-b42a-872d5c94aa55', 'serial': 'd2f5dbb5-f862-4389-b42a-872d5c94aa55'}, 'disk_bus': 'virtio', 'attachment_id': 'e9af754a-4e78-4ce9-8395-f84cb448b9ae', 'delete_on_termination': True, 'volume_type': None} {{(pid=72382) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 15:34:32 user nova-compute[72382]: WARNING nova.virt.libvirt.driver [None req-3cdc9f6b-a292-40b4-bce9-b1179124bfa6 tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 15:34:32 user nova-compute[72382]: WARNING nova.virt.libvirt.driver [None req-3cdc9f6b-a292-40b4-bce9-b1179124bfa6 tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 15:34:32 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-3cdc9f6b-a292-40b4-bce9-b1179124bfa6 tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72382) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 15:34:32 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-3cdc9f6b-a292-40b4-bce9-b1179124bfa6 tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] CPU controller missing on host. {{(pid=72382) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 15:34:32 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-3cdc9f6b-a292-40b4-bce9-b1179124bfa6 tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72382) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 15:34:32 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-3cdc9f6b-a292-40b4-bce9-b1179124bfa6 tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] CPU controller found on host. {{(pid=72382) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 15:34:32 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-3cdc9f6b-a292-40b4-bce9-b1179124bfa6 tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72382) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 15:34:32 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-3cdc9f6b-a292-40b4-bce9-b1179124bfa6 tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T15:11:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 15:34:32 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-3cdc9f6b-a292-40b4-bce9-b1179124bfa6 tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] Flavor limits 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 15:34:32 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-3cdc9f6b-a292-40b4-bce9-b1179124bfa6 tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] Image limits 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 15:34:32 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-3cdc9f6b-a292-40b4-bce9-b1179124bfa6 tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] Flavor pref 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 15:34:32 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-3cdc9f6b-a292-40b4-bce9-b1179124bfa6 tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] Image pref 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 15:34:32 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-3cdc9f6b-a292-40b4-bce9-b1179124bfa6 tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 15:34:32 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-3cdc9f6b-a292-40b4-bce9-b1179124bfa6 tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 15:34:32 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-3cdc9f6b-a292-40b4-bce9-b1179124bfa6 tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72382) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 15:34:32 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-3cdc9f6b-a292-40b4-bce9-b1179124bfa6 tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] Got 1 possible topologies {{(pid=72382) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 15:34:32 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-3cdc9f6b-a292-40b4-bce9-b1179124bfa6 tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 15:34:32 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-3cdc9f6b-a292-40b4-bce9-b1179124bfa6 tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 15:34:32 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3cdc9f6b-a292-40b4-bce9-b1179124bfa6 tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] [instance: c88a5ff2-9789-4ee8-8283-6248bba6d66a] Calling os-brick to attach iSCSI Volume {{(pid=72382) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 15:34:32 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cdc9f6b-a292-40b4-bce9-b1179124bfa6 tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2a0c768340>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:d2f5dbb5-f862-4389-b42a-872d5c94aa55'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JoLXOIMx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 15:34:32 user nova-compute[72382]: WARNING os_brick.initiator.connectors.base [None req-3cdc9f6b-a292-40b4-bce9-b1179124bfa6 tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 15:34:32 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-3cdc9f6b-a292-40b4-bce9-b1179124bfa6 tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 15:34:32 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-3cdc9f6b-a292-40b4-bce9-b1179124bfa6 tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 15:34:32 user nova-compute[72382]: WARNING os_brick.initiator.connectors.base [None req-3cdc9f6b-a292-40b4-bce9-b1179124bfa6 tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 15:34:32 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-3cdc9f6b-a292-40b4-bce9-b1179124bfa6 tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d2f5dbb5-f862-4389-b42a-872d5c94aa55" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 15:34:32 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-3cdc9f6b-a292-40b4-bce9-b1179124bfa6 tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d2f5dbb5-f862-4389-b42a-872d5c94aa55" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 15:34:32 user nova-compute[72382]: INFO os_brick.initiator.connectors.iscsi [None req-3cdc9f6b-a292-40b4-bce9-b1179124bfa6 tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 15:34:32 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2f5dbb5-f862-4389-b42a-872d5c94aa55 -p 172.16.0.220:3260 {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:34:32 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2f5dbb5-f862-4389-b42a-872d5c94aa55 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:34:32 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[be5712c2-dffd-4406-a001-5bbe75f43bf3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:34:32 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cdc9f6b-a292-40b4-bce9-b1179124bfa6 tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 15:34:32 user nova-compute[72382]:  {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:34:32 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2f5dbb5-f862-4389-b42a-872d5c94aa55 -p 172.16.0.220:3260 --interface default --op new {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:34:32 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2f5dbb5-f862-4389-b42a-872d5c94aa55 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:34:32 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed57ae45-e4cf-4fa3-b79d-156efe5e065a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d2f5dbb5-f862-4389-b42a-872d5c94aa55] added\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:34:32 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cdc9f6b-a292-40b4-bce9-b1179124bfa6 tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d2f5dbb5-f862-4389-b42a-872d5c94aa55] added
Aug 09 15:34:32 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:34:32 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2f5dbb5-f862-4389-b42a-872d5c94aa55 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:34:32 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2f5dbb5-f862-4389-b42a-872d5c94aa55 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:34:32 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce94fa6e-323e-438c-a439-e9e037c6a600]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:34:32 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cdc9f6b-a292-40b4-bce9-b1179124bfa6 tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:34:32 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2f5dbb5-f862-4389-b42a-872d5c94aa55 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:34:32 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2f5dbb5-f862-4389-b42a-872d5c94aa55 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:34:32 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2fda44c-7a50-4a75-a123-03075eed59da]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:34:32 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cdc9f6b-a292-40b4-bce9-b1179124bfa6 tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:34:32 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2f5dbb5-f862-4389-b42a-872d5c94aa55 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JoLXOIMx {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:34:32 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2f5dbb5-f862-4389-b42a-872d5c94aa55 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JoLXOIMx" returned: 0 in 0.017s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:34:32 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2b12fb3-0864-4b2c-87a3-0a531cf4576f]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:34:32 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cdc9f6b-a292-40b4-bce9-b1179124bfa6 tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JoLXOIMx'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:34:32 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2f5dbb5-f862-4389-b42a-872d5c94aa55 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:34:32 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2f5dbb5-f862-4389-b42a-872d5c94aa55 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:34:32 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[603b781c-905d-459e-aa4c-7dff282a1789]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:34:32 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cdc9f6b-a292-40b4-bce9-b1179124bfa6 tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:34:32 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:34:32 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:34:32 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[785e5297-5e95-473f-8bcd-01e2124e28fa]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59852df5-d4c8-4f25-8693-36181ff6a447 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b93bb40-75bb-4387-aa01-c839f97e3432 (non-flash)\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:34:32 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cdc9f6b-a292-40b4-bce9-b1179124bfa6 tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59852df5-d4c8-4f25-8693-36181ff6a447 (non-flash)
Aug 09 15:34:32 user nova-compute[72382]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b93bb40-75bb-4387-aa01-c839f97e3432 (non-flash)
Aug 09 15:34:32 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 15:34:32 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cdc9f6b-a292-40b4-bce9-b1179124bfa6 tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59852df5-d4c8-4f25-8693-36181ff6a447 (non-flash)
Aug 09 15:34:32 user nova-compute[72382]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b93bb40-75bb-4387-aa01-c839f97e3432 (non-flash)
Aug 09 15:34:32 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 15:34:32 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2f5dbb5-f862-4389-b42a-872d5c94aa55 -p 172.16.0.220:3260 --login {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:34:33 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2f5dbb5-f862-4389-b42a-872d5c94aa55 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:34:33 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[022d804b-0a12-461e-b968-2c9438bd5a02]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d2f5dbb5-f862-4389-b42a-872d5c94aa55, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d2f5dbb5-f862-4389-b42a-872d5c94aa55, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:34:33 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cdc9f6b-a292-40b4-bce9-b1179124bfa6 tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d2f5dbb5-f862-4389-b42a-872d5c94aa55, portal: 172.16.0.220,3260]
Aug 09 15:34:33 user nova-compute[72382]: Login to [iface: default, target: iqn.2010-10.org.openstack:d2f5dbb5-f862-4389-b42a-872d5c94aa55, portal: 172.16.0.220,3260] successful.
Aug 09 15:34:33 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:34:33 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2f5dbb5-f862-4389-b42a-872d5c94aa55 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:34:33 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2f5dbb5-f862-4389-b42a-872d5c94aa55 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:34:33 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[97e193a7-9da5-4494-9d15-f90d0732e05b]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:34:33 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cdc9f6b-a292-40b4-bce9-b1179124bfa6 tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:34:33 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:34:33 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:34:33 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dda2c88-44ad-4b94-b5fb-69e7a5e69509]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59852df5-d4c8-4f25-8693-36181ff6a447 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b93bb40-75bb-4387-aa01-c839f97e3432 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2f5dbb5-f862-4389-b42a-872d5c94aa55 (non-flash)\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:34:33 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cdc9f6b-a292-40b4-bce9-b1179124bfa6 tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59852df5-d4c8-4f25-8693-36181ff6a447 (non-flash)
Aug 09 15:34:33 user nova-compute[72382]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b93bb40-75bb-4387-aa01-c839f97e3432 (non-flash)
Aug 09 15:34:33 user nova-compute[72382]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2f5dbb5-f862-4389-b42a-872d5c94aa55 (non-flash)
Aug 09 15:34:33 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 15:34:33 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cdc9f6b-a292-40b4-bce9-b1179124bfa6 tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59852df5-d4c8-4f25-8693-36181ff6a447 (non-flash)
Aug 09 15:34:33 user nova-compute[72382]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b93bb40-75bb-4387-aa01-c839f97e3432 (non-flash)
Aug 09 15:34:33 user nova-compute[72382]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2f5dbb5-f862-4389-b42a-872d5c94aa55 (non-flash)
Aug 09 15:34:33 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 15:34:33 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-3cdc9f6b-a292-40b4-bce9-b1179124bfa6 tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d2f5dbb5-f862-4389-b42a-872d5c94aa55" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.288s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 15:34:33 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cdc9f6b-a292-40b4-bce9-b1179124bfa6 tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] Connected to 172.16.0.220:3260 {{(pid=72382) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 15:34:33 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-3cdc9f6b-a292-40b4-bce9-b1179124bfa6 tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] HCTL ('33', '-', '-', 0) found on session 45 with lun 0 {{(pid=72382) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 15:34:33 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-3cdc9f6b-a292-40b4-bce9-b1179124bfa6 tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72382) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 15:34:33 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:34:33 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.024s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:34:33 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[55fc5850-6cd5-4241-9b75-dfe48fe51838]: (4, ('- - 0', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:34:33 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-3cdc9f6b-a292-40b4-bce9-b1179124bfa6 tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] Searching for a device in session 45 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72382) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 15:34:33 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cdc9f6b-a292-40b4-bce9-b1179124bfa6 tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JoLXOIMx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72382) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 15:34:34 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-3cdc9f6b-a292-40b4-bce9-b1179124bfa6 tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.326s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 15:34:34 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cdc9f6b-a292-40b4-bce9-b1179124bfa6 tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] <== connect_volume: return (1327ms) {'type': 'block', 'scsi_wwn': '23336326237313164', 'path': '/dev/sdb'} {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 15:34:34 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3cdc9f6b-a292-40b4-bce9-b1179124bfa6 tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] [instance: c88a5ff2-9789-4ee8-8283-6248bba6d66a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23336326237313164', 'path': '/dev/sdb'} {{(pid=72382) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 15:34:34 user nova-compute[72382]: DEBUG nova.virt.libvirt.vif [None req-3cdc9f6b-a292-40b4-bce9-b1179124bfa6 tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T15:34:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1501121398',display_name='tempest-TestShelveInstance-server-1501121398',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1501121398',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCQeChkkmZm29XyCKvIOrSdRJlcr1oiXG61vF6rcJ4b2pFtnXlLbiZxIkRlmPJGbv2kd4U6HD3QswG5kTgi7CPYGFQie1zKygmhXmMi1vEfJ/SAk2GycDqgaYBJJp6hk9A==',key_name='tempest-TestShelveInstance-1348374500',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='108a420b4c6e451d8429d21665e12fb9',ramdisk_id='',reservation_id='r-3ps4xjyg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1984291610',owner_user_name='tempest-TestShelveInstance-1984291610-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T15:34:24Z,user_data=None,user_id='827f726259fb452aad32077e24ec4fc2',uuid=c88a5ff2-9789-4ee8-8283-6248bba6d66a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4f9e0eae-81c7-4a91-8ac1-51459e231532", "address": "fa:16:3e:b2:aa:71", "network": {"id": "5f3f6e0f-94b3-4a66-9839-763a2e2d259c", "bridge": "br-int", "label": "tempest-TestShelveInstance-338163972-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "108a420b4c6e451d8429d21665e12fb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f9e0eae-81", "ovs_interfaceid": "4f9e0eae-81c7-4a91-8ac1-51459e231532", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72382) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 15:34:34 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-3cdc9f6b-a292-40b4-bce9-b1179124bfa6 tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] Converting VIF {"id": "4f9e0eae-81c7-4a91-8ac1-51459e231532", "address": "fa:16:3e:b2:aa:71", "network": {"id": "5f3f6e0f-94b3-4a66-9839-763a2e2d259c", "bridge": "br-int", "label": "tempest-TestShelveInstance-338163972-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "108a420b4c6e451d8429d21665e12fb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f9e0eae-81", "ovs_interfaceid": "4f9e0eae-81c7-4a91-8ac1-51459e231532", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 15:34:34 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-3cdc9f6b-a292-40b4-bce9-b1179124bfa6 tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:aa:71,bridge_name='br-int',has_traffic_filtering=True,id=4f9e0eae-81c7-4a91-8ac1-51459e231532,network=Network(5f3f6e0f-94b3-4a66-9839-763a2e2d259c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f9e0eae-81') {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 15:34:34 user nova-compute[72382]: DEBUG nova.objects.instance [None req-3cdc9f6b-a292-40b4-bce9-b1179124bfa6 tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] Lazy-loading 'pci_devices' on Instance uuid c88a5ff2-9789-4ee8-8283-6248bba6d66a {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:34:34 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-3cdc9f6b-a292-40b4-bce9-b1179124bfa6 tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] [instance: c88a5ff2-9789-4ee8-8283-6248bba6d66a] End _get_guest_xml xml=<domain type="kvm">
Aug 09 15:34:34 user nova-compute[72382]:   <uuid>c88a5ff2-9789-4ee8-8283-6248bba6d66a</uuid>
Aug 09 15:34:34 user nova-compute[72382]:   <name>instance-00000025</name>
Aug 09 15:34:34 user nova-compute[72382]:   <memory>524288</memory>
Aug 09 15:34:34 user nova-compute[72382]:   <vcpu>1</vcpu>
Aug 09 15:34:34 user nova-compute[72382]:   <metadata>
Aug 09 15:34:34 user nova-compute[72382]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 15:34:34 user nova-compute[72382]:       <nova:package version="0.0.0"/>
Aug 09 15:34:34 user nova-compute[72382]:       <nova:name>tempest-TestShelveInstance-server-1501121398</nova:name>
Aug 09 15:34:34 user nova-compute[72382]:       <nova:creationTime>2023-08-09 15:34:32</nova:creationTime>
Aug 09 15:34:34 user nova-compute[72382]:       <nova:flavor name="m1.tiny">
Aug 09 15:34:34 user nova-compute[72382]:         <nova:memory>512</nova:memory>
Aug 09 15:34:34 user nova-compute[72382]:         <nova:disk>1</nova:disk>
Aug 09 15:34:34 user nova-compute[72382]:         <nova:swap>0</nova:swap>
Aug 09 15:34:34 user nova-compute[72382]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 15:34:34 user nova-compute[72382]:         <nova:vcpus>1</nova:vcpus>
Aug 09 15:34:34 user nova-compute[72382]:       </nova:flavor>
Aug 09 15:34:34 user nova-compute[72382]:       <nova:owner>
Aug 09 15:34:34 user nova-compute[72382]:         <nova:user uuid="827f726259fb452aad32077e24ec4fc2">tempest-TestShelveInstance-1984291610-project-member</nova:user>
Aug 09 15:34:34 user nova-compute[72382]:         <nova:project uuid="108a420b4c6e451d8429d21665e12fb9">tempest-TestShelveInstance-1984291610</nova:project>
Aug 09 15:34:34 user nova-compute[72382]:       </nova:owner>
Aug 09 15:34:34 user nova-compute[72382]:       <nova:ports>
Aug 09 15:34:34 user nova-compute[72382]:         <nova:port uuid="4f9e0eae-81c7-4a91-8ac1-51459e231532">
Aug 09 15:34:34 user nova-compute[72382]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 09 15:34:34 user nova-compute[72382]:         </nova:port>
Aug 09 15:34:34 user nova-compute[72382]:       </nova:ports>
Aug 09 15:34:34 user nova-compute[72382]:     </nova:instance>
Aug 09 15:34:34 user nova-compute[72382]:   </metadata>
Aug 09 15:34:34 user nova-compute[72382]:   <sysinfo type="smbios">
Aug 09 15:34:34 user nova-compute[72382]:     <system>
Aug 09 15:34:34 user nova-compute[72382]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 15:34:34 user nova-compute[72382]:       <entry name="product">OpenStack Nova</entry>
Aug 09 15:34:34 user nova-compute[72382]:       <entry name="version">0.0.0</entry>
Aug 09 15:34:34 user nova-compute[72382]:       <entry name="serial">c88a5ff2-9789-4ee8-8283-6248bba6d66a</entry>
Aug 09 15:34:34 user nova-compute[72382]:       <entry name="uuid">c88a5ff2-9789-4ee8-8283-6248bba6d66a</entry>
Aug 09 15:34:34 user nova-compute[72382]:       <entry name="family">Virtual Machine</entry>
Aug 09 15:34:34 user nova-compute[72382]:     </system>
Aug 09 15:34:34 user nova-compute[72382]:   </sysinfo>
Aug 09 15:34:34 user nova-compute[72382]:   <os>
Aug 09 15:34:34 user nova-compute[72382]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 15:34:34 user nova-compute[72382]:     <boot dev="hd"/>
Aug 09 15:34:34 user nova-compute[72382]:     <smbios mode="sysinfo"/>
Aug 09 15:34:34 user nova-compute[72382]:   </os>
Aug 09 15:34:34 user nova-compute[72382]:   <features>
Aug 09 15:34:34 user nova-compute[72382]:     <acpi/>
Aug 09 15:34:34 user nova-compute[72382]:     <apic/>
Aug 09 15:34:34 user nova-compute[72382]:     <vmcoreinfo/>
Aug 09 15:34:34 user nova-compute[72382]:   </features>
Aug 09 15:34:34 user nova-compute[72382]:   <clock offset="utc">
Aug 09 15:34:34 user nova-compute[72382]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 15:34:34 user nova-compute[72382]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 15:34:34 user nova-compute[72382]:     <timer name="hpet" present="no"/>
Aug 09 15:34:34 user nova-compute[72382]:   </clock>
Aug 09 15:34:34 user nova-compute[72382]:   <cpu mode="custom" match="exact">
Aug 09 15:34:34 user nova-compute[72382]:     <model>Nehalem</model>
Aug 09 15:34:34 user nova-compute[72382]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 15:34:34 user nova-compute[72382]:   </cpu>
Aug 09 15:34:34 user nova-compute[72382]:   <devices>
Aug 09 15:34:34 user nova-compute[72382]:     <disk type="block" device="disk">
Aug 09 15:34:34 user nova-compute[72382]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 15:34:34 user nova-compute[72382]:       <source dev="/dev/sdb"/>
Aug 09 15:34:34 user nova-compute[72382]:       <target dev="vda" bus="virtio"/>
Aug 09 15:34:34 user nova-compute[72382]:       <serial>d2f5dbb5-f862-4389-b42a-872d5c94aa55</serial>
Aug 09 15:34:34 user nova-compute[72382]:     </disk>
Aug 09 15:34:34 user nova-compute[72382]:     <interface type="ethernet">
Aug 09 15:34:34 user nova-compute[72382]:       <mac address="fa:16:3e:b2:aa:71"/>
Aug 09 15:34:34 user nova-compute[72382]:       <model type="virtio"/>
Aug 09 15:34:34 user nova-compute[72382]:       <mtu size="1442"/>
Aug 09 15:34:34 user nova-compute[72382]:       <target dev="tap4f9e0eae-81"/>
Aug 09 15:34:34 user nova-compute[72382]:     </interface>
Aug 09 15:34:34 user nova-compute[72382]:     <serial type="pty">
Aug 09 15:34:34 user nova-compute[72382]:       <log file="/opt/stack/data/nova/instances/c88a5ff2-9789-4ee8-8283-6248bba6d66a/console.log" append="off"/>
Aug 09 15:34:34 user nova-compute[72382]:     </serial>
Aug 09 15:34:34 user nova-compute[72382]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 15:34:34 user nova-compute[72382]:     <video>
Aug 09 15:34:34 user nova-compute[72382]:       <model type="virtio"/>
Aug 09 15:34:34 user nova-compute[72382]:     </video>
Aug 09 15:34:34 user nova-compute[72382]:     <rng model="virtio">
Aug 09 15:34:34 user nova-compute[72382]:       <backend model="random">/dev/urandom</backend>
Aug 09 15:34:34 user nova-compute[72382]:     </rng>
Aug 09 15:34:34 user nova-compute[72382]:     <controller type="usb" index="0" model="none"/>
Aug 09 15:34:34 user nova-compute[72382]:     <memballoon model="virtio">
Aug 09 15:34:34 user nova-compute[72382]:       <stats period="10"/>
Aug 09 15:34:34 user nova-compute[72382]:     </memballoon>
Aug 09 15:34:34 user nova-compute[72382]:   </devices>
Aug 09 15:34:34 user nova-compute[72382]: </domain>
Aug 09 15:34:34 user nova-compute[72382]:  {{(pid=72382) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 15:34:34 user nova-compute[72382]: DEBUG nova.virt.libvirt.vif [None req-3cdc9f6b-a292-40b4-bce9-b1179124bfa6 tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T15:34:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1501121398',display_name='tempest-TestShelveInstance-server-1501121398',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1501121398',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCQeChkkmZm29XyCKvIOrSdRJlcr1oiXG61vF6rcJ4b2pFtnXlLbiZxIkRlmPJGbv2kd4U6HD3QswG5kTgi7CPYGFQie1zKygmhXmMi1vEfJ/SAk2GycDqgaYBJJp6hk9A==',key_name='tempest-TestShelveInstance-1348374500',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='108a420b4c6e451d8429d21665e12fb9',ramdisk_id='',reservation_id='r-3ps4xjyg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1984291610',owner_user_name='tempest-TestShelveInstance-1984291610-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T15:34:24Z,user_data=None,user_id='827f726259fb452aad32077e24ec4fc2',uuid=c88a5ff2-9789-4ee8-8283-6248bba6d66a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4f9e0eae-81c7-4a91-8ac1-51459e231532", "address": "fa:16:3e:b2:aa:71", "network": {"id": "5f3f6e0f-94b3-4a66-9839-763a2e2d259c", "bridge": "br-int", "label": "tempest-TestShelveInstance-338163972-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "108a420b4c6e451d8429d21665e12fb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f9e0eae-81", "ovs_interfaceid": "4f9e0eae-81c7-4a91-8ac1-51459e231532", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 15:34:34 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-3cdc9f6b-a292-40b4-bce9-b1179124bfa6 tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] Converting VIF {"id": "4f9e0eae-81c7-4a91-8ac1-51459e231532", "address": "fa:16:3e:b2:aa:71", "network": {"id": "5f3f6e0f-94b3-4a66-9839-763a2e2d259c", "bridge": "br-int", "label": "tempest-TestShelveInstance-338163972-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "108a420b4c6e451d8429d21665e12fb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f9e0eae-81", "ovs_interfaceid": "4f9e0eae-81c7-4a91-8ac1-51459e231532", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 15:34:34 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-3cdc9f6b-a292-40b4-bce9-b1179124bfa6 tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:aa:71,bridge_name='br-int',has_traffic_filtering=True,id=4f9e0eae-81c7-4a91-8ac1-51459e231532,network=Network(5f3f6e0f-94b3-4a66-9839-763a2e2d259c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f9e0eae-81') {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 15:34:34 user nova-compute[72382]: DEBUG os_vif [None req-3cdc9f6b-a292-40b4-bce9-b1179124bfa6 tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:aa:71,bridge_name='br-int',has_traffic_filtering=True,id=4f9e0eae-81c7-4a91-8ac1-51459e231532,network=Network(5f3f6e0f-94b3-4a66-9839-763a2e2d259c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f9e0eae-81') {{(pid=72382) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 15:34:34 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:34:34 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:34:34 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 15:34:34 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:34:34 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4f9e0eae-81, may_exist=True, interface_attrs={}) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:34:34 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4f9e0eae-81, col_values=(('external_ids', {'iface-id': '4f9e0eae-81c7-4a91-8ac1-51459e231532', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b2:aa:71', 'vm-uuid': 'c88a5ff2-9789-4ee8-8283-6248bba6d66a'}),), if_exists=True) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:34:34 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:34:34 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:34:34 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:34:34 user nova-compute[72382]: INFO os_vif [None req-3cdc9f6b-a292-40b4-bce9-b1179124bfa6 tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:aa:71,bridge_name='br-int',has_traffic_filtering=True,id=4f9e0eae-81c7-4a91-8ac1-51459e231532,network=Network(5f3f6e0f-94b3-4a66-9839-763a2e2d259c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f9e0eae-81')
Aug 09 15:34:34 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-3cdc9f6b-a292-40b4-bce9-b1179124bfa6 tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] No BDM found with device name vda, not building metadata. {{(pid=72382) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 15:34:34 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-3cdc9f6b-a292-40b4-bce9-b1179124bfa6 tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] No VIF found with MAC fa:16:3e:b2:aa:71, not building metadata {{(pid=72382) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 15:34:34 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:34:35 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:34:35 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:34:35 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:34:35 user nova-compute[72382]: DEBUG nova.compute.manager [req-c6521dd1-59e3-4fc6-8d22-5653b5e542b3 req-395deca1-b57a-45e8-a4ea-1a4fbfeab404 service nova] [instance: c88a5ff2-9789-4ee8-8283-6248bba6d66a] Received event network-vif-plugged-4f9e0eae-81c7-4a91-8ac1-51459e231532 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:34:35 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-c6521dd1-59e3-4fc6-8d22-5653b5e542b3 req-395deca1-b57a-45e8-a4ea-1a4fbfeab404 service nova] Acquiring lock "c88a5ff2-9789-4ee8-8283-6248bba6d66a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:34:35 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-c6521dd1-59e3-4fc6-8d22-5653b5e542b3 req-395deca1-b57a-45e8-a4ea-1a4fbfeab404 service nova] Lock "c88a5ff2-9789-4ee8-8283-6248bba6d66a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:34:35 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-c6521dd1-59e3-4fc6-8d22-5653b5e542b3 req-395deca1-b57a-45e8-a4ea-1a4fbfeab404 service nova] Lock "c88a5ff2-9789-4ee8-8283-6248bba6d66a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:34:35 user nova-compute[72382]: DEBUG nova.compute.manager [req-c6521dd1-59e3-4fc6-8d22-5653b5e542b3 req-395deca1-b57a-45e8-a4ea-1a4fbfeab404 service nova] [instance: c88a5ff2-9789-4ee8-8283-6248bba6d66a] No waiting events found dispatching network-vif-plugged-4f9e0eae-81c7-4a91-8ac1-51459e231532 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:34:35 user nova-compute[72382]: WARNING nova.compute.manager [req-c6521dd1-59e3-4fc6-8d22-5653b5e542b3 req-395deca1-b57a-45e8-a4ea-1a4fbfeab404 service nova] [instance: c88a5ff2-9789-4ee8-8283-6248bba6d66a] Received unexpected event network-vif-plugged-4f9e0eae-81c7-4a91-8ac1-51459e231532 for instance with vm_state building and task_state spawning.
Aug 09 15:34:36 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:34:36 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:34:36 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:34:36 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:34:37 user nova-compute[72382]: DEBUG nova.virt.driver [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Emitting event <LifecycleEvent: 1691595277.72735, c88a5ff2-9789-4ee8-8283-6248bba6d66a => Resumed> {{(pid=72382) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 15:34:37 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: c88a5ff2-9789-4ee8-8283-6248bba6d66a] VM Resumed (Lifecycle Event)
Aug 09 15:34:37 user nova-compute[72382]: DEBUG nova.compute.manager [None req-3cdc9f6b-a292-40b4-bce9-b1179124bfa6 tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] [instance: c88a5ff2-9789-4ee8-8283-6248bba6d66a] Instance event wait completed in 0 seconds for  {{(pid=72382) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 15:34:37 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-3cdc9f6b-a292-40b4-bce9-b1179124bfa6 tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] [instance: c88a5ff2-9789-4ee8-8283-6248bba6d66a] Guest created on hypervisor {{(pid=72382) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 15:34:37 user nova-compute[72382]: INFO nova.virt.libvirt.driver [-] [instance: c88a5ff2-9789-4ee8-8283-6248bba6d66a] Instance spawned successfully.
Aug 09 15:34:37 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-3cdc9f6b-a292-40b4-bce9-b1179124bfa6 tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] [instance: c88a5ff2-9789-4ee8-8283-6248bba6d66a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 15:34:37 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: c88a5ff2-9789-4ee8-8283-6248bba6d66a] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:34:37 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: c88a5ff2-9789-4ee8-8283-6248bba6d66a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72382) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 15:34:37 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-3cdc9f6b-a292-40b4-bce9-b1179124bfa6 tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] [instance: c88a5ff2-9789-4ee8-8283-6248bba6d66a] Found default for hw_cdrom_bus of ide {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:34:37 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-3cdc9f6b-a292-40b4-bce9-b1179124bfa6 tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] [instance: c88a5ff2-9789-4ee8-8283-6248bba6d66a] Found default for hw_disk_bus of virtio {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:34:37 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-3cdc9f6b-a292-40b4-bce9-b1179124bfa6 tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] [instance: c88a5ff2-9789-4ee8-8283-6248bba6d66a] Found default for hw_input_bus of None {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:34:37 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-3cdc9f6b-a292-40b4-bce9-b1179124bfa6 tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] [instance: c88a5ff2-9789-4ee8-8283-6248bba6d66a] Found default for hw_pointer_model of None {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:34:37 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-3cdc9f6b-a292-40b4-bce9-b1179124bfa6 tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] [instance: c88a5ff2-9789-4ee8-8283-6248bba6d66a] Found default for hw_video_model of virtio {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:34:37 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-3cdc9f6b-a292-40b4-bce9-b1179124bfa6 tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] [instance: c88a5ff2-9789-4ee8-8283-6248bba6d66a] Found default for hw_vif_model of virtio {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:34:37 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: c88a5ff2-9789-4ee8-8283-6248bba6d66a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 15:34:37 user nova-compute[72382]: DEBUG nova.virt.driver [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Emitting event <LifecycleEvent: 1691595277.730066, c88a5ff2-9789-4ee8-8283-6248bba6d66a => Started> {{(pid=72382) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 15:34:37 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: c88a5ff2-9789-4ee8-8283-6248bba6d66a] VM Started (Lifecycle Event)
Aug 09 15:34:37 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: c88a5ff2-9789-4ee8-8283-6248bba6d66a] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:34:37 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: c88a5ff2-9789-4ee8-8283-6248bba6d66a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72382) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 15:34:37 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: c88a5ff2-9789-4ee8-8283-6248bba6d66a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 15:34:37 user nova-compute[72382]: INFO nova.compute.manager [None req-3cdc9f6b-a292-40b4-bce9-b1179124bfa6 tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] [instance: c88a5ff2-9789-4ee8-8283-6248bba6d66a] Took 5.08 seconds to spawn the instance on the hypervisor.
Aug 09 15:34:37 user nova-compute[72382]: DEBUG nova.compute.manager [None req-3cdc9f6b-a292-40b4-bce9-b1179124bfa6 tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] [instance: c88a5ff2-9789-4ee8-8283-6248bba6d66a] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:34:37 user nova-compute[72382]: DEBUG nova.compute.manager [req-11d5e6e5-5e19-466c-897f-f7f5ad2dbac7 req-7ef47b64-bcac-45dc-91c8-30a012bfc519 service nova] [instance: c88a5ff2-9789-4ee8-8283-6248bba6d66a] Received event network-vif-plugged-4f9e0eae-81c7-4a91-8ac1-51459e231532 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:34:37 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-11d5e6e5-5e19-466c-897f-f7f5ad2dbac7 req-7ef47b64-bcac-45dc-91c8-30a012bfc519 service nova] Acquiring lock "c88a5ff2-9789-4ee8-8283-6248bba6d66a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:34:37 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-11d5e6e5-5e19-466c-897f-f7f5ad2dbac7 req-7ef47b64-bcac-45dc-91c8-30a012bfc519 service nova] Lock "c88a5ff2-9789-4ee8-8283-6248bba6d66a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:34:37 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-11d5e6e5-5e19-466c-897f-f7f5ad2dbac7 req-7ef47b64-bcac-45dc-91c8-30a012bfc519 service nova] Lock "c88a5ff2-9789-4ee8-8283-6248bba6d66a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:34:37 user nova-compute[72382]: DEBUG nova.compute.manager [req-11d5e6e5-5e19-466c-897f-f7f5ad2dbac7 req-7ef47b64-bcac-45dc-91c8-30a012bfc519 service nova] [instance: c88a5ff2-9789-4ee8-8283-6248bba6d66a] No waiting events found dispatching network-vif-plugged-4f9e0eae-81c7-4a91-8ac1-51459e231532 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:34:37 user nova-compute[72382]: WARNING nova.compute.manager [req-11d5e6e5-5e19-466c-897f-f7f5ad2dbac7 req-7ef47b64-bcac-45dc-91c8-30a012bfc519 service nova] [instance: c88a5ff2-9789-4ee8-8283-6248bba6d66a] Received unexpected event network-vif-plugged-4f9e0eae-81c7-4a91-8ac1-51459e231532 for instance with vm_state building and task_state spawning.
Aug 09 15:34:37 user nova-compute[72382]: INFO nova.compute.manager [None req-3cdc9f6b-a292-40b4-bce9-b1179124bfa6 tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] [instance: c88a5ff2-9789-4ee8-8283-6248bba6d66a] Took 14.68 seconds to build instance.
Aug 09 15:34:37 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-3cdc9f6b-a292-40b4-bce9-b1179124bfa6 tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] Lock "c88a5ff2-9789-4ee8-8283-6248bba6d66a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.789s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:34:39 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:34:39 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:34:43 user nova-compute[72382]: DEBUG nova.compute.manager [req-67ec55e3-9c49-4313-bd13-f1b739256a89 req-35152cbb-1ad2-4f4c-aea3-167c1907da8f service nova] [instance: 765eb553-6c1c-4d5a-a1cf-6ac8b348ac8e] Received event network-changed-4936f05e-b54a-4219-aa37-681330955e94 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:34:43 user nova-compute[72382]: DEBUG nova.compute.manager [req-67ec55e3-9c49-4313-bd13-f1b739256a89 req-35152cbb-1ad2-4f4c-aea3-167c1907da8f service nova] [instance: 765eb553-6c1c-4d5a-a1cf-6ac8b348ac8e] Refreshing instance network info cache due to event network-changed-4936f05e-b54a-4219-aa37-681330955e94. {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 15:34:43 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-67ec55e3-9c49-4313-bd13-f1b739256a89 req-35152cbb-1ad2-4f4c-aea3-167c1907da8f service nova] Acquiring lock "refresh_cache-765eb553-6c1c-4d5a-a1cf-6ac8b348ac8e" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 15:34:43 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-67ec55e3-9c49-4313-bd13-f1b739256a89 req-35152cbb-1ad2-4f4c-aea3-167c1907da8f service nova] Acquired lock "refresh_cache-765eb553-6c1c-4d5a-a1cf-6ac8b348ac8e" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 15:34:43 user nova-compute[72382]: DEBUG nova.network.neutron [req-67ec55e3-9c49-4313-bd13-f1b739256a89 req-35152cbb-1ad2-4f4c-aea3-167c1907da8f service nova] [instance: 765eb553-6c1c-4d5a-a1cf-6ac8b348ac8e] Refreshing network info cache for port 4936f05e-b54a-4219-aa37-681330955e94 {{(pid=72382) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 15:34:43 user nova-compute[72382]: DEBUG nova.network.neutron [req-67ec55e3-9c49-4313-bd13-f1b739256a89 req-35152cbb-1ad2-4f4c-aea3-167c1907da8f service nova] [instance: 765eb553-6c1c-4d5a-a1cf-6ac8b348ac8e] Updated VIF entry in instance network info cache for port 4936f05e-b54a-4219-aa37-681330955e94. {{(pid=72382) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 15:34:43 user nova-compute[72382]: DEBUG nova.network.neutron [req-67ec55e3-9c49-4313-bd13-f1b739256a89 req-35152cbb-1ad2-4f4c-aea3-167c1907da8f service nova] [instance: 765eb553-6c1c-4d5a-a1cf-6ac8b348ac8e] Updating instance_info_cache with network_info: [{"id": "4936f05e-b54a-4219-aa37-681330955e94", "address": "fa:16:3e:86:c1:69", "network": {"id": "a78e6cb6-feb7-4f64-a3c0-4900594b6e37", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-338007968-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.122", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70310b1af40b4d239fe5ea362972554b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4936f05e-b5", "ovs_interfaceid": "4936f05e-b54a-4219-aa37-681330955e94", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:34:43 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-67ec55e3-9c49-4313-bd13-f1b739256a89 req-35152cbb-1ad2-4f4c-aea3-167c1907da8f service nova] Releasing lock "refresh_cache-765eb553-6c1c-4d5a-a1cf-6ac8b348ac8e" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 15:34:44 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-8299ce33-8f2d-4ac7-ae14-09ce76060f22 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Acquiring lock "765eb553-6c1c-4d5a-a1cf-6ac8b348ac8e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:34:44 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-8299ce33-8f2d-4ac7-ae14-09ce76060f22 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Lock "765eb553-6c1c-4d5a-a1cf-6ac8b348ac8e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:34:44 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-8299ce33-8f2d-4ac7-ae14-09ce76060f22 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Acquiring lock "765eb553-6c1c-4d5a-a1cf-6ac8b348ac8e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:34:44 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-8299ce33-8f2d-4ac7-ae14-09ce76060f22 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Lock "765eb553-6c1c-4d5a-a1cf-6ac8b348ac8e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:34:44 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-8299ce33-8f2d-4ac7-ae14-09ce76060f22 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Lock "765eb553-6c1c-4d5a-a1cf-6ac8b348ac8e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:34:44 user nova-compute[72382]: INFO nova.compute.manager [None req-8299ce33-8f2d-4ac7-ae14-09ce76060f22 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: 765eb553-6c1c-4d5a-a1cf-6ac8b348ac8e] Terminating instance
Aug 09 15:34:44 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8299ce33-8f2d-4ac7-ae14-09ce76060f22 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: 765eb553-6c1c-4d5a-a1cf-6ac8b348ac8e] Start destroying the instance on the hypervisor. {{(pid=72382) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 15:34:44 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:34:44 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:34:44 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:34:44 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:34:44 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:34:44 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:34:44 user nova-compute[72382]: INFO nova.virt.libvirt.driver [-] [instance: 765eb553-6c1c-4d5a-a1cf-6ac8b348ac8e] Instance destroyed successfully.
Aug 09 15:34:44 user nova-compute[72382]: DEBUG nova.objects.instance [None req-8299ce33-8f2d-4ac7-ae14-09ce76060f22 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Lazy-loading 'resources' on Instance uuid 765eb553-6c1c-4d5a-a1cf-6ac8b348ac8e {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:34:44 user nova-compute[72382]: DEBUG nova.virt.libvirt.vif [None req-8299ce33-8f2d-4ac7-ae14-09ce76060f22 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T15:32:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1314691970',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1314691970',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1314691970',id=35,image_ref='517344be-3709-4576-9bc3-25515ae59215',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEvAABBE0ImmPJHlhvG+ei5Kpw6Q9p/nD7wB8dehbmgx9OM5jAZZul+5YZCixv3LdKlkCUxp5t9OpV7dAlvRztw/Wi+KSm1ZN4c585plDdkzEWW7DGuI89HS5TTVZNYfgg==',key_name='tempest-keypair-978880427',keypairs=<?>,launch_index=0,launched_at=2023-08-09T15:33:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='70310b1af40b4d239fe5ea362972554b',ramdisk_id='',reservation_id='r-incmwery',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-451643589',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-451643589-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-451643589',owner_user_name='tempest-TestVolumeBootPattern-451643589-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T15:33:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='280bcf2afd7245a7bcd605e0db79c569',uuid=765eb553-6c1c-4d5a-a1cf-6ac8b348ac8e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4936f05e-b54a-4219-aa37-681330955e94", "address": "fa:16:3e:86:c1:69", "network": {"id": "a78e6cb6-feb7-4f64-a3c0-4900594b6e37", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-338007968-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70310b1af40b4d239fe5ea362972554b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4936f05e-b5", "ovs_interfaceid": "4936f05e-b54a-4219-aa37-681330955e94", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 15:34:44 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-8299ce33-8f2d-4ac7-ae14-09ce76060f22 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Converting VIF {"id": "4936f05e-b54a-4219-aa37-681330955e94", "address": "fa:16:3e:86:c1:69", "network": {"id": "a78e6cb6-feb7-4f64-a3c0-4900594b6e37", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-338007968-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70310b1af40b4d239fe5ea362972554b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4936f05e-b5", "ovs_interfaceid": "4936f05e-b54a-4219-aa37-681330955e94", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 15:34:44 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-8299ce33-8f2d-4ac7-ae14-09ce76060f22 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:c1:69,bridge_name='br-int',has_traffic_filtering=True,id=4936f05e-b54a-4219-aa37-681330955e94,network=Network(a78e6cb6-feb7-4f64-a3c0-4900594b6e37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4936f05e-b5') {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 15:34:44 user nova-compute[72382]: DEBUG os_vif [None req-8299ce33-8f2d-4ac7-ae14-09ce76060f22 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:c1:69,bridge_name='br-int',has_traffic_filtering=True,id=4936f05e-b54a-4219-aa37-681330955e94,network=Network(a78e6cb6-feb7-4f64-a3c0-4900594b6e37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4936f05e-b5') {{(pid=72382) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 15:34:44 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:34:44 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4936f05e-b5, bridge=br-int, if_exists=True) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:34:44 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:34:44 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:34:44 user nova-compute[72382]: INFO os_vif [None req-8299ce33-8f2d-4ac7-ae14-09ce76060f22 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:c1:69,bridge_name='br-int',has_traffic_filtering=True,id=4936f05e-b54a-4219-aa37-681330955e94,network=Network(a78e6cb6-feb7-4f64-a3c0-4900594b6e37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4936f05e-b5')
Aug 09 15:34:44 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8299ce33-8f2d-4ac7-ae14-09ce76060f22 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: 765eb553-6c1c-4d5a-a1cf-6ac8b348ac8e] calling os-brick to detach iSCSI Volume {{(pid=72382) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 15:34:44 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-8299ce33-8f2d-4ac7-ae14-09ce76060f22 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2a0c768340>, {'target_iqns': ['iqn.2010-10.org.openstack:9b93bb40-75bb-4387-aa01-c839f97e3432'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'anqFGEkv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 15:34:44 user nova-compute[72382]: WARNING os_brick.initiator.connectors.base [None req-8299ce33-8f2d-4ac7-ae14-09ce76060f22 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 15:34:44 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-8299ce33-8f2d-4ac7-ae14-09ce76060f22 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 15:34:44 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-8299ce33-8f2d-4ac7-ae14-09ce76060f22 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 15:34:44 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-8299ce33-8f2d-4ac7-ae14-09ce76060f22 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9b93bb40-75bb-4387-aa01-c839f97e3432', 0)] {{(pid=72382) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 15:34:44 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:34:44 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:34:44 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[c33fdc43-0797-4484-8bd3-3cc02f7c33fb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:59852df5-d4c8-4f25-8693-36181ff6a447\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9b93bb40-75bb-4387-aa01-c839f97e3432\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d2f5dbb5-f862-4389-b42a-872d5c94aa55\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:34:44 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:34:44 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:34:44 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a021e88-8d50-4d75-8081-2b2409d66c34]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59852df5-d4c8-4f25-8693-36181ff6a447 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b93bb40-75bb-4387-aa01-c839f97e3432 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2f5dbb5-f862-4389-b42a-872d5c94aa55 (non-flash)\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:34:44 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-8299ce33-8f2d-4ac7-ae14-09ce76060f22 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59852df5-d4c8-4f25-8693-36181ff6a447 (non-flash)
Aug 09 15:34:44 user nova-compute[72382]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b93bb40-75bb-4387-aa01-c839f97e3432 (non-flash)
Aug 09 15:34:44 user nova-compute[72382]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2f5dbb5-f862-4389-b42a-872d5c94aa55 (non-flash)
Aug 09 15:34:44 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 15:34:44 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-8299ce33-8f2d-4ac7-ae14-09ce76060f22 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59852df5-d4c8-4f25-8693-36181ff6a447 (non-flash)
Aug 09 15:34:44 user nova-compute[72382]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b93bb40-75bb-4387-aa01-c839f97e3432 (non-flash)
Aug 09 15:34:44 user nova-compute[72382]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2f5dbb5-f862-4389-b42a-872d5c94aa55 (non-flash)
Aug 09 15:34:44 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 15:34:44 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-8299ce33-8f2d-4ac7-ae14-09ce76060f22 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2a0c3d5510>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9b93bb40-75bb-4387-aa01-c839f97e3432'): ({'sdg'}, set())}) {{(pid=72382) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 15:34:44 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-8299ce33-8f2d-4ac7-ae14-09ce76060f22 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Removing single pathed devices sdg {{(pid=72382) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 15:34:44 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:34:44 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.033s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:34:44 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d0b0223-dc26-4d2a-ac59-9322d0281f8a]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:34:44 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:34:44 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.019s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:34:44 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[17eaa6da-0439-4e40-86d6-366bcda2edb4]: (4, ('ok\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:34:44 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-8299ce33-8f2d-4ac7-ae14-09ce76060f22 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Flushing IO for device /dev/sdg {{(pid=72382) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 15:34:44 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:34:44 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.014s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:34:44 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[84867ff0-77c1-444c-b9c7-4edc2106b510]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:34:44 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-8299ce33-8f2d-4ac7-ae14-09ce76060f22 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=72382) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 15:34:44 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:34:45 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.147s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:34:45 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[e304a756-8f32-45e1-a13d-a1f65169528b]: (4, ('1', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:34:45 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-8299ce33-8f2d-4ac7-ae14-09ce76060f22 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=72382) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 15:34:45 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-8299ce33-8f2d-4ac7-ae14-09ce76060f22 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] SCSI volumes sdg have been removed. {{(pid=72382) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 15:34:45 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-8299ce33-8f2d-4ac7-ae14-09ce76060f22 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9b93bb40-75bb-4387-aa01-c839f97e3432')] {{(pid=72382) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 15:34:45 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b93bb40-75bb-4387-aa01-c839f97e3432 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:34:45 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b93bb40-75bb-4387-aa01-c839f97e3432 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.060s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:34:45 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c0cd0d8-cbbe-448f-bba8-fa62c170a874]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:34:45 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-8299ce33-8f2d-4ac7-ae14-09ce76060f22 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:34:45 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b93bb40-75bb-4387-aa01-c839f97e3432 -p 172.16.0.220:3260 --logout {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:34:45 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b93bb40-75bb-4387-aa01-c839f97e3432 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:34:45 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[66d77e8c-4159-463d-9711-b94207e979f3]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:9b93bb40-75bb-4387-aa01-c839f97e3432, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:9b93bb40-75bb-4387-aa01-c839f97e3432, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:34:45 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-8299ce33-8f2d-4ac7-ae14-09ce76060f22 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:9b93bb40-75bb-4387-aa01-c839f97e3432, portal: 172.16.0.220,3260]
Aug 09 15:34:45 user nova-compute[72382]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:9b93bb40-75bb-4387-aa01-c839f97e3432, portal: 172.16.0.220,3260] successful.
Aug 09 15:34:45 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:34:45 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b93bb40-75bb-4387-aa01-c839f97e3432 -p 172.16.0.220:3260 --op delete {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:34:45 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b93bb40-75bb-4387-aa01-c839f97e3432 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:34:45 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9a219a6-b2c9-4405-87bf-a37391af8770]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:34:45 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-8299ce33-8f2d-4ac7-ae14-09ce76060f22 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:34:45 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-8299ce33-8f2d-4ac7-ae14-09ce76060f22 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.454s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 15:34:45 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-8299ce33-8f2d-4ac7-ae14-09ce76060f22 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] <== disconnect_volume: return (455ms) None {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 15:34:45 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8299ce33-8f2d-4ac7-ae14-09ce76060f22 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: 765eb553-6c1c-4d5a-a1cf-6ac8b348ac8e] Disconnected iSCSI Volume {{(pid=72382) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 15:34:45 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-8299ce33-8f2d-4ac7-ae14-09ce76060f22 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: 765eb553-6c1c-4d5a-a1cf-6ac8b348ac8e] Deleting instance files /opt/stack/data/nova/instances/765eb553-6c1c-4d5a-a1cf-6ac8b348ac8e_del
Aug 09 15:34:45 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-8299ce33-8f2d-4ac7-ae14-09ce76060f22 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: 765eb553-6c1c-4d5a-a1cf-6ac8b348ac8e] Deletion of /opt/stack/data/nova/instances/765eb553-6c1c-4d5a-a1cf-6ac8b348ac8e_del complete
Aug 09 15:34:45 user nova-compute[72382]: INFO nova.compute.manager [None req-8299ce33-8f2d-4ac7-ae14-09ce76060f22 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: 765eb553-6c1c-4d5a-a1cf-6ac8b348ac8e] Took 1.32 seconds to destroy the instance on the hypervisor.
Aug 09 15:34:45 user nova-compute[72382]: DEBUG oslo.service.loopingcall [None req-8299ce33-8f2d-4ac7-ae14-09ce76060f22 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72382) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 15:34:45 user nova-compute[72382]: DEBUG nova.compute.manager [-] [instance: 765eb553-6c1c-4d5a-a1cf-6ac8b348ac8e] Deallocating network for instance {{(pid=72382) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 15:34:45 user nova-compute[72382]: DEBUG nova.network.neutron [-] [instance: 765eb553-6c1c-4d5a-a1cf-6ac8b348ac8e] deallocate_for_instance() {{(pid=72382) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 15:34:45 user nova-compute[72382]: DEBUG nova.compute.manager [req-2f7dc7fd-1b8c-4fbb-b8dc-b35650adfe95 req-3864eb74-5173-4f9b-a587-49521090e15e service nova] [instance: 765eb553-6c1c-4d5a-a1cf-6ac8b348ac8e] Received event network-vif-unplugged-4936f05e-b54a-4219-aa37-681330955e94 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:34:45 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-2f7dc7fd-1b8c-4fbb-b8dc-b35650adfe95 req-3864eb74-5173-4f9b-a587-49521090e15e service nova] Acquiring lock "765eb553-6c1c-4d5a-a1cf-6ac8b348ac8e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:34:45 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-2f7dc7fd-1b8c-4fbb-b8dc-b35650adfe95 req-3864eb74-5173-4f9b-a587-49521090e15e service nova] Lock "765eb553-6c1c-4d5a-a1cf-6ac8b348ac8e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:34:45 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-2f7dc7fd-1b8c-4fbb-b8dc-b35650adfe95 req-3864eb74-5173-4f9b-a587-49521090e15e service nova] Lock "765eb553-6c1c-4d5a-a1cf-6ac8b348ac8e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:34:45 user nova-compute[72382]: DEBUG nova.compute.manager [req-2f7dc7fd-1b8c-4fbb-b8dc-b35650adfe95 req-3864eb74-5173-4f9b-a587-49521090e15e service nova] [instance: 765eb553-6c1c-4d5a-a1cf-6ac8b348ac8e] No waiting events found dispatching network-vif-unplugged-4936f05e-b54a-4219-aa37-681330955e94 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:34:45 user nova-compute[72382]: DEBUG nova.compute.manager [req-2f7dc7fd-1b8c-4fbb-b8dc-b35650adfe95 req-3864eb74-5173-4f9b-a587-49521090e15e service nova] [instance: 765eb553-6c1c-4d5a-a1cf-6ac8b348ac8e] Received event network-vif-unplugged-4936f05e-b54a-4219-aa37-681330955e94 for instance with task_state deleting. {{(pid=72382) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 15:34:45 user nova-compute[72382]: DEBUG nova.compute.manager [req-2f7dc7fd-1b8c-4fbb-b8dc-b35650adfe95 req-3864eb74-5173-4f9b-a587-49521090e15e service nova] [instance: 765eb553-6c1c-4d5a-a1cf-6ac8b348ac8e] Received event network-vif-plugged-4936f05e-b54a-4219-aa37-681330955e94 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:34:45 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-2f7dc7fd-1b8c-4fbb-b8dc-b35650adfe95 req-3864eb74-5173-4f9b-a587-49521090e15e service nova] Acquiring lock "765eb553-6c1c-4d5a-a1cf-6ac8b348ac8e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:34:45 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-2f7dc7fd-1b8c-4fbb-b8dc-b35650adfe95 req-3864eb74-5173-4f9b-a587-49521090e15e service nova] Lock "765eb553-6c1c-4d5a-a1cf-6ac8b348ac8e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:34:45 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-2f7dc7fd-1b8c-4fbb-b8dc-b35650adfe95 req-3864eb74-5173-4f9b-a587-49521090e15e service nova] Lock "765eb553-6c1c-4d5a-a1cf-6ac8b348ac8e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:34:45 user nova-compute[72382]: DEBUG nova.compute.manager [req-2f7dc7fd-1b8c-4fbb-b8dc-b35650adfe95 req-3864eb74-5173-4f9b-a587-49521090e15e service nova] [instance: 765eb553-6c1c-4d5a-a1cf-6ac8b348ac8e] No waiting events found dispatching network-vif-plugged-4936f05e-b54a-4219-aa37-681330955e94 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:34:45 user nova-compute[72382]: WARNING nova.compute.manager [req-2f7dc7fd-1b8c-4fbb-b8dc-b35650adfe95 req-3864eb74-5173-4f9b-a587-49521090e15e service nova] [instance: 765eb553-6c1c-4d5a-a1cf-6ac8b348ac8e] Received unexpected event network-vif-plugged-4936f05e-b54a-4219-aa37-681330955e94 for instance with vm_state active and task_state deleting.
Aug 09 15:34:46 user nova-compute[72382]: DEBUG nova.network.neutron [-] [instance: 765eb553-6c1c-4d5a-a1cf-6ac8b348ac8e] Updating instance_info_cache with network_info: [] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:34:46 user nova-compute[72382]: INFO nova.compute.manager [-] [instance: 765eb553-6c1c-4d5a-a1cf-6ac8b348ac8e] Took 1.00 seconds to deallocate network for instance.
Aug 09 15:34:46 user nova-compute[72382]: DEBUG nova.compute.manager [req-5487359f-5b72-4979-bf9f-533580025560 req-df38f5b8-09f1-4ad2-b46d-9de0f73c9b42 service nova] [instance: 765eb553-6c1c-4d5a-a1cf-6ac8b348ac8e] Received event network-vif-deleted-4936f05e-b54a-4219-aa37-681330955e94 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:34:47 user nova-compute[72382]: INFO nova.compute.manager [None req-8299ce33-8f2d-4ac7-ae14-09ce76060f22 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: 765eb553-6c1c-4d5a-a1cf-6ac8b348ac8e] Took 0.74 seconds to detach 1 volumes for instance.
Aug 09 15:34:47 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8299ce33-8f2d-4ac7-ae14-09ce76060f22 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: 765eb553-6c1c-4d5a-a1cf-6ac8b348ac8e] Deleting volume: 9b93bb40-75bb-4387-aa01-c839f97e3432 {{(pid=72382) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 09 15:34:47 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-8299ce33-8f2d-4ac7-ae14-09ce76060f22 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:34:47 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-8299ce33-8f2d-4ac7-ae14-09ce76060f22 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:34:47 user nova-compute[72382]: DEBUG nova.compute.provider_tree [None req-8299ce33-8f2d-4ac7-ae14-09ce76060f22 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Inventory has not changed in ProviderTree for provider: 7b15b0e5-df4d-49db-833b-2855d21d10ae {{(pid=72382) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 15:34:47 user nova-compute[72382]: DEBUG nova.scheduler.client.report [None req-8299ce33-8f2d-4ac7-ae14-09ce76060f22 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Inventory has not changed for provider 7b15b0e5-df4d-49db-833b-2855d21d10ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72382) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 15:34:47 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-8299ce33-8f2d-4ac7-ae14-09ce76060f22 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.293s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:34:47 user nova-compute[72382]: INFO nova.scheduler.client.report [None req-8299ce33-8f2d-4ac7-ae14-09ce76060f22 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Deleted allocations for instance 765eb553-6c1c-4d5a-a1cf-6ac8b348ac8e
Aug 09 15:34:47 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-8299ce33-8f2d-4ac7-ae14-09ce76060f22 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Lock "765eb553-6c1c-4d5a-a1cf-6ac8b348ac8e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.618s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:34:49 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:34:49 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:34:51 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-1c9cf88e-0f7d-4519-b252-2785632fea79 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Acquiring lock "f780040f-b789-4b72-8986-813c7b9fe4a6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:34:51 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-1c9cf88e-0f7d-4519-b252-2785632fea79 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Lock "f780040f-b789-4b72-8986-813c7b9fe4a6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:34:51 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-1c9cf88e-0f7d-4519-b252-2785632fea79 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Acquiring lock "f780040f-b789-4b72-8986-813c7b9fe4a6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:34:51 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-1c9cf88e-0f7d-4519-b252-2785632fea79 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Lock "f780040f-b789-4b72-8986-813c7b9fe4a6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:34:51 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-1c9cf88e-0f7d-4519-b252-2785632fea79 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Lock "f780040f-b789-4b72-8986-813c7b9fe4a6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:34:51 user nova-compute[72382]: INFO nova.compute.manager [None req-1c9cf88e-0f7d-4519-b252-2785632fea79 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] [instance: f780040f-b789-4b72-8986-813c7b9fe4a6] Terminating instance
Aug 09 15:34:51 user nova-compute[72382]: DEBUG nova.compute.manager [None req-1c9cf88e-0f7d-4519-b252-2785632fea79 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] [instance: f780040f-b789-4b72-8986-813c7b9fe4a6] Start destroying the instance on the hypervisor. {{(pid=72382) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 15:34:51 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:34:51 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:34:51 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:34:51 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:34:51 user nova-compute[72382]: DEBUG nova.compute.manager [req-b734951a-2612-49e3-aee3-9723ca490b6a req-60b530ed-c8aa-4ab0-a432-a86fe14b46d5 service nova] [instance: f780040f-b789-4b72-8986-813c7b9fe4a6] Received event network-vif-unplugged-3c9b6983-5682-4eaa-866c-1baf9f2ede26 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:34:51 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-b734951a-2612-49e3-aee3-9723ca490b6a req-60b530ed-c8aa-4ab0-a432-a86fe14b46d5 service nova] Acquiring lock "f780040f-b789-4b72-8986-813c7b9fe4a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:34:51 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-b734951a-2612-49e3-aee3-9723ca490b6a req-60b530ed-c8aa-4ab0-a432-a86fe14b46d5 service nova] Lock "f780040f-b789-4b72-8986-813c7b9fe4a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:34:51 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-b734951a-2612-49e3-aee3-9723ca490b6a req-60b530ed-c8aa-4ab0-a432-a86fe14b46d5 service nova] Lock "f780040f-b789-4b72-8986-813c7b9fe4a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:34:51 user nova-compute[72382]: DEBUG nova.compute.manager [req-b734951a-2612-49e3-aee3-9723ca490b6a req-60b530ed-c8aa-4ab0-a432-a86fe14b46d5 service nova] [instance: f780040f-b789-4b72-8986-813c7b9fe4a6] No waiting events found dispatching network-vif-unplugged-3c9b6983-5682-4eaa-866c-1baf9f2ede26 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:34:51 user nova-compute[72382]: DEBUG nova.compute.manager [req-b734951a-2612-49e3-aee3-9723ca490b6a req-60b530ed-c8aa-4ab0-a432-a86fe14b46d5 service nova] [instance: f780040f-b789-4b72-8986-813c7b9fe4a6] Received event network-vif-unplugged-3c9b6983-5682-4eaa-866c-1baf9f2ede26 for instance with task_state deleting. {{(pid=72382) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 15:34:51 user nova-compute[72382]: INFO nova.virt.libvirt.driver [-] [instance: f780040f-b789-4b72-8986-813c7b9fe4a6] Instance destroyed successfully.
Aug 09 15:34:51 user nova-compute[72382]: DEBUG nova.objects.instance [None req-1c9cf88e-0f7d-4519-b252-2785632fea79 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Lazy-loading 'resources' on Instance uuid f780040f-b789-4b72-8986-813c7b9fe4a6 {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:34:51 user nova-compute[72382]: DEBUG nova.virt.libvirt.vif [None req-1c9cf88e-0f7d-4519-b252-2785632fea79 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T15:15:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-639252285',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-639252285',id=1,image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-09T15:15:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='080d1ded4cd94e5083ee0b7e691b7363',ramdisk_id='',reservation_id='r-603sw5mw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1187177274',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T15:17:05Z,user_data=None,user_id='e71af7a4912147cd9fab070cb77b275c',uuid=f780040f-b789-4b72-8986-813c7b9fe4a6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3c9b6983-5682-4eaa-866c-1baf9f2ede26", "address": "fa:16:3e:20:d4:ea", "network": {"id": "d47e3749-fdff-4112-bd72-69ca584efe1f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-302967634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "080d1ded4cd94e5083ee0b7e691b7363", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c9b6983-56", "ovs_interfaceid": "3c9b6983-5682-4eaa-866c-1baf9f2ede26", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 15:34:51 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-1c9cf88e-0f7d-4519-b252-2785632fea79 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Converting VIF {"id": "3c9b6983-5682-4eaa-866c-1baf9f2ede26", "address": "fa:16:3e:20:d4:ea", "network": {"id": "d47e3749-fdff-4112-bd72-69ca584efe1f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-302967634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "080d1ded4cd94e5083ee0b7e691b7363", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c9b6983-56", "ovs_interfaceid": "3c9b6983-5682-4eaa-866c-1baf9f2ede26", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 15:34:51 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-1c9cf88e-0f7d-4519-b252-2785632fea79 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:20:d4:ea,bridge_name='br-int',has_traffic_filtering=True,id=3c9b6983-5682-4eaa-866c-1baf9f2ede26,network=Network(d47e3749-fdff-4112-bd72-69ca584efe1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c9b6983-56') {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 15:34:51 user nova-compute[72382]: DEBUG os_vif [None req-1c9cf88e-0f7d-4519-b252-2785632fea79 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:20:d4:ea,bridge_name='br-int',has_traffic_filtering=True,id=3c9b6983-5682-4eaa-866c-1baf9f2ede26,network=Network(d47e3749-fdff-4112-bd72-69ca584efe1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c9b6983-56') {{(pid=72382) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 15:34:51 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:34:51 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3c9b6983-56, bridge=br-int, if_exists=True) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:34:51 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:34:51 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:34:51 user nova-compute[72382]: INFO os_vif [None req-1c9cf88e-0f7d-4519-b252-2785632fea79 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:20:d4:ea,bridge_name='br-int',has_traffic_filtering=True,id=3c9b6983-5682-4eaa-866c-1baf9f2ede26,network=Network(d47e3749-fdff-4112-bd72-69ca584efe1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c9b6983-56')
Aug 09 15:34:51 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-1c9cf88e-0f7d-4519-b252-2785632fea79 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] [instance: f780040f-b789-4b72-8986-813c7b9fe4a6] Deleting instance files /opt/stack/data/nova/instances/f780040f-b789-4b72-8986-813c7b9fe4a6_del
Aug 09 15:34:51 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-1c9cf88e-0f7d-4519-b252-2785632fea79 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] [instance: f780040f-b789-4b72-8986-813c7b9fe4a6] Deletion of /opt/stack/data/nova/instances/f780040f-b789-4b72-8986-813c7b9fe4a6_del complete
Aug 09 15:34:52 user nova-compute[72382]: INFO nova.compute.manager [None req-1c9cf88e-0f7d-4519-b252-2785632fea79 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] [instance: f780040f-b789-4b72-8986-813c7b9fe4a6] Took 0.93 seconds to destroy the instance on the hypervisor.
Aug 09 15:34:52 user nova-compute[72382]: DEBUG oslo.service.loopingcall [None req-1c9cf88e-0f7d-4519-b252-2785632fea79 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72382) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 15:34:52 user nova-compute[72382]: DEBUG nova.compute.manager [-] [instance: f780040f-b789-4b72-8986-813c7b9fe4a6] Deallocating network for instance {{(pid=72382) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 15:34:52 user nova-compute[72382]: DEBUG nova.network.neutron [-] [instance: f780040f-b789-4b72-8986-813c7b9fe4a6] deallocate_for_instance() {{(pid=72382) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 15:34:52 user nova-compute[72382]: DEBUG nova.network.neutron [-] [instance: f780040f-b789-4b72-8986-813c7b9fe4a6] Updating instance_info_cache with network_info: [] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:34:52 user nova-compute[72382]: INFO nova.compute.manager [-] [instance: f780040f-b789-4b72-8986-813c7b9fe4a6] Took 0.52 seconds to deallocate network for instance.
Aug 09 15:34:52 user nova-compute[72382]: DEBUG nova.compute.manager [req-c0a4fdcd-58b2-4431-a876-bf6a13ea66f1 req-7f84a443-c91b-425c-b373-9d0313160903 service nova] [instance: f780040f-b789-4b72-8986-813c7b9fe4a6] Received event network-vif-deleted-3c9b6983-5682-4eaa-866c-1baf9f2ede26 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:34:52 user nova-compute[72382]: INFO nova.compute.manager [req-c0a4fdcd-58b2-4431-a876-bf6a13ea66f1 req-7f84a443-c91b-425c-b373-9d0313160903 service nova] [instance: f780040f-b789-4b72-8986-813c7b9fe4a6] Neutron deleted interface 3c9b6983-5682-4eaa-866c-1baf9f2ede26; detaching it from the instance and deleting it from the info cache
Aug 09 15:34:52 user nova-compute[72382]: DEBUG nova.network.neutron [req-c0a4fdcd-58b2-4431-a876-bf6a13ea66f1 req-7f84a443-c91b-425c-b373-9d0313160903 service nova] [instance: f780040f-b789-4b72-8986-813c7b9fe4a6] Updating instance_info_cache with network_info: [] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:34:52 user nova-compute[72382]: DEBUG nova.compute.manager [req-c0a4fdcd-58b2-4431-a876-bf6a13ea66f1 req-7f84a443-c91b-425c-b373-9d0313160903 service nova] [instance: f780040f-b789-4b72-8986-813c7b9fe4a6] Detach interface failed, port_id=3c9b6983-5682-4eaa-866c-1baf9f2ede26, reason: Instance f780040f-b789-4b72-8986-813c7b9fe4a6 could not be found. {{(pid=72382) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 09 15:34:52 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-1c9cf88e-0f7d-4519-b252-2785632fea79 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:34:52 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-1c9cf88e-0f7d-4519-b252-2785632fea79 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:34:52 user nova-compute[72382]: DEBUG nova.compute.provider_tree [None req-1c9cf88e-0f7d-4519-b252-2785632fea79 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Inventory has not changed in ProviderTree for provider: 7b15b0e5-df4d-49db-833b-2855d21d10ae {{(pid=72382) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 15:34:52 user nova-compute[72382]: DEBUG nova.scheduler.client.report [None req-1c9cf88e-0f7d-4519-b252-2785632fea79 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Inventory has not changed for provider 7b15b0e5-df4d-49db-833b-2855d21d10ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72382) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 15:34:52 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-1c9cf88e-0f7d-4519-b252-2785632fea79 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.215s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:34:52 user nova-compute[72382]: INFO nova.scheduler.client.report [None req-1c9cf88e-0f7d-4519-b252-2785632fea79 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Deleted allocations for instance f780040f-b789-4b72-8986-813c7b9fe4a6
Aug 09 15:34:52 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-1c9cf88e-0f7d-4519-b252-2785632fea79 tempest-ServerBootFromVolumeStableRescueTest-1187177274 tempest-ServerBootFromVolumeStableRescueTest-1187177274-project-member] Lock "f780040f-b789-4b72-8986-813c7b9fe4a6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.848s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:34:53 user nova-compute[72382]: DEBUG nova.compute.manager [req-cc71eddd-cb3f-431c-bb58-32062321925d req-381cf04c-3064-4405-9d44-5b2ca41cc4e6 service nova] [instance: f780040f-b789-4b72-8986-813c7b9fe4a6] Received event network-vif-plugged-3c9b6983-5682-4eaa-866c-1baf9f2ede26 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:34:53 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-cc71eddd-cb3f-431c-bb58-32062321925d req-381cf04c-3064-4405-9d44-5b2ca41cc4e6 service nova] Acquiring lock "f780040f-b789-4b72-8986-813c7b9fe4a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:34:53 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-cc71eddd-cb3f-431c-bb58-32062321925d req-381cf04c-3064-4405-9d44-5b2ca41cc4e6 service nova] Lock "f780040f-b789-4b72-8986-813c7b9fe4a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:34:53 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-cc71eddd-cb3f-431c-bb58-32062321925d req-381cf04c-3064-4405-9d44-5b2ca41cc4e6 service nova] Lock "f780040f-b789-4b72-8986-813c7b9fe4a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:34:53 user nova-compute[72382]: DEBUG nova.compute.manager [req-cc71eddd-cb3f-431c-bb58-32062321925d req-381cf04c-3064-4405-9d44-5b2ca41cc4e6 service nova] [instance: f780040f-b789-4b72-8986-813c7b9fe4a6] No waiting events found dispatching network-vif-plugged-3c9b6983-5682-4eaa-866c-1baf9f2ede26 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:34:53 user nova-compute[72382]: WARNING nova.compute.manager [req-cc71eddd-cb3f-431c-bb58-32062321925d req-381cf04c-3064-4405-9d44-5b2ca41cc4e6 service nova] [instance: f780040f-b789-4b72-8986-813c7b9fe4a6] Received unexpected event network-vif-plugged-3c9b6983-5682-4eaa-866c-1baf9f2ede26 for instance with vm_state deleted and task_state None.
Aug 09 15:34:54 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:34:56 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:34:59 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:34:59 user nova-compute[72382]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691595284.759067, 765eb553-6c1c-4d5a-a1cf-6ac8b348ac8e => Stopped> {{(pid=72382) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 15:34:59 user nova-compute[72382]: INFO nova.compute.manager [-] [instance: 765eb553-6c1c-4d5a-a1cf-6ac8b348ac8e] VM Stopped (Lifecycle Event)
Aug 09 15:34:59 user nova-compute[72382]: DEBUG nova.compute.manager [None req-38c7fcce-de40-4530-b00b-be710d858993 None None] [instance: 765eb553-6c1c-4d5a-a1cf-6ac8b348ac8e] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:35:01 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-86078130-191b-4f91-b665-bd2b2532b444 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Acquiring lock "402ba448-a30a-45f2-a724-5a53cf584547" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:35:01 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-86078130-191b-4f91-b665-bd2b2532b444 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Lock "402ba448-a30a-45f2-a724-5a53cf584547" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:35:01 user nova-compute[72382]: DEBUG nova.compute.manager [None req-86078130-191b-4f91-b665-bd2b2532b444 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] [instance: 402ba448-a30a-45f2-a724-5a53cf584547] Starting instance... {{(pid=72382) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 15:35:01 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-86078130-191b-4f91-b665-bd2b2532b444 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:35:01 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-86078130-191b-4f91-b665-bd2b2532b444 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:35:01 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-86078130-191b-4f91-b665-bd2b2532b444 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72382) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 15:35:01 user nova-compute[72382]: INFO nova.compute.claims [None req-86078130-191b-4f91-b665-bd2b2532b444 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] [instance: 402ba448-a30a-45f2-a724-5a53cf584547] Claim successful on node user
Aug 09 15:35:01 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:35:02 user nova-compute[72382]: DEBUG nova.compute.provider_tree [None req-86078130-191b-4f91-b665-bd2b2532b444 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Inventory has not changed in ProviderTree for provider: 7b15b0e5-df4d-49db-833b-2855d21d10ae {{(pid=72382) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 15:35:02 user nova-compute[72382]: DEBUG nova.scheduler.client.report [None req-86078130-191b-4f91-b665-bd2b2532b444 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Inventory has not changed for provider 7b15b0e5-df4d-49db-833b-2855d21d10ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72382) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 15:35:02 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-86078130-191b-4f91-b665-bd2b2532b444 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.292s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:35:02 user nova-compute[72382]: DEBUG nova.compute.manager [None req-86078130-191b-4f91-b665-bd2b2532b444 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] [instance: 402ba448-a30a-45f2-a724-5a53cf584547] Start building networks asynchronously for instance. {{(pid=72382) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 15:35:02 user nova-compute[72382]: DEBUG nova.compute.manager [None req-86078130-191b-4f91-b665-bd2b2532b444 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] [instance: 402ba448-a30a-45f2-a724-5a53cf584547] Allocating IP information in the background. {{(pid=72382) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 15:35:02 user nova-compute[72382]: DEBUG nova.network.neutron [None req-86078130-191b-4f91-b665-bd2b2532b444 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] [instance: 402ba448-a30a-45f2-a724-5a53cf584547] allocate_for_instance() {{(pid=72382) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 15:35:02 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-86078130-191b-4f91-b665-bd2b2532b444 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] [instance: 402ba448-a30a-45f2-a724-5a53cf584547] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 15:35:02 user nova-compute[72382]: DEBUG nova.compute.manager [None req-86078130-191b-4f91-b665-bd2b2532b444 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] [instance: 402ba448-a30a-45f2-a724-5a53cf584547] Start building block device mappings for instance. {{(pid=72382) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 15:35:02 user nova-compute[72382]: DEBUG nova.compute.manager [None req-86078130-191b-4f91-b665-bd2b2532b444 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] [instance: 402ba448-a30a-45f2-a724-5a53cf584547] Start spawning the instance on the hypervisor. {{(pid=72382) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 15:35:02 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-86078130-191b-4f91-b665-bd2b2532b444 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] [instance: 402ba448-a30a-45f2-a724-5a53cf584547] Creating instance directory {{(pid=72382) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 15:35:02 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-86078130-191b-4f91-b665-bd2b2532b444 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] [instance: 402ba448-a30a-45f2-a724-5a53cf584547] Creating image(s)
Aug 09 15:35:02 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-86078130-191b-4f91-b665-bd2b2532b444 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Acquiring lock "/opt/stack/data/nova/instances/402ba448-a30a-45f2-a724-5a53cf584547/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:35:02 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-86078130-191b-4f91-b665-bd2b2532b444 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Lock "/opt/stack/data/nova/instances/402ba448-a30a-45f2-a724-5a53cf584547/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:35:02 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-86078130-191b-4f91-b665-bd2b2532b444 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Lock "/opt/stack/data/nova/instances/402ba448-a30a-45f2-a724-5a53cf584547/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:35:02 user nova-compute[72382]: DEBUG nova.policy [None req-86078130-191b-4f91-b665-bd2b2532b444 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9f95e50aa6194e778dfaee31e6e2fa68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6db5fd3ce24c1cadbedd64757e219b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72382) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 15:35:02 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-86078130-191b-4f91-b665-bd2b2532b444 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:35:02 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-86078130-191b-4f91-b665-bd2b2532b444 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b --force-share --output=json" returned: 0 in 0.138s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:35:02 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-86078130-191b-4f91-b665-bd2b2532b444 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Acquiring lock "383812ff437283e0191ed5b9ecc04c27f1162b0b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:35:02 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-86078130-191b-4f91-b665-bd2b2532b444 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Lock "383812ff437283e0191ed5b9ecc04c27f1162b0b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:35:02 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-86078130-191b-4f91-b665-bd2b2532b444 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:35:02 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-86078130-191b-4f91-b665-bd2b2532b444 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b --force-share --output=json" returned: 0 in 0.128s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:35:02 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-86078130-191b-4f91-b665-bd2b2532b444 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b,backing_fmt=raw /opt/stack/data/nova/instances/402ba448-a30a-45f2-a724-5a53cf584547/disk 1073741824 {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:35:02 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-86078130-191b-4f91-b665-bd2b2532b444 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b,backing_fmt=raw /opt/stack/data/nova/instances/402ba448-a30a-45f2-a724-5a53cf584547/disk 1073741824" returned: 0 in 0.050s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:35:02 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-86078130-191b-4f91-b665-bd2b2532b444 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Lock "383812ff437283e0191ed5b9ecc04c27f1162b0b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.185s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:35:02 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-86078130-191b-4f91-b665-bd2b2532b444 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:35:02 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-86078130-191b-4f91-b665-bd2b2532b444 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b --force-share --output=json" returned: 0 in 0.136s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:35:02 user nova-compute[72382]: DEBUG nova.virt.disk.api [None req-86078130-191b-4f91-b665-bd2b2532b444 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Checking if we can resize image /opt/stack/data/nova/instances/402ba448-a30a-45f2-a724-5a53cf584547/disk. size=1073741824 {{(pid=72382) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 15:35:02 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-86078130-191b-4f91-b665-bd2b2532b444 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/402ba448-a30a-45f2-a724-5a53cf584547/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:35:03 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-86078130-191b-4f91-b665-bd2b2532b444 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/402ba448-a30a-45f2-a724-5a53cf584547/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:35:03 user nova-compute[72382]: DEBUG nova.virt.disk.api [None req-86078130-191b-4f91-b665-bd2b2532b444 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Cannot resize image /opt/stack/data/nova/instances/402ba448-a30a-45f2-a724-5a53cf584547/disk to a smaller size. {{(pid=72382) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 15:35:03 user nova-compute[72382]: DEBUG nova.objects.instance [None req-86078130-191b-4f91-b665-bd2b2532b444 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Lazy-loading 'migration_context' on Instance uuid 402ba448-a30a-45f2-a724-5a53cf584547 {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:35:03 user nova-compute[72382]: DEBUG nova.network.neutron [None req-86078130-191b-4f91-b665-bd2b2532b444 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] [instance: 402ba448-a30a-45f2-a724-5a53cf584547] Successfully created port: a4cb9706-2448-4789-b7ef-8c4bef62e160 {{(pid=72382) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 15:35:03 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-86078130-191b-4f91-b665-bd2b2532b444 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] [instance: 402ba448-a30a-45f2-a724-5a53cf584547] Created local disks {{(pid=72382) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 15:35:03 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-86078130-191b-4f91-b665-bd2b2532b444 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] [instance: 402ba448-a30a-45f2-a724-5a53cf584547] Ensure instance console log exists: /opt/stack/data/nova/instances/402ba448-a30a-45f2-a724-5a53cf584547/console.log {{(pid=72382) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 15:35:03 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-86078130-191b-4f91-b665-bd2b2532b444 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:35:03 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-86078130-191b-4f91-b665-bd2b2532b444 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:35:03 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-86078130-191b-4f91-b665-bd2b2532b444 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:35:03 user nova-compute[72382]: DEBUG nova.network.neutron [None req-86078130-191b-4f91-b665-bd2b2532b444 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] [instance: 402ba448-a30a-45f2-a724-5a53cf584547] Successfully updated port: a4cb9706-2448-4789-b7ef-8c4bef62e160 {{(pid=72382) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 15:35:03 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-86078130-191b-4f91-b665-bd2b2532b444 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Acquiring lock "refresh_cache-402ba448-a30a-45f2-a724-5a53cf584547" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 15:35:03 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-86078130-191b-4f91-b665-bd2b2532b444 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Acquired lock "refresh_cache-402ba448-a30a-45f2-a724-5a53cf584547" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 15:35:03 user nova-compute[72382]: DEBUG nova.network.neutron [None req-86078130-191b-4f91-b665-bd2b2532b444 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] [instance: 402ba448-a30a-45f2-a724-5a53cf584547] Building network info cache for instance {{(pid=72382) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 15:35:03 user nova-compute[72382]: DEBUG nova.compute.manager [req-65154969-9559-4d78-99aa-aae7888feb84 req-ff07a1c9-fe68-4acf-b7ec-34f09074424d service nova] [instance: 402ba448-a30a-45f2-a724-5a53cf584547] Received event network-changed-a4cb9706-2448-4789-b7ef-8c4bef62e160 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:35:03 user nova-compute[72382]: DEBUG nova.compute.manager [req-65154969-9559-4d78-99aa-aae7888feb84 req-ff07a1c9-fe68-4acf-b7ec-34f09074424d service nova] [instance: 402ba448-a30a-45f2-a724-5a53cf584547] Refreshing instance network info cache due to event network-changed-a4cb9706-2448-4789-b7ef-8c4bef62e160. {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 15:35:03 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-65154969-9559-4d78-99aa-aae7888feb84 req-ff07a1c9-fe68-4acf-b7ec-34f09074424d service nova] Acquiring lock "refresh_cache-402ba448-a30a-45f2-a724-5a53cf584547" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 15:35:03 user nova-compute[72382]: DEBUG nova.network.neutron [None req-86078130-191b-4f91-b665-bd2b2532b444 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] [instance: 402ba448-a30a-45f2-a724-5a53cf584547] Instance cache missing network info. {{(pid=72382) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 15:35:04 user nova-compute[72382]: DEBUG nova.network.neutron [None req-86078130-191b-4f91-b665-bd2b2532b444 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] [instance: 402ba448-a30a-45f2-a724-5a53cf584547] Updating instance_info_cache with network_info: [{"id": "a4cb9706-2448-4789-b7ef-8c4bef62e160", "address": "fa:16:3e:e7:e5:94", "network": {"id": "643703fd-46b7-4309-862c-109141cb008c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-512918576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa6db5fd3ce24c1cadbedd64757e219b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4cb9706-24", "ovs_interfaceid": "a4cb9706-2448-4789-b7ef-8c4bef62e160", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:35:04 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-86078130-191b-4f91-b665-bd2b2532b444 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Releasing lock "refresh_cache-402ba448-a30a-45f2-a724-5a53cf584547" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 15:35:04 user nova-compute[72382]: DEBUG nova.compute.manager [None req-86078130-191b-4f91-b665-bd2b2532b444 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] [instance: 402ba448-a30a-45f2-a724-5a53cf584547] Instance network_info: |[{"id": "a4cb9706-2448-4789-b7ef-8c4bef62e160", "address": "fa:16:3e:e7:e5:94", "network": {"id": "643703fd-46b7-4309-862c-109141cb008c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-512918576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa6db5fd3ce24c1cadbedd64757e219b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4cb9706-24", "ovs_interfaceid": "a4cb9706-2448-4789-b7ef-8c4bef62e160", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72382) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 15:35:04 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-65154969-9559-4d78-99aa-aae7888feb84 req-ff07a1c9-fe68-4acf-b7ec-34f09074424d service nova] Acquired lock "refresh_cache-402ba448-a30a-45f2-a724-5a53cf584547" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 15:35:04 user nova-compute[72382]: DEBUG nova.network.neutron [req-65154969-9559-4d78-99aa-aae7888feb84 req-ff07a1c9-fe68-4acf-b7ec-34f09074424d service nova] [instance: 402ba448-a30a-45f2-a724-5a53cf584547] Refreshing network info cache for port a4cb9706-2448-4789-b7ef-8c4bef62e160 {{(pid=72382) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 15:35:04 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-86078130-191b-4f91-b665-bd2b2532b444 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] [instance: 402ba448-a30a-45f2-a724-5a53cf584547] Start _get_guest_xml network_info=[{"id": "a4cb9706-2448-4789-b7ef-8c4bef62e160", "address": "fa:16:3e:e7:e5:94", "network": {"id": "643703fd-46b7-4309-862c-109141cb008c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-512918576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa6db5fd3ce24c1cadbedd64757e219b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4cb9706-24", "ovs_interfaceid": "a4cb9706-2448-4789-b7ef-8c4bef62e160", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T15:11:25Z,direct_url=<?>,disk_format='qcow2',id=a79f2cea-eb27-4631-aaf3-05e7d9e411b4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a638990e12cc4d6eabb6d55e13be6bdf',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T15:11:27Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'a79f2cea-eb27-4631-aaf3-05e7d9e411b4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72382) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 15:35:04 user nova-compute[72382]: WARNING nova.virt.libvirt.driver [None req-86078130-191b-4f91-b665-bd2b2532b444 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 15:35:04 user nova-compute[72382]: WARNING nova.virt.libvirt.driver [None req-86078130-191b-4f91-b665-bd2b2532b444 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 15:35:04 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-86078130-191b-4f91-b665-bd2b2532b444 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72382) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 15:35:04 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-86078130-191b-4f91-b665-bd2b2532b444 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] CPU controller missing on host. {{(pid=72382) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 15:35:04 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-86078130-191b-4f91-b665-bd2b2532b444 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72382) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 15:35:04 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-86078130-191b-4f91-b665-bd2b2532b444 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] CPU controller found on host. {{(pid=72382) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 15:35:04 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-86078130-191b-4f91-b665-bd2b2532b444 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72382) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 15:35:04 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-86078130-191b-4f91-b665-bd2b2532b444 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T15:11:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T15:11:25Z,direct_url=<?>,disk_format='qcow2',id=a79f2cea-eb27-4631-aaf3-05e7d9e411b4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a638990e12cc4d6eabb6d55e13be6bdf',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T15:11:27Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 15:35:04 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-86078130-191b-4f91-b665-bd2b2532b444 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Flavor limits 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 15:35:04 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-86078130-191b-4f91-b665-bd2b2532b444 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Image limits 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 15:35:04 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-86078130-191b-4f91-b665-bd2b2532b444 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Flavor pref 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 15:35:04 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-86078130-191b-4f91-b665-bd2b2532b444 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Image pref 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 15:35:04 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-86078130-191b-4f91-b665-bd2b2532b444 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 15:35:04 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-86078130-191b-4f91-b665-bd2b2532b444 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 15:35:04 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-86078130-191b-4f91-b665-bd2b2532b444 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72382) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 15:35:04 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-86078130-191b-4f91-b665-bd2b2532b444 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Got 1 possible topologies {{(pid=72382) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 15:35:04 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-86078130-191b-4f91-b665-bd2b2532b444 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 15:35:04 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-86078130-191b-4f91-b665-bd2b2532b444 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 15:35:04 user nova-compute[72382]: DEBUG nova.virt.libvirt.vif [None req-86078130-191b-4f91-b665-bd2b2532b444 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T15:35:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-65834704',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-65834704',id=38,image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMF6jGuDbbrqZljy46Ffz2lajM02q0PiUP2BGfP6v9JYu5Gi8oDy4mKIbO973B9Z4PvoU5+/eMR9OoifcYq5Mmsc7SREeeJyOCsTarAp00BSYBslt/NAoCbi98+xt4jnRg==',key_name='tempest-keypair-1104367240',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aa6db5fd3ce24c1cadbedd64757e219b',ramdisk_id='',reservation_id='r-aqp1oexg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1817688709',owner_user_name='tempest-AttachVolumeShelveTestJSON-1817688709-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T15:35:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9f95e50aa6194e778dfaee31e6e2fa68',uuid=402ba448-a30a-45f2-a724-5a53cf584547,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a4cb9706-2448-4789-b7ef-8c4bef62e160", "address": "fa:16:3e:e7:e5:94", "network": {"id": "643703fd-46b7-4309-862c-109141cb008c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-512918576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa6db5fd3ce24c1cadbedd64757e219b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4cb9706-24", "ovs_interfaceid": "a4cb9706-2448-4789-b7ef-8c4bef62e160", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72382) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 15:35:04 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-86078130-191b-4f91-b665-bd2b2532b444 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Converting VIF {"id": "a4cb9706-2448-4789-b7ef-8c4bef62e160", "address": "fa:16:3e:e7:e5:94", "network": {"id": "643703fd-46b7-4309-862c-109141cb008c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-512918576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa6db5fd3ce24c1cadbedd64757e219b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4cb9706-24", "ovs_interfaceid": "a4cb9706-2448-4789-b7ef-8c4bef62e160", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 15:35:04 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-86078130-191b-4f91-b665-bd2b2532b444 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:e5:94,bridge_name='br-int',has_traffic_filtering=True,id=a4cb9706-2448-4789-b7ef-8c4bef62e160,network=Network(643703fd-46b7-4309-862c-109141cb008c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4cb9706-24') {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 15:35:04 user nova-compute[72382]: DEBUG nova.objects.instance [None req-86078130-191b-4f91-b665-bd2b2532b444 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Lazy-loading 'pci_devices' on Instance uuid 402ba448-a30a-45f2-a724-5a53cf584547 {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:35:04 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-86078130-191b-4f91-b665-bd2b2532b444 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] [instance: 402ba448-a30a-45f2-a724-5a53cf584547] End _get_guest_xml xml=<domain type="kvm">
Aug 09 15:35:04 user nova-compute[72382]:   <uuid>402ba448-a30a-45f2-a724-5a53cf584547</uuid>
Aug 09 15:35:04 user nova-compute[72382]:   <name>instance-00000026</name>
Aug 09 15:35:04 user nova-compute[72382]:   <memory>524288</memory>
Aug 09 15:35:04 user nova-compute[72382]:   <vcpu>1</vcpu>
Aug 09 15:35:04 user nova-compute[72382]:   <metadata>
Aug 09 15:35:04 user nova-compute[72382]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 15:35:04 user nova-compute[72382]:       <nova:package version="0.0.0"/>
Aug 09 15:35:04 user nova-compute[72382]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-65834704</nova:name>
Aug 09 15:35:04 user nova-compute[72382]:       <nova:creationTime>2023-08-09 15:35:04</nova:creationTime>
Aug 09 15:35:04 user nova-compute[72382]:       <nova:flavor name="m1.tiny">
Aug 09 15:35:04 user nova-compute[72382]:         <nova:memory>512</nova:memory>
Aug 09 15:35:04 user nova-compute[72382]:         <nova:disk>1</nova:disk>
Aug 09 15:35:04 user nova-compute[72382]:         <nova:swap>0</nova:swap>
Aug 09 15:35:04 user nova-compute[72382]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 15:35:04 user nova-compute[72382]:         <nova:vcpus>1</nova:vcpus>
Aug 09 15:35:04 user nova-compute[72382]:       </nova:flavor>
Aug 09 15:35:04 user nova-compute[72382]:       <nova:owner>
Aug 09 15:35:04 user nova-compute[72382]:         <nova:user uuid="9f95e50aa6194e778dfaee31e6e2fa68">tempest-AttachVolumeShelveTestJSON-1817688709-project-member</nova:user>
Aug 09 15:35:04 user nova-compute[72382]:         <nova:project uuid="aa6db5fd3ce24c1cadbedd64757e219b">tempest-AttachVolumeShelveTestJSON-1817688709</nova:project>
Aug 09 15:35:04 user nova-compute[72382]:       </nova:owner>
Aug 09 15:35:04 user nova-compute[72382]:       <nova:root type="image" uuid="a79f2cea-eb27-4631-aaf3-05e7d9e411b4"/>
Aug 09 15:35:04 user nova-compute[72382]:       <nova:ports>
Aug 09 15:35:04 user nova-compute[72382]:         <nova:port uuid="a4cb9706-2448-4789-b7ef-8c4bef62e160">
Aug 09 15:35:04 user nova-compute[72382]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 09 15:35:04 user nova-compute[72382]:         </nova:port>
Aug 09 15:35:04 user nova-compute[72382]:       </nova:ports>
Aug 09 15:35:04 user nova-compute[72382]:     </nova:instance>
Aug 09 15:35:04 user nova-compute[72382]:   </metadata>
Aug 09 15:35:04 user nova-compute[72382]:   <sysinfo type="smbios">
Aug 09 15:35:04 user nova-compute[72382]:     <system>
Aug 09 15:35:04 user nova-compute[72382]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 15:35:04 user nova-compute[72382]:       <entry name="product">OpenStack Nova</entry>
Aug 09 15:35:04 user nova-compute[72382]:       <entry name="version">0.0.0</entry>
Aug 09 15:35:04 user nova-compute[72382]:       <entry name="serial">402ba448-a30a-45f2-a724-5a53cf584547</entry>
Aug 09 15:35:04 user nova-compute[72382]:       <entry name="uuid">402ba448-a30a-45f2-a724-5a53cf584547</entry>
Aug 09 15:35:04 user nova-compute[72382]:       <entry name="family">Virtual Machine</entry>
Aug 09 15:35:04 user nova-compute[72382]:     </system>
Aug 09 15:35:04 user nova-compute[72382]:   </sysinfo>
Aug 09 15:35:04 user nova-compute[72382]:   <os>
Aug 09 15:35:04 user nova-compute[72382]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 15:35:04 user nova-compute[72382]:     <boot dev="hd"/>
Aug 09 15:35:04 user nova-compute[72382]:     <smbios mode="sysinfo"/>
Aug 09 15:35:04 user nova-compute[72382]:   </os>
Aug 09 15:35:04 user nova-compute[72382]:   <features>
Aug 09 15:35:04 user nova-compute[72382]:     <acpi/>
Aug 09 15:35:04 user nova-compute[72382]:     <apic/>
Aug 09 15:35:04 user nova-compute[72382]:     <vmcoreinfo/>
Aug 09 15:35:04 user nova-compute[72382]:   </features>
Aug 09 15:35:04 user nova-compute[72382]:   <clock offset="utc">
Aug 09 15:35:04 user nova-compute[72382]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 15:35:04 user nova-compute[72382]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 15:35:04 user nova-compute[72382]:     <timer name="hpet" present="no"/>
Aug 09 15:35:04 user nova-compute[72382]:   </clock>
Aug 09 15:35:04 user nova-compute[72382]:   <cpu mode="custom" match="exact">
Aug 09 15:35:04 user nova-compute[72382]:     <model>Nehalem</model>
Aug 09 15:35:04 user nova-compute[72382]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 15:35:04 user nova-compute[72382]:   </cpu>
Aug 09 15:35:04 user nova-compute[72382]:   <devices>
Aug 09 15:35:04 user nova-compute[72382]:     <disk type="file" device="disk">
Aug 09 15:35:04 user nova-compute[72382]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 15:35:04 user nova-compute[72382]:       <source file="/opt/stack/data/nova/instances/402ba448-a30a-45f2-a724-5a53cf584547/disk"/>
Aug 09 15:35:04 user nova-compute[72382]:       <target dev="vda" bus="virtio"/>
Aug 09 15:35:04 user nova-compute[72382]:     </disk>
Aug 09 15:35:04 user nova-compute[72382]:     <interface type="ethernet">
Aug 09 15:35:04 user nova-compute[72382]:       <mac address="fa:16:3e:e7:e5:94"/>
Aug 09 15:35:04 user nova-compute[72382]:       <model type="virtio"/>
Aug 09 15:35:04 user nova-compute[72382]:       <mtu size="1442"/>
Aug 09 15:35:04 user nova-compute[72382]:       <target dev="tapa4cb9706-24"/>
Aug 09 15:35:04 user nova-compute[72382]:     </interface>
Aug 09 15:35:04 user nova-compute[72382]:     <serial type="pty">
Aug 09 15:35:04 user nova-compute[72382]:       <log file="/opt/stack/data/nova/instances/402ba448-a30a-45f2-a724-5a53cf584547/console.log" append="off"/>
Aug 09 15:35:04 user nova-compute[72382]:     </serial>
Aug 09 15:35:04 user nova-compute[72382]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 15:35:04 user nova-compute[72382]:     <video>
Aug 09 15:35:04 user nova-compute[72382]:       <model type="virtio"/>
Aug 09 15:35:04 user nova-compute[72382]:     </video>
Aug 09 15:35:04 user nova-compute[72382]:     <rng model="virtio">
Aug 09 15:35:04 user nova-compute[72382]:       <backend model="random">/dev/urandom</backend>
Aug 09 15:35:04 user nova-compute[72382]:     </rng>
Aug 09 15:35:04 user nova-compute[72382]:     <controller type="usb" index="0" model="none"/>
Aug 09 15:35:04 user nova-compute[72382]:     <memballoon model="virtio">
Aug 09 15:35:04 user nova-compute[72382]:       <stats period="10"/>
Aug 09 15:35:04 user nova-compute[72382]:     </memballoon>
Aug 09 15:35:04 user nova-compute[72382]:   </devices>
Aug 09 15:35:04 user nova-compute[72382]: </domain>
Aug 09 15:35:04 user nova-compute[72382]:  {{(pid=72382) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 15:35:04 user nova-compute[72382]: DEBUG nova.virt.libvirt.vif [None req-86078130-191b-4f91-b665-bd2b2532b444 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T15:35:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-65834704',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-65834704',id=38,image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMF6jGuDbbrqZljy46Ffz2lajM02q0PiUP2BGfP6v9JYu5Gi8oDy4mKIbO973B9Z4PvoU5+/eMR9OoifcYq5Mmsc7SREeeJyOCsTarAp00BSYBslt/NAoCbi98+xt4jnRg==',key_name='tempest-keypair-1104367240',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aa6db5fd3ce24c1cadbedd64757e219b',ramdisk_id='',reservation_id='r-aqp1oexg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1817688709',owner_user_name='tempest-AttachVolumeShelveTestJSON-1817688709-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T15:35:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9f95e50aa6194e778dfaee31e6e2fa68',uuid=402ba448-a30a-45f2-a724-5a53cf584547,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a4cb9706-2448-4789-b7ef-8c4bef62e160", "address": "fa:16:3e:e7:e5:94", "network": {"id": "643703fd-46b7-4309-862c-109141cb008c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-512918576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa6db5fd3ce24c1cadbedd64757e219b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4cb9706-24", "ovs_interfaceid": "a4cb9706-2448-4789-b7ef-8c4bef62e160", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 15:35:04 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-86078130-191b-4f91-b665-bd2b2532b444 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Converting VIF {"id": "a4cb9706-2448-4789-b7ef-8c4bef62e160", "address": "fa:16:3e:e7:e5:94", "network": {"id": "643703fd-46b7-4309-862c-109141cb008c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-512918576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa6db5fd3ce24c1cadbedd64757e219b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4cb9706-24", "ovs_interfaceid": "a4cb9706-2448-4789-b7ef-8c4bef62e160", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 15:35:04 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-86078130-191b-4f91-b665-bd2b2532b444 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:e5:94,bridge_name='br-int',has_traffic_filtering=True,id=a4cb9706-2448-4789-b7ef-8c4bef62e160,network=Network(643703fd-46b7-4309-862c-109141cb008c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4cb9706-24') {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 15:35:04 user nova-compute[72382]: DEBUG os_vif [None req-86078130-191b-4f91-b665-bd2b2532b444 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:e5:94,bridge_name='br-int',has_traffic_filtering=True,id=a4cb9706-2448-4789-b7ef-8c4bef62e160,network=Network(643703fd-46b7-4309-862c-109141cb008c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4cb9706-24') {{(pid=72382) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 15:35:04 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:35:04 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:35:04 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 15:35:04 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:35:04 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa4cb9706-24, may_exist=True, interface_attrs={}) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:35:04 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa4cb9706-24, col_values=(('external_ids', {'iface-id': 'a4cb9706-2448-4789-b7ef-8c4bef62e160', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e7:e5:94', 'vm-uuid': '402ba448-a30a-45f2-a724-5a53cf584547'}),), if_exists=True) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:35:04 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:35:04 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:35:04 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:35:04 user nova-compute[72382]: INFO os_vif [None req-86078130-191b-4f91-b665-bd2b2532b444 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:e5:94,bridge_name='br-int',has_traffic_filtering=True,id=a4cb9706-2448-4789-b7ef-8c4bef62e160,network=Network(643703fd-46b7-4309-862c-109141cb008c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4cb9706-24')
Aug 09 15:35:04 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-86078130-191b-4f91-b665-bd2b2532b444 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] No BDM found with device name vda, not building metadata. {{(pid=72382) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 15:35:04 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-86078130-191b-4f91-b665-bd2b2532b444 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] No VIF found with MAC fa:16:3e:e7:e5:94, not building metadata {{(pid=72382) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 15:35:04 user nova-compute[72382]: DEBUG nova.network.neutron [req-65154969-9559-4d78-99aa-aae7888feb84 req-ff07a1c9-fe68-4acf-b7ec-34f09074424d service nova] [instance: 402ba448-a30a-45f2-a724-5a53cf584547] Updated VIF entry in instance network info cache for port a4cb9706-2448-4789-b7ef-8c4bef62e160. {{(pid=72382) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 15:35:04 user nova-compute[72382]: DEBUG nova.network.neutron [req-65154969-9559-4d78-99aa-aae7888feb84 req-ff07a1c9-fe68-4acf-b7ec-34f09074424d service nova] [instance: 402ba448-a30a-45f2-a724-5a53cf584547] Updating instance_info_cache with network_info: [{"id": "a4cb9706-2448-4789-b7ef-8c4bef62e160", "address": "fa:16:3e:e7:e5:94", "network": {"id": "643703fd-46b7-4309-862c-109141cb008c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-512918576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa6db5fd3ce24c1cadbedd64757e219b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4cb9706-24", "ovs_interfaceid": "a4cb9706-2448-4789-b7ef-8c4bef62e160", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:35:04 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-65154969-9559-4d78-99aa-aae7888feb84 req-ff07a1c9-fe68-4acf-b7ec-34f09074424d service nova] Releasing lock "refresh_cache-402ba448-a30a-45f2-a724-5a53cf584547" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 15:35:04 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:35:05 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-3e366e23-dbc1-45d8-b0e5-f8bb85f5745a tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Acquiring lock "14c97840-88c0-4a8e-96e8-2e7da318ad07" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:35:05 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-3e366e23-dbc1-45d8-b0e5-f8bb85f5745a tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Lock "14c97840-88c0-4a8e-96e8-2e7da318ad07" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:35:05 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-3e366e23-dbc1-45d8-b0e5-f8bb85f5745a tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Acquiring lock "14c97840-88c0-4a8e-96e8-2e7da318ad07-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:35:05 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-3e366e23-dbc1-45d8-b0e5-f8bb85f5745a tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Lock "14c97840-88c0-4a8e-96e8-2e7da318ad07-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:35:05 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-3e366e23-dbc1-45d8-b0e5-f8bb85f5745a tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Lock "14c97840-88c0-4a8e-96e8-2e7da318ad07-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:35:05 user nova-compute[72382]: INFO nova.compute.manager [None req-3e366e23-dbc1-45d8-b0e5-f8bb85f5745a tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] [instance: 14c97840-88c0-4a8e-96e8-2e7da318ad07] Terminating instance
Aug 09 15:35:05 user nova-compute[72382]: DEBUG nova.compute.manager [None req-3e366e23-dbc1-45d8-b0e5-f8bb85f5745a tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] [instance: 14c97840-88c0-4a8e-96e8-2e7da318ad07] Start destroying the instance on the hypervisor. {{(pid=72382) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 15:35:05 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:35:05 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:35:05 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:35:05 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:35:05 user nova-compute[72382]: DEBUG nova.compute.manager [req-b17ce8ed-d102-40d9-8522-6c2e73d884b2 req-efb32917-4e5a-4274-a96f-d0109c9fe86b service nova] [instance: 14c97840-88c0-4a8e-96e8-2e7da318ad07] Received event network-vif-unplugged-f22c0d53-f0da-4bc9-bf7b-c10fe61e2e1f {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:35:05 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-b17ce8ed-d102-40d9-8522-6c2e73d884b2 req-efb32917-4e5a-4274-a96f-d0109c9fe86b service nova] Acquiring lock "14c97840-88c0-4a8e-96e8-2e7da318ad07-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:35:05 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-b17ce8ed-d102-40d9-8522-6c2e73d884b2 req-efb32917-4e5a-4274-a96f-d0109c9fe86b service nova] Lock "14c97840-88c0-4a8e-96e8-2e7da318ad07-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:35:05 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-b17ce8ed-d102-40d9-8522-6c2e73d884b2 req-efb32917-4e5a-4274-a96f-d0109c9fe86b service nova] Lock "14c97840-88c0-4a8e-96e8-2e7da318ad07-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:35:05 user nova-compute[72382]: DEBUG nova.compute.manager [req-b17ce8ed-d102-40d9-8522-6c2e73d884b2 req-efb32917-4e5a-4274-a96f-d0109c9fe86b service nova] [instance: 14c97840-88c0-4a8e-96e8-2e7da318ad07] No waiting events found dispatching network-vif-unplugged-f22c0d53-f0da-4bc9-bf7b-c10fe61e2e1f {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:35:05 user nova-compute[72382]: DEBUG nova.compute.manager [req-b17ce8ed-d102-40d9-8522-6c2e73d884b2 req-efb32917-4e5a-4274-a96f-d0109c9fe86b service nova] [instance: 14c97840-88c0-4a8e-96e8-2e7da318ad07] Received event network-vif-unplugged-f22c0d53-f0da-4bc9-bf7b-c10fe61e2e1f for instance with task_state deleting. {{(pid=72382) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 15:35:06 user nova-compute[72382]: INFO nova.virt.libvirt.driver [-] [instance: 14c97840-88c0-4a8e-96e8-2e7da318ad07] Instance destroyed successfully.
Aug 09 15:35:06 user nova-compute[72382]: DEBUG nova.objects.instance [None req-3e366e23-dbc1-45d8-b0e5-f8bb85f5745a tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Lazy-loading 'resources' on Instance uuid 14c97840-88c0-4a8e-96e8-2e7da318ad07 {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:35:06 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:35:06 user nova-compute[72382]: DEBUG nova.virt.libvirt.vif [None req-3e366e23-dbc1-45d8-b0e5-f8bb85f5745a tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T15:25:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1065057662',display_name='tempest-AttachVolumeTestJSON-server-1065057662',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1065057662',id=25,image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDpgWhLPGWY2ElRglFQBqLuKZWglAfFVsofJemv1+kc4sKM1iZJZQ3Zp8fFAbw72Xaat0sVYwxhfDdHsZAI0ReSI/gfbVL6O5P/l5QvCIWZ9WBMY/UBAwONL1kUKiqSY5Q==',key_name='tempest-keypair-138739448',keypairs=<?>,launch_index=0,launched_at=2023-08-09T15:25:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8c1a50eacfd0414bbc13e3fd4087e998',ramdisk_id='',reservation_id='r-p2h4ne70',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-502043064',owner_user_name='tempest-AttachVolumeTestJSON-502043064-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T15:33:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='13c67153e9ec44029e8d80c09d405175',uuid=14c97840-88c0-4a8e-96e8-2e7da318ad07,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f22c0d53-f0da-4bc9-bf7b-c10fe61e2e1f", "address": "fa:16:3e:72:44:b1", "network": {"id": "a85a6e1f-20f5-4719-90d2-0dc23ce525cd", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-780716970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c1a50eacfd0414bbc13e3fd4087e998", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf22c0d53-f0", "ovs_interfaceid": "f22c0d53-f0da-4bc9-bf7b-c10fe61e2e1f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 15:35:06 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-3e366e23-dbc1-45d8-b0e5-f8bb85f5745a tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Converting VIF {"id": "f22c0d53-f0da-4bc9-bf7b-c10fe61e2e1f", "address": "fa:16:3e:72:44:b1", "network": {"id": "a85a6e1f-20f5-4719-90d2-0dc23ce525cd", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-780716970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c1a50eacfd0414bbc13e3fd4087e998", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf22c0d53-f0", "ovs_interfaceid": "f22c0d53-f0da-4bc9-bf7b-c10fe61e2e1f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 15:35:06 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-3e366e23-dbc1-45d8-b0e5-f8bb85f5745a tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:72:44:b1,bridge_name='br-int',has_traffic_filtering=True,id=f22c0d53-f0da-4bc9-bf7b-c10fe61e2e1f,network=Network(a85a6e1f-20f5-4719-90d2-0dc23ce525cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf22c0d53-f0') {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 15:35:06 user nova-compute[72382]: DEBUG os_vif [None req-3e366e23-dbc1-45d8-b0e5-f8bb85f5745a tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:72:44:b1,bridge_name='br-int',has_traffic_filtering=True,id=f22c0d53-f0da-4bc9-bf7b-c10fe61e2e1f,network=Network(a85a6e1f-20f5-4719-90d2-0dc23ce525cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf22c0d53-f0') {{(pid=72382) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 15:35:06 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:35:06 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf22c0d53-f0, bridge=br-int, if_exists=True) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:35:06 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:35:06 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:35:06 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:35:06 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:35:06 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:35:06 user nova-compute[72382]: INFO os_vif [None req-3e366e23-dbc1-45d8-b0e5-f8bb85f5745a tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:72:44:b1,bridge_name='br-int',has_traffic_filtering=True,id=f22c0d53-f0da-4bc9-bf7b-c10fe61e2e1f,network=Network(a85a6e1f-20f5-4719-90d2-0dc23ce525cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf22c0d53-f0')
Aug 09 15:35:06 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-3e366e23-dbc1-45d8-b0e5-f8bb85f5745a tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] [instance: 14c97840-88c0-4a8e-96e8-2e7da318ad07] Deleting instance files /opt/stack/data/nova/instances/14c97840-88c0-4a8e-96e8-2e7da318ad07_del
Aug 09 15:35:06 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-3e366e23-dbc1-45d8-b0e5-f8bb85f5745a tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] [instance: 14c97840-88c0-4a8e-96e8-2e7da318ad07] Deletion of /opt/stack/data/nova/instances/14c97840-88c0-4a8e-96e8-2e7da318ad07_del complete
Aug 09 15:35:06 user nova-compute[72382]: INFO nova.compute.manager [None req-3e366e23-dbc1-45d8-b0e5-f8bb85f5745a tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] [instance: 14c97840-88c0-4a8e-96e8-2e7da318ad07] Took 1.14 seconds to destroy the instance on the hypervisor.
Aug 09 15:35:06 user nova-compute[72382]: DEBUG oslo.service.loopingcall [None req-3e366e23-dbc1-45d8-b0e5-f8bb85f5745a tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72382) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 15:35:06 user nova-compute[72382]: DEBUG nova.compute.manager [-] [instance: 14c97840-88c0-4a8e-96e8-2e7da318ad07] Deallocating network for instance {{(pid=72382) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 15:35:06 user nova-compute[72382]: DEBUG nova.network.neutron [-] [instance: 14c97840-88c0-4a8e-96e8-2e7da318ad07] deallocate_for_instance() {{(pid=72382) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 15:35:06 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:35:06 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:35:06 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:35:06 user nova-compute[72382]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691595291.921166, f780040f-b789-4b72-8986-813c7b9fe4a6 => Stopped> {{(pid=72382) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 15:35:06 user nova-compute[72382]: INFO nova.compute.manager [-] [instance: f780040f-b789-4b72-8986-813c7b9fe4a6] VM Stopped (Lifecycle Event)
Aug 09 15:35:06 user nova-compute[72382]: DEBUG nova.compute.manager [None req-4cac9f52-af35-4112-a072-7c6dae317f6d None None] [instance: f780040f-b789-4b72-8986-813c7b9fe4a6] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:35:07 user nova-compute[72382]: DEBUG nova.compute.manager [req-bc10fa5d-b1b0-48f5-9c45-ad58dd51d1f7 req-b2c453c6-01a1-4d78-8411-ff5c638b2d9e service nova] [instance: 14c97840-88c0-4a8e-96e8-2e7da318ad07] Received event network-vif-plugged-f22c0d53-f0da-4bc9-bf7b-c10fe61e2e1f {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:35:07 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-bc10fa5d-b1b0-48f5-9c45-ad58dd51d1f7 req-b2c453c6-01a1-4d78-8411-ff5c638b2d9e service nova] Acquiring lock "14c97840-88c0-4a8e-96e8-2e7da318ad07-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:35:07 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-bc10fa5d-b1b0-48f5-9c45-ad58dd51d1f7 req-b2c453c6-01a1-4d78-8411-ff5c638b2d9e service nova] Lock "14c97840-88c0-4a8e-96e8-2e7da318ad07-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:35:07 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-bc10fa5d-b1b0-48f5-9c45-ad58dd51d1f7 req-b2c453c6-01a1-4d78-8411-ff5c638b2d9e service nova] Lock "14c97840-88c0-4a8e-96e8-2e7da318ad07-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:35:07 user nova-compute[72382]: DEBUG nova.compute.manager [req-bc10fa5d-b1b0-48f5-9c45-ad58dd51d1f7 req-b2c453c6-01a1-4d78-8411-ff5c638b2d9e service nova] [instance: 14c97840-88c0-4a8e-96e8-2e7da318ad07] No waiting events found dispatching network-vif-plugged-f22c0d53-f0da-4bc9-bf7b-c10fe61e2e1f {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:35:07 user nova-compute[72382]: WARNING nova.compute.manager [req-bc10fa5d-b1b0-48f5-9c45-ad58dd51d1f7 req-b2c453c6-01a1-4d78-8411-ff5c638b2d9e service nova] [instance: 14c97840-88c0-4a8e-96e8-2e7da318ad07] Received unexpected event network-vif-plugged-f22c0d53-f0da-4bc9-bf7b-c10fe61e2e1f for instance with vm_state active and task_state deleting.
Aug 09 15:35:07 user nova-compute[72382]: DEBUG nova.compute.manager [req-bc10fa5d-b1b0-48f5-9c45-ad58dd51d1f7 req-b2c453c6-01a1-4d78-8411-ff5c638b2d9e service nova] [instance: 402ba448-a30a-45f2-a724-5a53cf584547] Received event network-vif-plugged-a4cb9706-2448-4789-b7ef-8c4bef62e160 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:35:07 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-bc10fa5d-b1b0-48f5-9c45-ad58dd51d1f7 req-b2c453c6-01a1-4d78-8411-ff5c638b2d9e service nova] Acquiring lock "402ba448-a30a-45f2-a724-5a53cf584547-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:35:07 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-bc10fa5d-b1b0-48f5-9c45-ad58dd51d1f7 req-b2c453c6-01a1-4d78-8411-ff5c638b2d9e service nova] Lock "402ba448-a30a-45f2-a724-5a53cf584547-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:35:07 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-bc10fa5d-b1b0-48f5-9c45-ad58dd51d1f7 req-b2c453c6-01a1-4d78-8411-ff5c638b2d9e service nova] Lock "402ba448-a30a-45f2-a724-5a53cf584547-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:35:07 user nova-compute[72382]: DEBUG nova.compute.manager [req-bc10fa5d-b1b0-48f5-9c45-ad58dd51d1f7 req-b2c453c6-01a1-4d78-8411-ff5c638b2d9e service nova] [instance: 402ba448-a30a-45f2-a724-5a53cf584547] No waiting events found dispatching network-vif-plugged-a4cb9706-2448-4789-b7ef-8c4bef62e160 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:35:07 user nova-compute[72382]: WARNING nova.compute.manager [req-bc10fa5d-b1b0-48f5-9c45-ad58dd51d1f7 req-b2c453c6-01a1-4d78-8411-ff5c638b2d9e service nova] [instance: 402ba448-a30a-45f2-a724-5a53cf584547] Received unexpected event network-vif-plugged-a4cb9706-2448-4789-b7ef-8c4bef62e160 for instance with vm_state building and task_state spawning.
Aug 09 15:35:07 user nova-compute[72382]: DEBUG nova.compute.manager [req-bc10fa5d-b1b0-48f5-9c45-ad58dd51d1f7 req-b2c453c6-01a1-4d78-8411-ff5c638b2d9e service nova] [instance: 402ba448-a30a-45f2-a724-5a53cf584547] Received event network-vif-plugged-a4cb9706-2448-4789-b7ef-8c4bef62e160 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:35:07 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-bc10fa5d-b1b0-48f5-9c45-ad58dd51d1f7 req-b2c453c6-01a1-4d78-8411-ff5c638b2d9e service nova] Acquiring lock "402ba448-a30a-45f2-a724-5a53cf584547-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:35:07 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-bc10fa5d-b1b0-48f5-9c45-ad58dd51d1f7 req-b2c453c6-01a1-4d78-8411-ff5c638b2d9e service nova] Lock "402ba448-a30a-45f2-a724-5a53cf584547-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:35:07 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-bc10fa5d-b1b0-48f5-9c45-ad58dd51d1f7 req-b2c453c6-01a1-4d78-8411-ff5c638b2d9e service nova] Lock "402ba448-a30a-45f2-a724-5a53cf584547-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:35:07 user nova-compute[72382]: DEBUG nova.compute.manager [req-bc10fa5d-b1b0-48f5-9c45-ad58dd51d1f7 req-b2c453c6-01a1-4d78-8411-ff5c638b2d9e service nova] [instance: 402ba448-a30a-45f2-a724-5a53cf584547] No waiting events found dispatching network-vif-plugged-a4cb9706-2448-4789-b7ef-8c4bef62e160 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:35:07 user nova-compute[72382]: WARNING nova.compute.manager [req-bc10fa5d-b1b0-48f5-9c45-ad58dd51d1f7 req-b2c453c6-01a1-4d78-8411-ff5c638b2d9e service nova] [instance: 402ba448-a30a-45f2-a724-5a53cf584547] Received unexpected event network-vif-plugged-a4cb9706-2448-4789-b7ef-8c4bef62e160 for instance with vm_state building and task_state spawning.
Aug 09 15:35:07 user nova-compute[72382]: DEBUG nova.network.neutron [-] [instance: 14c97840-88c0-4a8e-96e8-2e7da318ad07] Updating instance_info_cache with network_info: [] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:35:07 user nova-compute[72382]: INFO nova.compute.manager [-] [instance: 14c97840-88c0-4a8e-96e8-2e7da318ad07] Took 1.27 seconds to deallocate network for instance.
Aug 09 15:35:07 user nova-compute[72382]: DEBUG nova.compute.manager [req-a9097932-6b09-45ae-8c44-05882e2e9c20 req-dc1f2a47-cab1-4b53-93df-dac97304ddf6 service nova] [instance: 14c97840-88c0-4a8e-96e8-2e7da318ad07] Received event network-vif-deleted-f22c0d53-f0da-4bc9-bf7b-c10fe61e2e1f {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:35:07 user nova-compute[72382]: INFO nova.compute.manager [req-a9097932-6b09-45ae-8c44-05882e2e9c20 req-dc1f2a47-cab1-4b53-93df-dac97304ddf6 service nova] [instance: 14c97840-88c0-4a8e-96e8-2e7da318ad07] Neutron deleted interface f22c0d53-f0da-4bc9-bf7b-c10fe61e2e1f; detaching it from the instance and deleting it from the info cache
Aug 09 15:35:07 user nova-compute[72382]: DEBUG nova.network.neutron [req-a9097932-6b09-45ae-8c44-05882e2e9c20 req-dc1f2a47-cab1-4b53-93df-dac97304ddf6 service nova] [instance: 14c97840-88c0-4a8e-96e8-2e7da318ad07] Updating instance_info_cache with network_info: [] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:35:07 user nova-compute[72382]: DEBUG nova.compute.manager [req-a9097932-6b09-45ae-8c44-05882e2e9c20 req-dc1f2a47-cab1-4b53-93df-dac97304ddf6 service nova] [instance: 14c97840-88c0-4a8e-96e8-2e7da318ad07] Detach interface failed, port_id=f22c0d53-f0da-4bc9-bf7b-c10fe61e2e1f, reason: Instance 14c97840-88c0-4a8e-96e8-2e7da318ad07 could not be found. {{(pid=72382) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 09 15:35:07 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-3e366e23-dbc1-45d8-b0e5-f8bb85f5745a tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:35:07 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-3e366e23-dbc1-45d8-b0e5-f8bb85f5745a tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:35:07 user nova-compute[72382]: DEBUG nova.compute.provider_tree [None req-3e366e23-dbc1-45d8-b0e5-f8bb85f5745a tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Inventory has not changed in ProviderTree for provider: 7b15b0e5-df4d-49db-833b-2855d21d10ae {{(pid=72382) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 15:35:07 user nova-compute[72382]: DEBUG nova.scheduler.client.report [None req-3e366e23-dbc1-45d8-b0e5-f8bb85f5745a tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Inventory has not changed for provider 7b15b0e5-df4d-49db-833b-2855d21d10ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72382) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 15:35:07 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-3e366e23-dbc1-45d8-b0e5-f8bb85f5745a tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.220s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:35:07 user nova-compute[72382]: INFO nova.scheduler.client.report [None req-3e366e23-dbc1-45d8-b0e5-f8bb85f5745a tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Deleted allocations for instance 14c97840-88c0-4a8e-96e8-2e7da318ad07
Aug 09 15:35:07 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-3e366e23-dbc1-45d8-b0e5-f8bb85f5745a tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Lock "14c97840-88c0-4a8e-96e8-2e7da318ad07" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.814s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:35:08 user nova-compute[72382]: DEBUG nova.virt.driver [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Emitting event <LifecycleEvent: 1691595308.288136, 402ba448-a30a-45f2-a724-5a53cf584547 => Resumed> {{(pid=72382) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 15:35:08 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 402ba448-a30a-45f2-a724-5a53cf584547] VM Resumed (Lifecycle Event)
Aug 09 15:35:08 user nova-compute[72382]: DEBUG nova.compute.manager [None req-86078130-191b-4f91-b665-bd2b2532b444 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] [instance: 402ba448-a30a-45f2-a724-5a53cf584547] Instance event wait completed in 0 seconds for  {{(pid=72382) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 15:35:08 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-86078130-191b-4f91-b665-bd2b2532b444 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] [instance: 402ba448-a30a-45f2-a724-5a53cf584547] Guest created on hypervisor {{(pid=72382) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 15:35:08 user nova-compute[72382]: INFO nova.virt.libvirt.driver [-] [instance: 402ba448-a30a-45f2-a724-5a53cf584547] Instance spawned successfully.
Aug 09 15:35:08 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-86078130-191b-4f91-b665-bd2b2532b444 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] [instance: 402ba448-a30a-45f2-a724-5a53cf584547] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 15:35:08 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 402ba448-a30a-45f2-a724-5a53cf584547] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:35:08 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-86078130-191b-4f91-b665-bd2b2532b444 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] [instance: 402ba448-a30a-45f2-a724-5a53cf584547] Found default for hw_cdrom_bus of ide {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:35:08 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-86078130-191b-4f91-b665-bd2b2532b444 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] [instance: 402ba448-a30a-45f2-a724-5a53cf584547] Found default for hw_disk_bus of virtio {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:35:08 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-86078130-191b-4f91-b665-bd2b2532b444 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] [instance: 402ba448-a30a-45f2-a724-5a53cf584547] Found default for hw_input_bus of None {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:35:08 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-86078130-191b-4f91-b665-bd2b2532b444 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] [instance: 402ba448-a30a-45f2-a724-5a53cf584547] Found default for hw_pointer_model of None {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:35:08 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-86078130-191b-4f91-b665-bd2b2532b444 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] [instance: 402ba448-a30a-45f2-a724-5a53cf584547] Found default for hw_video_model of virtio {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:35:08 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-86078130-191b-4f91-b665-bd2b2532b444 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] [instance: 402ba448-a30a-45f2-a724-5a53cf584547] Found default for hw_vif_model of virtio {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:35:08 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 402ba448-a30a-45f2-a724-5a53cf584547] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72382) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 15:35:08 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 402ba448-a30a-45f2-a724-5a53cf584547] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 15:35:08 user nova-compute[72382]: DEBUG nova.virt.driver [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Emitting event <LifecycleEvent: 1691595308.291327, 402ba448-a30a-45f2-a724-5a53cf584547 => Started> {{(pid=72382) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 15:35:08 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 402ba448-a30a-45f2-a724-5a53cf584547] VM Started (Lifecycle Event)
Aug 09 15:35:08 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 402ba448-a30a-45f2-a724-5a53cf584547] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:35:08 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 402ba448-a30a-45f2-a724-5a53cf584547] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72382) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 15:35:08 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 402ba448-a30a-45f2-a724-5a53cf584547] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 15:35:08 user nova-compute[72382]: INFO nova.compute.manager [None req-86078130-191b-4f91-b665-bd2b2532b444 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] [instance: 402ba448-a30a-45f2-a724-5a53cf584547] Took 5.93 seconds to spawn the instance on the hypervisor.
Aug 09 15:35:08 user nova-compute[72382]: DEBUG nova.compute.manager [None req-86078130-191b-4f91-b665-bd2b2532b444 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] [instance: 402ba448-a30a-45f2-a724-5a53cf584547] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:35:08 user nova-compute[72382]: INFO nova.compute.manager [None req-86078130-191b-4f91-b665-bd2b2532b444 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] [instance: 402ba448-a30a-45f2-a724-5a53cf584547] Took 6.58 seconds to build instance.
Aug 09 15:35:08 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-86078130-191b-4f91-b665-bd2b2532b444 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Lock "402ba448-a30a-45f2-a724-5a53cf584547" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.662s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:35:09 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:35:11 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:35:11 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:35:11 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:35:11 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:35:11 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:35:11 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Auditing locally available compute resources for user (node: user) {{(pid=72382) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 15:35:12 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72382) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 15:35:12 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/402ba448-a30a-45f2-a724-5a53cf584547/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:35:12 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/402ba448-a30a-45f2-a724-5a53cf584547/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:35:12 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/402ba448-a30a-45f2-a724-5a53cf584547/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:35:12 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/402ba448-a30a-45f2-a724-5a53cf584547/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:35:12 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ccbfda2-8bcd-4ec1-972a-cf49a62b1583/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:35:12 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ccbfda2-8bcd-4ec1-972a-cf49a62b1583/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:35:12 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ccbfda2-8bcd-4ec1-972a-cf49a62b1583/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:35:12 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ccbfda2-8bcd-4ec1-972a-cf49a62b1583/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:35:12 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/429ebe93-dd7a-41c4-b80a-0379d3816402/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:35:12 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/429ebe93-dd7a-41c4-b80a-0379d3816402/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:35:12 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/429ebe93-dd7a-41c4-b80a-0379d3816402/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:35:13 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/429ebe93-dd7a-41c4-b80a-0379d3816402/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:35:13 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72382) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 15:35:13 user nova-compute[72382]: WARNING nova.virt.libvirt.driver [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 15:35:13 user nova-compute[72382]: WARNING nova.virt.libvirt.driver [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 15:35:13 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Hypervisor/Node resource view: name=user free_ram=8041MB free_disk=25.544883728027344GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72382) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 15:35:13 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:35:13 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:35:13 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance 4ccbfda2-8bcd-4ec1-972a-cf49a62b1583 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:35:13 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance 94c8cc29-3300-475f-aca0-40fa0e58cd66 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:35:13 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance 429ebe93-dd7a-41c4-b80a-0379d3816402 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:35:13 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance c88a5ff2-9789-4ee8-8283-6248bba6d66a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:35:13 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance 402ba448-a30a-45f2-a724-5a53cf584547 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:35:13 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=72382) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 15:35:13 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=72382) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 15:35:13 user nova-compute[72382]: DEBUG nova.compute.provider_tree [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Inventory has not changed in ProviderTree for provider: 7b15b0e5-df4d-49db-833b-2855d21d10ae {{(pid=72382) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 15:35:13 user nova-compute[72382]: DEBUG nova.scheduler.client.report [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Inventory has not changed for provider 7b15b0e5-df4d-49db-833b-2855d21d10ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72382) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 15:35:13 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Compute_service record updated for user:user {{(pid=72382) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 15:35:13 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.352s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:35:16 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:35:16 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:35:16 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:35:18 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:35:18 user nova-compute[72382]: DEBUG nova.compute.manager [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Starting heal instance info cache {{(pid=72382) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 15:35:18 user nova-compute[72382]: DEBUG nova.compute.manager [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Didn't find any instances for network info cache update. {{(pid=72382) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 09 15:35:18 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:35:18 user nova-compute[72382]: DEBUG nova.compute.manager [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72382) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 15:35:19 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:35:19 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:35:20 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:35:20 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:35:21 user nova-compute[72382]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691595306.0201929, 14c97840-88c0-4a8e-96e8-2e7da318ad07 => Stopped> {{(pid=72382) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 15:35:21 user nova-compute[72382]: INFO nova.compute.manager [-] [instance: 14c97840-88c0-4a8e-96e8-2e7da318ad07] VM Stopped (Lifecycle Event)
Aug 09 15:35:21 user nova-compute[72382]: DEBUG nova.compute.manager [None req-08fa50be-2ad2-47d5-8149-b7f1d6ce0227 None None] [instance: 14c97840-88c0-4a8e-96e8-2e7da318ad07] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:35:21 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:35:21 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:35:21 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72382) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 15:35:21 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72382) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 15:35:21 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72382) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 15:35:21 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:35:24 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:35:24 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:35:26 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:35:26 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-7a948fbb-2a2c-44e6-94e1-68930666c26c tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Acquiring lock "54523d3e-bfae-4621-85cb-d6a7bc40abf5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:35:26 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-7a948fbb-2a2c-44e6-94e1-68930666c26c tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Lock "54523d3e-bfae-4621-85cb-d6a7bc40abf5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:35:26 user nova-compute[72382]: DEBUG nova.compute.manager [None req-7a948fbb-2a2c-44e6-94e1-68930666c26c tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] [instance: 54523d3e-bfae-4621-85cb-d6a7bc40abf5] Starting instance... {{(pid=72382) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 15:35:26 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-7a948fbb-2a2c-44e6-94e1-68930666c26c tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:35:26 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-7a948fbb-2a2c-44e6-94e1-68930666c26c tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:35:26 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-7a948fbb-2a2c-44e6-94e1-68930666c26c tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72382) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 15:35:26 user nova-compute[72382]: INFO nova.compute.claims [None req-7a948fbb-2a2c-44e6-94e1-68930666c26c tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] [instance: 54523d3e-bfae-4621-85cb-d6a7bc40abf5] Claim successful on node user
Aug 09 15:35:26 user nova-compute[72382]: DEBUG nova.compute.provider_tree [None req-7a948fbb-2a2c-44e6-94e1-68930666c26c tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Inventory has not changed in ProviderTree for provider: 7b15b0e5-df4d-49db-833b-2855d21d10ae {{(pid=72382) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 15:35:26 user nova-compute[72382]: DEBUG nova.scheduler.client.report [None req-7a948fbb-2a2c-44e6-94e1-68930666c26c tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Inventory has not changed for provider 7b15b0e5-df4d-49db-833b-2855d21d10ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72382) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 15:35:26 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-7a948fbb-2a2c-44e6-94e1-68930666c26c tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.290s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:35:26 user nova-compute[72382]: DEBUG nova.compute.manager [None req-7a948fbb-2a2c-44e6-94e1-68930666c26c tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] [instance: 54523d3e-bfae-4621-85cb-d6a7bc40abf5] Start building networks asynchronously for instance. {{(pid=72382) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 15:35:26 user nova-compute[72382]: DEBUG nova.compute.manager [None req-7a948fbb-2a2c-44e6-94e1-68930666c26c tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] [instance: 54523d3e-bfae-4621-85cb-d6a7bc40abf5] Allocating IP information in the background. {{(pid=72382) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 15:35:26 user nova-compute[72382]: DEBUG nova.network.neutron [None req-7a948fbb-2a2c-44e6-94e1-68930666c26c tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] [instance: 54523d3e-bfae-4621-85cb-d6a7bc40abf5] allocate_for_instance() {{(pid=72382) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 15:35:26 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-7a948fbb-2a2c-44e6-94e1-68930666c26c tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] [instance: 54523d3e-bfae-4621-85cb-d6a7bc40abf5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 15:35:26 user nova-compute[72382]: DEBUG nova.compute.manager [None req-7a948fbb-2a2c-44e6-94e1-68930666c26c tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] [instance: 54523d3e-bfae-4621-85cb-d6a7bc40abf5] Start building block device mappings for instance. {{(pid=72382) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 15:35:26 user nova-compute[72382]: INFO nova.virt.block_device [None req-7a948fbb-2a2c-44e6-94e1-68930666c26c tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] [instance: 54523d3e-bfae-4621-85cb-d6a7bc40abf5] Booting with volume a0a612d6-0f3f-4d2c-9fb5-aff9384338de at /dev/vda
Aug 09 15:35:26 user nova-compute[72382]: DEBUG os_brick.utils [None req-7a948fbb-2a2c-44e6-94e1-68930666c26c tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 15:35:26 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:35:27 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:35:27 user nova-compute[72382]: DEBUG nova.policy [None req-7a948fbb-2a2c-44e6-94e1-68930666c26c tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2cca9aef887b4b91a46ff4bd5cd32302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb5bf3f95d2843af94dbcab2af932bd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72382) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 15:35:27 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeaf6a87-22d8-44a9-b318-a2ae9b84e81b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d2cfa7015fe\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:35:27 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:35:27 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:35:27 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6b01ade-d0c3-4e22-b765-3ce89e0fc9a4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:35:27 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:35:27 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:35:27 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[77639312-a8d6-4613-b4f8-6ff7ab67ab06]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:35:27 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1847404-3a0f-416b-9f01-2876a98bcd4f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:35:27 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-7a948fbb-2a2c-44e6-94e1-68930666c26c tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Running cmd (subprocess): nvme version {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:35:27 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-7a948fbb-2a2c-44e6-94e1-68930666c26c tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] 'nvme version' failed. Not Retrying. {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 15:35:27 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7a948fbb-2a2c-44e6-94e1-68930666c26c tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] nvme not present on system {{(pid=72382) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 15:35:27 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:35:27 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 15:35:27 user nova-compute[72382]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 15:35:27 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[d850cdf7-4db9-4d13-b25d-30f7917f424c]: (4, '') {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:35:27 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.lightos [None req-7a948fbb-2a2c-44e6-94e1-68930666c26c tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72382) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 15:35:27 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.lightos [None req-7a948fbb-2a2c-44e6-94e1-68930666c26c tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72382) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 15:35:27 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.lightos [None req-7a948fbb-2a2c-44e6-94e1-68930666c26c tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] LIGHTOS: no hostnqn found. {{(pid=72382) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 15:35:27 user nova-compute[72382]: DEBUG os_brick.utils [None req-7a948fbb-2a2c-44e6-94e1-68930666c26c tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d2cfa7015fe', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 15:35:27 user nova-compute[72382]: DEBUG nova.virt.block_device [None req-7a948fbb-2a2c-44e6-94e1-68930666c26c tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] [instance: 54523d3e-bfae-4621-85cb-d6a7bc40abf5] Updating existing volume attachment record: c503906f-b2bc-4007-a19d-7b6d9d3bdaf7 {{(pid=72382) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 15:35:27 user nova-compute[72382]: DEBUG nova.network.neutron [None req-7a948fbb-2a2c-44e6-94e1-68930666c26c tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] [instance: 54523d3e-bfae-4621-85cb-d6a7bc40abf5] Successfully created port: 8557ab28-9722-4e6e-a14d-f941e3b693c8 {{(pid=72382) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 15:35:28 user nova-compute[72382]: DEBUG nova.network.neutron [None req-7a948fbb-2a2c-44e6-94e1-68930666c26c tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] [instance: 54523d3e-bfae-4621-85cb-d6a7bc40abf5] Successfully updated port: 8557ab28-9722-4e6e-a14d-f941e3b693c8 {{(pid=72382) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 15:35:28 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-7a948fbb-2a2c-44e6-94e1-68930666c26c tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Acquiring lock "refresh_cache-54523d3e-bfae-4621-85cb-d6a7bc40abf5" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 15:35:28 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-7a948fbb-2a2c-44e6-94e1-68930666c26c tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Acquired lock "refresh_cache-54523d3e-bfae-4621-85cb-d6a7bc40abf5" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 15:35:28 user nova-compute[72382]: DEBUG nova.network.neutron [None req-7a948fbb-2a2c-44e6-94e1-68930666c26c tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] [instance: 54523d3e-bfae-4621-85cb-d6a7bc40abf5] Building network info cache for instance {{(pid=72382) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 15:35:28 user nova-compute[72382]: DEBUG nova.compute.manager [req-e8173661-3fae-4402-8b00-2d218153ab4c req-4d772497-fa77-4c4c-9734-112b61e4e4e6 service nova] [instance: 54523d3e-bfae-4621-85cb-d6a7bc40abf5] Received event network-changed-8557ab28-9722-4e6e-a14d-f941e3b693c8 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:35:28 user nova-compute[72382]: DEBUG nova.compute.manager [req-e8173661-3fae-4402-8b00-2d218153ab4c req-4d772497-fa77-4c4c-9734-112b61e4e4e6 service nova] [instance: 54523d3e-bfae-4621-85cb-d6a7bc40abf5] Refreshing instance network info cache due to event network-changed-8557ab28-9722-4e6e-a14d-f941e3b693c8. {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 15:35:28 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-e8173661-3fae-4402-8b00-2d218153ab4c req-4d772497-fa77-4c4c-9734-112b61e4e4e6 service nova] Acquiring lock "refresh_cache-54523d3e-bfae-4621-85cb-d6a7bc40abf5" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 15:35:28 user nova-compute[72382]: DEBUG nova.network.neutron [None req-7a948fbb-2a2c-44e6-94e1-68930666c26c tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] [instance: 54523d3e-bfae-4621-85cb-d6a7bc40abf5] Instance cache missing network info. {{(pid=72382) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 15:35:29 user nova-compute[72382]: DEBUG nova.network.neutron [None req-7a948fbb-2a2c-44e6-94e1-68930666c26c tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] [instance: 54523d3e-bfae-4621-85cb-d6a7bc40abf5] Updating instance_info_cache with network_info: [{"id": "8557ab28-9722-4e6e-a14d-f941e3b693c8", "address": "fa:16:3e:40:5f:a8", "network": {"id": "308641dc-cc18-41db-9baa-7cc880e594ad", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1932973397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb5bf3f95d2843af94dbcab2af932bd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8557ab28-97", "ovs_interfaceid": "8557ab28-9722-4e6e-a14d-f941e3b693c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:35:29 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-7a948fbb-2a2c-44e6-94e1-68930666c26c tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Releasing lock "refresh_cache-54523d3e-bfae-4621-85cb-d6a7bc40abf5" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 15:35:29 user nova-compute[72382]: DEBUG nova.compute.manager [None req-7a948fbb-2a2c-44e6-94e1-68930666c26c tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] [instance: 54523d3e-bfae-4621-85cb-d6a7bc40abf5] Instance network_info: |[{"id": "8557ab28-9722-4e6e-a14d-f941e3b693c8", "address": "fa:16:3e:40:5f:a8", "network": {"id": "308641dc-cc18-41db-9baa-7cc880e594ad", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1932973397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb5bf3f95d2843af94dbcab2af932bd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8557ab28-97", "ovs_interfaceid": "8557ab28-9722-4e6e-a14d-f941e3b693c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72382) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 15:35:29 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-e8173661-3fae-4402-8b00-2d218153ab4c req-4d772497-fa77-4c4c-9734-112b61e4e4e6 service nova] Acquired lock "refresh_cache-54523d3e-bfae-4621-85cb-d6a7bc40abf5" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 15:35:29 user nova-compute[72382]: DEBUG nova.network.neutron [req-e8173661-3fae-4402-8b00-2d218153ab4c req-4d772497-fa77-4c4c-9734-112b61e4e4e6 service nova] [instance: 54523d3e-bfae-4621-85cb-d6a7bc40abf5] Refreshing network info cache for port 8557ab28-9722-4e6e-a14d-f941e3b693c8 {{(pid=72382) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 15:35:29 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:35:29 user nova-compute[72382]: DEBUG nova.network.neutron [req-e8173661-3fae-4402-8b00-2d218153ab4c req-4d772497-fa77-4c4c-9734-112b61e4e4e6 service nova] [instance: 54523d3e-bfae-4621-85cb-d6a7bc40abf5] Updated VIF entry in instance network info cache for port 8557ab28-9722-4e6e-a14d-f941e3b693c8. {{(pid=72382) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 15:35:29 user nova-compute[72382]: DEBUG nova.network.neutron [req-e8173661-3fae-4402-8b00-2d218153ab4c req-4d772497-fa77-4c4c-9734-112b61e4e4e6 service nova] [instance: 54523d3e-bfae-4621-85cb-d6a7bc40abf5] Updating instance_info_cache with network_info: [{"id": "8557ab28-9722-4e6e-a14d-f941e3b693c8", "address": "fa:16:3e:40:5f:a8", "network": {"id": "308641dc-cc18-41db-9baa-7cc880e594ad", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1932973397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb5bf3f95d2843af94dbcab2af932bd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8557ab28-97", "ovs_interfaceid": "8557ab28-9722-4e6e-a14d-f941e3b693c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:35:29 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-e8173661-3fae-4402-8b00-2d218153ab4c req-4d772497-fa77-4c4c-9734-112b61e4e4e6 service nova] Releasing lock "refresh_cache-54523d3e-bfae-4621-85cb-d6a7bc40abf5" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 15:35:29 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:35:31 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:35:31 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:35:34 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:35:35 user nova-compute[72382]: DEBUG nova.compute.manager [None req-7a948fbb-2a2c-44e6-94e1-68930666c26c tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] [instance: 54523d3e-bfae-4621-85cb-d6a7bc40abf5] Start spawning the instance on the hypervisor. {{(pid=72382) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 15:35:35 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-7a948fbb-2a2c-44e6-94e1-68930666c26c tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] [instance: 54523d3e-bfae-4621-85cb-d6a7bc40abf5] Creating instance directory {{(pid=72382) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 15:35:35 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-7a948fbb-2a2c-44e6-94e1-68930666c26c tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] [instance: 54523d3e-bfae-4621-85cb-d6a7bc40abf5] Creating image(s)
Aug 09 15:35:35 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-7a948fbb-2a2c-44e6-94e1-68930666c26c tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] [instance: 54523d3e-bfae-4621-85cb-d6a7bc40abf5] Did not create local disks {{(pid=72382) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 09 15:35:35 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-7a948fbb-2a2c-44e6-94e1-68930666c26c tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] [instance: 54523d3e-bfae-4621-85cb-d6a7bc40abf5] Ensure instance console log exists: /opt/stack/data/nova/instances/54523d3e-bfae-4621-85cb-d6a7bc40abf5/console.log {{(pid=72382) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 15:35:35 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-7a948fbb-2a2c-44e6-94e1-68930666c26c tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:35:35 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-7a948fbb-2a2c-44e6-94e1-68930666c26c tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:35:35 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-7a948fbb-2a2c-44e6-94e1-68930666c26c tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:35:35 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-7a948fbb-2a2c-44e6-94e1-68930666c26c tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] [instance: 54523d3e-bfae-4621-85cb-d6a7bc40abf5] Start _get_guest_xml network_info=[{"id": "8557ab28-9722-4e6e-a14d-f941e3b693c8", "address": "fa:16:3e:40:5f:a8", "network": {"id": "308641dc-cc18-41db-9baa-7cc880e594ad", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1932973397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb5bf3f95d2843af94dbcab2af932bd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8557ab28-97", "ovs_interfaceid": "8557ab28-9722-4e6e-a14d-f941e3b693c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:a0a612d6-0f3f-4d2c-9fb5-aff9384338de'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kCZuiYgU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '54523d3e-bfae-4621-85cb-d6a7bc40abf5', 'attached_at': '', 'detached_at': '', 'volume_id': 'a0a612d6-0f3f-4d2c-9fb5-aff9384338de', 'serial': 'a0a612d6-0f3f-4d2c-9fb5-aff9384338de'}, 'disk_bus': 'virtio', 'attachment_id': 'c503906f-b2bc-4007-a19d-7b6d9d3bdaf7', 'delete_on_termination': True, 'volume_type': None} {{(pid=72382) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 15:35:35 user nova-compute[72382]: WARNING nova.virt.libvirt.driver [None req-7a948fbb-2a2c-44e6-94e1-68930666c26c tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 15:35:35 user nova-compute[72382]: WARNING nova.virt.libvirt.driver [None req-7a948fbb-2a2c-44e6-94e1-68930666c26c tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 15:35:35 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-7a948fbb-2a2c-44e6-94e1-68930666c26c tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72382) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 15:35:35 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-7a948fbb-2a2c-44e6-94e1-68930666c26c tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] CPU controller missing on host. {{(pid=72382) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 15:35:35 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-7a948fbb-2a2c-44e6-94e1-68930666c26c tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72382) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 15:35:35 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-7a948fbb-2a2c-44e6-94e1-68930666c26c tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] CPU controller found on host. {{(pid=72382) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 15:35:35 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-7a948fbb-2a2c-44e6-94e1-68930666c26c tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72382) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 15:35:35 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-7a948fbb-2a2c-44e6-94e1-68930666c26c tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T15:11:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 15:35:35 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-7a948fbb-2a2c-44e6-94e1-68930666c26c tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Flavor limits 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 15:35:35 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-7a948fbb-2a2c-44e6-94e1-68930666c26c tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Image limits 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 15:35:35 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-7a948fbb-2a2c-44e6-94e1-68930666c26c tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Flavor pref 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 15:35:35 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-7a948fbb-2a2c-44e6-94e1-68930666c26c tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Image pref 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 15:35:35 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-7a948fbb-2a2c-44e6-94e1-68930666c26c tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 15:35:35 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-7a948fbb-2a2c-44e6-94e1-68930666c26c tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 15:35:35 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-7a948fbb-2a2c-44e6-94e1-68930666c26c tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72382) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 15:35:35 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-7a948fbb-2a2c-44e6-94e1-68930666c26c tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Got 1 possible topologies {{(pid=72382) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 15:35:35 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-7a948fbb-2a2c-44e6-94e1-68930666c26c tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 15:35:35 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-7a948fbb-2a2c-44e6-94e1-68930666c26c tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 15:35:35 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7a948fbb-2a2c-44e6-94e1-68930666c26c tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] [instance: 54523d3e-bfae-4621-85cb-d6a7bc40abf5] Calling os-brick to attach iSCSI Volume {{(pid=72382) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 15:35:35 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a948fbb-2a2c-44e6-94e1-68930666c26c tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2a0c768340>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:a0a612d6-0f3f-4d2c-9fb5-aff9384338de'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kCZuiYgU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 15:35:35 user nova-compute[72382]: WARNING os_brick.initiator.connectors.base [None req-7a948fbb-2a2c-44e6-94e1-68930666c26c tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 15:35:35 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-7a948fbb-2a2c-44e6-94e1-68930666c26c tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 15:35:35 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-7a948fbb-2a2c-44e6-94e1-68930666c26c tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 15:35:35 user nova-compute[72382]: WARNING os_brick.initiator.connectors.base [None req-7a948fbb-2a2c-44e6-94e1-68930666c26c tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 15:35:35 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-7a948fbb-2a2c-44e6-94e1-68930666c26c tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a0a612d6-0f3f-4d2c-9fb5-aff9384338de" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 15:35:35 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-7a948fbb-2a2c-44e6-94e1-68930666c26c tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a0a612d6-0f3f-4d2c-9fb5-aff9384338de" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 15:35:35 user nova-compute[72382]: INFO os_brick.initiator.connectors.iscsi [None req-7a948fbb-2a2c-44e6-94e1-68930666c26c tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 15:35:35 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0a612d6-0f3f-4d2c-9fb5-aff9384338de -p 172.16.0.220:3260 {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:35:35 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0a612d6-0f3f-4d2c-9fb5-aff9384338de -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:35:35 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[52d846b0-7dcf-49da-8526-64abe24d34fd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:35:35 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a948fbb-2a2c-44e6-94e1-68930666c26c tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 15:35:35 user nova-compute[72382]:  {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:35:35 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0a612d6-0f3f-4d2c-9fb5-aff9384338de -p 172.16.0.220:3260 --interface default --op new {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:35:35 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0a612d6-0f3f-4d2c-9fb5-aff9384338de -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.028s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:35:35 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[91e229f6-8af2-44c4-8dea-39261da866b9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a0a612d6-0f3f-4d2c-9fb5-aff9384338de] added\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:35:35 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a948fbb-2a2c-44e6-94e1-68930666c26c tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a0a612d6-0f3f-4d2c-9fb5-aff9384338de] added
Aug 09 15:35:35 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:35:35 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0a612d6-0f3f-4d2c-9fb5-aff9384338de -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:35:35 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0a612d6-0f3f-4d2c-9fb5-aff9384338de -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:35:35 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9d9b63e-5be7-4347-b454-71e2ad516a17]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:35:35 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a948fbb-2a2c-44e6-94e1-68930666c26c tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:35:35 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0a612d6-0f3f-4d2c-9fb5-aff9384338de -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:35:35 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0a612d6-0f3f-4d2c-9fb5-aff9384338de -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:35:35 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[882d9320-6f48-49c7-9042-2abac58719d9]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:35:35 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a948fbb-2a2c-44e6-94e1-68930666c26c tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:35:35 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0a612d6-0f3f-4d2c-9fb5-aff9384338de -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kCZuiYgU {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:35:35 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0a612d6-0f3f-4d2c-9fb5-aff9384338de -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kCZuiYgU" returned: 0 in 0.023s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:35:35 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[e871f333-aee2-4eb2-a86c-574c3881e319]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:35:35 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a948fbb-2a2c-44e6-94e1-68930666c26c tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kCZuiYgU'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:35:35 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0a612d6-0f3f-4d2c-9fb5-aff9384338de -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:35:35 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0a612d6-0f3f-4d2c-9fb5-aff9384338de -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:35:35 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[51b4c1d8-2f8d-48b0-a610-a6aa2ebf6df4]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:35:35 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a948fbb-2a2c-44e6-94e1-68930666c26c tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:35:35 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:35:35 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:35:35 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[637abcd8-d964-4242-aa44-914f1c1f1588]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59852df5-d4c8-4f25-8693-36181ff6a447 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2f5dbb5-f862-4389-b42a-872d5c94aa55 (non-flash)\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:35:35 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a948fbb-2a2c-44e6-94e1-68930666c26c tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59852df5-d4c8-4f25-8693-36181ff6a447 (non-flash)
Aug 09 15:35:35 user nova-compute[72382]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2f5dbb5-f862-4389-b42a-872d5c94aa55 (non-flash)
Aug 09 15:35:35 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 15:35:35 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a948fbb-2a2c-44e6-94e1-68930666c26c tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59852df5-d4c8-4f25-8693-36181ff6a447 (non-flash)
Aug 09 15:35:35 user nova-compute[72382]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2f5dbb5-f862-4389-b42a-872d5c94aa55 (non-flash)
Aug 09 15:35:35 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 15:35:35 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0a612d6-0f3f-4d2c-9fb5-aff9384338de -p 172.16.0.220:3260 --login {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:35:35 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0a612d6-0f3f-4d2c-9fb5-aff9384338de -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:35:35 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[cefa559c-817c-495f-b3eb-f387b52c094c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a0a612d6-0f3f-4d2c-9fb5-aff9384338de, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a0a612d6-0f3f-4d2c-9fb5-aff9384338de, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:35:35 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a948fbb-2a2c-44e6-94e1-68930666c26c tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a0a612d6-0f3f-4d2c-9fb5-aff9384338de, portal: 172.16.0.220,3260]
Aug 09 15:35:35 user nova-compute[72382]: Login to [iface: default, target: iqn.2010-10.org.openstack:a0a612d6-0f3f-4d2c-9fb5-aff9384338de, portal: 172.16.0.220,3260] successful.
Aug 09 15:35:35 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:35:35 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0a612d6-0f3f-4d2c-9fb5-aff9384338de -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:35:35 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0a612d6-0f3f-4d2c-9fb5-aff9384338de -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:35:35 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[f331fa03-e3b8-462d-a2dd-7cbd337a7349]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:35:35 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a948fbb-2a2c-44e6-94e1-68930666c26c tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:35:35 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:35:35 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:35:35 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb7202ae-9069-4734-8a20-83ea5479c1af]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59852df5-d4c8-4f25-8693-36181ff6a447 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2f5dbb5-f862-4389-b42a-872d5c94aa55 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0a612d6-0f3f-4d2c-9fb5-aff9384338de (non-flash)\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:35:35 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a948fbb-2a2c-44e6-94e1-68930666c26c tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59852df5-d4c8-4f25-8693-36181ff6a447 (non-flash)
Aug 09 15:35:35 user nova-compute[72382]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2f5dbb5-f862-4389-b42a-872d5c94aa55 (non-flash)
Aug 09 15:35:35 user nova-compute[72382]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0a612d6-0f3f-4d2c-9fb5-aff9384338de (non-flash)
Aug 09 15:35:35 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 15:35:35 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a948fbb-2a2c-44e6-94e1-68930666c26c tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59852df5-d4c8-4f25-8693-36181ff6a447 (non-flash)
Aug 09 15:35:35 user nova-compute[72382]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2f5dbb5-f862-4389-b42a-872d5c94aa55 (non-flash)
Aug 09 15:35:35 user nova-compute[72382]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0a612d6-0f3f-4d2c-9fb5-aff9384338de (non-flash)
Aug 09 15:35:35 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 15:35:35 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-7a948fbb-2a2c-44e6-94e1-68930666c26c tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a0a612d6-0f3f-4d2c-9fb5-aff9384338de" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.316s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 15:35:35 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a948fbb-2a2c-44e6-94e1-68930666c26c tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Connected to 172.16.0.220:3260 {{(pid=72382) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 15:35:35 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-7a948fbb-2a2c-44e6-94e1-68930666c26c tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] HCTL ('35', '-', '-', 0) found on session 46 with lun 0 {{(pid=72382) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 15:35:35 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-7a948fbb-2a2c-44e6-94e1-68930666c26c tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72382) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 15:35:35 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:35:35 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:35:35 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce3bdbc8-41d2-4e09-8a9e-cb481829d90a]: (4, ('- - 0', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:35:35 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-7a948fbb-2a2c-44e6-94e1-68930666c26c tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Searching for a device in session 46 and hctl ['35', '*', '*', 0] yield: None {{(pid=72382) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 15:35:36 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:35:36 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-7a948fbb-2a2c-44e6-94e1-68930666c26c tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Searching for a device in session 46 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72382) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 15:35:36 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a948fbb-2a2c-44e6-94e1-68930666c26c tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kCZuiYgU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72382) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 15:35:36 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-7a948fbb-2a2c-44e6-94e1-68930666c26c tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.346s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 15:35:36 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a948fbb-2a2c-44e6-94e1-68930666c26c tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] <== connect_volume: return (1348ms) {'type': 'block', 'scsi_wwn': '23936326336346561', 'path': '/dev/sdd'} {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 15:35:36 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7a948fbb-2a2c-44e6-94e1-68930666c26c tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] [instance: 54523d3e-bfae-4621-85cb-d6a7bc40abf5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23936326336346561', 'path': '/dev/sdd'} {{(pid=72382) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 15:35:36 user nova-compute[72382]: DEBUG nova.virt.libvirt.vif [None req-7a948fbb-2a2c-44e6-94e1-68930666c26c tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T15:35:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1481123959',display_name='tempest-ServerActionsTestOtherA-server-1481123959',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1481123959',id=39,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCmuVV1ynikE+pH75fjLIal2KFmSgV7eQmOTfU0+P2w2YCXfBWnAu9n1cQQTYYTDt/aP+JsGjkRdlSPqvnnG5WbnlJT+9aj9SfyqprOo87kqF8CD2U4mVDTvv+6ADzXJvQ==',key_name='tempest-keypair-568328368',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='eb5bf3f95d2843af94dbcab2af932bd1',ramdisk_id='',reservation_id='r-f5r16m9c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1899577274',owner_user_name='tempest-ServerActionsTestOtherA-1899577274-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T15:35:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2cca9aef887b4b91a46ff4bd5cd32302',uuid=54523d3e-bfae-4621-85cb-d6a7bc40abf5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8557ab28-9722-4e6e-a14d-f941e3b693c8", "address": "fa:16:3e:40:5f:a8", "network": {"id": "308641dc-cc18-41db-9baa-7cc880e594ad", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1932973397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb5bf3f95d2843af94dbcab2af932bd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8557ab28-97", "ovs_interfaceid": "8557ab28-9722-4e6e-a14d-f941e3b693c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72382) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 15:35:36 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-7a948fbb-2a2c-44e6-94e1-68930666c26c tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Converting VIF {"id": "8557ab28-9722-4e6e-a14d-f941e3b693c8", "address": "fa:16:3e:40:5f:a8", "network": {"id": "308641dc-cc18-41db-9baa-7cc880e594ad", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1932973397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb5bf3f95d2843af94dbcab2af932bd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8557ab28-97", "ovs_interfaceid": "8557ab28-9722-4e6e-a14d-f941e3b693c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 15:35:36 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-7a948fbb-2a2c-44e6-94e1-68930666c26c tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:40:5f:a8,bridge_name='br-int',has_traffic_filtering=True,id=8557ab28-9722-4e6e-a14d-f941e3b693c8,network=Network(308641dc-cc18-41db-9baa-7cc880e594ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8557ab28-97') {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 15:35:36 user nova-compute[72382]: DEBUG nova.objects.instance [None req-7a948fbb-2a2c-44e6-94e1-68930666c26c tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Lazy-loading 'pci_devices' on Instance uuid 54523d3e-bfae-4621-85cb-d6a7bc40abf5 {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:35:36 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-7a948fbb-2a2c-44e6-94e1-68930666c26c tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] [instance: 54523d3e-bfae-4621-85cb-d6a7bc40abf5] End _get_guest_xml xml=<domain type="kvm">
Aug 09 15:35:36 user nova-compute[72382]:   <uuid>54523d3e-bfae-4621-85cb-d6a7bc40abf5</uuid>
Aug 09 15:35:36 user nova-compute[72382]:   <name>instance-00000027</name>
Aug 09 15:35:36 user nova-compute[72382]:   <memory>524288</memory>
Aug 09 15:35:36 user nova-compute[72382]:   <vcpu>1</vcpu>
Aug 09 15:35:36 user nova-compute[72382]:   <metadata>
Aug 09 15:35:36 user nova-compute[72382]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 15:35:36 user nova-compute[72382]:       <nova:package version="0.0.0"/>
Aug 09 15:35:36 user nova-compute[72382]:       <nova:name>tempest-ServerActionsTestOtherA-server-1481123959</nova:name>
Aug 09 15:35:36 user nova-compute[72382]:       <nova:creationTime>2023-08-09 15:35:35</nova:creationTime>
Aug 09 15:35:36 user nova-compute[72382]:       <nova:flavor name="m1.tiny">
Aug 09 15:35:36 user nova-compute[72382]:         <nova:memory>512</nova:memory>
Aug 09 15:35:36 user nova-compute[72382]:         <nova:disk>1</nova:disk>
Aug 09 15:35:36 user nova-compute[72382]:         <nova:swap>0</nova:swap>
Aug 09 15:35:36 user nova-compute[72382]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 15:35:36 user nova-compute[72382]:         <nova:vcpus>1</nova:vcpus>
Aug 09 15:35:36 user nova-compute[72382]:       </nova:flavor>
Aug 09 15:35:36 user nova-compute[72382]:       <nova:owner>
Aug 09 15:35:36 user nova-compute[72382]:         <nova:user uuid="2cca9aef887b4b91a46ff4bd5cd32302">tempest-ServerActionsTestOtherA-1899577274-project-member</nova:user>
Aug 09 15:35:36 user nova-compute[72382]:         <nova:project uuid="eb5bf3f95d2843af94dbcab2af932bd1">tempest-ServerActionsTestOtherA-1899577274</nova:project>
Aug 09 15:35:36 user nova-compute[72382]:       </nova:owner>
Aug 09 15:35:36 user nova-compute[72382]:       <nova:ports>
Aug 09 15:35:36 user nova-compute[72382]:         <nova:port uuid="8557ab28-9722-4e6e-a14d-f941e3b693c8">
Aug 09 15:35:36 user nova-compute[72382]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 09 15:35:36 user nova-compute[72382]:         </nova:port>
Aug 09 15:35:36 user nova-compute[72382]:       </nova:ports>
Aug 09 15:35:36 user nova-compute[72382]:     </nova:instance>
Aug 09 15:35:36 user nova-compute[72382]:   </metadata>
Aug 09 15:35:36 user nova-compute[72382]:   <sysinfo type="smbios">
Aug 09 15:35:36 user nova-compute[72382]:     <system>
Aug 09 15:35:36 user nova-compute[72382]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 15:35:36 user nova-compute[72382]:       <entry name="product">OpenStack Nova</entry>
Aug 09 15:35:36 user nova-compute[72382]:       <entry name="version">0.0.0</entry>
Aug 09 15:35:36 user nova-compute[72382]:       <entry name="serial">54523d3e-bfae-4621-85cb-d6a7bc40abf5</entry>
Aug 09 15:35:36 user nova-compute[72382]:       <entry name="uuid">54523d3e-bfae-4621-85cb-d6a7bc40abf5</entry>
Aug 09 15:35:36 user nova-compute[72382]:       <entry name="family">Virtual Machine</entry>
Aug 09 15:35:36 user nova-compute[72382]:     </system>
Aug 09 15:35:36 user nova-compute[72382]:   </sysinfo>
Aug 09 15:35:36 user nova-compute[72382]:   <os>
Aug 09 15:35:36 user nova-compute[72382]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 15:35:36 user nova-compute[72382]:     <boot dev="hd"/>
Aug 09 15:35:36 user nova-compute[72382]:     <smbios mode="sysinfo"/>
Aug 09 15:35:36 user nova-compute[72382]:   </os>
Aug 09 15:35:36 user nova-compute[72382]:   <features>
Aug 09 15:35:36 user nova-compute[72382]:     <acpi/>
Aug 09 15:35:36 user nova-compute[72382]:     <apic/>
Aug 09 15:35:36 user nova-compute[72382]:     <vmcoreinfo/>
Aug 09 15:35:36 user nova-compute[72382]:   </features>
Aug 09 15:35:36 user nova-compute[72382]:   <clock offset="utc">
Aug 09 15:35:36 user nova-compute[72382]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 15:35:36 user nova-compute[72382]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 15:35:36 user nova-compute[72382]:     <timer name="hpet" present="no"/>
Aug 09 15:35:36 user nova-compute[72382]:   </clock>
Aug 09 15:35:36 user nova-compute[72382]:   <cpu mode="custom" match="exact">
Aug 09 15:35:36 user nova-compute[72382]:     <model>Nehalem</model>
Aug 09 15:35:36 user nova-compute[72382]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 15:35:36 user nova-compute[72382]:   </cpu>
Aug 09 15:35:36 user nova-compute[72382]:   <devices>
Aug 09 15:35:36 user nova-compute[72382]:     <disk type="block" device="disk">
Aug 09 15:35:36 user nova-compute[72382]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 15:35:36 user nova-compute[72382]:       <source dev="/dev/sdd"/>
Aug 09 15:35:36 user nova-compute[72382]:       <target dev="vda" bus="virtio"/>
Aug 09 15:35:36 user nova-compute[72382]:       <serial>a0a612d6-0f3f-4d2c-9fb5-aff9384338de</serial>
Aug 09 15:35:36 user nova-compute[72382]:     </disk>
Aug 09 15:35:36 user nova-compute[72382]:     <interface type="ethernet">
Aug 09 15:35:36 user nova-compute[72382]:       <mac address="fa:16:3e:40:5f:a8"/>
Aug 09 15:35:36 user nova-compute[72382]:       <model type="virtio"/>
Aug 09 15:35:36 user nova-compute[72382]:       <mtu size="1442"/>
Aug 09 15:35:36 user nova-compute[72382]:       <target dev="tap8557ab28-97"/>
Aug 09 15:35:36 user nova-compute[72382]:     </interface>
Aug 09 15:35:36 user nova-compute[72382]:     <serial type="pty">
Aug 09 15:35:36 user nova-compute[72382]:       <log file="/opt/stack/data/nova/instances/54523d3e-bfae-4621-85cb-d6a7bc40abf5/console.log" append="off"/>
Aug 09 15:35:36 user nova-compute[72382]:     </serial>
Aug 09 15:35:36 user nova-compute[72382]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 15:35:36 user nova-compute[72382]:     <video>
Aug 09 15:35:36 user nova-compute[72382]:       <model type="virtio"/>
Aug 09 15:35:36 user nova-compute[72382]:     </video>
Aug 09 15:35:36 user nova-compute[72382]:     <rng model="virtio">
Aug 09 15:35:36 user nova-compute[72382]:       <backend model="random">/dev/urandom</backend>
Aug 09 15:35:36 user nova-compute[72382]:     </rng>
Aug 09 15:35:36 user nova-compute[72382]:     <controller type="usb" index="0" model="none"/>
Aug 09 15:35:36 user nova-compute[72382]:     <memballoon model="virtio">
Aug 09 15:35:36 user nova-compute[72382]:       <stats period="10"/>
Aug 09 15:35:36 user nova-compute[72382]:     </memballoon>
Aug 09 15:35:36 user nova-compute[72382]:   </devices>
Aug 09 15:35:36 user nova-compute[72382]: </domain>
Aug 09 15:35:36 user nova-compute[72382]:  {{(pid=72382) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 15:35:36 user nova-compute[72382]: DEBUG nova.virt.libvirt.vif [None req-7a948fbb-2a2c-44e6-94e1-68930666c26c tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T15:35:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1481123959',display_name='tempest-ServerActionsTestOtherA-server-1481123959',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1481123959',id=39,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCmuVV1ynikE+pH75fjLIal2KFmSgV7eQmOTfU0+P2w2YCXfBWnAu9n1cQQTYYTDt/aP+JsGjkRdlSPqvnnG5WbnlJT+9aj9SfyqprOo87kqF8CD2U4mVDTvv+6ADzXJvQ==',key_name='tempest-keypair-568328368',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='eb5bf3f95d2843af94dbcab2af932bd1',ramdisk_id='',reservation_id='r-f5r16m9c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1899577274',owner_user_name='tempest-ServerActionsTestOtherA-1899577274-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T15:35:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2cca9aef887b4b91a46ff4bd5cd32302',uuid=54523d3e-bfae-4621-85cb-d6a7bc40abf5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8557ab28-9722-4e6e-a14d-f941e3b693c8", "address": "fa:16:3e:40:5f:a8", "network": {"id": "308641dc-cc18-41db-9baa-7cc880e594ad", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1932973397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb5bf3f95d2843af94dbcab2af932bd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8557ab28-97", "ovs_interfaceid": "8557ab28-9722-4e6e-a14d-f941e3b693c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 15:35:36 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-7a948fbb-2a2c-44e6-94e1-68930666c26c tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Converting VIF {"id": "8557ab28-9722-4e6e-a14d-f941e3b693c8", "address": "fa:16:3e:40:5f:a8", "network": {"id": "308641dc-cc18-41db-9baa-7cc880e594ad", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1932973397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb5bf3f95d2843af94dbcab2af932bd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8557ab28-97", "ovs_interfaceid": "8557ab28-9722-4e6e-a14d-f941e3b693c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 15:35:36 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-7a948fbb-2a2c-44e6-94e1-68930666c26c tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:40:5f:a8,bridge_name='br-int',has_traffic_filtering=True,id=8557ab28-9722-4e6e-a14d-f941e3b693c8,network=Network(308641dc-cc18-41db-9baa-7cc880e594ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8557ab28-97') {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 15:35:36 user nova-compute[72382]: DEBUG os_vif [None req-7a948fbb-2a2c-44e6-94e1-68930666c26c tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:40:5f:a8,bridge_name='br-int',has_traffic_filtering=True,id=8557ab28-9722-4e6e-a14d-f941e3b693c8,network=Network(308641dc-cc18-41db-9baa-7cc880e594ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8557ab28-97') {{(pid=72382) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 15:35:36 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:35:36 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:35:36 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 15:35:36 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:35:36 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8557ab28-97, may_exist=True, interface_attrs={}) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:35:36 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8557ab28-97, col_values=(('external_ids', {'iface-id': '8557ab28-9722-4e6e-a14d-f941e3b693c8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:40:5f:a8', 'vm-uuid': '54523d3e-bfae-4621-85cb-d6a7bc40abf5'}),), if_exists=True) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:35:36 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:35:36 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:35:36 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:35:36 user nova-compute[72382]: INFO os_vif [None req-7a948fbb-2a2c-44e6-94e1-68930666c26c tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:40:5f:a8,bridge_name='br-int',has_traffic_filtering=True,id=8557ab28-9722-4e6e-a14d-f941e3b693c8,network=Network(308641dc-cc18-41db-9baa-7cc880e594ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8557ab28-97')
Aug 09 15:35:37 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-7a948fbb-2a2c-44e6-94e1-68930666c26c tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] No BDM found with device name vda, not building metadata. {{(pid=72382) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 15:35:37 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-7a948fbb-2a2c-44e6-94e1-68930666c26c tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] No VIF found with MAC fa:16:3e:40:5f:a8, not building metadata {{(pid=72382) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 15:35:37 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:35:38 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:35:38 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:35:38 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:35:38 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:35:38 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:35:38 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:35:38 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-6458ce86-df52-469d-b69b-fc4a49b5d42a tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Acquiring lock "94c8cc29-3300-475f-aca0-40fa0e58cd66" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:35:38 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-6458ce86-df52-469d-b69b-fc4a49b5d42a tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Lock "94c8cc29-3300-475f-aca0-40fa0e58cd66" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:35:38 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-6458ce86-df52-469d-b69b-fc4a49b5d42a tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Acquiring lock "94c8cc29-3300-475f-aca0-40fa0e58cd66-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:35:38 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-6458ce86-df52-469d-b69b-fc4a49b5d42a tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Lock "94c8cc29-3300-475f-aca0-40fa0e58cd66-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:35:38 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-6458ce86-df52-469d-b69b-fc4a49b5d42a tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Lock "94c8cc29-3300-475f-aca0-40fa0e58cd66-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:35:38 user nova-compute[72382]: INFO nova.compute.manager [None req-6458ce86-df52-469d-b69b-fc4a49b5d42a tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: 94c8cc29-3300-475f-aca0-40fa0e58cd66] Terminating instance
Aug 09 15:35:38 user nova-compute[72382]: DEBUG nova.compute.manager [None req-6458ce86-df52-469d-b69b-fc4a49b5d42a tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: 94c8cc29-3300-475f-aca0-40fa0e58cd66] Start destroying the instance on the hypervisor. {{(pid=72382) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 15:35:38 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:35:38 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:35:38 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:35:38 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:35:39 user nova-compute[72382]: DEBUG nova.compute.manager [req-cf5eaf79-1075-49bc-b369-321743098e63 req-6d08eec3-e9ea-4b31-8108-7d58142c12d5 service nova] [instance: 54523d3e-bfae-4621-85cb-d6a7bc40abf5] Received event network-vif-plugged-8557ab28-9722-4e6e-a14d-f941e3b693c8 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:35:39 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-cf5eaf79-1075-49bc-b369-321743098e63 req-6d08eec3-e9ea-4b31-8108-7d58142c12d5 service nova] Acquiring lock "54523d3e-bfae-4621-85cb-d6a7bc40abf5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:35:39 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-cf5eaf79-1075-49bc-b369-321743098e63 req-6d08eec3-e9ea-4b31-8108-7d58142c12d5 service nova] Lock "54523d3e-bfae-4621-85cb-d6a7bc40abf5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:35:39 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-cf5eaf79-1075-49bc-b369-321743098e63 req-6d08eec3-e9ea-4b31-8108-7d58142c12d5 service nova] Lock "54523d3e-bfae-4621-85cb-d6a7bc40abf5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:35:39 user nova-compute[72382]: DEBUG nova.compute.manager [req-cf5eaf79-1075-49bc-b369-321743098e63 req-6d08eec3-e9ea-4b31-8108-7d58142c12d5 service nova] [instance: 54523d3e-bfae-4621-85cb-d6a7bc40abf5] No waiting events found dispatching network-vif-plugged-8557ab28-9722-4e6e-a14d-f941e3b693c8 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:35:39 user nova-compute[72382]: WARNING nova.compute.manager [req-cf5eaf79-1075-49bc-b369-321743098e63 req-6d08eec3-e9ea-4b31-8108-7d58142c12d5 service nova] [instance: 54523d3e-bfae-4621-85cb-d6a7bc40abf5] Received unexpected event network-vif-plugged-8557ab28-9722-4e6e-a14d-f941e3b693c8 for instance with vm_state building and task_state spawning.
Aug 09 15:35:39 user nova-compute[72382]: INFO nova.virt.libvirt.driver [-] [instance: 94c8cc29-3300-475f-aca0-40fa0e58cd66] Instance destroyed successfully.
Aug 09 15:35:39 user nova-compute[72382]: DEBUG nova.objects.instance [None req-6458ce86-df52-469d-b69b-fc4a49b5d42a tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Lazy-loading 'resources' on Instance uuid 94c8cc29-3300-475f-aca0-40fa0e58cd66 {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:35:39 user nova-compute[72382]: DEBUG nova.virt.libvirt.vif [None req-6458ce86-df52-469d-b69b-fc4a49b5d42a tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T15:30:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-2037810923',display_name='tempest-TestVolumeBootPattern-volume-backed-server-2037810923',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-2037810923',id=33,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBYb5plrKxPSfm6Wek6JUI6+qscloW+iqcYwCWmqaqgcxdDsdYEdQ+ksS+DfwVOUC/EjNnbb4/cc1FYVv+816sDXt53uKzsShXxIe1A2eeK7gVUpSjVgPUO8NSbQTaXymg==',key_name='tempest-keypair-519794732',keypairs=<?>,launch_index=0,launched_at=2023-08-09T15:31:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='70310b1af40b4d239fe5ea362972554b',ramdisk_id='',reservation_id='r-ylx9id1a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-451643589',owner_user_name='tempest-TestVolumeBootPattern-451643589-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T15:31:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='280bcf2afd7245a7bcd605e0db79c569',uuid=94c8cc29-3300-475f-aca0-40fa0e58cd66,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ae7204a8-8b63-4d77-933c-00e37a89a187", "address": "fa:16:3e:a9:9b:f8", "network": {"id": "a78e6cb6-feb7-4f64-a3c0-4900594b6e37", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-338007968-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70310b1af40b4d239fe5ea362972554b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae7204a8-8b", "ovs_interfaceid": "ae7204a8-8b63-4d77-933c-00e37a89a187", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 15:35:39 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-6458ce86-df52-469d-b69b-fc4a49b5d42a tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Converting VIF {"id": "ae7204a8-8b63-4d77-933c-00e37a89a187", "address": "fa:16:3e:a9:9b:f8", "network": {"id": "a78e6cb6-feb7-4f64-a3c0-4900594b6e37", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-338007968-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70310b1af40b4d239fe5ea362972554b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae7204a8-8b", "ovs_interfaceid": "ae7204a8-8b63-4d77-933c-00e37a89a187", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 15:35:39 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-6458ce86-df52-469d-b69b-fc4a49b5d42a tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a9:9b:f8,bridge_name='br-int',has_traffic_filtering=True,id=ae7204a8-8b63-4d77-933c-00e37a89a187,network=Network(a78e6cb6-feb7-4f64-a3c0-4900594b6e37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae7204a8-8b') {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 15:35:39 user nova-compute[72382]: DEBUG os_vif [None req-6458ce86-df52-469d-b69b-fc4a49b5d42a tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a9:9b:f8,bridge_name='br-int',has_traffic_filtering=True,id=ae7204a8-8b63-4d77-933c-00e37a89a187,network=Network(a78e6cb6-feb7-4f64-a3c0-4900594b6e37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae7204a8-8b') {{(pid=72382) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 15:35:39 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:35:39 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapae7204a8-8b, bridge=br-int, if_exists=True) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:35:39 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:35:39 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:35:39 user nova-compute[72382]: INFO os_vif [None req-6458ce86-df52-469d-b69b-fc4a49b5d42a tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a9:9b:f8,bridge_name='br-int',has_traffic_filtering=True,id=ae7204a8-8b63-4d77-933c-00e37a89a187,network=Network(a78e6cb6-feb7-4f64-a3c0-4900594b6e37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae7204a8-8b')
Aug 09 15:35:39 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6458ce86-df52-469d-b69b-fc4a49b5d42a tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: 94c8cc29-3300-475f-aca0-40fa0e58cd66] calling os-brick to detach iSCSI Volume {{(pid=72382) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 15:35:39 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-6458ce86-df52-469d-b69b-fc4a49b5d42a tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2a0c768340>, {'target_iqns': ['iqn.2010-10.org.openstack:59852df5-d4c8-4f25-8693-36181ff6a447'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wtDgMKZf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 15:35:39 user nova-compute[72382]: WARNING os_brick.initiator.connectors.base [None req-6458ce86-df52-469d-b69b-fc4a49b5d42a tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 15:35:39 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-6458ce86-df52-469d-b69b-fc4a49b5d42a tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 15:35:39 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-6458ce86-df52-469d-b69b-fc4a49b5d42a tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 15:35:39 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-6458ce86-df52-469d-b69b-fc4a49b5d42a tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:59852df5-d4c8-4f25-8693-36181ff6a447', 0)] {{(pid=72382) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 15:35:39 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:35:39 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:35:39 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[17181163-8bb2-4e22-a2ac-3fe8d9f46e93]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:59852df5-d4c8-4f25-8693-36181ff6a447\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a0a612d6-0f3f-4d2c-9fb5-aff9384338de\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d2f5dbb5-f862-4389-b42a-872d5c94aa55\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:35:39 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:35:39 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:35:39 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[07f65a5f-ac6a-485e-a9c2-fd3c81486ae0]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59852df5-d4c8-4f25-8693-36181ff6a447 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2f5dbb5-f862-4389-b42a-872d5c94aa55 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0a612d6-0f3f-4d2c-9fb5-aff9384338de (non-flash)\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:35:39 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-6458ce86-df52-469d-b69b-fc4a49b5d42a tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59852df5-d4c8-4f25-8693-36181ff6a447 (non-flash)
Aug 09 15:35:39 user nova-compute[72382]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2f5dbb5-f862-4389-b42a-872d5c94aa55 (non-flash)
Aug 09 15:35:39 user nova-compute[72382]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0a612d6-0f3f-4d2c-9fb5-aff9384338de (non-flash)
Aug 09 15:35:39 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 15:35:39 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-6458ce86-df52-469d-b69b-fc4a49b5d42a tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59852df5-d4c8-4f25-8693-36181ff6a447 (non-flash)
Aug 09 15:35:39 user nova-compute[72382]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2f5dbb5-f862-4389-b42a-872d5c94aa55 (non-flash)
Aug 09 15:35:39 user nova-compute[72382]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0a612d6-0f3f-4d2c-9fb5-aff9384338de (non-flash)
Aug 09 15:35:39 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 15:35:39 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-6458ce86-df52-469d-b69b-fc4a49b5d42a tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2a0c31cb80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:59852df5-d4c8-4f25-8693-36181ff6a447'): ({'sdc'}, set())}) {{(pid=72382) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 15:35:39 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-6458ce86-df52-469d-b69b-fc4a49b5d42a tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Removing single pathed devices sdc {{(pid=72382) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 15:35:39 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:35:39 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:35:39 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[edd1851c-929d-4abe-b6d3-1891eb2c3c1c]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:35:39 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:35:39 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:35:39 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fb519b5-03fb-4332-bbb9-f45540b0ced1]: (4, ('ok\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:35:39 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-6458ce86-df52-469d-b69b-fc4a49b5d42a tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Flushing IO for device /dev/sdc {{(pid=72382) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 15:35:39 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:35:39 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:35:39 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[b36fdde9-3c0b-440b-9461-aa095e5e5b88]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:35:39 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-6458ce86-df52-469d-b69b-fc4a49b5d42a tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72382) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 15:35:39 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:35:39 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:35:39 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.060s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:35:39 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[21bb8fd6-448f-4e7c-8dae-e6787b13b6f0]: (4, ('1', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:35:39 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-6458ce86-df52-469d-b69b-fc4a49b5d42a tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72382) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 15:35:39 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-6458ce86-df52-469d-b69b-fc4a49b5d42a tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] SCSI volumes sdc have been removed. {{(pid=72382) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 15:35:39 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-6458ce86-df52-469d-b69b-fc4a49b5d42a tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:59852df5-d4c8-4f25-8693-36181ff6a447')] {{(pid=72382) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 15:35:39 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59852df5-d4c8-4f25-8693-36181ff6a447 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:35:39 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59852df5-d4c8-4f25-8693-36181ff6a447 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.039s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:35:39 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fb339df-122e-41a7-bee4-377a07099ad5]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:35:39 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-6458ce86-df52-469d-b69b-fc4a49b5d42a tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:35:39 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59852df5-d4c8-4f25-8693-36181ff6a447 -p 172.16.0.220:3260 --logout {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:35:39 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59852df5-d4c8-4f25-8693-36181ff6a447 -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:35:39 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f69988d-aa4a-4211-a385-c19705ba5330]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:59852df5-d4c8-4f25-8693-36181ff6a447, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:59852df5-d4c8-4f25-8693-36181ff6a447, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:35:39 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-6458ce86-df52-469d-b69b-fc4a49b5d42a tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:59852df5-d4c8-4f25-8693-36181ff6a447, portal: 172.16.0.220,3260]
Aug 09 15:35:39 user nova-compute[72382]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:59852df5-d4c8-4f25-8693-36181ff6a447, portal: 172.16.0.220,3260] successful.
Aug 09 15:35:39 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:35:39 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59852df5-d4c8-4f25-8693-36181ff6a447 -p 172.16.0.220:3260 --op delete {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:35:39 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59852df5-d4c8-4f25-8693-36181ff6a447 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:35:39 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5122eb2-008a-4da2-b836-750ef27aaf4a]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:35:39 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-6458ce86-df52-469d-b69b-fc4a49b5d42a tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:35:39 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-6458ce86-df52-469d-b69b-fc4a49b5d42a tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.349s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 15:35:39 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-6458ce86-df52-469d-b69b-fc4a49b5d42a tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] <== disconnect_volume: return (351ms) None {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 15:35:39 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6458ce86-df52-469d-b69b-fc4a49b5d42a tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: 94c8cc29-3300-475f-aca0-40fa0e58cd66] Disconnected iSCSI Volume {{(pid=72382) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 15:35:39 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-6458ce86-df52-469d-b69b-fc4a49b5d42a tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: 94c8cc29-3300-475f-aca0-40fa0e58cd66] Deleting instance files /opt/stack/data/nova/instances/94c8cc29-3300-475f-aca0-40fa0e58cd66_del
Aug 09 15:35:39 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-6458ce86-df52-469d-b69b-fc4a49b5d42a tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: 94c8cc29-3300-475f-aca0-40fa0e58cd66] Deletion of /opt/stack/data/nova/instances/94c8cc29-3300-475f-aca0-40fa0e58cd66_del complete
Aug 09 15:35:40 user nova-compute[72382]: INFO nova.compute.manager [None req-6458ce86-df52-469d-b69b-fc4a49b5d42a tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: 94c8cc29-3300-475f-aca0-40fa0e58cd66] Took 1.26 seconds to destroy the instance on the hypervisor.
Aug 09 15:35:40 user nova-compute[72382]: DEBUG oslo.service.loopingcall [None req-6458ce86-df52-469d-b69b-fc4a49b5d42a tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72382) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 15:35:40 user nova-compute[72382]: DEBUG nova.compute.manager [-] [instance: 94c8cc29-3300-475f-aca0-40fa0e58cd66] Deallocating network for instance {{(pid=72382) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 15:35:40 user nova-compute[72382]: DEBUG nova.network.neutron [-] [instance: 94c8cc29-3300-475f-aca0-40fa0e58cd66] deallocate_for_instance() {{(pid=72382) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 15:35:40 user nova-compute[72382]: DEBUG nova.virt.driver [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Emitting event <LifecycleEvent: 1691595340.7632487, 54523d3e-bfae-4621-85cb-d6a7bc40abf5 => Resumed> {{(pid=72382) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 15:35:40 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 54523d3e-bfae-4621-85cb-d6a7bc40abf5] VM Resumed (Lifecycle Event)
Aug 09 15:35:40 user nova-compute[72382]: DEBUG nova.compute.manager [None req-7a948fbb-2a2c-44e6-94e1-68930666c26c tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] [instance: 54523d3e-bfae-4621-85cb-d6a7bc40abf5] Instance event wait completed in 0 seconds for  {{(pid=72382) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 15:35:40 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-7a948fbb-2a2c-44e6-94e1-68930666c26c tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] [instance: 54523d3e-bfae-4621-85cb-d6a7bc40abf5] Guest created on hypervisor {{(pid=72382) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 15:35:40 user nova-compute[72382]: INFO nova.virt.libvirt.driver [-] [instance: 54523d3e-bfae-4621-85cb-d6a7bc40abf5] Instance spawned successfully.
Aug 09 15:35:40 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-7a948fbb-2a2c-44e6-94e1-68930666c26c tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] [instance: 54523d3e-bfae-4621-85cb-d6a7bc40abf5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 15:35:40 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 54523d3e-bfae-4621-85cb-d6a7bc40abf5] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:35:40 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 54523d3e-bfae-4621-85cb-d6a7bc40abf5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72382) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 15:35:40 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-7a948fbb-2a2c-44e6-94e1-68930666c26c tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] [instance: 54523d3e-bfae-4621-85cb-d6a7bc40abf5] Found default for hw_cdrom_bus of ide {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:35:40 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-7a948fbb-2a2c-44e6-94e1-68930666c26c tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] [instance: 54523d3e-bfae-4621-85cb-d6a7bc40abf5] Found default for hw_disk_bus of virtio {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:35:40 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-7a948fbb-2a2c-44e6-94e1-68930666c26c tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] [instance: 54523d3e-bfae-4621-85cb-d6a7bc40abf5] Found default for hw_input_bus of None {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:35:40 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-7a948fbb-2a2c-44e6-94e1-68930666c26c tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] [instance: 54523d3e-bfae-4621-85cb-d6a7bc40abf5] Found default for hw_pointer_model of None {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:35:40 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-7a948fbb-2a2c-44e6-94e1-68930666c26c tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] [instance: 54523d3e-bfae-4621-85cb-d6a7bc40abf5] Found default for hw_video_model of virtio {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:35:40 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-7a948fbb-2a2c-44e6-94e1-68930666c26c tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] [instance: 54523d3e-bfae-4621-85cb-d6a7bc40abf5] Found default for hw_vif_model of virtio {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:35:40 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 54523d3e-bfae-4621-85cb-d6a7bc40abf5] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 15:35:40 user nova-compute[72382]: DEBUG nova.virt.driver [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Emitting event <LifecycleEvent: 1691595340.7645414, 54523d3e-bfae-4621-85cb-d6a7bc40abf5 => Started> {{(pid=72382) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 15:35:40 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 54523d3e-bfae-4621-85cb-d6a7bc40abf5] VM Started (Lifecycle Event)
Aug 09 15:35:40 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 54523d3e-bfae-4621-85cb-d6a7bc40abf5] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:35:40 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 54523d3e-bfae-4621-85cb-d6a7bc40abf5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72382) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 15:35:40 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 54523d3e-bfae-4621-85cb-d6a7bc40abf5] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 15:35:40 user nova-compute[72382]: INFO nova.compute.manager [None req-7a948fbb-2a2c-44e6-94e1-68930666c26c tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] [instance: 54523d3e-bfae-4621-85cb-d6a7bc40abf5] Took 5.50 seconds to spawn the instance on the hypervisor.
Aug 09 15:35:40 user nova-compute[72382]: DEBUG nova.compute.manager [None req-7a948fbb-2a2c-44e6-94e1-68930666c26c tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] [instance: 54523d3e-bfae-4621-85cb-d6a7bc40abf5] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:35:41 user nova-compute[72382]: INFO nova.compute.manager [None req-7a948fbb-2a2c-44e6-94e1-68930666c26c tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] [instance: 54523d3e-bfae-4621-85cb-d6a7bc40abf5] Took 14.66 seconds to build instance.
Aug 09 15:35:41 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-7a948fbb-2a2c-44e6-94e1-68930666c26c tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Lock "54523d3e-bfae-4621-85cb-d6a7bc40abf5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.781s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:35:41 user nova-compute[72382]: DEBUG nova.compute.manager [req-81c01817-7e2f-41a0-9d76-e229fe343ede req-fecd6549-c782-4a59-ac65-43314607aeb5 service nova] [instance: 54523d3e-bfae-4621-85cb-d6a7bc40abf5] Received event network-vif-plugged-8557ab28-9722-4e6e-a14d-f941e3b693c8 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:35:41 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-81c01817-7e2f-41a0-9d76-e229fe343ede req-fecd6549-c782-4a59-ac65-43314607aeb5 service nova] Acquiring lock "54523d3e-bfae-4621-85cb-d6a7bc40abf5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:35:41 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-81c01817-7e2f-41a0-9d76-e229fe343ede req-fecd6549-c782-4a59-ac65-43314607aeb5 service nova] Lock "54523d3e-bfae-4621-85cb-d6a7bc40abf5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:35:41 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-81c01817-7e2f-41a0-9d76-e229fe343ede req-fecd6549-c782-4a59-ac65-43314607aeb5 service nova] Lock "54523d3e-bfae-4621-85cb-d6a7bc40abf5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:35:41 user nova-compute[72382]: DEBUG nova.compute.manager [req-81c01817-7e2f-41a0-9d76-e229fe343ede req-fecd6549-c782-4a59-ac65-43314607aeb5 service nova] [instance: 54523d3e-bfae-4621-85cb-d6a7bc40abf5] No waiting events found dispatching network-vif-plugged-8557ab28-9722-4e6e-a14d-f941e3b693c8 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:35:41 user nova-compute[72382]: WARNING nova.compute.manager [req-81c01817-7e2f-41a0-9d76-e229fe343ede req-fecd6549-c782-4a59-ac65-43314607aeb5 service nova] [instance: 54523d3e-bfae-4621-85cb-d6a7bc40abf5] Received unexpected event network-vif-plugged-8557ab28-9722-4e6e-a14d-f941e3b693c8 for instance with vm_state active and task_state None.
Aug 09 15:35:41 user nova-compute[72382]: DEBUG nova.compute.manager [req-81c01817-7e2f-41a0-9d76-e229fe343ede req-fecd6549-c782-4a59-ac65-43314607aeb5 service nova] [instance: 94c8cc29-3300-475f-aca0-40fa0e58cd66] Received event network-vif-unplugged-ae7204a8-8b63-4d77-933c-00e37a89a187 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:35:41 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-81c01817-7e2f-41a0-9d76-e229fe343ede req-fecd6549-c782-4a59-ac65-43314607aeb5 service nova] Acquiring lock "94c8cc29-3300-475f-aca0-40fa0e58cd66-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:35:41 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-81c01817-7e2f-41a0-9d76-e229fe343ede req-fecd6549-c782-4a59-ac65-43314607aeb5 service nova] Lock "94c8cc29-3300-475f-aca0-40fa0e58cd66-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:35:41 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-81c01817-7e2f-41a0-9d76-e229fe343ede req-fecd6549-c782-4a59-ac65-43314607aeb5 service nova] Lock "94c8cc29-3300-475f-aca0-40fa0e58cd66-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:35:41 user nova-compute[72382]: DEBUG nova.compute.manager [req-81c01817-7e2f-41a0-9d76-e229fe343ede req-fecd6549-c782-4a59-ac65-43314607aeb5 service nova] [instance: 94c8cc29-3300-475f-aca0-40fa0e58cd66] No waiting events found dispatching network-vif-unplugged-ae7204a8-8b63-4d77-933c-00e37a89a187 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:35:41 user nova-compute[72382]: DEBUG nova.compute.manager [req-81c01817-7e2f-41a0-9d76-e229fe343ede req-fecd6549-c782-4a59-ac65-43314607aeb5 service nova] [instance: 94c8cc29-3300-475f-aca0-40fa0e58cd66] Received event network-vif-unplugged-ae7204a8-8b63-4d77-933c-00e37a89a187 for instance with task_state deleting. {{(pid=72382) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 15:35:42 user nova-compute[72382]: DEBUG nova.network.neutron [-] [instance: 94c8cc29-3300-475f-aca0-40fa0e58cd66] Updating instance_info_cache with network_info: [] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:35:42 user nova-compute[72382]: INFO nova.compute.manager [-] [instance: 94c8cc29-3300-475f-aca0-40fa0e58cd66] Took 2.89 seconds to deallocate network for instance.
Aug 09 15:35:43 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:35:43 user nova-compute[72382]: DEBUG nova.compute.manager [req-2c160b8c-aaf0-45c3-b803-0f0735bd0b72 req-72543c9e-0504-4521-ad9e-38aecb9ab0a4 service nova] [instance: 94c8cc29-3300-475f-aca0-40fa0e58cd66] Received event network-vif-plugged-ae7204a8-8b63-4d77-933c-00e37a89a187 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:35:43 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-2c160b8c-aaf0-45c3-b803-0f0735bd0b72 req-72543c9e-0504-4521-ad9e-38aecb9ab0a4 service nova] Acquiring lock "94c8cc29-3300-475f-aca0-40fa0e58cd66-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:35:43 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-2c160b8c-aaf0-45c3-b803-0f0735bd0b72 req-72543c9e-0504-4521-ad9e-38aecb9ab0a4 service nova] Lock "94c8cc29-3300-475f-aca0-40fa0e58cd66-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:35:43 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-2c160b8c-aaf0-45c3-b803-0f0735bd0b72 req-72543c9e-0504-4521-ad9e-38aecb9ab0a4 service nova] Lock "94c8cc29-3300-475f-aca0-40fa0e58cd66-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:35:43 user nova-compute[72382]: DEBUG nova.compute.manager [req-2c160b8c-aaf0-45c3-b803-0f0735bd0b72 req-72543c9e-0504-4521-ad9e-38aecb9ab0a4 service nova] [instance: 94c8cc29-3300-475f-aca0-40fa0e58cd66] No waiting events found dispatching network-vif-plugged-ae7204a8-8b63-4d77-933c-00e37a89a187 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:35:43 user nova-compute[72382]: WARNING nova.compute.manager [req-2c160b8c-aaf0-45c3-b803-0f0735bd0b72 req-72543c9e-0504-4521-ad9e-38aecb9ab0a4 service nova] [instance: 94c8cc29-3300-475f-aca0-40fa0e58cd66] Received unexpected event network-vif-plugged-ae7204a8-8b63-4d77-933c-00e37a89a187 for instance with vm_state active and task_state deleting.
Aug 09 15:35:43 user nova-compute[72382]: DEBUG nova.compute.manager [req-2c160b8c-aaf0-45c3-b803-0f0735bd0b72 req-72543c9e-0504-4521-ad9e-38aecb9ab0a4 service nova] [instance: 94c8cc29-3300-475f-aca0-40fa0e58cd66] Received event network-vif-deleted-ae7204a8-8b63-4d77-933c-00e37a89a187 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:35:43 user nova-compute[72382]: INFO nova.compute.manager [None req-6458ce86-df52-469d-b69b-fc4a49b5d42a tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: 94c8cc29-3300-475f-aca0-40fa0e58cd66] Took 0.88 seconds to detach 1 volumes for instance.
Aug 09 15:35:43 user nova-compute[72382]: DEBUG nova.compute.manager [None req-6458ce86-df52-469d-b69b-fc4a49b5d42a tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: 94c8cc29-3300-475f-aca0-40fa0e58cd66] Deleting volume: 59852df5-d4c8-4f25-8693-36181ff6a447 {{(pid=72382) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 09 15:35:43 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-6458ce86-df52-469d-b69b-fc4a49b5d42a tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:35:43 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-6458ce86-df52-469d-b69b-fc4a49b5d42a tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:35:44 user nova-compute[72382]: DEBUG nova.compute.provider_tree [None req-6458ce86-df52-469d-b69b-fc4a49b5d42a tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Inventory has not changed in ProviderTree for provider: 7b15b0e5-df4d-49db-833b-2855d21d10ae {{(pid=72382) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 15:35:44 user nova-compute[72382]: DEBUG nova.scheduler.client.report [None req-6458ce86-df52-469d-b69b-fc4a49b5d42a tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Inventory has not changed for provider 7b15b0e5-df4d-49db-833b-2855d21d10ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72382) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 15:35:44 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-6458ce86-df52-469d-b69b-fc4a49b5d42a tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.344s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:35:44 user nova-compute[72382]: INFO nova.scheduler.client.report [None req-6458ce86-df52-469d-b69b-fc4a49b5d42a tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Deleted allocations for instance 94c8cc29-3300-475f-aca0-40fa0e58cd66
Aug 09 15:35:44 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-6458ce86-df52-469d-b69b-fc4a49b5d42a tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Lock "94c8cc29-3300-475f-aca0-40fa0e58cd66" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 5.714s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:35:44 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:35:44 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:35:45 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:35:48 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:35:49 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:35:49 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:35:52 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:35:54 user nova-compute[72382]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691595339.5319767, 94c8cc29-3300-475f-aca0-40fa0e58cd66 => Stopped> {{(pid=72382) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 15:35:54 user nova-compute[72382]: INFO nova.compute.manager [-] [instance: 94c8cc29-3300-475f-aca0-40fa0e58cd66] VM Stopped (Lifecycle Event)
Aug 09 15:35:54 user nova-compute[72382]: DEBUG nova.compute.manager [None req-16f5da53-9157-4122-bc5b-e347361b1068 None None] [instance: 94c8cc29-3300-475f-aca0-40fa0e58cd66] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:35:54 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:35:54 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:35:56 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-cdadf666-68b4-4518-ae9e-63f144e45865 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Acquiring lock "7949b7d0-2712-402f-86ee-30acaef2d3e7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:35:56 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-cdadf666-68b4-4518-ae9e-63f144e45865 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Lock "7949b7d0-2712-402f-86ee-30acaef2d3e7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:35:56 user nova-compute[72382]: DEBUG nova.compute.manager [None req-cdadf666-68b4-4518-ae9e-63f144e45865 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] [instance: 7949b7d0-2712-402f-86ee-30acaef2d3e7] Starting instance... {{(pid=72382) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 15:35:56 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-cdadf666-68b4-4518-ae9e-63f144e45865 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:35:56 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-cdadf666-68b4-4518-ae9e-63f144e45865 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:35:56 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-cdadf666-68b4-4518-ae9e-63f144e45865 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72382) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 15:35:56 user nova-compute[72382]: INFO nova.compute.claims [None req-cdadf666-68b4-4518-ae9e-63f144e45865 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] [instance: 7949b7d0-2712-402f-86ee-30acaef2d3e7] Claim successful on node user
Aug 09 15:35:56 user nova-compute[72382]: DEBUG nova.compute.provider_tree [None req-cdadf666-68b4-4518-ae9e-63f144e45865 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Inventory has not changed in ProviderTree for provider: 7b15b0e5-df4d-49db-833b-2855d21d10ae {{(pid=72382) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 15:35:56 user nova-compute[72382]: DEBUG nova.scheduler.client.report [None req-cdadf666-68b4-4518-ae9e-63f144e45865 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Inventory has not changed for provider 7b15b0e5-df4d-49db-833b-2855d21d10ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72382) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 15:35:56 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-cdadf666-68b4-4518-ae9e-63f144e45865 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.360s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:35:56 user nova-compute[72382]: DEBUG nova.compute.manager [None req-cdadf666-68b4-4518-ae9e-63f144e45865 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] [instance: 7949b7d0-2712-402f-86ee-30acaef2d3e7] Start building networks asynchronously for instance. {{(pid=72382) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 15:35:57 user nova-compute[72382]: DEBUG nova.compute.manager [None req-cdadf666-68b4-4518-ae9e-63f144e45865 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] [instance: 7949b7d0-2712-402f-86ee-30acaef2d3e7] Allocating IP information in the background. {{(pid=72382) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 15:35:57 user nova-compute[72382]: DEBUG nova.network.neutron [None req-cdadf666-68b4-4518-ae9e-63f144e45865 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] [instance: 7949b7d0-2712-402f-86ee-30acaef2d3e7] allocate_for_instance() {{(pid=72382) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 15:35:57 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-cdadf666-68b4-4518-ae9e-63f144e45865 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] [instance: 7949b7d0-2712-402f-86ee-30acaef2d3e7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 15:35:57 user nova-compute[72382]: DEBUG nova.compute.manager [None req-cdadf666-68b4-4518-ae9e-63f144e45865 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] [instance: 7949b7d0-2712-402f-86ee-30acaef2d3e7] Start building block device mappings for instance. {{(pid=72382) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 15:35:57 user nova-compute[72382]: DEBUG nova.compute.manager [None req-cdadf666-68b4-4518-ae9e-63f144e45865 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] [instance: 7949b7d0-2712-402f-86ee-30acaef2d3e7] Start spawning the instance on the hypervisor. {{(pid=72382) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 15:35:57 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-cdadf666-68b4-4518-ae9e-63f144e45865 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] [instance: 7949b7d0-2712-402f-86ee-30acaef2d3e7] Creating instance directory {{(pid=72382) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 15:35:57 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-cdadf666-68b4-4518-ae9e-63f144e45865 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] [instance: 7949b7d0-2712-402f-86ee-30acaef2d3e7] Creating image(s)
Aug 09 15:35:57 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-cdadf666-68b4-4518-ae9e-63f144e45865 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Acquiring lock "/opt/stack/data/nova/instances/7949b7d0-2712-402f-86ee-30acaef2d3e7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:35:57 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-cdadf666-68b4-4518-ae9e-63f144e45865 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Lock "/opt/stack/data/nova/instances/7949b7d0-2712-402f-86ee-30acaef2d3e7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:35:57 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-cdadf666-68b4-4518-ae9e-63f144e45865 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Lock "/opt/stack/data/nova/instances/7949b7d0-2712-402f-86ee-30acaef2d3e7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:35:57 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-cdadf666-68b4-4518-ae9e-63f144e45865 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Acquiring lock "92bc25e5f2690987729e59abf1455719f9df9668" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:35:57 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-cdadf666-68b4-4518-ae9e-63f144e45865 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Lock "92bc25e5f2690987729e59abf1455719f9df9668" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:35:57 user nova-compute[72382]: DEBUG nova.policy [None req-cdadf666-68b4-4518-ae9e-63f144e45865 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '12ac8eca784e480d86c8fff801e73d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c87775443b4abd987197c4b46693bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72382) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 15:35:57 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-cdadf666-68b4-4518-ae9e-63f144e45865 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/92bc25e5f2690987729e59abf1455719f9df9668.part --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:35:57 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-cdadf666-68b4-4518-ae9e-63f144e45865 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/92bc25e5f2690987729e59abf1455719f9df9668.part --force-share --output=json" returned: 0 in 0.139s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:35:57 user nova-compute[72382]: DEBUG nova.virt.images [None req-cdadf666-68b4-4518-ae9e-63f144e45865 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] cc9c1e6c-3869-41a3-8884-92bc10fd88dd was qcow2, converting to raw {{(pid=72382) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 09 15:35:57 user nova-compute[72382]: DEBUG nova.privsep.utils [None req-cdadf666-68b4-4518-ae9e-63f144e45865 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72382) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 09 15:35:57 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-cdadf666-68b4-4518-ae9e-63f144e45865 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/92bc25e5f2690987729e59abf1455719f9df9668.part /opt/stack/data/nova/instances/_base/92bc25e5f2690987729e59abf1455719f9df9668.converted {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:35:58 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-cdadf666-68b4-4518-ae9e-63f144e45865 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/92bc25e5f2690987729e59abf1455719f9df9668.part /opt/stack/data/nova/instances/_base/92bc25e5f2690987729e59abf1455719f9df9668.converted" returned: 0 in 0.272s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:35:58 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-cdadf666-68b4-4518-ae9e-63f144e45865 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/92bc25e5f2690987729e59abf1455719f9df9668.converted --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:35:58 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-cdadf666-68b4-4518-ae9e-63f144e45865 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/92bc25e5f2690987729e59abf1455719f9df9668.converted --force-share --output=json" returned: 0 in 0.139s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:35:58 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-cdadf666-68b4-4518-ae9e-63f144e45865 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Lock "92bc25e5f2690987729e59abf1455719f9df9668" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.101s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:35:58 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-cdadf666-68b4-4518-ae9e-63f144e45865 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/92bc25e5f2690987729e59abf1455719f9df9668 --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:35:58 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-cdadf666-68b4-4518-ae9e-63f144e45865 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/92bc25e5f2690987729e59abf1455719f9df9668 --force-share --output=json" returned: 0 in 0.138s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:35:58 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-cdadf666-68b4-4518-ae9e-63f144e45865 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Acquiring lock "92bc25e5f2690987729e59abf1455719f9df9668" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:35:58 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-cdadf666-68b4-4518-ae9e-63f144e45865 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Lock "92bc25e5f2690987729e59abf1455719f9df9668" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:35:58 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-cdadf666-68b4-4518-ae9e-63f144e45865 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/92bc25e5f2690987729e59abf1455719f9df9668 --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:35:58 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-cdadf666-68b4-4518-ae9e-63f144e45865 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/92bc25e5f2690987729e59abf1455719f9df9668 --force-share --output=json" returned: 0 in 0.140s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:35:58 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-cdadf666-68b4-4518-ae9e-63f144e45865 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/92bc25e5f2690987729e59abf1455719f9df9668,backing_fmt=raw /opt/stack/data/nova/instances/7949b7d0-2712-402f-86ee-30acaef2d3e7/disk 1073741824 {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:35:58 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-cdadf666-68b4-4518-ae9e-63f144e45865 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/92bc25e5f2690987729e59abf1455719f9df9668,backing_fmt=raw /opt/stack/data/nova/instances/7949b7d0-2712-402f-86ee-30acaef2d3e7/disk 1073741824" returned: 0 in 0.051s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:35:58 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-cdadf666-68b4-4518-ae9e-63f144e45865 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Lock "92bc25e5f2690987729e59abf1455719f9df9668" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.200s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:35:58 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-cdadf666-68b4-4518-ae9e-63f144e45865 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/92bc25e5f2690987729e59abf1455719f9df9668 --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:35:58 user nova-compute[72382]: DEBUG nova.network.neutron [None req-cdadf666-68b4-4518-ae9e-63f144e45865 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] [instance: 7949b7d0-2712-402f-86ee-30acaef2d3e7] Successfully created port: bf6ac419-c6ba-4f01-b35a-4fa5e58913be {{(pid=72382) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 15:35:58 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-cdadf666-68b4-4518-ae9e-63f144e45865 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/92bc25e5f2690987729e59abf1455719f9df9668 --force-share --output=json" returned: 0 in 0.187s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:35:58 user nova-compute[72382]: DEBUG nova.virt.disk.api [None req-cdadf666-68b4-4518-ae9e-63f144e45865 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7949b7d0-2712-402f-86ee-30acaef2d3e7/disk. size=1073741824 {{(pid=72382) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 15:35:58 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-cdadf666-68b4-4518-ae9e-63f144e45865 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7949b7d0-2712-402f-86ee-30acaef2d3e7/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:35:58 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-cdadf666-68b4-4518-ae9e-63f144e45865 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7949b7d0-2712-402f-86ee-30acaef2d3e7/disk --force-share --output=json" returned: 0 in 0.128s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:35:58 user nova-compute[72382]: DEBUG nova.virt.disk.api [None req-cdadf666-68b4-4518-ae9e-63f144e45865 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Cannot resize image /opt/stack/data/nova/instances/7949b7d0-2712-402f-86ee-30acaef2d3e7/disk to a smaller size. {{(pid=72382) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 15:35:58 user nova-compute[72382]: DEBUG nova.objects.instance [None req-cdadf666-68b4-4518-ae9e-63f144e45865 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Lazy-loading 'migration_context' on Instance uuid 7949b7d0-2712-402f-86ee-30acaef2d3e7 {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:35:58 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-cdadf666-68b4-4518-ae9e-63f144e45865 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] [instance: 7949b7d0-2712-402f-86ee-30acaef2d3e7] Created local disks {{(pid=72382) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 15:35:58 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-cdadf666-68b4-4518-ae9e-63f144e45865 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] [instance: 7949b7d0-2712-402f-86ee-30acaef2d3e7] Ensure instance console log exists: /opt/stack/data/nova/instances/7949b7d0-2712-402f-86ee-30acaef2d3e7/console.log {{(pid=72382) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 15:35:58 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-cdadf666-68b4-4518-ae9e-63f144e45865 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:35:58 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-cdadf666-68b4-4518-ae9e-63f144e45865 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:35:58 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-cdadf666-68b4-4518-ae9e-63f144e45865 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:35:59 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:35:59 user nova-compute[72382]: DEBUG nova.network.neutron [None req-cdadf666-68b4-4518-ae9e-63f144e45865 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] [instance: 7949b7d0-2712-402f-86ee-30acaef2d3e7] Successfully updated port: bf6ac419-c6ba-4f01-b35a-4fa5e58913be {{(pid=72382) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 15:35:59 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-cdadf666-68b4-4518-ae9e-63f144e45865 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Acquiring lock "refresh_cache-7949b7d0-2712-402f-86ee-30acaef2d3e7" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 15:35:59 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-cdadf666-68b4-4518-ae9e-63f144e45865 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Acquired lock "refresh_cache-7949b7d0-2712-402f-86ee-30acaef2d3e7" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 15:35:59 user nova-compute[72382]: DEBUG nova.network.neutron [None req-cdadf666-68b4-4518-ae9e-63f144e45865 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] [instance: 7949b7d0-2712-402f-86ee-30acaef2d3e7] Building network info cache for instance {{(pid=72382) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 15:35:59 user nova-compute[72382]: DEBUG nova.compute.manager [req-5a033ee9-98ad-45c6-85b6-d27a0f388db8 req-b4a64f72-383a-4d90-9c32-003ae726f363 service nova] [instance: 7949b7d0-2712-402f-86ee-30acaef2d3e7] Received event network-changed-bf6ac419-c6ba-4f01-b35a-4fa5e58913be {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:35:59 user nova-compute[72382]: DEBUG nova.compute.manager [req-5a033ee9-98ad-45c6-85b6-d27a0f388db8 req-b4a64f72-383a-4d90-9c32-003ae726f363 service nova] [instance: 7949b7d0-2712-402f-86ee-30acaef2d3e7] Refreshing instance network info cache due to event network-changed-bf6ac419-c6ba-4f01-b35a-4fa5e58913be. {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 15:35:59 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-5a033ee9-98ad-45c6-85b6-d27a0f388db8 req-b4a64f72-383a-4d90-9c32-003ae726f363 service nova] Acquiring lock "refresh_cache-7949b7d0-2712-402f-86ee-30acaef2d3e7" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 15:35:59 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:35:59 user nova-compute[72382]: DEBUG nova.network.neutron [None req-cdadf666-68b4-4518-ae9e-63f144e45865 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] [instance: 7949b7d0-2712-402f-86ee-30acaef2d3e7] Instance cache missing network info. {{(pid=72382) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 15:36:00 user nova-compute[72382]: DEBUG nova.network.neutron [None req-cdadf666-68b4-4518-ae9e-63f144e45865 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] [instance: 7949b7d0-2712-402f-86ee-30acaef2d3e7] Updating instance_info_cache with network_info: [{"id": "bf6ac419-c6ba-4f01-b35a-4fa5e58913be", "address": "fa:16:3e:26:fd:d1", "network": {"id": "8d929426-09f7-49b5-a79e-711e20e00750", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1307802727-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93c87775443b4abd987197c4b46693bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf6ac419-c6", "ovs_interfaceid": "bf6ac419-c6ba-4f01-b35a-4fa5e58913be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:36:00 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-24784b7f-bb51-4002-85a2-b19f36da158c tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Acquiring lock "d66443a2-2dc1-46f6-9572-f0717f830927" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:36:00 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-24784b7f-bb51-4002-85a2-b19f36da158c tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Lock "d66443a2-2dc1-46f6-9572-f0717f830927" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:36:00 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-cdadf666-68b4-4518-ae9e-63f144e45865 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Releasing lock "refresh_cache-7949b7d0-2712-402f-86ee-30acaef2d3e7" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 15:36:00 user nova-compute[72382]: DEBUG nova.compute.manager [None req-cdadf666-68b4-4518-ae9e-63f144e45865 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] [instance: 7949b7d0-2712-402f-86ee-30acaef2d3e7] Instance network_info: |[{"id": "bf6ac419-c6ba-4f01-b35a-4fa5e58913be", "address": "fa:16:3e:26:fd:d1", "network": {"id": "8d929426-09f7-49b5-a79e-711e20e00750", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1307802727-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93c87775443b4abd987197c4b46693bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf6ac419-c6", "ovs_interfaceid": "bf6ac419-c6ba-4f01-b35a-4fa5e58913be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72382) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 15:36:00 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-5a033ee9-98ad-45c6-85b6-d27a0f388db8 req-b4a64f72-383a-4d90-9c32-003ae726f363 service nova] Acquired lock "refresh_cache-7949b7d0-2712-402f-86ee-30acaef2d3e7" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 15:36:00 user nova-compute[72382]: DEBUG nova.network.neutron [req-5a033ee9-98ad-45c6-85b6-d27a0f388db8 req-b4a64f72-383a-4d90-9c32-003ae726f363 service nova] [instance: 7949b7d0-2712-402f-86ee-30acaef2d3e7] Refreshing network info cache for port bf6ac419-c6ba-4f01-b35a-4fa5e58913be {{(pid=72382) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 15:36:00 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-cdadf666-68b4-4518-ae9e-63f144e45865 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] [instance: 7949b7d0-2712-402f-86ee-30acaef2d3e7] Start _get_guest_xml network_info=[{"id": "bf6ac419-c6ba-4f01-b35a-4fa5e58913be", "address": "fa:16:3e:26:fd:d1", "network": {"id": "8d929426-09f7-49b5-a79e-711e20e00750", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1307802727-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93c87775443b4abd987197c4b46693bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf6ac419-c6", "ovs_interfaceid": "bf6ac419-c6ba-4f01-b35a-4fa5e58913be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T15:35:53Z,direct_url=<?>,disk_format='qcow2',id=cc9c1e6c-3869-41a3-8884-92bc10fd88dd,min_disk=0,min_ram=0,name='tempest-scenario-img--560724323',owner='93c87775443b4abd987197c4b46693bc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T15:35:55Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'cc9c1e6c-3869-41a3-8884-92bc10fd88dd'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72382) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 15:36:00 user nova-compute[72382]: DEBUG nova.compute.manager [None req-24784b7f-bb51-4002-85a2-b19f36da158c tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] [instance: d66443a2-2dc1-46f6-9572-f0717f830927] Starting instance... {{(pid=72382) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 15:36:00 user nova-compute[72382]: WARNING nova.virt.libvirt.driver [None req-cdadf666-68b4-4518-ae9e-63f144e45865 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 15:36:00 user nova-compute[72382]: WARNING nova.virt.libvirt.driver [None req-cdadf666-68b4-4518-ae9e-63f144e45865 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 15:36:00 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-cdadf666-68b4-4518-ae9e-63f144e45865 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72382) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 15:36:00 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-cdadf666-68b4-4518-ae9e-63f144e45865 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] CPU controller missing on host. {{(pid=72382) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 15:36:00 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-cdadf666-68b4-4518-ae9e-63f144e45865 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72382) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 15:36:00 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-cdadf666-68b4-4518-ae9e-63f144e45865 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] CPU controller found on host. {{(pid=72382) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 15:36:00 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-cdadf666-68b4-4518-ae9e-63f144e45865 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72382) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 15:36:00 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-cdadf666-68b4-4518-ae9e-63f144e45865 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T15:11:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T15:35:53Z,direct_url=<?>,disk_format='qcow2',id=cc9c1e6c-3869-41a3-8884-92bc10fd88dd,min_disk=0,min_ram=0,name='tempest-scenario-img--560724323',owner='93c87775443b4abd987197c4b46693bc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T15:35:55Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 15:36:00 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-cdadf666-68b4-4518-ae9e-63f144e45865 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Flavor limits 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 15:36:00 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-cdadf666-68b4-4518-ae9e-63f144e45865 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Image limits 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 15:36:00 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-cdadf666-68b4-4518-ae9e-63f144e45865 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Flavor pref 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 15:36:00 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-cdadf666-68b4-4518-ae9e-63f144e45865 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Image pref 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 15:36:00 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-cdadf666-68b4-4518-ae9e-63f144e45865 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 15:36:00 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-cdadf666-68b4-4518-ae9e-63f144e45865 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 15:36:00 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-cdadf666-68b4-4518-ae9e-63f144e45865 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72382) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 15:36:00 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-cdadf666-68b4-4518-ae9e-63f144e45865 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Got 1 possible topologies {{(pid=72382) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 15:36:00 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-cdadf666-68b4-4518-ae9e-63f144e45865 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 15:36:00 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-cdadf666-68b4-4518-ae9e-63f144e45865 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 15:36:00 user nova-compute[72382]: DEBUG nova.virt.libvirt.vif [None req-cdadf666-68b4-4518-ae9e-63f144e45865 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T15:35:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1437781387',display_name='tempest-TestMinimumBasicScenario-server-1437781387',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1437781387',id=40,image_ref='cc9c1e6c-3869-41a3-8884-92bc10fd88dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE7fZdqwv14TbpkokOGrZLxteONCsQhHwHtSkm0iehxIvEwr8CDGRfFb4MKI0stgbdIk1yccqk1l+GgnPmgswjQ9PIPDbFPc3f6proZobtF+S6ZVWml9M9bSSrAd7AGo5w==',key_name='tempest-TestMinimumBasicScenario-63485549',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='93c87775443b4abd987197c4b46693bc',ramdisk_id='',reservation_id='r-oo0ozxn0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cc9c1e6c-3869-41a3-8884-92bc10fd88dd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-389394165',owner_user_name='tempest-TestMinimumBasicScenario-389394165-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T15:35:57Z,user_data=None,user_id='12ac8eca784e480d86c8fff801e73d2d',uuid=7949b7d0-2712-402f-86ee-30acaef2d3e7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bf6ac419-c6ba-4f01-b35a-4fa5e58913be", "address": "fa:16:3e:26:fd:d1", "network": {"id": "8d929426-09f7-49b5-a79e-711e20e00750", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1307802727-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93c87775443b4abd987197c4b46693bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf6ac419-c6", "ovs_interfaceid": "bf6ac419-c6ba-4f01-b35a-4fa5e58913be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72382) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 15:36:00 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-cdadf666-68b4-4518-ae9e-63f144e45865 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Converting VIF {"id": "bf6ac419-c6ba-4f01-b35a-4fa5e58913be", "address": "fa:16:3e:26:fd:d1", "network": {"id": "8d929426-09f7-49b5-a79e-711e20e00750", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1307802727-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93c87775443b4abd987197c4b46693bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf6ac419-c6", "ovs_interfaceid": "bf6ac419-c6ba-4f01-b35a-4fa5e58913be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 15:36:00 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-cdadf666-68b4-4518-ae9e-63f144e45865 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:26:fd:d1,bridge_name='br-int',has_traffic_filtering=True,id=bf6ac419-c6ba-4f01-b35a-4fa5e58913be,network=Network(8d929426-09f7-49b5-a79e-711e20e00750),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf6ac419-c6') {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 15:36:00 user nova-compute[72382]: DEBUG nova.objects.instance [None req-cdadf666-68b4-4518-ae9e-63f144e45865 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Lazy-loading 'pci_devices' on Instance uuid 7949b7d0-2712-402f-86ee-30acaef2d3e7 {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:36:00 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-cdadf666-68b4-4518-ae9e-63f144e45865 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] [instance: 7949b7d0-2712-402f-86ee-30acaef2d3e7] End _get_guest_xml xml=<domain type="kvm">
Aug 09 15:36:00 user nova-compute[72382]:   <uuid>7949b7d0-2712-402f-86ee-30acaef2d3e7</uuid>
Aug 09 15:36:00 user nova-compute[72382]:   <name>instance-00000028</name>
Aug 09 15:36:00 user nova-compute[72382]:   <memory>524288</memory>
Aug 09 15:36:00 user nova-compute[72382]:   <vcpu>1</vcpu>
Aug 09 15:36:00 user nova-compute[72382]:   <metadata>
Aug 09 15:36:00 user nova-compute[72382]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 15:36:00 user nova-compute[72382]:       <nova:package version="0.0.0"/>
Aug 09 15:36:00 user nova-compute[72382]:       <nova:name>tempest-TestMinimumBasicScenario-server-1437781387</nova:name>
Aug 09 15:36:00 user nova-compute[72382]:       <nova:creationTime>2023-08-09 15:36:00</nova:creationTime>
Aug 09 15:36:00 user nova-compute[72382]:       <nova:flavor name="m1.tiny">
Aug 09 15:36:00 user nova-compute[72382]:         <nova:memory>512</nova:memory>
Aug 09 15:36:00 user nova-compute[72382]:         <nova:disk>1</nova:disk>
Aug 09 15:36:00 user nova-compute[72382]:         <nova:swap>0</nova:swap>
Aug 09 15:36:00 user nova-compute[72382]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 15:36:00 user nova-compute[72382]:         <nova:vcpus>1</nova:vcpus>
Aug 09 15:36:00 user nova-compute[72382]:       </nova:flavor>
Aug 09 15:36:00 user nova-compute[72382]:       <nova:owner>
Aug 09 15:36:00 user nova-compute[72382]:         <nova:user uuid="12ac8eca784e480d86c8fff801e73d2d">tempest-TestMinimumBasicScenario-389394165-project-member</nova:user>
Aug 09 15:36:00 user nova-compute[72382]:         <nova:project uuid="93c87775443b4abd987197c4b46693bc">tempest-TestMinimumBasicScenario-389394165</nova:project>
Aug 09 15:36:00 user nova-compute[72382]:       </nova:owner>
Aug 09 15:36:00 user nova-compute[72382]:       <nova:root type="image" uuid="cc9c1e6c-3869-41a3-8884-92bc10fd88dd"/>
Aug 09 15:36:00 user nova-compute[72382]:       <nova:ports>
Aug 09 15:36:00 user nova-compute[72382]:         <nova:port uuid="bf6ac419-c6ba-4f01-b35a-4fa5e58913be">
Aug 09 15:36:00 user nova-compute[72382]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 09 15:36:00 user nova-compute[72382]:         </nova:port>
Aug 09 15:36:00 user nova-compute[72382]:       </nova:ports>
Aug 09 15:36:00 user nova-compute[72382]:     </nova:instance>
Aug 09 15:36:00 user nova-compute[72382]:   </metadata>
Aug 09 15:36:00 user nova-compute[72382]:   <sysinfo type="smbios">
Aug 09 15:36:00 user nova-compute[72382]:     <system>
Aug 09 15:36:00 user nova-compute[72382]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 15:36:00 user nova-compute[72382]:       <entry name="product">OpenStack Nova</entry>
Aug 09 15:36:00 user nova-compute[72382]:       <entry name="version">0.0.0</entry>
Aug 09 15:36:00 user nova-compute[72382]:       <entry name="serial">7949b7d0-2712-402f-86ee-30acaef2d3e7</entry>
Aug 09 15:36:00 user nova-compute[72382]:       <entry name="uuid">7949b7d0-2712-402f-86ee-30acaef2d3e7</entry>
Aug 09 15:36:00 user nova-compute[72382]:       <entry name="family">Virtual Machine</entry>
Aug 09 15:36:00 user nova-compute[72382]:     </system>
Aug 09 15:36:00 user nova-compute[72382]:   </sysinfo>
Aug 09 15:36:00 user nova-compute[72382]:   <os>
Aug 09 15:36:00 user nova-compute[72382]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 15:36:00 user nova-compute[72382]:     <boot dev="hd"/>
Aug 09 15:36:00 user nova-compute[72382]:     <smbios mode="sysinfo"/>
Aug 09 15:36:00 user nova-compute[72382]:   </os>
Aug 09 15:36:00 user nova-compute[72382]:   <features>
Aug 09 15:36:00 user nova-compute[72382]:     <acpi/>
Aug 09 15:36:00 user nova-compute[72382]:     <apic/>
Aug 09 15:36:00 user nova-compute[72382]:     <vmcoreinfo/>
Aug 09 15:36:00 user nova-compute[72382]:   </features>
Aug 09 15:36:00 user nova-compute[72382]:   <clock offset="utc">
Aug 09 15:36:00 user nova-compute[72382]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 15:36:00 user nova-compute[72382]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 15:36:00 user nova-compute[72382]:     <timer name="hpet" present="no"/>
Aug 09 15:36:00 user nova-compute[72382]:   </clock>
Aug 09 15:36:00 user nova-compute[72382]:   <cpu mode="custom" match="exact">
Aug 09 15:36:00 user nova-compute[72382]:     <model>Nehalem</model>
Aug 09 15:36:00 user nova-compute[72382]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 15:36:00 user nova-compute[72382]:   </cpu>
Aug 09 15:36:00 user nova-compute[72382]:   <devices>
Aug 09 15:36:00 user nova-compute[72382]:     <disk type="file" device="disk">
Aug 09 15:36:00 user nova-compute[72382]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 15:36:00 user nova-compute[72382]:       <source file="/opt/stack/data/nova/instances/7949b7d0-2712-402f-86ee-30acaef2d3e7/disk"/>
Aug 09 15:36:00 user nova-compute[72382]:       <target dev="vda" bus="virtio"/>
Aug 09 15:36:00 user nova-compute[72382]:     </disk>
Aug 09 15:36:00 user nova-compute[72382]:     <interface type="ethernet">
Aug 09 15:36:00 user nova-compute[72382]:       <mac address="fa:16:3e:26:fd:d1"/>
Aug 09 15:36:00 user nova-compute[72382]:       <model type="virtio"/>
Aug 09 15:36:00 user nova-compute[72382]:       <mtu size="1442"/>
Aug 09 15:36:00 user nova-compute[72382]:       <target dev="tapbf6ac419-c6"/>
Aug 09 15:36:00 user nova-compute[72382]:     </interface>
Aug 09 15:36:00 user nova-compute[72382]:     <serial type="pty">
Aug 09 15:36:00 user nova-compute[72382]:       <log file="/opt/stack/data/nova/instances/7949b7d0-2712-402f-86ee-30acaef2d3e7/console.log" append="off"/>
Aug 09 15:36:00 user nova-compute[72382]:     </serial>
Aug 09 15:36:00 user nova-compute[72382]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 15:36:00 user nova-compute[72382]:     <video>
Aug 09 15:36:00 user nova-compute[72382]:       <model type="virtio"/>
Aug 09 15:36:00 user nova-compute[72382]:     </video>
Aug 09 15:36:00 user nova-compute[72382]:     <rng model="virtio">
Aug 09 15:36:00 user nova-compute[72382]:       <backend model="random">/dev/urandom</backend>
Aug 09 15:36:00 user nova-compute[72382]:     </rng>
Aug 09 15:36:00 user nova-compute[72382]:     <controller type="usb" index="0" model="none"/>
Aug 09 15:36:00 user nova-compute[72382]:     <memballoon model="virtio">
Aug 09 15:36:00 user nova-compute[72382]:       <stats period="10"/>
Aug 09 15:36:00 user nova-compute[72382]:     </memballoon>
Aug 09 15:36:00 user nova-compute[72382]:   </devices>
Aug 09 15:36:00 user nova-compute[72382]: </domain>
Aug 09 15:36:00 user nova-compute[72382]:  {{(pid=72382) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 15:36:00 user nova-compute[72382]: DEBUG nova.virt.libvirt.vif [None req-cdadf666-68b4-4518-ae9e-63f144e45865 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T15:35:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1437781387',display_name='tempest-TestMinimumBasicScenario-server-1437781387',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1437781387',id=40,image_ref='cc9c1e6c-3869-41a3-8884-92bc10fd88dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE7fZdqwv14TbpkokOGrZLxteONCsQhHwHtSkm0iehxIvEwr8CDGRfFb4MKI0stgbdIk1yccqk1l+GgnPmgswjQ9PIPDbFPc3f6proZobtF+S6ZVWml9M9bSSrAd7AGo5w==',key_name='tempest-TestMinimumBasicScenario-63485549',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='93c87775443b4abd987197c4b46693bc',ramdisk_id='',reservation_id='r-oo0ozxn0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cc9c1e6c-3869-41a3-8884-92bc10fd88dd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-389394165',owner_user_name='tempest-TestMinimumBasicScenario-389394165-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T15:35:57Z,user_data=None,user_id='12ac8eca784e480d86c8fff801e73d2d',uuid=7949b7d0-2712-402f-86ee-30acaef2d3e7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bf6ac419-c6ba-4f01-b35a-4fa5e58913be", "address": "fa:16:3e:26:fd:d1", "network": {"id": "8d929426-09f7-49b5-a79e-711e20e00750", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1307802727-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93c87775443b4abd987197c4b46693bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf6ac419-c6", "ovs_interfaceid": "bf6ac419-c6ba-4f01-b35a-4fa5e58913be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 15:36:00 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-cdadf666-68b4-4518-ae9e-63f144e45865 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Converting VIF {"id": "bf6ac419-c6ba-4f01-b35a-4fa5e58913be", "address": "fa:16:3e:26:fd:d1", "network": {"id": "8d929426-09f7-49b5-a79e-711e20e00750", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1307802727-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93c87775443b4abd987197c4b46693bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf6ac419-c6", "ovs_interfaceid": "bf6ac419-c6ba-4f01-b35a-4fa5e58913be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 15:36:00 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-cdadf666-68b4-4518-ae9e-63f144e45865 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:26:fd:d1,bridge_name='br-int',has_traffic_filtering=True,id=bf6ac419-c6ba-4f01-b35a-4fa5e58913be,network=Network(8d929426-09f7-49b5-a79e-711e20e00750),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf6ac419-c6') {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 15:36:00 user nova-compute[72382]: DEBUG os_vif [None req-cdadf666-68b4-4518-ae9e-63f144e45865 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:fd:d1,bridge_name='br-int',has_traffic_filtering=True,id=bf6ac419-c6ba-4f01-b35a-4fa5e58913be,network=Network(8d929426-09f7-49b5-a79e-711e20e00750),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf6ac419-c6') {{(pid=72382) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 15:36:00 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:36:00 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:36:00 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 15:36:00 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:36:00 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbf6ac419-c6, may_exist=True, interface_attrs={}) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:36:00 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapbf6ac419-c6, col_values=(('external_ids', {'iface-id': 'bf6ac419-c6ba-4f01-b35a-4fa5e58913be', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:26:fd:d1', 'vm-uuid': '7949b7d0-2712-402f-86ee-30acaef2d3e7'}),), if_exists=True) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:36:00 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:36:00 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:36:00 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:36:00 user nova-compute[72382]: INFO os_vif [None req-cdadf666-68b4-4518-ae9e-63f144e45865 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:fd:d1,bridge_name='br-int',has_traffic_filtering=True,id=bf6ac419-c6ba-4f01-b35a-4fa5e58913be,network=Network(8d929426-09f7-49b5-a79e-711e20e00750),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf6ac419-c6')
Aug 09 15:36:00 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-24784b7f-bb51-4002-85a2-b19f36da158c tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:36:00 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-24784b7f-bb51-4002-85a2-b19f36da158c tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:36:00 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-24784b7f-bb51-4002-85a2-b19f36da158c tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72382) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 15:36:00 user nova-compute[72382]: INFO nova.compute.claims [None req-24784b7f-bb51-4002-85a2-b19f36da158c tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] [instance: d66443a2-2dc1-46f6-9572-f0717f830927] Claim successful on node user
Aug 09 15:36:00 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-cdadf666-68b4-4518-ae9e-63f144e45865 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] No BDM found with device name vda, not building metadata. {{(pid=72382) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 15:36:00 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-cdadf666-68b4-4518-ae9e-63f144e45865 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] No VIF found with MAC fa:16:3e:26:fd:d1, not building metadata {{(pid=72382) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 15:36:00 user nova-compute[72382]: DEBUG nova.compute.provider_tree [None req-24784b7f-bb51-4002-85a2-b19f36da158c tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Inventory has not changed in ProviderTree for provider: 7b15b0e5-df4d-49db-833b-2855d21d10ae {{(pid=72382) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 15:36:00 user nova-compute[72382]: DEBUG nova.scheduler.client.report [None req-24784b7f-bb51-4002-85a2-b19f36da158c tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Inventory has not changed for provider 7b15b0e5-df4d-49db-833b-2855d21d10ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72382) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 15:36:00 user nova-compute[72382]: DEBUG nova.network.neutron [req-5a033ee9-98ad-45c6-85b6-d27a0f388db8 req-b4a64f72-383a-4d90-9c32-003ae726f363 service nova] [instance: 7949b7d0-2712-402f-86ee-30acaef2d3e7] Updated VIF entry in instance network info cache for port bf6ac419-c6ba-4f01-b35a-4fa5e58913be. {{(pid=72382) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 15:36:00 user nova-compute[72382]: DEBUG nova.network.neutron [req-5a033ee9-98ad-45c6-85b6-d27a0f388db8 req-b4a64f72-383a-4d90-9c32-003ae726f363 service nova] [instance: 7949b7d0-2712-402f-86ee-30acaef2d3e7] Updating instance_info_cache with network_info: [{"id": "bf6ac419-c6ba-4f01-b35a-4fa5e58913be", "address": "fa:16:3e:26:fd:d1", "network": {"id": "8d929426-09f7-49b5-a79e-711e20e00750", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1307802727-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93c87775443b4abd987197c4b46693bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf6ac419-c6", "ovs_interfaceid": "bf6ac419-c6ba-4f01-b35a-4fa5e58913be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:36:00 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-5a033ee9-98ad-45c6-85b6-d27a0f388db8 req-b4a64f72-383a-4d90-9c32-003ae726f363 service nova] Releasing lock "refresh_cache-7949b7d0-2712-402f-86ee-30acaef2d3e7" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 15:36:00 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-24784b7f-bb51-4002-85a2-b19f36da158c tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.388s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:36:00 user nova-compute[72382]: DEBUG nova.compute.manager [None req-24784b7f-bb51-4002-85a2-b19f36da158c tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] [instance: d66443a2-2dc1-46f6-9572-f0717f830927] Start building networks asynchronously for instance. {{(pid=72382) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 15:36:00 user nova-compute[72382]: DEBUG nova.compute.manager [None req-24784b7f-bb51-4002-85a2-b19f36da158c tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] [instance: d66443a2-2dc1-46f6-9572-f0717f830927] Allocating IP information in the background. {{(pid=72382) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 15:36:00 user nova-compute[72382]: DEBUG nova.network.neutron [None req-24784b7f-bb51-4002-85a2-b19f36da158c tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] [instance: d66443a2-2dc1-46f6-9572-f0717f830927] allocate_for_instance() {{(pid=72382) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 15:36:00 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-24784b7f-bb51-4002-85a2-b19f36da158c tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] [instance: d66443a2-2dc1-46f6-9572-f0717f830927] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 15:36:00 user nova-compute[72382]: DEBUG nova.compute.manager [None req-24784b7f-bb51-4002-85a2-b19f36da158c tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] [instance: d66443a2-2dc1-46f6-9572-f0717f830927] Start building block device mappings for instance. {{(pid=72382) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 15:36:01 user nova-compute[72382]: DEBUG nova.policy [None req-24784b7f-bb51-4002-85a2-b19f36da158c tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '13c67153e9ec44029e8d80c09d405175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1a50eacfd0414bbc13e3fd4087e998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72382) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 15:36:01 user nova-compute[72382]: DEBUG nova.compute.manager [None req-24784b7f-bb51-4002-85a2-b19f36da158c tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] [instance: d66443a2-2dc1-46f6-9572-f0717f830927] Start spawning the instance on the hypervisor. {{(pid=72382) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 15:36:01 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-24784b7f-bb51-4002-85a2-b19f36da158c tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] [instance: d66443a2-2dc1-46f6-9572-f0717f830927] Creating instance directory {{(pid=72382) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 15:36:01 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-24784b7f-bb51-4002-85a2-b19f36da158c tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] [instance: d66443a2-2dc1-46f6-9572-f0717f830927] Creating image(s)
Aug 09 15:36:01 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-24784b7f-bb51-4002-85a2-b19f36da158c tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Acquiring lock "/opt/stack/data/nova/instances/d66443a2-2dc1-46f6-9572-f0717f830927/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:36:01 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-24784b7f-bb51-4002-85a2-b19f36da158c tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Lock "/opt/stack/data/nova/instances/d66443a2-2dc1-46f6-9572-f0717f830927/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:36:01 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-24784b7f-bb51-4002-85a2-b19f36da158c tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Lock "/opt/stack/data/nova/instances/d66443a2-2dc1-46f6-9572-f0717f830927/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:36:01 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-24784b7f-bb51-4002-85a2-b19f36da158c tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:36:01 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-24784b7f-bb51-4002-85a2-b19f36da158c tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b --force-share --output=json" returned: 0 in 0.171s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:36:01 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-24784b7f-bb51-4002-85a2-b19f36da158c tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Acquiring lock "383812ff437283e0191ed5b9ecc04c27f1162b0b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:36:01 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-24784b7f-bb51-4002-85a2-b19f36da158c tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Lock "383812ff437283e0191ed5b9ecc04c27f1162b0b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:36:01 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-24784b7f-bb51-4002-85a2-b19f36da158c tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:36:01 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-24784b7f-bb51-4002-85a2-b19f36da158c tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b --force-share --output=json" returned: 0 in 0.145s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:36:01 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-24784b7f-bb51-4002-85a2-b19f36da158c tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b,backing_fmt=raw /opt/stack/data/nova/instances/d66443a2-2dc1-46f6-9572-f0717f830927/disk 1073741824 {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:36:01 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-24784b7f-bb51-4002-85a2-b19f36da158c tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b,backing_fmt=raw /opt/stack/data/nova/instances/d66443a2-2dc1-46f6-9572-f0717f830927/disk 1073741824" returned: 0 in 0.055s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:36:01 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-24784b7f-bb51-4002-85a2-b19f36da158c tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Lock "383812ff437283e0191ed5b9ecc04c27f1162b0b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.209s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:36:01 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-24784b7f-bb51-4002-85a2-b19f36da158c tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:36:01 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-24784b7f-bb51-4002-85a2-b19f36da158c tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b --force-share --output=json" returned: 0 in 0.166s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:36:01 user nova-compute[72382]: DEBUG nova.virt.disk.api [None req-24784b7f-bb51-4002-85a2-b19f36da158c tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d66443a2-2dc1-46f6-9572-f0717f830927/disk. size=1073741824 {{(pid=72382) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 15:36:01 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-24784b7f-bb51-4002-85a2-b19f36da158c tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d66443a2-2dc1-46f6-9572-f0717f830927/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:36:01 user nova-compute[72382]: DEBUG nova.network.neutron [None req-24784b7f-bb51-4002-85a2-b19f36da158c tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] [instance: d66443a2-2dc1-46f6-9572-f0717f830927] Successfully created port: 49ab3b4d-3d4b-41a6-bd6f-a1c1567ca7bd {{(pid=72382) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 15:36:01 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:36:01 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-24784b7f-bb51-4002-85a2-b19f36da158c tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d66443a2-2dc1-46f6-9572-f0717f830927/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:36:01 user nova-compute[72382]: DEBUG nova.virt.disk.api [None req-24784b7f-bb51-4002-85a2-b19f36da158c tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Cannot resize image /opt/stack/data/nova/instances/d66443a2-2dc1-46f6-9572-f0717f830927/disk to a smaller size. {{(pid=72382) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 15:36:01 user nova-compute[72382]: DEBUG nova.objects.instance [None req-24784b7f-bb51-4002-85a2-b19f36da158c tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Lazy-loading 'migration_context' on Instance uuid d66443a2-2dc1-46f6-9572-f0717f830927 {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:36:01 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-24784b7f-bb51-4002-85a2-b19f36da158c tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] [instance: d66443a2-2dc1-46f6-9572-f0717f830927] Created local disks {{(pid=72382) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 15:36:01 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-24784b7f-bb51-4002-85a2-b19f36da158c tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] [instance: d66443a2-2dc1-46f6-9572-f0717f830927] Ensure instance console log exists: /opt/stack/data/nova/instances/d66443a2-2dc1-46f6-9572-f0717f830927/console.log {{(pid=72382) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 15:36:01 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-24784b7f-bb51-4002-85a2-b19f36da158c tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:36:01 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-24784b7f-bb51-4002-85a2-b19f36da158c tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:36:01 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-24784b7f-bb51-4002-85a2-b19f36da158c tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:36:01 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:36:01 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:36:02 user nova-compute[72382]: DEBUG nova.compute.manager [req-64e73e40-232e-42d8-be22-be100aeb6826 req-303e25e9-cae9-44fb-8001-9108aacaf1e0 service nova] [instance: 7949b7d0-2712-402f-86ee-30acaef2d3e7] Received event network-vif-plugged-bf6ac419-c6ba-4f01-b35a-4fa5e58913be {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:36:02 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-64e73e40-232e-42d8-be22-be100aeb6826 req-303e25e9-cae9-44fb-8001-9108aacaf1e0 service nova] Acquiring lock "7949b7d0-2712-402f-86ee-30acaef2d3e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:36:02 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-64e73e40-232e-42d8-be22-be100aeb6826 req-303e25e9-cae9-44fb-8001-9108aacaf1e0 service nova] Lock "7949b7d0-2712-402f-86ee-30acaef2d3e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:36:02 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-64e73e40-232e-42d8-be22-be100aeb6826 req-303e25e9-cae9-44fb-8001-9108aacaf1e0 service nova] Lock "7949b7d0-2712-402f-86ee-30acaef2d3e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:36:02 user nova-compute[72382]: DEBUG nova.compute.manager [req-64e73e40-232e-42d8-be22-be100aeb6826 req-303e25e9-cae9-44fb-8001-9108aacaf1e0 service nova] [instance: 7949b7d0-2712-402f-86ee-30acaef2d3e7] No waiting events found dispatching network-vif-plugged-bf6ac419-c6ba-4f01-b35a-4fa5e58913be {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:36:02 user nova-compute[72382]: WARNING nova.compute.manager [req-64e73e40-232e-42d8-be22-be100aeb6826 req-303e25e9-cae9-44fb-8001-9108aacaf1e0 service nova] [instance: 7949b7d0-2712-402f-86ee-30acaef2d3e7] Received unexpected event network-vif-plugged-bf6ac419-c6ba-4f01-b35a-4fa5e58913be for instance with vm_state building and task_state spawning.
Aug 09 15:36:02 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:36:02 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:36:02 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:36:03 user nova-compute[72382]: DEBUG nova.network.neutron [None req-24784b7f-bb51-4002-85a2-b19f36da158c tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] [instance: d66443a2-2dc1-46f6-9572-f0717f830927] Successfully updated port: 49ab3b4d-3d4b-41a6-bd6f-a1c1567ca7bd {{(pid=72382) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 15:36:03 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-24784b7f-bb51-4002-85a2-b19f36da158c tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Acquiring lock "refresh_cache-d66443a2-2dc1-46f6-9572-f0717f830927" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 15:36:03 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-24784b7f-bb51-4002-85a2-b19f36da158c tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Acquired lock "refresh_cache-d66443a2-2dc1-46f6-9572-f0717f830927" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 15:36:03 user nova-compute[72382]: DEBUG nova.network.neutron [None req-24784b7f-bb51-4002-85a2-b19f36da158c tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] [instance: d66443a2-2dc1-46f6-9572-f0717f830927] Building network info cache for instance {{(pid=72382) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 15:36:03 user nova-compute[72382]: DEBUG nova.network.neutron [None req-24784b7f-bb51-4002-85a2-b19f36da158c tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] [instance: d66443a2-2dc1-46f6-9572-f0717f830927] Instance cache missing network info. {{(pid=72382) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 15:36:03 user nova-compute[72382]: DEBUG nova.network.neutron [None req-24784b7f-bb51-4002-85a2-b19f36da158c tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] [instance: d66443a2-2dc1-46f6-9572-f0717f830927] Updating instance_info_cache with network_info: [{"id": "49ab3b4d-3d4b-41a6-bd6f-a1c1567ca7bd", "address": "fa:16:3e:5a:e8:fb", "network": {"id": "a85a6e1f-20f5-4719-90d2-0dc23ce525cd", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-780716970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c1a50eacfd0414bbc13e3fd4087e998", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49ab3b4d-3d", "ovs_interfaceid": "49ab3b4d-3d4b-41a6-bd6f-a1c1567ca7bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:36:03 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-24784b7f-bb51-4002-85a2-b19f36da158c tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Releasing lock "refresh_cache-d66443a2-2dc1-46f6-9572-f0717f830927" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 15:36:03 user nova-compute[72382]: DEBUG nova.compute.manager [None req-24784b7f-bb51-4002-85a2-b19f36da158c tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] [instance: d66443a2-2dc1-46f6-9572-f0717f830927] Instance network_info: |[{"id": "49ab3b4d-3d4b-41a6-bd6f-a1c1567ca7bd", "address": "fa:16:3e:5a:e8:fb", "network": {"id": "a85a6e1f-20f5-4719-90d2-0dc23ce525cd", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-780716970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c1a50eacfd0414bbc13e3fd4087e998", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49ab3b4d-3d", "ovs_interfaceid": "49ab3b4d-3d4b-41a6-bd6f-a1c1567ca7bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72382) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 15:36:03 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-24784b7f-bb51-4002-85a2-b19f36da158c tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] [instance: d66443a2-2dc1-46f6-9572-f0717f830927] Start _get_guest_xml network_info=[{"id": "49ab3b4d-3d4b-41a6-bd6f-a1c1567ca7bd", "address": "fa:16:3e:5a:e8:fb", "network": {"id": "a85a6e1f-20f5-4719-90d2-0dc23ce525cd", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-780716970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c1a50eacfd0414bbc13e3fd4087e998", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49ab3b4d-3d", "ovs_interfaceid": "49ab3b4d-3d4b-41a6-bd6f-a1c1567ca7bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T15:11:25Z,direct_url=<?>,disk_format='qcow2',id=a79f2cea-eb27-4631-aaf3-05e7d9e411b4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a638990e12cc4d6eabb6d55e13be6bdf',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T15:11:27Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'a79f2cea-eb27-4631-aaf3-05e7d9e411b4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72382) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 15:36:03 user nova-compute[72382]: WARNING nova.virt.libvirt.driver [None req-24784b7f-bb51-4002-85a2-b19f36da158c tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 15:36:03 user nova-compute[72382]: WARNING nova.virt.libvirt.driver [None req-24784b7f-bb51-4002-85a2-b19f36da158c tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 15:36:03 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-24784b7f-bb51-4002-85a2-b19f36da158c tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72382) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 15:36:03 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-24784b7f-bb51-4002-85a2-b19f36da158c tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] CPU controller missing on host. {{(pid=72382) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 15:36:03 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-24784b7f-bb51-4002-85a2-b19f36da158c tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72382) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 15:36:03 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-24784b7f-bb51-4002-85a2-b19f36da158c tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] CPU controller found on host. {{(pid=72382) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 15:36:03 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-24784b7f-bb51-4002-85a2-b19f36da158c tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72382) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 15:36:03 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-24784b7f-bb51-4002-85a2-b19f36da158c tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T15:11:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T15:11:25Z,direct_url=<?>,disk_format='qcow2',id=a79f2cea-eb27-4631-aaf3-05e7d9e411b4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a638990e12cc4d6eabb6d55e13be6bdf',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T15:11:27Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 15:36:03 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-24784b7f-bb51-4002-85a2-b19f36da158c tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Flavor limits 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 15:36:03 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-24784b7f-bb51-4002-85a2-b19f36da158c tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Image limits 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 15:36:03 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-24784b7f-bb51-4002-85a2-b19f36da158c tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Flavor pref 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 15:36:03 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-24784b7f-bb51-4002-85a2-b19f36da158c tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Image pref 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 15:36:03 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-24784b7f-bb51-4002-85a2-b19f36da158c tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 15:36:03 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-24784b7f-bb51-4002-85a2-b19f36da158c tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 15:36:03 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-24784b7f-bb51-4002-85a2-b19f36da158c tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72382) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 15:36:03 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-24784b7f-bb51-4002-85a2-b19f36da158c tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Got 1 possible topologies {{(pid=72382) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 15:36:03 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-24784b7f-bb51-4002-85a2-b19f36da158c tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 15:36:03 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-24784b7f-bb51-4002-85a2-b19f36da158c tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 15:36:03 user nova-compute[72382]: DEBUG nova.virt.libvirt.vif [None req-24784b7f-bb51-4002-85a2-b19f36da158c tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T15:35:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1518587981',display_name='tempest-AttachVolumeTestJSON-server-1518587981',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1518587981',id=41,image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFdQaTnwnCVHk2ncC2uzyyfntHgY9kXYhsLJgEtQF4ih89XcG3fIJjKm0SGVQ51cVXX303KNnKW2jM0/vkRCAkoT48ShAsYx4mOluignojAPzQ+x4HPMNlFbEplwifLCIQ==',key_name='tempest-keypair-1834267699',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8c1a50eacfd0414bbc13e3fd4087e998',ramdisk_id='',reservation_id='r-syev47lw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-502043064',owner_user_name='tempest-AttachVolumeTestJSON-502043064-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T15:36:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='13c67153e9ec44029e8d80c09d405175',uuid=d66443a2-2dc1-46f6-9572-f0717f830927,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "49ab3b4d-3d4b-41a6-bd6f-a1c1567ca7bd", "address": "fa:16:3e:5a:e8:fb", "network": {"id": "a85a6e1f-20f5-4719-90d2-0dc23ce525cd", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-780716970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c1a50eacfd0414bbc13e3fd4087e998", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49ab3b4d-3d", "ovs_interfaceid": "49ab3b4d-3d4b-41a6-bd6f-a1c1567ca7bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72382) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 15:36:03 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-24784b7f-bb51-4002-85a2-b19f36da158c tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Converting VIF {"id": "49ab3b4d-3d4b-41a6-bd6f-a1c1567ca7bd", "address": "fa:16:3e:5a:e8:fb", "network": {"id": "a85a6e1f-20f5-4719-90d2-0dc23ce525cd", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-780716970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c1a50eacfd0414bbc13e3fd4087e998", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49ab3b4d-3d", "ovs_interfaceid": "49ab3b4d-3d4b-41a6-bd6f-a1c1567ca7bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 15:36:03 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-24784b7f-bb51-4002-85a2-b19f36da158c tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5a:e8:fb,bridge_name='br-int',has_traffic_filtering=True,id=49ab3b4d-3d4b-41a6-bd6f-a1c1567ca7bd,network=Network(a85a6e1f-20f5-4719-90d2-0dc23ce525cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49ab3b4d-3d') {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 15:36:03 user nova-compute[72382]: DEBUG nova.objects.instance [None req-24784b7f-bb51-4002-85a2-b19f36da158c tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Lazy-loading 'pci_devices' on Instance uuid d66443a2-2dc1-46f6-9572-f0717f830927 {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:36:03 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-24784b7f-bb51-4002-85a2-b19f36da158c tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] [instance: d66443a2-2dc1-46f6-9572-f0717f830927] End _get_guest_xml xml=<domain type="kvm">
Aug 09 15:36:03 user nova-compute[72382]:   <uuid>d66443a2-2dc1-46f6-9572-f0717f830927</uuid>
Aug 09 15:36:03 user nova-compute[72382]:   <name>instance-00000029</name>
Aug 09 15:36:03 user nova-compute[72382]:   <memory>524288</memory>
Aug 09 15:36:03 user nova-compute[72382]:   <vcpu>1</vcpu>
Aug 09 15:36:03 user nova-compute[72382]:   <metadata>
Aug 09 15:36:03 user nova-compute[72382]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 15:36:03 user nova-compute[72382]:       <nova:package version="0.0.0"/>
Aug 09 15:36:03 user nova-compute[72382]:       <nova:name>tempest-AttachVolumeTestJSON-server-1518587981</nova:name>
Aug 09 15:36:03 user nova-compute[72382]:       <nova:creationTime>2023-08-09 15:36:03</nova:creationTime>
Aug 09 15:36:03 user nova-compute[72382]:       <nova:flavor name="m1.tiny">
Aug 09 15:36:03 user nova-compute[72382]:         <nova:memory>512</nova:memory>
Aug 09 15:36:03 user nova-compute[72382]:         <nova:disk>1</nova:disk>
Aug 09 15:36:03 user nova-compute[72382]:         <nova:swap>0</nova:swap>
Aug 09 15:36:03 user nova-compute[72382]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 15:36:03 user nova-compute[72382]:         <nova:vcpus>1</nova:vcpus>
Aug 09 15:36:03 user nova-compute[72382]:       </nova:flavor>
Aug 09 15:36:03 user nova-compute[72382]:       <nova:owner>
Aug 09 15:36:03 user nova-compute[72382]:         <nova:user uuid="13c67153e9ec44029e8d80c09d405175">tempest-AttachVolumeTestJSON-502043064-project-member</nova:user>
Aug 09 15:36:03 user nova-compute[72382]:         <nova:project uuid="8c1a50eacfd0414bbc13e3fd4087e998">tempest-AttachVolumeTestJSON-502043064</nova:project>
Aug 09 15:36:03 user nova-compute[72382]:       </nova:owner>
Aug 09 15:36:03 user nova-compute[72382]:       <nova:root type="image" uuid="a79f2cea-eb27-4631-aaf3-05e7d9e411b4"/>
Aug 09 15:36:03 user nova-compute[72382]:       <nova:ports>
Aug 09 15:36:03 user nova-compute[72382]:         <nova:port uuid="49ab3b4d-3d4b-41a6-bd6f-a1c1567ca7bd">
Aug 09 15:36:03 user nova-compute[72382]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 09 15:36:03 user nova-compute[72382]:         </nova:port>
Aug 09 15:36:03 user nova-compute[72382]:       </nova:ports>
Aug 09 15:36:03 user nova-compute[72382]:     </nova:instance>
Aug 09 15:36:03 user nova-compute[72382]:   </metadata>
Aug 09 15:36:03 user nova-compute[72382]:   <sysinfo type="smbios">
Aug 09 15:36:03 user nova-compute[72382]:     <system>
Aug 09 15:36:03 user nova-compute[72382]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 15:36:03 user nova-compute[72382]:       <entry name="product">OpenStack Nova</entry>
Aug 09 15:36:03 user nova-compute[72382]:       <entry name="version">0.0.0</entry>
Aug 09 15:36:03 user nova-compute[72382]:       <entry name="serial">d66443a2-2dc1-46f6-9572-f0717f830927</entry>
Aug 09 15:36:03 user nova-compute[72382]:       <entry name="uuid">d66443a2-2dc1-46f6-9572-f0717f830927</entry>
Aug 09 15:36:03 user nova-compute[72382]:       <entry name="family">Virtual Machine</entry>
Aug 09 15:36:03 user nova-compute[72382]:     </system>
Aug 09 15:36:03 user nova-compute[72382]:   </sysinfo>
Aug 09 15:36:03 user nova-compute[72382]:   <os>
Aug 09 15:36:03 user nova-compute[72382]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 15:36:03 user nova-compute[72382]:     <boot dev="hd"/>
Aug 09 15:36:03 user nova-compute[72382]:     <smbios mode="sysinfo"/>
Aug 09 15:36:03 user nova-compute[72382]:   </os>
Aug 09 15:36:03 user nova-compute[72382]:   <features>
Aug 09 15:36:03 user nova-compute[72382]:     <acpi/>
Aug 09 15:36:03 user nova-compute[72382]:     <apic/>
Aug 09 15:36:03 user nova-compute[72382]:     <vmcoreinfo/>
Aug 09 15:36:03 user nova-compute[72382]:   </features>
Aug 09 15:36:03 user nova-compute[72382]:   <clock offset="utc">
Aug 09 15:36:03 user nova-compute[72382]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 15:36:03 user nova-compute[72382]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 15:36:03 user nova-compute[72382]:     <timer name="hpet" present="no"/>
Aug 09 15:36:03 user nova-compute[72382]:   </clock>
Aug 09 15:36:03 user nova-compute[72382]:   <cpu mode="custom" match="exact">
Aug 09 15:36:03 user nova-compute[72382]:     <model>Nehalem</model>
Aug 09 15:36:03 user nova-compute[72382]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 15:36:03 user nova-compute[72382]:   </cpu>
Aug 09 15:36:03 user nova-compute[72382]:   <devices>
Aug 09 15:36:03 user nova-compute[72382]:     <disk type="file" device="disk">
Aug 09 15:36:03 user nova-compute[72382]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 15:36:03 user nova-compute[72382]:       <source file="/opt/stack/data/nova/instances/d66443a2-2dc1-46f6-9572-f0717f830927/disk"/>
Aug 09 15:36:03 user nova-compute[72382]:       <target dev="vda" bus="virtio"/>
Aug 09 15:36:03 user nova-compute[72382]:     </disk>
Aug 09 15:36:03 user nova-compute[72382]:     <interface type="ethernet">
Aug 09 15:36:03 user nova-compute[72382]:       <mac address="fa:16:3e:5a:e8:fb"/>
Aug 09 15:36:03 user nova-compute[72382]:       <model type="virtio"/>
Aug 09 15:36:03 user nova-compute[72382]:       <mtu size="1442"/>
Aug 09 15:36:03 user nova-compute[72382]:       <target dev="tap49ab3b4d-3d"/>
Aug 09 15:36:03 user nova-compute[72382]:     </interface>
Aug 09 15:36:03 user nova-compute[72382]:     <serial type="pty">
Aug 09 15:36:03 user nova-compute[72382]:       <log file="/opt/stack/data/nova/instances/d66443a2-2dc1-46f6-9572-f0717f830927/console.log" append="off"/>
Aug 09 15:36:03 user nova-compute[72382]:     </serial>
Aug 09 15:36:03 user nova-compute[72382]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 15:36:03 user nova-compute[72382]:     <video>
Aug 09 15:36:03 user nova-compute[72382]:       <model type="virtio"/>
Aug 09 15:36:03 user nova-compute[72382]:     </video>
Aug 09 15:36:03 user nova-compute[72382]:     <rng model="virtio">
Aug 09 15:36:03 user nova-compute[72382]:       <backend model="random">/dev/urandom</backend>
Aug 09 15:36:03 user nova-compute[72382]:     </rng>
Aug 09 15:36:03 user nova-compute[72382]:     <controller type="usb" index="0" model="none"/>
Aug 09 15:36:03 user nova-compute[72382]:     <memballoon model="virtio">
Aug 09 15:36:03 user nova-compute[72382]:       <stats period="10"/>
Aug 09 15:36:03 user nova-compute[72382]:     </memballoon>
Aug 09 15:36:03 user nova-compute[72382]:   </devices>
Aug 09 15:36:03 user nova-compute[72382]: </domain>
Aug 09 15:36:03 user nova-compute[72382]:  {{(pid=72382) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 15:36:03 user nova-compute[72382]: DEBUG nova.virt.libvirt.vif [None req-24784b7f-bb51-4002-85a2-b19f36da158c tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T15:35:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1518587981',display_name='tempest-AttachVolumeTestJSON-server-1518587981',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1518587981',id=41,image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFdQaTnwnCVHk2ncC2uzyyfntHgY9kXYhsLJgEtQF4ih89XcG3fIJjKm0SGVQ51cVXX303KNnKW2jM0/vkRCAkoT48ShAsYx4mOluignojAPzQ+x4HPMNlFbEplwifLCIQ==',key_name='tempest-keypair-1834267699',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8c1a50eacfd0414bbc13e3fd4087e998',ramdisk_id='',reservation_id='r-syev47lw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-502043064',owner_user_name='tempest-AttachVolumeTestJSON-502043064-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T15:36:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='13c67153e9ec44029e8d80c09d405175',uuid=d66443a2-2dc1-46f6-9572-f0717f830927,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "49ab3b4d-3d4b-41a6-bd6f-a1c1567ca7bd", "address": "fa:16:3e:5a:e8:fb", "network": {"id": "a85a6e1f-20f5-4719-90d2-0dc23ce525cd", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-780716970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c1a50eacfd0414bbc13e3fd4087e998", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49ab3b4d-3d", "ovs_interfaceid": "49ab3b4d-3d4b-41a6-bd6f-a1c1567ca7bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 15:36:03 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-24784b7f-bb51-4002-85a2-b19f36da158c tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Converting VIF {"id": "49ab3b4d-3d4b-41a6-bd6f-a1c1567ca7bd", "address": "fa:16:3e:5a:e8:fb", "network": {"id": "a85a6e1f-20f5-4719-90d2-0dc23ce525cd", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-780716970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c1a50eacfd0414bbc13e3fd4087e998", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49ab3b4d-3d", "ovs_interfaceid": "49ab3b4d-3d4b-41a6-bd6f-a1c1567ca7bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 15:36:03 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-24784b7f-bb51-4002-85a2-b19f36da158c tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5a:e8:fb,bridge_name='br-int',has_traffic_filtering=True,id=49ab3b4d-3d4b-41a6-bd6f-a1c1567ca7bd,network=Network(a85a6e1f-20f5-4719-90d2-0dc23ce525cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49ab3b4d-3d') {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 15:36:03 user nova-compute[72382]: DEBUG os_vif [None req-24784b7f-bb51-4002-85a2-b19f36da158c tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:e8:fb,bridge_name='br-int',has_traffic_filtering=True,id=49ab3b4d-3d4b-41a6-bd6f-a1c1567ca7bd,network=Network(a85a6e1f-20f5-4719-90d2-0dc23ce525cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49ab3b4d-3d') {{(pid=72382) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 15:36:03 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:36:03 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:36:03 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 15:36:03 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:36:03 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap49ab3b4d-3d, may_exist=True, interface_attrs={}) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:36:03 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap49ab3b4d-3d, col_values=(('external_ids', {'iface-id': '49ab3b4d-3d4b-41a6-bd6f-a1c1567ca7bd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5a:e8:fb', 'vm-uuid': 'd66443a2-2dc1-46f6-9572-f0717f830927'}),), if_exists=True) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:36:03 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:36:03 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:36:03 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:36:03 user nova-compute[72382]: INFO os_vif [None req-24784b7f-bb51-4002-85a2-b19f36da158c tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:e8:fb,bridge_name='br-int',has_traffic_filtering=True,id=49ab3b4d-3d4b-41a6-bd6f-a1c1567ca7bd,network=Network(a85a6e1f-20f5-4719-90d2-0dc23ce525cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49ab3b4d-3d')
Aug 09 15:36:04 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-24784b7f-bb51-4002-85a2-b19f36da158c tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] No BDM found with device name vda, not building metadata. {{(pid=72382) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 15:36:04 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-24784b7f-bb51-4002-85a2-b19f36da158c tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] No VIF found with MAC fa:16:3e:5a:e8:fb, not building metadata {{(pid=72382) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 15:36:04 user nova-compute[72382]: DEBUG nova.virt.driver [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Emitting event <LifecycleEvent: 1691595364.0436263, 7949b7d0-2712-402f-86ee-30acaef2d3e7 => Resumed> {{(pid=72382) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 15:36:04 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 7949b7d0-2712-402f-86ee-30acaef2d3e7] VM Resumed (Lifecycle Event)
Aug 09 15:36:04 user nova-compute[72382]: DEBUG nova.compute.manager [None req-cdadf666-68b4-4518-ae9e-63f144e45865 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] [instance: 7949b7d0-2712-402f-86ee-30acaef2d3e7] Instance event wait completed in 0 seconds for  {{(pid=72382) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 15:36:04 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-cdadf666-68b4-4518-ae9e-63f144e45865 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] [instance: 7949b7d0-2712-402f-86ee-30acaef2d3e7] Guest created on hypervisor {{(pid=72382) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 15:36:04 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 7949b7d0-2712-402f-86ee-30acaef2d3e7] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:36:04 user nova-compute[72382]: INFO nova.virt.libvirt.driver [-] [instance: 7949b7d0-2712-402f-86ee-30acaef2d3e7] Instance spawned successfully.
Aug 09 15:36:04 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-cdadf666-68b4-4518-ae9e-63f144e45865 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] [instance: 7949b7d0-2712-402f-86ee-30acaef2d3e7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 15:36:04 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 7949b7d0-2712-402f-86ee-30acaef2d3e7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72382) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 15:36:04 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-cdadf666-68b4-4518-ae9e-63f144e45865 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] [instance: 7949b7d0-2712-402f-86ee-30acaef2d3e7] Found default for hw_cdrom_bus of ide {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:36:04 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-cdadf666-68b4-4518-ae9e-63f144e45865 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] [instance: 7949b7d0-2712-402f-86ee-30acaef2d3e7] Found default for hw_disk_bus of virtio {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:36:04 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-cdadf666-68b4-4518-ae9e-63f144e45865 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] [instance: 7949b7d0-2712-402f-86ee-30acaef2d3e7] Found default for hw_input_bus of None {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:36:04 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-cdadf666-68b4-4518-ae9e-63f144e45865 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] [instance: 7949b7d0-2712-402f-86ee-30acaef2d3e7] Found default for hw_pointer_model of None {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:36:04 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-cdadf666-68b4-4518-ae9e-63f144e45865 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] [instance: 7949b7d0-2712-402f-86ee-30acaef2d3e7] Found default for hw_video_model of virtio {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:36:04 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-cdadf666-68b4-4518-ae9e-63f144e45865 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] [instance: 7949b7d0-2712-402f-86ee-30acaef2d3e7] Found default for hw_vif_model of virtio {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:36:04 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 7949b7d0-2712-402f-86ee-30acaef2d3e7] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 15:36:04 user nova-compute[72382]: DEBUG nova.virt.driver [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Emitting event <LifecycleEvent: 1691595364.0453823, 7949b7d0-2712-402f-86ee-30acaef2d3e7 => Started> {{(pid=72382) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 15:36:04 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 7949b7d0-2712-402f-86ee-30acaef2d3e7] VM Started (Lifecycle Event)
Aug 09 15:36:04 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 7949b7d0-2712-402f-86ee-30acaef2d3e7] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:36:04 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 7949b7d0-2712-402f-86ee-30acaef2d3e7] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72382) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 15:36:04 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 7949b7d0-2712-402f-86ee-30acaef2d3e7] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 15:36:04 user nova-compute[72382]: INFO nova.compute.manager [None req-cdadf666-68b4-4518-ae9e-63f144e45865 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] [instance: 7949b7d0-2712-402f-86ee-30acaef2d3e7] Took 7.02 seconds to spawn the instance on the hypervisor.
Aug 09 15:36:04 user nova-compute[72382]: DEBUG nova.compute.manager [None req-cdadf666-68b4-4518-ae9e-63f144e45865 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] [instance: 7949b7d0-2712-402f-86ee-30acaef2d3e7] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:36:04 user nova-compute[72382]: INFO nova.compute.manager [None req-cdadf666-68b4-4518-ae9e-63f144e45865 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] [instance: 7949b7d0-2712-402f-86ee-30acaef2d3e7] Took 7.70 seconds to build instance.
Aug 09 15:36:04 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-cdadf666-68b4-4518-ae9e-63f144e45865 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Lock "7949b7d0-2712-402f-86ee-30acaef2d3e7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.803s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:36:04 user nova-compute[72382]: DEBUG nova.compute.manager [req-40647245-1922-49d2-870c-4b743ae84910 req-da7b6ca2-6603-4c25-9381-85cf95b6a260 service nova] [instance: 7949b7d0-2712-402f-86ee-30acaef2d3e7] Received event network-vif-plugged-bf6ac419-c6ba-4f01-b35a-4fa5e58913be {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:36:04 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-40647245-1922-49d2-870c-4b743ae84910 req-da7b6ca2-6603-4c25-9381-85cf95b6a260 service nova] Acquiring lock "7949b7d0-2712-402f-86ee-30acaef2d3e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:36:04 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-40647245-1922-49d2-870c-4b743ae84910 req-da7b6ca2-6603-4c25-9381-85cf95b6a260 service nova] Lock "7949b7d0-2712-402f-86ee-30acaef2d3e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:36:04 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-40647245-1922-49d2-870c-4b743ae84910 req-da7b6ca2-6603-4c25-9381-85cf95b6a260 service nova] Lock "7949b7d0-2712-402f-86ee-30acaef2d3e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:36:04 user nova-compute[72382]: DEBUG nova.compute.manager [req-40647245-1922-49d2-870c-4b743ae84910 req-da7b6ca2-6603-4c25-9381-85cf95b6a260 service nova] [instance: 7949b7d0-2712-402f-86ee-30acaef2d3e7] No waiting events found dispatching network-vif-plugged-bf6ac419-c6ba-4f01-b35a-4fa5e58913be {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:36:04 user nova-compute[72382]: WARNING nova.compute.manager [req-40647245-1922-49d2-870c-4b743ae84910 req-da7b6ca2-6603-4c25-9381-85cf95b6a260 service nova] [instance: 7949b7d0-2712-402f-86ee-30acaef2d3e7] Received unexpected event network-vif-plugged-bf6ac419-c6ba-4f01-b35a-4fa5e58913be for instance with vm_state active and task_state None.
Aug 09 15:36:04 user nova-compute[72382]: DEBUG nova.compute.manager [req-40647245-1922-49d2-870c-4b743ae84910 req-da7b6ca2-6603-4c25-9381-85cf95b6a260 service nova] [instance: d66443a2-2dc1-46f6-9572-f0717f830927] Received event network-changed-49ab3b4d-3d4b-41a6-bd6f-a1c1567ca7bd {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:36:04 user nova-compute[72382]: DEBUG nova.compute.manager [req-40647245-1922-49d2-870c-4b743ae84910 req-da7b6ca2-6603-4c25-9381-85cf95b6a260 service nova] [instance: d66443a2-2dc1-46f6-9572-f0717f830927] Refreshing instance network info cache due to event network-changed-49ab3b4d-3d4b-41a6-bd6f-a1c1567ca7bd. {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 15:36:04 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-40647245-1922-49d2-870c-4b743ae84910 req-da7b6ca2-6603-4c25-9381-85cf95b6a260 service nova] Acquiring lock "refresh_cache-d66443a2-2dc1-46f6-9572-f0717f830927" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 15:36:04 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-40647245-1922-49d2-870c-4b743ae84910 req-da7b6ca2-6603-4c25-9381-85cf95b6a260 service nova] Acquired lock "refresh_cache-d66443a2-2dc1-46f6-9572-f0717f830927" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 15:36:04 user nova-compute[72382]: DEBUG nova.network.neutron [req-40647245-1922-49d2-870c-4b743ae84910 req-da7b6ca2-6603-4c25-9381-85cf95b6a260 service nova] [instance: d66443a2-2dc1-46f6-9572-f0717f830927] Refreshing network info cache for port 49ab3b4d-3d4b-41a6-bd6f-a1c1567ca7bd {{(pid=72382) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 15:36:04 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:36:04 user nova-compute[72382]: DEBUG nova.network.neutron [req-40647245-1922-49d2-870c-4b743ae84910 req-da7b6ca2-6603-4c25-9381-85cf95b6a260 service nova] [instance: d66443a2-2dc1-46f6-9572-f0717f830927] Updated VIF entry in instance network info cache for port 49ab3b4d-3d4b-41a6-bd6f-a1c1567ca7bd. {{(pid=72382) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 15:36:04 user nova-compute[72382]: DEBUG nova.network.neutron [req-40647245-1922-49d2-870c-4b743ae84910 req-da7b6ca2-6603-4c25-9381-85cf95b6a260 service nova] [instance: d66443a2-2dc1-46f6-9572-f0717f830927] Updating instance_info_cache with network_info: [{"id": "49ab3b4d-3d4b-41a6-bd6f-a1c1567ca7bd", "address": "fa:16:3e:5a:e8:fb", "network": {"id": "a85a6e1f-20f5-4719-90d2-0dc23ce525cd", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-780716970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c1a50eacfd0414bbc13e3fd4087e998", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49ab3b4d-3d", "ovs_interfaceid": "49ab3b4d-3d4b-41a6-bd6f-a1c1567ca7bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:36:04 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-40647245-1922-49d2-870c-4b743ae84910 req-da7b6ca2-6603-4c25-9381-85cf95b6a260 service nova] Releasing lock "refresh_cache-d66443a2-2dc1-46f6-9572-f0717f830927" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 15:36:05 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:36:05 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:36:05 user nova-compute[72382]: DEBUG nova.compute.manager [req-abf158e9-c996-4a09-b08d-7b4e3fb4deb2 req-e5ab982b-b33a-4eb3-bd50-0ad5c5855957 service nova] [instance: d66443a2-2dc1-46f6-9572-f0717f830927] Received event network-vif-plugged-49ab3b4d-3d4b-41a6-bd6f-a1c1567ca7bd {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:36:05 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-abf158e9-c996-4a09-b08d-7b4e3fb4deb2 req-e5ab982b-b33a-4eb3-bd50-0ad5c5855957 service nova] Acquiring lock "d66443a2-2dc1-46f6-9572-f0717f830927-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:36:05 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-abf158e9-c996-4a09-b08d-7b4e3fb4deb2 req-e5ab982b-b33a-4eb3-bd50-0ad5c5855957 service nova] Lock "d66443a2-2dc1-46f6-9572-f0717f830927-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:36:05 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-abf158e9-c996-4a09-b08d-7b4e3fb4deb2 req-e5ab982b-b33a-4eb3-bd50-0ad5c5855957 service nova] Lock "d66443a2-2dc1-46f6-9572-f0717f830927-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:36:05 user nova-compute[72382]: DEBUG nova.compute.manager [req-abf158e9-c996-4a09-b08d-7b4e3fb4deb2 req-e5ab982b-b33a-4eb3-bd50-0ad5c5855957 service nova] [instance: d66443a2-2dc1-46f6-9572-f0717f830927] No waiting events found dispatching network-vif-plugged-49ab3b4d-3d4b-41a6-bd6f-a1c1567ca7bd {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:36:05 user nova-compute[72382]: WARNING nova.compute.manager [req-abf158e9-c996-4a09-b08d-7b4e3fb4deb2 req-e5ab982b-b33a-4eb3-bd50-0ad5c5855957 service nova] [instance: d66443a2-2dc1-46f6-9572-f0717f830927] Received unexpected event network-vif-plugged-49ab3b4d-3d4b-41a6-bd6f-a1c1567ca7bd for instance with vm_state building and task_state spawning.
Aug 09 15:36:06 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:36:06 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:36:06 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:36:06 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:36:07 user nova-compute[72382]: DEBUG nova.virt.driver [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Emitting event <LifecycleEvent: 1691595367.8188415, d66443a2-2dc1-46f6-9572-f0717f830927 => Resumed> {{(pid=72382) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 15:36:07 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: d66443a2-2dc1-46f6-9572-f0717f830927] VM Resumed (Lifecycle Event)
Aug 09 15:36:07 user nova-compute[72382]: DEBUG nova.compute.manager [None req-24784b7f-bb51-4002-85a2-b19f36da158c tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] [instance: d66443a2-2dc1-46f6-9572-f0717f830927] Instance event wait completed in 0 seconds for  {{(pid=72382) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 15:36:07 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-24784b7f-bb51-4002-85a2-b19f36da158c tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] [instance: d66443a2-2dc1-46f6-9572-f0717f830927] Guest created on hypervisor {{(pid=72382) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 15:36:07 user nova-compute[72382]: INFO nova.virt.libvirt.driver [-] [instance: d66443a2-2dc1-46f6-9572-f0717f830927] Instance spawned successfully.
Aug 09 15:36:07 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-24784b7f-bb51-4002-85a2-b19f36da158c tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] [instance: d66443a2-2dc1-46f6-9572-f0717f830927] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 15:36:07 user nova-compute[72382]: DEBUG nova.compute.manager [req-ab667316-9c70-4d72-bd0e-92585dfda3ac req-c1c92c06-5d3b-4b2b-a5a0-812f3e7c2a2e service nova] [instance: d66443a2-2dc1-46f6-9572-f0717f830927] Received event network-vif-plugged-49ab3b4d-3d4b-41a6-bd6f-a1c1567ca7bd {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:36:07 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-ab667316-9c70-4d72-bd0e-92585dfda3ac req-c1c92c06-5d3b-4b2b-a5a0-812f3e7c2a2e service nova] Acquiring lock "d66443a2-2dc1-46f6-9572-f0717f830927-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:36:07 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-ab667316-9c70-4d72-bd0e-92585dfda3ac req-c1c92c06-5d3b-4b2b-a5a0-812f3e7c2a2e service nova] Lock "d66443a2-2dc1-46f6-9572-f0717f830927-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:36:07 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-ab667316-9c70-4d72-bd0e-92585dfda3ac req-c1c92c06-5d3b-4b2b-a5a0-812f3e7c2a2e service nova] Lock "d66443a2-2dc1-46f6-9572-f0717f830927-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:36:07 user nova-compute[72382]: DEBUG nova.compute.manager [req-ab667316-9c70-4d72-bd0e-92585dfda3ac req-c1c92c06-5d3b-4b2b-a5a0-812f3e7c2a2e service nova] [instance: d66443a2-2dc1-46f6-9572-f0717f830927] No waiting events found dispatching network-vif-plugged-49ab3b4d-3d4b-41a6-bd6f-a1c1567ca7bd {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:36:07 user nova-compute[72382]: WARNING nova.compute.manager [req-ab667316-9c70-4d72-bd0e-92585dfda3ac req-c1c92c06-5d3b-4b2b-a5a0-812f3e7c2a2e service nova] [instance: d66443a2-2dc1-46f6-9572-f0717f830927] Received unexpected event network-vif-plugged-49ab3b4d-3d4b-41a6-bd6f-a1c1567ca7bd for instance with vm_state building and task_state spawning.
Aug 09 15:36:07 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: d66443a2-2dc1-46f6-9572-f0717f830927] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:36:07 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: d66443a2-2dc1-46f6-9572-f0717f830927] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72382) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 15:36:07 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-24784b7f-bb51-4002-85a2-b19f36da158c tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] [instance: d66443a2-2dc1-46f6-9572-f0717f830927] Found default for hw_cdrom_bus of ide {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:36:07 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-24784b7f-bb51-4002-85a2-b19f36da158c tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] [instance: d66443a2-2dc1-46f6-9572-f0717f830927] Found default for hw_disk_bus of virtio {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:36:07 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-24784b7f-bb51-4002-85a2-b19f36da158c tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] [instance: d66443a2-2dc1-46f6-9572-f0717f830927] Found default for hw_input_bus of None {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:36:07 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-24784b7f-bb51-4002-85a2-b19f36da158c tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] [instance: d66443a2-2dc1-46f6-9572-f0717f830927] Found default for hw_pointer_model of None {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:36:07 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-24784b7f-bb51-4002-85a2-b19f36da158c tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] [instance: d66443a2-2dc1-46f6-9572-f0717f830927] Found default for hw_video_model of virtio {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:36:07 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-24784b7f-bb51-4002-85a2-b19f36da158c tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] [instance: d66443a2-2dc1-46f6-9572-f0717f830927] Found default for hw_vif_model of virtio {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:36:07 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: d66443a2-2dc1-46f6-9572-f0717f830927] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 15:36:07 user nova-compute[72382]: DEBUG nova.virt.driver [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Emitting event <LifecycleEvent: 1691595367.823833, d66443a2-2dc1-46f6-9572-f0717f830927 => Started> {{(pid=72382) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 15:36:07 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: d66443a2-2dc1-46f6-9572-f0717f830927] VM Started (Lifecycle Event)
Aug 09 15:36:07 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: d66443a2-2dc1-46f6-9572-f0717f830927] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:36:07 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: d66443a2-2dc1-46f6-9572-f0717f830927] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72382) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 15:36:07 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: d66443a2-2dc1-46f6-9572-f0717f830927] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 15:36:07 user nova-compute[72382]: INFO nova.compute.manager [None req-24784b7f-bb51-4002-85a2-b19f36da158c tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] [instance: d66443a2-2dc1-46f6-9572-f0717f830927] Took 6.89 seconds to spawn the instance on the hypervisor.
Aug 09 15:36:07 user nova-compute[72382]: DEBUG nova.compute.manager [None req-24784b7f-bb51-4002-85a2-b19f36da158c tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] [instance: d66443a2-2dc1-46f6-9572-f0717f830927] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:36:08 user nova-compute[72382]: INFO nova.compute.manager [None req-24784b7f-bb51-4002-85a2-b19f36da158c tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] [instance: d66443a2-2dc1-46f6-9572-f0717f830927] Took 7.65 seconds to build instance.
Aug 09 15:36:08 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-24784b7f-bb51-4002-85a2-b19f36da158c tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Lock "d66443a2-2dc1-46f6-9572-f0717f830927" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.871s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:36:08 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:36:09 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:36:10 user nova-compute[72382]: DEBUG nova.compute.manager [req-7c745b55-39aa-4a53-863b-9323c520fc9c req-823dc0a9-24dc-491a-9d61-a739214b3f3f service nova] [instance: 429ebe93-dd7a-41c4-b80a-0379d3816402] Received event network-changed-d7669ab9-996e-4cf6-82a3-0083fbb7fa5c {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:36:10 user nova-compute[72382]: DEBUG nova.compute.manager [req-7c745b55-39aa-4a53-863b-9323c520fc9c req-823dc0a9-24dc-491a-9d61-a739214b3f3f service nova] [instance: 429ebe93-dd7a-41c4-b80a-0379d3816402] Refreshing instance network info cache due to event network-changed-d7669ab9-996e-4cf6-82a3-0083fbb7fa5c. {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 15:36:10 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-7c745b55-39aa-4a53-863b-9323c520fc9c req-823dc0a9-24dc-491a-9d61-a739214b3f3f service nova] Acquiring lock "refresh_cache-429ebe93-dd7a-41c4-b80a-0379d3816402" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 15:36:10 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-7c745b55-39aa-4a53-863b-9323c520fc9c req-823dc0a9-24dc-491a-9d61-a739214b3f3f service nova] Acquired lock "refresh_cache-429ebe93-dd7a-41c4-b80a-0379d3816402" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 15:36:10 user nova-compute[72382]: DEBUG nova.network.neutron [req-7c745b55-39aa-4a53-863b-9323c520fc9c req-823dc0a9-24dc-491a-9d61-a739214b3f3f service nova] [instance: 429ebe93-dd7a-41c4-b80a-0379d3816402] Refreshing network info cache for port d7669ab9-996e-4cf6-82a3-0083fbb7fa5c {{(pid=72382) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 15:36:11 user nova-compute[72382]: DEBUG nova.network.neutron [req-7c745b55-39aa-4a53-863b-9323c520fc9c req-823dc0a9-24dc-491a-9d61-a739214b3f3f service nova] [instance: 429ebe93-dd7a-41c4-b80a-0379d3816402] Updated VIF entry in instance network info cache for port d7669ab9-996e-4cf6-82a3-0083fbb7fa5c. {{(pid=72382) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 15:36:11 user nova-compute[72382]: DEBUG nova.network.neutron [req-7c745b55-39aa-4a53-863b-9323c520fc9c req-823dc0a9-24dc-491a-9d61-a739214b3f3f service nova] [instance: 429ebe93-dd7a-41c4-b80a-0379d3816402] Updating instance_info_cache with network_info: [{"id": "d7669ab9-996e-4cf6-82a3-0083fbb7fa5c", "address": "fa:16:3e:18:b4:42", "network": {"id": "46eb5f03-e04d-43d1-96d6-0792bc7a94b1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1842512309-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98009994d9c74eb9b4fc6321e82440de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7669ab9-99", "ovs_interfaceid": "d7669ab9-996e-4cf6-82a3-0083fbb7fa5c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:36:11 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-7c745b55-39aa-4a53-863b-9323c520fc9c req-823dc0a9-24dc-491a-9d61-a739214b3f3f service nova] Releasing lock "refresh_cache-429ebe93-dd7a-41c4-b80a-0379d3816402" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 15:36:13 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:36:13 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:36:13 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:36:13 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:36:13 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Auditing locally available compute resources for user (node: user) {{(pid=72382) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 15:36:13 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:36:14 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d66443a2-2dc1-46f6-9572-f0717f830927/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:36:14 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d66443a2-2dc1-46f6-9572-f0717f830927/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:36:14 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d66443a2-2dc1-46f6-9572-f0717f830927/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:36:14 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d66443a2-2dc1-46f6-9572-f0717f830927/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:36:14 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72382) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 15:36:14 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7949b7d0-2712-402f-86ee-30acaef2d3e7/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:36:14 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-5c719caf-6212-408b-b165-4cebd51ea6f3 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Acquiring lock "429ebe93-dd7a-41c4-b80a-0379d3816402" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:36:14 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-5c719caf-6212-408b-b165-4cebd51ea6f3 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Lock "429ebe93-dd7a-41c4-b80a-0379d3816402" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:36:14 user nova-compute[72382]: DEBUG nova.objects.instance [None req-5c719caf-6212-408b-b165-4cebd51ea6f3 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Lazy-loading 'flavor' on Instance uuid 429ebe93-dd7a-41c4-b80a-0379d3816402 {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:36:14 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7949b7d0-2712-402f-86ee-30acaef2d3e7/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:36:14 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7949b7d0-2712-402f-86ee-30acaef2d3e7/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:36:14 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-5c719caf-6212-408b-b165-4cebd51ea6f3 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Lock "429ebe93-dd7a-41c4-b80a-0379d3816402" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.186s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:36:14 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7949b7d0-2712-402f-86ee-30acaef2d3e7/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:36:14 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:36:14 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/402ba448-a30a-45f2-a724-5a53cf584547/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:36:14 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-5c719caf-6212-408b-b165-4cebd51ea6f3 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Acquiring lock "429ebe93-dd7a-41c4-b80a-0379d3816402" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:36:14 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-5c719caf-6212-408b-b165-4cebd51ea6f3 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Lock "429ebe93-dd7a-41c4-b80a-0379d3816402" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:36:14 user nova-compute[72382]: INFO nova.compute.manager [None req-5c719caf-6212-408b-b165-4cebd51ea6f3 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] [instance: 429ebe93-dd7a-41c4-b80a-0379d3816402] Attaching volume 0550bae7-eb05-4964-8e51-43b5b93a29cb to /dev/vdb
Aug 09 15:36:14 user nova-compute[72382]: DEBUG os_brick.utils [None req-5c719caf-6212-408b-b165-4cebd51ea6f3 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 15:36:14 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:36:14 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/402ba448-a30a-45f2-a724-5a53cf584547/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:36:14 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/402ba448-a30a-45f2-a724-5a53cf584547/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:36:14 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:36:14 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[246f5f2e-9ee6-4337-af7d-e009a4909fb5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d2cfa7015fe\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:36:14 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:36:14 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:36:14 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[8900a5f7-63fa-4b22-b33e-e415ca6d0c7e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:36:14 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:36:14 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:36:14 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[95157150-d40e-4a22-9b4b-a196b8afd584]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:36:14 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[726d9d91-6a72-4130-9213-1bda2dc02d25]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:36:14 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-5c719caf-6212-408b-b165-4cebd51ea6f3 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Running cmd (subprocess): nvme version {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:36:15 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-5c719caf-6212-408b-b165-4cebd51ea6f3 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] 'nvme version' failed. Not Retrying. {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 15:36:15 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5c719caf-6212-408b-b165-4cebd51ea6f3 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] nvme not present on system {{(pid=72382) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 15:36:15 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:36:15 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 15:36:15 user nova-compute[72382]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 15:36:15 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b19fbe6-eb13-424a-8f17-8e98f444257b]: (4, '') {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:36:15 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.lightos [None req-5c719caf-6212-408b-b165-4cebd51ea6f3 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72382) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 15:36:15 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.lightos [None req-5c719caf-6212-408b-b165-4cebd51ea6f3 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72382) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 15:36:15 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.lightos [None req-5c719caf-6212-408b-b165-4cebd51ea6f3 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] LIGHTOS: no hostnqn found. {{(pid=72382) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 15:36:15 user nova-compute[72382]: DEBUG os_brick.utils [None req-5c719caf-6212-408b-b165-4cebd51ea6f3 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] <== get_connector_properties: return (159ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d2cfa7015fe', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 15:36:15 user nova-compute[72382]: DEBUG nova.virt.block_device [None req-5c719caf-6212-408b-b165-4cebd51ea6f3 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] [instance: 429ebe93-dd7a-41c4-b80a-0379d3816402] Updating existing volume attachment record: f18f2f57-be36-4770-b983-2a932537530f {{(pid=72382) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 15:36:15 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/402ba448-a30a-45f2-a724-5a53cf584547/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:36:15 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ccbfda2-8bcd-4ec1-972a-cf49a62b1583/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:36:15 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ccbfda2-8bcd-4ec1-972a-cf49a62b1583/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:36:15 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ccbfda2-8bcd-4ec1-972a-cf49a62b1583/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:36:15 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ccbfda2-8bcd-4ec1-972a-cf49a62b1583/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:36:15 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/429ebe93-dd7a-41c4-b80a-0379d3816402/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:36:15 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/429ebe93-dd7a-41c4-b80a-0379d3816402/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:36:15 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/429ebe93-dd7a-41c4-b80a-0379d3816402/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:36:15 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/429ebe93-dd7a-41c4-b80a-0379d3816402/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:36:15 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72382) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 15:36:16 user nova-compute[72382]: DEBUG nova.compute.manager [req-9018661d-9fc5-4932-92b5-e6e5aa6bc9c6 req-cfe614e4-42e7-46b4-82d0-050500a5e0d6 service nova] [instance: c88a5ff2-9789-4ee8-8283-6248bba6d66a] Received event network-changed-4f9e0eae-81c7-4a91-8ac1-51459e231532 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:36:16 user nova-compute[72382]: DEBUG nova.compute.manager [req-9018661d-9fc5-4932-92b5-e6e5aa6bc9c6 req-cfe614e4-42e7-46b4-82d0-050500a5e0d6 service nova] [instance: c88a5ff2-9789-4ee8-8283-6248bba6d66a] Refreshing instance network info cache due to event network-changed-4f9e0eae-81c7-4a91-8ac1-51459e231532. {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 15:36:16 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-9018661d-9fc5-4932-92b5-e6e5aa6bc9c6 req-cfe614e4-42e7-46b4-82d0-050500a5e0d6 service nova] Acquiring lock "refresh_cache-c88a5ff2-9789-4ee8-8283-6248bba6d66a" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 15:36:16 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-9018661d-9fc5-4932-92b5-e6e5aa6bc9c6 req-cfe614e4-42e7-46b4-82d0-050500a5e0d6 service nova] Acquired lock "refresh_cache-c88a5ff2-9789-4ee8-8283-6248bba6d66a" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 15:36:16 user nova-compute[72382]: DEBUG nova.network.neutron [req-9018661d-9fc5-4932-92b5-e6e5aa6bc9c6 req-cfe614e4-42e7-46b4-82d0-050500a5e0d6 service nova] [instance: c88a5ff2-9789-4ee8-8283-6248bba6d66a] Refreshing network info cache for port 4f9e0eae-81c7-4a91-8ac1-51459e231532 {{(pid=72382) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 15:36:16 user nova-compute[72382]: WARNING nova.virt.libvirt.driver [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 15:36:16 user nova-compute[72382]: WARNING nova.virt.libvirt.driver [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 15:36:16 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Hypervisor/Node resource view: name=user free_ram=7741MB free_disk=25.440860748291016GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72382) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 15:36:16 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:36:16 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:36:16 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-5309ba65-2937-4ecb-8972-be396630415c tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] Acquiring lock "c88a5ff2-9789-4ee8-8283-6248bba6d66a" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:36:16 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-5309ba65-2937-4ecb-8972-be396630415c tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] Lock "c88a5ff2-9789-4ee8-8283-6248bba6d66a" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:36:16 user nova-compute[72382]: INFO nova.compute.manager [None req-5309ba65-2937-4ecb-8972-be396630415c tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] [instance: c88a5ff2-9789-4ee8-8283-6248bba6d66a] Shelve offloading
Aug 09 15:36:16 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:36:16 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:36:16 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance 4ccbfda2-8bcd-4ec1-972a-cf49a62b1583 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:36:16 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance 429ebe93-dd7a-41c4-b80a-0379d3816402 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:36:16 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance c88a5ff2-9789-4ee8-8283-6248bba6d66a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:36:16 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance 402ba448-a30a-45f2-a724-5a53cf584547 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:36:16 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance 54523d3e-bfae-4621-85cb-d6a7bc40abf5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:36:16 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance 7949b7d0-2712-402f-86ee-30acaef2d3e7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:36:16 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance d66443a2-2dc1-46f6-9572-f0717f830927 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:36:16 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=72382) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 15:36:16 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=72382) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 15:36:16 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:36:16 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:36:16 user nova-compute[72382]: DEBUG nova.compute.provider_tree [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Inventory has not changed in ProviderTree for provider: 7b15b0e5-df4d-49db-833b-2855d21d10ae {{(pid=72382) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 15:36:16 user nova-compute[72382]: DEBUG nova.scheduler.client.report [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Inventory has not changed for provider 7b15b0e5-df4d-49db-833b-2855d21d10ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72382) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 15:36:16 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Compute_service record updated for user:user {{(pid=72382) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 15:36:16 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.542s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:36:16 user nova-compute[72382]: DEBUG nova.compute.manager [req-59cf2b6f-283e-44af-8eca-3748807f582c req-24939f97-59da-4c1a-a622-515504f54ca6 service nova] [instance: c88a5ff2-9789-4ee8-8283-6248bba6d66a] Received event network-vif-unplugged-4f9e0eae-81c7-4a91-8ac1-51459e231532 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:36:16 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-59cf2b6f-283e-44af-8eca-3748807f582c req-24939f97-59da-4c1a-a622-515504f54ca6 service nova] Acquiring lock "c88a5ff2-9789-4ee8-8283-6248bba6d66a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:36:16 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-59cf2b6f-283e-44af-8eca-3748807f582c req-24939f97-59da-4c1a-a622-515504f54ca6 service nova] Lock "c88a5ff2-9789-4ee8-8283-6248bba6d66a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:36:16 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-59cf2b6f-283e-44af-8eca-3748807f582c req-24939f97-59da-4c1a-a622-515504f54ca6 service nova] Lock "c88a5ff2-9789-4ee8-8283-6248bba6d66a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:36:16 user nova-compute[72382]: DEBUG nova.compute.manager [req-59cf2b6f-283e-44af-8eca-3748807f582c req-24939f97-59da-4c1a-a622-515504f54ca6 service nova] [instance: c88a5ff2-9789-4ee8-8283-6248bba6d66a] No waiting events found dispatching network-vif-unplugged-4f9e0eae-81c7-4a91-8ac1-51459e231532 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:36:16 user nova-compute[72382]: WARNING nova.compute.manager [req-59cf2b6f-283e-44af-8eca-3748807f582c req-24939f97-59da-4c1a-a622-515504f54ca6 service nova] [instance: c88a5ff2-9789-4ee8-8283-6248bba6d66a] Received unexpected event network-vif-unplugged-4f9e0eae-81c7-4a91-8ac1-51459e231532 for instance with vm_state active and task_state shelving.
Aug 09 15:36:17 user nova-compute[72382]: DEBUG nova.network.neutron [req-9018661d-9fc5-4932-92b5-e6e5aa6bc9c6 req-cfe614e4-42e7-46b4-82d0-050500a5e0d6 service nova] [instance: c88a5ff2-9789-4ee8-8283-6248bba6d66a] Updated VIF entry in instance network info cache for port 4f9e0eae-81c7-4a91-8ac1-51459e231532. {{(pid=72382) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 15:36:17 user nova-compute[72382]: DEBUG nova.network.neutron [req-9018661d-9fc5-4932-92b5-e6e5aa6bc9c6 req-cfe614e4-42e7-46b4-82d0-050500a5e0d6 service nova] [instance: c88a5ff2-9789-4ee8-8283-6248bba6d66a] Updating instance_info_cache with network_info: [{"id": "4f9e0eae-81c7-4a91-8ac1-51459e231532", "address": "fa:16:3e:b2:aa:71", "network": {"id": "5f3f6e0f-94b3-4a66-9839-763a2e2d259c", "bridge": "br-int", "label": "tempest-TestShelveInstance-338163972-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "108a420b4c6e451d8429d21665e12fb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f9e0eae-81", "ovs_interfaceid": "4f9e0eae-81c7-4a91-8ac1-51459e231532", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:36:17 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-9018661d-9fc5-4932-92b5-e6e5aa6bc9c6 req-cfe614e4-42e7-46b4-82d0-050500a5e0d6 service nova] Releasing lock "refresh_cache-c88a5ff2-9789-4ee8-8283-6248bba6d66a" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 15:36:17 user nova-compute[72382]: INFO nova.virt.libvirt.driver [-] [instance: c88a5ff2-9789-4ee8-8283-6248bba6d66a] Instance destroyed successfully.
Aug 09 15:36:17 user nova-compute[72382]: DEBUG nova.compute.manager [None req-5309ba65-2937-4ecb-8972-be396630415c tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] [instance: c88a5ff2-9789-4ee8-8283-6248bba6d66a] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:36:17 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-5309ba65-2937-4ecb-8972-be396630415c tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] Acquiring lock "refresh_cache-c88a5ff2-9789-4ee8-8283-6248bba6d66a" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 15:36:17 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-5309ba65-2937-4ecb-8972-be396630415c tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] Acquired lock "refresh_cache-c88a5ff2-9789-4ee8-8283-6248bba6d66a" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 15:36:17 user nova-compute[72382]: DEBUG nova.network.neutron [None req-5309ba65-2937-4ecb-8972-be396630415c tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] [instance: c88a5ff2-9789-4ee8-8283-6248bba6d66a] Building network info cache for instance {{(pid=72382) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 15:36:17 user nova-compute[72382]: DEBUG nova.network.neutron [None req-5309ba65-2937-4ecb-8972-be396630415c tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] [instance: c88a5ff2-9789-4ee8-8283-6248bba6d66a] Updating instance_info_cache with network_info: [{"id": "4f9e0eae-81c7-4a91-8ac1-51459e231532", "address": "fa:16:3e:b2:aa:71", "network": {"id": "5f3f6e0f-94b3-4a66-9839-763a2e2d259c", "bridge": "br-int", "label": "tempest-TestShelveInstance-338163972-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "108a420b4c6e451d8429d21665e12fb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f9e0eae-81", "ovs_interfaceid": "4f9e0eae-81c7-4a91-8ac1-51459e231532", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:36:17 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-5309ba65-2937-4ecb-8972-be396630415c tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] Releasing lock "refresh_cache-c88a5ff2-9789-4ee8-8283-6248bba6d66a" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 15:36:18 user nova-compute[72382]: INFO nova.virt.libvirt.driver [-] [instance: c88a5ff2-9789-4ee8-8283-6248bba6d66a] Instance destroyed successfully.
Aug 09 15:36:18 user nova-compute[72382]: DEBUG nova.objects.instance [None req-5309ba65-2937-4ecb-8972-be396630415c tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] Lazy-loading 'resources' on Instance uuid c88a5ff2-9789-4ee8-8283-6248bba6d66a {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:36:18 user nova-compute[72382]: DEBUG nova.virt.libvirt.vif [None req-5309ba65-2937-4ecb-8972-be396630415c tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T15:34:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1501121398',display_name='tempest-TestShelveInstance-server-1501121398',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1501121398',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCQeChkkmZm29XyCKvIOrSdRJlcr1oiXG61vF6rcJ4b2pFtnXlLbiZxIkRlmPJGbv2kd4U6HD3QswG5kTgi7CPYGFQie1zKygmhXmMi1vEfJ/SAk2GycDqgaYBJJp6hk9A==',key_name='tempest-TestShelveInstance-1348374500',keypairs=<?>,launch_index=0,launched_at=2023-08-09T15:34:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='108a420b4c6e451d8429d21665e12fb9',ramdisk_id='',reservation_id='r-3ps4xjyg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1984291610',owner_user_name='tempest-TestShelveInstance-1984291610-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T15:34:38Z,user_data=None,user_id='827f726259fb452aad32077e24ec4fc2',uuid=c88a5ff2-9789-4ee8-8283-6248bba6d66a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4f9e0eae-81c7-4a91-8ac1-51459e231532", "address": "fa:16:3e:b2:aa:71", "network": {"id": "5f3f6e0f-94b3-4a66-9839-763a2e2d259c", "bridge": "br-int", "label": "tempest-TestShelveInstance-338163972-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "108a420b4c6e451d8429d21665e12fb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f9e0eae-81", "ovs_interfaceid": "4f9e0eae-81c7-4a91-8ac1-51459e231532", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 15:36:18 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-5309ba65-2937-4ecb-8972-be396630415c tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] Converting VIF {"id": "4f9e0eae-81c7-4a91-8ac1-51459e231532", "address": "fa:16:3e:b2:aa:71", "network": {"id": "5f3f6e0f-94b3-4a66-9839-763a2e2d259c", "bridge": "br-int", "label": "tempest-TestShelveInstance-338163972-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "108a420b4c6e451d8429d21665e12fb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f9e0eae-81", "ovs_interfaceid": "4f9e0eae-81c7-4a91-8ac1-51459e231532", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 15:36:18 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-5309ba65-2937-4ecb-8972-be396630415c tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:aa:71,bridge_name='br-int',has_traffic_filtering=True,id=4f9e0eae-81c7-4a91-8ac1-51459e231532,network=Network(5f3f6e0f-94b3-4a66-9839-763a2e2d259c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f9e0eae-81') {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 15:36:18 user nova-compute[72382]: DEBUG os_vif [None req-5309ba65-2937-4ecb-8972-be396630415c tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:aa:71,bridge_name='br-int',has_traffic_filtering=True,id=4f9e0eae-81c7-4a91-8ac1-51459e231532,network=Network(5f3f6e0f-94b3-4a66-9839-763a2e2d259c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f9e0eae-81') {{(pid=72382) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 15:36:18 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:36:18 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4f9e0eae-81, bridge=br-int, if_exists=True) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:36:18 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:36:18 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:36:18 user nova-compute[72382]: DEBUG nova.compute.manager [req-8188eb89-ce61-4c15-9578-b1806d89d9d1 req-5031df4f-336a-4f1b-b313-c7b98404edb9 service nova] [instance: c88a5ff2-9789-4ee8-8283-6248bba6d66a] Received event network-changed-4f9e0eae-81c7-4a91-8ac1-51459e231532 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:36:18 user nova-compute[72382]: DEBUG nova.compute.manager [req-8188eb89-ce61-4c15-9578-b1806d89d9d1 req-5031df4f-336a-4f1b-b313-c7b98404edb9 service nova] [instance: c88a5ff2-9789-4ee8-8283-6248bba6d66a] Refreshing instance network info cache due to event network-changed-4f9e0eae-81c7-4a91-8ac1-51459e231532. {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 15:36:18 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-8188eb89-ce61-4c15-9578-b1806d89d9d1 req-5031df4f-336a-4f1b-b313-c7b98404edb9 service nova] Acquiring lock "refresh_cache-c88a5ff2-9789-4ee8-8283-6248bba6d66a" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 15:36:18 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-8188eb89-ce61-4c15-9578-b1806d89d9d1 req-5031df4f-336a-4f1b-b313-c7b98404edb9 service nova] Acquired lock "refresh_cache-c88a5ff2-9789-4ee8-8283-6248bba6d66a" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 15:36:18 user nova-compute[72382]: DEBUG nova.network.neutron [req-8188eb89-ce61-4c15-9578-b1806d89d9d1 req-5031df4f-336a-4f1b-b313-c7b98404edb9 service nova] [instance: c88a5ff2-9789-4ee8-8283-6248bba6d66a] Refreshing network info cache for port 4f9e0eae-81c7-4a91-8ac1-51459e231532 {{(pid=72382) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 15:36:18 user nova-compute[72382]: INFO os_vif [None req-5309ba65-2937-4ecb-8972-be396630415c tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:aa:71,bridge_name='br-int',has_traffic_filtering=True,id=4f9e0eae-81c7-4a91-8ac1-51459e231532,network=Network(5f3f6e0f-94b3-4a66-9839-763a2e2d259c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f9e0eae-81')
Aug 09 15:36:18 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5309ba65-2937-4ecb-8972-be396630415c tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] [instance: c88a5ff2-9789-4ee8-8283-6248bba6d66a] calling os-brick to detach iSCSI Volume {{(pid=72382) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 15:36:18 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-5309ba65-2937-4ecb-8972-be396630415c tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2a0c768340>, {'target_iqns': ['iqn.2010-10.org.openstack:d2f5dbb5-f862-4389-b42a-872d5c94aa55'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JoLXOIMx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 15:36:18 user nova-compute[72382]: WARNING os_brick.initiator.connectors.base [None req-5309ba65-2937-4ecb-8972-be396630415c tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 15:36:18 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-5309ba65-2937-4ecb-8972-be396630415c tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 15:36:18 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-5309ba65-2937-4ecb-8972-be396630415c tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 15:36:18 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-5309ba65-2937-4ecb-8972-be396630415c tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d2f5dbb5-f862-4389-b42a-872d5c94aa55', 0)] {{(pid=72382) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 15:36:18 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:36:18 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:36:18 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[33e78b08-5026-49e9-a24f-3eed92361739]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a0a612d6-0f3f-4d2c-9fb5-aff9384338de\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d2f5dbb5-f862-4389-b42a-872d5c94aa55\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:36:18 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:36:18 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:36:18 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[d01979db-6a6b-4b4b-9c5b-4c0881c21b9d]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2f5dbb5-f862-4389-b42a-872d5c94aa55 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0a612d6-0f3f-4d2c-9fb5-aff9384338de (non-flash)\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:36:18 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-5309ba65-2937-4ecb-8972-be396630415c tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2f5dbb5-f862-4389-b42a-872d5c94aa55 (non-flash)
Aug 09 15:36:18 user nova-compute[72382]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0a612d6-0f3f-4d2c-9fb5-aff9384338de (non-flash)
Aug 09 15:36:18 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 15:36:18 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-5309ba65-2937-4ecb-8972-be396630415c tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2f5dbb5-f862-4389-b42a-872d5c94aa55 (non-flash)
Aug 09 15:36:18 user nova-compute[72382]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0a612d6-0f3f-4d2c-9fb5-aff9384338de (non-flash)
Aug 09 15:36:18 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 15:36:18 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-5309ba65-2937-4ecb-8972-be396630415c tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2a0c364430>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d2f5dbb5-f862-4389-b42a-872d5c94aa55'): ({'sdb'}, set())}) {{(pid=72382) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 15:36:18 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-5309ba65-2937-4ecb-8972-be396630415c tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] Removing single pathed devices sdb {{(pid=72382) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 15:36:18 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:36:18 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:36:18 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[c711a647-0dd6-4ac2-bc5d-484854058ee6]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:36:18 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:36:18 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.027s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:36:18 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7c786a1-196f-4b65-a001-15334ad39410]: (4, ('ok\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:36:18 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-5309ba65-2937-4ecb-8972-be396630415c tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] Flushing IO for device /dev/sdb {{(pid=72382) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 15:36:18 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:36:18 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:36:18 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[375cc416-74cd-42ee-9ab6-432b5cd959dd]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:36:18 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-5309ba65-2937-4ecb-8972-be396630415c tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72382) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 15:36:18 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:36:18 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.051s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:36:18 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c224e49-3e7e-48e2-9453-6709faa7a169]: (4, ('1', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:36:18 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-5309ba65-2937-4ecb-8972-be396630415c tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72382) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 15:36:18 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-5309ba65-2937-4ecb-8972-be396630415c tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] SCSI volumes sdb have been removed. {{(pid=72382) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 15:36:18 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-5309ba65-2937-4ecb-8972-be396630415c tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d2f5dbb5-f862-4389-b42a-872d5c94aa55')] {{(pid=72382) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 15:36:18 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2f5dbb5-f862-4389-b42a-872d5c94aa55 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:36:18 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2f5dbb5-f862-4389-b42a-872d5c94aa55 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:36:18 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cad307c-3d9b-46e2-bb39-4ec9ab451d39]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:36:18 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-5309ba65-2937-4ecb-8972-be396630415c tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:36:18 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2f5dbb5-f862-4389-b42a-872d5c94aa55 -p 172.16.0.220:3260 --logout {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:36:18 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2f5dbb5-f862-4389-b42a-872d5c94aa55 -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:36:18 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[83d5e7cf-9e8a-460b-803b-126bec5ec454]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:d2f5dbb5-f862-4389-b42a-872d5c94aa55, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:d2f5dbb5-f862-4389-b42a-872d5c94aa55, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:36:18 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-5309ba65-2937-4ecb-8972-be396630415c tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:d2f5dbb5-f862-4389-b42a-872d5c94aa55, portal: 172.16.0.220,3260]
Aug 09 15:36:18 user nova-compute[72382]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:d2f5dbb5-f862-4389-b42a-872d5c94aa55, portal: 172.16.0.220,3260] successful.
Aug 09 15:36:18 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:36:18 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2f5dbb5-f862-4389-b42a-872d5c94aa55 -p 172.16.0.220:3260 --op delete {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:36:18 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2f5dbb5-f862-4389-b42a-872d5c94aa55 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:36:18 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a1852ed-0606-4cf7-a04e-fa500e75e754]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:36:18 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-5309ba65-2937-4ecb-8972-be396630415c tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:36:18 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-5309ba65-2937-4ecb-8972-be396630415c tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.326s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 15:36:18 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-5309ba65-2937-4ecb-8972-be396630415c tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] <== disconnect_volume: return (328ms) None {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 15:36:18 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5309ba65-2937-4ecb-8972-be396630415c tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] [instance: c88a5ff2-9789-4ee8-8283-6248bba6d66a] Disconnected iSCSI Volume {{(pid=72382) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 15:36:18 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-5309ba65-2937-4ecb-8972-be396630415c tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] [instance: c88a5ff2-9789-4ee8-8283-6248bba6d66a] Deleting instance files /opt/stack/data/nova/instances/c88a5ff2-9789-4ee8-8283-6248bba6d66a_del
Aug 09 15:36:18 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-5309ba65-2937-4ecb-8972-be396630415c tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] [instance: c88a5ff2-9789-4ee8-8283-6248bba6d66a] Deletion of /opt/stack/data/nova/instances/c88a5ff2-9789-4ee8-8283-6248bba6d66a_del complete
Aug 09 15:36:18 user nova-compute[72382]: DEBUG nova.network.neutron [req-8188eb89-ce61-4c15-9578-b1806d89d9d1 req-5031df4f-336a-4f1b-b313-c7b98404edb9 service nova] [instance: c88a5ff2-9789-4ee8-8283-6248bba6d66a] Updated VIF entry in instance network info cache for port 4f9e0eae-81c7-4a91-8ac1-51459e231532. {{(pid=72382) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 15:36:18 user nova-compute[72382]: DEBUG nova.network.neutron [req-8188eb89-ce61-4c15-9578-b1806d89d9d1 req-5031df4f-336a-4f1b-b313-c7b98404edb9 service nova] [instance: c88a5ff2-9789-4ee8-8283-6248bba6d66a] Updating instance_info_cache with network_info: [{"id": "4f9e0eae-81c7-4a91-8ac1-51459e231532", "address": "fa:16:3e:b2:aa:71", "network": {"id": "5f3f6e0f-94b3-4a66-9839-763a2e2d259c", "bridge": null, "label": "tempest-TestShelveInstance-338163972-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "108a420b4c6e451d8429d21665e12fb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap4f9e0eae-81", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:36:18 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-8188eb89-ce61-4c15-9578-b1806d89d9d1 req-5031df4f-336a-4f1b-b313-c7b98404edb9 service nova] Releasing lock "refresh_cache-c88a5ff2-9789-4ee8-8283-6248bba6d66a" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 15:36:18 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:36:18 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:36:18 user nova-compute[72382]: DEBUG nova.compute.manager [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Starting heal instance info cache {{(pid=72382) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 15:36:18 user nova-compute[72382]: DEBUG nova.compute.manager [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Rebuilding the list of instances to heal {{(pid=72382) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 09 15:36:18 user nova-compute[72382]: DEBUG nova.compute.manager [req-6089e98c-d531-4fcb-ab0b-6ec8e162c55e req-093115da-427f-43a7-a2c9-891e6224f1ac service nova] [instance: c88a5ff2-9789-4ee8-8283-6248bba6d66a] Received event network-vif-plugged-4f9e0eae-81c7-4a91-8ac1-51459e231532 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:36:18 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-6089e98c-d531-4fcb-ab0b-6ec8e162c55e req-093115da-427f-43a7-a2c9-891e6224f1ac service nova] Acquiring lock "c88a5ff2-9789-4ee8-8283-6248bba6d66a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:36:18 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-6089e98c-d531-4fcb-ab0b-6ec8e162c55e req-093115da-427f-43a7-a2c9-891e6224f1ac service nova] Lock "c88a5ff2-9789-4ee8-8283-6248bba6d66a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:36:18 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-6089e98c-d531-4fcb-ab0b-6ec8e162c55e req-093115da-427f-43a7-a2c9-891e6224f1ac service nova] Lock "c88a5ff2-9789-4ee8-8283-6248bba6d66a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:36:19 user nova-compute[72382]: DEBUG nova.compute.manager [req-6089e98c-d531-4fcb-ab0b-6ec8e162c55e req-093115da-427f-43a7-a2c9-891e6224f1ac service nova] [instance: c88a5ff2-9789-4ee8-8283-6248bba6d66a] No waiting events found dispatching network-vif-plugged-4f9e0eae-81c7-4a91-8ac1-51459e231532 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:36:19 user nova-compute[72382]: WARNING nova.compute.manager [req-6089e98c-d531-4fcb-ab0b-6ec8e162c55e req-093115da-427f-43a7-a2c9-891e6224f1ac service nova] [instance: c88a5ff2-9789-4ee8-8283-6248bba6d66a] Received unexpected event network-vif-plugged-4f9e0eae-81c7-4a91-8ac1-51459e231532 for instance with vm_state active and task_state shelving.
Aug 09 15:36:19 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Acquiring lock "refresh_cache-4ccbfda2-8bcd-4ec1-972a-cf49a62b1583" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 15:36:19 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Acquired lock "refresh_cache-4ccbfda2-8bcd-4ec1-972a-cf49a62b1583" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 15:36:19 user nova-compute[72382]: DEBUG nova.network.neutron [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] [instance: 4ccbfda2-8bcd-4ec1-972a-cf49a62b1583] Forcefully refreshing network info cache for instance {{(pid=72382) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 15:36:19 user nova-compute[72382]: DEBUG nova.objects.instance [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lazy-loading 'info_cache' on Instance uuid 4ccbfda2-8bcd-4ec1-972a-cf49a62b1583 {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:36:19 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:36:19 user nova-compute[72382]: INFO nova.scheduler.client.report [None req-5309ba65-2937-4ecb-8972-be396630415c tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] Deleted allocations for instance c88a5ff2-9789-4ee8-8283-6248bba6d66a
Aug 09 15:36:19 user nova-compute[72382]: DEBUG nova.network.neutron [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] [instance: 4ccbfda2-8bcd-4ec1-972a-cf49a62b1583] Updating instance_info_cache with network_info: [{"id": "2d07e6a3-03b7-4035-bdd2-a95435b99852", "address": "fa:16:3e:9a:d4:3a", "network": {"id": "308641dc-cc18-41db-9baa-7cc880e594ad", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1932973397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb5bf3f95d2843af94dbcab2af932bd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d07e6a3-03", "ovs_interfaceid": "2d07e6a3-03b7-4035-bdd2-a95435b99852", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:36:20 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Releasing lock "refresh_cache-4ccbfda2-8bcd-4ec1-972a-cf49a62b1583" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 15:36:20 user nova-compute[72382]: DEBUG nova.compute.manager [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] [instance: 4ccbfda2-8bcd-4ec1-972a-cf49a62b1583] Updated the network info_cache for instance {{(pid=72382) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 15:36:20 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:36:20 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:36:20 user nova-compute[72382]: DEBUG nova.compute.manager [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72382) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 15:36:20 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:36:20 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-5309ba65-2937-4ecb-8972-be396630415c tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:36:20 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-5309ba65-2937-4ecb-8972-be396630415c tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:36:20 user nova-compute[72382]: DEBUG nova.objects.instance [None req-5309ba65-2937-4ecb-8972-be396630415c tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] Lazy-loading 'numa_topology' on Instance uuid c88a5ff2-9789-4ee8-8283-6248bba6d66a {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:36:20 user nova-compute[72382]: DEBUG nova.compute.provider_tree [None req-5309ba65-2937-4ecb-8972-be396630415c tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] Inventory has not changed in ProviderTree for provider: 7b15b0e5-df4d-49db-833b-2855d21d10ae {{(pid=72382) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 15:36:20 user nova-compute[72382]: DEBUG nova.scheduler.client.report [None req-5309ba65-2937-4ecb-8972-be396630415c tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] Inventory has not changed for provider 7b15b0e5-df4d-49db-833b-2855d21d10ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72382) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 15:36:20 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-5309ba65-2937-4ecb-8972-be396630415c tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.295s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:36:20 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-5309ba65-2937-4ecb-8972-be396630415c tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] Lock "c88a5ff2-9789-4ee8-8283-6248bba6d66a" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 4.014s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:36:20 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:36:20 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:36:20 user nova-compute[72382]: DEBUG nova.compute.manager [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Cleaning up deleted instances {{(pid=72382) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 09 15:36:20 user nova-compute[72382]: DEBUG nova.compute.manager [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] There are 0 instances to clean {{(pid=72382) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 09 15:36:21 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:36:21 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:36:23 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:36:23 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5c719caf-6212-408b-b165-4cebd51ea6f3 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] [instance: 429ebe93-dd7a-41c4-b80a-0379d3816402] Calling os-brick to attach iSCSI Volume {{(pid=72382) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 15:36:23 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c719caf-6212-408b-b165-4cebd51ea6f3 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2a0c768340>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:0550bae7-eb05-4964-8e51-43b5b93a29cb'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QEjrZvAJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 15:36:23 user nova-compute[72382]: WARNING os_brick.initiator.connectors.base [None req-5c719caf-6212-408b-b165-4cebd51ea6f3 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 15:36:23 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-5c719caf-6212-408b-b165-4cebd51ea6f3 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 15:36:23 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-5c719caf-6212-408b-b165-4cebd51ea6f3 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 15:36:23 user nova-compute[72382]: WARNING os_brick.initiator.connectors.base [None req-5c719caf-6212-408b-b165-4cebd51ea6f3 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 15:36:23 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-5c719caf-6212-408b-b165-4cebd51ea6f3 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0550bae7-eb05-4964-8e51-43b5b93a29cb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 15:36:23 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-5c719caf-6212-408b-b165-4cebd51ea6f3 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0550bae7-eb05-4964-8e51-43b5b93a29cb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 15:36:23 user nova-compute[72382]: INFO os_brick.initiator.connectors.iscsi [None req-5c719caf-6212-408b-b165-4cebd51ea6f3 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 15:36:23 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0550bae7-eb05-4964-8e51-43b5b93a29cb -p 172.16.0.220:3260 {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:36:23 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0550bae7-eb05-4964-8e51-43b5b93a29cb -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:36:23 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[da48efc1-db61-4807-b91d-dc2889b68d5b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:36:23 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c719caf-6212-408b-b165-4cebd51ea6f3 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 15:36:23 user nova-compute[72382]:  {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:36:23 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0550bae7-eb05-4964-8e51-43b5b93a29cb -p 172.16.0.220:3260 --interface default --op new {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:36:23 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0550bae7-eb05-4964-8e51-43b5b93a29cb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:36:23 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[547bb13b-359f-46ad-82bf-5be93f627db0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0550bae7-eb05-4964-8e51-43b5b93a29cb] added\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:36:23 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c719caf-6212-408b-b165-4cebd51ea6f3 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0550bae7-eb05-4964-8e51-43b5b93a29cb] added
Aug 09 15:36:23 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:36:23 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0550bae7-eb05-4964-8e51-43b5b93a29cb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:36:23 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0550bae7-eb05-4964-8e51-43b5b93a29cb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:36:23 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[390330d6-51d1-4028-aaa8-872a4bdecd68]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:36:23 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c719caf-6212-408b-b165-4cebd51ea6f3 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:36:23 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0550bae7-eb05-4964-8e51-43b5b93a29cb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:36:23 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0550bae7-eb05-4964-8e51-43b5b93a29cb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:36:23 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[df86df9d-2ab6-46a1-a16d-98742f04a364]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:36:23 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c719caf-6212-408b-b165-4cebd51ea6f3 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:36:23 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0550bae7-eb05-4964-8e51-43b5b93a29cb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QEjrZvAJ {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:36:23 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0550bae7-eb05-4964-8e51-43b5b93a29cb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QEjrZvAJ" returned: 0 in 0.025s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:36:23 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b34b913-5c20-4d5f-9084-664545da690e]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:36:23 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c719caf-6212-408b-b165-4cebd51ea6f3 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QEjrZvAJ'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:36:23 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0550bae7-eb05-4964-8e51-43b5b93a29cb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:36:23 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0550bae7-eb05-4964-8e51-43b5b93a29cb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:36:23 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[eab27470-1f3b-40cb-9638-3f863f2607b0]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:36:23 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c719caf-6212-408b-b165-4cebd51ea6f3 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:36:23 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:36:23 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:36:23 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e677907-7451-4231-971a-48988fac5254]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0a612d6-0f3f-4d2c-9fb5-aff9384338de (non-flash)\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:36:23 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c719caf-6212-408b-b165-4cebd51ea6f3 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0a612d6-0f3f-4d2c-9fb5-aff9384338de (non-flash)
Aug 09 15:36:23 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 15:36:23 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c719caf-6212-408b-b165-4cebd51ea6f3 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0a612d6-0f3f-4d2c-9fb5-aff9384338de (non-flash)
Aug 09 15:36:23 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 15:36:23 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0550bae7-eb05-4964-8e51-43b5b93a29cb -p 172.16.0.220:3260 --login {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:36:23 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0550bae7-eb05-4964-8e51-43b5b93a29cb -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:36:23 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[364eb43e-8585-4814-b790-f63e9670d8f5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0550bae7-eb05-4964-8e51-43b5b93a29cb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0550bae7-eb05-4964-8e51-43b5b93a29cb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:36:23 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c719caf-6212-408b-b165-4cebd51ea6f3 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0550bae7-eb05-4964-8e51-43b5b93a29cb, portal: 172.16.0.220,3260]
Aug 09 15:36:23 user nova-compute[72382]: Login to [iface: default, target: iqn.2010-10.org.openstack:0550bae7-eb05-4964-8e51-43b5b93a29cb, portal: 172.16.0.220,3260] successful.
Aug 09 15:36:23 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:36:23 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0550bae7-eb05-4964-8e51-43b5b93a29cb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:36:23 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0550bae7-eb05-4964-8e51-43b5b93a29cb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:36:23 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[d17f5522-5001-4e61-9726-4ab5843d04cf]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:36:23 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c719caf-6212-408b-b165-4cebd51ea6f3 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:36:23 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:36:24 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:36:24 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ae9366e-c738-4bfc-b8ad-27a1de9bde24]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0a612d6-0f3f-4d2c-9fb5-aff9384338de (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0550bae7-eb05-4964-8e51-43b5b93a29cb (non-flash)\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:36:24 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c719caf-6212-408b-b165-4cebd51ea6f3 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0a612d6-0f3f-4d2c-9fb5-aff9384338de (non-flash)
Aug 09 15:36:24 user nova-compute[72382]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0550bae7-eb05-4964-8e51-43b5b93a29cb (non-flash)
Aug 09 15:36:24 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 15:36:24 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c719caf-6212-408b-b165-4cebd51ea6f3 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0a612d6-0f3f-4d2c-9fb5-aff9384338de (non-flash)
Aug 09 15:36:24 user nova-compute[72382]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0550bae7-eb05-4964-8e51-43b5b93a29cb (non-flash)
Aug 09 15:36:24 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 15:36:24 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-5c719caf-6212-408b-b165-4cebd51ea6f3 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0550bae7-eb05-4964-8e51-43b5b93a29cb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.292s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 15:36:24 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c719caf-6212-408b-b165-4cebd51ea6f3 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Connected to 172.16.0.220:3260 {{(pid=72382) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 15:36:24 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-5c719caf-6212-408b-b165-4cebd51ea6f3 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] HCTL ('33', '-', '-', 0) found on session 47 with lun 0 {{(pid=72382) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 15:36:24 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-5c719caf-6212-408b-b165-4cebd51ea6f3 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72382) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 15:36:24 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:36:24 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:36:24 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f2dc63b-5ffa-4e9a-9d87-016abbef783a]: (4, ('- - 0', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:36:24 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-5c719caf-6212-408b-b165-4cebd51ea6f3 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Searching for a device in session 47 and hctl ['33', '*', '*', 0] yield: None {{(pid=72382) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 15:36:24 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:36:24 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:36:25 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-5c719caf-6212-408b-b165-4cebd51ea6f3 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Searching for a device in session 47 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72382) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 15:36:25 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c719caf-6212-408b-b165-4cebd51ea6f3 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QEjrZvAJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72382) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 15:36:25 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-5c719caf-6212-408b-b165-4cebd51ea6f3 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.321s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 15:36:25 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c719caf-6212-408b-b165-4cebd51ea6f3 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] <== connect_volume: return (1322ms) {'type': 'block', 'scsi_wwn': '23564326262616565', 'path': '/dev/sdb'} {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 15:36:25 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5c719caf-6212-408b-b165-4cebd51ea6f3 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] [instance: 429ebe93-dd7a-41c4-b80a-0379d3816402] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23564326262616565', 'path': '/dev/sdb'} {{(pid=72382) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 15:36:25 user nova-compute[72382]: DEBUG nova.objects.instance [None req-5c719caf-6212-408b-b165-4cebd51ea6f3 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Lazy-loading 'flavor' on Instance uuid 429ebe93-dd7a-41c4-b80a-0379d3816402 {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:36:25 user nova-compute[72382]: DEBUG nova.virt.libvirt.guest [None req-5c719caf-6212-408b-b165-4cebd51ea6f3 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 15:36:25 user nova-compute[72382]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 15:36:25 user nova-compute[72382]:   <source dev="/dev/sdb"/>
Aug 09 15:36:25 user nova-compute[72382]:   <target dev="vdb" bus="virtio"/>
Aug 09 15:36:25 user nova-compute[72382]:   <serial>0550bae7-eb05-4964-8e51-43b5b93a29cb</serial>
Aug 09 15:36:25 user nova-compute[72382]: </disk>
Aug 09 15:36:25 user nova-compute[72382]:  {{(pid=72382) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 15:36:25 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-5c719caf-6212-408b-b165-4cebd51ea6f3 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] No BDM found with device name vda, not building metadata. {{(pid=72382) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 15:36:25 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-5c719caf-6212-408b-b165-4cebd51ea6f3 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72382) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 15:36:25 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-5c719caf-6212-408b-b165-4cebd51ea6f3 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] No VIF found with MAC fa:16:3e:18:b4:42, not building metadata {{(pid=72382) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 15:36:25 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-5c719caf-6212-408b-b165-4cebd51ea6f3 tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Lock "429ebe93-dd7a-41c4-b80a-0379d3816402" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.789s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:36:26 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-f1cc887e-567d-416b-aa6f-f7c2251add4c tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Acquiring lock "429ebe93-dd7a-41c4-b80a-0379d3816402" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:36:26 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-f1cc887e-567d-416b-aa6f-f7c2251add4c tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Lock "429ebe93-dd7a-41c4-b80a-0379d3816402" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:36:26 user nova-compute[72382]: INFO nova.compute.manager [None req-f1cc887e-567d-416b-aa6f-f7c2251add4c tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] [instance: 429ebe93-dd7a-41c4-b80a-0379d3816402] Detaching volume 0550bae7-eb05-4964-8e51-43b5b93a29cb
Aug 09 15:36:27 user nova-compute[72382]: INFO nova.virt.block_device [None req-f1cc887e-567d-416b-aa6f-f7c2251add4c tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] [instance: 429ebe93-dd7a-41c4-b80a-0379d3816402] Attempting to driver detach volume 0550bae7-eb05-4964-8e51-43b5b93a29cb from mountpoint /dev/vdb
Aug 09 15:36:27 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-f1cc887e-567d-416b-aa6f-f7c2251add4c tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Attempting to detach device vdb from instance 429ebe93-dd7a-41c4-b80a-0379d3816402 from the persistent domain config. {{(pid=72382) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 15:36:27 user nova-compute[72382]: DEBUG nova.virt.libvirt.guest [None req-f1cc887e-567d-416b-aa6f-f7c2251add4c tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 15:36:27 user nova-compute[72382]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 15:36:27 user nova-compute[72382]:   <source dev="/dev/sdb"/>
Aug 09 15:36:27 user nova-compute[72382]:   <target dev="vdb" bus="virtio"/>
Aug 09 15:36:27 user nova-compute[72382]:   <serial>0550bae7-eb05-4964-8e51-43b5b93a29cb</serial>
Aug 09 15:36:27 user nova-compute[72382]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 15:36:27 user nova-compute[72382]: </disk>
Aug 09 15:36:27 user nova-compute[72382]:  {{(pid=72382) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 15:36:27 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-f1cc887e-567d-416b-aa6f-f7c2251add4c tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Successfully detached device vdb from instance 429ebe93-dd7a-41c4-b80a-0379d3816402 from the persistent domain config.
Aug 09 15:36:27 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-f1cc887e-567d-416b-aa6f-f7c2251add4c tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 429ebe93-dd7a-41c4-b80a-0379d3816402 from the live domain config. {{(pid=72382) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 15:36:27 user nova-compute[72382]: DEBUG nova.virt.libvirt.guest [None req-f1cc887e-567d-416b-aa6f-f7c2251add4c tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 15:36:27 user nova-compute[72382]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 15:36:27 user nova-compute[72382]:   <source dev="/dev/sdb"/>
Aug 09 15:36:27 user nova-compute[72382]:   <target dev="vdb" bus="virtio"/>
Aug 09 15:36:27 user nova-compute[72382]:   <serial>0550bae7-eb05-4964-8e51-43b5b93a29cb</serial>
Aug 09 15:36:27 user nova-compute[72382]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 15:36:27 user nova-compute[72382]: </disk>
Aug 09 15:36:27 user nova-compute[72382]:  {{(pid=72382) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 15:36:27 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Received event <DeviceRemovedEvent: 1691595387.531463, 429ebe93-dd7a-41c4-b80a-0379d3816402 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72382) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 15:36:27 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-f1cc887e-567d-416b-aa6f-f7c2251add4c tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 429ebe93-dd7a-41c4-b80a-0379d3816402 {{(pid=72382) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 15:36:27 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-f1cc887e-567d-416b-aa6f-f7c2251add4c tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Successfully detached device vdb from instance 429ebe93-dd7a-41c4-b80a-0379d3816402 from the live domain config.
Aug 09 15:36:27 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f1cc887e-567d-416b-aa6f-f7c2251add4c tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] [instance: 429ebe93-dd7a-41c4-b80a-0379d3816402] calling os-brick to detach iSCSI Volume {{(pid=72382) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 15:36:27 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1cc887e-567d-416b-aa6f-f7c2251add4c tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2a0c768340>, {'target_iqns': ['iqn.2010-10.org.openstack:0550bae7-eb05-4964-8e51-43b5b93a29cb'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QEjrZvAJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 15:36:27 user nova-compute[72382]: WARNING os_brick.initiator.connectors.base [None req-f1cc887e-567d-416b-aa6f-f7c2251add4c tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 15:36:27 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-f1cc887e-567d-416b-aa6f-f7c2251add4c tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 15:36:27 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-f1cc887e-567d-416b-aa6f-f7c2251add4c tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 15:36:27 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1cc887e-567d-416b-aa6f-f7c2251add4c tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0550bae7-eb05-4964-8e51-43b5b93a29cb', 0)] {{(pid=72382) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 15:36:27 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:36:27 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:36:27 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[e780c076-1618-48d9-a42b-014a80fe54bc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0550bae7-eb05-4964-8e51-43b5b93a29cb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a0a612d6-0f3f-4d2c-9fb5-aff9384338de\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:36:27 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:36:27 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:36:27 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[45fbbef5-ea35-4b1e-9647-6ac25cbeea54]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0a612d6-0f3f-4d2c-9fb5-aff9384338de (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0550bae7-eb05-4964-8e51-43b5b93a29cb (non-flash)\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:36:27 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1cc887e-567d-416b-aa6f-f7c2251add4c tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0a612d6-0f3f-4d2c-9fb5-aff9384338de (non-flash)
Aug 09 15:36:27 user nova-compute[72382]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0550bae7-eb05-4964-8e51-43b5b93a29cb (non-flash)
Aug 09 15:36:27 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 15:36:27 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1cc887e-567d-416b-aa6f-f7c2251add4c tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0a612d6-0f3f-4d2c-9fb5-aff9384338de (non-flash)
Aug 09 15:36:27 user nova-compute[72382]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0550bae7-eb05-4964-8e51-43b5b93a29cb (non-flash)
Aug 09 15:36:27 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 15:36:27 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1cc887e-567d-416b-aa6f-f7c2251add4c tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2a0c366950>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0550bae7-eb05-4964-8e51-43b5b93a29cb'): ({'sdb'}, set())}) {{(pid=72382) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 15:36:27 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-f1cc887e-567d-416b-aa6f-f7c2251add4c tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Removing single pathed devices sdb {{(pid=72382) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 15:36:27 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:36:27 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:36:27 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8854be4-57f2-4503-86cb-277ce55ad8b0]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:36:27 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:36:27 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:36:27 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c21a1c8-989a-4fd3-9df6-5f3a5a425c5a]: (4, ('ok\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:36:27 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-f1cc887e-567d-416b-aa6f-f7c2251add4c tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Flushing IO for device /dev/sdb {{(pid=72382) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 15:36:27 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:36:27 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:36:27 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aef802a-58d1-4d75-82e3-fd3c78f44d69]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:36:27 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-f1cc887e-567d-416b-aa6f-f7c2251add4c tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72382) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 15:36:27 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:36:27 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.051s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:36:27 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[135830ae-c691-447d-ab13-7230007bc3bf]: (4, ('1', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:36:27 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-f1cc887e-567d-416b-aa6f-f7c2251add4c tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72382) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 15:36:27 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-f1cc887e-567d-416b-aa6f-f7c2251add4c tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] SCSI volumes sdb have been removed. {{(pid=72382) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 15:36:27 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1cc887e-567d-416b-aa6f-f7c2251add4c tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0550bae7-eb05-4964-8e51-43b5b93a29cb')] {{(pid=72382) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 15:36:27 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0550bae7-eb05-4964-8e51-43b5b93a29cb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:36:27 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0550bae7-eb05-4964-8e51-43b5b93a29cb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:36:27 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[643cf4eb-755a-453e-ae25-d09090c64434]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:36:27 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1cc887e-567d-416b-aa6f-f7c2251add4c tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:36:27 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0550bae7-eb05-4964-8e51-43b5b93a29cb -p 172.16.0.220:3260 --logout {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:36:27 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0550bae7-eb05-4964-8e51-43b5b93a29cb -p 172.16.0.220:3260 --logout" returned: 0 in 0.048s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:36:27 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[073af436-b4eb-488c-85df-2163472c1e04]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:0550bae7-eb05-4964-8e51-43b5b93a29cb, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:0550bae7-eb05-4964-8e51-43b5b93a29cb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:36:27 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1cc887e-567d-416b-aa6f-f7c2251add4c tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:0550bae7-eb05-4964-8e51-43b5b93a29cb, portal: 172.16.0.220,3260]
Aug 09 15:36:27 user nova-compute[72382]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:0550bae7-eb05-4964-8e51-43b5b93a29cb, portal: 172.16.0.220,3260] successful.
Aug 09 15:36:27 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:36:27 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0550bae7-eb05-4964-8e51-43b5b93a29cb -p 172.16.0.220:3260 --op delete {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:36:27 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0550bae7-eb05-4964-8e51-43b5b93a29cb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:36:27 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c472649-dceb-4a06-a50e-a7738a1562f7]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:36:27 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1cc887e-567d-416b-aa6f-f7c2251add4c tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:36:27 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-f1cc887e-567d-416b-aa6f-f7c2251add4c tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.292s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 15:36:27 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1cc887e-567d-416b-aa6f-f7c2251add4c tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] <== disconnect_volume: return (294ms) None {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 15:36:27 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f1cc887e-567d-416b-aa6f-f7c2251add4c tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] [instance: 429ebe93-dd7a-41c4-b80a-0379d3816402] Disconnected iSCSI Volume {{(pid=72382) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 15:36:28 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:36:28 user nova-compute[72382]: DEBUG nova.objects.instance [None req-f1cc887e-567d-416b-aa6f-f7c2251add4c tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Lazy-loading 'flavor' on Instance uuid 429ebe93-dd7a-41c4-b80a-0379d3816402 {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:36:28 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-f1cc887e-567d-416b-aa6f-f7c2251add4c tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Lock "429ebe93-dd7a-41c4-b80a-0379d3816402" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.634s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:36:29 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:36:29 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:36:29 user nova-compute[72382]: DEBUG nova.compute.manager [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Cleaning up deleted instances with incomplete migration  {{(pid=72382) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 09 15:36:30 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:36:32 user nova-compute[72382]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691595377.2528057, c88a5ff2-9789-4ee8-8283-6248bba6d66a => Stopped> {{(pid=72382) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 15:36:32 user nova-compute[72382]: INFO nova.compute.manager [-] [instance: c88a5ff2-9789-4ee8-8283-6248bba6d66a] VM Stopped (Lifecycle Event)
Aug 09 15:36:32 user nova-compute[72382]: DEBUG nova.compute.manager [None req-c815e75b-6438-4048-9c32-c6a623d47835 None None] [instance: c88a5ff2-9789-4ee8-8283-6248bba6d66a] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:36:33 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:36:34 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:36:38 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:36:39 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:36:40 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:36:42 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:36:43 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-f624cbc3-5994-47b0-a206-2870fbe56bba tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Acquiring lock "2158de7a-1e53-450a-80de-a5c56844feba" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:36:43 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-f624cbc3-5994-47b0-a206-2870fbe56bba tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Lock "2158de7a-1e53-450a-80de-a5c56844feba" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:36:43 user nova-compute[72382]: DEBUG nova.compute.manager [None req-f624cbc3-5994-47b0-a206-2870fbe56bba tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: 2158de7a-1e53-450a-80de-a5c56844feba] Starting instance... {{(pid=72382) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 15:36:43 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:36:43 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-f624cbc3-5994-47b0-a206-2870fbe56bba tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:36:43 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-f624cbc3-5994-47b0-a206-2870fbe56bba tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:36:43 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-f624cbc3-5994-47b0-a206-2870fbe56bba tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72382) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 15:36:43 user nova-compute[72382]: INFO nova.compute.claims [None req-f624cbc3-5994-47b0-a206-2870fbe56bba tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: 2158de7a-1e53-450a-80de-a5c56844feba] Claim successful on node user
Aug 09 15:36:43 user nova-compute[72382]: DEBUG nova.scheduler.client.report [None req-f624cbc3-5994-47b0-a206-2870fbe56bba tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Refreshing inventories for resource provider 7b15b0e5-df4d-49db-833b-2855d21d10ae {{(pid=72382) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 09 15:36:43 user nova-compute[72382]: DEBUG nova.scheduler.client.report [None req-f624cbc3-5994-47b0-a206-2870fbe56bba tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Updating ProviderTree inventory for provider 7b15b0e5-df4d-49db-833b-2855d21d10ae from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72382) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 09 15:36:43 user nova-compute[72382]: DEBUG nova.compute.provider_tree [None req-f624cbc3-5994-47b0-a206-2870fbe56bba tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Updating inventory in ProviderTree for provider 7b15b0e5-df4d-49db-833b-2855d21d10ae with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72382) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 09 15:36:43 user nova-compute[72382]: DEBUG nova.scheduler.client.report [None req-f624cbc3-5994-47b0-a206-2870fbe56bba tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Refreshing aggregate associations for resource provider 7b15b0e5-df4d-49db-833b-2855d21d10ae, aggregates: None {{(pid=72382) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 09 15:36:43 user nova-compute[72382]: DEBUG nova.scheduler.client.report [None req-f624cbc3-5994-47b0-a206-2870fbe56bba tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Refreshing trait associations for resource provider 7b15b0e5-df4d-49db-833b-2855d21d10ae, traits: COMPUTE_DEVICE_TAGGING,COMPUTE_NODE,COMPUTE_VOLUME_EXTEND,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE42,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_MMX,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE2 {{(pid=72382) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 09 15:36:43 user nova-compute[72382]: DEBUG nova.compute.provider_tree [None req-f624cbc3-5994-47b0-a206-2870fbe56bba tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Inventory has not changed in ProviderTree for provider: 7b15b0e5-df4d-49db-833b-2855d21d10ae {{(pid=72382) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 15:36:43 user nova-compute[72382]: DEBUG nova.scheduler.client.report [None req-f624cbc3-5994-47b0-a206-2870fbe56bba tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Inventory has not changed for provider 7b15b0e5-df4d-49db-833b-2855d21d10ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72382) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 15:36:43 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-f624cbc3-5994-47b0-a206-2870fbe56bba tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.426s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:36:43 user nova-compute[72382]: DEBUG nova.compute.manager [None req-f624cbc3-5994-47b0-a206-2870fbe56bba tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: 2158de7a-1e53-450a-80de-a5c56844feba] Start building networks asynchronously for instance. {{(pid=72382) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 15:36:43 user nova-compute[72382]: DEBUG nova.compute.manager [None req-f624cbc3-5994-47b0-a206-2870fbe56bba tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: 2158de7a-1e53-450a-80de-a5c56844feba] Allocating IP information in the background. {{(pid=72382) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 15:36:43 user nova-compute[72382]: DEBUG nova.network.neutron [None req-f624cbc3-5994-47b0-a206-2870fbe56bba tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: 2158de7a-1e53-450a-80de-a5c56844feba] allocate_for_instance() {{(pid=72382) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 15:36:43 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-f624cbc3-5994-47b0-a206-2870fbe56bba tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: 2158de7a-1e53-450a-80de-a5c56844feba] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 15:36:43 user nova-compute[72382]: DEBUG nova.compute.manager [None req-f624cbc3-5994-47b0-a206-2870fbe56bba tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: 2158de7a-1e53-450a-80de-a5c56844feba] Start building block device mappings for instance. {{(pid=72382) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 15:36:44 user nova-compute[72382]: INFO nova.virt.block_device [None req-f624cbc3-5994-47b0-a206-2870fbe56bba tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: 2158de7a-1e53-450a-80de-a5c56844feba] Booting with volume 3f58579c-f69a-4bee-b16e-970e5a8f590c at /dev/vda
Aug 09 15:36:44 user nova-compute[72382]: DEBUG nova.policy [None req-f624cbc3-5994-47b0-a206-2870fbe56bba tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '280bcf2afd7245a7bcd605e0db79c569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70310b1af40b4d239fe5ea362972554b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72382) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 15:36:44 user nova-compute[72382]: DEBUG os_brick.utils [None req-f624cbc3-5994-47b0-a206-2870fbe56bba tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 15:36:44 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:36:44 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:36:44 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbbe6c0f-0324-4be8-99de-fcfe8b9b4940]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d2cfa7015fe\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:36:44 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:36:44 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:36:44 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[67de1249-41fa-40cc-9365-ad8ab2d6797f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:36:44 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:36:44 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:36:44 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[a02b6d49-24dd-4b67-9e4e-9894e2d61965]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:36:44 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[974a5793-6c8c-4676-acba-05fcf0485a0a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:36:44 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-f624cbc3-5994-47b0-a206-2870fbe56bba tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Running cmd (subprocess): nvme version {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:36:44 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-f624cbc3-5994-47b0-a206-2870fbe56bba tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] 'nvme version' failed. Not Retrying. {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 15:36:44 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f624cbc3-5994-47b0-a206-2870fbe56bba tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] nvme not present on system {{(pid=72382) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 15:36:44 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:36:44 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 15:36:44 user nova-compute[72382]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 15:36:44 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[0382b37c-e7d5-4a9b-885f-0ac5d953622e]: (4, '') {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:36:44 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.lightos [None req-f624cbc3-5994-47b0-a206-2870fbe56bba tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72382) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 15:36:44 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.lightos [None req-f624cbc3-5994-47b0-a206-2870fbe56bba tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72382) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 15:36:44 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.lightos [None req-f624cbc3-5994-47b0-a206-2870fbe56bba tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] LIGHTOS: no hostnqn found. {{(pid=72382) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 15:36:44 user nova-compute[72382]: DEBUG os_brick.utils [None req-f624cbc3-5994-47b0-a206-2870fbe56bba tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d2cfa7015fe', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 15:36:44 user nova-compute[72382]: DEBUG nova.virt.block_device [None req-f624cbc3-5994-47b0-a206-2870fbe56bba tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: 2158de7a-1e53-450a-80de-a5c56844feba] Updating existing volume attachment record: 911e3577-e2a1-47b5-8efd-69baacc739bd {{(pid=72382) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 15:36:44 user nova-compute[72382]: DEBUG nova.network.neutron [None req-f624cbc3-5994-47b0-a206-2870fbe56bba tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: 2158de7a-1e53-450a-80de-a5c56844feba] Successfully created port: 8fc3cbf4-d7ef-434b-a7b5-b611e919b364 {{(pid=72382) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 15:36:44 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:36:45 user nova-compute[72382]: DEBUG nova.network.neutron [None req-f624cbc3-5994-47b0-a206-2870fbe56bba tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: 2158de7a-1e53-450a-80de-a5c56844feba] Successfully updated port: 8fc3cbf4-d7ef-434b-a7b5-b611e919b364 {{(pid=72382) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 15:36:45 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-f624cbc3-5994-47b0-a206-2870fbe56bba tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Acquiring lock "refresh_cache-2158de7a-1e53-450a-80de-a5c56844feba" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 15:36:45 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-f624cbc3-5994-47b0-a206-2870fbe56bba tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Acquired lock "refresh_cache-2158de7a-1e53-450a-80de-a5c56844feba" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 15:36:45 user nova-compute[72382]: DEBUG nova.network.neutron [None req-f624cbc3-5994-47b0-a206-2870fbe56bba tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: 2158de7a-1e53-450a-80de-a5c56844feba] Building network info cache for instance {{(pid=72382) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 15:36:45 user nova-compute[72382]: DEBUG nova.compute.manager [req-e68b7c9c-59da-4f21-8eb0-c8f47ea93a43 req-65a7a57b-fc67-4954-aeb9-ea0090c5b88f service nova] [instance: 2158de7a-1e53-450a-80de-a5c56844feba] Received event network-changed-8fc3cbf4-d7ef-434b-a7b5-b611e919b364 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:36:45 user nova-compute[72382]: DEBUG nova.compute.manager [req-e68b7c9c-59da-4f21-8eb0-c8f47ea93a43 req-65a7a57b-fc67-4954-aeb9-ea0090c5b88f service nova] [instance: 2158de7a-1e53-450a-80de-a5c56844feba] Refreshing instance network info cache due to event network-changed-8fc3cbf4-d7ef-434b-a7b5-b611e919b364. {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 15:36:45 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-e68b7c9c-59da-4f21-8eb0-c8f47ea93a43 req-65a7a57b-fc67-4954-aeb9-ea0090c5b88f service nova] Acquiring lock "refresh_cache-2158de7a-1e53-450a-80de-a5c56844feba" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 15:36:45 user nova-compute[72382]: DEBUG nova.network.neutron [None req-f624cbc3-5994-47b0-a206-2870fbe56bba tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: 2158de7a-1e53-450a-80de-a5c56844feba] Instance cache missing network info. {{(pid=72382) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 15:36:45 user nova-compute[72382]: DEBUG nova.network.neutron [None req-f624cbc3-5994-47b0-a206-2870fbe56bba tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: 2158de7a-1e53-450a-80de-a5c56844feba] Updating instance_info_cache with network_info: [{"id": "8fc3cbf4-d7ef-434b-a7b5-b611e919b364", "address": "fa:16:3e:c5:f7:64", "network": {"id": "a78e6cb6-feb7-4f64-a3c0-4900594b6e37", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-338007968-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70310b1af40b4d239fe5ea362972554b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fc3cbf4-d7", "ovs_interfaceid": "8fc3cbf4-d7ef-434b-a7b5-b611e919b364", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:36:45 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-f624cbc3-5994-47b0-a206-2870fbe56bba tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Releasing lock "refresh_cache-2158de7a-1e53-450a-80de-a5c56844feba" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 15:36:45 user nova-compute[72382]: DEBUG nova.compute.manager [None req-f624cbc3-5994-47b0-a206-2870fbe56bba tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: 2158de7a-1e53-450a-80de-a5c56844feba] Instance network_info: |[{"id": "8fc3cbf4-d7ef-434b-a7b5-b611e919b364", "address": "fa:16:3e:c5:f7:64", "network": {"id": "a78e6cb6-feb7-4f64-a3c0-4900594b6e37", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-338007968-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70310b1af40b4d239fe5ea362972554b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fc3cbf4-d7", "ovs_interfaceid": "8fc3cbf4-d7ef-434b-a7b5-b611e919b364", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72382) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 15:36:45 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-e68b7c9c-59da-4f21-8eb0-c8f47ea93a43 req-65a7a57b-fc67-4954-aeb9-ea0090c5b88f service nova] Acquired lock "refresh_cache-2158de7a-1e53-450a-80de-a5c56844feba" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 15:36:45 user nova-compute[72382]: DEBUG nova.network.neutron [req-e68b7c9c-59da-4f21-8eb0-c8f47ea93a43 req-65a7a57b-fc67-4954-aeb9-ea0090c5b88f service nova] [instance: 2158de7a-1e53-450a-80de-a5c56844feba] Refreshing network info cache for port 8fc3cbf4-d7ef-434b-a7b5-b611e919b364 {{(pid=72382) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 15:36:46 user nova-compute[72382]: DEBUG nova.network.neutron [req-e68b7c9c-59da-4f21-8eb0-c8f47ea93a43 req-65a7a57b-fc67-4954-aeb9-ea0090c5b88f service nova] [instance: 2158de7a-1e53-450a-80de-a5c56844feba] Updated VIF entry in instance network info cache for port 8fc3cbf4-d7ef-434b-a7b5-b611e919b364. {{(pid=72382) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 15:36:46 user nova-compute[72382]: DEBUG nova.network.neutron [req-e68b7c9c-59da-4f21-8eb0-c8f47ea93a43 req-65a7a57b-fc67-4954-aeb9-ea0090c5b88f service nova] [instance: 2158de7a-1e53-450a-80de-a5c56844feba] Updating instance_info_cache with network_info: [{"id": "8fc3cbf4-d7ef-434b-a7b5-b611e919b364", "address": "fa:16:3e:c5:f7:64", "network": {"id": "a78e6cb6-feb7-4f64-a3c0-4900594b6e37", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-338007968-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70310b1af40b4d239fe5ea362972554b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fc3cbf4-d7", "ovs_interfaceid": "8fc3cbf4-d7ef-434b-a7b5-b611e919b364", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:36:46 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-e68b7c9c-59da-4f21-8eb0-c8f47ea93a43 req-65a7a57b-fc67-4954-aeb9-ea0090c5b88f service nova] Releasing lock "refresh_cache-2158de7a-1e53-450a-80de-a5c56844feba" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 15:36:47 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-8b51d6ce-08a9-4329-8073-87d9af306a7e tempest-VolumesActionsTest-1154417962 tempest-VolumesActionsTest-1154417962-project-member] Acquiring lock "5607360c-5f17-42b3-a373-6a33a183f92f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:36:47 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-8b51d6ce-08a9-4329-8073-87d9af306a7e tempest-VolumesActionsTest-1154417962 tempest-VolumesActionsTest-1154417962-project-member] Lock "5607360c-5f17-42b3-a373-6a33a183f92f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:36:47 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8b51d6ce-08a9-4329-8073-87d9af306a7e tempest-VolumesActionsTest-1154417962 tempest-VolumesActionsTest-1154417962-project-member] [instance: 5607360c-5f17-42b3-a373-6a33a183f92f] Starting instance... {{(pid=72382) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 15:36:47 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-8b51d6ce-08a9-4329-8073-87d9af306a7e tempest-VolumesActionsTest-1154417962 tempest-VolumesActionsTest-1154417962-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:36:47 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-8b51d6ce-08a9-4329-8073-87d9af306a7e tempest-VolumesActionsTest-1154417962 tempest-VolumesActionsTest-1154417962-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:36:47 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-8b51d6ce-08a9-4329-8073-87d9af306a7e tempest-VolumesActionsTest-1154417962 tempest-VolumesActionsTest-1154417962-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72382) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 15:36:47 user nova-compute[72382]: INFO nova.compute.claims [None req-8b51d6ce-08a9-4329-8073-87d9af306a7e tempest-VolumesActionsTest-1154417962 tempest-VolumesActionsTest-1154417962-project-member] [instance: 5607360c-5f17-42b3-a373-6a33a183f92f] Claim successful on node user
Aug 09 15:36:47 user nova-compute[72382]: DEBUG nova.compute.provider_tree [None req-8b51d6ce-08a9-4329-8073-87d9af306a7e tempest-VolumesActionsTest-1154417962 tempest-VolumesActionsTest-1154417962-project-member] Inventory has not changed in ProviderTree for provider: 7b15b0e5-df4d-49db-833b-2855d21d10ae {{(pid=72382) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 15:36:47 user nova-compute[72382]: DEBUG nova.scheduler.client.report [None req-8b51d6ce-08a9-4329-8073-87d9af306a7e tempest-VolumesActionsTest-1154417962 tempest-VolumesActionsTest-1154417962-project-member] Inventory has not changed for provider 7b15b0e5-df4d-49db-833b-2855d21d10ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72382) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 15:36:47 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-8b51d6ce-08a9-4329-8073-87d9af306a7e tempest-VolumesActionsTest-1154417962 tempest-VolumesActionsTest-1154417962-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.577s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:36:47 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8b51d6ce-08a9-4329-8073-87d9af306a7e tempest-VolumesActionsTest-1154417962 tempest-VolumesActionsTest-1154417962-project-member] [instance: 5607360c-5f17-42b3-a373-6a33a183f92f] Start building networks asynchronously for instance. {{(pid=72382) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 15:36:47 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8b51d6ce-08a9-4329-8073-87d9af306a7e tempest-VolumesActionsTest-1154417962 tempest-VolumesActionsTest-1154417962-project-member] [instance: 5607360c-5f17-42b3-a373-6a33a183f92f] Allocating IP information in the background. {{(pid=72382) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 15:36:47 user nova-compute[72382]: DEBUG nova.network.neutron [None req-8b51d6ce-08a9-4329-8073-87d9af306a7e tempest-VolumesActionsTest-1154417962 tempest-VolumesActionsTest-1154417962-project-member] [instance: 5607360c-5f17-42b3-a373-6a33a183f92f] allocate_for_instance() {{(pid=72382) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 15:36:47 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-8b51d6ce-08a9-4329-8073-87d9af306a7e tempest-VolumesActionsTest-1154417962 tempest-VolumesActionsTest-1154417962-project-member] [instance: 5607360c-5f17-42b3-a373-6a33a183f92f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 15:36:47 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8b51d6ce-08a9-4329-8073-87d9af306a7e tempest-VolumesActionsTest-1154417962 tempest-VolumesActionsTest-1154417962-project-member] [instance: 5607360c-5f17-42b3-a373-6a33a183f92f] Start building block device mappings for instance. {{(pid=72382) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 15:36:48 user nova-compute[72382]: DEBUG nova.policy [None req-8b51d6ce-08a9-4329-8073-87d9af306a7e tempest-VolumesActionsTest-1154417962 tempest-VolumesActionsTest-1154417962-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a780bb50b3d54386b8ed790da8a6cbea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7bd7707b7d84acdb15e5f89b6720ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72382) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 15:36:48 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8b51d6ce-08a9-4329-8073-87d9af306a7e tempest-VolumesActionsTest-1154417962 tempest-VolumesActionsTest-1154417962-project-member] [instance: 5607360c-5f17-42b3-a373-6a33a183f92f] Start spawning the instance on the hypervisor. {{(pid=72382) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 15:36:48 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-8b51d6ce-08a9-4329-8073-87d9af306a7e tempest-VolumesActionsTest-1154417962 tempest-VolumesActionsTest-1154417962-project-member] [instance: 5607360c-5f17-42b3-a373-6a33a183f92f] Creating instance directory {{(pid=72382) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 15:36:48 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-8b51d6ce-08a9-4329-8073-87d9af306a7e tempest-VolumesActionsTest-1154417962 tempest-VolumesActionsTest-1154417962-project-member] [instance: 5607360c-5f17-42b3-a373-6a33a183f92f] Creating image(s)
Aug 09 15:36:48 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-8b51d6ce-08a9-4329-8073-87d9af306a7e tempest-VolumesActionsTest-1154417962 tempest-VolumesActionsTest-1154417962-project-member] Acquiring lock "/opt/stack/data/nova/instances/5607360c-5f17-42b3-a373-6a33a183f92f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:36:48 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-8b51d6ce-08a9-4329-8073-87d9af306a7e tempest-VolumesActionsTest-1154417962 tempest-VolumesActionsTest-1154417962-project-member] Lock "/opt/stack/data/nova/instances/5607360c-5f17-42b3-a373-6a33a183f92f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:36:48 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-8b51d6ce-08a9-4329-8073-87d9af306a7e tempest-VolumesActionsTest-1154417962 tempest-VolumesActionsTest-1154417962-project-member] Lock "/opt/stack/data/nova/instances/5607360c-5f17-42b3-a373-6a33a183f92f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:36:48 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-8b51d6ce-08a9-4329-8073-87d9af306a7e tempest-VolumesActionsTest-1154417962 tempest-VolumesActionsTest-1154417962-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:36:48 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-8b51d6ce-08a9-4329-8073-87d9af306a7e tempest-VolumesActionsTest-1154417962 tempest-VolumesActionsTest-1154417962-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b --force-share --output=json" returned: 0 in 0.137s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:36:48 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-8b51d6ce-08a9-4329-8073-87d9af306a7e tempest-VolumesActionsTest-1154417962 tempest-VolumesActionsTest-1154417962-project-member] Acquiring lock "383812ff437283e0191ed5b9ecc04c27f1162b0b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:36:48 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-8b51d6ce-08a9-4329-8073-87d9af306a7e tempest-VolumesActionsTest-1154417962 tempest-VolumesActionsTest-1154417962-project-member] Lock "383812ff437283e0191ed5b9ecc04c27f1162b0b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:36:48 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-8b51d6ce-08a9-4329-8073-87d9af306a7e tempest-VolumesActionsTest-1154417962 tempest-VolumesActionsTest-1154417962-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:36:48 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-8b51d6ce-08a9-4329-8073-87d9af306a7e tempest-VolumesActionsTest-1154417962 tempest-VolumesActionsTest-1154417962-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b --force-share --output=json" returned: 0 in 0.142s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:36:48 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-8b51d6ce-08a9-4329-8073-87d9af306a7e tempest-VolumesActionsTest-1154417962 tempest-VolumesActionsTest-1154417962-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b,backing_fmt=raw /opt/stack/data/nova/instances/5607360c-5f17-42b3-a373-6a33a183f92f/disk 1073741824 {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:36:48 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:36:48 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-8b51d6ce-08a9-4329-8073-87d9af306a7e tempest-VolumesActionsTest-1154417962 tempest-VolumesActionsTest-1154417962-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b,backing_fmt=raw /opt/stack/data/nova/instances/5607360c-5f17-42b3-a373-6a33a183f92f/disk 1073741824" returned: 0 in 0.051s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:36:48 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-8b51d6ce-08a9-4329-8073-87d9af306a7e tempest-VolumesActionsTest-1154417962 tempest-VolumesActionsTest-1154417962-project-member] Lock "383812ff437283e0191ed5b9ecc04c27f1162b0b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.200s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:36:48 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-8b51d6ce-08a9-4329-8073-87d9af306a7e tempest-VolumesActionsTest-1154417962 tempest-VolumesActionsTest-1154417962-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:36:48 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-8b51d6ce-08a9-4329-8073-87d9af306a7e tempest-VolumesActionsTest-1154417962 tempest-VolumesActionsTest-1154417962-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b --force-share --output=json" returned: 0 in 0.138s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:36:48 user nova-compute[72382]: DEBUG nova.virt.disk.api [None req-8b51d6ce-08a9-4329-8073-87d9af306a7e tempest-VolumesActionsTest-1154417962 tempest-VolumesActionsTest-1154417962-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5607360c-5f17-42b3-a373-6a33a183f92f/disk. size=1073741824 {{(pid=72382) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 15:36:48 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-8b51d6ce-08a9-4329-8073-87d9af306a7e tempest-VolumesActionsTest-1154417962 tempest-VolumesActionsTest-1154417962-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5607360c-5f17-42b3-a373-6a33a183f92f/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:36:48 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-8b51d6ce-08a9-4329-8073-87d9af306a7e tempest-VolumesActionsTest-1154417962 tempest-VolumesActionsTest-1154417962-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5607360c-5f17-42b3-a373-6a33a183f92f/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:36:48 user nova-compute[72382]: DEBUG nova.virt.disk.api [None req-8b51d6ce-08a9-4329-8073-87d9af306a7e tempest-VolumesActionsTest-1154417962 tempest-VolumesActionsTest-1154417962-project-member] Cannot resize image /opt/stack/data/nova/instances/5607360c-5f17-42b3-a373-6a33a183f92f/disk to a smaller size. {{(pid=72382) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 15:36:48 user nova-compute[72382]: DEBUG nova.objects.instance [None req-8b51d6ce-08a9-4329-8073-87d9af306a7e tempest-VolumesActionsTest-1154417962 tempest-VolumesActionsTest-1154417962-project-member] Lazy-loading 'migration_context' on Instance uuid 5607360c-5f17-42b3-a373-6a33a183f92f {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:36:48 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-8b51d6ce-08a9-4329-8073-87d9af306a7e tempest-VolumesActionsTest-1154417962 tempest-VolumesActionsTest-1154417962-project-member] [instance: 5607360c-5f17-42b3-a373-6a33a183f92f] Created local disks {{(pid=72382) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 15:36:48 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-8b51d6ce-08a9-4329-8073-87d9af306a7e tempest-VolumesActionsTest-1154417962 tempest-VolumesActionsTest-1154417962-project-member] [instance: 5607360c-5f17-42b3-a373-6a33a183f92f] Ensure instance console log exists: /opt/stack/data/nova/instances/5607360c-5f17-42b3-a373-6a33a183f92f/console.log {{(pid=72382) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 15:36:48 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-8b51d6ce-08a9-4329-8073-87d9af306a7e tempest-VolumesActionsTest-1154417962 tempest-VolumesActionsTest-1154417962-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:36:48 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-8b51d6ce-08a9-4329-8073-87d9af306a7e tempest-VolumesActionsTest-1154417962 tempest-VolumesActionsTest-1154417962-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:36:48 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-8b51d6ce-08a9-4329-8073-87d9af306a7e tempest-VolumesActionsTest-1154417962 tempest-VolumesActionsTest-1154417962-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:36:48 user nova-compute[72382]: DEBUG nova.network.neutron [None req-8b51d6ce-08a9-4329-8073-87d9af306a7e tempest-VolumesActionsTest-1154417962 tempest-VolumesActionsTest-1154417962-project-member] [instance: 5607360c-5f17-42b3-a373-6a33a183f92f] Successfully created port: c8fa95b9-76c9-4eac-a049-660e46ab4f5e {{(pid=72382) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 15:36:49 user nova-compute[72382]: DEBUG nova.network.neutron [None req-8b51d6ce-08a9-4329-8073-87d9af306a7e tempest-VolumesActionsTest-1154417962 tempest-VolumesActionsTest-1154417962-project-member] [instance: 5607360c-5f17-42b3-a373-6a33a183f92f] Successfully updated port: c8fa95b9-76c9-4eac-a049-660e46ab4f5e {{(pid=72382) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 15:36:49 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-8b51d6ce-08a9-4329-8073-87d9af306a7e tempest-VolumesActionsTest-1154417962 tempest-VolumesActionsTest-1154417962-project-member] Acquiring lock "refresh_cache-5607360c-5f17-42b3-a373-6a33a183f92f" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 15:36:49 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-8b51d6ce-08a9-4329-8073-87d9af306a7e tempest-VolumesActionsTest-1154417962 tempest-VolumesActionsTest-1154417962-project-member] Acquired lock "refresh_cache-5607360c-5f17-42b3-a373-6a33a183f92f" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 15:36:49 user nova-compute[72382]: DEBUG nova.network.neutron [None req-8b51d6ce-08a9-4329-8073-87d9af306a7e tempest-VolumesActionsTest-1154417962 tempest-VolumesActionsTest-1154417962-project-member] [instance: 5607360c-5f17-42b3-a373-6a33a183f92f] Building network info cache for instance {{(pid=72382) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 15:36:49 user nova-compute[72382]: DEBUG nova.compute.manager [req-616fe370-fdc0-418b-a068-928d0349889c req-5364fa96-549c-4d76-b8a7-a6112554d2f2 service nova] [instance: 5607360c-5f17-42b3-a373-6a33a183f92f] Received event network-changed-c8fa95b9-76c9-4eac-a049-660e46ab4f5e {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:36:49 user nova-compute[72382]: DEBUG nova.compute.manager [req-616fe370-fdc0-418b-a068-928d0349889c req-5364fa96-549c-4d76-b8a7-a6112554d2f2 service nova] [instance: 5607360c-5f17-42b3-a373-6a33a183f92f] Refreshing instance network info cache due to event network-changed-c8fa95b9-76c9-4eac-a049-660e46ab4f5e. {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 15:36:49 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-616fe370-fdc0-418b-a068-928d0349889c req-5364fa96-549c-4d76-b8a7-a6112554d2f2 service nova] Acquiring lock "refresh_cache-5607360c-5f17-42b3-a373-6a33a183f92f" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 15:36:49 user nova-compute[72382]: DEBUG nova.network.neutron [None req-8b51d6ce-08a9-4329-8073-87d9af306a7e tempest-VolumesActionsTest-1154417962 tempest-VolumesActionsTest-1154417962-project-member] [instance: 5607360c-5f17-42b3-a373-6a33a183f92f] Instance cache missing network info. {{(pid=72382) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 15:36:49 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:36:49 user nova-compute[72382]: DEBUG nova.network.neutron [None req-8b51d6ce-08a9-4329-8073-87d9af306a7e tempest-VolumesActionsTest-1154417962 tempest-VolumesActionsTest-1154417962-project-member] [instance: 5607360c-5f17-42b3-a373-6a33a183f92f] Updating instance_info_cache with network_info: [{"id": "c8fa95b9-76c9-4eac-a049-660e46ab4f5e", "address": "fa:16:3e:1b:c5:d0", "network": {"id": "7cba5169-ea03-4ec4-a7e4-11b56c637e26", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1109056022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7bd7707b7d84acdb15e5f89b6720ff7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8fa95b9-76", "ovs_interfaceid": "c8fa95b9-76c9-4eac-a049-660e46ab4f5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:36:49 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-8b51d6ce-08a9-4329-8073-87d9af306a7e tempest-VolumesActionsTest-1154417962 tempest-VolumesActionsTest-1154417962-project-member] Releasing lock "refresh_cache-5607360c-5f17-42b3-a373-6a33a183f92f" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 15:36:49 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8b51d6ce-08a9-4329-8073-87d9af306a7e tempest-VolumesActionsTest-1154417962 tempest-VolumesActionsTest-1154417962-project-member] [instance: 5607360c-5f17-42b3-a373-6a33a183f92f] Instance network_info: |[{"id": "c8fa95b9-76c9-4eac-a049-660e46ab4f5e", "address": "fa:16:3e:1b:c5:d0", "network": {"id": "7cba5169-ea03-4ec4-a7e4-11b56c637e26", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1109056022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7bd7707b7d84acdb15e5f89b6720ff7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8fa95b9-76", "ovs_interfaceid": "c8fa95b9-76c9-4eac-a049-660e46ab4f5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72382) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 15:36:49 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-616fe370-fdc0-418b-a068-928d0349889c req-5364fa96-549c-4d76-b8a7-a6112554d2f2 service nova] Acquired lock "refresh_cache-5607360c-5f17-42b3-a373-6a33a183f92f" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 15:36:49 user nova-compute[72382]: DEBUG nova.network.neutron [req-616fe370-fdc0-418b-a068-928d0349889c req-5364fa96-549c-4d76-b8a7-a6112554d2f2 service nova] [instance: 5607360c-5f17-42b3-a373-6a33a183f92f] Refreshing network info cache for port c8fa95b9-76c9-4eac-a049-660e46ab4f5e {{(pid=72382) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 15:36:50 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-8b51d6ce-08a9-4329-8073-87d9af306a7e tempest-VolumesActionsTest-1154417962 tempest-VolumesActionsTest-1154417962-project-member] [instance: 5607360c-5f17-42b3-a373-6a33a183f92f] Start _get_guest_xml network_info=[{"id": "c8fa95b9-76c9-4eac-a049-660e46ab4f5e", "address": "fa:16:3e:1b:c5:d0", "network": {"id": "7cba5169-ea03-4ec4-a7e4-11b56c637e26", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1109056022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7bd7707b7d84acdb15e5f89b6720ff7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8fa95b9-76", "ovs_interfaceid": "c8fa95b9-76c9-4eac-a049-660e46ab4f5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T15:11:25Z,direct_url=<?>,disk_format='qcow2',id=a79f2cea-eb27-4631-aaf3-05e7d9e411b4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a638990e12cc4d6eabb6d55e13be6bdf',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T15:11:27Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'a79f2cea-eb27-4631-aaf3-05e7d9e411b4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72382) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 15:36:50 user nova-compute[72382]: WARNING nova.virt.libvirt.driver [None req-8b51d6ce-08a9-4329-8073-87d9af306a7e tempest-VolumesActionsTest-1154417962 tempest-VolumesActionsTest-1154417962-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 15:36:50 user nova-compute[72382]: WARNING nova.virt.libvirt.driver [None req-8b51d6ce-08a9-4329-8073-87d9af306a7e tempest-VolumesActionsTest-1154417962 tempest-VolumesActionsTest-1154417962-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 15:36:50 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-8b51d6ce-08a9-4329-8073-87d9af306a7e tempest-VolumesActionsTest-1154417962 tempest-VolumesActionsTest-1154417962-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72382) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 15:36:50 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-8b51d6ce-08a9-4329-8073-87d9af306a7e tempest-VolumesActionsTest-1154417962 tempest-VolumesActionsTest-1154417962-project-member] CPU controller missing on host. {{(pid=72382) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 15:36:50 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-8b51d6ce-08a9-4329-8073-87d9af306a7e tempest-VolumesActionsTest-1154417962 tempest-VolumesActionsTest-1154417962-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72382) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 15:36:50 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-8b51d6ce-08a9-4329-8073-87d9af306a7e tempest-VolumesActionsTest-1154417962 tempest-VolumesActionsTest-1154417962-project-member] CPU controller found on host. {{(pid=72382) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 15:36:50 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-8b51d6ce-08a9-4329-8073-87d9af306a7e tempest-VolumesActionsTest-1154417962 tempest-VolumesActionsTest-1154417962-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72382) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 15:36:50 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-8b51d6ce-08a9-4329-8073-87d9af306a7e tempest-VolumesActionsTest-1154417962 tempest-VolumesActionsTest-1154417962-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T15:11:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T15:11:25Z,direct_url=<?>,disk_format='qcow2',id=a79f2cea-eb27-4631-aaf3-05e7d9e411b4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a638990e12cc4d6eabb6d55e13be6bdf',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T15:11:27Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 15:36:50 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-8b51d6ce-08a9-4329-8073-87d9af306a7e tempest-VolumesActionsTest-1154417962 tempest-VolumesActionsTest-1154417962-project-member] Flavor limits 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 15:36:50 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-8b51d6ce-08a9-4329-8073-87d9af306a7e tempest-VolumesActionsTest-1154417962 tempest-VolumesActionsTest-1154417962-project-member] Image limits 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 15:36:50 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-8b51d6ce-08a9-4329-8073-87d9af306a7e tempest-VolumesActionsTest-1154417962 tempest-VolumesActionsTest-1154417962-project-member] Flavor pref 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 15:36:50 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-8b51d6ce-08a9-4329-8073-87d9af306a7e tempest-VolumesActionsTest-1154417962 tempest-VolumesActionsTest-1154417962-project-member] Image pref 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 15:36:50 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-8b51d6ce-08a9-4329-8073-87d9af306a7e tempest-VolumesActionsTest-1154417962 tempest-VolumesActionsTest-1154417962-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 15:36:50 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-8b51d6ce-08a9-4329-8073-87d9af306a7e tempest-VolumesActionsTest-1154417962 tempest-VolumesActionsTest-1154417962-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 15:36:50 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-8b51d6ce-08a9-4329-8073-87d9af306a7e tempest-VolumesActionsTest-1154417962 tempest-VolumesActionsTest-1154417962-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72382) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 15:36:50 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-8b51d6ce-08a9-4329-8073-87d9af306a7e tempest-VolumesActionsTest-1154417962 tempest-VolumesActionsTest-1154417962-project-member] Got 1 possible topologies {{(pid=72382) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 15:36:50 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-8b51d6ce-08a9-4329-8073-87d9af306a7e tempest-VolumesActionsTest-1154417962 tempest-VolumesActionsTest-1154417962-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 15:36:50 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-8b51d6ce-08a9-4329-8073-87d9af306a7e tempest-VolumesActionsTest-1154417962 tempest-VolumesActionsTest-1154417962-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 15:36:50 user nova-compute[72382]: DEBUG nova.virt.libvirt.vif [None req-8b51d6ce-08a9-4329-8073-87d9af306a7e tempest-VolumesActionsTest-1154417962 tempest-VolumesActionsTest-1154417962-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T15:36:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1145669130',display_name='tempest-VolumesActionsTest-instance-1145669130',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1145669130',id=43,image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b7bd7707b7d84acdb15e5f89b6720ff7',ramdisk_id='',reservation_id='r-6ni53l5z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1154417962',owner_user_name='tempest-VolumesActionsTest-1154417962-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T15:36:48Z,user_data=None,user_id='a780bb50b3d54386b8ed790da8a6cbea',uuid=5607360c-5f17-42b3-a373-6a33a183f92f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c8fa95b9-76c9-4eac-a049-660e46ab4f5e", "address": "fa:16:3e:1b:c5:d0", "network": {"id": "7cba5169-ea03-4ec4-a7e4-11b56c637e26", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1109056022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7bd7707b7d84acdb15e5f89b6720ff7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8fa95b9-76", "ovs_interfaceid": "c8fa95b9-76c9-4eac-a049-660e46ab4f5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72382) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 15:36:50 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-8b51d6ce-08a9-4329-8073-87d9af306a7e tempest-VolumesActionsTest-1154417962 tempest-VolumesActionsTest-1154417962-project-member] Converting VIF {"id": "c8fa95b9-76c9-4eac-a049-660e46ab4f5e", "address": "fa:16:3e:1b:c5:d0", "network": {"id": "7cba5169-ea03-4ec4-a7e4-11b56c637e26", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1109056022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7bd7707b7d84acdb15e5f89b6720ff7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8fa95b9-76", "ovs_interfaceid": "c8fa95b9-76c9-4eac-a049-660e46ab4f5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 15:36:50 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-8b51d6ce-08a9-4329-8073-87d9af306a7e tempest-VolumesActionsTest-1154417962 tempest-VolumesActionsTest-1154417962-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1b:c5:d0,bridge_name='br-int',has_traffic_filtering=True,id=c8fa95b9-76c9-4eac-a049-660e46ab4f5e,network=Network(7cba5169-ea03-4ec4-a7e4-11b56c637e26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8fa95b9-76') {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 15:36:50 user nova-compute[72382]: DEBUG nova.objects.instance [None req-8b51d6ce-08a9-4329-8073-87d9af306a7e tempest-VolumesActionsTest-1154417962 tempest-VolumesActionsTest-1154417962-project-member] Lazy-loading 'pci_devices' on Instance uuid 5607360c-5f17-42b3-a373-6a33a183f92f {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:36:50 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-8b51d6ce-08a9-4329-8073-87d9af306a7e tempest-VolumesActionsTest-1154417962 tempest-VolumesActionsTest-1154417962-project-member] [instance: 5607360c-5f17-42b3-a373-6a33a183f92f] End _get_guest_xml xml=<domain type="kvm">
Aug 09 15:36:50 user nova-compute[72382]:   <uuid>5607360c-5f17-42b3-a373-6a33a183f92f</uuid>
Aug 09 15:36:50 user nova-compute[72382]:   <name>instance-0000002b</name>
Aug 09 15:36:50 user nova-compute[72382]:   <memory>524288</memory>
Aug 09 15:36:50 user nova-compute[72382]:   <vcpu>1</vcpu>
Aug 09 15:36:50 user nova-compute[72382]:   <metadata>
Aug 09 15:36:50 user nova-compute[72382]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 15:36:50 user nova-compute[72382]:       <nova:package version="0.0.0"/>
Aug 09 15:36:50 user nova-compute[72382]:       <nova:name>tempest-VolumesActionsTest-instance-1145669130</nova:name>
Aug 09 15:36:50 user nova-compute[72382]:       <nova:creationTime>2023-08-09 15:36:50</nova:creationTime>
Aug 09 15:36:50 user nova-compute[72382]:       <nova:flavor name="m1.tiny">
Aug 09 15:36:50 user nova-compute[72382]:         <nova:memory>512</nova:memory>
Aug 09 15:36:50 user nova-compute[72382]:         <nova:disk>1</nova:disk>
Aug 09 15:36:50 user nova-compute[72382]:         <nova:swap>0</nova:swap>
Aug 09 15:36:50 user nova-compute[72382]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 15:36:50 user nova-compute[72382]:         <nova:vcpus>1</nova:vcpus>
Aug 09 15:36:50 user nova-compute[72382]:       </nova:flavor>
Aug 09 15:36:50 user nova-compute[72382]:       <nova:owner>
Aug 09 15:36:50 user nova-compute[72382]:         <nova:user uuid="a780bb50b3d54386b8ed790da8a6cbea">tempest-VolumesActionsTest-1154417962-project-member</nova:user>
Aug 09 15:36:50 user nova-compute[72382]:         <nova:project uuid="b7bd7707b7d84acdb15e5f89b6720ff7">tempest-VolumesActionsTest-1154417962</nova:project>
Aug 09 15:36:50 user nova-compute[72382]:       </nova:owner>
Aug 09 15:36:50 user nova-compute[72382]:       <nova:root type="image" uuid="a79f2cea-eb27-4631-aaf3-05e7d9e411b4"/>
Aug 09 15:36:50 user nova-compute[72382]:       <nova:ports>
Aug 09 15:36:50 user nova-compute[72382]:         <nova:port uuid="c8fa95b9-76c9-4eac-a049-660e46ab4f5e">
Aug 09 15:36:50 user nova-compute[72382]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 09 15:36:50 user nova-compute[72382]:         </nova:port>
Aug 09 15:36:50 user nova-compute[72382]:       </nova:ports>
Aug 09 15:36:50 user nova-compute[72382]:     </nova:instance>
Aug 09 15:36:50 user nova-compute[72382]:   </metadata>
Aug 09 15:36:50 user nova-compute[72382]:   <sysinfo type="smbios">
Aug 09 15:36:50 user nova-compute[72382]:     <system>
Aug 09 15:36:50 user nova-compute[72382]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 15:36:50 user nova-compute[72382]:       <entry name="product">OpenStack Nova</entry>
Aug 09 15:36:50 user nova-compute[72382]:       <entry name="version">0.0.0</entry>
Aug 09 15:36:50 user nova-compute[72382]:       <entry name="serial">5607360c-5f17-42b3-a373-6a33a183f92f</entry>
Aug 09 15:36:50 user nova-compute[72382]:       <entry name="uuid">5607360c-5f17-42b3-a373-6a33a183f92f</entry>
Aug 09 15:36:50 user nova-compute[72382]:       <entry name="family">Virtual Machine</entry>
Aug 09 15:36:50 user nova-compute[72382]:     </system>
Aug 09 15:36:50 user nova-compute[72382]:   </sysinfo>
Aug 09 15:36:50 user nova-compute[72382]:   <os>
Aug 09 15:36:50 user nova-compute[72382]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 15:36:50 user nova-compute[72382]:     <boot dev="hd"/>
Aug 09 15:36:50 user nova-compute[72382]:     <smbios mode="sysinfo"/>
Aug 09 15:36:50 user nova-compute[72382]:   </os>
Aug 09 15:36:50 user nova-compute[72382]:   <features>
Aug 09 15:36:50 user nova-compute[72382]:     <acpi/>
Aug 09 15:36:50 user nova-compute[72382]:     <apic/>
Aug 09 15:36:50 user nova-compute[72382]:     <vmcoreinfo/>
Aug 09 15:36:50 user nova-compute[72382]:   </features>
Aug 09 15:36:50 user nova-compute[72382]:   <clock offset="utc">
Aug 09 15:36:50 user nova-compute[72382]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 15:36:50 user nova-compute[72382]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 15:36:50 user nova-compute[72382]:     <timer name="hpet" present="no"/>
Aug 09 15:36:50 user nova-compute[72382]:   </clock>
Aug 09 15:36:50 user nova-compute[72382]:   <cpu mode="custom" match="exact">
Aug 09 15:36:50 user nova-compute[72382]:     <model>Nehalem</model>
Aug 09 15:36:50 user nova-compute[72382]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 15:36:50 user nova-compute[72382]:   </cpu>
Aug 09 15:36:50 user nova-compute[72382]:   <devices>
Aug 09 15:36:50 user nova-compute[72382]:     <disk type="file" device="disk">
Aug 09 15:36:50 user nova-compute[72382]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 15:36:50 user nova-compute[72382]:       <source file="/opt/stack/data/nova/instances/5607360c-5f17-42b3-a373-6a33a183f92f/disk"/>
Aug 09 15:36:50 user nova-compute[72382]:       <target dev="vda" bus="virtio"/>
Aug 09 15:36:50 user nova-compute[72382]:     </disk>
Aug 09 15:36:50 user nova-compute[72382]:     <interface type="ethernet">
Aug 09 15:36:50 user nova-compute[72382]:       <mac address="fa:16:3e:1b:c5:d0"/>
Aug 09 15:36:50 user nova-compute[72382]:       <model type="virtio"/>
Aug 09 15:36:50 user nova-compute[72382]:       <mtu size="1442"/>
Aug 09 15:36:50 user nova-compute[72382]:       <target dev="tapc8fa95b9-76"/>
Aug 09 15:36:50 user nova-compute[72382]:     </interface>
Aug 09 15:36:50 user nova-compute[72382]:     <serial type="pty">
Aug 09 15:36:50 user nova-compute[72382]:       <log file="/opt/stack/data/nova/instances/5607360c-5f17-42b3-a373-6a33a183f92f/console.log" append="off"/>
Aug 09 15:36:50 user nova-compute[72382]:     </serial>
Aug 09 15:36:50 user nova-compute[72382]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 15:36:50 user nova-compute[72382]:     <video>
Aug 09 15:36:50 user nova-compute[72382]:       <model type="virtio"/>
Aug 09 15:36:50 user nova-compute[72382]:     </video>
Aug 09 15:36:50 user nova-compute[72382]:     <rng model="virtio">
Aug 09 15:36:50 user nova-compute[72382]:       <backend model="random">/dev/urandom</backend>
Aug 09 15:36:50 user nova-compute[72382]:     </rng>
Aug 09 15:36:50 user nova-compute[72382]:     <controller type="usb" index="0" model="none"/>
Aug 09 15:36:50 user nova-compute[72382]:     <memballoon model="virtio">
Aug 09 15:36:50 user nova-compute[72382]:       <stats period="10"/>
Aug 09 15:36:50 user nova-compute[72382]:     </memballoon>
Aug 09 15:36:50 user nova-compute[72382]:   </devices>
Aug 09 15:36:50 user nova-compute[72382]: </domain>
Aug 09 15:36:50 user nova-compute[72382]:  {{(pid=72382) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 15:36:50 user nova-compute[72382]: DEBUG nova.virt.libvirt.vif [None req-8b51d6ce-08a9-4329-8073-87d9af306a7e tempest-VolumesActionsTest-1154417962 tempest-VolumesActionsTest-1154417962-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T15:36:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1145669130',display_name='tempest-VolumesActionsTest-instance-1145669130',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1145669130',id=43,image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b7bd7707b7d84acdb15e5f89b6720ff7',ramdisk_id='',reservation_id='r-6ni53l5z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1154417962',owner_user_name='tempest-VolumesActionsTest-1154417962-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T15:36:48Z,user_data=None,user_id='a780bb50b3d54386b8ed790da8a6cbea',uuid=5607360c-5f17-42b3-a373-6a33a183f92f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c8fa95b9-76c9-4eac-a049-660e46ab4f5e", "address": "fa:16:3e:1b:c5:d0", "network": {"id": "7cba5169-ea03-4ec4-a7e4-11b56c637e26", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1109056022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7bd7707b7d84acdb15e5f89b6720ff7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8fa95b9-76", "ovs_interfaceid": "c8fa95b9-76c9-4eac-a049-660e46ab4f5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 15:36:50 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-8b51d6ce-08a9-4329-8073-87d9af306a7e tempest-VolumesActionsTest-1154417962 tempest-VolumesActionsTest-1154417962-project-member] Converting VIF {"id": "c8fa95b9-76c9-4eac-a049-660e46ab4f5e", "address": "fa:16:3e:1b:c5:d0", "network": {"id": "7cba5169-ea03-4ec4-a7e4-11b56c637e26", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1109056022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7bd7707b7d84acdb15e5f89b6720ff7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8fa95b9-76", "ovs_interfaceid": "c8fa95b9-76c9-4eac-a049-660e46ab4f5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 15:36:50 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-8b51d6ce-08a9-4329-8073-87d9af306a7e tempest-VolumesActionsTest-1154417962 tempest-VolumesActionsTest-1154417962-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1b:c5:d0,bridge_name='br-int',has_traffic_filtering=True,id=c8fa95b9-76c9-4eac-a049-660e46ab4f5e,network=Network(7cba5169-ea03-4ec4-a7e4-11b56c637e26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8fa95b9-76') {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 15:36:50 user nova-compute[72382]: DEBUG os_vif [None req-8b51d6ce-08a9-4329-8073-87d9af306a7e tempest-VolumesActionsTest-1154417962 tempest-VolumesActionsTest-1154417962-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:c5:d0,bridge_name='br-int',has_traffic_filtering=True,id=c8fa95b9-76c9-4eac-a049-660e46ab4f5e,network=Network(7cba5169-ea03-4ec4-a7e4-11b56c637e26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8fa95b9-76') {{(pid=72382) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 15:36:50 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:36:50 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:36:50 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 15:36:50 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:36:50 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc8fa95b9-76, may_exist=True, interface_attrs={}) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:36:50 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc8fa95b9-76, col_values=(('external_ids', {'iface-id': 'c8fa95b9-76c9-4eac-a049-660e46ab4f5e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1b:c5:d0', 'vm-uuid': '5607360c-5f17-42b3-a373-6a33a183f92f'}),), if_exists=True) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:36:50 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:36:50 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:36:50 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:36:50 user nova-compute[72382]: INFO os_vif [None req-8b51d6ce-08a9-4329-8073-87d9af306a7e tempest-VolumesActionsTest-1154417962 tempest-VolumesActionsTest-1154417962-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:c5:d0,bridge_name='br-int',has_traffic_filtering=True,id=c8fa95b9-76c9-4eac-a049-660e46ab4f5e,network=Network(7cba5169-ea03-4ec4-a7e4-11b56c637e26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8fa95b9-76')
Aug 09 15:36:50 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-8b51d6ce-08a9-4329-8073-87d9af306a7e tempest-VolumesActionsTest-1154417962 tempest-VolumesActionsTest-1154417962-project-member] No BDM found with device name vda, not building metadata. {{(pid=72382) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 15:36:50 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-8b51d6ce-08a9-4329-8073-87d9af306a7e tempest-VolumesActionsTest-1154417962 tempest-VolumesActionsTest-1154417962-project-member] No VIF found with MAC fa:16:3e:1b:c5:d0, not building metadata {{(pid=72382) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 15:36:50 user nova-compute[72382]: DEBUG nova.network.neutron [req-616fe370-fdc0-418b-a068-928d0349889c req-5364fa96-549c-4d76-b8a7-a6112554d2f2 service nova] [instance: 5607360c-5f17-42b3-a373-6a33a183f92f] Updated VIF entry in instance network info cache for port c8fa95b9-76c9-4eac-a049-660e46ab4f5e. {{(pid=72382) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 15:36:50 user nova-compute[72382]: DEBUG nova.network.neutron [req-616fe370-fdc0-418b-a068-928d0349889c req-5364fa96-549c-4d76-b8a7-a6112554d2f2 service nova] [instance: 5607360c-5f17-42b3-a373-6a33a183f92f] Updating instance_info_cache with network_info: [{"id": "c8fa95b9-76c9-4eac-a049-660e46ab4f5e", "address": "fa:16:3e:1b:c5:d0", "network": {"id": "7cba5169-ea03-4ec4-a7e4-11b56c637e26", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1109056022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7bd7707b7d84acdb15e5f89b6720ff7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8fa95b9-76", "ovs_interfaceid": "c8fa95b9-76c9-4eac-a049-660e46ab4f5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:36:50 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-616fe370-fdc0-418b-a068-928d0349889c req-5364fa96-549c-4d76-b8a7-a6112554d2f2 service nova] Releasing lock "refresh_cache-5607360c-5f17-42b3-a373-6a33a183f92f" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 15:36:51 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:36:51 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:36:51 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:36:51 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:36:51 user nova-compute[72382]: DEBUG nova.compute.manager [req-26bc9dbc-f79c-4aa0-b2d4-f177895d46e7 req-a9591f38-fcb3-45a9-ae4b-98ceeea9ce86 service nova] [instance: 5607360c-5f17-42b3-a373-6a33a183f92f] Received event network-vif-plugged-c8fa95b9-76c9-4eac-a049-660e46ab4f5e {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:36:51 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-26bc9dbc-f79c-4aa0-b2d4-f177895d46e7 req-a9591f38-fcb3-45a9-ae4b-98ceeea9ce86 service nova] Acquiring lock "5607360c-5f17-42b3-a373-6a33a183f92f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:36:51 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-26bc9dbc-f79c-4aa0-b2d4-f177895d46e7 req-a9591f38-fcb3-45a9-ae4b-98ceeea9ce86 service nova] Lock "5607360c-5f17-42b3-a373-6a33a183f92f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:36:51 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-26bc9dbc-f79c-4aa0-b2d4-f177895d46e7 req-a9591f38-fcb3-45a9-ae4b-98ceeea9ce86 service nova] Lock "5607360c-5f17-42b3-a373-6a33a183f92f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:36:51 user nova-compute[72382]: DEBUG nova.compute.manager [req-26bc9dbc-f79c-4aa0-b2d4-f177895d46e7 req-a9591f38-fcb3-45a9-ae4b-98ceeea9ce86 service nova] [instance: 5607360c-5f17-42b3-a373-6a33a183f92f] No waiting events found dispatching network-vif-plugged-c8fa95b9-76c9-4eac-a049-660e46ab4f5e {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:36:51 user nova-compute[72382]: WARNING nova.compute.manager [req-26bc9dbc-f79c-4aa0-b2d4-f177895d46e7 req-a9591f38-fcb3-45a9-ae4b-98ceeea9ce86 service nova] [instance: 5607360c-5f17-42b3-a373-6a33a183f92f] Received unexpected event network-vif-plugged-c8fa95b9-76c9-4eac-a049-660e46ab4f5e for instance with vm_state building and task_state spawning.
Aug 09 15:36:52 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:36:52 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:36:52 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:36:52 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:36:52 user nova-compute[72382]: DEBUG nova.compute.manager [None req-f624cbc3-5994-47b0-a206-2870fbe56bba tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: 2158de7a-1e53-450a-80de-a5c56844feba] Start spawning the instance on the hypervisor. {{(pid=72382) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 15:36:52 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-f624cbc3-5994-47b0-a206-2870fbe56bba tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: 2158de7a-1e53-450a-80de-a5c56844feba] Creating instance directory {{(pid=72382) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 15:36:52 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-f624cbc3-5994-47b0-a206-2870fbe56bba tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: 2158de7a-1e53-450a-80de-a5c56844feba] Creating image(s)
Aug 09 15:36:52 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-f624cbc3-5994-47b0-a206-2870fbe56bba tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: 2158de7a-1e53-450a-80de-a5c56844feba] Did not create local disks {{(pid=72382) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 09 15:36:52 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-f624cbc3-5994-47b0-a206-2870fbe56bba tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: 2158de7a-1e53-450a-80de-a5c56844feba] Ensure instance console log exists: /opt/stack/data/nova/instances/2158de7a-1e53-450a-80de-a5c56844feba/console.log {{(pid=72382) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 15:36:52 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-f624cbc3-5994-47b0-a206-2870fbe56bba tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:36:52 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-f624cbc3-5994-47b0-a206-2870fbe56bba tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:36:52 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-f624cbc3-5994-47b0-a206-2870fbe56bba tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:36:52 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-f624cbc3-5994-47b0-a206-2870fbe56bba tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: 2158de7a-1e53-450a-80de-a5c56844feba] Start _get_guest_xml network_info=[{"id": "8fc3cbf4-d7ef-434b-a7b5-b611e919b364", "address": "fa:16:3e:c5:f7:64", "network": {"id": "a78e6cb6-feb7-4f64-a3c0-4900594b6e37", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-338007968-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70310b1af40b4d239fe5ea362972554b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fc3cbf4-d7", "ovs_interfaceid": "8fc3cbf4-d7ef-434b-a7b5-b611e919b364", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:3f58579c-f69a-4bee-b16e-970e5a8f590c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sJYkmfxN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '2158de7a-1e53-450a-80de-a5c56844feba', 'attached_at': '', 'detached_at': '', 'volume_id': '3f58579c-f69a-4bee-b16e-970e5a8f590c', 'serial': '3f58579c-f69a-4bee-b16e-970e5a8f590c'}, 'disk_bus': 'virtio', 'attachment_id': '911e3577-e2a1-47b5-8efd-69baacc739bd', 'delete_on_termination': False, 'volume_type': None} {{(pid=72382) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 15:36:52 user nova-compute[72382]: WARNING nova.virt.libvirt.driver [None req-f624cbc3-5994-47b0-a206-2870fbe56bba tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 15:36:52 user nova-compute[72382]: WARNING nova.virt.libvirt.driver [None req-f624cbc3-5994-47b0-a206-2870fbe56bba tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 15:36:52 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-f624cbc3-5994-47b0-a206-2870fbe56bba tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72382) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 15:36:52 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-f624cbc3-5994-47b0-a206-2870fbe56bba tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] CPU controller missing on host. {{(pid=72382) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 15:36:52 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-f624cbc3-5994-47b0-a206-2870fbe56bba tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72382) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 15:36:52 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-f624cbc3-5994-47b0-a206-2870fbe56bba tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] CPU controller found on host. {{(pid=72382) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 15:36:52 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-f624cbc3-5994-47b0-a206-2870fbe56bba tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72382) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 15:36:52 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-f624cbc3-5994-47b0-a206-2870fbe56bba tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T15:11:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 15:36:52 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-f624cbc3-5994-47b0-a206-2870fbe56bba tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Flavor limits 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 15:36:52 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-f624cbc3-5994-47b0-a206-2870fbe56bba tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Image limits 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 15:36:52 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-f624cbc3-5994-47b0-a206-2870fbe56bba tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Flavor pref 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 15:36:52 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-f624cbc3-5994-47b0-a206-2870fbe56bba tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Image pref 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 15:36:52 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-f624cbc3-5994-47b0-a206-2870fbe56bba tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 15:36:52 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-f624cbc3-5994-47b0-a206-2870fbe56bba tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 15:36:52 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-f624cbc3-5994-47b0-a206-2870fbe56bba tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72382) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 15:36:52 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-f624cbc3-5994-47b0-a206-2870fbe56bba tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Got 1 possible topologies {{(pid=72382) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 15:36:52 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-f624cbc3-5994-47b0-a206-2870fbe56bba tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 15:36:52 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-f624cbc3-5994-47b0-a206-2870fbe56bba tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 15:36:52 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f624cbc3-5994-47b0-a206-2870fbe56bba tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: 2158de7a-1e53-450a-80de-a5c56844feba] Calling os-brick to attach iSCSI Volume {{(pid=72382) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 15:36:52 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-f624cbc3-5994-47b0-a206-2870fbe56bba tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2a0c768340>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:3f58579c-f69a-4bee-b16e-970e5a8f590c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sJYkmfxN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 15:36:52 user nova-compute[72382]: WARNING os_brick.initiator.connectors.base [None req-f624cbc3-5994-47b0-a206-2870fbe56bba tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 15:36:52 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-f624cbc3-5994-47b0-a206-2870fbe56bba tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 15:36:52 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-f624cbc3-5994-47b0-a206-2870fbe56bba tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 15:36:52 user nova-compute[72382]: WARNING os_brick.initiator.connectors.base [None req-f624cbc3-5994-47b0-a206-2870fbe56bba tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 15:36:52 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-f624cbc3-5994-47b0-a206-2870fbe56bba tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3f58579c-f69a-4bee-b16e-970e5a8f590c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 15:36:52 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-f624cbc3-5994-47b0-a206-2870fbe56bba tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3f58579c-f69a-4bee-b16e-970e5a8f590c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 15:36:52 user nova-compute[72382]: INFO os_brick.initiator.connectors.iscsi [None req-f624cbc3-5994-47b0-a206-2870fbe56bba tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 15:36:52 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f58579c-f69a-4bee-b16e-970e5a8f590c -p 172.16.0.220:3260 {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:36:52 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f58579c-f69a-4bee-b16e-970e5a8f590c -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:36:52 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[6afc862a-d876-4f5f-bf66-67ad4719ea35]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:36:52 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-f624cbc3-5994-47b0-a206-2870fbe56bba tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 15:36:52 user nova-compute[72382]:  {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:36:52 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f58579c-f69a-4bee-b16e-970e5a8f590c -p 172.16.0.220:3260 --interface default --op new {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:36:52 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f58579c-f69a-4bee-b16e-970e5a8f590c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:36:52 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4d991c3-8af7-4e0e-bca4-80a3b5353d92]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3f58579c-f69a-4bee-b16e-970e5a8f590c] added\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:36:52 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-f624cbc3-5994-47b0-a206-2870fbe56bba tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3f58579c-f69a-4bee-b16e-970e5a8f590c] added
Aug 09 15:36:52 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:36:52 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f58579c-f69a-4bee-b16e-970e5a8f590c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:36:52 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f58579c-f69a-4bee-b16e-970e5a8f590c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:36:52 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[932647c2-9a1b-4730-9a9d-e9248f1d42d4]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:36:52 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-f624cbc3-5994-47b0-a206-2870fbe56bba tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:36:52 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f58579c-f69a-4bee-b16e-970e5a8f590c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:36:52 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f58579c-f69a-4bee-b16e-970e5a8f590c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:36:52 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[79efec38-3129-473c-be75-174a59396e25]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:36:52 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-f624cbc3-5994-47b0-a206-2870fbe56bba tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:36:52 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f58579c-f69a-4bee-b16e-970e5a8f590c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sJYkmfxN {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:36:52 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f58579c-f69a-4bee-b16e-970e5a8f590c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sJYkmfxN" returned: 0 in 0.018s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:36:52 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[e99132d9-1c78-43e8-995e-fa8d964b395e]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:36:52 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-f624cbc3-5994-47b0-a206-2870fbe56bba tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'sJYkmfxN'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:36:52 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f58579c-f69a-4bee-b16e-970e5a8f590c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:36:52 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f58579c-f69a-4bee-b16e-970e5a8f590c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:36:52 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ef84446-4062-419a-b0b8-520b99b47b25]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:36:52 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-f624cbc3-5994-47b0-a206-2870fbe56bba tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:36:52 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:36:52 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:36:52 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0ed82e4-4ff3-4d7d-878c-e1e08b5b65bf]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0a612d6-0f3f-4d2c-9fb5-aff9384338de (non-flash)\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:36:52 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-f624cbc3-5994-47b0-a206-2870fbe56bba tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0a612d6-0f3f-4d2c-9fb5-aff9384338de (non-flash)
Aug 09 15:36:52 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 15:36:52 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-f624cbc3-5994-47b0-a206-2870fbe56bba tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0a612d6-0f3f-4d2c-9fb5-aff9384338de (non-flash)
Aug 09 15:36:52 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 15:36:52 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f58579c-f69a-4bee-b16e-970e5a8f590c -p 172.16.0.220:3260 --login {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:36:52 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f58579c-f69a-4bee-b16e-970e5a8f590c -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:36:52 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[04726c4c-3d2e-4370-bb98-3ee2bd0b6e8d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3f58579c-f69a-4bee-b16e-970e5a8f590c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3f58579c-f69a-4bee-b16e-970e5a8f590c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:36:52 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-f624cbc3-5994-47b0-a206-2870fbe56bba tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3f58579c-f69a-4bee-b16e-970e5a8f590c, portal: 172.16.0.220,3260]
Aug 09 15:36:52 user nova-compute[72382]: Login to [iface: default, target: iqn.2010-10.org.openstack:3f58579c-f69a-4bee-b16e-970e5a8f590c, portal: 172.16.0.220,3260] successful.
Aug 09 15:36:52 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:36:52 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f58579c-f69a-4bee-b16e-970e5a8f590c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:36:53 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f58579c-f69a-4bee-b16e-970e5a8f590c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:36:53 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[05768595-1400-4a64-8dd9-927f9c2c3a11]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:36:53 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-f624cbc3-5994-47b0-a206-2870fbe56bba tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:36:53 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:36:53 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:36:53 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[033ab93d-4ab7-416d-9796-fad9b6214355]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0a612d6-0f3f-4d2c-9fb5-aff9384338de (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f58579c-f69a-4bee-b16e-970e5a8f590c (non-flash)\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:36:53 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-f624cbc3-5994-47b0-a206-2870fbe56bba tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0a612d6-0f3f-4d2c-9fb5-aff9384338de (non-flash)
Aug 09 15:36:53 user nova-compute[72382]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f58579c-f69a-4bee-b16e-970e5a8f590c (non-flash)
Aug 09 15:36:53 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 15:36:53 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-f624cbc3-5994-47b0-a206-2870fbe56bba tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0a612d6-0f3f-4d2c-9fb5-aff9384338de (non-flash)
Aug 09 15:36:53 user nova-compute[72382]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f58579c-f69a-4bee-b16e-970e5a8f590c (non-flash)
Aug 09 15:36:53 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 15:36:53 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-f624cbc3-5994-47b0-a206-2870fbe56bba tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3f58579c-f69a-4bee-b16e-970e5a8f590c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.277s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 15:36:53 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-f624cbc3-5994-47b0-a206-2870fbe56bba tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Connected to 172.16.0.220:3260 {{(pid=72382) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 15:36:53 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-f624cbc3-5994-47b0-a206-2870fbe56bba tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] HCTL ('33', '-', '-', 0) found on session 48 with lun 0 {{(pid=72382) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 15:36:53 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-f624cbc3-5994-47b0-a206-2870fbe56bba tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72382) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 15:36:53 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:36:53 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:36:53 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[86b0d536-56d7-4d6e-916d-61bfb37e1205]: (4, ('- - 0', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:36:53 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-f624cbc3-5994-47b0-a206-2870fbe56bba tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Searching for a device in session 48 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72382) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 15:36:53 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-f624cbc3-5994-47b0-a206-2870fbe56bba tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sJYkmfxN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72382) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 15:36:53 user nova-compute[72382]: DEBUG nova.compute.manager [req-5152389c-9da6-4c75-8892-c3e90d321ac6 req-43125109-1a10-4623-8455-965a6cf2ec3f service nova] [instance: 402ba448-a30a-45f2-a724-5a53cf584547] Received event network-changed-a4cb9706-2448-4789-b7ef-8c4bef62e160 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:36:53 user nova-compute[72382]: DEBUG nova.compute.manager [req-5152389c-9da6-4c75-8892-c3e90d321ac6 req-43125109-1a10-4623-8455-965a6cf2ec3f service nova] [instance: 402ba448-a30a-45f2-a724-5a53cf584547] Refreshing instance network info cache due to event network-changed-a4cb9706-2448-4789-b7ef-8c4bef62e160. {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 15:36:53 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-5152389c-9da6-4c75-8892-c3e90d321ac6 req-43125109-1a10-4623-8455-965a6cf2ec3f service nova] Acquiring lock "refresh_cache-402ba448-a30a-45f2-a724-5a53cf584547" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 15:36:53 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-5152389c-9da6-4c75-8892-c3e90d321ac6 req-43125109-1a10-4623-8455-965a6cf2ec3f service nova] Acquired lock "refresh_cache-402ba448-a30a-45f2-a724-5a53cf584547" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 15:36:53 user nova-compute[72382]: DEBUG nova.network.neutron [req-5152389c-9da6-4c75-8892-c3e90d321ac6 req-43125109-1a10-4623-8455-965a6cf2ec3f service nova] [instance: 402ba448-a30a-45f2-a724-5a53cf584547] Refreshing network info cache for port a4cb9706-2448-4789-b7ef-8c4bef62e160 {{(pid=72382) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 15:36:53 user nova-compute[72382]: DEBUG nova.network.neutron [req-5152389c-9da6-4c75-8892-c3e90d321ac6 req-43125109-1a10-4623-8455-965a6cf2ec3f service nova] [instance: 402ba448-a30a-45f2-a724-5a53cf584547] Updated VIF entry in instance network info cache for port a4cb9706-2448-4789-b7ef-8c4bef62e160. {{(pid=72382) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 15:36:53 user nova-compute[72382]: DEBUG nova.network.neutron [req-5152389c-9da6-4c75-8892-c3e90d321ac6 req-43125109-1a10-4623-8455-965a6cf2ec3f service nova] [instance: 402ba448-a30a-45f2-a724-5a53cf584547] Updating instance_info_cache with network_info: [{"id": "a4cb9706-2448-4789-b7ef-8c4bef62e160", "address": "fa:16:3e:e7:e5:94", "network": {"id": "643703fd-46b7-4309-862c-109141cb008c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-512918576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa6db5fd3ce24c1cadbedd64757e219b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4cb9706-24", "ovs_interfaceid": "a4cb9706-2448-4789-b7ef-8c4bef62e160", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:36:53 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-5152389c-9da6-4c75-8892-c3e90d321ac6 req-43125109-1a10-4623-8455-965a6cf2ec3f service nova] Releasing lock "refresh_cache-402ba448-a30a-45f2-a724-5a53cf584547" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 15:36:53 user nova-compute[72382]: DEBUG nova.virt.driver [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Emitting event <LifecycleEvent: 1691595413.6900065, 5607360c-5f17-42b3-a373-6a33a183f92f => Resumed> {{(pid=72382) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 15:36:53 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 5607360c-5f17-42b3-a373-6a33a183f92f] VM Resumed (Lifecycle Event)
Aug 09 15:36:53 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8b51d6ce-08a9-4329-8073-87d9af306a7e tempest-VolumesActionsTest-1154417962 tempest-VolumesActionsTest-1154417962-project-member] [instance: 5607360c-5f17-42b3-a373-6a33a183f92f] Instance event wait completed in 0 seconds for  {{(pid=72382) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 15:36:53 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-8b51d6ce-08a9-4329-8073-87d9af306a7e tempest-VolumesActionsTest-1154417962 tempest-VolumesActionsTest-1154417962-project-member] [instance: 5607360c-5f17-42b3-a373-6a33a183f92f] Guest created on hypervisor {{(pid=72382) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 15:36:53 user nova-compute[72382]: INFO nova.virt.libvirt.driver [-] [instance: 5607360c-5f17-42b3-a373-6a33a183f92f] Instance spawned successfully.
Aug 09 15:36:53 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-8b51d6ce-08a9-4329-8073-87d9af306a7e tempest-VolumesActionsTest-1154417962 tempest-VolumesActionsTest-1154417962-project-member] [instance: 5607360c-5f17-42b3-a373-6a33a183f92f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 15:36:53 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 5607360c-5f17-42b3-a373-6a33a183f92f] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:36:53 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 5607360c-5f17-42b3-a373-6a33a183f92f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72382) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 15:36:53 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-8b51d6ce-08a9-4329-8073-87d9af306a7e tempest-VolumesActionsTest-1154417962 tempest-VolumesActionsTest-1154417962-project-member] [instance: 5607360c-5f17-42b3-a373-6a33a183f92f] Found default for hw_cdrom_bus of ide {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:36:53 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-8b51d6ce-08a9-4329-8073-87d9af306a7e tempest-VolumesActionsTest-1154417962 tempest-VolumesActionsTest-1154417962-project-member] [instance: 5607360c-5f17-42b3-a373-6a33a183f92f] Found default for hw_disk_bus of virtio {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:36:53 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-8b51d6ce-08a9-4329-8073-87d9af306a7e tempest-VolumesActionsTest-1154417962 tempest-VolumesActionsTest-1154417962-project-member] [instance: 5607360c-5f17-42b3-a373-6a33a183f92f] Found default for hw_input_bus of None {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:36:53 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-8b51d6ce-08a9-4329-8073-87d9af306a7e tempest-VolumesActionsTest-1154417962 tempest-VolumesActionsTest-1154417962-project-member] [instance: 5607360c-5f17-42b3-a373-6a33a183f92f] Found default for hw_pointer_model of None {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:36:53 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-8b51d6ce-08a9-4329-8073-87d9af306a7e tempest-VolumesActionsTest-1154417962 tempest-VolumesActionsTest-1154417962-project-member] [instance: 5607360c-5f17-42b3-a373-6a33a183f92f] Found default for hw_video_model of virtio {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:36:53 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-8b51d6ce-08a9-4329-8073-87d9af306a7e tempest-VolumesActionsTest-1154417962 tempest-VolumesActionsTest-1154417962-project-member] [instance: 5607360c-5f17-42b3-a373-6a33a183f92f] Found default for hw_vif_model of virtio {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:36:53 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 5607360c-5f17-42b3-a373-6a33a183f92f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 15:36:53 user nova-compute[72382]: DEBUG nova.virt.driver [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Emitting event <LifecycleEvent: 1691595413.6922534, 5607360c-5f17-42b3-a373-6a33a183f92f => Started> {{(pid=72382) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 15:36:53 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 5607360c-5f17-42b3-a373-6a33a183f92f] VM Started (Lifecycle Event)
Aug 09 15:36:53 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 5607360c-5f17-42b3-a373-6a33a183f92f] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:36:53 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 5607360c-5f17-42b3-a373-6a33a183f92f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72382) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 15:36:53 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 5607360c-5f17-42b3-a373-6a33a183f92f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 15:36:53 user nova-compute[72382]: INFO nova.compute.manager [None req-8b51d6ce-08a9-4329-8073-87d9af306a7e tempest-VolumesActionsTest-1154417962 tempest-VolumesActionsTest-1154417962-project-member] [instance: 5607360c-5f17-42b3-a373-6a33a183f92f] Took 5.73 seconds to spawn the instance on the hypervisor.
Aug 09 15:36:53 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8b51d6ce-08a9-4329-8073-87d9af306a7e tempest-VolumesActionsTest-1154417962 tempest-VolumesActionsTest-1154417962-project-member] [instance: 5607360c-5f17-42b3-a373-6a33a183f92f] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:36:53 user nova-compute[72382]: INFO nova.compute.manager [None req-8b51d6ce-08a9-4329-8073-87d9af306a7e tempest-VolumesActionsTest-1154417962 tempest-VolumesActionsTest-1154417962-project-member] [instance: 5607360c-5f17-42b3-a373-6a33a183f92f] Took 6.62 seconds to build instance.
Aug 09 15:36:53 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-8b51d6ce-08a9-4329-8073-87d9af306a7e tempest-VolumesActionsTest-1154417962 tempest-VolumesActionsTest-1154417962-project-member] Lock "5607360c-5f17-42b3-a373-6a33a183f92f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.726s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:36:53 user nova-compute[72382]: DEBUG nova.compute.manager [req-446207c1-2622-40c6-9948-e54d787178a2 req-11617965-ea89-409f-b45f-acd7fd28d7d1 service nova] [instance: 5607360c-5f17-42b3-a373-6a33a183f92f] Received event network-vif-plugged-c8fa95b9-76c9-4eac-a049-660e46ab4f5e {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:36:53 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-446207c1-2622-40c6-9948-e54d787178a2 req-11617965-ea89-409f-b45f-acd7fd28d7d1 service nova] Acquiring lock "5607360c-5f17-42b3-a373-6a33a183f92f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:36:53 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-446207c1-2622-40c6-9948-e54d787178a2 req-11617965-ea89-409f-b45f-acd7fd28d7d1 service nova] Lock "5607360c-5f17-42b3-a373-6a33a183f92f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:36:53 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-446207c1-2622-40c6-9948-e54d787178a2 req-11617965-ea89-409f-b45f-acd7fd28d7d1 service nova] Lock "5607360c-5f17-42b3-a373-6a33a183f92f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:36:53 user nova-compute[72382]: DEBUG nova.compute.manager [req-446207c1-2622-40c6-9948-e54d787178a2 req-11617965-ea89-409f-b45f-acd7fd28d7d1 service nova] [instance: 5607360c-5f17-42b3-a373-6a33a183f92f] No waiting events found dispatching network-vif-plugged-c8fa95b9-76c9-4eac-a049-660e46ab4f5e {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:36:53 user nova-compute[72382]: WARNING nova.compute.manager [req-446207c1-2622-40c6-9948-e54d787178a2 req-11617965-ea89-409f-b45f-acd7fd28d7d1 service nova] [instance: 5607360c-5f17-42b3-a373-6a33a183f92f] Received unexpected event network-vif-plugged-c8fa95b9-76c9-4eac-a049-660e46ab4f5e for instance with vm_state active and task_state None.
Aug 09 15:36:54 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-f624cbc3-5994-47b0-a206-2870fbe56bba tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.310s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 15:36:54 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-f624cbc3-5994-47b0-a206-2870fbe56bba tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] <== connect_volume: return (1311ms) {'type': 'block', 'scsi_wwn': '23461323063613834', 'path': '/dev/sdb'} {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 15:36:54 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f624cbc3-5994-47b0-a206-2870fbe56bba tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: 2158de7a-1e53-450a-80de-a5c56844feba] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23461323063613834', 'path': '/dev/sdb'} {{(pid=72382) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 15:36:54 user nova-compute[72382]: DEBUG nova.virt.libvirt.vif [None req-f624cbc3-5994-47b0-a206-2870fbe56bba tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T15:36:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-74396283',display_name='tempest-TestVolumeBootPattern-server-74396283',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-74396283',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE2Ft4ugcR+xm9FJQARVlCQBYm313gUcmopkZOKz9jwU+uIeLmDWZczJQzSvB2hHfGE3d6cxNwerl6nmxRdqMq6zUG8hCLpv56gJB1tj7Wzv5bBbh5m7r3DF8/P9Gg51AA==',key_name='tempest-TestVolumeBootPattern-1990844198',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='70310b1af40b4d239fe5ea362972554b',ramdisk_id='',reservation_id='r-8kyudepv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-451643589',owner_user_name='tempest-TestVolumeBootPattern-451643589-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T15:36:44Z,user_data=None,user_id='280bcf2afd7245a7bcd605e0db79c569',uuid=2158de7a-1e53-450a-80de-a5c56844feba,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8fc3cbf4-d7ef-434b-a7b5-b611e919b364", "address": "fa:16:3e:c5:f7:64", "network": {"id": "a78e6cb6-feb7-4f64-a3c0-4900594b6e37", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-338007968-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70310b1af40b4d239fe5ea362972554b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fc3cbf4-d7", "ovs_interfaceid": "8fc3cbf4-d7ef-434b-a7b5-b611e919b364", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72382) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 15:36:54 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-f624cbc3-5994-47b0-a206-2870fbe56bba tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Converting VIF {"id": "8fc3cbf4-d7ef-434b-a7b5-b611e919b364", "address": "fa:16:3e:c5:f7:64", "network": {"id": "a78e6cb6-feb7-4f64-a3c0-4900594b6e37", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-338007968-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70310b1af40b4d239fe5ea362972554b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fc3cbf4-d7", "ovs_interfaceid": "8fc3cbf4-d7ef-434b-a7b5-b611e919b364", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 15:36:54 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-f624cbc3-5994-47b0-a206-2870fbe56bba tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:f7:64,bridge_name='br-int',has_traffic_filtering=True,id=8fc3cbf4-d7ef-434b-a7b5-b611e919b364,network=Network(a78e6cb6-feb7-4f64-a3c0-4900594b6e37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fc3cbf4-d7') {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 15:36:54 user nova-compute[72382]: DEBUG nova.objects.instance [None req-f624cbc3-5994-47b0-a206-2870fbe56bba tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Lazy-loading 'pci_devices' on Instance uuid 2158de7a-1e53-450a-80de-a5c56844feba {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:36:54 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-f624cbc3-5994-47b0-a206-2870fbe56bba tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: 2158de7a-1e53-450a-80de-a5c56844feba] End _get_guest_xml xml=<domain type="kvm">
Aug 09 15:36:54 user nova-compute[72382]:   <uuid>2158de7a-1e53-450a-80de-a5c56844feba</uuid>
Aug 09 15:36:54 user nova-compute[72382]:   <name>instance-0000002a</name>
Aug 09 15:36:54 user nova-compute[72382]:   <memory>524288</memory>
Aug 09 15:36:54 user nova-compute[72382]:   <vcpu>1</vcpu>
Aug 09 15:36:54 user nova-compute[72382]:   <metadata>
Aug 09 15:36:54 user nova-compute[72382]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 15:36:54 user nova-compute[72382]:       <nova:package version="0.0.0"/>
Aug 09 15:36:54 user nova-compute[72382]:       <nova:name>tempest-TestVolumeBootPattern-server-74396283</nova:name>
Aug 09 15:36:54 user nova-compute[72382]:       <nova:creationTime>2023-08-09 15:36:52</nova:creationTime>
Aug 09 15:36:54 user nova-compute[72382]:       <nova:flavor name="m1.tiny">
Aug 09 15:36:54 user nova-compute[72382]:         <nova:memory>512</nova:memory>
Aug 09 15:36:54 user nova-compute[72382]:         <nova:disk>1</nova:disk>
Aug 09 15:36:54 user nova-compute[72382]:         <nova:swap>0</nova:swap>
Aug 09 15:36:54 user nova-compute[72382]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 15:36:54 user nova-compute[72382]:         <nova:vcpus>1</nova:vcpus>
Aug 09 15:36:54 user nova-compute[72382]:       </nova:flavor>
Aug 09 15:36:54 user nova-compute[72382]:       <nova:owner>
Aug 09 15:36:54 user nova-compute[72382]:         <nova:user uuid="280bcf2afd7245a7bcd605e0db79c569">tempest-TestVolumeBootPattern-451643589-project-member</nova:user>
Aug 09 15:36:54 user nova-compute[72382]:         <nova:project uuid="70310b1af40b4d239fe5ea362972554b">tempest-TestVolumeBootPattern-451643589</nova:project>
Aug 09 15:36:54 user nova-compute[72382]:       </nova:owner>
Aug 09 15:36:54 user nova-compute[72382]:       <nova:ports>
Aug 09 15:36:54 user nova-compute[72382]:         <nova:port uuid="8fc3cbf4-d7ef-434b-a7b5-b611e919b364">
Aug 09 15:36:54 user nova-compute[72382]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 09 15:36:54 user nova-compute[72382]:         </nova:port>
Aug 09 15:36:54 user nova-compute[72382]:       </nova:ports>
Aug 09 15:36:54 user nova-compute[72382]:     </nova:instance>
Aug 09 15:36:54 user nova-compute[72382]:   </metadata>
Aug 09 15:36:54 user nova-compute[72382]:   <sysinfo type="smbios">
Aug 09 15:36:54 user nova-compute[72382]:     <system>
Aug 09 15:36:54 user nova-compute[72382]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 15:36:54 user nova-compute[72382]:       <entry name="product">OpenStack Nova</entry>
Aug 09 15:36:54 user nova-compute[72382]:       <entry name="version">0.0.0</entry>
Aug 09 15:36:54 user nova-compute[72382]:       <entry name="serial">2158de7a-1e53-450a-80de-a5c56844feba</entry>
Aug 09 15:36:54 user nova-compute[72382]:       <entry name="uuid">2158de7a-1e53-450a-80de-a5c56844feba</entry>
Aug 09 15:36:54 user nova-compute[72382]:       <entry name="family">Virtual Machine</entry>
Aug 09 15:36:54 user nova-compute[72382]:     </system>
Aug 09 15:36:54 user nova-compute[72382]:   </sysinfo>
Aug 09 15:36:54 user nova-compute[72382]:   <os>
Aug 09 15:36:54 user nova-compute[72382]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 15:36:54 user nova-compute[72382]:     <boot dev="hd"/>
Aug 09 15:36:54 user nova-compute[72382]:     <smbios mode="sysinfo"/>
Aug 09 15:36:54 user nova-compute[72382]:   </os>
Aug 09 15:36:54 user nova-compute[72382]:   <features>
Aug 09 15:36:54 user nova-compute[72382]:     <acpi/>
Aug 09 15:36:54 user nova-compute[72382]:     <apic/>
Aug 09 15:36:54 user nova-compute[72382]:     <vmcoreinfo/>
Aug 09 15:36:54 user nova-compute[72382]:   </features>
Aug 09 15:36:54 user nova-compute[72382]:   <clock offset="utc">
Aug 09 15:36:54 user nova-compute[72382]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 15:36:54 user nova-compute[72382]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 15:36:54 user nova-compute[72382]:     <timer name="hpet" present="no"/>
Aug 09 15:36:54 user nova-compute[72382]:   </clock>
Aug 09 15:36:54 user nova-compute[72382]:   <cpu mode="custom" match="exact">
Aug 09 15:36:54 user nova-compute[72382]:     <model>Nehalem</model>
Aug 09 15:36:54 user nova-compute[72382]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 15:36:54 user nova-compute[72382]:   </cpu>
Aug 09 15:36:54 user nova-compute[72382]:   <devices>
Aug 09 15:36:54 user nova-compute[72382]:     <disk type="block" device="disk">
Aug 09 15:36:54 user nova-compute[72382]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 15:36:54 user nova-compute[72382]:       <source dev="/dev/sdb"/>
Aug 09 15:36:54 user nova-compute[72382]:       <target dev="vda" bus="virtio"/>
Aug 09 15:36:54 user nova-compute[72382]:       <serial>3f58579c-f69a-4bee-b16e-970e5a8f590c</serial>
Aug 09 15:36:54 user nova-compute[72382]:     </disk>
Aug 09 15:36:54 user nova-compute[72382]:     <interface type="ethernet">
Aug 09 15:36:54 user nova-compute[72382]:       <mac address="fa:16:3e:c5:f7:64"/>
Aug 09 15:36:54 user nova-compute[72382]:       <model type="virtio"/>
Aug 09 15:36:54 user nova-compute[72382]:       <mtu size="1442"/>
Aug 09 15:36:54 user nova-compute[72382]:       <target dev="tap8fc3cbf4-d7"/>
Aug 09 15:36:54 user nova-compute[72382]:     </interface>
Aug 09 15:36:54 user nova-compute[72382]:     <serial type="pty">
Aug 09 15:36:54 user nova-compute[72382]:       <log file="/opt/stack/data/nova/instances/2158de7a-1e53-450a-80de-a5c56844feba/console.log" append="off"/>
Aug 09 15:36:54 user nova-compute[72382]:     </serial>
Aug 09 15:36:54 user nova-compute[72382]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 15:36:54 user nova-compute[72382]:     <video>
Aug 09 15:36:54 user nova-compute[72382]:       <model type="virtio"/>
Aug 09 15:36:54 user nova-compute[72382]:     </video>
Aug 09 15:36:54 user nova-compute[72382]:     <rng model="virtio">
Aug 09 15:36:54 user nova-compute[72382]:       <backend model="random">/dev/urandom</backend>
Aug 09 15:36:54 user nova-compute[72382]:     </rng>
Aug 09 15:36:54 user nova-compute[72382]:     <controller type="usb" index="0" model="none"/>
Aug 09 15:36:54 user nova-compute[72382]:     <memballoon model="virtio">
Aug 09 15:36:54 user nova-compute[72382]:       <stats period="10"/>
Aug 09 15:36:54 user nova-compute[72382]:     </memballoon>
Aug 09 15:36:54 user nova-compute[72382]:   </devices>
Aug 09 15:36:54 user nova-compute[72382]: </domain>
Aug 09 15:36:54 user nova-compute[72382]:  {{(pid=72382) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 15:36:54 user nova-compute[72382]: DEBUG nova.virt.libvirt.vif [None req-f624cbc3-5994-47b0-a206-2870fbe56bba tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T15:36:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-74396283',display_name='tempest-TestVolumeBootPattern-server-74396283',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-74396283',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE2Ft4ugcR+xm9FJQARVlCQBYm313gUcmopkZOKz9jwU+uIeLmDWZczJQzSvB2hHfGE3d6cxNwerl6nmxRdqMq6zUG8hCLpv56gJB1tj7Wzv5bBbh5m7r3DF8/P9Gg51AA==',key_name='tempest-TestVolumeBootPattern-1990844198',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='70310b1af40b4d239fe5ea362972554b',ramdisk_id='',reservation_id='r-8kyudepv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-451643589',owner_user_name='tempest-TestVolumeBootPattern-451643589-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T15:36:44Z,user_data=None,user_id='280bcf2afd7245a7bcd605e0db79c569',uuid=2158de7a-1e53-450a-80de-a5c56844feba,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8fc3cbf4-d7ef-434b-a7b5-b611e919b364", "address": "fa:16:3e:c5:f7:64", "network": {"id": "a78e6cb6-feb7-4f64-a3c0-4900594b6e37", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-338007968-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70310b1af40b4d239fe5ea362972554b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fc3cbf4-d7", "ovs_interfaceid": "8fc3cbf4-d7ef-434b-a7b5-b611e919b364", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 15:36:54 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-f624cbc3-5994-47b0-a206-2870fbe56bba tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Converting VIF {"id": "8fc3cbf4-d7ef-434b-a7b5-b611e919b364", "address": "fa:16:3e:c5:f7:64", "network": {"id": "a78e6cb6-feb7-4f64-a3c0-4900594b6e37", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-338007968-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70310b1af40b4d239fe5ea362972554b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fc3cbf4-d7", "ovs_interfaceid": "8fc3cbf4-d7ef-434b-a7b5-b611e919b364", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 15:36:54 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-f624cbc3-5994-47b0-a206-2870fbe56bba tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:f7:64,bridge_name='br-int',has_traffic_filtering=True,id=8fc3cbf4-d7ef-434b-a7b5-b611e919b364,network=Network(a78e6cb6-feb7-4f64-a3c0-4900594b6e37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fc3cbf4-d7') {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 15:36:54 user nova-compute[72382]: DEBUG os_vif [None req-f624cbc3-5994-47b0-a206-2870fbe56bba tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:f7:64,bridge_name='br-int',has_traffic_filtering=True,id=8fc3cbf4-d7ef-434b-a7b5-b611e919b364,network=Network(a78e6cb6-feb7-4f64-a3c0-4900594b6e37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fc3cbf4-d7') {{(pid=72382) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 15:36:54 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:36:54 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:36:54 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 15:36:54 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:36:54 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8fc3cbf4-d7, may_exist=True, interface_attrs={}) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:36:54 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8fc3cbf4-d7, col_values=(('external_ids', {'iface-id': '8fc3cbf4-d7ef-434b-a7b5-b611e919b364', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c5:f7:64', 'vm-uuid': '2158de7a-1e53-450a-80de-a5c56844feba'}),), if_exists=True) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:36:54 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:36:54 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:36:54 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:36:54 user nova-compute[72382]: INFO os_vif [None req-f624cbc3-5994-47b0-a206-2870fbe56bba tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:f7:64,bridge_name='br-int',has_traffic_filtering=True,id=8fc3cbf4-d7ef-434b-a7b5-b611e919b364,network=Network(a78e6cb6-feb7-4f64-a3c0-4900594b6e37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fc3cbf4-d7')
Aug 09 15:36:54 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-f624cbc3-5994-47b0-a206-2870fbe56bba tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] No BDM found with device name vda, not building metadata. {{(pid=72382) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 15:36:54 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-f624cbc3-5994-47b0-a206-2870fbe56bba tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] No VIF found with MAC fa:16:3e:c5:f7:64, not building metadata {{(pid=72382) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 15:36:54 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:36:55 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:36:55 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:36:55 user nova-compute[72382]: DEBUG nova.compute.manager [req-1d144d1f-824c-437d-9c7a-8cac13c057c9 req-b6da03a3-3fb8-4a25-a1f4-51bc22520c6e service nova] [instance: 2158de7a-1e53-450a-80de-a5c56844feba] Received event network-vif-plugged-8fc3cbf4-d7ef-434b-a7b5-b611e919b364 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:36:55 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-1d144d1f-824c-437d-9c7a-8cac13c057c9 req-b6da03a3-3fb8-4a25-a1f4-51bc22520c6e service nova] Acquiring lock "2158de7a-1e53-450a-80de-a5c56844feba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:36:55 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-1d144d1f-824c-437d-9c7a-8cac13c057c9 req-b6da03a3-3fb8-4a25-a1f4-51bc22520c6e service nova] Lock "2158de7a-1e53-450a-80de-a5c56844feba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:36:55 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-1d144d1f-824c-437d-9c7a-8cac13c057c9 req-b6da03a3-3fb8-4a25-a1f4-51bc22520c6e service nova] Lock "2158de7a-1e53-450a-80de-a5c56844feba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:36:55 user nova-compute[72382]: DEBUG nova.compute.manager [req-1d144d1f-824c-437d-9c7a-8cac13c057c9 req-b6da03a3-3fb8-4a25-a1f4-51bc22520c6e service nova] [instance: 2158de7a-1e53-450a-80de-a5c56844feba] No waiting events found dispatching network-vif-plugged-8fc3cbf4-d7ef-434b-a7b5-b611e919b364 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:36:55 user nova-compute[72382]: WARNING nova.compute.manager [req-1d144d1f-824c-437d-9c7a-8cac13c057c9 req-b6da03a3-3fb8-4a25-a1f4-51bc22520c6e service nova] [instance: 2158de7a-1e53-450a-80de-a5c56844feba] Received unexpected event network-vif-plugged-8fc3cbf4-d7ef-434b-a7b5-b611e919b364 for instance with vm_state building and task_state spawning.
Aug 09 15:36:56 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:36:56 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:36:56 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:36:56 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:36:57 user nova-compute[72382]: DEBUG nova.virt.driver [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Emitting event <LifecycleEvent: 1691595417.6794522, 2158de7a-1e53-450a-80de-a5c56844feba => Resumed> {{(pid=72382) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 15:36:57 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 2158de7a-1e53-450a-80de-a5c56844feba] VM Resumed (Lifecycle Event)
Aug 09 15:36:57 user nova-compute[72382]: DEBUG nova.compute.manager [None req-f624cbc3-5994-47b0-a206-2870fbe56bba tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: 2158de7a-1e53-450a-80de-a5c56844feba] Instance event wait completed in 0 seconds for  {{(pid=72382) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 15:36:57 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-f624cbc3-5994-47b0-a206-2870fbe56bba tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: 2158de7a-1e53-450a-80de-a5c56844feba] Guest created on hypervisor {{(pid=72382) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 15:36:57 user nova-compute[72382]: INFO nova.virt.libvirt.driver [-] [instance: 2158de7a-1e53-450a-80de-a5c56844feba] Instance spawned successfully.
Aug 09 15:36:57 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-f624cbc3-5994-47b0-a206-2870fbe56bba tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: 2158de7a-1e53-450a-80de-a5c56844feba] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 15:36:57 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 2158de7a-1e53-450a-80de-a5c56844feba] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:36:57 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 2158de7a-1e53-450a-80de-a5c56844feba] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72382) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 15:36:57 user nova-compute[72382]: DEBUG nova.compute.manager [req-f83440b7-f075-40fb-9f84-74b6c0916318 req-e5cafb38-b086-412d-9696-c6caf5660ae1 service nova] [instance: 2158de7a-1e53-450a-80de-a5c56844feba] Received event network-vif-plugged-8fc3cbf4-d7ef-434b-a7b5-b611e919b364 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:36:57 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-f83440b7-f075-40fb-9f84-74b6c0916318 req-e5cafb38-b086-412d-9696-c6caf5660ae1 service nova] Acquiring lock "2158de7a-1e53-450a-80de-a5c56844feba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:36:57 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-f83440b7-f075-40fb-9f84-74b6c0916318 req-e5cafb38-b086-412d-9696-c6caf5660ae1 service nova] Lock "2158de7a-1e53-450a-80de-a5c56844feba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:36:57 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-f83440b7-f075-40fb-9f84-74b6c0916318 req-e5cafb38-b086-412d-9696-c6caf5660ae1 service nova] Lock "2158de7a-1e53-450a-80de-a5c56844feba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:36:57 user nova-compute[72382]: DEBUG nova.compute.manager [req-f83440b7-f075-40fb-9f84-74b6c0916318 req-e5cafb38-b086-412d-9696-c6caf5660ae1 service nova] [instance: 2158de7a-1e53-450a-80de-a5c56844feba] No waiting events found dispatching network-vif-plugged-8fc3cbf4-d7ef-434b-a7b5-b611e919b364 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:36:57 user nova-compute[72382]: WARNING nova.compute.manager [req-f83440b7-f075-40fb-9f84-74b6c0916318 req-e5cafb38-b086-412d-9696-c6caf5660ae1 service nova] [instance: 2158de7a-1e53-450a-80de-a5c56844feba] Received unexpected event network-vif-plugged-8fc3cbf4-d7ef-434b-a7b5-b611e919b364 for instance with vm_state building and task_state spawning.
Aug 09 15:36:57 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 2158de7a-1e53-450a-80de-a5c56844feba] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 15:36:57 user nova-compute[72382]: DEBUG nova.virt.driver [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Emitting event <LifecycleEvent: 1691595417.6910405, 2158de7a-1e53-450a-80de-a5c56844feba => Started> {{(pid=72382) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 15:36:57 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 2158de7a-1e53-450a-80de-a5c56844feba] VM Started (Lifecycle Event)
Aug 09 15:36:57 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-f624cbc3-5994-47b0-a206-2870fbe56bba tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: 2158de7a-1e53-450a-80de-a5c56844feba] Found default for hw_cdrom_bus of ide {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:36:57 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-f624cbc3-5994-47b0-a206-2870fbe56bba tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: 2158de7a-1e53-450a-80de-a5c56844feba] Found default for hw_disk_bus of virtio {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:36:57 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-f624cbc3-5994-47b0-a206-2870fbe56bba tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: 2158de7a-1e53-450a-80de-a5c56844feba] Found default for hw_input_bus of None {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:36:57 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-f624cbc3-5994-47b0-a206-2870fbe56bba tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: 2158de7a-1e53-450a-80de-a5c56844feba] Found default for hw_pointer_model of None {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:36:57 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-f624cbc3-5994-47b0-a206-2870fbe56bba tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: 2158de7a-1e53-450a-80de-a5c56844feba] Found default for hw_video_model of virtio {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:36:57 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-f624cbc3-5994-47b0-a206-2870fbe56bba tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: 2158de7a-1e53-450a-80de-a5c56844feba] Found default for hw_vif_model of virtio {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:36:57 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 2158de7a-1e53-450a-80de-a5c56844feba] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:36:57 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 2158de7a-1e53-450a-80de-a5c56844feba] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72382) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 15:36:57 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 2158de7a-1e53-450a-80de-a5c56844feba] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 15:36:57 user nova-compute[72382]: INFO nova.compute.manager [None req-f624cbc3-5994-47b0-a206-2870fbe56bba tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: 2158de7a-1e53-450a-80de-a5c56844feba] Took 5.16 seconds to spawn the instance on the hypervisor.
Aug 09 15:36:57 user nova-compute[72382]: DEBUG nova.compute.manager [None req-f624cbc3-5994-47b0-a206-2870fbe56bba tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: 2158de7a-1e53-450a-80de-a5c56844feba] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:36:57 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-01d50e0e-61ee-4b30-b1bc-ba6fdaa80b31 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Acquiring lock "402ba448-a30a-45f2-a724-5a53cf584547" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:36:57 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-01d50e0e-61ee-4b30-b1bc-ba6fdaa80b31 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Lock "402ba448-a30a-45f2-a724-5a53cf584547" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:36:57 user nova-compute[72382]: INFO nova.compute.manager [None req-01d50e0e-61ee-4b30-b1bc-ba6fdaa80b31 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] [instance: 402ba448-a30a-45f2-a724-5a53cf584547] Shelving
Aug 09 15:36:57 user nova-compute[72382]: INFO nova.compute.manager [None req-f624cbc3-5994-47b0-a206-2870fbe56bba tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: 2158de7a-1e53-450a-80de-a5c56844feba] Took 14.59 seconds to build instance.
Aug 09 15:36:57 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-f624cbc3-5994-47b0-a206-2870fbe56bba tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Lock "2158de7a-1e53-450a-80de-a5c56844feba" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.721s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:36:57 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:36:57 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:36:58 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:36:58 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:36:58 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:36:58 user nova-compute[72382]: INFO nova.virt.libvirt.driver [-] [instance: 402ba448-a30a-45f2-a724-5a53cf584547] Instance destroyed successfully.
Aug 09 15:36:58 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-01d50e0e-61ee-4b30-b1bc-ba6fdaa80b31 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] [instance: 402ba448-a30a-45f2-a724-5a53cf584547] Beginning cold snapshot process
Aug 09 15:36:58 user nova-compute[72382]: DEBUG nova.privsep.utils [None req-01d50e0e-61ee-4b30-b1bc-ba6fdaa80b31 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72382) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 09 15:36:58 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-01d50e0e-61ee-4b30-b1bc-ba6fdaa80b31 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/402ba448-a30a-45f2-a724-5a53cf584547/disk /opt/stack/data/nova/instances/snapshots/tmphhdt7lxb/3230f785db954c1387248d4e437f1c91 {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:36:59 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:36:59 user nova-compute[72382]: DEBUG nova.compute.manager [req-b71d3fdf-9635-447b-a649-f23e4a61d2f0 req-6c97b329-8f6b-4347-ad05-e9ce95f7dfea service nova] [instance: 402ba448-a30a-45f2-a724-5a53cf584547] Received event network-vif-unplugged-a4cb9706-2448-4789-b7ef-8c4bef62e160 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:36:59 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-b71d3fdf-9635-447b-a649-f23e4a61d2f0 req-6c97b329-8f6b-4347-ad05-e9ce95f7dfea service nova] Acquiring lock "402ba448-a30a-45f2-a724-5a53cf584547-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:36:59 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-b71d3fdf-9635-447b-a649-f23e4a61d2f0 req-6c97b329-8f6b-4347-ad05-e9ce95f7dfea service nova] Lock "402ba448-a30a-45f2-a724-5a53cf584547-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:36:59 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-b71d3fdf-9635-447b-a649-f23e4a61d2f0 req-6c97b329-8f6b-4347-ad05-e9ce95f7dfea service nova] Lock "402ba448-a30a-45f2-a724-5a53cf584547-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:36:59 user nova-compute[72382]: DEBUG nova.compute.manager [req-b71d3fdf-9635-447b-a649-f23e4a61d2f0 req-6c97b329-8f6b-4347-ad05-e9ce95f7dfea service nova] [instance: 402ba448-a30a-45f2-a724-5a53cf584547] No waiting events found dispatching network-vif-unplugged-a4cb9706-2448-4789-b7ef-8c4bef62e160 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:36:59 user nova-compute[72382]: WARNING nova.compute.manager [req-b71d3fdf-9635-447b-a649-f23e4a61d2f0 req-6c97b329-8f6b-4347-ad05-e9ce95f7dfea service nova] [instance: 402ba448-a30a-45f2-a724-5a53cf584547] Received unexpected event network-vif-unplugged-a4cb9706-2448-4789-b7ef-8c4bef62e160 for instance with vm_state active and task_state shelving_image_pending_upload.
Aug 09 15:36:59 user nova-compute[72382]: DEBUG nova.compute.manager [req-b71d3fdf-9635-447b-a649-f23e4a61d2f0 req-6c97b329-8f6b-4347-ad05-e9ce95f7dfea service nova] [instance: 402ba448-a30a-45f2-a724-5a53cf584547] Received event network-vif-plugged-a4cb9706-2448-4789-b7ef-8c4bef62e160 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:36:59 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-b71d3fdf-9635-447b-a649-f23e4a61d2f0 req-6c97b329-8f6b-4347-ad05-e9ce95f7dfea service nova] Acquiring lock "402ba448-a30a-45f2-a724-5a53cf584547-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:36:59 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-b71d3fdf-9635-447b-a649-f23e4a61d2f0 req-6c97b329-8f6b-4347-ad05-e9ce95f7dfea service nova] Lock "402ba448-a30a-45f2-a724-5a53cf584547-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:36:59 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-b71d3fdf-9635-447b-a649-f23e4a61d2f0 req-6c97b329-8f6b-4347-ad05-e9ce95f7dfea service nova] Lock "402ba448-a30a-45f2-a724-5a53cf584547-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:36:59 user nova-compute[72382]: DEBUG nova.compute.manager [req-b71d3fdf-9635-447b-a649-f23e4a61d2f0 req-6c97b329-8f6b-4347-ad05-e9ce95f7dfea service nova] [instance: 402ba448-a30a-45f2-a724-5a53cf584547] No waiting events found dispatching network-vif-plugged-a4cb9706-2448-4789-b7ef-8c4bef62e160 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:36:59 user nova-compute[72382]: WARNING nova.compute.manager [req-b71d3fdf-9635-447b-a649-f23e4a61d2f0 req-6c97b329-8f6b-4347-ad05-e9ce95f7dfea service nova] [instance: 402ba448-a30a-45f2-a724-5a53cf584547] Received unexpected event network-vif-plugged-a4cb9706-2448-4789-b7ef-8c4bef62e160 for instance with vm_state active and task_state shelving_image_pending_upload.
Aug 09 15:36:59 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:36:59 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-01d50e0e-61ee-4b30-b1bc-ba6fdaa80b31 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/402ba448-a30a-45f2-a724-5a53cf584547/disk /opt/stack/data/nova/instances/snapshots/tmphhdt7lxb/3230f785db954c1387248d4e437f1c91" returned: 0 in 0.885s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:36:59 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-01d50e0e-61ee-4b30-b1bc-ba6fdaa80b31 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] [instance: 402ba448-a30a-45f2-a724-5a53cf584547] Snapshot extracted, beginning image upload
Aug 09 15:37:02 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-01d50e0e-61ee-4b30-b1bc-ba6fdaa80b31 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] [instance: 402ba448-a30a-45f2-a724-5a53cf584547] Snapshot image upload complete
Aug 09 15:37:02 user nova-compute[72382]: DEBUG nova.compute.manager [None req-01d50e0e-61ee-4b30-b1bc-ba6fdaa80b31 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] [instance: 402ba448-a30a-45f2-a724-5a53cf584547] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:37:02 user nova-compute[72382]: INFO nova.compute.manager [None req-01d50e0e-61ee-4b30-b1bc-ba6fdaa80b31 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] [instance: 402ba448-a30a-45f2-a724-5a53cf584547] Shelve offloading
Aug 09 15:37:02 user nova-compute[72382]: INFO nova.virt.libvirt.driver [-] [instance: 402ba448-a30a-45f2-a724-5a53cf584547] Instance destroyed successfully.
Aug 09 15:37:02 user nova-compute[72382]: DEBUG nova.compute.manager [None req-01d50e0e-61ee-4b30-b1bc-ba6fdaa80b31 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] [instance: 402ba448-a30a-45f2-a724-5a53cf584547] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:37:02 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-01d50e0e-61ee-4b30-b1bc-ba6fdaa80b31 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Acquiring lock "refresh_cache-402ba448-a30a-45f2-a724-5a53cf584547" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 15:37:02 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-01d50e0e-61ee-4b30-b1bc-ba6fdaa80b31 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Acquired lock "refresh_cache-402ba448-a30a-45f2-a724-5a53cf584547" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 15:37:02 user nova-compute[72382]: DEBUG nova.network.neutron [None req-01d50e0e-61ee-4b30-b1bc-ba6fdaa80b31 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] [instance: 402ba448-a30a-45f2-a724-5a53cf584547] Building network info cache for instance {{(pid=72382) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 15:37:02 user nova-compute[72382]: DEBUG nova.network.neutron [None req-01d50e0e-61ee-4b30-b1bc-ba6fdaa80b31 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] [instance: 402ba448-a30a-45f2-a724-5a53cf584547] Updating instance_info_cache with network_info: [{"id": "a4cb9706-2448-4789-b7ef-8c4bef62e160", "address": "fa:16:3e:e7:e5:94", "network": {"id": "643703fd-46b7-4309-862c-109141cb008c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-512918576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa6db5fd3ce24c1cadbedd64757e219b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4cb9706-24", "ovs_interfaceid": "a4cb9706-2448-4789-b7ef-8c4bef62e160", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:37:02 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-01d50e0e-61ee-4b30-b1bc-ba6fdaa80b31 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Releasing lock "refresh_cache-402ba448-a30a-45f2-a724-5a53cf584547" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 15:37:03 user nova-compute[72382]: INFO nova.virt.libvirt.driver [-] [instance: 402ba448-a30a-45f2-a724-5a53cf584547] Instance destroyed successfully.
Aug 09 15:37:03 user nova-compute[72382]: DEBUG nova.objects.instance [None req-01d50e0e-61ee-4b30-b1bc-ba6fdaa80b31 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Lazy-loading 'resources' on Instance uuid 402ba448-a30a-45f2-a724-5a53cf584547 {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:37:03 user nova-compute[72382]: DEBUG nova.virt.libvirt.vif [None req-01d50e0e-61ee-4b30-b1bc-ba6fdaa80b31 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T15:35:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-65834704',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-65834704',id=38,image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMF6jGuDbbrqZljy46Ffz2lajM02q0PiUP2BGfP6v9JYu5Gi8oDy4mKIbO973B9Z4PvoU5+/eMR9OoifcYq5Mmsc7SREeeJyOCsTarAp00BSYBslt/NAoCbi98+xt4jnRg==',key_name='tempest-keypair-1104367240',keypairs=<?>,launch_index=0,launched_at=2023-08-09T15:35:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='aa6db5fd3ce24c1cadbedd64757e219b',ramdisk_id='',reservation_id='r-aqp1oexg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1817688709',owner_user_name='tempest-AttachVolumeShelveTestJSON-1817688709-project-member',shelved_at='2023-08-09T15:37:02.289294',shelved_host='user',shelved_image_id='f59f6193-09d1-444a-b9c2-f9fccd2f1058'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T15:37:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9f95e50aa6194e778dfaee31e6e2fa68',uuid=402ba448-a30a-45f2-a724-5a53cf584547,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "a4cb9706-2448-4789-b7ef-8c4bef62e160", "address": "fa:16:3e:e7:e5:94", "network": {"id": "643703fd-46b7-4309-862c-109141cb008c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-512918576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa6db5fd3ce24c1cadbedd64757e219b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4cb9706-24", "ovs_interfaceid": "a4cb9706-2448-4789-b7ef-8c4bef62e160", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 15:37:03 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-01d50e0e-61ee-4b30-b1bc-ba6fdaa80b31 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Converting VIF {"id": "a4cb9706-2448-4789-b7ef-8c4bef62e160", "address": "fa:16:3e:e7:e5:94", "network": {"id": "643703fd-46b7-4309-862c-109141cb008c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-512918576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa6db5fd3ce24c1cadbedd64757e219b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4cb9706-24", "ovs_interfaceid": "a4cb9706-2448-4789-b7ef-8c4bef62e160", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 15:37:03 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-01d50e0e-61ee-4b30-b1bc-ba6fdaa80b31 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:e5:94,bridge_name='br-int',has_traffic_filtering=True,id=a4cb9706-2448-4789-b7ef-8c4bef62e160,network=Network(643703fd-46b7-4309-862c-109141cb008c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4cb9706-24') {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 15:37:03 user nova-compute[72382]: DEBUG os_vif [None req-01d50e0e-61ee-4b30-b1bc-ba6fdaa80b31 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:e5:94,bridge_name='br-int',has_traffic_filtering=True,id=a4cb9706-2448-4789-b7ef-8c4bef62e160,network=Network(643703fd-46b7-4309-862c-109141cb008c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4cb9706-24') {{(pid=72382) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 15:37:03 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:37:03 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa4cb9706-24, bridge=br-int, if_exists=True) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:37:03 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:37:03 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:37:03 user nova-compute[72382]: INFO os_vif [None req-01d50e0e-61ee-4b30-b1bc-ba6fdaa80b31 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:e5:94,bridge_name='br-int',has_traffic_filtering=True,id=a4cb9706-2448-4789-b7ef-8c4bef62e160,network=Network(643703fd-46b7-4309-862c-109141cb008c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4cb9706-24')
Aug 09 15:37:03 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-01d50e0e-61ee-4b30-b1bc-ba6fdaa80b31 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] [instance: 402ba448-a30a-45f2-a724-5a53cf584547] Deleting instance files /opt/stack/data/nova/instances/402ba448-a30a-45f2-a724-5a53cf584547_del
Aug 09 15:37:03 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-01d50e0e-61ee-4b30-b1bc-ba6fdaa80b31 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] [instance: 402ba448-a30a-45f2-a724-5a53cf584547] Deletion of /opt/stack/data/nova/instances/402ba448-a30a-45f2-a724-5a53cf584547_del complete
Aug 09 15:37:03 user nova-compute[72382]: DEBUG nova.compute.manager [req-4f6df6a9-2ff7-47f7-a6c3-c45e15bec20f req-fbeb3436-361d-471d-bd29-24a51abd99e6 service nova] [instance: 402ba448-a30a-45f2-a724-5a53cf584547] Received event network-changed-a4cb9706-2448-4789-b7ef-8c4bef62e160 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:37:03 user nova-compute[72382]: DEBUG nova.compute.manager [req-4f6df6a9-2ff7-47f7-a6c3-c45e15bec20f req-fbeb3436-361d-471d-bd29-24a51abd99e6 service nova] [instance: 402ba448-a30a-45f2-a724-5a53cf584547] Refreshing instance network info cache due to event network-changed-a4cb9706-2448-4789-b7ef-8c4bef62e160. {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 15:37:03 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-4f6df6a9-2ff7-47f7-a6c3-c45e15bec20f req-fbeb3436-361d-471d-bd29-24a51abd99e6 service nova] Acquiring lock "refresh_cache-402ba448-a30a-45f2-a724-5a53cf584547" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 15:37:03 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-4f6df6a9-2ff7-47f7-a6c3-c45e15bec20f req-fbeb3436-361d-471d-bd29-24a51abd99e6 service nova] Acquired lock "refresh_cache-402ba448-a30a-45f2-a724-5a53cf584547" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 15:37:03 user nova-compute[72382]: DEBUG nova.network.neutron [req-4f6df6a9-2ff7-47f7-a6c3-c45e15bec20f req-fbeb3436-361d-471d-bd29-24a51abd99e6 service nova] [instance: 402ba448-a30a-45f2-a724-5a53cf584547] Refreshing network info cache for port a4cb9706-2448-4789-b7ef-8c4bef62e160 {{(pid=72382) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 15:37:03 user nova-compute[72382]: INFO nova.scheduler.client.report [None req-01d50e0e-61ee-4b30-b1bc-ba6fdaa80b31 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Deleted allocations for instance 402ba448-a30a-45f2-a724-5a53cf584547
Aug 09 15:37:03 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-01d50e0e-61ee-4b30-b1bc-ba6fdaa80b31 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:37:03 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-01d50e0e-61ee-4b30-b1bc-ba6fdaa80b31 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:37:03 user nova-compute[72382]: DEBUG nova.objects.instance [None req-01d50e0e-61ee-4b30-b1bc-ba6fdaa80b31 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Lazy-loading 'numa_topology' on Instance uuid 402ba448-a30a-45f2-a724-5a53cf584547 {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:37:03 user nova-compute[72382]: DEBUG nova.compute.provider_tree [None req-01d50e0e-61ee-4b30-b1bc-ba6fdaa80b31 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Inventory has not changed in ProviderTree for provider: 7b15b0e5-df4d-49db-833b-2855d21d10ae {{(pid=72382) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 15:37:04 user nova-compute[72382]: DEBUG nova.scheduler.client.report [None req-01d50e0e-61ee-4b30-b1bc-ba6fdaa80b31 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Inventory has not changed for provider 7b15b0e5-df4d-49db-833b-2855d21d10ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72382) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 15:37:04 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-01d50e0e-61ee-4b30-b1bc-ba6fdaa80b31 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.297s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:37:04 user nova-compute[72382]: DEBUG nova.network.neutron [req-4f6df6a9-2ff7-47f7-a6c3-c45e15bec20f req-fbeb3436-361d-471d-bd29-24a51abd99e6 service nova] [instance: 402ba448-a30a-45f2-a724-5a53cf584547] Updated VIF entry in instance network info cache for port a4cb9706-2448-4789-b7ef-8c4bef62e160. {{(pid=72382) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 15:37:04 user nova-compute[72382]: DEBUG nova.network.neutron [req-4f6df6a9-2ff7-47f7-a6c3-c45e15bec20f req-fbeb3436-361d-471d-bd29-24a51abd99e6 service nova] [instance: 402ba448-a30a-45f2-a724-5a53cf584547] Updating instance_info_cache with network_info: [{"id": "a4cb9706-2448-4789-b7ef-8c4bef62e160", "address": "fa:16:3e:e7:e5:94", "network": {"id": "643703fd-46b7-4309-862c-109141cb008c", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-512918576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa6db5fd3ce24c1cadbedd64757e219b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapa4cb9706-24", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:37:04 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-4f6df6a9-2ff7-47f7-a6c3-c45e15bec20f req-fbeb3436-361d-471d-bd29-24a51abd99e6 service nova] Releasing lock "refresh_cache-402ba448-a30a-45f2-a724-5a53cf584547" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 15:37:04 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-01d50e0e-61ee-4b30-b1bc-ba6fdaa80b31 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Lock "402ba448-a30a-45f2-a724-5a53cf584547" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 6.258s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:37:08 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:37:09 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:37:13 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:37:13 user nova-compute[72382]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691595418.6753225, 402ba448-a30a-45f2-a724-5a53cf584547 => Stopped> {{(pid=72382) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 15:37:13 user nova-compute[72382]: INFO nova.compute.manager [-] [instance: 402ba448-a30a-45f2-a724-5a53cf584547] VM Stopped (Lifecycle Event)
Aug 09 15:37:13 user nova-compute[72382]: DEBUG nova.compute.manager [None req-e481a4ee-a82f-410f-b9eb-0eeded6bb3ef None None] [instance: 402ba448-a30a-45f2-a724-5a53cf584547] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:37:14 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:37:14 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:37:14 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:37:14 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:37:14 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:37:14 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Auditing locally available compute resources for user (node: user) {{(pid=72382) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 15:37:15 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d66443a2-2dc1-46f6-9572-f0717f830927/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:37:15 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d66443a2-2dc1-46f6-9572-f0717f830927/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:37:15 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d66443a2-2dc1-46f6-9572-f0717f830927/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:37:15 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d66443a2-2dc1-46f6-9572-f0717f830927/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:37:15 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5607360c-5f17-42b3-a373-6a33a183f92f/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:37:15 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5607360c-5f17-42b3-a373-6a33a183f92f/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:37:15 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5607360c-5f17-42b3-a373-6a33a183f92f/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:37:15 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5607360c-5f17-42b3-a373-6a33a183f92f/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:37:15 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7949b7d0-2712-402f-86ee-30acaef2d3e7/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:37:15 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7949b7d0-2712-402f-86ee-30acaef2d3e7/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:37:15 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7949b7d0-2712-402f-86ee-30acaef2d3e7/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:37:15 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7949b7d0-2712-402f-86ee-30acaef2d3e7/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:37:15 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ccbfda2-8bcd-4ec1-972a-cf49a62b1583/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:37:16 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ccbfda2-8bcd-4ec1-972a-cf49a62b1583/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:37:16 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ccbfda2-8bcd-4ec1-972a-cf49a62b1583/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:37:16 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ccbfda2-8bcd-4ec1-972a-cf49a62b1583/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:37:16 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/429ebe93-dd7a-41c4-b80a-0379d3816402/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:37:16 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/429ebe93-dd7a-41c4-b80a-0379d3816402/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:37:16 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/429ebe93-dd7a-41c4-b80a-0379d3816402/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:37:16 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/429ebe93-dd7a-41c4-b80a-0379d3816402/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:37:16 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72382) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 15:37:16 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72382) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 15:37:16 user nova-compute[72382]: WARNING nova.virt.libvirt.driver [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 15:37:16 user nova-compute[72382]: WARNING nova.virt.libvirt.driver [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 15:37:16 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Hypervisor/Node resource view: name=user free_ram=7690MB free_disk=25.332454681396484GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72382) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 15:37:16 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:37:16 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:37:17 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance 4ccbfda2-8bcd-4ec1-972a-cf49a62b1583 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:37:17 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance 429ebe93-dd7a-41c4-b80a-0379d3816402 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:37:17 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance 54523d3e-bfae-4621-85cb-d6a7bc40abf5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:37:17 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance 7949b7d0-2712-402f-86ee-30acaef2d3e7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:37:17 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance d66443a2-2dc1-46f6-9572-f0717f830927 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:37:17 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance 2158de7a-1e53-450a-80de-a5c56844feba actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:37:17 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance 5607360c-5f17-42b3-a373-6a33a183f92f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:37:17 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=72382) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 15:37:17 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=72382) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 15:37:17 user nova-compute[72382]: DEBUG nova.compute.provider_tree [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Inventory has not changed in ProviderTree for provider: 7b15b0e5-df4d-49db-833b-2855d21d10ae {{(pid=72382) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 15:37:17 user nova-compute[72382]: DEBUG nova.scheduler.client.report [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Inventory has not changed for provider 7b15b0e5-df4d-49db-833b-2855d21d10ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72382) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 15:37:17 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-ed2bd2f5-22b5-4079-9743-a090603bc8cb tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Acquiring lock "429ebe93-dd7a-41c4-b80a-0379d3816402" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:37:17 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-ed2bd2f5-22b5-4079-9743-a090603bc8cb tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Lock "429ebe93-dd7a-41c4-b80a-0379d3816402" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:37:17 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-ed2bd2f5-22b5-4079-9743-a090603bc8cb tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Acquiring lock "429ebe93-dd7a-41c4-b80a-0379d3816402-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:37:17 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-ed2bd2f5-22b5-4079-9743-a090603bc8cb tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Lock "429ebe93-dd7a-41c4-b80a-0379d3816402-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:37:17 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-ed2bd2f5-22b5-4079-9743-a090603bc8cb tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Lock "429ebe93-dd7a-41c4-b80a-0379d3816402-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:37:17 user nova-compute[72382]: INFO nova.compute.manager [None req-ed2bd2f5-22b5-4079-9743-a090603bc8cb tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] [instance: 429ebe93-dd7a-41c4-b80a-0379d3816402] Terminating instance
Aug 09 15:37:17 user nova-compute[72382]: DEBUG nova.compute.manager [None req-ed2bd2f5-22b5-4079-9743-a090603bc8cb tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] [instance: 429ebe93-dd7a-41c4-b80a-0379d3816402] Start destroying the instance on the hypervisor. {{(pid=72382) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 15:37:17 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Compute_service record updated for user:user {{(pid=72382) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 15:37:17 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.357s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:37:17 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:37:17 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:37:17 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:37:17 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:37:17 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:37:17 user nova-compute[72382]: DEBUG nova.compute.manager [req-f5a1dead-5d35-4ff4-9f0c-025a7b0f0d7f req-5e454ce8-58e3-4d06-bc0c-0ef1b86aeab9 service nova] [instance: 429ebe93-dd7a-41c4-b80a-0379d3816402] Received event network-vif-unplugged-d7669ab9-996e-4cf6-82a3-0083fbb7fa5c {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:37:17 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-f5a1dead-5d35-4ff4-9f0c-025a7b0f0d7f req-5e454ce8-58e3-4d06-bc0c-0ef1b86aeab9 service nova] Acquiring lock "429ebe93-dd7a-41c4-b80a-0379d3816402-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:37:17 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-f5a1dead-5d35-4ff4-9f0c-025a7b0f0d7f req-5e454ce8-58e3-4d06-bc0c-0ef1b86aeab9 service nova] Lock "429ebe93-dd7a-41c4-b80a-0379d3816402-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:37:17 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-f5a1dead-5d35-4ff4-9f0c-025a7b0f0d7f req-5e454ce8-58e3-4d06-bc0c-0ef1b86aeab9 service nova] Lock "429ebe93-dd7a-41c4-b80a-0379d3816402-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:37:17 user nova-compute[72382]: DEBUG nova.compute.manager [req-f5a1dead-5d35-4ff4-9f0c-025a7b0f0d7f req-5e454ce8-58e3-4d06-bc0c-0ef1b86aeab9 service nova] [instance: 429ebe93-dd7a-41c4-b80a-0379d3816402] No waiting events found dispatching network-vif-unplugged-d7669ab9-996e-4cf6-82a3-0083fbb7fa5c {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:37:17 user nova-compute[72382]: DEBUG nova.compute.manager [req-f5a1dead-5d35-4ff4-9f0c-025a7b0f0d7f req-5e454ce8-58e3-4d06-bc0c-0ef1b86aeab9 service nova] [instance: 429ebe93-dd7a-41c4-b80a-0379d3816402] Received event network-vif-unplugged-d7669ab9-996e-4cf6-82a3-0083fbb7fa5c for instance with task_state deleting. {{(pid=72382) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 15:37:18 user nova-compute[72382]: INFO nova.virt.libvirt.driver [-] [instance: 429ebe93-dd7a-41c4-b80a-0379d3816402] Instance destroyed successfully.
Aug 09 15:37:18 user nova-compute[72382]: DEBUG nova.objects.instance [None req-ed2bd2f5-22b5-4079-9743-a090603bc8cb tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Lazy-loading 'resources' on Instance uuid 429ebe93-dd7a-41c4-b80a-0379d3816402 {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:37:18 user nova-compute[72382]: DEBUG nova.virt.libvirt.vif [None req-ed2bd2f5-22b5-4079-9743-a090603bc8cb tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T15:34:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-554390021',display_name='tempest-AttachVolumeNegativeTest-server-554390021',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-554390021',id=36,image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPr9UKLHRdNpgLNg1y/Qg5MQvxAflbKswHUG5+9EhnkuIACQbwD4DtPjuy/KhcLwWGdSuifIZaH2x296ZeqXrcCbIeVsn4VdvhRheyfe1WPiSZsf3ywZ+N4qEbGvdtwrYg==',key_name='tempest-keypair-1273601612',keypairs=<?>,launch_index=0,launched_at=2023-08-09T15:34:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='98009994d9c74eb9b4fc6321e82440de',ramdisk_id='',reservation_id='r-rcnmt08c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1325594356',owner_user_name='tempest-AttachVolumeNegativeTest-1325594356-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T15:34:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='401c9df41f284c88a86557485d7d9537',uuid=429ebe93-dd7a-41c4-b80a-0379d3816402,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d7669ab9-996e-4cf6-82a3-0083fbb7fa5c", "address": "fa:16:3e:18:b4:42", "network": {"id": "46eb5f03-e04d-43d1-96d6-0792bc7a94b1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1842512309-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98009994d9c74eb9b4fc6321e82440de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7669ab9-99", "ovs_interfaceid": "d7669ab9-996e-4cf6-82a3-0083fbb7fa5c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 15:37:18 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-ed2bd2f5-22b5-4079-9743-a090603bc8cb tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Converting VIF {"id": "d7669ab9-996e-4cf6-82a3-0083fbb7fa5c", "address": "fa:16:3e:18:b4:42", "network": {"id": "46eb5f03-e04d-43d1-96d6-0792bc7a94b1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1842512309-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98009994d9c74eb9b4fc6321e82440de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7669ab9-99", "ovs_interfaceid": "d7669ab9-996e-4cf6-82a3-0083fbb7fa5c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 15:37:18 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-ed2bd2f5-22b5-4079-9743-a090603bc8cb tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:18:b4:42,bridge_name='br-int',has_traffic_filtering=True,id=d7669ab9-996e-4cf6-82a3-0083fbb7fa5c,network=Network(46eb5f03-e04d-43d1-96d6-0792bc7a94b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7669ab9-99') {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 15:37:18 user nova-compute[72382]: DEBUG os_vif [None req-ed2bd2f5-22b5-4079-9743-a090603bc8cb tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:18:b4:42,bridge_name='br-int',has_traffic_filtering=True,id=d7669ab9-996e-4cf6-82a3-0083fbb7fa5c,network=Network(46eb5f03-e04d-43d1-96d6-0792bc7a94b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7669ab9-99') {{(pid=72382) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 15:37:18 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:37:18 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd7669ab9-99, bridge=br-int, if_exists=True) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:37:18 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:37:18 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:37:18 user nova-compute[72382]: INFO os_vif [None req-ed2bd2f5-22b5-4079-9743-a090603bc8cb tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:18:b4:42,bridge_name='br-int',has_traffic_filtering=True,id=d7669ab9-996e-4cf6-82a3-0083fbb7fa5c,network=Network(46eb5f03-e04d-43d1-96d6-0792bc7a94b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7669ab9-99')
Aug 09 15:37:18 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-ed2bd2f5-22b5-4079-9743-a090603bc8cb tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] [instance: 429ebe93-dd7a-41c4-b80a-0379d3816402] Deleting instance files /opt/stack/data/nova/instances/429ebe93-dd7a-41c4-b80a-0379d3816402_del
Aug 09 15:37:18 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-ed2bd2f5-22b5-4079-9743-a090603bc8cb tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] [instance: 429ebe93-dd7a-41c4-b80a-0379d3816402] Deletion of /opt/stack/data/nova/instances/429ebe93-dd7a-41c4-b80a-0379d3816402_del complete
Aug 09 15:37:18 user nova-compute[72382]: INFO nova.compute.manager [None req-ed2bd2f5-22b5-4079-9743-a090603bc8cb tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] [instance: 429ebe93-dd7a-41c4-b80a-0379d3816402] Took 0.94 seconds to destroy the instance on the hypervisor.
Aug 09 15:37:18 user nova-compute[72382]: DEBUG oslo.service.loopingcall [None req-ed2bd2f5-22b5-4079-9743-a090603bc8cb tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72382) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 15:37:18 user nova-compute[72382]: DEBUG nova.compute.manager [-] [instance: 429ebe93-dd7a-41c4-b80a-0379d3816402] Deallocating network for instance {{(pid=72382) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 15:37:18 user nova-compute[72382]: DEBUG nova.network.neutron [-] [instance: 429ebe93-dd7a-41c4-b80a-0379d3816402] deallocate_for_instance() {{(pid=72382) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 15:37:18 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:37:18 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:37:18 user nova-compute[72382]: DEBUG nova.compute.manager [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Starting heal instance info cache {{(pid=72382) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 15:37:18 user nova-compute[72382]: DEBUG nova.compute.manager [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] [instance: 429ebe93-dd7a-41c4-b80a-0379d3816402] Skipping network cache update for instance because it is being deleted. {{(pid=72382) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9891}}
Aug 09 15:37:18 user nova-compute[72382]: DEBUG nova.compute.manager [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] [instance: c88a5ff2-9789-4ee8-8283-6248bba6d66a] Skipping network cache update for instance because it has been migrated to another host. {{(pid=72382) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9886}}
Aug 09 15:37:18 user nova-compute[72382]: DEBUG nova.compute.manager [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] [instance: 402ba448-a30a-45f2-a724-5a53cf584547] Skipping network cache update for instance because it has been migrated to another host. {{(pid=72382) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9886}}
Aug 09 15:37:19 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Acquiring lock "refresh_cache-54523d3e-bfae-4621-85cb-d6a7bc40abf5" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 15:37:19 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Acquired lock "refresh_cache-54523d3e-bfae-4621-85cb-d6a7bc40abf5" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 15:37:19 user nova-compute[72382]: DEBUG nova.network.neutron [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] [instance: 54523d3e-bfae-4621-85cb-d6a7bc40abf5] Forcefully refreshing network info cache for instance {{(pid=72382) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 15:37:19 user nova-compute[72382]: DEBUG nova.network.neutron [-] [instance: 429ebe93-dd7a-41c4-b80a-0379d3816402] Updating instance_info_cache with network_info: [] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:37:19 user nova-compute[72382]: INFO nova.compute.manager [-] [instance: 429ebe93-dd7a-41c4-b80a-0379d3816402] Took 1.25 seconds to deallocate network for instance.
Aug 09 15:37:19 user nova-compute[72382]: DEBUG nova.compute.manager [req-31bdd45f-73eb-4cc6-bb8e-0a3ea651ebae req-856803d4-b652-438c-8bb2-7ca63fcdeb8d service nova] [instance: 429ebe93-dd7a-41c4-b80a-0379d3816402] Received event network-vif-deleted-d7669ab9-996e-4cf6-82a3-0083fbb7fa5c {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:37:19 user nova-compute[72382]: INFO nova.compute.manager [req-31bdd45f-73eb-4cc6-bb8e-0a3ea651ebae req-856803d4-b652-438c-8bb2-7ca63fcdeb8d service nova] [instance: 429ebe93-dd7a-41c4-b80a-0379d3816402] Neutron deleted interface d7669ab9-996e-4cf6-82a3-0083fbb7fa5c; detaching it from the instance and deleting it from the info cache
Aug 09 15:37:19 user nova-compute[72382]: DEBUG nova.network.neutron [req-31bdd45f-73eb-4cc6-bb8e-0a3ea651ebae req-856803d4-b652-438c-8bb2-7ca63fcdeb8d service nova] [instance: 429ebe93-dd7a-41c4-b80a-0379d3816402] Updating instance_info_cache with network_info: [] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:37:19 user nova-compute[72382]: DEBUG nova.compute.manager [req-31bdd45f-73eb-4cc6-bb8e-0a3ea651ebae req-856803d4-b652-438c-8bb2-7ca63fcdeb8d service nova] [instance: 429ebe93-dd7a-41c4-b80a-0379d3816402] Detach interface failed, port_id=d7669ab9-996e-4cf6-82a3-0083fbb7fa5c, reason: Instance 429ebe93-dd7a-41c4-b80a-0379d3816402 could not be found. {{(pid=72382) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 09 15:37:19 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-ed2bd2f5-22b5-4079-9743-a090603bc8cb tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:37:19 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-ed2bd2f5-22b5-4079-9743-a090603bc8cb tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:37:19 user nova-compute[72382]: DEBUG nova.network.neutron [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] [instance: 54523d3e-bfae-4621-85cb-d6a7bc40abf5] Updating instance_info_cache with network_info: [{"id": "8557ab28-9722-4e6e-a14d-f941e3b693c8", "address": "fa:16:3e:40:5f:a8", "network": {"id": "308641dc-cc18-41db-9baa-7cc880e594ad", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1932973397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb5bf3f95d2843af94dbcab2af932bd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8557ab28-97", "ovs_interfaceid": "8557ab28-9722-4e6e-a14d-f941e3b693c8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:37:19 user nova-compute[72382]: DEBUG nova.compute.provider_tree [None req-ed2bd2f5-22b5-4079-9743-a090603bc8cb tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Inventory has not changed in ProviderTree for provider: 7b15b0e5-df4d-49db-833b-2855d21d10ae {{(pid=72382) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 15:37:19 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:37:19 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Releasing lock "refresh_cache-54523d3e-bfae-4621-85cb-d6a7bc40abf5" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 15:37:19 user nova-compute[72382]: DEBUG nova.compute.manager [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] [instance: 54523d3e-bfae-4621-85cb-d6a7bc40abf5] Updated the network info_cache for instance {{(pid=72382) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 15:37:19 user nova-compute[72382]: DEBUG nova.scheduler.client.report [None req-ed2bd2f5-22b5-4079-9743-a090603bc8cb tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Inventory has not changed for provider 7b15b0e5-df4d-49db-833b-2855d21d10ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72382) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 15:37:19 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:37:19 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-ed2bd2f5-22b5-4079-9743-a090603bc8cb tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.247s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:37:19 user nova-compute[72382]: INFO nova.scheduler.client.report [None req-ed2bd2f5-22b5-4079-9743-a090603bc8cb tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Deleted allocations for instance 429ebe93-dd7a-41c4-b80a-0379d3816402
Aug 09 15:37:19 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-ed2bd2f5-22b5-4079-9743-a090603bc8cb tempest-AttachVolumeNegativeTest-1325594356 tempest-AttachVolumeNegativeTest-1325594356-project-member] Lock "429ebe93-dd7a-41c4-b80a-0379d3816402" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.607s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:37:19 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8b1a1887-7c4b-4ffc-9dba-52515b7787a1 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] [instance: 54523d3e-bfae-4621-85cb-d6a7bc40abf5] Stashing vm_state: active {{(pid=72382) _prep_resize /opt/stack/nova/nova/compute/manager.py:5535}}
Aug 09 15:37:20 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-8b1a1887-7c4b-4ffc-9dba-52515b7787a1 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:37:20 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-8b1a1887-7c4b-4ffc-9dba-52515b7787a1 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:37:20 user nova-compute[72382]: DEBUG nova.objects.instance [None req-8b1a1887-7c4b-4ffc-9dba-52515b7787a1 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Lazy-loading 'pci_requests' on Instance uuid 54523d3e-bfae-4621-85cb-d6a7bc40abf5 {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:37:20 user nova-compute[72382]: DEBUG nova.compute.manager [req-5075c96a-c86d-49e8-899a-8940c33c0f4a req-226d5c84-369d-446b-bbac-c31f9e47b76d service nova] [instance: 4ccbfda2-8bcd-4ec1-972a-cf49a62b1583] Received event network-changed-2d07e6a3-03b7-4035-bdd2-a95435b99852 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:37:20 user nova-compute[72382]: DEBUG nova.compute.manager [req-5075c96a-c86d-49e8-899a-8940c33c0f4a req-226d5c84-369d-446b-bbac-c31f9e47b76d service nova] [instance: 4ccbfda2-8bcd-4ec1-972a-cf49a62b1583] Refreshing instance network info cache due to event network-changed-2d07e6a3-03b7-4035-bdd2-a95435b99852. {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 15:37:20 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-5075c96a-c86d-49e8-899a-8940c33c0f4a req-226d5c84-369d-446b-bbac-c31f9e47b76d service nova] Acquiring lock "refresh_cache-4ccbfda2-8bcd-4ec1-972a-cf49a62b1583" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 15:37:20 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-5075c96a-c86d-49e8-899a-8940c33c0f4a req-226d5c84-369d-446b-bbac-c31f9e47b76d service nova] Acquired lock "refresh_cache-4ccbfda2-8bcd-4ec1-972a-cf49a62b1583" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 15:37:20 user nova-compute[72382]: DEBUG nova.network.neutron [req-5075c96a-c86d-49e8-899a-8940c33c0f4a req-226d5c84-369d-446b-bbac-c31f9e47b76d service nova] [instance: 4ccbfda2-8bcd-4ec1-972a-cf49a62b1583] Refreshing network info cache for port 2d07e6a3-03b7-4035-bdd2-a95435b99852 {{(pid=72382) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 15:37:20 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-8b1a1887-7c4b-4ffc-9dba-52515b7787a1 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72382) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 15:37:20 user nova-compute[72382]: INFO nova.compute.claims [None req-8b1a1887-7c4b-4ffc-9dba-52515b7787a1 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] [instance: 54523d3e-bfae-4621-85cb-d6a7bc40abf5] Claim successful on node user
Aug 09 15:37:20 user nova-compute[72382]: DEBUG nova.objects.instance [None req-8b1a1887-7c4b-4ffc-9dba-52515b7787a1 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Lazy-loading 'resources' on Instance uuid 54523d3e-bfae-4621-85cb-d6a7bc40abf5 {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:37:20 user nova-compute[72382]: DEBUG nova.objects.instance [None req-8b1a1887-7c4b-4ffc-9dba-52515b7787a1 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Lazy-loading 'pci_devices' on Instance uuid 54523d3e-bfae-4621-85cb-d6a7bc40abf5 {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:37:20 user nova-compute[72382]: INFO nova.compute.resource_tracker [None req-8b1a1887-7c4b-4ffc-9dba-52515b7787a1 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] [instance: 54523d3e-bfae-4621-85cb-d6a7bc40abf5] Updating resource usage from migration c31f6e97-fa8b-4d15-9ea5-540eb0d7d304
Aug 09 15:37:20 user nova-compute[72382]: DEBUG nova.compute.provider_tree [None req-8b1a1887-7c4b-4ffc-9dba-52515b7787a1 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Inventory has not changed in ProviderTree for provider: 7b15b0e5-df4d-49db-833b-2855d21d10ae {{(pid=72382) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 15:37:20 user nova-compute[72382]: DEBUG nova.scheduler.client.report [None req-8b1a1887-7c4b-4ffc-9dba-52515b7787a1 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Inventory has not changed for provider 7b15b0e5-df4d-49db-833b-2855d21d10ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72382) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 15:37:20 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-8b1a1887-7c4b-4ffc-9dba-52515b7787a1 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.360s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:37:20 user nova-compute[72382]: INFO nova.compute.manager [None req-8b1a1887-7c4b-4ffc-9dba-52515b7787a1 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] [instance: 54523d3e-bfae-4621-85cb-d6a7bc40abf5] Migrating
Aug 09 15:37:20 user nova-compute[72382]: DEBUG nova.network.neutron [req-5075c96a-c86d-49e8-899a-8940c33c0f4a req-226d5c84-369d-446b-bbac-c31f9e47b76d service nova] [instance: 4ccbfda2-8bcd-4ec1-972a-cf49a62b1583] Updated VIF entry in instance network info cache for port 2d07e6a3-03b7-4035-bdd2-a95435b99852. {{(pid=72382) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 15:37:20 user nova-compute[72382]: DEBUG nova.network.neutron [req-5075c96a-c86d-49e8-899a-8940c33c0f4a req-226d5c84-369d-446b-bbac-c31f9e47b76d service nova] [instance: 4ccbfda2-8bcd-4ec1-972a-cf49a62b1583] Updating instance_info_cache with network_info: [{"id": "2d07e6a3-03b7-4035-bdd2-a95435b99852", "address": "fa:16:3e:9a:d4:3a", "network": {"id": "308641dc-cc18-41db-9baa-7cc880e594ad", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1932973397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb5bf3f95d2843af94dbcab2af932bd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d07e6a3-03", "ovs_interfaceid": "2d07e6a3-03b7-4035-bdd2-a95435b99852", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:37:20 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-5075c96a-c86d-49e8-899a-8940c33c0f4a req-226d5c84-369d-446b-bbac-c31f9e47b76d service nova] Releasing lock "refresh_cache-4ccbfda2-8bcd-4ec1-972a-cf49a62b1583" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 15:37:20 user nova-compute[72382]: DEBUG nova.compute.manager [req-5075c96a-c86d-49e8-899a-8940c33c0f4a req-226d5c84-369d-446b-bbac-c31f9e47b76d service nova] [instance: 54523d3e-bfae-4621-85cb-d6a7bc40abf5] Received event network-changed-8557ab28-9722-4e6e-a14d-f941e3b693c8 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:37:20 user nova-compute[72382]: DEBUG nova.compute.manager [req-5075c96a-c86d-49e8-899a-8940c33c0f4a req-226d5c84-369d-446b-bbac-c31f9e47b76d service nova] [instance: 54523d3e-bfae-4621-85cb-d6a7bc40abf5] Refreshing instance network info cache due to event network-changed-8557ab28-9722-4e6e-a14d-f941e3b693c8. {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 15:37:20 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-5075c96a-c86d-49e8-899a-8940c33c0f4a req-226d5c84-369d-446b-bbac-c31f9e47b76d service nova] Acquiring lock "refresh_cache-54523d3e-bfae-4621-85cb-d6a7bc40abf5" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 15:37:20 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-5075c96a-c86d-49e8-899a-8940c33c0f4a req-226d5c84-369d-446b-bbac-c31f9e47b76d service nova] Acquired lock "refresh_cache-54523d3e-bfae-4621-85cb-d6a7bc40abf5" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 15:37:20 user nova-compute[72382]: DEBUG nova.network.neutron [req-5075c96a-c86d-49e8-899a-8940c33c0f4a req-226d5c84-369d-446b-bbac-c31f9e47b76d service nova] [instance: 54523d3e-bfae-4621-85cb-d6a7bc40abf5] Refreshing network info cache for port 8557ab28-9722-4e6e-a14d-f941e3b693c8 {{(pid=72382) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 15:37:20 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-8b1a1887-7c4b-4ffc-9dba-52515b7787a1 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Acquiring lock "refresh_cache-54523d3e-bfae-4621-85cb-d6a7bc40abf5" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 15:37:21 user nova-compute[72382]: DEBUG nova.network.neutron [req-5075c96a-c86d-49e8-899a-8940c33c0f4a req-226d5c84-369d-446b-bbac-c31f9e47b76d service nova] [instance: 54523d3e-bfae-4621-85cb-d6a7bc40abf5] Updated VIF entry in instance network info cache for port 8557ab28-9722-4e6e-a14d-f941e3b693c8. {{(pid=72382) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 15:37:21 user nova-compute[72382]: DEBUG nova.network.neutron [req-5075c96a-c86d-49e8-899a-8940c33c0f4a req-226d5c84-369d-446b-bbac-c31f9e47b76d service nova] [instance: 54523d3e-bfae-4621-85cb-d6a7bc40abf5] Updating instance_info_cache with network_info: [{"id": "8557ab28-9722-4e6e-a14d-f941e3b693c8", "address": "fa:16:3e:40:5f:a8", "network": {"id": "308641dc-cc18-41db-9baa-7cc880e594ad", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1932973397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb5bf3f95d2843af94dbcab2af932bd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8557ab28-97", "ovs_interfaceid": "8557ab28-9722-4e6e-a14d-f941e3b693c8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:37:21 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-5075c96a-c86d-49e8-899a-8940c33c0f4a req-226d5c84-369d-446b-bbac-c31f9e47b76d service nova] Releasing lock "refresh_cache-54523d3e-bfae-4621-85cb-d6a7bc40abf5" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 15:37:21 user nova-compute[72382]: DEBUG nova.compute.manager [req-5075c96a-c86d-49e8-899a-8940c33c0f4a req-226d5c84-369d-446b-bbac-c31f9e47b76d service nova] [instance: 429ebe93-dd7a-41c4-b80a-0379d3816402] Received event network-vif-plugged-d7669ab9-996e-4cf6-82a3-0083fbb7fa5c {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:37:21 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-5075c96a-c86d-49e8-899a-8940c33c0f4a req-226d5c84-369d-446b-bbac-c31f9e47b76d service nova] Acquiring lock "429ebe93-dd7a-41c4-b80a-0379d3816402-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:37:21 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-5075c96a-c86d-49e8-899a-8940c33c0f4a req-226d5c84-369d-446b-bbac-c31f9e47b76d service nova] Lock "429ebe93-dd7a-41c4-b80a-0379d3816402-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:37:21 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-5075c96a-c86d-49e8-899a-8940c33c0f4a req-226d5c84-369d-446b-bbac-c31f9e47b76d service nova] Lock "429ebe93-dd7a-41c4-b80a-0379d3816402-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:37:21 user nova-compute[72382]: DEBUG nova.compute.manager [req-5075c96a-c86d-49e8-899a-8940c33c0f4a req-226d5c84-369d-446b-bbac-c31f9e47b76d service nova] [instance: 429ebe93-dd7a-41c4-b80a-0379d3816402] No waiting events found dispatching network-vif-plugged-d7669ab9-996e-4cf6-82a3-0083fbb7fa5c {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:37:21 user nova-compute[72382]: WARNING nova.compute.manager [req-5075c96a-c86d-49e8-899a-8940c33c0f4a req-226d5c84-369d-446b-bbac-c31f9e47b76d service nova] [instance: 429ebe93-dd7a-41c4-b80a-0379d3816402] Received unexpected event network-vif-plugged-d7669ab9-996e-4cf6-82a3-0083fbb7fa5c for instance with vm_state deleted and task_state None.
Aug 09 15:37:21 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-8b1a1887-7c4b-4ffc-9dba-52515b7787a1 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Acquired lock "refresh_cache-54523d3e-bfae-4621-85cb-d6a7bc40abf5" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 15:37:21 user nova-compute[72382]: DEBUG nova.network.neutron [None req-8b1a1887-7c4b-4ffc-9dba-52515b7787a1 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] [instance: 54523d3e-bfae-4621-85cb-d6a7bc40abf5] Building network info cache for instance {{(pid=72382) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 15:37:21 user nova-compute[72382]: DEBUG nova.network.neutron [None req-8b1a1887-7c4b-4ffc-9dba-52515b7787a1 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] [instance: 54523d3e-bfae-4621-85cb-d6a7bc40abf5] Updating instance_info_cache with network_info: [{"id": "8557ab28-9722-4e6e-a14d-f941e3b693c8", "address": "fa:16:3e:40:5f:a8", "network": {"id": "308641dc-cc18-41db-9baa-7cc880e594ad", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1932973397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb5bf3f95d2843af94dbcab2af932bd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8557ab28-97", "ovs_interfaceid": "8557ab28-9722-4e6e-a14d-f941e3b693c8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:37:21 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-8b1a1887-7c4b-4ffc-9dba-52515b7787a1 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Releasing lock "refresh_cache-54523d3e-bfae-4621-85cb-d6a7bc40abf5" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 15:37:21 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-8b1a1887-7c4b-4ffc-9dba-52515b7787a1 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] [instance: 54523d3e-bfae-4621-85cb-d6a7bc40abf5] Starting migrate_disk_and_power_off {{(pid=72382) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Aug 09 15:37:21 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:37:21 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:37:21 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:37:21 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:37:21 user nova-compute[72382]: DEBUG nova.compute.manager [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72382) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 15:37:21 user nova-compute[72382]: DEBUG nova.compute.manager [req-1636cb94-3980-4a72-8ce8-7e17f7192733 req-8e91fbb2-4558-4ebf-9dbb-a61128bf419b service nova] [instance: 54523d3e-bfae-4621-85cb-d6a7bc40abf5] Received event network-vif-unplugged-8557ab28-9722-4e6e-a14d-f941e3b693c8 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:37:21 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-1636cb94-3980-4a72-8ce8-7e17f7192733 req-8e91fbb2-4558-4ebf-9dbb-a61128bf419b service nova] Acquiring lock "54523d3e-bfae-4621-85cb-d6a7bc40abf5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:37:21 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-1636cb94-3980-4a72-8ce8-7e17f7192733 req-8e91fbb2-4558-4ebf-9dbb-a61128bf419b service nova] Lock "54523d3e-bfae-4621-85cb-d6a7bc40abf5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:37:21 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-1636cb94-3980-4a72-8ce8-7e17f7192733 req-8e91fbb2-4558-4ebf-9dbb-a61128bf419b service nova] Lock "54523d3e-bfae-4621-85cb-d6a7bc40abf5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:37:21 user nova-compute[72382]: DEBUG nova.compute.manager [req-1636cb94-3980-4a72-8ce8-7e17f7192733 req-8e91fbb2-4558-4ebf-9dbb-a61128bf419b service nova] [instance: 54523d3e-bfae-4621-85cb-d6a7bc40abf5] No waiting events found dispatching network-vif-unplugged-8557ab28-9722-4e6e-a14d-f941e3b693c8 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:37:21 user nova-compute[72382]: WARNING nova.compute.manager [req-1636cb94-3980-4a72-8ce8-7e17f7192733 req-8e91fbb2-4558-4ebf-9dbb-a61128bf419b service nova] [instance: 54523d3e-bfae-4621-85cb-d6a7bc40abf5] Received unexpected event network-vif-unplugged-8557ab28-9722-4e6e-a14d-f941e3b693c8 for instance with vm_state active and task_state resize_migrating.
Aug 09 15:37:21 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:37:21 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:37:22 user nova-compute[72382]: INFO nova.virt.libvirt.driver [-] [instance: 54523d3e-bfae-4621-85cb-d6a7bc40abf5] Instance destroyed successfully.
Aug 09 15:37:22 user nova-compute[72382]: DEBUG nova.virt.libvirt.vif [None req-8b1a1887-7c4b-4ffc-9dba-52515b7787a1 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T15:35:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1481123959',display_name='tempest-ServerActionsTestOtherA-server-1481123959',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1481123959',id=39,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCmuVV1ynikE+pH75fjLIal2KFmSgV7eQmOTfU0+P2w2YCXfBWnAu9n1cQQTYYTDt/aP+JsGjkRdlSPqvnnG5WbnlJT+9aj9SfyqprOo87kqF8CD2U4mVDTvv+6ADzXJvQ==',key_name='tempest-keypair-568328368',keypairs=<?>,launch_index=0,launched_at=2023-08-09T15:35:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='eb5bf3f95d2843af94dbcab2af932bd1',ramdisk_id='',reservation_id='r-f5r16m9c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1899577274',owner_user_name='tempest-ServerActionsTestOtherA-1899577274-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T15:37:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2cca9aef887b4b91a46ff4bd5cd32302',uuid=54523d3e-bfae-4621-85cb-d6a7bc40abf5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8557ab28-9722-4e6e-a14d-f941e3b693c8", "address": "fa:16:3e:40:5f:a8", "network": {"id": "308641dc-cc18-41db-9baa-7cc880e594ad", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1932973397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1932973397-network", "vif_mac": "fa:16:3e:40:5f:a8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb5bf3f95d2843af94dbcab2af932bd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8557ab28-97", "ovs_interfaceid": "8557ab28-9722-4e6e-a14d-f941e3b693c8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 15:37:22 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-8b1a1887-7c4b-4ffc-9dba-52515b7787a1 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Converting VIF {"id": "8557ab28-9722-4e6e-a14d-f941e3b693c8", "address": "fa:16:3e:40:5f:a8", "network": {"id": "308641dc-cc18-41db-9baa-7cc880e594ad", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1932973397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1932973397-network", "vif_mac": "fa:16:3e:40:5f:a8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb5bf3f95d2843af94dbcab2af932bd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8557ab28-97", "ovs_interfaceid": "8557ab28-9722-4e6e-a14d-f941e3b693c8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 15:37:22 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-8b1a1887-7c4b-4ffc-9dba-52515b7787a1 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:40:5f:a8,bridge_name='br-int',has_traffic_filtering=True,id=8557ab28-9722-4e6e-a14d-f941e3b693c8,network=Network(308641dc-cc18-41db-9baa-7cc880e594ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8557ab28-97') {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 15:37:22 user nova-compute[72382]: DEBUG os_vif [None req-8b1a1887-7c4b-4ffc-9dba-52515b7787a1 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:40:5f:a8,bridge_name='br-int',has_traffic_filtering=True,id=8557ab28-9722-4e6e-a14d-f941e3b693c8,network=Network(308641dc-cc18-41db-9baa-7cc880e594ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8557ab28-97') {{(pid=72382) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 15:37:22 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:37:22 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8557ab28-97, bridge=br-int, if_exists=True) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:37:22 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:37:22 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:37:22 user nova-compute[72382]: INFO os_vif [None req-8b1a1887-7c4b-4ffc-9dba-52515b7787a1 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:40:5f:a8,bridge_name='br-int',has_traffic_filtering=True,id=8557ab28-9722-4e6e-a14d-f941e3b693c8,network=Network(308641dc-cc18-41db-9baa-7cc880e594ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8557ab28-97')
Aug 09 15:37:22 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8b1a1887-7c4b-4ffc-9dba-52515b7787a1 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] [instance: 54523d3e-bfae-4621-85cb-d6a7bc40abf5] calling os-brick to detach iSCSI Volume {{(pid=72382) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 15:37:22 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b1a1887-7c4b-4ffc-9dba-52515b7787a1 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2a0c768340>, {'target_iqns': ['iqn.2010-10.org.openstack:a0a612d6-0f3f-4d2c-9fb5-aff9384338de'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kCZuiYgU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 15:37:22 user nova-compute[72382]: WARNING os_brick.initiator.connectors.base [None req-8b1a1887-7c4b-4ffc-9dba-52515b7787a1 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 15:37:22 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-8b1a1887-7c4b-4ffc-9dba-52515b7787a1 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 15:37:22 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-8b1a1887-7c4b-4ffc-9dba-52515b7787a1 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 15:37:22 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b1a1887-7c4b-4ffc-9dba-52515b7787a1 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a0a612d6-0f3f-4d2c-9fb5-aff9384338de', 0)] {{(pid=72382) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 15:37:22 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:37:22 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:37:22 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a6c3494-5992-469c-b925-eca908b6db7c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3f58579c-f69a-4bee-b16e-970e5a8f590c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a0a612d6-0f3f-4d2c-9fb5-aff9384338de\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:37:22 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:37:22 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:37:22 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[04e0b562-9144-4766-bc0d-2eb54b5170cc]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0a612d6-0f3f-4d2c-9fb5-aff9384338de (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f58579c-f69a-4bee-b16e-970e5a8f590c (non-flash)\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:37:22 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b1a1887-7c4b-4ffc-9dba-52515b7787a1 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0a612d6-0f3f-4d2c-9fb5-aff9384338de (non-flash)
Aug 09 15:37:22 user nova-compute[72382]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f58579c-f69a-4bee-b16e-970e5a8f590c (non-flash)
Aug 09 15:37:22 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 15:37:22 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b1a1887-7c4b-4ffc-9dba-52515b7787a1 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0a612d6-0f3f-4d2c-9fb5-aff9384338de (non-flash)
Aug 09 15:37:22 user nova-compute[72382]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f58579c-f69a-4bee-b16e-970e5a8f590c (non-flash)
Aug 09 15:37:22 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 15:37:22 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b1a1887-7c4b-4ffc-9dba-52515b7787a1 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2a0c34a8c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a0a612d6-0f3f-4d2c-9fb5-aff9384338de'): ({'sdd'}, set())}) {{(pid=72382) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 15:37:22 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-8b1a1887-7c4b-4ffc-9dba-52515b7787a1 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Removing single pathed devices sdd {{(pid=72382) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 15:37:22 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:37:22 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:37:22 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[65bd2cc5-3518-489e-ad90-7da4def44d02]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:37:22 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:37:22 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:37:22 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eb712aa-7c97-444e-bd5c-b62ef534502c]: (4, ('ok\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:37:22 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-8b1a1887-7c4b-4ffc-9dba-52515b7787a1 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Flushing IO for device /dev/sdd {{(pid=72382) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 15:37:22 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:37:22 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:37:22 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ca53eb2-c15b-4c40-ae7d-f2f9410d8e43]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:37:22 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-8b1a1887-7c4b-4ffc-9dba-52515b7787a1 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72382) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 15:37:22 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:37:22 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.053s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:37:22 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1e04ece-cb46-4b19-bd87-68e478435eb9]: (4, ('1', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:37:22 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-8b1a1887-7c4b-4ffc-9dba-52515b7787a1 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72382) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 15:37:22 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-8b1a1887-7c4b-4ffc-9dba-52515b7787a1 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] SCSI volumes sdd have been removed. {{(pid=72382) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 15:37:22 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b1a1887-7c4b-4ffc-9dba-52515b7787a1 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a0a612d6-0f3f-4d2c-9fb5-aff9384338de')] {{(pid=72382) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 15:37:22 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0a612d6-0f3f-4d2c-9fb5-aff9384338de -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:37:22 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0a612d6-0f3f-4d2c-9fb5-aff9384338de -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:37:22 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c622f70-25b8-448e-93ed-46d4e43a89d4]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:37:22 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b1a1887-7c4b-4ffc-9dba-52515b7787a1 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:37:22 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0a612d6-0f3f-4d2c-9fb5-aff9384338de -p 172.16.0.220:3260 --logout {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:37:22 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0a612d6-0f3f-4d2c-9fb5-aff9384338de -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:37:22 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffa8c577-ed6f-41dc-b8b7-c7906feeb78a]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:a0a612d6-0f3f-4d2c-9fb5-aff9384338de, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:a0a612d6-0f3f-4d2c-9fb5-aff9384338de, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:37:22 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b1a1887-7c4b-4ffc-9dba-52515b7787a1 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:a0a612d6-0f3f-4d2c-9fb5-aff9384338de, portal: 172.16.0.220,3260]
Aug 09 15:37:22 user nova-compute[72382]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:a0a612d6-0f3f-4d2c-9fb5-aff9384338de, portal: 172.16.0.220,3260] successful.
Aug 09 15:37:22 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:37:22 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0a612d6-0f3f-4d2c-9fb5-aff9384338de -p 172.16.0.220:3260 --op delete {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:37:22 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0a612d6-0f3f-4d2c-9fb5-aff9384338de -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:37:22 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[f999310a-29c0-4aae-b231-c676f7ef4599]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:37:22 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b1a1887-7c4b-4ffc-9dba-52515b7787a1 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:37:22 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-8b1a1887-7c4b-4ffc-9dba-52515b7787a1 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.292s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 15:37:22 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b1a1887-7c4b-4ffc-9dba-52515b7787a1 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] <== disconnect_volume: return (294ms) None {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 15:37:22 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8b1a1887-7c4b-4ffc-9dba-52515b7787a1 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] [instance: 54523d3e-bfae-4621-85cb-d6a7bc40abf5] Disconnected iSCSI Volume {{(pid=72382) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 15:37:22 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-8b1a1887-7c4b-4ffc-9dba-52515b7787a1 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72382) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 15:37:22 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:37:23 user nova-compute[72382]: DEBUG nova.network.neutron [None req-8b1a1887-7c4b-4ffc-9dba-52515b7787a1 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] [instance: 54523d3e-bfae-4621-85cb-d6a7bc40abf5] Port 8557ab28-9722-4e6e-a14d-f941e3b693c8 binding to destination host user is already ACTIVE {{(pid=72382) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Aug 09 15:37:23 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-8b1a1887-7c4b-4ffc-9dba-52515b7787a1 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Acquiring lock "54523d3e-bfae-4621-85cb-d6a7bc40abf5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:37:23 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-8b1a1887-7c4b-4ffc-9dba-52515b7787a1 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Lock "54523d3e-bfae-4621-85cb-d6a7bc40abf5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:37:23 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-8b1a1887-7c4b-4ffc-9dba-52515b7787a1 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Lock "54523d3e-bfae-4621-85cb-d6a7bc40abf5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:37:23 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:37:23 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-8b1a1887-7c4b-4ffc-9dba-52515b7787a1 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Acquiring lock "refresh_cache-54523d3e-bfae-4621-85cb-d6a7bc40abf5" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 15:37:23 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-8b1a1887-7c4b-4ffc-9dba-52515b7787a1 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Acquired lock "refresh_cache-54523d3e-bfae-4621-85cb-d6a7bc40abf5" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 15:37:23 user nova-compute[72382]: DEBUG nova.network.neutron [None req-8b1a1887-7c4b-4ffc-9dba-52515b7787a1 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] [instance: 54523d3e-bfae-4621-85cb-d6a7bc40abf5] Building network info cache for instance {{(pid=72382) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 15:37:23 user nova-compute[72382]: DEBUG nova.compute.manager [req-ed03d4db-ce53-4567-9293-5f5042179dc7 req-64e1a3ba-a542-4a29-b79d-5495b825ba26 service nova] [instance: 54523d3e-bfae-4621-85cb-d6a7bc40abf5] Received event network-vif-plugged-8557ab28-9722-4e6e-a14d-f941e3b693c8 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:37:23 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-ed03d4db-ce53-4567-9293-5f5042179dc7 req-64e1a3ba-a542-4a29-b79d-5495b825ba26 service nova] Acquiring lock "54523d3e-bfae-4621-85cb-d6a7bc40abf5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:37:23 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-ed03d4db-ce53-4567-9293-5f5042179dc7 req-64e1a3ba-a542-4a29-b79d-5495b825ba26 service nova] Lock "54523d3e-bfae-4621-85cb-d6a7bc40abf5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:37:23 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-ed03d4db-ce53-4567-9293-5f5042179dc7 req-64e1a3ba-a542-4a29-b79d-5495b825ba26 service nova] Lock "54523d3e-bfae-4621-85cb-d6a7bc40abf5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:37:23 user nova-compute[72382]: DEBUG nova.compute.manager [req-ed03d4db-ce53-4567-9293-5f5042179dc7 req-64e1a3ba-a542-4a29-b79d-5495b825ba26 service nova] [instance: 54523d3e-bfae-4621-85cb-d6a7bc40abf5] No waiting events found dispatching network-vif-plugged-8557ab28-9722-4e6e-a14d-f941e3b693c8 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:37:23 user nova-compute[72382]: WARNING nova.compute.manager [req-ed03d4db-ce53-4567-9293-5f5042179dc7 req-64e1a3ba-a542-4a29-b79d-5495b825ba26 service nova] [instance: 54523d3e-bfae-4621-85cb-d6a7bc40abf5] Received unexpected event network-vif-plugged-8557ab28-9722-4e6e-a14d-f941e3b693c8 for instance with vm_state active and task_state resize_migrated.
Aug 09 15:37:24 user nova-compute[72382]: DEBUG nova.network.neutron [None req-8b1a1887-7c4b-4ffc-9dba-52515b7787a1 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] [instance: 54523d3e-bfae-4621-85cb-d6a7bc40abf5] Updating instance_info_cache with network_info: [{"id": "8557ab28-9722-4e6e-a14d-f941e3b693c8", "address": "fa:16:3e:40:5f:a8", "network": {"id": "308641dc-cc18-41db-9baa-7cc880e594ad", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1932973397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb5bf3f95d2843af94dbcab2af932bd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8557ab28-97", "ovs_interfaceid": "8557ab28-9722-4e6e-a14d-f941e3b693c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:37:24 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-8b1a1887-7c4b-4ffc-9dba-52515b7787a1 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Releasing lock "refresh_cache-54523d3e-bfae-4621-85cb-d6a7bc40abf5" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 15:37:24 user nova-compute[72382]: DEBUG os_brick.utils [None req-8b1a1887-7c4b-4ffc-9dba-52515b7787a1 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 15:37:24 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:37:24 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:37:24 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d1e4c81-1e14-41b1-92ce-b04f8f9e3d22]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d2cfa7015fe\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:37:24 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:37:24 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:37:24 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6f96df6-3701-4490-ad1d-72b1ffb33ade]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:37:24 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:37:24 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:37:24 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5a8c7d6-1652-4397-877b-1a9fffa9bf7f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:37:24 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7f33564-4867-4502-88f5-9bae77012f65]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:37:24 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-8b1a1887-7c4b-4ffc-9dba-52515b7787a1 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Running cmd (subprocess): nvme version {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:37:24 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-8b1a1887-7c4b-4ffc-9dba-52515b7787a1 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] 'nvme version' failed. Not Retrying. {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 15:37:24 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8b1a1887-7c4b-4ffc-9dba-52515b7787a1 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] nvme not present on system {{(pid=72382) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 15:37:24 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:37:24 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 15:37:24 user nova-compute[72382]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 15:37:24 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[4329ff67-32ea-45de-9713-8acfe5a41843]: (4, '') {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:37:24 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.lightos [None req-8b1a1887-7c4b-4ffc-9dba-52515b7787a1 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72382) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 15:37:24 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.lightos [None req-8b1a1887-7c4b-4ffc-9dba-52515b7787a1 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72382) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 15:37:24 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.lightos [None req-8b1a1887-7c4b-4ffc-9dba-52515b7787a1 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] LIGHTOS: no hostnqn found. {{(pid=72382) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 15:37:24 user nova-compute[72382]: DEBUG os_brick.utils [None req-8b1a1887-7c4b-4ffc-9dba-52515b7787a1 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d2cfa7015fe', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 15:37:24 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:37:25 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:37:25 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:37:27 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:37:29 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:37:32 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:37:32 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-8b1a1887-7c4b-4ffc-9dba-52515b7787a1 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] [instance: 54523d3e-bfae-4621-85cb-d6a7bc40abf5] Starting finish_migration {{(pid=72382) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Aug 09 15:37:32 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-8b1a1887-7c4b-4ffc-9dba-52515b7787a1 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] [instance: 54523d3e-bfae-4621-85cb-d6a7bc40abf5] Instance directory exists: not creating {{(pid=72382) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 09 15:37:32 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-8b1a1887-7c4b-4ffc-9dba-52515b7787a1 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] [instance: 54523d3e-bfae-4621-85cb-d6a7bc40abf5] Creating image(s)
Aug 09 15:37:32 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-8b1a1887-7c4b-4ffc-9dba-52515b7787a1 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] [instance: 54523d3e-bfae-4621-85cb-d6a7bc40abf5] Did not create local disks {{(pid=72382) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 09 15:37:32 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-8b1a1887-7c4b-4ffc-9dba-52515b7787a1 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] [instance: 54523d3e-bfae-4621-85cb-d6a7bc40abf5] Ensure instance console log exists: /opt/stack/data/nova/instances/54523d3e-bfae-4621-85cb-d6a7bc40abf5/console.log {{(pid=72382) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 15:37:32 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-8b1a1887-7c4b-4ffc-9dba-52515b7787a1 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:37:32 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-8b1a1887-7c4b-4ffc-9dba-52515b7787a1 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:37:32 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-8b1a1887-7c4b-4ffc-9dba-52515b7787a1 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:37:32 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-8b1a1887-7c4b-4ffc-9dba-52515b7787a1 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] [instance: 54523d3e-bfae-4621-85cb-d6a7bc40abf5] Start _get_guest_xml network_info=[{"id": "8557ab28-9722-4e6e-a14d-f941e3b693c8", "address": "fa:16:3e:40:5f:a8", "network": {"id": "308641dc-cc18-41db-9baa-7cc880e594ad", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1932973397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1932973397-network", "vif_mac": "fa:16:3e:40:5f:a8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb5bf3f95d2843af94dbcab2af932bd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8557ab28-97", "ovs_interfaceid": "8557ab28-9722-4e6e-a14d-f941e3b693c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:a0a612d6-0f3f-4d2c-9fb5-aff9384338de'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kCZuiYgU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '54523d3e-bfae-4621-85cb-d6a7bc40abf5', 'attached_at': '2023-08-09T15:37:33.000000', 'detached_at': '', 'volume_id': 'a0a612d6-0f3f-4d2c-9fb5-aff9384338de', 'serial': 'a0a612d6-0f3f-4d2c-9fb5-aff9384338de'}, 'disk_bus': 'virtio', 'attachment_id': 'baf8ddf7-35d8-4557-a6b6-1cbdd2ccccc7', 'delete_on_termination': True, 'volume_type': None} {{(pid=72382) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 15:37:32 user nova-compute[72382]: WARNING nova.virt.libvirt.driver [None req-8b1a1887-7c4b-4ffc-9dba-52515b7787a1 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 15:37:32 user nova-compute[72382]: WARNING nova.virt.libvirt.driver [None req-8b1a1887-7c4b-4ffc-9dba-52515b7787a1 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 15:37:32 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-8b1a1887-7c4b-4ffc-9dba-52515b7787a1 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72382) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 15:37:32 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-8b1a1887-7c4b-4ffc-9dba-52515b7787a1 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] CPU controller missing on host. {{(pid=72382) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 15:37:32 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-8b1a1887-7c4b-4ffc-9dba-52515b7787a1 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72382) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 15:37:32 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-8b1a1887-7c4b-4ffc-9dba-52515b7787a1 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] CPU controller found on host. {{(pid=72382) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 15:37:32 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-8b1a1887-7c4b-4ffc-9dba-52515b7787a1 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72382) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 15:37:32 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-8b1a1887-7c4b-4ffc-9dba-52515b7787a1 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T15:11:17Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 15:37:32 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-8b1a1887-7c4b-4ffc-9dba-52515b7787a1 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Flavor limits 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 15:37:32 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-8b1a1887-7c4b-4ffc-9dba-52515b7787a1 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Image limits 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 15:37:32 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-8b1a1887-7c4b-4ffc-9dba-52515b7787a1 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Flavor pref 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 15:37:32 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-8b1a1887-7c4b-4ffc-9dba-52515b7787a1 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Image pref 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 15:37:32 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-8b1a1887-7c4b-4ffc-9dba-52515b7787a1 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 15:37:32 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-8b1a1887-7c4b-4ffc-9dba-52515b7787a1 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 15:37:32 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-8b1a1887-7c4b-4ffc-9dba-52515b7787a1 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72382) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 15:37:32 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-8b1a1887-7c4b-4ffc-9dba-52515b7787a1 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Got 1 possible topologies {{(pid=72382) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 15:37:32 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-8b1a1887-7c4b-4ffc-9dba-52515b7787a1 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 15:37:32 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-8b1a1887-7c4b-4ffc-9dba-52515b7787a1 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 15:37:32 user nova-compute[72382]: DEBUG nova.objects.instance [None req-8b1a1887-7c4b-4ffc-9dba-52515b7787a1 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Lazy-loading 'vcpu_model' on Instance uuid 54523d3e-bfae-4621-85cb-d6a7bc40abf5 {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:37:32 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8b1a1887-7c4b-4ffc-9dba-52515b7787a1 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] [instance: 54523d3e-bfae-4621-85cb-d6a7bc40abf5] Calling os-brick to attach iSCSI Volume {{(pid=72382) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 15:37:32 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b1a1887-7c4b-4ffc-9dba-52515b7787a1 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2a0c768340>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:a0a612d6-0f3f-4d2c-9fb5-aff9384338de'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kCZuiYgU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 15:37:32 user nova-compute[72382]: WARNING os_brick.initiator.connectors.base [None req-8b1a1887-7c4b-4ffc-9dba-52515b7787a1 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 15:37:32 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-8b1a1887-7c4b-4ffc-9dba-52515b7787a1 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 15:37:32 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-8b1a1887-7c4b-4ffc-9dba-52515b7787a1 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 15:37:32 user nova-compute[72382]: WARNING os_brick.initiator.connectors.base [None req-8b1a1887-7c4b-4ffc-9dba-52515b7787a1 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 15:37:32 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-8b1a1887-7c4b-4ffc-9dba-52515b7787a1 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a0a612d6-0f3f-4d2c-9fb5-aff9384338de" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 15:37:32 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-8b1a1887-7c4b-4ffc-9dba-52515b7787a1 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a0a612d6-0f3f-4d2c-9fb5-aff9384338de" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 15:37:32 user nova-compute[72382]: INFO os_brick.initiator.connectors.iscsi [None req-8b1a1887-7c4b-4ffc-9dba-52515b7787a1 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 15:37:32 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0a612d6-0f3f-4d2c-9fb5-aff9384338de -p 172.16.0.220:3260 {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:37:32 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0a612d6-0f3f-4d2c-9fb5-aff9384338de -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:37:32 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[c08fef06-0f88-4f56-b9d9-3f420affbf4e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:37:32 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b1a1887-7c4b-4ffc-9dba-52515b7787a1 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 15:37:32 user nova-compute[72382]:  {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:37:32 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0a612d6-0f3f-4d2c-9fb5-aff9384338de -p 172.16.0.220:3260 --interface default --op new {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:37:32 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0a612d6-0f3f-4d2c-9fb5-aff9384338de -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:37:32 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbd515e3-9ef5-44b5-9612-1e24206922f9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a0a612d6-0f3f-4d2c-9fb5-aff9384338de] added\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:37:32 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b1a1887-7c4b-4ffc-9dba-52515b7787a1 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a0a612d6-0f3f-4d2c-9fb5-aff9384338de] added
Aug 09 15:37:32 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:37:32 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0a612d6-0f3f-4d2c-9fb5-aff9384338de -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:37:32 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0a612d6-0f3f-4d2c-9fb5-aff9384338de -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:37:32 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa82e78c-d7da-4288-a995-68abb9045ced]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:37:32 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b1a1887-7c4b-4ffc-9dba-52515b7787a1 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:37:32 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0a612d6-0f3f-4d2c-9fb5-aff9384338de -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:37:32 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0a612d6-0f3f-4d2c-9fb5-aff9384338de -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:37:32 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[99a0a038-33b3-4f56-a9dd-fc3d9555310f]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:37:32 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b1a1887-7c4b-4ffc-9dba-52515b7787a1 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:37:32 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0a612d6-0f3f-4d2c-9fb5-aff9384338de -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kCZuiYgU {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:37:32 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0a612d6-0f3f-4d2c-9fb5-aff9384338de -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kCZuiYgU" returned: 0 in 0.020s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:37:32 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[07a7686d-0d9f-438c-81c7-7c3e766eac9d]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:37:32 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b1a1887-7c4b-4ffc-9dba-52515b7787a1 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kCZuiYgU'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:37:32 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0a612d6-0f3f-4d2c-9fb5-aff9384338de -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:37:32 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0a612d6-0f3f-4d2c-9fb5-aff9384338de -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:37:32 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[60f3aee0-bae2-47b5-93a4-bf4198f82797]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:37:32 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b1a1887-7c4b-4ffc-9dba-52515b7787a1 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:37:32 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:37:32 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:37:32 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[04fdaf25-2cbd-45bc-977e-99b66a454f6e]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f58579c-f69a-4bee-b16e-970e5a8f590c (non-flash)\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:37:32 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b1a1887-7c4b-4ffc-9dba-52515b7787a1 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f58579c-f69a-4bee-b16e-970e5a8f590c (non-flash)
Aug 09 15:37:32 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 15:37:32 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b1a1887-7c4b-4ffc-9dba-52515b7787a1 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f58579c-f69a-4bee-b16e-970e5a8f590c (non-flash)
Aug 09 15:37:32 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 15:37:32 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0a612d6-0f3f-4d2c-9fb5-aff9384338de -p 172.16.0.220:3260 --login {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:37:33 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0a612d6-0f3f-4d2c-9fb5-aff9384338de -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:37:33 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a39d253-fb38-47b4-9c69-1687a616395f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a0a612d6-0f3f-4d2c-9fb5-aff9384338de, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a0a612d6-0f3f-4d2c-9fb5-aff9384338de, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:37:33 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b1a1887-7c4b-4ffc-9dba-52515b7787a1 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a0a612d6-0f3f-4d2c-9fb5-aff9384338de, portal: 172.16.0.220,3260]
Aug 09 15:37:33 user nova-compute[72382]: Login to [iface: default, target: iqn.2010-10.org.openstack:a0a612d6-0f3f-4d2c-9fb5-aff9384338de, portal: 172.16.0.220,3260] successful.
Aug 09 15:37:33 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:37:33 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0a612d6-0f3f-4d2c-9fb5-aff9384338de -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:37:33 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0a612d6-0f3f-4d2c-9fb5-aff9384338de -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:37:33 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[92517000-a7e4-494b-9b67-bf9a332dd3a8]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:37:33 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b1a1887-7c4b-4ffc-9dba-52515b7787a1 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:37:33 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:37:33 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:37:33 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe4b1e3c-504c-4e68-b8c9-0d923b0d9ccf]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f58579c-f69a-4bee-b16e-970e5a8f590c (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0a612d6-0f3f-4d2c-9fb5-aff9384338de (non-flash)\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:37:33 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b1a1887-7c4b-4ffc-9dba-52515b7787a1 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f58579c-f69a-4bee-b16e-970e5a8f590c (non-flash)
Aug 09 15:37:33 user nova-compute[72382]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0a612d6-0f3f-4d2c-9fb5-aff9384338de (non-flash)
Aug 09 15:37:33 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 15:37:33 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b1a1887-7c4b-4ffc-9dba-52515b7787a1 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f58579c-f69a-4bee-b16e-970e5a8f590c (non-flash)
Aug 09 15:37:33 user nova-compute[72382]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0a612d6-0f3f-4d2c-9fb5-aff9384338de (non-flash)
Aug 09 15:37:33 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 15:37:33 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-8b1a1887-7c4b-4ffc-9dba-52515b7787a1 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a0a612d6-0f3f-4d2c-9fb5-aff9384338de" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.279s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 15:37:33 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b1a1887-7c4b-4ffc-9dba-52515b7787a1 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Connected to 172.16.0.220:3260 {{(pid=72382) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 15:37:33 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-8b1a1887-7c4b-4ffc-9dba-52515b7787a1 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] HCTL ('34', '-', '-', 0) found on session 49 with lun 0 {{(pid=72382) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 15:37:33 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-8b1a1887-7c4b-4ffc-9dba-52515b7787a1 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72382) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 15:37:33 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:37:33 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:37:33 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d8eb40e-1474-40db-b6fc-b6fb3e1c6b30]: (4, ('- - 0', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:37:33 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-8b1a1887-7c4b-4ffc-9dba-52515b7787a1 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Searching for a device in session 49 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72382) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 15:37:33 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b1a1887-7c4b-4ffc-9dba-52515b7787a1 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kCZuiYgU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72382) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 15:37:33 user nova-compute[72382]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691595438.1498113, 429ebe93-dd7a-41c4-b80a-0379d3816402 => Stopped> {{(pid=72382) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 15:37:33 user nova-compute[72382]: INFO nova.compute.manager [-] [instance: 429ebe93-dd7a-41c4-b80a-0379d3816402] VM Stopped (Lifecycle Event)
Aug 09 15:37:33 user nova-compute[72382]: DEBUG nova.compute.manager [None req-a7cb6887-5aeb-4964-97f3-17eaa366c3db None None] [instance: 429ebe93-dd7a-41c4-b80a-0379d3816402] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:37:34 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-8b1a1887-7c4b-4ffc-9dba-52515b7787a1 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.313s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 15:37:34 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b1a1887-7c4b-4ffc-9dba-52515b7787a1 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] <== connect_volume: return (1314ms) {'type': 'block', 'scsi_wwn': '23936326336346561', 'path': '/dev/sdc'} {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 15:37:34 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8b1a1887-7c4b-4ffc-9dba-52515b7787a1 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] [instance: 54523d3e-bfae-4621-85cb-d6a7bc40abf5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23936326336346561', 'path': '/dev/sdc'} {{(pid=72382) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 15:37:34 user nova-compute[72382]: DEBUG nova.virt.libvirt.vif [None req-8b1a1887-7c4b-4ffc-9dba-52515b7787a1 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T15:35:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1481123959',display_name='tempest-ServerActionsTestOtherA-server-1481123959',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1481123959',id=39,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCmuVV1ynikE+pH75fjLIal2KFmSgV7eQmOTfU0+P2w2YCXfBWnAu9n1cQQTYYTDt/aP+JsGjkRdlSPqvnnG5WbnlJT+9aj9SfyqprOo87kqF8CD2U4mVDTvv+6ADzXJvQ==',key_name='tempest-keypair-568328368',keypairs=<?>,launch_index=0,launched_at=2023-08-09T15:35:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='eb5bf3f95d2843af94dbcab2af932bd1',ramdisk_id='',reservation_id='r-f5r16m9c',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1899577274',owner_user_name='tempest-ServerActionsTestOtherA-1899577274-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T15:37:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2cca9aef887b4b91a46ff4bd5cd32302',uuid=54523d3e-bfae-4621-85cb-d6a7bc40abf5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8557ab28-9722-4e6e-a14d-f941e3b693c8", "address": "fa:16:3e:40:5f:a8", "network": {"id": "308641dc-cc18-41db-9baa-7cc880e594ad", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1932973397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1932973397-network", "vif_mac": "fa:16:3e:40:5f:a8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb5bf3f95d2843af94dbcab2af932bd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8557ab28-97", "ovs_interfaceid": "8557ab28-9722-4e6e-a14d-f941e3b693c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72382) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 15:37:34 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-8b1a1887-7c4b-4ffc-9dba-52515b7787a1 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Converting VIF {"id": "8557ab28-9722-4e6e-a14d-f941e3b693c8", "address": "fa:16:3e:40:5f:a8", "network": {"id": "308641dc-cc18-41db-9baa-7cc880e594ad", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1932973397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1932973397-network", "vif_mac": "fa:16:3e:40:5f:a8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb5bf3f95d2843af94dbcab2af932bd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8557ab28-97", "ovs_interfaceid": "8557ab28-9722-4e6e-a14d-f941e3b693c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 15:37:34 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-8b1a1887-7c4b-4ffc-9dba-52515b7787a1 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:40:5f:a8,bridge_name='br-int',has_traffic_filtering=True,id=8557ab28-9722-4e6e-a14d-f941e3b693c8,network=Network(308641dc-cc18-41db-9baa-7cc880e594ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8557ab28-97') {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 15:37:34 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-8b1a1887-7c4b-4ffc-9dba-52515b7787a1 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] [instance: 54523d3e-bfae-4621-85cb-d6a7bc40abf5] End _get_guest_xml xml=<domain type="kvm">
Aug 09 15:37:34 user nova-compute[72382]:   <uuid>54523d3e-bfae-4621-85cb-d6a7bc40abf5</uuid>
Aug 09 15:37:34 user nova-compute[72382]:   <name>instance-00000027</name>
Aug 09 15:37:34 user nova-compute[72382]:   <memory>2097152</memory>
Aug 09 15:37:34 user nova-compute[72382]:   <vcpu>1</vcpu>
Aug 09 15:37:34 user nova-compute[72382]:   <metadata>
Aug 09 15:37:34 user nova-compute[72382]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 15:37:34 user nova-compute[72382]:       <nova:package version="0.0.0"/>
Aug 09 15:37:34 user nova-compute[72382]:       <nova:name>tempest-ServerActionsTestOtherA-server-1481123959</nova:name>
Aug 09 15:37:34 user nova-compute[72382]:       <nova:creationTime>2023-08-09 15:37:32</nova:creationTime>
Aug 09 15:37:34 user nova-compute[72382]:       <nova:flavor name="m1.small">
Aug 09 15:37:34 user nova-compute[72382]:         <nova:memory>2048</nova:memory>
Aug 09 15:37:34 user nova-compute[72382]:         <nova:disk>20</nova:disk>
Aug 09 15:37:34 user nova-compute[72382]:         <nova:swap>0</nova:swap>
Aug 09 15:37:34 user nova-compute[72382]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 15:37:34 user nova-compute[72382]:         <nova:vcpus>1</nova:vcpus>
Aug 09 15:37:34 user nova-compute[72382]:       </nova:flavor>
Aug 09 15:37:34 user nova-compute[72382]:       <nova:owner>
Aug 09 15:37:34 user nova-compute[72382]:         <nova:user uuid="2cca9aef887b4b91a46ff4bd5cd32302">tempest-ServerActionsTestOtherA-1899577274-project-member</nova:user>
Aug 09 15:37:34 user nova-compute[72382]:         <nova:project uuid="eb5bf3f95d2843af94dbcab2af932bd1">tempest-ServerActionsTestOtherA-1899577274</nova:project>
Aug 09 15:37:34 user nova-compute[72382]:       </nova:owner>
Aug 09 15:37:34 user nova-compute[72382]:       <nova:ports>
Aug 09 15:37:34 user nova-compute[72382]:         <nova:port uuid="8557ab28-9722-4e6e-a14d-f941e3b693c8">
Aug 09 15:37:34 user nova-compute[72382]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 09 15:37:34 user nova-compute[72382]:         </nova:port>
Aug 09 15:37:34 user nova-compute[72382]:       </nova:ports>
Aug 09 15:37:34 user nova-compute[72382]:     </nova:instance>
Aug 09 15:37:34 user nova-compute[72382]:   </metadata>
Aug 09 15:37:34 user nova-compute[72382]:   <sysinfo type="smbios">
Aug 09 15:37:34 user nova-compute[72382]:     <system>
Aug 09 15:37:34 user nova-compute[72382]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 15:37:34 user nova-compute[72382]:       <entry name="product">OpenStack Nova</entry>
Aug 09 15:37:34 user nova-compute[72382]:       <entry name="version">0.0.0</entry>
Aug 09 15:37:34 user nova-compute[72382]:       <entry name="serial">54523d3e-bfae-4621-85cb-d6a7bc40abf5</entry>
Aug 09 15:37:34 user nova-compute[72382]:       <entry name="uuid">54523d3e-bfae-4621-85cb-d6a7bc40abf5</entry>
Aug 09 15:37:34 user nova-compute[72382]:       <entry name="family">Virtual Machine</entry>
Aug 09 15:37:34 user nova-compute[72382]:     </system>
Aug 09 15:37:34 user nova-compute[72382]:   </sysinfo>
Aug 09 15:37:34 user nova-compute[72382]:   <os>
Aug 09 15:37:34 user nova-compute[72382]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 15:37:34 user nova-compute[72382]:     <boot dev="hd"/>
Aug 09 15:37:34 user nova-compute[72382]:     <smbios mode="sysinfo"/>
Aug 09 15:37:34 user nova-compute[72382]:   </os>
Aug 09 15:37:34 user nova-compute[72382]:   <features>
Aug 09 15:37:34 user nova-compute[72382]:     <acpi/>
Aug 09 15:37:34 user nova-compute[72382]:     <apic/>
Aug 09 15:37:34 user nova-compute[72382]:     <vmcoreinfo/>
Aug 09 15:37:34 user nova-compute[72382]:   </features>
Aug 09 15:37:34 user nova-compute[72382]:   <clock offset="utc">
Aug 09 15:37:34 user nova-compute[72382]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 15:37:34 user nova-compute[72382]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 15:37:34 user nova-compute[72382]:     <timer name="hpet" present="no"/>
Aug 09 15:37:34 user nova-compute[72382]:   </clock>
Aug 09 15:37:34 user nova-compute[72382]:   <cpu mode="custom" match="exact">
Aug 09 15:37:34 user nova-compute[72382]:     <model>Nehalem</model>
Aug 09 15:37:34 user nova-compute[72382]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 15:37:34 user nova-compute[72382]:   </cpu>
Aug 09 15:37:34 user nova-compute[72382]:   <devices>
Aug 09 15:37:34 user nova-compute[72382]:     <disk type="block" device="disk">
Aug 09 15:37:34 user nova-compute[72382]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 15:37:34 user nova-compute[72382]:       <source dev="/dev/sdc"/>
Aug 09 15:37:34 user nova-compute[72382]:       <target dev="vda" bus="virtio"/>
Aug 09 15:37:34 user nova-compute[72382]:       <serial>a0a612d6-0f3f-4d2c-9fb5-aff9384338de</serial>
Aug 09 15:37:34 user nova-compute[72382]:     </disk>
Aug 09 15:37:34 user nova-compute[72382]:     <interface type="ethernet">
Aug 09 15:37:34 user nova-compute[72382]:       <mac address="fa:16:3e:40:5f:a8"/>
Aug 09 15:37:34 user nova-compute[72382]:       <model type="virtio"/>
Aug 09 15:37:34 user nova-compute[72382]:       <mtu size="1442"/>
Aug 09 15:37:34 user nova-compute[72382]:       <target dev="tap8557ab28-97"/>
Aug 09 15:37:34 user nova-compute[72382]:     </interface>
Aug 09 15:37:34 user nova-compute[72382]:     <serial type="pty">
Aug 09 15:37:34 user nova-compute[72382]:       <log file="/opt/stack/data/nova/instances/54523d3e-bfae-4621-85cb-d6a7bc40abf5/console.log" append="off"/>
Aug 09 15:37:34 user nova-compute[72382]:     </serial>
Aug 09 15:37:34 user nova-compute[72382]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 15:37:34 user nova-compute[72382]:     <video>
Aug 09 15:37:34 user nova-compute[72382]:       <model type="virtio"/>
Aug 09 15:37:34 user nova-compute[72382]:     </video>
Aug 09 15:37:34 user nova-compute[72382]:     <rng model="virtio">
Aug 09 15:37:34 user nova-compute[72382]:       <backend model="random">/dev/urandom</backend>
Aug 09 15:37:34 user nova-compute[72382]:     </rng>
Aug 09 15:37:34 user nova-compute[72382]:     <controller type="usb" index="0" model="none"/>
Aug 09 15:37:34 user nova-compute[72382]:     <memballoon model="virtio">
Aug 09 15:37:34 user nova-compute[72382]:       <stats period="10"/>
Aug 09 15:37:34 user nova-compute[72382]:     </memballoon>
Aug 09 15:37:34 user nova-compute[72382]:   </devices>
Aug 09 15:37:34 user nova-compute[72382]: </domain>
Aug 09 15:37:34 user nova-compute[72382]:  {{(pid=72382) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 15:37:34 user nova-compute[72382]: DEBUG nova.virt.libvirt.vif [None req-8b1a1887-7c4b-4ffc-9dba-52515b7787a1 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T15:35:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1481123959',display_name='tempest-ServerActionsTestOtherA-server-1481123959',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1481123959',id=39,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCmuVV1ynikE+pH75fjLIal2KFmSgV7eQmOTfU0+P2w2YCXfBWnAu9n1cQQTYYTDt/aP+JsGjkRdlSPqvnnG5WbnlJT+9aj9SfyqprOo87kqF8CD2U4mVDTvv+6ADzXJvQ==',key_name='tempest-keypair-568328368',keypairs=<?>,launch_index=0,launched_at=2023-08-09T15:35:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='eb5bf3f95d2843af94dbcab2af932bd1',ramdisk_id='',reservation_id='r-f5r16m9c',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1899577274',owner_user_name='tempest-ServerActionsTestOtherA-1899577274-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T15:37:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2cca9aef887b4b91a46ff4bd5cd32302',uuid=54523d3e-bfae-4621-85cb-d6a7bc40abf5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8557ab28-9722-4e6e-a14d-f941e3b693c8", "address": "fa:16:3e:40:5f:a8", "network": {"id": "308641dc-cc18-41db-9baa-7cc880e594ad", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1932973397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1932973397-network", "vif_mac": "fa:16:3e:40:5f:a8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb5bf3f95d2843af94dbcab2af932bd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8557ab28-97", "ovs_interfaceid": "8557ab28-9722-4e6e-a14d-f941e3b693c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 15:37:34 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-8b1a1887-7c4b-4ffc-9dba-52515b7787a1 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Converting VIF {"id": "8557ab28-9722-4e6e-a14d-f941e3b693c8", "address": "fa:16:3e:40:5f:a8", "network": {"id": "308641dc-cc18-41db-9baa-7cc880e594ad", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1932973397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1932973397-network", "vif_mac": "fa:16:3e:40:5f:a8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb5bf3f95d2843af94dbcab2af932bd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8557ab28-97", "ovs_interfaceid": "8557ab28-9722-4e6e-a14d-f941e3b693c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 15:37:34 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-8b1a1887-7c4b-4ffc-9dba-52515b7787a1 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:40:5f:a8,bridge_name='br-int',has_traffic_filtering=True,id=8557ab28-9722-4e6e-a14d-f941e3b693c8,network=Network(308641dc-cc18-41db-9baa-7cc880e594ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8557ab28-97') {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 15:37:34 user nova-compute[72382]: DEBUG os_vif [None req-8b1a1887-7c4b-4ffc-9dba-52515b7787a1 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:40:5f:a8,bridge_name='br-int',has_traffic_filtering=True,id=8557ab28-9722-4e6e-a14d-f941e3b693c8,network=Network(308641dc-cc18-41db-9baa-7cc880e594ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8557ab28-97') {{(pid=72382) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 15:37:34 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:37:34 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:37:34 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 15:37:34 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:37:34 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8557ab28-97, may_exist=True, interface_attrs={}) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:37:34 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8557ab28-97, col_values=(('external_ids', {'iface-id': '8557ab28-9722-4e6e-a14d-f941e3b693c8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:40:5f:a8', 'vm-uuid': '54523d3e-bfae-4621-85cb-d6a7bc40abf5'}),), if_exists=True) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:37:34 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:37:34 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:37:34 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:37:34 user nova-compute[72382]: INFO os_vif [None req-8b1a1887-7c4b-4ffc-9dba-52515b7787a1 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:40:5f:a8,bridge_name='br-int',has_traffic_filtering=True,id=8557ab28-9722-4e6e-a14d-f941e3b693c8,network=Network(308641dc-cc18-41db-9baa-7cc880e594ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8557ab28-97')
Aug 09 15:37:34 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-8b1a1887-7c4b-4ffc-9dba-52515b7787a1 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] No BDM found with device name vda, not building metadata. {{(pid=72382) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 15:37:34 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-8b1a1887-7c4b-4ffc-9dba-52515b7787a1 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] No VIF found with MAC fa:16:3e:40:5f:a8, not building metadata {{(pid=72382) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 15:37:35 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:37:35 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:37:35 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:37:35 user nova-compute[72382]: DEBUG nova.compute.manager [req-7afa14dd-04de-4130-a438-ef0f5d7e16f3 req-4976793f-2848-4230-ad06-5780e6cf138b service nova] [instance: 54523d3e-bfae-4621-85cb-d6a7bc40abf5] Received event network-vif-plugged-8557ab28-9722-4e6e-a14d-f941e3b693c8 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:37:35 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-7afa14dd-04de-4130-a438-ef0f5d7e16f3 req-4976793f-2848-4230-ad06-5780e6cf138b service nova] Acquiring lock "54523d3e-bfae-4621-85cb-d6a7bc40abf5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:37:35 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-7afa14dd-04de-4130-a438-ef0f5d7e16f3 req-4976793f-2848-4230-ad06-5780e6cf138b service nova] Lock "54523d3e-bfae-4621-85cb-d6a7bc40abf5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:37:35 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-7afa14dd-04de-4130-a438-ef0f5d7e16f3 req-4976793f-2848-4230-ad06-5780e6cf138b service nova] Lock "54523d3e-bfae-4621-85cb-d6a7bc40abf5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:37:35 user nova-compute[72382]: DEBUG nova.compute.manager [req-7afa14dd-04de-4130-a438-ef0f5d7e16f3 req-4976793f-2848-4230-ad06-5780e6cf138b service nova] [instance: 54523d3e-bfae-4621-85cb-d6a7bc40abf5] No waiting events found dispatching network-vif-plugged-8557ab28-9722-4e6e-a14d-f941e3b693c8 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:37:35 user nova-compute[72382]: WARNING nova.compute.manager [req-7afa14dd-04de-4130-a438-ef0f5d7e16f3 req-4976793f-2848-4230-ad06-5780e6cf138b service nova] [instance: 54523d3e-bfae-4621-85cb-d6a7bc40abf5] Received unexpected event network-vif-plugged-8557ab28-9722-4e6e-a14d-f941e3b693c8 for instance with vm_state active and task_state resize_finish.
Aug 09 15:37:35 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:37:35 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:37:37 user nova-compute[72382]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691595442.3742797, 54523d3e-bfae-4621-85cb-d6a7bc40abf5 => Stopped> {{(pid=72382) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 15:37:37 user nova-compute[72382]: INFO nova.compute.manager [-] [instance: 54523d3e-bfae-4621-85cb-d6a7bc40abf5] VM Stopped (Lifecycle Event)
Aug 09 15:37:37 user nova-compute[72382]: DEBUG nova.compute.manager [None req-33ba0976-5e5d-4c56-a8bb-e261f938e93b None None] [instance: 54523d3e-bfae-4621-85cb-d6a7bc40abf5] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:37:37 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8b1a1887-7c4b-4ffc-9dba-52515b7787a1 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] [instance: 54523d3e-bfae-4621-85cb-d6a7bc40abf5] Instance event wait completed in 0 seconds for  {{(pid=72382) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 15:37:37 user nova-compute[72382]: DEBUG nova.virt.driver [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Emitting event <LifecycleEvent: 1691595457.5223055, 54523d3e-bfae-4621-85cb-d6a7bc40abf5 => Resumed> {{(pid=72382) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 15:37:37 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 54523d3e-bfae-4621-85cb-d6a7bc40abf5] VM Resumed (Lifecycle Event)
Aug 09 15:37:37 user nova-compute[72382]: INFO nova.virt.libvirt.driver [-] [instance: 54523d3e-bfae-4621-85cb-d6a7bc40abf5] Instance running successfully.
Aug 09 15:37:37 user nova-compute[72382]: DEBUG nova.virt.libvirt.guest [None req-8b1a1887-7c4b-4ffc-9dba-52515b7787a1 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] [instance: 54523d3e-bfae-4621-85cb-d6a7bc40abf5] Failed to set time: agent not configured {{(pid=72382) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Aug 09 15:37:37 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-8b1a1887-7c4b-4ffc-9dba-52515b7787a1 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] [instance: 54523d3e-bfae-4621-85cb-d6a7bc40abf5] finish_migration finished successfully. {{(pid=72382) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Aug 09 15:37:37 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 54523d3e-bfae-4621-85cb-d6a7bc40abf5] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:37:37 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 54523d3e-bfae-4621-85cb-d6a7bc40abf5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=72382) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 15:37:37 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 54523d3e-bfae-4621-85cb-d6a7bc40abf5] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 09 15:37:37 user nova-compute[72382]: DEBUG nova.virt.driver [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Emitting event <LifecycleEvent: 1691595457.523608, 54523d3e-bfae-4621-85cb-d6a7bc40abf5 => Started> {{(pid=72382) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 15:37:37 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 54523d3e-bfae-4621-85cb-d6a7bc40abf5] VM Started (Lifecycle Event)
Aug 09 15:37:37 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 54523d3e-bfae-4621-85cb-d6a7bc40abf5] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:37:37 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 54523d3e-bfae-4621-85cb-d6a7bc40abf5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=72382) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 15:37:37 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 54523d3e-bfae-4621-85cb-d6a7bc40abf5] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 09 15:37:37 user nova-compute[72382]: DEBUG nova.compute.manager [req-70a7129a-51cc-443f-aeba-c0cf5cccef73 req-f6882ea1-ceec-4082-98eb-3fe1a4010392 service nova] [instance: 54523d3e-bfae-4621-85cb-d6a7bc40abf5] Received event network-vif-plugged-8557ab28-9722-4e6e-a14d-f941e3b693c8 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:37:37 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-70a7129a-51cc-443f-aeba-c0cf5cccef73 req-f6882ea1-ceec-4082-98eb-3fe1a4010392 service nova] Acquiring lock "54523d3e-bfae-4621-85cb-d6a7bc40abf5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:37:37 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-70a7129a-51cc-443f-aeba-c0cf5cccef73 req-f6882ea1-ceec-4082-98eb-3fe1a4010392 service nova] Lock "54523d3e-bfae-4621-85cb-d6a7bc40abf5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:37:37 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-70a7129a-51cc-443f-aeba-c0cf5cccef73 req-f6882ea1-ceec-4082-98eb-3fe1a4010392 service nova] Lock "54523d3e-bfae-4621-85cb-d6a7bc40abf5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:37:37 user nova-compute[72382]: DEBUG nova.compute.manager [req-70a7129a-51cc-443f-aeba-c0cf5cccef73 req-f6882ea1-ceec-4082-98eb-3fe1a4010392 service nova] [instance: 54523d3e-bfae-4621-85cb-d6a7bc40abf5] No waiting events found dispatching network-vif-plugged-8557ab28-9722-4e6e-a14d-f941e3b693c8 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:37:37 user nova-compute[72382]: WARNING nova.compute.manager [req-70a7129a-51cc-443f-aeba-c0cf5cccef73 req-f6882ea1-ceec-4082-98eb-3fe1a4010392 service nova] [instance: 54523d3e-bfae-4621-85cb-d6a7bc40abf5] Received unexpected event network-vif-plugged-8557ab28-9722-4e6e-a14d-f941e3b693c8 for instance with vm_state active and task_state resize_finish.
Aug 09 15:37:39 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:37:39 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:37:44 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:37:49 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:37:50 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-4d44bed8-b8c1-497f-a6e8-942a1fd3a955 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Acquiring lock "7949b7d0-2712-402f-86ee-30acaef2d3e7" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:37:50 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-4d44bed8-b8c1-497f-a6e8-942a1fd3a955 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Lock "7949b7d0-2712-402f-86ee-30acaef2d3e7" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:37:50 user nova-compute[72382]: DEBUG nova.objects.instance [None req-4d44bed8-b8c1-497f-a6e8-942a1fd3a955 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Lazy-loading 'flavor' on Instance uuid 7949b7d0-2712-402f-86ee-30acaef2d3e7 {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:37:50 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-4d44bed8-b8c1-497f-a6e8-942a1fd3a955 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Lock "7949b7d0-2712-402f-86ee-30acaef2d3e7" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:37:51 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-4d44bed8-b8c1-497f-a6e8-942a1fd3a955 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Acquiring lock "7949b7d0-2712-402f-86ee-30acaef2d3e7" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:37:51 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-4d44bed8-b8c1-497f-a6e8-942a1fd3a955 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Lock "7949b7d0-2712-402f-86ee-30acaef2d3e7" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:37:51 user nova-compute[72382]: INFO nova.compute.manager [None req-4d44bed8-b8c1-497f-a6e8-942a1fd3a955 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] [instance: 7949b7d0-2712-402f-86ee-30acaef2d3e7] Attaching volume 170d7509-0928-4a87-9d9f-437977452501 to /dev/vdb
Aug 09 15:37:51 user nova-compute[72382]: DEBUG os_brick.utils [None req-4d44bed8-b8c1-497f-a6e8-942a1fd3a955 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 15:37:51 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:37:51 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:37:51 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[2314bd83-4b9e-4715-94d0-f11b9fc6fa26]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d2cfa7015fe\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:37:51 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:37:51 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:37:51 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[d815ba30-830f-4548-9dc1-610d640b0907]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:37:51 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:37:51 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:37:51 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c2007a5-5713-4114-8963-c3e4e41a31ca]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:37:51 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[a87cf314-619a-4122-a30d-86ac4b78277f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:37:51 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-4d44bed8-b8c1-497f-a6e8-942a1fd3a955 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Running cmd (subprocess): nvme version {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:37:51 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-4d44bed8-b8c1-497f-a6e8-942a1fd3a955 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] 'nvme version' failed. Not Retrying. {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 15:37:51 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4d44bed8-b8c1-497f-a6e8-942a1fd3a955 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] nvme not present on system {{(pid=72382) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 15:37:51 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:37:51 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 15:37:51 user nova-compute[72382]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 15:37:51 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[590f27a8-056e-4bf8-b0a3-1647b9f133dd]: (4, '') {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:37:51 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.lightos [None req-4d44bed8-b8c1-497f-a6e8-942a1fd3a955 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72382) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 15:37:51 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.lightos [None req-4d44bed8-b8c1-497f-a6e8-942a1fd3a955 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72382) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 15:37:51 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.lightos [None req-4d44bed8-b8c1-497f-a6e8-942a1fd3a955 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] LIGHTOS: no hostnqn found. {{(pid=72382) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 15:37:51 user nova-compute[72382]: DEBUG os_brick.utils [None req-4d44bed8-b8c1-497f-a6e8-942a1fd3a955 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d2cfa7015fe', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 15:37:51 user nova-compute[72382]: DEBUG nova.virt.block_device [None req-4d44bed8-b8c1-497f-a6e8-942a1fd3a955 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] [instance: 7949b7d0-2712-402f-86ee-30acaef2d3e7] Updating existing volume attachment record: 04f25fb9-689c-45c8-8c1a-c51ac9009eaf {{(pid=72382) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 15:37:51 user nova-compute[72382]: DEBUG nova.compute.manager [req-3d42203c-2590-47b4-b3bd-61d43da9435f req-12d4cb43-2411-4425-a55b-17fca068fd2c service nova] [instance: d66443a2-2dc1-46f6-9572-f0717f830927] Received event network-changed-49ab3b4d-3d4b-41a6-bd6f-a1c1567ca7bd {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:37:51 user nova-compute[72382]: DEBUG nova.compute.manager [req-3d42203c-2590-47b4-b3bd-61d43da9435f req-12d4cb43-2411-4425-a55b-17fca068fd2c service nova] [instance: d66443a2-2dc1-46f6-9572-f0717f830927] Refreshing instance network info cache due to event network-changed-49ab3b4d-3d4b-41a6-bd6f-a1c1567ca7bd. {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 15:37:51 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-3d42203c-2590-47b4-b3bd-61d43da9435f req-12d4cb43-2411-4425-a55b-17fca068fd2c service nova] Acquiring lock "refresh_cache-d66443a2-2dc1-46f6-9572-f0717f830927" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 15:37:51 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-3d42203c-2590-47b4-b3bd-61d43da9435f req-12d4cb43-2411-4425-a55b-17fca068fd2c service nova] Acquired lock "refresh_cache-d66443a2-2dc1-46f6-9572-f0717f830927" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 15:37:51 user nova-compute[72382]: DEBUG nova.network.neutron [req-3d42203c-2590-47b4-b3bd-61d43da9435f req-12d4cb43-2411-4425-a55b-17fca068fd2c service nova] [instance: d66443a2-2dc1-46f6-9572-f0717f830927] Refreshing network info cache for port 49ab3b4d-3d4b-41a6-bd6f-a1c1567ca7bd {{(pid=72382) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 15:37:51 user nova-compute[72382]: DEBUG nova.network.neutron [req-3d42203c-2590-47b4-b3bd-61d43da9435f req-12d4cb43-2411-4425-a55b-17fca068fd2c service nova] [instance: d66443a2-2dc1-46f6-9572-f0717f830927] Updated VIF entry in instance network info cache for port 49ab3b4d-3d4b-41a6-bd6f-a1c1567ca7bd. {{(pid=72382) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 15:37:51 user nova-compute[72382]: DEBUG nova.network.neutron [req-3d42203c-2590-47b4-b3bd-61d43da9435f req-12d4cb43-2411-4425-a55b-17fca068fd2c service nova] [instance: d66443a2-2dc1-46f6-9572-f0717f830927] Updating instance_info_cache with network_info: [{"id": "49ab3b4d-3d4b-41a6-bd6f-a1c1567ca7bd", "address": "fa:16:3e:5a:e8:fb", "network": {"id": "a85a6e1f-20f5-4719-90d2-0dc23ce525cd", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-780716970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.79", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c1a50eacfd0414bbc13e3fd4087e998", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49ab3b4d-3d", "ovs_interfaceid": "49ab3b4d-3d4b-41a6-bd6f-a1c1567ca7bd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:37:51 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-3d42203c-2590-47b4-b3bd-61d43da9435f req-12d4cb43-2411-4425-a55b-17fca068fd2c service nova] Releasing lock "refresh_cache-d66443a2-2dc1-46f6-9572-f0717f830927" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 15:37:54 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:37:54 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:37:55 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-3cb5fb78-8cbf-44fd-997d-c128c539270a tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Acquiring lock "d66443a2-2dc1-46f6-9572-f0717f830927" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:37:55 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-3cb5fb78-8cbf-44fd-997d-c128c539270a tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Lock "d66443a2-2dc1-46f6-9572-f0717f830927" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:37:55 user nova-compute[72382]: DEBUG nova.objects.instance [None req-3cb5fb78-8cbf-44fd-997d-c128c539270a tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Lazy-loading 'flavor' on Instance uuid d66443a2-2dc1-46f6-9572-f0717f830927 {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:37:55 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-3cb5fb78-8cbf-44fd-997d-c128c539270a tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Lock "d66443a2-2dc1-46f6-9572-f0717f830927" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:37:55 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-3cb5fb78-8cbf-44fd-997d-c128c539270a tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Acquiring lock "d66443a2-2dc1-46f6-9572-f0717f830927" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:37:55 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-3cb5fb78-8cbf-44fd-997d-c128c539270a tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Lock "d66443a2-2dc1-46f6-9572-f0717f830927" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:37:55 user nova-compute[72382]: INFO nova.compute.manager [None req-3cb5fb78-8cbf-44fd-997d-c128c539270a tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] [instance: d66443a2-2dc1-46f6-9572-f0717f830927] Attaching volume 726fb5e9-e6eb-43b0-84a3-497d899991b8 to /dev/vdb
Aug 09 15:37:55 user nova-compute[72382]: DEBUG os_brick.utils [None req-3cb5fb78-8cbf-44fd-997d-c128c539270a tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 15:37:55 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:37:55 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:37:55 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b9674f7-c0ad-4e4e-a4e9-32a0b5aa631d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d2cfa7015fe\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:37:55 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:37:55 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:37:55 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e20807e-4776-469e-8406-5a63388e9d8d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:37:55 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:37:55 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:37:55 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[49866936-32ea-4993-8b30-6da3b05ab4d0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:37:55 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7f52f09-0285-499c-a50e-bc9e2f47af5f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:37:55 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-3cb5fb78-8cbf-44fd-997d-c128c539270a tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Running cmd (subprocess): nvme version {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:37:55 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-3cb5fb78-8cbf-44fd-997d-c128c539270a tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] 'nvme version' failed. Not Retrying. {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 15:37:55 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3cb5fb78-8cbf-44fd-997d-c128c539270a tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] nvme not present on system {{(pid=72382) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 15:37:55 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:37:55 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 15:37:55 user nova-compute[72382]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 15:37:55 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ff4909e-351e-452f-a99f-a4da16764b74]: (4, '') {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:37:55 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.lightos [None req-3cb5fb78-8cbf-44fd-997d-c128c539270a tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72382) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 15:37:55 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.lightos [None req-3cb5fb78-8cbf-44fd-997d-c128c539270a tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72382) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 15:37:55 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.lightos [None req-3cb5fb78-8cbf-44fd-997d-c128c539270a tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] LIGHTOS: no hostnqn found. {{(pid=72382) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 15:37:55 user nova-compute[72382]: DEBUG os_brick.utils [None req-3cb5fb78-8cbf-44fd-997d-c128c539270a tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d2cfa7015fe', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 15:37:55 user nova-compute[72382]: DEBUG nova.virt.block_device [None req-3cb5fb78-8cbf-44fd-997d-c128c539270a tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] [instance: d66443a2-2dc1-46f6-9572-f0717f830927] Updating existing volume attachment record: e475d15b-ac45-400b-ad4a-76eb7f45d0f5 {{(pid=72382) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 15:37:59 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:37:59 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4d44bed8-b8c1-497f-a6e8-942a1fd3a955 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] [instance: 7949b7d0-2712-402f-86ee-30acaef2d3e7] Calling os-brick to attach iSCSI Volume {{(pid=72382) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 15:37:59 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d44bed8-b8c1-497f-a6e8-942a1fd3a955 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2a0c768340>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:170d7509-0928-4a87-9d9f-437977452501'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IeCsFWVU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 15:37:59 user nova-compute[72382]: WARNING os_brick.initiator.connectors.base [None req-4d44bed8-b8c1-497f-a6e8-942a1fd3a955 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 15:37:59 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-4d44bed8-b8c1-497f-a6e8-942a1fd3a955 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 15:37:59 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-4d44bed8-b8c1-497f-a6e8-942a1fd3a955 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 15:37:59 user nova-compute[72382]: WARNING os_brick.initiator.connectors.base [None req-4d44bed8-b8c1-497f-a6e8-942a1fd3a955 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 15:37:59 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-4d44bed8-b8c1-497f-a6e8-942a1fd3a955 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:170d7509-0928-4a87-9d9f-437977452501" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 15:37:59 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-4d44bed8-b8c1-497f-a6e8-942a1fd3a955 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:170d7509-0928-4a87-9d9f-437977452501" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 15:37:59 user nova-compute[72382]: INFO os_brick.initiator.connectors.iscsi [None req-4d44bed8-b8c1-497f-a6e8-942a1fd3a955 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 15:37:59 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:170d7509-0928-4a87-9d9f-437977452501 -p 172.16.0.220:3260 {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:37:59 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:170d7509-0928-4a87-9d9f-437977452501 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:37:59 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[6453e40e-b406-4c87-8592-46a045f591a6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:37:59 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d44bed8-b8c1-497f-a6e8-942a1fd3a955 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 15:37:59 user nova-compute[72382]:  {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:37:59 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:170d7509-0928-4a87-9d9f-437977452501 -p 172.16.0.220:3260 --interface default --op new {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:37:59 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:170d7509-0928-4a87-9d9f-437977452501 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:37:59 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[6553a644-85f5-4583-9f8a-89b7966761f8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:170d7509-0928-4a87-9d9f-437977452501] added\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:37:59 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d44bed8-b8c1-497f-a6e8-942a1fd3a955 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:170d7509-0928-4a87-9d9f-437977452501] added
Aug 09 15:37:59 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:37:59 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:170d7509-0928-4a87-9d9f-437977452501 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:37:59 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:170d7509-0928-4a87-9d9f-437977452501 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:37:59 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[3858ad26-2825-4d74-96ea-979889410dfc]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:37:59 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d44bed8-b8c1-497f-a6e8-942a1fd3a955 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:37:59 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:170d7509-0928-4a87-9d9f-437977452501 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:37:59 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:170d7509-0928-4a87-9d9f-437977452501 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:37:59 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b433bd1-5aec-4331-b3a2-270a263033a1]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:37:59 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d44bed8-b8c1-497f-a6e8-942a1fd3a955 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:37:59 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:170d7509-0928-4a87-9d9f-437977452501 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IeCsFWVU {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:37:59 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:170d7509-0928-4a87-9d9f-437977452501 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IeCsFWVU" returned: 0 in 0.018s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:37:59 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fdf6440-951c-4bce-ad27-7a1e0062b441]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:37:59 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d44bed8-b8c1-497f-a6e8-942a1fd3a955 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IeCsFWVU'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:37:59 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:170d7509-0928-4a87-9d9f-437977452501 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:37:59 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:170d7509-0928-4a87-9d9f-437977452501 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:37:59 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb5126f3-8d0e-4449-bd5d-24c2b457f13a]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:37:59 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d44bed8-b8c1-497f-a6e8-942a1fd3a955 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:37:59 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:37:59 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:37:59 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ae8d876-dd19-45b7-8570-8422364a7251]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f58579c-f69a-4bee-b16e-970e5a8f590c (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0a612d6-0f3f-4d2c-9fb5-aff9384338de (non-flash)\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:37:59 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d44bed8-b8c1-497f-a6e8-942a1fd3a955 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f58579c-f69a-4bee-b16e-970e5a8f590c (non-flash)
Aug 09 15:37:59 user nova-compute[72382]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0a612d6-0f3f-4d2c-9fb5-aff9384338de (non-flash)
Aug 09 15:37:59 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 15:37:59 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d44bed8-b8c1-497f-a6e8-942a1fd3a955 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f58579c-f69a-4bee-b16e-970e5a8f590c (non-flash)
Aug 09 15:37:59 user nova-compute[72382]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0a612d6-0f3f-4d2c-9fb5-aff9384338de (non-flash)
Aug 09 15:37:59 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 15:37:59 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:170d7509-0928-4a87-9d9f-437977452501 -p 172.16.0.220:3260 --login {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:37:59 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:170d7509-0928-4a87-9d9f-437977452501 -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:37:59 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[358f707f-742d-4094-96e0-6f96c21025a2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:170d7509-0928-4a87-9d9f-437977452501, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:170d7509-0928-4a87-9d9f-437977452501, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:37:59 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d44bed8-b8c1-497f-a6e8-942a1fd3a955 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:170d7509-0928-4a87-9d9f-437977452501, portal: 172.16.0.220,3260]
Aug 09 15:37:59 user nova-compute[72382]: Login to [iface: default, target: iqn.2010-10.org.openstack:170d7509-0928-4a87-9d9f-437977452501, portal: 172.16.0.220,3260] successful.
Aug 09 15:37:59 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:37:59 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:170d7509-0928-4a87-9d9f-437977452501 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:37:59 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:170d7509-0928-4a87-9d9f-437977452501 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:37:59 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[87ee3d55-601d-4914-95fc-7b456801b767]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:37:59 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d44bed8-b8c1-497f-a6e8-942a1fd3a955 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:37:59 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:37:59 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:37:59 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[12038199-a946-4767-a5b5-23e7fe7ad5d1]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f58579c-f69a-4bee-b16e-970e5a8f590c (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0a612d6-0f3f-4d2c-9fb5-aff9384338de (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:170d7509-0928-4a87-9d9f-437977452501 (non-flash)\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:37:59 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d44bed8-b8c1-497f-a6e8-942a1fd3a955 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f58579c-f69a-4bee-b16e-970e5a8f590c (non-flash)
Aug 09 15:37:59 user nova-compute[72382]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0a612d6-0f3f-4d2c-9fb5-aff9384338de (non-flash)
Aug 09 15:37:59 user nova-compute[72382]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:170d7509-0928-4a87-9d9f-437977452501 (non-flash)
Aug 09 15:37:59 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 15:37:59 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d44bed8-b8c1-497f-a6e8-942a1fd3a955 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f58579c-f69a-4bee-b16e-970e5a8f590c (non-flash)
Aug 09 15:37:59 user nova-compute[72382]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0a612d6-0f3f-4d2c-9fb5-aff9384338de (non-flash)
Aug 09 15:37:59 user nova-compute[72382]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:170d7509-0928-4a87-9d9f-437977452501 (non-flash)
Aug 09 15:37:59 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 15:37:59 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-4d44bed8-b8c1-497f-a6e8-942a1fd3a955 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:170d7509-0928-4a87-9d9f-437977452501" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.276s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 15:37:59 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d44bed8-b8c1-497f-a6e8-942a1fd3a955 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Connected to 172.16.0.220:3260 {{(pid=72382) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 15:37:59 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-4d44bed8-b8c1-497f-a6e8-942a1fd3a955 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] HCTL ('35', '-', '-', 0) found on session 50 with lun 0 {{(pid=72382) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 15:37:59 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-4d44bed8-b8c1-497f-a6e8-942a1fd3a955 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72382) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 15:37:59 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:37:59 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:37:59 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a020a20-013e-4e29-881e-784c9d5e0396]: (4, ('- - 0', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:37:59 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-4d44bed8-b8c1-497f-a6e8-942a1fd3a955 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Searching for a device in session 50 and hctl ['35', '*', '*', 0] yield: None {{(pid=72382) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 15:37:59 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:38:00 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-4d44bed8-b8c1-497f-a6e8-942a1fd3a955 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Searching for a device in session 50 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72382) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 15:38:00 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d44bed8-b8c1-497f-a6e8-942a1fd3a955 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IeCsFWVU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72382) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 15:38:00 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-4d44bed8-b8c1-497f-a6e8-942a1fd3a955 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.307s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 15:38:00 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d44bed8-b8c1-497f-a6e8-942a1fd3a955 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] <== connect_volume: return (1308ms) {'type': 'block', 'scsi_wwn': '23638613364663539', 'path': '/dev/sdd'} {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 15:38:00 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4d44bed8-b8c1-497f-a6e8-942a1fd3a955 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] [instance: 7949b7d0-2712-402f-86ee-30acaef2d3e7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23638613364663539', 'path': '/dev/sdd'} {{(pid=72382) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 15:38:00 user nova-compute[72382]: DEBUG nova.objects.instance [None req-4d44bed8-b8c1-497f-a6e8-942a1fd3a955 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Lazy-loading 'flavor' on Instance uuid 7949b7d0-2712-402f-86ee-30acaef2d3e7 {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:38:00 user nova-compute[72382]: DEBUG nova.virt.libvirt.guest [None req-4d44bed8-b8c1-497f-a6e8-942a1fd3a955 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 15:38:00 user nova-compute[72382]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 15:38:00 user nova-compute[72382]:   <source dev="/dev/sdd"/>
Aug 09 15:38:00 user nova-compute[72382]:   <target dev="vdb" bus="virtio"/>
Aug 09 15:38:00 user nova-compute[72382]:   <serial>170d7509-0928-4a87-9d9f-437977452501</serial>
Aug 09 15:38:00 user nova-compute[72382]: </disk>
Aug 09 15:38:00 user nova-compute[72382]:  {{(pid=72382) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 15:38:01 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-4d44bed8-b8c1-497f-a6e8-942a1fd3a955 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] No BDM found with device name vda, not building metadata. {{(pid=72382) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 15:38:01 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-4d44bed8-b8c1-497f-a6e8-942a1fd3a955 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72382) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 15:38:01 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-4d44bed8-b8c1-497f-a6e8-942a1fd3a955 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] No VIF found with MAC fa:16:3e:26:fd:d1, not building metadata {{(pid=72382) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 15:38:01 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-4d44bed8-b8c1-497f-a6e8-942a1fd3a955 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Lock "7949b7d0-2712-402f-86ee-30acaef2d3e7" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.291s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:38:03 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3cb5fb78-8cbf-44fd-997d-c128c539270a tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] [instance: d66443a2-2dc1-46f6-9572-f0717f830927] Calling os-brick to attach iSCSI Volume {{(pid=72382) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 15:38:03 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cb5fb78-8cbf-44fd-997d-c128c539270a tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2a0c768340>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:726fb5e9-e6eb-43b0-84a3-497d899991b8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mNoghzWZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 15:38:03 user nova-compute[72382]: WARNING os_brick.initiator.connectors.base [None req-3cb5fb78-8cbf-44fd-997d-c128c539270a tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 15:38:03 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-3cb5fb78-8cbf-44fd-997d-c128c539270a tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 15:38:03 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-3cb5fb78-8cbf-44fd-997d-c128c539270a tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 15:38:03 user nova-compute[72382]: WARNING os_brick.initiator.connectors.base [None req-3cb5fb78-8cbf-44fd-997d-c128c539270a tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 15:38:03 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-3cb5fb78-8cbf-44fd-997d-c128c539270a tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:726fb5e9-e6eb-43b0-84a3-497d899991b8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 15:38:03 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-3cb5fb78-8cbf-44fd-997d-c128c539270a tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:726fb5e9-e6eb-43b0-84a3-497d899991b8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 15:38:03 user nova-compute[72382]: INFO os_brick.initiator.connectors.iscsi [None req-3cb5fb78-8cbf-44fd-997d-c128c539270a tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 15:38:03 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:726fb5e9-e6eb-43b0-84a3-497d899991b8 -p 172.16.0.220:3260 {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:38:03 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:726fb5e9-e6eb-43b0-84a3-497d899991b8 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:38:03 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f7bbeec-8df3-4a1c-bd57-08da793bab57]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:38:03 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cb5fb78-8cbf-44fd-997d-c128c539270a tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 15:38:03 user nova-compute[72382]:  {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:38:03 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:726fb5e9-e6eb-43b0-84a3-497d899991b8 -p 172.16.0.220:3260 --interface default --op new {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:38:03 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:726fb5e9-e6eb-43b0-84a3-497d899991b8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:38:03 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac6b72ae-dae9-4b64-aac4-0c002a09c523]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:726fb5e9-e6eb-43b0-84a3-497d899991b8] added\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:38:03 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cb5fb78-8cbf-44fd-997d-c128c539270a tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:726fb5e9-e6eb-43b0-84a3-497d899991b8] added
Aug 09 15:38:03 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:38:03 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:726fb5e9-e6eb-43b0-84a3-497d899991b8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:38:03 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:726fb5e9-e6eb-43b0-84a3-497d899991b8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:38:03 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[427b068c-80d6-4876-9751-d4d3f59090c5]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:38:03 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cb5fb78-8cbf-44fd-997d-c128c539270a tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:38:03 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:726fb5e9-e6eb-43b0-84a3-497d899991b8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:38:03 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:726fb5e9-e6eb-43b0-84a3-497d899991b8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:38:03 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[d98febfb-ccea-486c-b2f1-e1c460015a48]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:38:03 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cb5fb78-8cbf-44fd-997d-c128c539270a tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:38:03 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:726fb5e9-e6eb-43b0-84a3-497d899991b8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mNoghzWZ {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:38:03 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:726fb5e9-e6eb-43b0-84a3-497d899991b8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mNoghzWZ" returned: 0 in 0.018s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:38:03 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d668602-f4e0-4783-bd75-ec7492dbc623]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:38:03 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cb5fb78-8cbf-44fd-997d-c128c539270a tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mNoghzWZ'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:38:03 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:726fb5e9-e6eb-43b0-84a3-497d899991b8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:38:03 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:726fb5e9-e6eb-43b0-84a3-497d899991b8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:38:03 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[98c2783a-06eb-4792-9cd0-d85d0d4b7c9f]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:38:03 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cb5fb78-8cbf-44fd-997d-c128c539270a tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:38:03 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:38:03 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:38:03 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[1da1f886-c535-4cdc-8872-7066017b4e6f]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f58579c-f69a-4bee-b16e-970e5a8f590c (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0a612d6-0f3f-4d2c-9fb5-aff9384338de (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:170d7509-0928-4a87-9d9f-437977452501 (non-flash)\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:38:03 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cb5fb78-8cbf-44fd-997d-c128c539270a tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f58579c-f69a-4bee-b16e-970e5a8f590c (non-flash)
Aug 09 15:38:03 user nova-compute[72382]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0a612d6-0f3f-4d2c-9fb5-aff9384338de (non-flash)
Aug 09 15:38:03 user nova-compute[72382]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:170d7509-0928-4a87-9d9f-437977452501 (non-flash)
Aug 09 15:38:03 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 15:38:03 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cb5fb78-8cbf-44fd-997d-c128c539270a tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f58579c-f69a-4bee-b16e-970e5a8f590c (non-flash)
Aug 09 15:38:03 user nova-compute[72382]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0a612d6-0f3f-4d2c-9fb5-aff9384338de (non-flash)
Aug 09 15:38:03 user nova-compute[72382]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:170d7509-0928-4a87-9d9f-437977452501 (non-flash)
Aug 09 15:38:03 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 15:38:03 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:726fb5e9-e6eb-43b0-84a3-497d899991b8 -p 172.16.0.220:3260 --login {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:38:03 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:726fb5e9-e6eb-43b0-84a3-497d899991b8 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:38:03 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd41be4e-38fc-4ca5-b602-c192e6cf96d3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:726fb5e9-e6eb-43b0-84a3-497d899991b8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:726fb5e9-e6eb-43b0-84a3-497d899991b8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:38:03 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cb5fb78-8cbf-44fd-997d-c128c539270a tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:726fb5e9-e6eb-43b0-84a3-497d899991b8, portal: 172.16.0.220,3260]
Aug 09 15:38:03 user nova-compute[72382]: Login to [iface: default, target: iqn.2010-10.org.openstack:726fb5e9-e6eb-43b0-84a3-497d899991b8, portal: 172.16.0.220,3260] successful.
Aug 09 15:38:03 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:38:03 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:726fb5e9-e6eb-43b0-84a3-497d899991b8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:38:03 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:726fb5e9-e6eb-43b0-84a3-497d899991b8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:38:03 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[39c57f3e-77d4-45cb-8206-4fe4907940ea]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:38:03 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cb5fb78-8cbf-44fd-997d-c128c539270a tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:38:03 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:38:04 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:38:04 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3275763-e08c-4367-b9d4-c3ed830d0c2e]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f58579c-f69a-4bee-b16e-970e5a8f590c (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0a612d6-0f3f-4d2c-9fb5-aff9384338de (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:170d7509-0928-4a87-9d9f-437977452501 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:726fb5e9-e6eb-43b0-84a3-497d899991b8 (non-flash)\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:38:04 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cb5fb78-8cbf-44fd-997d-c128c539270a tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f58579c-f69a-4bee-b16e-970e5a8f590c (non-flash)
Aug 09 15:38:04 user nova-compute[72382]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0a612d6-0f3f-4d2c-9fb5-aff9384338de (non-flash)
Aug 09 15:38:04 user nova-compute[72382]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:170d7509-0928-4a87-9d9f-437977452501 (non-flash)
Aug 09 15:38:04 user nova-compute[72382]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:726fb5e9-e6eb-43b0-84a3-497d899991b8 (non-flash)
Aug 09 15:38:04 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 15:38:04 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cb5fb78-8cbf-44fd-997d-c128c539270a tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f58579c-f69a-4bee-b16e-970e5a8f590c (non-flash)
Aug 09 15:38:04 user nova-compute[72382]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0a612d6-0f3f-4d2c-9fb5-aff9384338de (non-flash)
Aug 09 15:38:04 user nova-compute[72382]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:170d7509-0928-4a87-9d9f-437977452501 (non-flash)
Aug 09 15:38:04 user nova-compute[72382]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:726fb5e9-e6eb-43b0-84a3-497d899991b8 (non-flash)
Aug 09 15:38:04 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 15:38:04 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-3cb5fb78-8cbf-44fd-997d-c128c539270a tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:726fb5e9-e6eb-43b0-84a3-497d899991b8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.285s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 15:38:04 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cb5fb78-8cbf-44fd-997d-c128c539270a tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Connected to 172.16.0.220:3260 {{(pid=72382) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 15:38:04 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-3cb5fb78-8cbf-44fd-997d-c128c539270a tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] HCTL ('36', '-', '-', 0) found on session 51 with lun 0 {{(pid=72382) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 15:38:04 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-3cb5fb78-8cbf-44fd-997d-c128c539270a tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72382) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 15:38:04 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:38:04 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.020s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:38:04 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[f663f3c4-d571-4c92-98df-8b021dfaf14e]: (4, ('- - 0', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:38:04 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-3cb5fb78-8cbf-44fd-997d-c128c539270a tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Searching for a device in session 51 and hctl ['36', '*', '*', 0] yield: None {{(pid=72382) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 15:38:04 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:38:04 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:38:05 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-3cb5fb78-8cbf-44fd-997d-c128c539270a tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Searching for a device in session 51 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72382) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 15:38:05 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cb5fb78-8cbf-44fd-997d-c128c539270a tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mNoghzWZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72382) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 15:38:05 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-3cb5fb78-8cbf-44fd-997d-c128c539270a tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.318s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 15:38:05 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cb5fb78-8cbf-44fd-997d-c128c539270a tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] <== connect_volume: return (1319ms) {'type': 'block', 'scsi_wwn': '26465393737333466', 'path': '/dev/sde'} {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 15:38:05 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3cb5fb78-8cbf-44fd-997d-c128c539270a tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] [instance: d66443a2-2dc1-46f6-9572-f0717f830927] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26465393737333466', 'path': '/dev/sde'} {{(pid=72382) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 15:38:05 user nova-compute[72382]: DEBUG nova.objects.instance [None req-3cb5fb78-8cbf-44fd-997d-c128c539270a tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Lazy-loading 'flavor' on Instance uuid d66443a2-2dc1-46f6-9572-f0717f830927 {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:38:05 user nova-compute[72382]: DEBUG nova.virt.libvirt.guest [None req-3cb5fb78-8cbf-44fd-997d-c128c539270a tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 15:38:05 user nova-compute[72382]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 15:38:05 user nova-compute[72382]:   <source dev="/dev/sde"/>
Aug 09 15:38:05 user nova-compute[72382]:   <target dev="vdb" bus="virtio"/>
Aug 09 15:38:05 user nova-compute[72382]:   <serial>726fb5e9-e6eb-43b0-84a3-497d899991b8</serial>
Aug 09 15:38:05 user nova-compute[72382]: </disk>
Aug 09 15:38:05 user nova-compute[72382]:  {{(pid=72382) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 15:38:05 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-3cb5fb78-8cbf-44fd-997d-c128c539270a tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] No BDM found with device name vda, not building metadata. {{(pid=72382) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 15:38:05 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-3cb5fb78-8cbf-44fd-997d-c128c539270a tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72382) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 15:38:05 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-3cb5fb78-8cbf-44fd-997d-c128c539270a tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] No VIF found with MAC fa:16:3e:5a:e8:fb, not building metadata {{(pid=72382) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 15:38:05 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-3cb5fb78-8cbf-44fd-997d-c128c539270a tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Lock "d66443a2-2dc1-46f6-9572-f0717f830927" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.394s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:38:08 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-7813323f-510a-4504-a7df-c7e49447d98f tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] Acquiring lock "c88a5ff2-9789-4ee8-8283-6248bba6d66a" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:38:08 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-7813323f-510a-4504-a7df-c7e49447d98f tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] Lock "c88a5ff2-9789-4ee8-8283-6248bba6d66a" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:38:08 user nova-compute[72382]: INFO nova.compute.manager [None req-7813323f-510a-4504-a7df-c7e49447d98f tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] [instance: c88a5ff2-9789-4ee8-8283-6248bba6d66a] Unshelving
Aug 09 15:38:08 user nova-compute[72382]: INFO nova.virt.block_device [None req-7813323f-510a-4504-a7df-c7e49447d98f tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] [instance: c88a5ff2-9789-4ee8-8283-6248bba6d66a] Booting with volume d2f5dbb5-f862-4389-b42a-872d5c94aa55 at /dev/vda
Aug 09 15:38:08 user nova-compute[72382]: DEBUG os_brick.utils [None req-7813323f-510a-4504-a7df-c7e49447d98f tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 15:38:08 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:38:08 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:38:08 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b6ec54e-94b5-46c7-b12a-b19663d10a86]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d2cfa7015fe\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:38:08 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:38:08 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:38:08 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[c27b24c9-4ed6-4c74-bb48-95647b518440]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:38:08 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:38:08 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:38:08 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:38:08 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[a40c2eb8-ff59-4473-b8d3-14c154cf264f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:38:08 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[35c6a0eb-ab03-4e44-b15d-cd7638be4883]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:38:08 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-7813323f-510a-4504-a7df-c7e49447d98f tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] Running cmd (subprocess): nvme version {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:38:08 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-7813323f-510a-4504-a7df-c7e49447d98f tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] 'nvme version' failed. Not Retrying. {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 15:38:08 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7813323f-510a-4504-a7df-c7e49447d98f tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] nvme not present on system {{(pid=72382) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 15:38:08 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:38:08 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 15:38:08 user nova-compute[72382]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 15:38:08 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eb86cda-f8c2-490f-9138-bd31ff6df5ac]: (4, '') {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:38:08 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.lightos [None req-7813323f-510a-4504-a7df-c7e49447d98f tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72382) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 15:38:08 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.lightos [None req-7813323f-510a-4504-a7df-c7e49447d98f tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72382) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 15:38:08 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.lightos [None req-7813323f-510a-4504-a7df-c7e49447d98f tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] LIGHTOS: no hostnqn found. {{(pid=72382) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 15:38:08 user nova-compute[72382]: DEBUG os_brick.utils [None req-7813323f-510a-4504-a7df-c7e49447d98f tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d2cfa7015fe', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 15:38:08 user nova-compute[72382]: DEBUG nova.virt.block_device [None req-7813323f-510a-4504-a7df-c7e49447d98f tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] [instance: c88a5ff2-9789-4ee8-8283-6248bba6d66a] Updating existing volume attachment record: 86cbb496-3eba-4ccb-8f04-2030ea31aa15 {{(pid=72382) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 15:38:09 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:38:09 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-5330cdb0-0529-41d6-9237-0310e4afff7d tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Acquiring lock "d66443a2-2dc1-46f6-9572-f0717f830927" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:38:09 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-5330cdb0-0529-41d6-9237-0310e4afff7d tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Lock "d66443a2-2dc1-46f6-9572-f0717f830927" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:38:09 user nova-compute[72382]: DEBUG nova.objects.instance [None req-5330cdb0-0529-41d6-9237-0310e4afff7d tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Lazy-loading 'flavor' on Instance uuid d66443a2-2dc1-46f6-9572-f0717f830927 {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:38:09 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-5330cdb0-0529-41d6-9237-0310e4afff7d tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Lock "d66443a2-2dc1-46f6-9572-f0717f830927" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:38:09 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:38:09 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-5330cdb0-0529-41d6-9237-0310e4afff7d tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Acquiring lock "d66443a2-2dc1-46f6-9572-f0717f830927" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:38:09 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-5330cdb0-0529-41d6-9237-0310e4afff7d tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Lock "d66443a2-2dc1-46f6-9572-f0717f830927" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:38:09 user nova-compute[72382]: INFO nova.compute.manager [None req-5330cdb0-0529-41d6-9237-0310e4afff7d tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] [instance: d66443a2-2dc1-46f6-9572-f0717f830927] Attaching volume 34d84af2-674d-428b-ba0e-5759ed077c26 to /dev/vdc
Aug 09 15:38:09 user nova-compute[72382]: DEBUG os_brick.utils [None req-5330cdb0-0529-41d6-9237-0310e4afff7d tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 15:38:09 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:38:09 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:38:09 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[704be510-83ec-45d3-bd73-fd36d3043374]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d2cfa7015fe\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:38:09 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:38:09 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:38:09 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[deff839d-b21c-44aa-b0e1-53fe1db98038]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:38:09 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:38:09 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.013s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:38:09 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f5f6226-1e67-47c6-aa8a-beab95f8879a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:38:09 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[b076d48d-bce5-4a88-ad7c-c2eac9460a97]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:38:09 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-5330cdb0-0529-41d6-9237-0310e4afff7d tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Running cmd (subprocess): nvme version {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:38:10 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-5330cdb0-0529-41d6-9237-0310e4afff7d tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] 'nvme version' failed. Not Retrying. {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 15:38:10 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5330cdb0-0529-41d6-9237-0310e4afff7d tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] nvme not present on system {{(pid=72382) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 15:38:10 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:38:10 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 15:38:10 user nova-compute[72382]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 15:38:10 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[134d2a4b-40f1-4e58-9802-ea2aa37ed5c4]: (4, '') {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:38:10 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.lightos [None req-5330cdb0-0529-41d6-9237-0310e4afff7d tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72382) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 15:38:10 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.lightos [None req-5330cdb0-0529-41d6-9237-0310e4afff7d tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72382) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 15:38:10 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.lightos [None req-5330cdb0-0529-41d6-9237-0310e4afff7d tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] LIGHTOS: no hostnqn found. {{(pid=72382) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 15:38:10 user nova-compute[72382]: DEBUG os_brick.utils [None req-5330cdb0-0529-41d6-9237-0310e4afff7d tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d2cfa7015fe', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 15:38:10 user nova-compute[72382]: DEBUG nova.virt.block_device [None req-5330cdb0-0529-41d6-9237-0310e4afff7d tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] [instance: d66443a2-2dc1-46f6-9572-f0717f830927] Updating existing volume attachment record: 6e97004b-0272-4550-a2df-f8fecb622c5c {{(pid=72382) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 15:38:10 user nova-compute[72382]: DEBUG nova.compute.manager [req-430d921c-c56c-4ad1-b7b9-51c8b6032ad2 req-9dd05da2-d924-4a8a-88b3-6b2ba6214b10 service nova] [instance: 7949b7d0-2712-402f-86ee-30acaef2d3e7] Received event network-changed-bf6ac419-c6ba-4f01-b35a-4fa5e58913be {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:38:10 user nova-compute[72382]: DEBUG nova.compute.manager [req-430d921c-c56c-4ad1-b7b9-51c8b6032ad2 req-9dd05da2-d924-4a8a-88b3-6b2ba6214b10 service nova] [instance: 7949b7d0-2712-402f-86ee-30acaef2d3e7] Refreshing instance network info cache due to event network-changed-bf6ac419-c6ba-4f01-b35a-4fa5e58913be. {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 15:38:10 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-430d921c-c56c-4ad1-b7b9-51c8b6032ad2 req-9dd05da2-d924-4a8a-88b3-6b2ba6214b10 service nova] Acquiring lock "refresh_cache-7949b7d0-2712-402f-86ee-30acaef2d3e7" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 15:38:10 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-430d921c-c56c-4ad1-b7b9-51c8b6032ad2 req-9dd05da2-d924-4a8a-88b3-6b2ba6214b10 service nova] Acquired lock "refresh_cache-7949b7d0-2712-402f-86ee-30acaef2d3e7" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 15:38:10 user nova-compute[72382]: DEBUG nova.network.neutron [req-430d921c-c56c-4ad1-b7b9-51c8b6032ad2 req-9dd05da2-d924-4a8a-88b3-6b2ba6214b10 service nova] [instance: 7949b7d0-2712-402f-86ee-30acaef2d3e7] Refreshing network info cache for port bf6ac419-c6ba-4f01-b35a-4fa5e58913be {{(pid=72382) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 15:38:11 user nova-compute[72382]: DEBUG nova.network.neutron [req-430d921c-c56c-4ad1-b7b9-51c8b6032ad2 req-9dd05da2-d924-4a8a-88b3-6b2ba6214b10 service nova] [instance: 7949b7d0-2712-402f-86ee-30acaef2d3e7] Updated VIF entry in instance network info cache for port bf6ac419-c6ba-4f01-b35a-4fa5e58913be. {{(pid=72382) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 15:38:11 user nova-compute[72382]: DEBUG nova.network.neutron [req-430d921c-c56c-4ad1-b7b9-51c8b6032ad2 req-9dd05da2-d924-4a8a-88b3-6b2ba6214b10 service nova] [instance: 7949b7d0-2712-402f-86ee-30acaef2d3e7] Updating instance_info_cache with network_info: [{"id": "bf6ac419-c6ba-4f01-b35a-4fa5e58913be", "address": "fa:16:3e:26:fd:d1", "network": {"id": "8d929426-09f7-49b5-a79e-711e20e00750", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1307802727-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.154", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93c87775443b4abd987197c4b46693bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf6ac419-c6", "ovs_interfaceid": "bf6ac419-c6ba-4f01-b35a-4fa5e58913be", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:38:11 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-430d921c-c56c-4ad1-b7b9-51c8b6032ad2 req-9dd05da2-d924-4a8a-88b3-6b2ba6214b10 service nova] Releasing lock "refresh_cache-7949b7d0-2712-402f-86ee-30acaef2d3e7" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 15:38:12 user nova-compute[72382]: DEBUG nova.compute.manager [req-bdf66e42-efdb-4f2f-a286-f89e5c3cbbec req-02c9c74b-bf9f-449c-be64-b7c114f4d69b service nova] [instance: 7949b7d0-2712-402f-86ee-30acaef2d3e7] Received event network-changed-bf6ac419-c6ba-4f01-b35a-4fa5e58913be {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:38:12 user nova-compute[72382]: DEBUG nova.compute.manager [req-bdf66e42-efdb-4f2f-a286-f89e5c3cbbec req-02c9c74b-bf9f-449c-be64-b7c114f4d69b service nova] [instance: 7949b7d0-2712-402f-86ee-30acaef2d3e7] Refreshing instance network info cache due to event network-changed-bf6ac419-c6ba-4f01-b35a-4fa5e58913be. {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 15:38:12 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-bdf66e42-efdb-4f2f-a286-f89e5c3cbbec req-02c9c74b-bf9f-449c-be64-b7c114f4d69b service nova] Acquiring lock "refresh_cache-7949b7d0-2712-402f-86ee-30acaef2d3e7" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 15:38:12 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-bdf66e42-efdb-4f2f-a286-f89e5c3cbbec req-02c9c74b-bf9f-449c-be64-b7c114f4d69b service nova] Acquired lock "refresh_cache-7949b7d0-2712-402f-86ee-30acaef2d3e7" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 15:38:12 user nova-compute[72382]: DEBUG nova.network.neutron [req-bdf66e42-efdb-4f2f-a286-f89e5c3cbbec req-02c9c74b-bf9f-449c-be64-b7c114f4d69b service nova] [instance: 7949b7d0-2712-402f-86ee-30acaef2d3e7] Refreshing network info cache for port bf6ac419-c6ba-4f01-b35a-4fa5e58913be {{(pid=72382) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 15:38:13 user nova-compute[72382]: DEBUG nova.network.neutron [req-bdf66e42-efdb-4f2f-a286-f89e5c3cbbec req-02c9c74b-bf9f-449c-be64-b7c114f4d69b service nova] [instance: 7949b7d0-2712-402f-86ee-30acaef2d3e7] Updated VIF entry in instance network info cache for port bf6ac419-c6ba-4f01-b35a-4fa5e58913be. {{(pid=72382) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 15:38:13 user nova-compute[72382]: DEBUG nova.network.neutron [req-bdf66e42-efdb-4f2f-a286-f89e5c3cbbec req-02c9c74b-bf9f-449c-be64-b7c114f4d69b service nova] [instance: 7949b7d0-2712-402f-86ee-30acaef2d3e7] Updating instance_info_cache with network_info: [{"id": "bf6ac419-c6ba-4f01-b35a-4fa5e58913be", "address": "fa:16:3e:26:fd:d1", "network": {"id": "8d929426-09f7-49b5-a79e-711e20e00750", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1307802727-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.154", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93c87775443b4abd987197c4b46693bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf6ac419-c6", "ovs_interfaceid": "bf6ac419-c6ba-4f01-b35a-4fa5e58913be", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:38:13 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-bdf66e42-efdb-4f2f-a286-f89e5c3cbbec req-02c9c74b-bf9f-449c-be64-b7c114f4d69b service nova] Releasing lock "refresh_cache-7949b7d0-2712-402f-86ee-30acaef2d3e7" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 15:38:14 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:38:14 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:38:14 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:38:14 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:38:14 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:38:14 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:38:14 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Auditing locally available compute resources for user (node: user) {{(pid=72382) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 15:38:15 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d66443a2-2dc1-46f6-9572-f0717f830927/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:38:15 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d66443a2-2dc1-46f6-9572-f0717f830927/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:38:15 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d66443a2-2dc1-46f6-9572-f0717f830927/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:38:15 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d66443a2-2dc1-46f6-9572-f0717f830927/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:38:15 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=72382) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 15:38:15 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5607360c-5f17-42b3-a373-6a33a183f92f/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:38:15 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5607360c-5f17-42b3-a373-6a33a183f92f/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:38:15 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5607360c-5f17-42b3-a373-6a33a183f92f/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:38:15 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5607360c-5f17-42b3-a373-6a33a183f92f/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:38:15 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7949b7d0-2712-402f-86ee-30acaef2d3e7/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:38:15 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7949b7d0-2712-402f-86ee-30acaef2d3e7/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:38:15 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7949b7d0-2712-402f-86ee-30acaef2d3e7/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:38:16 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7949b7d0-2712-402f-86ee-30acaef2d3e7/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:38:16 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72382) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 15:38:16 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ccbfda2-8bcd-4ec1-972a-cf49a62b1583/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:38:16 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ccbfda2-8bcd-4ec1-972a-cf49a62b1583/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:38:16 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ccbfda2-8bcd-4ec1-972a-cf49a62b1583/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:38:16 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ccbfda2-8bcd-4ec1-972a-cf49a62b1583/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:38:16 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72382) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 15:38:16 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72382) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 15:38:17 user nova-compute[72382]: WARNING nova.virt.libvirt.driver [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 15:38:17 user nova-compute[72382]: WARNING nova.virt.libvirt.driver [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 15:38:17 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Hypervisor/Node resource view: name=user free_ram=7851MB free_disk=25.34744644165039GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72382) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 15:38:17 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:38:17 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:38:17 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Applying migration context for instance 54523d3e-bfae-4621-85cb-d6a7bc40abf5 as it has an incoming, in-progress migration c31f6e97-fa8b-4d15-9ea5-540eb0d7d304. Migration status is finished {{(pid=72382) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 09 15:38:17 user nova-compute[72382]: INFO nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] [instance: 54523d3e-bfae-4621-85cb-d6a7bc40abf5] Updating resource usage from migration c31f6e97-fa8b-4d15-9ea5-540eb0d7d304
Aug 09 15:38:17 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance 4ccbfda2-8bcd-4ec1-972a-cf49a62b1583 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:38:17 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance 7949b7d0-2712-402f-86ee-30acaef2d3e7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:38:17 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance d66443a2-2dc1-46f6-9572-f0717f830927 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:38:17 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance 2158de7a-1e53-450a-80de-a5c56844feba actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:38:17 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance 5607360c-5f17-42b3-a373-6a33a183f92f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:38:17 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Migration c31f6e97-fa8b-4d15-9ea5-540eb0d7d304 is active on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 09 15:38:17 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance 54523d3e-bfae-4621-85cb-d6a7bc40abf5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:38:17 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance c88a5ff2-9789-4ee8-8283-6248bba6d66a has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Aug 09 15:38:17 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=72382) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 15:38:17 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=72382) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 15:38:17 user nova-compute[72382]: DEBUG nova.compute.provider_tree [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Inventory has not changed in ProviderTree for provider: 7b15b0e5-df4d-49db-833b-2855d21d10ae {{(pid=72382) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 15:38:17 user nova-compute[72382]: DEBUG nova.scheduler.client.report [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Inventory has not changed for provider 7b15b0e5-df4d-49db-833b-2855d21d10ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72382) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 15:38:17 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Compute_service record updated for user:user {{(pid=72382) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 15:38:17 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.559s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:38:17 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-7813323f-510a-4504-a7df-c7e49447d98f tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:38:17 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-7813323f-510a-4504-a7df-c7e49447d98f tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:38:17 user nova-compute[72382]: DEBUG nova.objects.instance [None req-7813323f-510a-4504-a7df-c7e49447d98f tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] Lazy-loading 'pci_requests' on Instance uuid c88a5ff2-9789-4ee8-8283-6248bba6d66a {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:38:17 user nova-compute[72382]: DEBUG nova.objects.instance [None req-7813323f-510a-4504-a7df-c7e49447d98f tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] Lazy-loading 'numa_topology' on Instance uuid c88a5ff2-9789-4ee8-8283-6248bba6d66a {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:38:17 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-7813323f-510a-4504-a7df-c7e49447d98f tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72382) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 15:38:17 user nova-compute[72382]: INFO nova.compute.claims [None req-7813323f-510a-4504-a7df-c7e49447d98f tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] [instance: c88a5ff2-9789-4ee8-8283-6248bba6d66a] Claim successful on node user
Aug 09 15:38:18 user nova-compute[72382]: DEBUG nova.compute.provider_tree [None req-7813323f-510a-4504-a7df-c7e49447d98f tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] Inventory has not changed in ProviderTree for provider: 7b15b0e5-df4d-49db-833b-2855d21d10ae {{(pid=72382) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 15:38:18 user nova-compute[72382]: DEBUG nova.scheduler.client.report [None req-7813323f-510a-4504-a7df-c7e49447d98f tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] Inventory has not changed for provider 7b15b0e5-df4d-49db-833b-2855d21d10ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72382) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 15:38:18 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-7813323f-510a-4504-a7df-c7e49447d98f tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.394s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:38:18 user nova-compute[72382]: INFO nova.network.neutron [None req-7813323f-510a-4504-a7df-c7e49447d98f tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] [instance: c88a5ff2-9789-4ee8-8283-6248bba6d66a] Updating port 4f9e0eae-81c7-4a91-8ac1-51459e231532 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Aug 09 15:38:18 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-3bd45d1e-2095-4ca5-9e52-6f0536ea6d9f tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Acquiring lock "7949b7d0-2712-402f-86ee-30acaef2d3e7" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:38:18 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-3bd45d1e-2095-4ca5-9e52-6f0536ea6d9f tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Lock "7949b7d0-2712-402f-86ee-30acaef2d3e7" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:38:18 user nova-compute[72382]: INFO nova.compute.manager [None req-3bd45d1e-2095-4ca5-9e52-6f0536ea6d9f tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] [instance: 7949b7d0-2712-402f-86ee-30acaef2d3e7] Rebooting instance
Aug 09 15:38:18 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-3bd45d1e-2095-4ca5-9e52-6f0536ea6d9f tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Acquiring lock "refresh_cache-7949b7d0-2712-402f-86ee-30acaef2d3e7" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 15:38:18 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-3bd45d1e-2095-4ca5-9e52-6f0536ea6d9f tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Acquired lock "refresh_cache-7949b7d0-2712-402f-86ee-30acaef2d3e7" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 15:38:18 user nova-compute[72382]: DEBUG nova.network.neutron [None req-3bd45d1e-2095-4ca5-9e52-6f0536ea6d9f tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] [instance: 7949b7d0-2712-402f-86ee-30acaef2d3e7] Building network info cache for instance {{(pid=72382) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 15:38:19 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:38:19 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:38:19 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5330cdb0-0529-41d6-9237-0310e4afff7d tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] [instance: d66443a2-2dc1-46f6-9572-f0717f830927] Calling os-brick to attach iSCSI Volume {{(pid=72382) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 15:38:19 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-5330cdb0-0529-41d6-9237-0310e4afff7d tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2a0c768340>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:34d84af2-674d-428b-ba0e-5759ed077c26'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xcISTdfm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 15:38:19 user nova-compute[72382]: WARNING os_brick.initiator.connectors.base [None req-5330cdb0-0529-41d6-9237-0310e4afff7d tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 15:38:19 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-5330cdb0-0529-41d6-9237-0310e4afff7d tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 15:38:19 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-5330cdb0-0529-41d6-9237-0310e4afff7d tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 15:38:19 user nova-compute[72382]: WARNING os_brick.initiator.connectors.base [None req-5330cdb0-0529-41d6-9237-0310e4afff7d tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 15:38:19 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-5330cdb0-0529-41d6-9237-0310e4afff7d tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:34d84af2-674d-428b-ba0e-5759ed077c26" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 15:38:19 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-5330cdb0-0529-41d6-9237-0310e4afff7d tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:34d84af2-674d-428b-ba0e-5759ed077c26" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 15:38:19 user nova-compute[72382]: INFO os_brick.initiator.connectors.iscsi [None req-5330cdb0-0529-41d6-9237-0310e4afff7d tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 15:38:19 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:34d84af2-674d-428b-ba0e-5759ed077c26 -p 172.16.0.220:3260 {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:38:19 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:34d84af2-674d-428b-ba0e-5759ed077c26 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:38:19 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[270fcbcb-5b6b-4113-870f-0973e02178f2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:38:19 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-5330cdb0-0529-41d6-9237-0310e4afff7d tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 15:38:19 user nova-compute[72382]:  {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:38:19 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:34d84af2-674d-428b-ba0e-5759ed077c26 -p 172.16.0.220:3260 --interface default --op new {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:38:19 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:34d84af2-674d-428b-ba0e-5759ed077c26 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:38:19 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[7385a067-3f23-4c8a-8bee-e56cf44fcb80]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:34d84af2-674d-428b-ba0e-5759ed077c26] added\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:38:19 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-5330cdb0-0529-41d6-9237-0310e4afff7d tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:34d84af2-674d-428b-ba0e-5759ed077c26] added
Aug 09 15:38:19 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:38:19 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:34d84af2-674d-428b-ba0e-5759ed077c26 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:38:19 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:34d84af2-674d-428b-ba0e-5759ed077c26 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:38:19 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6f4a6fe-6f2f-4522-9457-18f134f45347]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:38:19 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-5330cdb0-0529-41d6-9237-0310e4afff7d tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:38:19 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:34d84af2-674d-428b-ba0e-5759ed077c26 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:38:19 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:34d84af2-674d-428b-ba0e-5759ed077c26 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:38:19 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[20f41ac9-c2fa-40e8-b7a4-c9c0857e17c0]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:38:19 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-5330cdb0-0529-41d6-9237-0310e4afff7d tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:38:19 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:34d84af2-674d-428b-ba0e-5759ed077c26 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xcISTdfm {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:38:19 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:34d84af2-674d-428b-ba0e-5759ed077c26 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xcISTdfm" returned: 0 in 0.020s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:38:19 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3f5316e-db49-42c6-bbb9-b1f13486fbe4]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:38:19 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-5330cdb0-0529-41d6-9237-0310e4afff7d tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xcISTdfm'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:38:19 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:34d84af2-674d-428b-ba0e-5759ed077c26 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:38:19 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:34d84af2-674d-428b-ba0e-5759ed077c26 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:38:19 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[64d86962-edbe-47fb-9a9f-58f7eb31f73c]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:38:19 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-5330cdb0-0529-41d6-9237-0310e4afff7d tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:38:19 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:38:19 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:38:19 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1ed1e04-b309-4f68-afea-4d6aaa753aa3]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f58579c-f69a-4bee-b16e-970e5a8f590c (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0a612d6-0f3f-4d2c-9fb5-aff9384338de (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:170d7509-0928-4a87-9d9f-437977452501 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:726fb5e9-e6eb-43b0-84a3-497d899991b8 (non-flash)\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:38:19 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-5330cdb0-0529-41d6-9237-0310e4afff7d tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f58579c-f69a-4bee-b16e-970e5a8f590c (non-flash)
Aug 09 15:38:19 user nova-compute[72382]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0a612d6-0f3f-4d2c-9fb5-aff9384338de (non-flash)
Aug 09 15:38:19 user nova-compute[72382]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:170d7509-0928-4a87-9d9f-437977452501 (non-flash)
Aug 09 15:38:19 user nova-compute[72382]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:726fb5e9-e6eb-43b0-84a3-497d899991b8 (non-flash)
Aug 09 15:38:19 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 15:38:19 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-5330cdb0-0529-41d6-9237-0310e4afff7d tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f58579c-f69a-4bee-b16e-970e5a8f590c (non-flash)
Aug 09 15:38:19 user nova-compute[72382]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0a612d6-0f3f-4d2c-9fb5-aff9384338de (non-flash)
Aug 09 15:38:19 user nova-compute[72382]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:170d7509-0928-4a87-9d9f-437977452501 (non-flash)
Aug 09 15:38:19 user nova-compute[72382]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:726fb5e9-e6eb-43b0-84a3-497d899991b8 (non-flash)
Aug 09 15:38:19 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 15:38:19 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:34d84af2-674d-428b-ba0e-5759ed077c26 -p 172.16.0.220:3260 --login {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:38:19 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:38:19 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-7813323f-510a-4504-a7df-c7e49447d98f tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] Acquiring lock "refresh_cache-c88a5ff2-9789-4ee8-8283-6248bba6d66a" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 15:38:19 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-7813323f-510a-4504-a7df-c7e49447d98f tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] Acquired lock "refresh_cache-c88a5ff2-9789-4ee8-8283-6248bba6d66a" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 15:38:19 user nova-compute[72382]: DEBUG nova.network.neutron [None req-7813323f-510a-4504-a7df-c7e49447d98f tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] [instance: c88a5ff2-9789-4ee8-8283-6248bba6d66a] Building network info cache for instance {{(pid=72382) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 15:38:19 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:34d84af2-674d-428b-ba0e-5759ed077c26 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:38:19 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[f48a9640-9ecd-4fe4-9ba1-1e1ce9a1e3a1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:34d84af2-674d-428b-ba0e-5759ed077c26, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:34d84af2-674d-428b-ba0e-5759ed077c26, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:38:19 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-5330cdb0-0529-41d6-9237-0310e4afff7d tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:34d84af2-674d-428b-ba0e-5759ed077c26, portal: 172.16.0.220,3260]
Aug 09 15:38:19 user nova-compute[72382]: Login to [iface: default, target: iqn.2010-10.org.openstack:34d84af2-674d-428b-ba0e-5759ed077c26, portal: 172.16.0.220,3260] successful.
Aug 09 15:38:19 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:38:19 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:34d84af2-674d-428b-ba0e-5759ed077c26 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:38:19 user nova-compute[72382]: DEBUG nova.compute.manager [req-9abc412e-eefb-4fbc-9328-4a5d9fe3c97a req-5be50341-a6ff-4a88-8008-410b0b96d975 service nova] [instance: c88a5ff2-9789-4ee8-8283-6248bba6d66a] Received event network-changed-4f9e0eae-81c7-4a91-8ac1-51459e231532 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:38:19 user nova-compute[72382]: DEBUG nova.compute.manager [req-9abc412e-eefb-4fbc-9328-4a5d9fe3c97a req-5be50341-a6ff-4a88-8008-410b0b96d975 service nova] [instance: c88a5ff2-9789-4ee8-8283-6248bba6d66a] Refreshing instance network info cache due to event network-changed-4f9e0eae-81c7-4a91-8ac1-51459e231532. {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 15:38:19 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-9abc412e-eefb-4fbc-9328-4a5d9fe3c97a req-5be50341-a6ff-4a88-8008-410b0b96d975 service nova] Acquiring lock "refresh_cache-c88a5ff2-9789-4ee8-8283-6248bba6d66a" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 15:38:19 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:34d84af2-674d-428b-ba0e-5759ed077c26 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.029s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:38:19 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[2caee5bb-7286-4f26-8bb3-6b84a5f18d48]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:38:19 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-5330cdb0-0529-41d6-9237-0310e4afff7d tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:38:19 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:38:19 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:38:19 user nova-compute[72382]: DEBUG nova.compute.manager [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Starting heal instance info cache {{(pid=72382) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 15:38:19 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Acquiring lock "refresh_cache-7949b7d0-2712-402f-86ee-30acaef2d3e7" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 15:38:19 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:38:19 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dd4a72e-d3d9-4c8e-8c32-a944585f5bd1]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f58579c-f69a-4bee-b16e-970e5a8f590c (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0a612d6-0f3f-4d2c-9fb5-aff9384338de (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:170d7509-0928-4a87-9d9f-437977452501 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:726fb5e9-e6eb-43b0-84a3-497d899991b8 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34d84af2-674d-428b-ba0e-5759ed077c26 (non-flash)\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:38:19 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-5330cdb0-0529-41d6-9237-0310e4afff7d tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f58579c-f69a-4bee-b16e-970e5a8f590c (non-flash)
Aug 09 15:38:19 user nova-compute[72382]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0a612d6-0f3f-4d2c-9fb5-aff9384338de (non-flash)
Aug 09 15:38:19 user nova-compute[72382]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:170d7509-0928-4a87-9d9f-437977452501 (non-flash)
Aug 09 15:38:19 user nova-compute[72382]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:726fb5e9-e6eb-43b0-84a3-497d899991b8 (non-flash)
Aug 09 15:38:19 user nova-compute[72382]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34d84af2-674d-428b-ba0e-5759ed077c26 (non-flash)
Aug 09 15:38:19 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 15:38:19 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-5330cdb0-0529-41d6-9237-0310e4afff7d tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f58579c-f69a-4bee-b16e-970e5a8f590c (non-flash)
Aug 09 15:38:19 user nova-compute[72382]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0a612d6-0f3f-4d2c-9fb5-aff9384338de (non-flash)
Aug 09 15:38:19 user nova-compute[72382]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:170d7509-0928-4a87-9d9f-437977452501 (non-flash)
Aug 09 15:38:19 user nova-compute[72382]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:726fb5e9-e6eb-43b0-84a3-497d899991b8 (non-flash)
Aug 09 15:38:19 user nova-compute[72382]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34d84af2-674d-428b-ba0e-5759ed077c26 (non-flash)
Aug 09 15:38:19 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 15:38:19 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-5330cdb0-0529-41d6-9237-0310e4afff7d tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:34d84af2-674d-428b-ba0e-5759ed077c26" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.307s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 15:38:19 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-5330cdb0-0529-41d6-9237-0310e4afff7d tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Connected to 172.16.0.220:3260 {{(pid=72382) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 15:38:19 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-5330cdb0-0529-41d6-9237-0310e4afff7d tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] HCTL ('37', '-', '-', 0) found on session 52 with lun 0 {{(pid=72382) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 15:38:19 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-5330cdb0-0529-41d6-9237-0310e4afff7d tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=72382) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 15:38:19 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:38:19 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.020s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:38:19 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2e4192f-074a-43ed-bb11-f7506d28205f]: (4, ('- - 0', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:38:19 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-5330cdb0-0529-41d6-9237-0310e4afff7d tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Searching for a device in session 52 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=72382) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 15:38:19 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-5330cdb0-0529-41d6-9237-0310e4afff7d tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xcISTdfm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72382) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 15:38:20 user nova-compute[72382]: DEBUG nova.network.neutron [None req-3bd45d1e-2095-4ca5-9e52-6f0536ea6d9f tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] [instance: 7949b7d0-2712-402f-86ee-30acaef2d3e7] Updating instance_info_cache with network_info: [{"id": "bf6ac419-c6ba-4f01-b35a-4fa5e58913be", "address": "fa:16:3e:26:fd:d1", "network": {"id": "8d929426-09f7-49b5-a79e-711e20e00750", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1307802727-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.154", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93c87775443b4abd987197c4b46693bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf6ac419-c6", "ovs_interfaceid": "bf6ac419-c6ba-4f01-b35a-4fa5e58913be", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:38:20 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-3bd45d1e-2095-4ca5-9e52-6f0536ea6d9f tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Releasing lock "refresh_cache-7949b7d0-2712-402f-86ee-30acaef2d3e7" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 15:38:20 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Acquired lock "refresh_cache-7949b7d0-2712-402f-86ee-30acaef2d3e7" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 15:38:20 user nova-compute[72382]: DEBUG nova.network.neutron [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] [instance: 7949b7d0-2712-402f-86ee-30acaef2d3e7] Forcefully refreshing network info cache for instance {{(pid=72382) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 15:38:20 user nova-compute[72382]: DEBUG nova.compute.manager [None req-3bd45d1e-2095-4ca5-9e52-6f0536ea6d9f tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] [instance: 7949b7d0-2712-402f-86ee-30acaef2d3e7] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:38:20 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:38:20 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:38:20 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:38:20 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:38:20 user nova-compute[72382]: DEBUG nova.network.neutron [None req-7813323f-510a-4504-a7df-c7e49447d98f tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] [instance: c88a5ff2-9789-4ee8-8283-6248bba6d66a] Updating instance_info_cache with network_info: [{"id": "4f9e0eae-81c7-4a91-8ac1-51459e231532", "address": "fa:16:3e:b2:aa:71", "network": {"id": "5f3f6e0f-94b3-4a66-9839-763a2e2d259c", "bridge": "br-int", "label": "tempest-TestShelveInstance-338163972-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "108a420b4c6e451d8429d21665e12fb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f9e0eae-81", "ovs_interfaceid": "4f9e0eae-81c7-4a91-8ac1-51459e231532", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:38:20 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-7813323f-510a-4504-a7df-c7e49447d98f tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] Releasing lock "refresh_cache-c88a5ff2-9789-4ee8-8283-6248bba6d66a" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 15:38:20 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-7813323f-510a-4504-a7df-c7e49447d98f tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] [instance: c88a5ff2-9789-4ee8-8283-6248bba6d66a] Creating instance directory {{(pid=72382) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 15:38:20 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-7813323f-510a-4504-a7df-c7e49447d98f tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] [instance: c88a5ff2-9789-4ee8-8283-6248bba6d66a] Creating image(s)
Aug 09 15:38:20 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-7813323f-510a-4504-a7df-c7e49447d98f tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] [instance: c88a5ff2-9789-4ee8-8283-6248bba6d66a] Did not create local disks {{(pid=72382) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 09 15:38:20 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-7813323f-510a-4504-a7df-c7e49447d98f tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] [instance: c88a5ff2-9789-4ee8-8283-6248bba6d66a] Ensure instance console log exists: /opt/stack/data/nova/instances/c88a5ff2-9789-4ee8-8283-6248bba6d66a/console.log {{(pid=72382) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 15:38:20 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-7813323f-510a-4504-a7df-c7e49447d98f tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:38:20 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-7813323f-510a-4504-a7df-c7e49447d98f tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:38:20 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-7813323f-510a-4504-a7df-c7e49447d98f tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:38:20 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-7813323f-510a-4504-a7df-c7e49447d98f tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] [instance: c88a5ff2-9789-4ee8-8283-6248bba6d66a] Start _get_guest_xml network_info=[{"id": "4f9e0eae-81c7-4a91-8ac1-51459e231532", "address": "fa:16:3e:b2:aa:71", "network": {"id": "5f3f6e0f-94b3-4a66-9839-763a2e2d259c", "bridge": "br-int", "label": "tempest-TestShelveInstance-338163972-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "108a420b4c6e451d8429d21665e12fb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f9e0eae-81", "ovs_interfaceid": "4f9e0eae-81c7-4a91-8ac1-51459e231532", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:d2f5dbb5-f862-4389-b42a-872d5c94aa55'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JoLXOIMx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'c88a5ff2-9789-4ee8-8283-6248bba6d66a', 'attached_at': '', 'detached_at': '', 'volume_id': 'd2f5dbb5-f862-4389-b42a-872d5c94aa55', 'serial': 'd2f5dbb5-f862-4389-b42a-872d5c94aa55'}, 'disk_bus': 'virtio', 'attachment_id': '86cbb496-3eba-4ccb-8f04-2030ea31aa15', 'delete_on_termination': True, 'volume_type': None} {{(pid=72382) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 15:38:20 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-9abc412e-eefb-4fbc-9328-4a5d9fe3c97a req-5be50341-a6ff-4a88-8008-410b0b96d975 service nova] Acquired lock "refresh_cache-c88a5ff2-9789-4ee8-8283-6248bba6d66a" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 15:38:20 user nova-compute[72382]: DEBUG nova.network.neutron [req-9abc412e-eefb-4fbc-9328-4a5d9fe3c97a req-5be50341-a6ff-4a88-8008-410b0b96d975 service nova] [instance: c88a5ff2-9789-4ee8-8283-6248bba6d66a] Refreshing network info cache for port 4f9e0eae-81c7-4a91-8ac1-51459e231532 {{(pid=72382) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 15:38:20 user nova-compute[72382]: WARNING nova.virt.libvirt.driver [None req-7813323f-510a-4504-a7df-c7e49447d98f tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 15:38:20 user nova-compute[72382]: WARNING nova.virt.libvirt.driver [None req-7813323f-510a-4504-a7df-c7e49447d98f tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 15:38:20 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-7813323f-510a-4504-a7df-c7e49447d98f tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72382) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 15:38:20 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-7813323f-510a-4504-a7df-c7e49447d98f tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] CPU controller missing on host. {{(pid=72382) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 15:38:20 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-7813323f-510a-4504-a7df-c7e49447d98f tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72382) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 15:38:20 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-7813323f-510a-4504-a7df-c7e49447d98f tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] CPU controller found on host. {{(pid=72382) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 15:38:20 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-7813323f-510a-4504-a7df-c7e49447d98f tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72382) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 15:38:20 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-7813323f-510a-4504-a7df-c7e49447d98f tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T15:11:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 15:38:20 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-7813323f-510a-4504-a7df-c7e49447d98f tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] Flavor limits 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 15:38:20 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-7813323f-510a-4504-a7df-c7e49447d98f tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] Image limits 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 15:38:20 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-7813323f-510a-4504-a7df-c7e49447d98f tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] Flavor pref 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 15:38:20 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-7813323f-510a-4504-a7df-c7e49447d98f tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] Image pref 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 15:38:20 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-7813323f-510a-4504-a7df-c7e49447d98f tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 15:38:20 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-7813323f-510a-4504-a7df-c7e49447d98f tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 15:38:20 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-7813323f-510a-4504-a7df-c7e49447d98f tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72382) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 15:38:20 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-7813323f-510a-4504-a7df-c7e49447d98f tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] Got 1 possible topologies {{(pid=72382) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 15:38:20 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-7813323f-510a-4504-a7df-c7e49447d98f tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 15:38:20 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-7813323f-510a-4504-a7df-c7e49447d98f tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 15:38:20 user nova-compute[72382]: DEBUG nova.objects.instance [None req-7813323f-510a-4504-a7df-c7e49447d98f tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] Lazy-loading 'vcpu_model' on Instance uuid c88a5ff2-9789-4ee8-8283-6248bba6d66a {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:38:20 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7813323f-510a-4504-a7df-c7e49447d98f tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] [instance: c88a5ff2-9789-4ee8-8283-6248bba6d66a] Calling os-brick to attach iSCSI Volume {{(pid=72382) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 15:38:20 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-7813323f-510a-4504-a7df-c7e49447d98f tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2a0c768340>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:d2f5dbb5-f862-4389-b42a-872d5c94aa55'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JoLXOIMx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 15:38:20 user nova-compute[72382]: WARNING os_brick.initiator.connectors.base [None req-7813323f-510a-4504-a7df-c7e49447d98f tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 15:38:20 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-7813323f-510a-4504-a7df-c7e49447d98f tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 15:38:20 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-5330cdb0-0529-41d6-9237-0310e4afff7d tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.350s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 15:38:20 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-5330cdb0-0529-41d6-9237-0310e4afff7d tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] <== connect_volume: return (1351ms) {'type': 'block', 'scsi_wwn': '23631656138633038', 'path': '/dev/sdf'} {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 15:38:20 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5330cdb0-0529-41d6-9237-0310e4afff7d tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] [instance: d66443a2-2dc1-46f6-9572-f0717f830927] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23631656138633038', 'path': '/dev/sdf'} {{(pid=72382) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 15:38:20 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-7813323f-510a-4504-a7df-c7e49447d98f tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.099s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 15:38:20 user nova-compute[72382]: WARNING os_brick.initiator.connectors.base [None req-7813323f-510a-4504-a7df-c7e49447d98f tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 15:38:20 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-7813323f-510a-4504-a7df-c7e49447d98f tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d2f5dbb5-f862-4389-b42a-872d5c94aa55" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 15:38:20 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-7813323f-510a-4504-a7df-c7e49447d98f tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d2f5dbb5-f862-4389-b42a-872d5c94aa55" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 15:38:20 user nova-compute[72382]: INFO os_brick.initiator.connectors.iscsi [None req-7813323f-510a-4504-a7df-c7e49447d98f tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 15:38:20 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2f5dbb5-f862-4389-b42a-872d5c94aa55 -p 172.16.0.220:3260 {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:38:20 user nova-compute[72382]: DEBUG nova.objects.instance [None req-5330cdb0-0529-41d6-9237-0310e4afff7d tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Lazy-loading 'flavor' on Instance uuid d66443a2-2dc1-46f6-9572-f0717f830927 {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:38:20 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2f5dbb5-f862-4389-b42a-872d5c94aa55 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:38:20 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dcc0b98-6aef-43df-b17e-7825f40c0c89]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:38:20 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-7813323f-510a-4504-a7df-c7e49447d98f tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 15:38:20 user nova-compute[72382]:  {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:38:20 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2f5dbb5-f862-4389-b42a-872d5c94aa55 -p 172.16.0.220:3260 --interface default --op new {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:38:20 user nova-compute[72382]: DEBUG nova.virt.libvirt.guest [None req-5330cdb0-0529-41d6-9237-0310e4afff7d tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 15:38:20 user nova-compute[72382]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 15:38:20 user nova-compute[72382]:   <source dev="/dev/sdf"/>
Aug 09 15:38:20 user nova-compute[72382]:   <target dev="vdc" bus="virtio"/>
Aug 09 15:38:20 user nova-compute[72382]:   <serial>34d84af2-674d-428b-ba0e-5759ed077c26</serial>
Aug 09 15:38:20 user nova-compute[72382]: </disk>
Aug 09 15:38:20 user nova-compute[72382]:  {{(pid=72382) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 15:38:20 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2f5dbb5-f862-4389-b42a-872d5c94aa55 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:38:20 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6a0d90b-a5f7-413c-a5c8-521fb5c4a6d3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d2f5dbb5-f862-4389-b42a-872d5c94aa55] added\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:38:21 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-7813323f-510a-4504-a7df-c7e49447d98f tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d2f5dbb5-f862-4389-b42a-872d5c94aa55] added
Aug 09 15:38:21 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:38:21 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2f5dbb5-f862-4389-b42a-872d5c94aa55 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:38:21 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2f5dbb5-f862-4389-b42a-872d5c94aa55 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:38:21 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[01b11bb2-0f94-4027-b7af-65f3e2241b85]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:38:21 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-7813323f-510a-4504-a7df-c7e49447d98f tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:38:21 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2f5dbb5-f862-4389-b42a-872d5c94aa55 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:38:21 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2f5dbb5-f862-4389-b42a-872d5c94aa55 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:38:21 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[4afac023-d942-41e2-b56c-88fabf80cb0e]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:38:21 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-7813323f-510a-4504-a7df-c7e49447d98f tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:38:21 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2f5dbb5-f862-4389-b42a-872d5c94aa55 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JoLXOIMx {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:38:21 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2f5dbb5-f862-4389-b42a-872d5c94aa55 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JoLXOIMx" returned: 0 in 0.020s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:38:21 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[24d08e13-8ac1-4763-a312-a9ee774ef508]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:38:21 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-7813323f-510a-4504-a7df-c7e49447d98f tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JoLXOIMx'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:38:21 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2f5dbb5-f862-4389-b42a-872d5c94aa55 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:38:21 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2f5dbb5-f862-4389-b42a-872d5c94aa55 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:38:21 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a12d132-9c39-4141-acef-7cff831364f5]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:38:21 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-7813323f-510a-4504-a7df-c7e49447d98f tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:38:21 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:38:21 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:38:21 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[54b2d5f1-a5a7-4ec0-994b-192897bf062e]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f58579c-f69a-4bee-b16e-970e5a8f590c (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0a612d6-0f3f-4d2c-9fb5-aff9384338de (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:170d7509-0928-4a87-9d9f-437977452501 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:726fb5e9-e6eb-43b0-84a3-497d899991b8 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34d84af2-674d-428b-ba0e-5759ed077c26 (non-flash)\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:38:21 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-7813323f-510a-4504-a7df-c7e49447d98f tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f58579c-f69a-4bee-b16e-970e5a8f590c (non-flash)
Aug 09 15:38:21 user nova-compute[72382]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0a612d6-0f3f-4d2c-9fb5-aff9384338de (non-flash)
Aug 09 15:38:21 user nova-compute[72382]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:170d7509-0928-4a87-9d9f-437977452501 (non-flash)
Aug 09 15:38:21 user nova-compute[72382]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:726fb5e9-e6eb-43b0-84a3-497d899991b8 (non-flash)
Aug 09 15:38:21 user nova-compute[72382]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34d84af2-674d-428b-ba0e-5759ed077c26 (non-flash)
Aug 09 15:38:21 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 15:38:21 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-7813323f-510a-4504-a7df-c7e49447d98f tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f58579c-f69a-4bee-b16e-970e5a8f590c (non-flash)
Aug 09 15:38:21 user nova-compute[72382]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0a612d6-0f3f-4d2c-9fb5-aff9384338de (non-flash)
Aug 09 15:38:21 user nova-compute[72382]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:170d7509-0928-4a87-9d9f-437977452501 (non-flash)
Aug 09 15:38:21 user nova-compute[72382]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:726fb5e9-e6eb-43b0-84a3-497d899991b8 (non-flash)
Aug 09 15:38:21 user nova-compute[72382]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34d84af2-674d-428b-ba0e-5759ed077c26 (non-flash)
Aug 09 15:38:21 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 15:38:21 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2f5dbb5-f862-4389-b42a-872d5c94aa55 -p 172.16.0.220:3260 --login {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:38:21 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2f5dbb5-f862-4389-b42a-872d5c94aa55 -p 172.16.0.220:3260 --login" returned: 0 in 0.080s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:38:21 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd543327-14c5-4885-b326-45e0ebe1d9e3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d2f5dbb5-f862-4389-b42a-872d5c94aa55, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d2f5dbb5-f862-4389-b42a-872d5c94aa55, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:38:21 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-7813323f-510a-4504-a7df-c7e49447d98f tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d2f5dbb5-f862-4389-b42a-872d5c94aa55, portal: 172.16.0.220,3260]
Aug 09 15:38:21 user nova-compute[72382]: Login to [iface: default, target: iqn.2010-10.org.openstack:d2f5dbb5-f862-4389-b42a-872d5c94aa55, portal: 172.16.0.220,3260] successful.
Aug 09 15:38:21 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:38:21 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2f5dbb5-f862-4389-b42a-872d5c94aa55 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:38:21 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2f5dbb5-f862-4389-b42a-872d5c94aa55 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:38:21 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[c854fd9d-c7d2-429b-9e69-7a81fd08d7c2]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:38:21 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-7813323f-510a-4504-a7df-c7e49447d98f tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:38:21 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:38:21 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:38:21 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca26566e-edf5-4db0-83bd-ac57a7054fd4]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f58579c-f69a-4bee-b16e-970e5a8f590c (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0a612d6-0f3f-4d2c-9fb5-aff9384338de (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:170d7509-0928-4a87-9d9f-437977452501 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:726fb5e9-e6eb-43b0-84a3-497d899991b8 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34d84af2-674d-428b-ba0e-5759ed077c26 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2f5dbb5-f862-4389-b42a-872d5c94aa55 (non-flash)\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:38:21 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-7813323f-510a-4504-a7df-c7e49447d98f tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f58579c-f69a-4bee-b16e-970e5a8f590c (non-flash)
Aug 09 15:38:21 user nova-compute[72382]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0a612d6-0f3f-4d2c-9fb5-aff9384338de (non-flash)
Aug 09 15:38:21 user nova-compute[72382]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:170d7509-0928-4a87-9d9f-437977452501 (non-flash)
Aug 09 15:38:21 user nova-compute[72382]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:726fb5e9-e6eb-43b0-84a3-497d899991b8 (non-flash)
Aug 09 15:38:21 user nova-compute[72382]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34d84af2-674d-428b-ba0e-5759ed077c26 (non-flash)
Aug 09 15:38:21 user nova-compute[72382]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2f5dbb5-f862-4389-b42a-872d5c94aa55 (non-flash)
Aug 09 15:38:21 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 15:38:21 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-7813323f-510a-4504-a7df-c7e49447d98f tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f58579c-f69a-4bee-b16e-970e5a8f590c (non-flash)
Aug 09 15:38:21 user nova-compute[72382]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0a612d6-0f3f-4d2c-9fb5-aff9384338de (non-flash)
Aug 09 15:38:21 user nova-compute[72382]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:170d7509-0928-4a87-9d9f-437977452501 (non-flash)
Aug 09 15:38:21 user nova-compute[72382]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:726fb5e9-e6eb-43b0-84a3-497d899991b8 (non-flash)
Aug 09 15:38:21 user nova-compute[72382]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34d84af2-674d-428b-ba0e-5759ed077c26 (non-flash)
Aug 09 15:38:21 user nova-compute[72382]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2f5dbb5-f862-4389-b42a-872d5c94aa55 (non-flash)
Aug 09 15:38:21 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 15:38:21 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-7813323f-510a-4504-a7df-c7e49447d98f tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d2f5dbb5-f862-4389-b42a-872d5c94aa55" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.337s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 15:38:21 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-7813323f-510a-4504-a7df-c7e49447d98f tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] Connected to 172.16.0.220:3260 {{(pid=72382) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 15:38:21 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-7813323f-510a-4504-a7df-c7e49447d98f tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] HCTL ('38', '-', '-', 0) found on session 53 with lun 0 {{(pid=72382) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 15:38:21 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-7813323f-510a-4504-a7df-c7e49447d98f tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=72382) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 15:38:21 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:38:21 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.026s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:38:21 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[d24f10d1-8838-4fc1-9b41-3ad9624cb9f4]: (4, ('- - 0', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:38:21 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-7813323f-510a-4504-a7df-c7e49447d98f tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] Searching for a device in session 53 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=72382) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 15:38:21 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-7813323f-510a-4504-a7df-c7e49447d98f tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] Connected to sdg using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JoLXOIMx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72382) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 15:38:21 user nova-compute[72382]: DEBUG nova.network.neutron [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] [instance: 7949b7d0-2712-402f-86ee-30acaef2d3e7] Updating instance_info_cache with network_info: [{"id": "bf6ac419-c6ba-4f01-b35a-4fa5e58913be", "address": "fa:16:3e:26:fd:d1", "network": {"id": "8d929426-09f7-49b5-a79e-711e20e00750", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1307802727-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.154", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93c87775443b4abd987197c4b46693bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf6ac419-c6", "ovs_interfaceid": "bf6ac419-c6ba-4f01-b35a-4fa5e58913be", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:38:21 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Releasing lock "refresh_cache-7949b7d0-2712-402f-86ee-30acaef2d3e7" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 15:38:21 user nova-compute[72382]: DEBUG nova.compute.manager [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] [instance: 7949b7d0-2712-402f-86ee-30acaef2d3e7] Updated the network info_cache for instance {{(pid=72382) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 15:38:21 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:38:21 user nova-compute[72382]: INFO nova.virt.libvirt.driver [-] [instance: 7949b7d0-2712-402f-86ee-30acaef2d3e7] Instance destroyed successfully.
Aug 09 15:38:21 user nova-compute[72382]: DEBUG nova.objects.instance [None req-3bd45d1e-2095-4ca5-9e52-6f0536ea6d9f tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Lazy-loading 'resources' on Instance uuid 7949b7d0-2712-402f-86ee-30acaef2d3e7 {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:38:21 user nova-compute[72382]: DEBUG nova.virt.libvirt.vif [None req-3bd45d1e-2095-4ca5-9e52-6f0536ea6d9f tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T15:35:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1437781387',display_name='tempest-TestMinimumBasicScenario-server-1437781387',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1437781387',id=40,image_ref='cc9c1e6c-3869-41a3-8884-92bc10fd88dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE7fZdqwv14TbpkokOGrZLxteONCsQhHwHtSkm0iehxIvEwr8CDGRfFb4MKI0stgbdIk1yccqk1l+GgnPmgswjQ9PIPDbFPc3f6proZobtF+S6ZVWml9M9bSSrAd7AGo5w==',key_name='tempest-TestMinimumBasicScenario-63485549',keypairs=<?>,launch_index=0,launched_at=2023-08-09T15:36:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='93c87775443b4abd987197c4b46693bc',ramdisk_id='',reservation_id='r-oo0ozxn0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cc9c1e6c-3869-41a3-8884-92bc10fd88dd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-389394165',owner_user_name='tempest-TestMinimumBasicScenario-389394165-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T15:38:20Z,user_data=None,user_id='12ac8eca784e480d86c8fff801e73d2d',uuid=7949b7d0-2712-402f-86ee-30acaef2d3e7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bf6ac419-c6ba-4f01-b35a-4fa5e58913be", "address": "fa:16:3e:26:fd:d1", "network": {"id": "8d929426-09f7-49b5-a79e-711e20e00750", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1307802727-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.154", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93c87775443b4abd987197c4b46693bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf6ac419-c6", "ovs_interfaceid": "bf6ac419-c6ba-4f01-b35a-4fa5e58913be", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 15:38:21 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-3bd45d1e-2095-4ca5-9e52-6f0536ea6d9f tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Converting VIF {"id": "bf6ac419-c6ba-4f01-b35a-4fa5e58913be", "address": "fa:16:3e:26:fd:d1", "network": {"id": "8d929426-09f7-49b5-a79e-711e20e00750", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1307802727-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.154", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93c87775443b4abd987197c4b46693bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf6ac419-c6", "ovs_interfaceid": "bf6ac419-c6ba-4f01-b35a-4fa5e58913be", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 15:38:21 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-3bd45d1e-2095-4ca5-9e52-6f0536ea6d9f tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:26:fd:d1,bridge_name='br-int',has_traffic_filtering=True,id=bf6ac419-c6ba-4f01-b35a-4fa5e58913be,network=Network(8d929426-09f7-49b5-a79e-711e20e00750),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf6ac419-c6') {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 15:38:21 user nova-compute[72382]: DEBUG os_vif [None req-3bd45d1e-2095-4ca5-9e52-6f0536ea6d9f tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:26:fd:d1,bridge_name='br-int',has_traffic_filtering=True,id=bf6ac419-c6ba-4f01-b35a-4fa5e58913be,network=Network(8d929426-09f7-49b5-a79e-711e20e00750),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf6ac419-c6') {{(pid=72382) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 15:38:21 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:38:21 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbf6ac419-c6, bridge=br-int, if_exists=True) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:38:21 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:38:21 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:38:21 user nova-compute[72382]: INFO os_vif [None req-3bd45d1e-2095-4ca5-9e52-6f0536ea6d9f tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:26:fd:d1,bridge_name='br-int',has_traffic_filtering=True,id=bf6ac419-c6ba-4f01-b35a-4fa5e58913be,network=Network(8d929426-09f7-49b5-a79e-711e20e00750),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf6ac419-c6')
Aug 09 15:38:21 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3bd45d1e-2095-4ca5-9e52-6f0536ea6d9f tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] [instance: 7949b7d0-2712-402f-86ee-30acaef2d3e7] calling os-brick to detach iSCSI Volume {{(pid=72382) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 15:38:21 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bd45d1e-2095-4ca5-9e52-6f0536ea6d9f tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2a0c768340>, {'target_iqns': ['iqn.2010-10.org.openstack:170d7509-0928-4a87-9d9f-437977452501'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IeCsFWVU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 15:38:21 user nova-compute[72382]: WARNING os_brick.initiator.connectors.base [None req-3bd45d1e-2095-4ca5-9e52-6f0536ea6d9f tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 15:38:21 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-3bd45d1e-2095-4ca5-9e52-6f0536ea6d9f tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 15:38:21 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-5330cdb0-0529-41d6-9237-0310e4afff7d tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] No BDM found with device name vda, not building metadata. {{(pid=72382) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 15:38:21 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-5330cdb0-0529-41d6-9237-0310e4afff7d tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72382) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 15:38:21 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-5330cdb0-0529-41d6-9237-0310e4afff7d tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72382) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 15:38:21 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-5330cdb0-0529-41d6-9237-0310e4afff7d tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] No VIF found with MAC fa:16:3e:5a:e8:fb, not building metadata {{(pid=72382) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 15:38:21 user nova-compute[72382]: DEBUG nova.network.neutron [req-9abc412e-eefb-4fbc-9328-4a5d9fe3c97a req-5be50341-a6ff-4a88-8008-410b0b96d975 service nova] [instance: c88a5ff2-9789-4ee8-8283-6248bba6d66a] Updated VIF entry in instance network info cache for port 4f9e0eae-81c7-4a91-8ac1-51459e231532. {{(pid=72382) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 15:38:21 user nova-compute[72382]: DEBUG nova.network.neutron [req-9abc412e-eefb-4fbc-9328-4a5d9fe3c97a req-5be50341-a6ff-4a88-8008-410b0b96d975 service nova] [instance: c88a5ff2-9789-4ee8-8283-6248bba6d66a] Updating instance_info_cache with network_info: [{"id": "4f9e0eae-81c7-4a91-8ac1-51459e231532", "address": "fa:16:3e:b2:aa:71", "network": {"id": "5f3f6e0f-94b3-4a66-9839-763a2e2d259c", "bridge": "br-int", "label": "tempest-TestShelveInstance-338163972-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "108a420b4c6e451d8429d21665e12fb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f9e0eae-81", "ovs_interfaceid": "4f9e0eae-81c7-4a91-8ac1-51459e231532", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:38:21 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-9abc412e-eefb-4fbc-9328-4a5d9fe3c97a req-5be50341-a6ff-4a88-8008-410b0b96d975 service nova] Releasing lock "refresh_cache-c88a5ff2-9789-4ee8-8283-6248bba6d66a" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 15:38:21 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-5330cdb0-0529-41d6-9237-0310e4afff7d tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Lock "d66443a2-2dc1-46f6-9572-f0717f830927" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.959s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:38:21 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:38:21 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:38:21 user nova-compute[72382]: DEBUG nova.compute.manager [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72382) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 15:38:21 user nova-compute[72382]: DEBUG nova.compute.manager [req-f0da059c-0331-41dd-9375-4309fd8299d3 req-d14fc65b-5f9c-496c-856b-9952f89ecf9d service nova] [instance: 7949b7d0-2712-402f-86ee-30acaef2d3e7] Received event network-vif-unplugged-bf6ac419-c6ba-4f01-b35a-4fa5e58913be {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:38:21 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-f0da059c-0331-41dd-9375-4309fd8299d3 req-d14fc65b-5f9c-496c-856b-9952f89ecf9d service nova] Acquiring lock "7949b7d0-2712-402f-86ee-30acaef2d3e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:38:21 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-f0da059c-0331-41dd-9375-4309fd8299d3 req-d14fc65b-5f9c-496c-856b-9952f89ecf9d service nova] Lock "7949b7d0-2712-402f-86ee-30acaef2d3e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:38:21 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-f0da059c-0331-41dd-9375-4309fd8299d3 req-d14fc65b-5f9c-496c-856b-9952f89ecf9d service nova] Lock "7949b7d0-2712-402f-86ee-30acaef2d3e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:38:21 user nova-compute[72382]: DEBUG nova.compute.manager [req-f0da059c-0331-41dd-9375-4309fd8299d3 req-d14fc65b-5f9c-496c-856b-9952f89ecf9d service nova] [instance: 7949b7d0-2712-402f-86ee-30acaef2d3e7] No waiting events found dispatching network-vif-unplugged-bf6ac419-c6ba-4f01-b35a-4fa5e58913be {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:38:21 user nova-compute[72382]: WARNING nova.compute.manager [req-f0da059c-0331-41dd-9375-4309fd8299d3 req-d14fc65b-5f9c-496c-856b-9952f89ecf9d service nova] [instance: 7949b7d0-2712-402f-86ee-30acaef2d3e7] Received unexpected event network-vif-unplugged-bf6ac419-c6ba-4f01-b35a-4fa5e58913be for instance with vm_state active and task_state reboot_started_hard.
Aug 09 15:38:21 user nova-compute[72382]: DEBUG nova.compute.manager [req-f0da059c-0331-41dd-9375-4309fd8299d3 req-d14fc65b-5f9c-496c-856b-9952f89ecf9d service nova] [instance: 7949b7d0-2712-402f-86ee-30acaef2d3e7] Received event network-vif-plugged-bf6ac419-c6ba-4f01-b35a-4fa5e58913be {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:38:21 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-f0da059c-0331-41dd-9375-4309fd8299d3 req-d14fc65b-5f9c-496c-856b-9952f89ecf9d service nova] Acquiring lock "7949b7d0-2712-402f-86ee-30acaef2d3e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:38:21 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-f0da059c-0331-41dd-9375-4309fd8299d3 req-d14fc65b-5f9c-496c-856b-9952f89ecf9d service nova] Lock "7949b7d0-2712-402f-86ee-30acaef2d3e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:38:21 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-f0da059c-0331-41dd-9375-4309fd8299d3 req-d14fc65b-5f9c-496c-856b-9952f89ecf9d service nova] Lock "7949b7d0-2712-402f-86ee-30acaef2d3e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:38:21 user nova-compute[72382]: DEBUG nova.compute.manager [req-f0da059c-0331-41dd-9375-4309fd8299d3 req-d14fc65b-5f9c-496c-856b-9952f89ecf9d service nova] [instance: 7949b7d0-2712-402f-86ee-30acaef2d3e7] No waiting events found dispatching network-vif-plugged-bf6ac419-c6ba-4f01-b35a-4fa5e58913be {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:38:21 user nova-compute[72382]: WARNING nova.compute.manager [req-f0da059c-0331-41dd-9375-4309fd8299d3 req-d14fc65b-5f9c-496c-856b-9952f89ecf9d service nova] [instance: 7949b7d0-2712-402f-86ee-30acaef2d3e7] Received unexpected event network-vif-plugged-bf6ac419-c6ba-4f01-b35a-4fa5e58913be for instance with vm_state active and task_state reboot_started_hard.
Aug 09 15:38:22 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-7813323f-510a-4504-a7df-c7e49447d98f tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.387s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 15:38:22 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-7813323f-510a-4504-a7df-c7e49447d98f tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] <== connect_volume: return (1486ms) {'type': 'block', 'scsi_wwn': '23336326237313164', 'path': '/dev/sdg'} {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 15:38:22 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7813323f-510a-4504-a7df-c7e49447d98f tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] [instance: c88a5ff2-9789-4ee8-8283-6248bba6d66a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23336326237313164', 'path': '/dev/sdg'} {{(pid=72382) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 15:38:22 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-3bd45d1e-2095-4ca5-9e52-6f0536ea6d9f tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.692s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 15:38:22 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bd45d1e-2095-4ca5-9e52-6f0536ea6d9f tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:170d7509-0928-4a87-9d9f-437977452501', 0)] {{(pid=72382) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 15:38:22 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:38:22 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:38:22 user nova-compute[72382]: DEBUG nova.virt.libvirt.vif [None req-7813323f-510a-4504-a7df-c7e49447d98f tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-09T15:34:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1501121398',display_name='tempest-TestShelveInstance-server-1501121398',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1501121398',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1348374500',keypairs=<?>,launch_index=0,launched_at=2023-08-09T15:34:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='108a420b4c6e451d8429d21665e12fb9',ramdisk_id='',reservation_id='r-3ps4xjyg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1984291610',owner_user_name='tempest-TestShelveInstance-1984291610-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T15:38:08Z,user_data=None,user_id='827f726259fb452aad32077e24ec4fc2',uuid=c88a5ff2-9789-4ee8-8283-6248bba6d66a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "4f9e0eae-81c7-4a91-8ac1-51459e231532", "address": "fa:16:3e:b2:aa:71", "network": {"id": "5f3f6e0f-94b3-4a66-9839-763a2e2d259c", "bridge": "br-int", "label": "tempest-TestShelveInstance-338163972-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "108a420b4c6e451d8429d21665e12fb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f9e0eae-81", "ovs_interfaceid": "4f9e0eae-81c7-4a91-8ac1-51459e231532", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72382) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 15:38:22 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-7813323f-510a-4504-a7df-c7e49447d98f tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] Converting VIF {"id": "4f9e0eae-81c7-4a91-8ac1-51459e231532", "address": "fa:16:3e:b2:aa:71", "network": {"id": "5f3f6e0f-94b3-4a66-9839-763a2e2d259c", "bridge": "br-int", "label": "tempest-TestShelveInstance-338163972-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "108a420b4c6e451d8429d21665e12fb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f9e0eae-81", "ovs_interfaceid": "4f9e0eae-81c7-4a91-8ac1-51459e231532", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 15:38:22 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-7813323f-510a-4504-a7df-c7e49447d98f tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:aa:71,bridge_name='br-int',has_traffic_filtering=True,id=4f9e0eae-81c7-4a91-8ac1-51459e231532,network=Network(5f3f6e0f-94b3-4a66-9839-763a2e2d259c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f9e0eae-81') {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 15:38:22 user nova-compute[72382]: DEBUG nova.objects.instance [None req-7813323f-510a-4504-a7df-c7e49447d98f tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] Lazy-loading 'pci_devices' on Instance uuid c88a5ff2-9789-4ee8-8283-6248bba6d66a {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:38:22 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[82e798c8-4871-4ee4-ae31-fc48a14d6b29]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:170d7509-0928-4a87-9d9f-437977452501\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:34d84af2-674d-428b-ba0e-5759ed077c26\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3f58579c-f69a-4bee-b16e-970e5a8f590c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:726fb5e9-e6eb-43b0-84a3-497d899991b8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a0a612d6-0f3f-4d2c-9fb5-aff9384338de\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d2f5dbb5-f862-4389-b42a-872d5c94aa55\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:38:22 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:38:22 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-7813323f-510a-4504-a7df-c7e49447d98f tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] [instance: c88a5ff2-9789-4ee8-8283-6248bba6d66a] End _get_guest_xml xml=<domain type="kvm">
Aug 09 15:38:22 user nova-compute[72382]:   <uuid>c88a5ff2-9789-4ee8-8283-6248bba6d66a</uuid>
Aug 09 15:38:22 user nova-compute[72382]:   <name>instance-00000025</name>
Aug 09 15:38:22 user nova-compute[72382]:   <memory>524288</memory>
Aug 09 15:38:22 user nova-compute[72382]:   <vcpu>1</vcpu>
Aug 09 15:38:22 user nova-compute[72382]:   <metadata>
Aug 09 15:38:22 user nova-compute[72382]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 15:38:22 user nova-compute[72382]:       <nova:package version="0.0.0"/>
Aug 09 15:38:22 user nova-compute[72382]:       <nova:name>tempest-TestShelveInstance-server-1501121398</nova:name>
Aug 09 15:38:22 user nova-compute[72382]:       <nova:creationTime>2023-08-09 15:38:20</nova:creationTime>
Aug 09 15:38:22 user nova-compute[72382]:       <nova:flavor name="m1.tiny">
Aug 09 15:38:22 user nova-compute[72382]:         <nova:memory>512</nova:memory>
Aug 09 15:38:22 user nova-compute[72382]:         <nova:disk>1</nova:disk>
Aug 09 15:38:22 user nova-compute[72382]:         <nova:swap>0</nova:swap>
Aug 09 15:38:22 user nova-compute[72382]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 15:38:22 user nova-compute[72382]:         <nova:vcpus>1</nova:vcpus>
Aug 09 15:38:22 user nova-compute[72382]:       </nova:flavor>
Aug 09 15:38:22 user nova-compute[72382]:       <nova:owner>
Aug 09 15:38:22 user nova-compute[72382]:         <nova:user uuid="827f726259fb452aad32077e24ec4fc2">tempest-TestShelveInstance-1984291610-project-member</nova:user>
Aug 09 15:38:22 user nova-compute[72382]:         <nova:project uuid="108a420b4c6e451d8429d21665e12fb9">tempest-TestShelveInstance-1984291610</nova:project>
Aug 09 15:38:22 user nova-compute[72382]:       </nova:owner>
Aug 09 15:38:22 user nova-compute[72382]:       <nova:ports>
Aug 09 15:38:22 user nova-compute[72382]:         <nova:port uuid="4f9e0eae-81c7-4a91-8ac1-51459e231532">
Aug 09 15:38:22 user nova-compute[72382]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 09 15:38:22 user nova-compute[72382]:         </nova:port>
Aug 09 15:38:22 user nova-compute[72382]:       </nova:ports>
Aug 09 15:38:22 user nova-compute[72382]:     </nova:instance>
Aug 09 15:38:22 user nova-compute[72382]:   </metadata>
Aug 09 15:38:22 user nova-compute[72382]:   <sysinfo type="smbios">
Aug 09 15:38:22 user nova-compute[72382]:     <system>
Aug 09 15:38:22 user nova-compute[72382]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 15:38:22 user nova-compute[72382]:       <entry name="product">OpenStack Nova</entry>
Aug 09 15:38:22 user nova-compute[72382]:       <entry name="version">0.0.0</entry>
Aug 09 15:38:22 user nova-compute[72382]:       <entry name="serial">c88a5ff2-9789-4ee8-8283-6248bba6d66a</entry>
Aug 09 15:38:22 user nova-compute[72382]:       <entry name="uuid">c88a5ff2-9789-4ee8-8283-6248bba6d66a</entry>
Aug 09 15:38:22 user nova-compute[72382]:       <entry name="family">Virtual Machine</entry>
Aug 09 15:38:22 user nova-compute[72382]:     </system>
Aug 09 15:38:22 user nova-compute[72382]:   </sysinfo>
Aug 09 15:38:22 user nova-compute[72382]:   <os>
Aug 09 15:38:22 user nova-compute[72382]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 15:38:22 user nova-compute[72382]:     <boot dev="hd"/>
Aug 09 15:38:22 user nova-compute[72382]:     <smbios mode="sysinfo"/>
Aug 09 15:38:22 user nova-compute[72382]:   </os>
Aug 09 15:38:22 user nova-compute[72382]:   <features>
Aug 09 15:38:22 user nova-compute[72382]:     <acpi/>
Aug 09 15:38:22 user nova-compute[72382]:     <apic/>
Aug 09 15:38:22 user nova-compute[72382]:     <vmcoreinfo/>
Aug 09 15:38:22 user nova-compute[72382]:   </features>
Aug 09 15:38:22 user nova-compute[72382]:   <clock offset="utc">
Aug 09 15:38:22 user nova-compute[72382]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 15:38:22 user nova-compute[72382]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 15:38:22 user nova-compute[72382]:     <timer name="hpet" present="no"/>
Aug 09 15:38:22 user nova-compute[72382]:   </clock>
Aug 09 15:38:22 user nova-compute[72382]:   <cpu mode="custom" match="exact">
Aug 09 15:38:22 user nova-compute[72382]:     <model>Nehalem</model>
Aug 09 15:38:22 user nova-compute[72382]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 15:38:22 user nova-compute[72382]:   </cpu>
Aug 09 15:38:22 user nova-compute[72382]:   <devices>
Aug 09 15:38:22 user nova-compute[72382]:     <disk type="block" device="disk">
Aug 09 15:38:22 user nova-compute[72382]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 15:38:22 user nova-compute[72382]:       <source dev="/dev/sdg"/>
Aug 09 15:38:22 user nova-compute[72382]:       <target dev="vda" bus="virtio"/>
Aug 09 15:38:22 user nova-compute[72382]:       <serial>d2f5dbb5-f862-4389-b42a-872d5c94aa55</serial>
Aug 09 15:38:22 user nova-compute[72382]:     </disk>
Aug 09 15:38:22 user nova-compute[72382]:     <interface type="ethernet">
Aug 09 15:38:22 user nova-compute[72382]:       <mac address="fa:16:3e:b2:aa:71"/>
Aug 09 15:38:22 user nova-compute[72382]:       <model type="virtio"/>
Aug 09 15:38:22 user nova-compute[72382]:       <mtu size="1442"/>
Aug 09 15:38:22 user nova-compute[72382]:       <target dev="tap4f9e0eae-81"/>
Aug 09 15:38:22 user nova-compute[72382]:     </interface>
Aug 09 15:38:22 user nova-compute[72382]:     <serial type="pty">
Aug 09 15:38:22 user nova-compute[72382]:       <log file="/opt/stack/data/nova/instances/c88a5ff2-9789-4ee8-8283-6248bba6d66a/console.log" append="off"/>
Aug 09 15:38:22 user nova-compute[72382]:     </serial>
Aug 09 15:38:22 user nova-compute[72382]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 15:38:22 user nova-compute[72382]:     <video>
Aug 09 15:38:22 user nova-compute[72382]:       <model type="virtio"/>
Aug 09 15:38:22 user nova-compute[72382]:     </video>
Aug 09 15:38:22 user nova-compute[72382]:     <rng model="virtio">
Aug 09 15:38:22 user nova-compute[72382]:       <backend model="random">/dev/urandom</backend>
Aug 09 15:38:22 user nova-compute[72382]:     </rng>
Aug 09 15:38:22 user nova-compute[72382]:     <controller type="usb" index="0" model="none"/>
Aug 09 15:38:22 user nova-compute[72382]:     <memballoon model="virtio">
Aug 09 15:38:22 user nova-compute[72382]:       <stats period="10"/>
Aug 09 15:38:22 user nova-compute[72382]:     </memballoon>
Aug 09 15:38:22 user nova-compute[72382]:   </devices>
Aug 09 15:38:22 user nova-compute[72382]: </domain>
Aug 09 15:38:22 user nova-compute[72382]:  {{(pid=72382) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 15:38:22 user nova-compute[72382]: DEBUG nova.virt.libvirt.vif [None req-7813323f-510a-4504-a7df-c7e49447d98f tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-09T15:34:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1501121398',display_name='tempest-TestShelveInstance-server-1501121398',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1501121398',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1348374500',keypairs=<?>,launch_index=0,launched_at=2023-08-09T15:34:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='108a420b4c6e451d8429d21665e12fb9',ramdisk_id='',reservation_id='r-3ps4xjyg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1984291610',owner_user_name='tempest-TestShelveInstance-1984291610-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T15:38:08Z,user_data=None,user_id='827f726259fb452aad32077e24ec4fc2',uuid=c88a5ff2-9789-4ee8-8283-6248bba6d66a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "4f9e0eae-81c7-4a91-8ac1-51459e231532", "address": "fa:16:3e:b2:aa:71", "network": {"id": "5f3f6e0f-94b3-4a66-9839-763a2e2d259c", "bridge": "br-int", "label": "tempest-TestShelveInstance-338163972-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "108a420b4c6e451d8429d21665e12fb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f9e0eae-81", "ovs_interfaceid": "4f9e0eae-81c7-4a91-8ac1-51459e231532", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 15:38:22 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-7813323f-510a-4504-a7df-c7e49447d98f tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] Converting VIF {"id": "4f9e0eae-81c7-4a91-8ac1-51459e231532", "address": "fa:16:3e:b2:aa:71", "network": {"id": "5f3f6e0f-94b3-4a66-9839-763a2e2d259c", "bridge": "br-int", "label": "tempest-TestShelveInstance-338163972-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "108a420b4c6e451d8429d21665e12fb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f9e0eae-81", "ovs_interfaceid": "4f9e0eae-81c7-4a91-8ac1-51459e231532", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 15:38:22 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-7813323f-510a-4504-a7df-c7e49447d98f tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:aa:71,bridge_name='br-int',has_traffic_filtering=True,id=4f9e0eae-81c7-4a91-8ac1-51459e231532,network=Network(5f3f6e0f-94b3-4a66-9839-763a2e2d259c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f9e0eae-81') {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 15:38:22 user nova-compute[72382]: DEBUG os_vif [None req-7813323f-510a-4504-a7df-c7e49447d98f tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:aa:71,bridge_name='br-int',has_traffic_filtering=True,id=4f9e0eae-81c7-4a91-8ac1-51459e231532,network=Network(5f3f6e0f-94b3-4a66-9839-763a2e2d259c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f9e0eae-81') {{(pid=72382) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 15:38:22 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:38:22 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:38:22 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 15:38:22 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:38:22 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4f9e0eae-81, may_exist=True, interface_attrs={}) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:38:22 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4f9e0eae-81, col_values=(('external_ids', {'iface-id': '4f9e0eae-81c7-4a91-8ac1-51459e231532', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b2:aa:71', 'vm-uuid': 'c88a5ff2-9789-4ee8-8283-6248bba6d66a'}),), if_exists=True) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:38:22 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:38:22 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:38:22 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:38:22 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd1e5b90-9a44-41da-93c6-ca41a02e2e63]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f58579c-f69a-4bee-b16e-970e5a8f590c (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0a612d6-0f3f-4d2c-9fb5-aff9384338de (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:170d7509-0928-4a87-9d9f-437977452501 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:726fb5e9-e6eb-43b0-84a3-497d899991b8 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34d84af2-674d-428b-ba0e-5759ed077c26 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2f5dbb5-f862-4389-b42a-872d5c94aa55 (non-flash)\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:38:22 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bd45d1e-2095-4ca5-9e52-6f0536ea6d9f tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f58579c-f69a-4bee-b16e-970e5a8f590c (non-flash)
Aug 09 15:38:22 user nova-compute[72382]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0a612d6-0f3f-4d2c-9fb5-aff9384338de (non-flash)
Aug 09 15:38:22 user nova-compute[72382]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:170d7509-0928-4a87-9d9f-437977452501 (non-flash)
Aug 09 15:38:22 user nova-compute[72382]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:726fb5e9-e6eb-43b0-84a3-497d899991b8 (non-flash)
Aug 09 15:38:22 user nova-compute[72382]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34d84af2-674d-428b-ba0e-5759ed077c26 (non-flash)
Aug 09 15:38:22 user nova-compute[72382]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2f5dbb5-f862-4389-b42a-872d5c94aa55 (non-flash)
Aug 09 15:38:22 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 15:38:22 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bd45d1e-2095-4ca5-9e52-6f0536ea6d9f tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f58579c-f69a-4bee-b16e-970e5a8f590c (non-flash)
Aug 09 15:38:22 user nova-compute[72382]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0a612d6-0f3f-4d2c-9fb5-aff9384338de (non-flash)
Aug 09 15:38:22 user nova-compute[72382]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:170d7509-0928-4a87-9d9f-437977452501 (non-flash)
Aug 09 15:38:22 user nova-compute[72382]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:726fb5e9-e6eb-43b0-84a3-497d899991b8 (non-flash)
Aug 09 15:38:22 user nova-compute[72382]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34d84af2-674d-428b-ba0e-5759ed077c26 (non-flash)
Aug 09 15:38:22 user nova-compute[72382]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2f5dbb5-f862-4389-b42a-872d5c94aa55 (non-flash)
Aug 09 15:38:22 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 15:38:22 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bd45d1e-2095-4ca5-9e52-6f0536ea6d9f tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2a0c34b1c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:170d7509-0928-4a87-9d9f-437977452501'): ({'sdd'}, set())}) {{(pid=72382) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 15:38:22 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-3bd45d1e-2095-4ca5-9e52-6f0536ea6d9f tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Removing single pathed devices sdd {{(pid=72382) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 15:38:22 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:38:22 user nova-compute[72382]: INFO os_vif [None req-7813323f-510a-4504-a7df-c7e49447d98f tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:aa:71,bridge_name='br-int',has_traffic_filtering=True,id=4f9e0eae-81c7-4a91-8ac1-51459e231532,network=Network(5f3f6e0f-94b3-4a66-9839-763a2e2d259c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f9e0eae-81')
Aug 09 15:38:22 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:38:22 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:38:22 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[27e03c60-6766-49d0-bf7f-069aa4420d94]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:38:22 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:38:22 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:38:22 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8827756-8e2a-49c1-86eb-e9648231f318]: (4, ('ok\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:38:22 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-3bd45d1e-2095-4ca5-9e52-6f0536ea6d9f tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Flushing IO for device /dev/sdd {{(pid=72382) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 15:38:22 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:38:22 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-7813323f-510a-4504-a7df-c7e49447d98f tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] No BDM found with device name vda, not building metadata. {{(pid=72382) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 15:38:22 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-7813323f-510a-4504-a7df-c7e49447d98f tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] No VIF found with MAC fa:16:3e:b2:aa:71, not building metadata {{(pid=72382) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 15:38:22 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.017s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:38:22 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f64c0f0-03e7-45d0-a42b-3d7435b497ed]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:38:22 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-3bd45d1e-2095-4ca5-9e52-6f0536ea6d9f tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72382) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 15:38:22 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:38:22 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.047s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:38:22 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7b775bf-83fc-45b3-851a-5ada4933be2d]: (4, ('1', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:38:22 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-3bd45d1e-2095-4ca5-9e52-6f0536ea6d9f tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72382) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 15:38:22 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-3bd45d1e-2095-4ca5-9e52-6f0536ea6d9f tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] SCSI volumes sdd have been removed. {{(pid=72382) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 15:38:22 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bd45d1e-2095-4ca5-9e52-6f0536ea6d9f tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:170d7509-0928-4a87-9d9f-437977452501')] {{(pid=72382) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 15:38:22 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:170d7509-0928-4a87-9d9f-437977452501 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:38:22 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:170d7509-0928-4a87-9d9f-437977452501 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:38:22 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7d52ba1-0eea-49de-9955-dd5c85b1080a]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:38:22 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bd45d1e-2095-4ca5-9e52-6f0536ea6d9f tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:38:22 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:170d7509-0928-4a87-9d9f-437977452501 -p 172.16.0.220:3260 --logout {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:38:22 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:170d7509-0928-4a87-9d9f-437977452501 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:38:22 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[9badc14c-b9e0-473d-99b7-5f1ca852346d]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:170d7509-0928-4a87-9d9f-437977452501, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:170d7509-0928-4a87-9d9f-437977452501, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:38:22 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bd45d1e-2095-4ca5-9e52-6f0536ea6d9f tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:170d7509-0928-4a87-9d9f-437977452501, portal: 172.16.0.220,3260]
Aug 09 15:38:22 user nova-compute[72382]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:170d7509-0928-4a87-9d9f-437977452501, portal: 172.16.0.220,3260] successful.
Aug 09 15:38:22 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:38:22 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:170d7509-0928-4a87-9d9f-437977452501 -p 172.16.0.220:3260 --op delete {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:38:22 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:170d7509-0928-4a87-9d9f-437977452501 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:38:22 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0e77f38-596b-4708-bbcd-b735fb7450c2]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:38:22 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bd45d1e-2095-4ca5-9e52-6f0536ea6d9f tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:38:22 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-3bd45d1e-2095-4ca5-9e52-6f0536ea6d9f tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.314s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 15:38:22 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bd45d1e-2095-4ca5-9e52-6f0536ea6d9f tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] <== disconnect_volume: return (1005ms) None {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 15:38:22 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3bd45d1e-2095-4ca5-9e52-6f0536ea6d9f tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] [instance: 7949b7d0-2712-402f-86ee-30acaef2d3e7] Disconnected iSCSI Volume {{(pid=72382) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 15:38:22 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-3bd45d1e-2095-4ca5-9e52-6f0536ea6d9f tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] [instance: 7949b7d0-2712-402f-86ee-30acaef2d3e7] Start _get_guest_xml network_info=[{"id": "bf6ac419-c6ba-4f01-b35a-4fa5e58913be", "address": "fa:16:3e:26:fd:d1", "network": {"id": "8d929426-09f7-49b5-a79e-711e20e00750", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1307802727-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.154", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93c87775443b4abd987197c4b46693bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf6ac419-c6", "ovs_interfaceid": "bf6ac419-c6ba-4f01-b35a-4fa5e58913be", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=cc9c1e6c-3869-41a3-8884-92bc10fd88dd,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'cc9c1e6c-3869-41a3-8884-92bc10fd88dd'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'boot_index': None, 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:170d7509-0928-4a87-9d9f-437977452501'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IeCsFWVU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': '7949b7d0-2712-402f-86ee-30acaef2d3e7', 'attached_at': '', 'detached_at': '', 'volume_id': '170d7509-0928-4a87-9d9f-437977452501', 'serial': '170d7509-0928-4a87-9d9f-437977452501'}, 'disk_bus': 'virtio', 'attachment_id': '04f25fb9-689c-45c8-8c1a-c51ac9009eaf', 'delete_on_termination': False, 'volume_type': None} {{(pid=72382) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 15:38:22 user nova-compute[72382]: WARNING nova.virt.libvirt.driver [None req-3bd45d1e-2095-4ca5-9e52-6f0536ea6d9f tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 15:38:22 user nova-compute[72382]: WARNING nova.virt.libvirt.driver [None req-3bd45d1e-2095-4ca5-9e52-6f0536ea6d9f tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 15:38:22 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-3bd45d1e-2095-4ca5-9e52-6f0536ea6d9f tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72382) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 15:38:22 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-3bd45d1e-2095-4ca5-9e52-6f0536ea6d9f tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] CPU controller missing on host. {{(pid=72382) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 15:38:22 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-3bd45d1e-2095-4ca5-9e52-6f0536ea6d9f tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72382) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 15:38:22 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-3bd45d1e-2095-4ca5-9e52-6f0536ea6d9f tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] CPU controller found on host. {{(pid=72382) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 15:38:22 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-3bd45d1e-2095-4ca5-9e52-6f0536ea6d9f tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72382) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 15:38:22 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-3bd45d1e-2095-4ca5-9e52-6f0536ea6d9f tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T15:11:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=cc9c1e6c-3869-41a3-8884-92bc10fd88dd,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 15:38:22 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-3bd45d1e-2095-4ca5-9e52-6f0536ea6d9f tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Flavor limits 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 15:38:22 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-3bd45d1e-2095-4ca5-9e52-6f0536ea6d9f tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Image limits 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 15:38:22 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-3bd45d1e-2095-4ca5-9e52-6f0536ea6d9f tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Flavor pref 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 15:38:22 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-3bd45d1e-2095-4ca5-9e52-6f0536ea6d9f tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Image pref 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 15:38:22 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-3bd45d1e-2095-4ca5-9e52-6f0536ea6d9f tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 15:38:22 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-3bd45d1e-2095-4ca5-9e52-6f0536ea6d9f tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 15:38:22 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-3bd45d1e-2095-4ca5-9e52-6f0536ea6d9f tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72382) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 15:38:22 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-3bd45d1e-2095-4ca5-9e52-6f0536ea6d9f tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Got 1 possible topologies {{(pid=72382) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 15:38:22 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-3bd45d1e-2095-4ca5-9e52-6f0536ea6d9f tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 15:38:22 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-3bd45d1e-2095-4ca5-9e52-6f0536ea6d9f tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 15:38:22 user nova-compute[72382]: DEBUG nova.objects.instance [None req-3bd45d1e-2095-4ca5-9e52-6f0536ea6d9f tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Lazy-loading 'vcpu_model' on Instance uuid 7949b7d0-2712-402f-86ee-30acaef2d3e7 {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:38:22 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3bd45d1e-2095-4ca5-9e52-6f0536ea6d9f tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] [instance: 7949b7d0-2712-402f-86ee-30acaef2d3e7] Calling os-brick to attach iSCSI Volume {{(pid=72382) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 15:38:22 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bd45d1e-2095-4ca5-9e52-6f0536ea6d9f tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2a0c768340>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:170d7509-0928-4a87-9d9f-437977452501'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IeCsFWVU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 15:38:22 user nova-compute[72382]: WARNING os_brick.initiator.connectors.base [None req-3bd45d1e-2095-4ca5-9e52-6f0536ea6d9f tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 15:38:22 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-3bd45d1e-2095-4ca5-9e52-6f0536ea6d9f tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 15:38:22 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-3bd45d1e-2095-4ca5-9e52-6f0536ea6d9f tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 15:38:22 user nova-compute[72382]: WARNING os_brick.initiator.connectors.base [None req-3bd45d1e-2095-4ca5-9e52-6f0536ea6d9f tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 15:38:22 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-3bd45d1e-2095-4ca5-9e52-6f0536ea6d9f tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:170d7509-0928-4a87-9d9f-437977452501" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 15:38:22 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-3bd45d1e-2095-4ca5-9e52-6f0536ea6d9f tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:170d7509-0928-4a87-9d9f-437977452501" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 15:38:22 user nova-compute[72382]: INFO os_brick.initiator.connectors.iscsi [None req-3bd45d1e-2095-4ca5-9e52-6f0536ea6d9f tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 15:38:22 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:170d7509-0928-4a87-9d9f-437977452501 -p 172.16.0.220:3260 {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:38:22 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:170d7509-0928-4a87-9d9f-437977452501 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:38:22 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[55aff4a9-a817-4759-865b-9550a2b942c4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:38:22 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bd45d1e-2095-4ca5-9e52-6f0536ea6d9f tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 15:38:22 user nova-compute[72382]:  {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:38:22 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:170d7509-0928-4a87-9d9f-437977452501 -p 172.16.0.220:3260 --interface default --op new {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:38:22 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:170d7509-0928-4a87-9d9f-437977452501 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:38:22 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6c72554-289c-4a18-8c4d-be0cfc943245]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:170d7509-0928-4a87-9d9f-437977452501] added\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:38:22 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bd45d1e-2095-4ca5-9e52-6f0536ea6d9f tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:170d7509-0928-4a87-9d9f-437977452501] added
Aug 09 15:38:22 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:38:22 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:170d7509-0928-4a87-9d9f-437977452501 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:38:22 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:170d7509-0928-4a87-9d9f-437977452501 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:38:22 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e60a5fc-924f-4fb2-afab-a56667d93174]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:38:22 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bd45d1e-2095-4ca5-9e52-6f0536ea6d9f tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:38:22 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:170d7509-0928-4a87-9d9f-437977452501 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:38:22 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:170d7509-0928-4a87-9d9f-437977452501 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:38:22 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[64420a46-affd-49b6-80b5-f6e885de0488]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:38:22 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bd45d1e-2095-4ca5-9e52-6f0536ea6d9f tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:38:22 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:170d7509-0928-4a87-9d9f-437977452501 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IeCsFWVU {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:38:22 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:170d7509-0928-4a87-9d9f-437977452501 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IeCsFWVU" returned: 0 in 0.018s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:38:22 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[59604264-ec1e-42b2-a49c-b8459f54c1b6]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:38:22 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bd45d1e-2095-4ca5-9e52-6f0536ea6d9f tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IeCsFWVU'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:38:22 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:170d7509-0928-4a87-9d9f-437977452501 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:38:22 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:170d7509-0928-4a87-9d9f-437977452501 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:38:22 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[689eb8d2-92d4-412e-98d8-4311ac0659c0]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:38:22 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bd45d1e-2095-4ca5-9e52-6f0536ea6d9f tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:38:22 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:38:22 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:38:22 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1a8b56b-dc5d-4967-abab-28f618578d37]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f58579c-f69a-4bee-b16e-970e5a8f590c (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0a612d6-0f3f-4d2c-9fb5-aff9384338de (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:726fb5e9-e6eb-43b0-84a3-497d899991b8 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34d84af2-674d-428b-ba0e-5759ed077c26 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2f5dbb5-f862-4389-b42a-872d5c94aa55 (non-flash)\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:38:22 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bd45d1e-2095-4ca5-9e52-6f0536ea6d9f tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f58579c-f69a-4bee-b16e-970e5a8f590c (non-flash)
Aug 09 15:38:22 user nova-compute[72382]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0a612d6-0f3f-4d2c-9fb5-aff9384338de (non-flash)
Aug 09 15:38:22 user nova-compute[72382]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:726fb5e9-e6eb-43b0-84a3-497d899991b8 (non-flash)
Aug 09 15:38:22 user nova-compute[72382]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34d84af2-674d-428b-ba0e-5759ed077c26 (non-flash)
Aug 09 15:38:22 user nova-compute[72382]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2f5dbb5-f862-4389-b42a-872d5c94aa55 (non-flash)
Aug 09 15:38:22 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 15:38:22 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bd45d1e-2095-4ca5-9e52-6f0536ea6d9f tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f58579c-f69a-4bee-b16e-970e5a8f590c (non-flash)
Aug 09 15:38:22 user nova-compute[72382]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0a612d6-0f3f-4d2c-9fb5-aff9384338de (non-flash)
Aug 09 15:38:22 user nova-compute[72382]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:726fb5e9-e6eb-43b0-84a3-497d899991b8 (non-flash)
Aug 09 15:38:22 user nova-compute[72382]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34d84af2-674d-428b-ba0e-5759ed077c26 (non-flash)
Aug 09 15:38:22 user nova-compute[72382]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2f5dbb5-f862-4389-b42a-872d5c94aa55 (non-flash)
Aug 09 15:38:22 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 15:38:22 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:170d7509-0928-4a87-9d9f-437977452501 -p 172.16.0.220:3260 --login {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:38:22 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:170d7509-0928-4a87-9d9f-437977452501 -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:38:22 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[a73566e8-0b43-4d8a-9619-23e02f4a7a5d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:170d7509-0928-4a87-9d9f-437977452501, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:170d7509-0928-4a87-9d9f-437977452501, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:38:22 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bd45d1e-2095-4ca5-9e52-6f0536ea6d9f tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:170d7509-0928-4a87-9d9f-437977452501, portal: 172.16.0.220,3260]
Aug 09 15:38:22 user nova-compute[72382]: Login to [iface: default, target: iqn.2010-10.org.openstack:170d7509-0928-4a87-9d9f-437977452501, portal: 172.16.0.220,3260] successful.
Aug 09 15:38:22 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:38:22 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:170d7509-0928-4a87-9d9f-437977452501 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:38:23 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:170d7509-0928-4a87-9d9f-437977452501 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:38:23 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c59f851-19b4-44f8-9896-4fc66f249b1a]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:38:23 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bd45d1e-2095-4ca5-9e52-6f0536ea6d9f tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:38:23 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:38:23 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:38:23 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[741ebf9a-36f2-4fb9-8508-45b64844415f]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f58579c-f69a-4bee-b16e-970e5a8f590c (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0a612d6-0f3f-4d2c-9fb5-aff9384338de (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:726fb5e9-e6eb-43b0-84a3-497d899991b8 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34d84af2-674d-428b-ba0e-5759ed077c26 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2f5dbb5-f862-4389-b42a-872d5c94aa55 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:170d7509-0928-4a87-9d9f-437977452501 (non-flash)\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:38:23 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bd45d1e-2095-4ca5-9e52-6f0536ea6d9f tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f58579c-f69a-4bee-b16e-970e5a8f590c (non-flash)
Aug 09 15:38:23 user nova-compute[72382]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0a612d6-0f3f-4d2c-9fb5-aff9384338de (non-flash)
Aug 09 15:38:23 user nova-compute[72382]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:726fb5e9-e6eb-43b0-84a3-497d899991b8 (non-flash)
Aug 09 15:38:23 user nova-compute[72382]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34d84af2-674d-428b-ba0e-5759ed077c26 (non-flash)
Aug 09 15:38:23 user nova-compute[72382]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2f5dbb5-f862-4389-b42a-872d5c94aa55 (non-flash)
Aug 09 15:38:23 user nova-compute[72382]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:170d7509-0928-4a87-9d9f-437977452501 (non-flash)
Aug 09 15:38:23 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 15:38:23 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bd45d1e-2095-4ca5-9e52-6f0536ea6d9f tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f58579c-f69a-4bee-b16e-970e5a8f590c (non-flash)
Aug 09 15:38:23 user nova-compute[72382]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0a612d6-0f3f-4d2c-9fb5-aff9384338de (non-flash)
Aug 09 15:38:23 user nova-compute[72382]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:726fb5e9-e6eb-43b0-84a3-497d899991b8 (non-flash)
Aug 09 15:38:23 user nova-compute[72382]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34d84af2-674d-428b-ba0e-5759ed077c26 (non-flash)
Aug 09 15:38:23 user nova-compute[72382]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2f5dbb5-f862-4389-b42a-872d5c94aa55 (non-flash)
Aug 09 15:38:23 user nova-compute[72382]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:170d7509-0928-4a87-9d9f-437977452501 (non-flash)
Aug 09 15:38:23 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 15:38:23 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-3bd45d1e-2095-4ca5-9e52-6f0536ea6d9f tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:170d7509-0928-4a87-9d9f-437977452501" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.305s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 15:38:23 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bd45d1e-2095-4ca5-9e52-6f0536ea6d9f tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Connected to 172.16.0.220:3260 {{(pid=72382) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 15:38:23 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-3bd45d1e-2095-4ca5-9e52-6f0536ea6d9f tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] HCTL ('35', '-', '-', 0) found on session 54 with lun 0 {{(pid=72382) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 15:38:23 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-3bd45d1e-2095-4ca5-9e52-6f0536ea6d9f tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72382) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 15:38:23 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:38:23 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:38:23 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a68671a-04e5-497b-b12a-0aa3aeef47f6]: (4, ('- - 0', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:38:23 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-3bd45d1e-2095-4ca5-9e52-6f0536ea6d9f tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Searching for a device in session 54 and hctl ['35', '*', '*', 0] yield: None {{(pid=72382) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 15:38:23 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-261ea5ce-ca81-4b11-ba86-d0f58a8ca8cc tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Acquiring lock "d66443a2-2dc1-46f6-9572-f0717f830927" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:38:23 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-261ea5ce-ca81-4b11-ba86-d0f58a8ca8cc tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Lock "d66443a2-2dc1-46f6-9572-f0717f830927" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:38:23 user nova-compute[72382]: INFO nova.compute.manager [None req-261ea5ce-ca81-4b11-ba86-d0f58a8ca8cc tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] [instance: d66443a2-2dc1-46f6-9572-f0717f830927] Detaching volume 726fb5e9-e6eb-43b0-84a3-497d899991b8
Aug 09 15:38:23 user nova-compute[72382]: INFO nova.virt.block_device [None req-261ea5ce-ca81-4b11-ba86-d0f58a8ca8cc tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] [instance: d66443a2-2dc1-46f6-9572-f0717f830927] Attempting to driver detach volume 726fb5e9-e6eb-43b0-84a3-497d899991b8 from mountpoint /dev/vdb
Aug 09 15:38:23 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-261ea5ce-ca81-4b11-ba86-d0f58a8ca8cc tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Attempting to detach device vdb from instance d66443a2-2dc1-46f6-9572-f0717f830927 from the persistent domain config. {{(pid=72382) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 15:38:23 user nova-compute[72382]: DEBUG nova.virt.libvirt.guest [None req-261ea5ce-ca81-4b11-ba86-d0f58a8ca8cc tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 15:38:23 user nova-compute[72382]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 15:38:23 user nova-compute[72382]:   <source dev="/dev/sde"/>
Aug 09 15:38:23 user nova-compute[72382]:   <target dev="vdb" bus="virtio"/>
Aug 09 15:38:23 user nova-compute[72382]:   <serial>726fb5e9-e6eb-43b0-84a3-497d899991b8</serial>
Aug 09 15:38:23 user nova-compute[72382]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 15:38:23 user nova-compute[72382]: </disk>
Aug 09 15:38:23 user nova-compute[72382]:  {{(pid=72382) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 15:38:23 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-261ea5ce-ca81-4b11-ba86-d0f58a8ca8cc tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Successfully detached device vdb from instance d66443a2-2dc1-46f6-9572-f0717f830927 from the persistent domain config.
Aug 09 15:38:23 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-261ea5ce-ca81-4b11-ba86-d0f58a8ca8cc tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d66443a2-2dc1-46f6-9572-f0717f830927 from the live domain config. {{(pid=72382) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 15:38:23 user nova-compute[72382]: DEBUG nova.virt.libvirt.guest [None req-261ea5ce-ca81-4b11-ba86-d0f58a8ca8cc tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 15:38:23 user nova-compute[72382]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 15:38:23 user nova-compute[72382]:   <source dev="/dev/sde"/>
Aug 09 15:38:23 user nova-compute[72382]:   <target dev="vdb" bus="virtio"/>
Aug 09 15:38:23 user nova-compute[72382]:   <serial>726fb5e9-e6eb-43b0-84a3-497d899991b8</serial>
Aug 09 15:38:23 user nova-compute[72382]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 15:38:23 user nova-compute[72382]: </disk>
Aug 09 15:38:23 user nova-compute[72382]:  {{(pid=72382) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 15:38:23 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:38:23 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:38:23 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:38:23 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:38:23 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:38:23 user nova-compute[72382]: DEBUG nova.compute.manager [req-fefb4030-490b-4d57-adee-d17ba09bbbfb req-9f78304e-c063-4d63-b19e-f5d1f1092197 service nova] [instance: c88a5ff2-9789-4ee8-8283-6248bba6d66a] Received event network-vif-plugged-4f9e0eae-81c7-4a91-8ac1-51459e231532 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:38:23 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-fefb4030-490b-4d57-adee-d17ba09bbbfb req-9f78304e-c063-4d63-b19e-f5d1f1092197 service nova] Acquiring lock "c88a5ff2-9789-4ee8-8283-6248bba6d66a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:38:23 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-fefb4030-490b-4d57-adee-d17ba09bbbfb req-9f78304e-c063-4d63-b19e-f5d1f1092197 service nova] Lock "c88a5ff2-9789-4ee8-8283-6248bba6d66a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:38:23 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-fefb4030-490b-4d57-adee-d17ba09bbbfb req-9f78304e-c063-4d63-b19e-f5d1f1092197 service nova] Lock "c88a5ff2-9789-4ee8-8283-6248bba6d66a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:38:23 user nova-compute[72382]: DEBUG nova.compute.manager [req-fefb4030-490b-4d57-adee-d17ba09bbbfb req-9f78304e-c063-4d63-b19e-f5d1f1092197 service nova] [instance: c88a5ff2-9789-4ee8-8283-6248bba6d66a] No waiting events found dispatching network-vif-plugged-4f9e0eae-81c7-4a91-8ac1-51459e231532 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:38:23 user nova-compute[72382]: WARNING nova.compute.manager [req-fefb4030-490b-4d57-adee-d17ba09bbbfb req-9f78304e-c063-4d63-b19e-f5d1f1092197 service nova] [instance: c88a5ff2-9789-4ee8-8283-6248bba6d66a] Received unexpected event network-vif-plugged-4f9e0eae-81c7-4a91-8ac1-51459e231532 for instance with vm_state shelved_offloaded and task_state spawning.
Aug 09 15:38:24 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-3bd45d1e-2095-4ca5-9e52-6f0536ea6d9f tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Searching for a device in session 54 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72382) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 15:38:24 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bd45d1e-2095-4ca5-9e52-6f0536ea6d9f tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IeCsFWVU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72382) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 15:38:24 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-3bd45d1e-2095-4ca5-9e52-6f0536ea6d9f tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.337s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 15:38:24 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bd45d1e-2095-4ca5-9e52-6f0536ea6d9f tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] <== connect_volume: return (1339ms) {'type': 'block', 'scsi_wwn': '23638613364663539', 'path': '/dev/sdd'} {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 15:38:24 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3bd45d1e-2095-4ca5-9e52-6f0536ea6d9f tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] [instance: 7949b7d0-2712-402f-86ee-30acaef2d3e7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23638613364663539', 'path': '/dev/sdd'} {{(pid=72382) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 15:38:24 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Received event <DeviceRemovedEvent: 1691595504.0768204, d66443a2-2dc1-46f6-9572-f0717f830927 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72382) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 15:38:24 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-261ea5ce-ca81-4b11-ba86-d0f58a8ca8cc tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d66443a2-2dc1-46f6-9572-f0717f830927 {{(pid=72382) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 15:38:24 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-261ea5ce-ca81-4b11-ba86-d0f58a8ca8cc tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Successfully detached device vdb from instance d66443a2-2dc1-46f6-9572-f0717f830927 from the live domain config.
Aug 09 15:38:24 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-261ea5ce-ca81-4b11-ba86-d0f58a8ca8cc tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] [instance: d66443a2-2dc1-46f6-9572-f0717f830927] calling os-brick to detach iSCSI Volume {{(pid=72382) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 15:38:24 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-261ea5ce-ca81-4b11-ba86-d0f58a8ca8cc tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2a0c768340>, {'target_iqns': ['iqn.2010-10.org.openstack:726fb5e9-e6eb-43b0-84a3-497d899991b8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mNoghzWZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 15:38:24 user nova-compute[72382]: WARNING os_brick.initiator.connectors.base [None req-261ea5ce-ca81-4b11-ba86-d0f58a8ca8cc tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 15:38:24 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-261ea5ce-ca81-4b11-ba86-d0f58a8ca8cc tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 15:38:24 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-261ea5ce-ca81-4b11-ba86-d0f58a8ca8cc tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 15:38:24 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-261ea5ce-ca81-4b11-ba86-d0f58a8ca8cc tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:726fb5e9-e6eb-43b0-84a3-497d899991b8', 0)] {{(pid=72382) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 15:38:24 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:38:24 user nova-compute[72382]: DEBUG nova.virt.libvirt.vif [None req-3bd45d1e-2095-4ca5-9e52-6f0536ea6d9f tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T15:35:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1437781387',display_name='tempest-TestMinimumBasicScenario-server-1437781387',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1437781387',id=40,image_ref='cc9c1e6c-3869-41a3-8884-92bc10fd88dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE7fZdqwv14TbpkokOGrZLxteONCsQhHwHtSkm0iehxIvEwr8CDGRfFb4MKI0stgbdIk1yccqk1l+GgnPmgswjQ9PIPDbFPc3f6proZobtF+S6ZVWml9M9bSSrAd7AGo5w==',key_name='tempest-TestMinimumBasicScenario-63485549',keypairs=<?>,launch_index=0,launched_at=2023-08-09T15:36:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='93c87775443b4abd987197c4b46693bc',ramdisk_id='',reservation_id='r-oo0ozxn0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cc9c1e6c-3869-41a3-8884-92bc10fd88dd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-389394165',owner_user_name='tempest-TestMinimumBasicScenario-389394165-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T15:38:20Z,user_data=None,user_id='12ac8eca784e480d86c8fff801e73d2d',uuid=7949b7d0-2712-402f-86ee-30acaef2d3e7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bf6ac419-c6ba-4f01-b35a-4fa5e58913be", "address": "fa:16:3e:26:fd:d1", "network": {"id": "8d929426-09f7-49b5-a79e-711e20e00750", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1307802727-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.154", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93c87775443b4abd987197c4b46693bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf6ac419-c6", "ovs_interfaceid": "bf6ac419-c6ba-4f01-b35a-4fa5e58913be", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72382) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 15:38:24 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-3bd45d1e-2095-4ca5-9e52-6f0536ea6d9f tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Converting VIF {"id": "bf6ac419-c6ba-4f01-b35a-4fa5e58913be", "address": "fa:16:3e:26:fd:d1", "network": {"id": "8d929426-09f7-49b5-a79e-711e20e00750", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1307802727-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.154", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93c87775443b4abd987197c4b46693bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf6ac419-c6", "ovs_interfaceid": "bf6ac419-c6ba-4f01-b35a-4fa5e58913be", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 15:38:24 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-3bd45d1e-2095-4ca5-9e52-6f0536ea6d9f tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:26:fd:d1,bridge_name='br-int',has_traffic_filtering=True,id=bf6ac419-c6ba-4f01-b35a-4fa5e58913be,network=Network(8d929426-09f7-49b5-a79e-711e20e00750),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf6ac419-c6') {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 15:38:24 user nova-compute[72382]: DEBUG nova.objects.instance [None req-3bd45d1e-2095-4ca5-9e52-6f0536ea6d9f tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Lazy-loading 'pci_devices' on Instance uuid 7949b7d0-2712-402f-86ee-30acaef2d3e7 {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:38:24 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:38:24 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2917635-fcd6-4529-8120-22b84c0f40df]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:170d7509-0928-4a87-9d9f-437977452501\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:34d84af2-674d-428b-ba0e-5759ed077c26\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3f58579c-f69a-4bee-b16e-970e5a8f590c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:726fb5e9-e6eb-43b0-84a3-497d899991b8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a0a612d6-0f3f-4d2c-9fb5-aff9384338de\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d2f5dbb5-f862-4389-b42a-872d5c94aa55\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:38:24 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-3bd45d1e-2095-4ca5-9e52-6f0536ea6d9f tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] [instance: 7949b7d0-2712-402f-86ee-30acaef2d3e7] End _get_guest_xml xml=<domain type="kvm">
Aug 09 15:38:24 user nova-compute[72382]:   <uuid>7949b7d0-2712-402f-86ee-30acaef2d3e7</uuid>
Aug 09 15:38:24 user nova-compute[72382]:   <name>instance-00000028</name>
Aug 09 15:38:24 user nova-compute[72382]:   <memory>524288</memory>
Aug 09 15:38:24 user nova-compute[72382]:   <vcpu>1</vcpu>
Aug 09 15:38:24 user nova-compute[72382]:   <metadata>
Aug 09 15:38:24 user nova-compute[72382]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 15:38:24 user nova-compute[72382]:       <nova:package version="0.0.0"/>
Aug 09 15:38:24 user nova-compute[72382]:       <nova:name>tempest-TestMinimumBasicScenario-server-1437781387</nova:name>
Aug 09 15:38:24 user nova-compute[72382]:       <nova:creationTime>2023-08-09 15:38:22</nova:creationTime>
Aug 09 15:38:24 user nova-compute[72382]:       <nova:flavor name="m1.tiny">
Aug 09 15:38:24 user nova-compute[72382]:         <nova:memory>512</nova:memory>
Aug 09 15:38:24 user nova-compute[72382]:         <nova:disk>1</nova:disk>
Aug 09 15:38:24 user nova-compute[72382]:         <nova:swap>0</nova:swap>
Aug 09 15:38:24 user nova-compute[72382]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 15:38:24 user nova-compute[72382]:         <nova:vcpus>1</nova:vcpus>
Aug 09 15:38:24 user nova-compute[72382]:       </nova:flavor>
Aug 09 15:38:24 user nova-compute[72382]:       <nova:owner>
Aug 09 15:38:24 user nova-compute[72382]:         <nova:user uuid="12ac8eca784e480d86c8fff801e73d2d">tempest-TestMinimumBasicScenario-389394165-project-member</nova:user>
Aug 09 15:38:24 user nova-compute[72382]:         <nova:project uuid="93c87775443b4abd987197c4b46693bc">tempest-TestMinimumBasicScenario-389394165</nova:project>
Aug 09 15:38:24 user nova-compute[72382]:       </nova:owner>
Aug 09 15:38:24 user nova-compute[72382]:       <nova:root type="image" uuid="cc9c1e6c-3869-41a3-8884-92bc10fd88dd"/>
Aug 09 15:38:24 user nova-compute[72382]:       <nova:ports>
Aug 09 15:38:24 user nova-compute[72382]:         <nova:port uuid="bf6ac419-c6ba-4f01-b35a-4fa5e58913be">
Aug 09 15:38:24 user nova-compute[72382]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 09 15:38:24 user nova-compute[72382]:         </nova:port>
Aug 09 15:38:24 user nova-compute[72382]:       </nova:ports>
Aug 09 15:38:24 user nova-compute[72382]:     </nova:instance>
Aug 09 15:38:24 user nova-compute[72382]:   </metadata>
Aug 09 15:38:24 user nova-compute[72382]:   <sysinfo type="smbios">
Aug 09 15:38:24 user nova-compute[72382]:     <system>
Aug 09 15:38:24 user nova-compute[72382]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 15:38:24 user nova-compute[72382]:       <entry name="product">OpenStack Nova</entry>
Aug 09 15:38:24 user nova-compute[72382]:       <entry name="version">0.0.0</entry>
Aug 09 15:38:24 user nova-compute[72382]:       <entry name="serial">7949b7d0-2712-402f-86ee-30acaef2d3e7</entry>
Aug 09 15:38:24 user nova-compute[72382]:       <entry name="uuid">7949b7d0-2712-402f-86ee-30acaef2d3e7</entry>
Aug 09 15:38:24 user nova-compute[72382]:       <entry name="family">Virtual Machine</entry>
Aug 09 15:38:24 user nova-compute[72382]:     </system>
Aug 09 15:38:24 user nova-compute[72382]:   </sysinfo>
Aug 09 15:38:24 user nova-compute[72382]:   <os>
Aug 09 15:38:24 user nova-compute[72382]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 15:38:24 user nova-compute[72382]:     <boot dev="hd"/>
Aug 09 15:38:24 user nova-compute[72382]:     <smbios mode="sysinfo"/>
Aug 09 15:38:24 user nova-compute[72382]:   </os>
Aug 09 15:38:24 user nova-compute[72382]:   <features>
Aug 09 15:38:24 user nova-compute[72382]:     <acpi/>
Aug 09 15:38:24 user nova-compute[72382]:     <apic/>
Aug 09 15:38:24 user nova-compute[72382]:     <vmcoreinfo/>
Aug 09 15:38:24 user nova-compute[72382]:   </features>
Aug 09 15:38:24 user nova-compute[72382]:   <clock offset="utc">
Aug 09 15:38:24 user nova-compute[72382]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 15:38:24 user nova-compute[72382]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 15:38:24 user nova-compute[72382]:     <timer name="hpet" present="no"/>
Aug 09 15:38:24 user nova-compute[72382]:   </clock>
Aug 09 15:38:24 user nova-compute[72382]:   <cpu mode="custom" match="exact">
Aug 09 15:38:24 user nova-compute[72382]:     <model>Nehalem</model>
Aug 09 15:38:24 user nova-compute[72382]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 15:38:24 user nova-compute[72382]:   </cpu>
Aug 09 15:38:24 user nova-compute[72382]:   <devices>
Aug 09 15:38:24 user nova-compute[72382]:     <disk type="file" device="disk">
Aug 09 15:38:24 user nova-compute[72382]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 15:38:24 user nova-compute[72382]:       <source file="/opt/stack/data/nova/instances/7949b7d0-2712-402f-86ee-30acaef2d3e7/disk"/>
Aug 09 15:38:24 user nova-compute[72382]:       <target dev="vda" bus="virtio"/>
Aug 09 15:38:24 user nova-compute[72382]:     </disk>
Aug 09 15:38:24 user nova-compute[72382]:     <disk type="block" device="disk">
Aug 09 15:38:24 user nova-compute[72382]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 15:38:24 user nova-compute[72382]:       <source dev="/dev/sdd"/>
Aug 09 15:38:24 user nova-compute[72382]:       <target dev="vdb" bus="virtio"/>
Aug 09 15:38:24 user nova-compute[72382]:       <serial>170d7509-0928-4a87-9d9f-437977452501</serial>
Aug 09 15:38:24 user nova-compute[72382]:     </disk>
Aug 09 15:38:24 user nova-compute[72382]:     <interface type="ethernet">
Aug 09 15:38:24 user nova-compute[72382]:       <mac address="fa:16:3e:26:fd:d1"/>
Aug 09 15:38:24 user nova-compute[72382]:       <model type="virtio"/>
Aug 09 15:38:24 user nova-compute[72382]:       <mtu size="1442"/>
Aug 09 15:38:24 user nova-compute[72382]:       <target dev="tapbf6ac419-c6"/>
Aug 09 15:38:24 user nova-compute[72382]:     </interface>
Aug 09 15:38:24 user nova-compute[72382]:     <serial type="pty">
Aug 09 15:38:24 user nova-compute[72382]:       <log file="/opt/stack/data/nova/instances/7949b7d0-2712-402f-86ee-30acaef2d3e7/console.log" append="off"/>
Aug 09 15:38:24 user nova-compute[72382]:     </serial>
Aug 09 15:38:24 user nova-compute[72382]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 15:38:24 user nova-compute[72382]:     <video>
Aug 09 15:38:24 user nova-compute[72382]:       <model type="virtio"/>
Aug 09 15:38:24 user nova-compute[72382]:     </video>
Aug 09 15:38:24 user nova-compute[72382]:     <rng model="virtio">
Aug 09 15:38:24 user nova-compute[72382]:       <backend model="random">/dev/urandom</backend>
Aug 09 15:38:24 user nova-compute[72382]:     </rng>
Aug 09 15:38:24 user nova-compute[72382]:     <controller type="usb" index="0" model="none"/>
Aug 09 15:38:24 user nova-compute[72382]:     <memballoon model="virtio">
Aug 09 15:38:24 user nova-compute[72382]:       <stats period="10"/>
Aug 09 15:38:24 user nova-compute[72382]:     </memballoon>
Aug 09 15:38:24 user nova-compute[72382]:   </devices>
Aug 09 15:38:24 user nova-compute[72382]: </domain>
Aug 09 15:38:24 user nova-compute[72382]:  {{(pid=72382) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 15:38:24 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-3bd45d1e-2095-4ca5-9e52-6f0536ea6d9f tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7949b7d0-2712-402f-86ee-30acaef2d3e7/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:38:24 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:38:24 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:38:24 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b55b681-1413-4a75-b11f-eb07c3a2299a]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f58579c-f69a-4bee-b16e-970e5a8f590c (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0a612d6-0f3f-4d2c-9fb5-aff9384338de (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:726fb5e9-e6eb-43b0-84a3-497d899991b8 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34d84af2-674d-428b-ba0e-5759ed077c26 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2f5dbb5-f862-4389-b42a-872d5c94aa55 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:170d7509-0928-4a87-9d9f-437977452501 (non-flash)\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:38:24 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-261ea5ce-ca81-4b11-ba86-d0f58a8ca8cc tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f58579c-f69a-4bee-b16e-970e5a8f590c (non-flash)
Aug 09 15:38:24 user nova-compute[72382]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0a612d6-0f3f-4d2c-9fb5-aff9384338de (non-flash)
Aug 09 15:38:24 user nova-compute[72382]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:726fb5e9-e6eb-43b0-84a3-497d899991b8 (non-flash)
Aug 09 15:38:24 user nova-compute[72382]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34d84af2-674d-428b-ba0e-5759ed077c26 (non-flash)
Aug 09 15:38:24 user nova-compute[72382]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2f5dbb5-f862-4389-b42a-872d5c94aa55 (non-flash)
Aug 09 15:38:24 user nova-compute[72382]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:170d7509-0928-4a87-9d9f-437977452501 (non-flash)
Aug 09 15:38:24 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 15:38:24 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-261ea5ce-ca81-4b11-ba86-d0f58a8ca8cc tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f58579c-f69a-4bee-b16e-970e5a8f590c (non-flash)
Aug 09 15:38:24 user nova-compute[72382]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0a612d6-0f3f-4d2c-9fb5-aff9384338de (non-flash)
Aug 09 15:38:24 user nova-compute[72382]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:726fb5e9-e6eb-43b0-84a3-497d899991b8 (non-flash)
Aug 09 15:38:24 user nova-compute[72382]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34d84af2-674d-428b-ba0e-5759ed077c26 (non-flash)
Aug 09 15:38:24 user nova-compute[72382]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2f5dbb5-f862-4389-b42a-872d5c94aa55 (non-flash)
Aug 09 15:38:24 user nova-compute[72382]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:170d7509-0928-4a87-9d9f-437977452501 (non-flash)
Aug 09 15:38:24 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 15:38:24 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-261ea5ce-ca81-4b11-ba86-d0f58a8ca8cc tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2a0c348820>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:726fb5e9-e6eb-43b0-84a3-497d899991b8'): ({'sde'}, set())}) {{(pid=72382) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 15:38:24 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-261ea5ce-ca81-4b11-ba86-d0f58a8ca8cc tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Removing single pathed devices sde {{(pid=72382) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 15:38:24 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:38:24 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:38:24 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[40a7145b-1a8c-4e92-927e-fbc59b1c9393]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:38:24 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:38:24 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:38:24 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb981459-44b9-4e0a-9c07-a1f6064d04ef]: (4, ('ok\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:38:24 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-261ea5ce-ca81-4b11-ba86-d0f58a8ca8cc tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Flushing IO for device /dev/sde {{(pid=72382) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 15:38:24 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:38:24 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:38:24 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7745ab9-7bb7-43ef-9d63-8384344b8bfa]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:38:24 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-261ea5ce-ca81-4b11-ba86-d0f58a8ca8cc tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72382) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 15:38:24 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:38:24 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-3bd45d1e-2095-4ca5-9e52-6f0536ea6d9f tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7949b7d0-2712-402f-86ee-30acaef2d3e7/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:38:24 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-3bd45d1e-2095-4ca5-9e52-6f0536ea6d9f tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7949b7d0-2712-402f-86ee-30acaef2d3e7/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:38:24 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.039s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:38:24 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[31e19527-1371-471f-97e3-56ac245db43c]: (4, ('1', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:38:24 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-261ea5ce-ca81-4b11-ba86-d0f58a8ca8cc tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72382) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 15:38:24 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-261ea5ce-ca81-4b11-ba86-d0f58a8ca8cc tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] SCSI volumes sde have been removed. {{(pid=72382) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 15:38:24 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-261ea5ce-ca81-4b11-ba86-d0f58a8ca8cc tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:726fb5e9-e6eb-43b0-84a3-497d899991b8')] {{(pid=72382) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 15:38:24 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:726fb5e9-e6eb-43b0-84a3-497d899991b8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:38:24 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:726fb5e9-e6eb-43b0-84a3-497d899991b8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:38:24 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a648a58-78dd-4462-970d-5899c67fa630]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:38:24 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-261ea5ce-ca81-4b11-ba86-d0f58a8ca8cc tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:38:24 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:726fb5e9-e6eb-43b0-84a3-497d899991b8 -p 172.16.0.220:3260 --logout {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:38:24 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:726fb5e9-e6eb-43b0-84a3-497d899991b8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:38:24 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:38:24 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f336c69-b8e9-4bc6-9b45-3e057e64a1d3]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:726fb5e9-e6eb-43b0-84a3-497d899991b8, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:726fb5e9-e6eb-43b0-84a3-497d899991b8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:38:24 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-261ea5ce-ca81-4b11-ba86-d0f58a8ca8cc tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:726fb5e9-e6eb-43b0-84a3-497d899991b8, portal: 172.16.0.220,3260]
Aug 09 15:38:24 user nova-compute[72382]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:726fb5e9-e6eb-43b0-84a3-497d899991b8, portal: 172.16.0.220,3260] successful.
Aug 09 15:38:24 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:38:24 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:726fb5e9-e6eb-43b0-84a3-497d899991b8 -p 172.16.0.220:3260 --op delete {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:38:24 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-3bd45d1e-2095-4ca5-9e52-6f0536ea6d9f tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7949b7d0-2712-402f-86ee-30acaef2d3e7/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:38:24 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-3bd45d1e-2095-4ca5-9e52-6f0536ea6d9f tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72382) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 15:38:24 user nova-compute[72382]: DEBUG nova.objects.instance [None req-3bd45d1e-2095-4ca5-9e52-6f0536ea6d9f tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Lazy-loading 'trusted_certs' on Instance uuid 7949b7d0-2712-402f-86ee-30acaef2d3e7 {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:38:24 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:38:24 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-3bd45d1e-2095-4ca5-9e52-6f0536ea6d9f tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/92bc25e5f2690987729e59abf1455719f9df9668 --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:38:24 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:726fb5e9-e6eb-43b0-84a3-497d899991b8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.037s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:38:24 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7b8f051-a9fc-4907-9c4c-5a37f9576b08]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:38:24 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-261ea5ce-ca81-4b11-ba86-d0f58a8ca8cc tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:38:24 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-261ea5ce-ca81-4b11-ba86-d0f58a8ca8cc tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.401s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 15:38:24 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-261ea5ce-ca81-4b11-ba86-d0f58a8ca8cc tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] <== disconnect_volume: return (403ms) None {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 15:38:24 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-261ea5ce-ca81-4b11-ba86-d0f58a8ca8cc tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] [instance: d66443a2-2dc1-46f6-9572-f0717f830927] Disconnected iSCSI Volume {{(pid=72382) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 15:38:24 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-3bd45d1e-2095-4ca5-9e52-6f0536ea6d9f tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/92bc25e5f2690987729e59abf1455719f9df9668 --force-share --output=json" returned: 0 in 0.139s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:38:24 user nova-compute[72382]: DEBUG nova.virt.disk.api [None req-3bd45d1e-2095-4ca5-9e52-6f0536ea6d9f tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7949b7d0-2712-402f-86ee-30acaef2d3e7/disk. size=1073741824 {{(pid=72382) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 15:38:24 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-3bd45d1e-2095-4ca5-9e52-6f0536ea6d9f tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7949b7d0-2712-402f-86ee-30acaef2d3e7/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:38:24 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-3bd45d1e-2095-4ca5-9e52-6f0536ea6d9f tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7949b7d0-2712-402f-86ee-30acaef2d3e7/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:38:24 user nova-compute[72382]: DEBUG nova.virt.disk.api [None req-3bd45d1e-2095-4ca5-9e52-6f0536ea6d9f tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Cannot resize image /opt/stack/data/nova/instances/7949b7d0-2712-402f-86ee-30acaef2d3e7/disk to a smaller size. {{(pid=72382) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 15:38:24 user nova-compute[72382]: DEBUG nova.objects.instance [None req-3bd45d1e-2095-4ca5-9e52-6f0536ea6d9f tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Lazy-loading 'migration_context' on Instance uuid 7949b7d0-2712-402f-86ee-30acaef2d3e7 {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:38:24 user nova-compute[72382]: DEBUG nova.virt.libvirt.vif [None req-3bd45d1e-2095-4ca5-9e52-6f0536ea6d9f tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T15:35:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1437781387',display_name='tempest-TestMinimumBasicScenario-server-1437781387',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1437781387',id=40,image_ref='cc9c1e6c-3869-41a3-8884-92bc10fd88dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE7fZdqwv14TbpkokOGrZLxteONCsQhHwHtSkm0iehxIvEwr8CDGRfFb4MKI0stgbdIk1yccqk1l+GgnPmgswjQ9PIPDbFPc3f6proZobtF+S6ZVWml9M9bSSrAd7AGo5w==',key_name='tempest-TestMinimumBasicScenario-63485549',keypairs=<?>,launch_index=0,launched_at=2023-08-09T15:36:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='93c87775443b4abd987197c4b46693bc',ramdisk_id='',reservation_id='r-oo0ozxn0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cc9c1e6c-3869-41a3-8884-92bc10fd88dd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-389394165',owner_user_name='tempest-TestMinimumBasicScenario-389394165-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T15:38:20Z,user_data=None,user_id='12ac8eca784e480d86c8fff801e73d2d',uuid=7949b7d0-2712-402f-86ee-30acaef2d3e7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bf6ac419-c6ba-4f01-b35a-4fa5e58913be", "address": "fa:16:3e:26:fd:d1", "network": {"id": "8d929426-09f7-49b5-a79e-711e20e00750", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1307802727-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.154", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93c87775443b4abd987197c4b46693bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf6ac419-c6", "ovs_interfaceid": "bf6ac419-c6ba-4f01-b35a-4fa5e58913be", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 15:38:24 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-3bd45d1e-2095-4ca5-9e52-6f0536ea6d9f tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Converting VIF {"id": "bf6ac419-c6ba-4f01-b35a-4fa5e58913be", "address": "fa:16:3e:26:fd:d1", "network": {"id": "8d929426-09f7-49b5-a79e-711e20e00750", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1307802727-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.154", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93c87775443b4abd987197c4b46693bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf6ac419-c6", "ovs_interfaceid": "bf6ac419-c6ba-4f01-b35a-4fa5e58913be", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 15:38:24 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-3bd45d1e-2095-4ca5-9e52-6f0536ea6d9f tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:26:fd:d1,bridge_name='br-int',has_traffic_filtering=True,id=bf6ac419-c6ba-4f01-b35a-4fa5e58913be,network=Network(8d929426-09f7-49b5-a79e-711e20e00750),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf6ac419-c6') {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 15:38:24 user nova-compute[72382]: DEBUG os_vif [None req-3bd45d1e-2095-4ca5-9e52-6f0536ea6d9f tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:26:fd:d1,bridge_name='br-int',has_traffic_filtering=True,id=bf6ac419-c6ba-4f01-b35a-4fa5e58913be,network=Network(8d929426-09f7-49b5-a79e-711e20e00750),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf6ac419-c6') {{(pid=72382) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 15:38:24 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:38:24 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:38:24 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 15:38:24 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:38:24 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbf6ac419-c6, may_exist=True, interface_attrs={}) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:38:24 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapbf6ac419-c6, col_values=(('external_ids', {'iface-id': 'bf6ac419-c6ba-4f01-b35a-4fa5e58913be', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:26:fd:d1', 'vm-uuid': '7949b7d0-2712-402f-86ee-30acaef2d3e7'}),), if_exists=True) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:38:24 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:38:24 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:38:24 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:38:24 user nova-compute[72382]: INFO os_vif [None req-3bd45d1e-2095-4ca5-9e52-6f0536ea6d9f tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:26:fd:d1,bridge_name='br-int',has_traffic_filtering=True,id=bf6ac419-c6ba-4f01-b35a-4fa5e58913be,network=Network(8d929426-09f7-49b5-a79e-711e20e00750),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf6ac419-c6')
Aug 09 15:38:24 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:38:25 user nova-compute[72382]: DEBUG nova.objects.instance [None req-261ea5ce-ca81-4b11-ba86-d0f58a8ca8cc tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Lazy-loading 'flavor' on Instance uuid d66443a2-2dc1-46f6-9572-f0717f830927 {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:38:25 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-261ea5ce-ca81-4b11-ba86-d0f58a8ca8cc tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Lock "d66443a2-2dc1-46f6-9572-f0717f830927" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.046s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:38:25 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-7ba59352-2ab5-4059-bc71-7eec77694a35 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Acquiring lock "d66443a2-2dc1-46f6-9572-f0717f830927" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:38:25 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-7ba59352-2ab5-4059-bc71-7eec77694a35 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Lock "d66443a2-2dc1-46f6-9572-f0717f830927" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:38:25 user nova-compute[72382]: INFO nova.compute.manager [None req-7ba59352-2ab5-4059-bc71-7eec77694a35 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] [instance: d66443a2-2dc1-46f6-9572-f0717f830927] Detaching volume 34d84af2-674d-428b-ba0e-5759ed077c26
Aug 09 15:38:25 user nova-compute[72382]: INFO nova.virt.block_device [None req-7ba59352-2ab5-4059-bc71-7eec77694a35 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] [instance: d66443a2-2dc1-46f6-9572-f0717f830927] Attempting to driver detach volume 34d84af2-674d-428b-ba0e-5759ed077c26 from mountpoint /dev/vdc
Aug 09 15:38:25 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-7ba59352-2ab5-4059-bc71-7eec77694a35 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Attempting to detach device vdc from instance d66443a2-2dc1-46f6-9572-f0717f830927 from the persistent domain config. {{(pid=72382) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 15:38:25 user nova-compute[72382]: DEBUG nova.virt.libvirt.guest [None req-7ba59352-2ab5-4059-bc71-7eec77694a35 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 15:38:25 user nova-compute[72382]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 15:38:25 user nova-compute[72382]:   <source dev="/dev/sdf"/>
Aug 09 15:38:25 user nova-compute[72382]:   <target dev="vdc" bus="virtio"/>
Aug 09 15:38:25 user nova-compute[72382]:   <serial>34d84af2-674d-428b-ba0e-5759ed077c26</serial>
Aug 09 15:38:25 user nova-compute[72382]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 09 15:38:25 user nova-compute[72382]: </disk>
Aug 09 15:38:25 user nova-compute[72382]:  {{(pid=72382) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 15:38:25 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-7ba59352-2ab5-4059-bc71-7eec77694a35 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Successfully detached device vdc from instance d66443a2-2dc1-46f6-9572-f0717f830927 from the persistent domain config.
Aug 09 15:38:25 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-7ba59352-2ab5-4059-bc71-7eec77694a35 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance d66443a2-2dc1-46f6-9572-f0717f830927 from the live domain config. {{(pid=72382) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 15:38:25 user nova-compute[72382]: DEBUG nova.virt.libvirt.guest [None req-7ba59352-2ab5-4059-bc71-7eec77694a35 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 15:38:25 user nova-compute[72382]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 15:38:25 user nova-compute[72382]:   <source dev="/dev/sdf"/>
Aug 09 15:38:25 user nova-compute[72382]:   <target dev="vdc" bus="virtio"/>
Aug 09 15:38:25 user nova-compute[72382]:   <serial>34d84af2-674d-428b-ba0e-5759ed077c26</serial>
Aug 09 15:38:25 user nova-compute[72382]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 09 15:38:25 user nova-compute[72382]: </disk>
Aug 09 15:38:25 user nova-compute[72382]:  {{(pid=72382) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 15:38:26 user nova-compute[72382]: DEBUG nova.compute.manager [req-9f9c180b-7cd9-4e14-8cb0-6132dd6b4db0 req-273161c8-4b8c-4c61-8dc2-2861db3560d2 service nova] [instance: c88a5ff2-9789-4ee8-8283-6248bba6d66a] Received event network-vif-plugged-4f9e0eae-81c7-4a91-8ac1-51459e231532 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:38:26 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-9f9c180b-7cd9-4e14-8cb0-6132dd6b4db0 req-273161c8-4b8c-4c61-8dc2-2861db3560d2 service nova] Acquiring lock "c88a5ff2-9789-4ee8-8283-6248bba6d66a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:38:26 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-9f9c180b-7cd9-4e14-8cb0-6132dd6b4db0 req-273161c8-4b8c-4c61-8dc2-2861db3560d2 service nova] Lock "c88a5ff2-9789-4ee8-8283-6248bba6d66a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:38:26 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-9f9c180b-7cd9-4e14-8cb0-6132dd6b4db0 req-273161c8-4b8c-4c61-8dc2-2861db3560d2 service nova] Lock "c88a5ff2-9789-4ee8-8283-6248bba6d66a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:38:26 user nova-compute[72382]: DEBUG nova.compute.manager [req-9f9c180b-7cd9-4e14-8cb0-6132dd6b4db0 req-273161c8-4b8c-4c61-8dc2-2861db3560d2 service nova] [instance: c88a5ff2-9789-4ee8-8283-6248bba6d66a] No waiting events found dispatching network-vif-plugged-4f9e0eae-81c7-4a91-8ac1-51459e231532 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:38:26 user nova-compute[72382]: WARNING nova.compute.manager [req-9f9c180b-7cd9-4e14-8cb0-6132dd6b4db0 req-273161c8-4b8c-4c61-8dc2-2861db3560d2 service nova] [instance: c88a5ff2-9789-4ee8-8283-6248bba6d66a] Received unexpected event network-vif-plugged-4f9e0eae-81c7-4a91-8ac1-51459e231532 for instance with vm_state shelved_offloaded and task_state spawning.
Aug 09 15:38:26 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:38:26 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:38:26 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:38:26 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:38:26 user nova-compute[72382]: DEBUG nova.virt.driver [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Emitting event <LifecycleEvent: 1691595506.4557424, c88a5ff2-9789-4ee8-8283-6248bba6d66a => Resumed> {{(pid=72382) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 15:38:26 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: c88a5ff2-9789-4ee8-8283-6248bba6d66a] VM Resumed (Lifecycle Event)
Aug 09 15:38:26 user nova-compute[72382]: DEBUG nova.compute.manager [None req-7813323f-510a-4504-a7df-c7e49447d98f tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] [instance: c88a5ff2-9789-4ee8-8283-6248bba6d66a] Instance event wait completed in 0 seconds for  {{(pid=72382) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 15:38:26 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-7813323f-510a-4504-a7df-c7e49447d98f tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] [instance: c88a5ff2-9789-4ee8-8283-6248bba6d66a] Guest created on hypervisor {{(pid=72382) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 15:38:26 user nova-compute[72382]: INFO nova.virt.libvirt.driver [-] [instance: c88a5ff2-9789-4ee8-8283-6248bba6d66a] Instance spawned successfully.
Aug 09 15:38:26 user nova-compute[72382]: DEBUG nova.compute.manager [None req-7813323f-510a-4504-a7df-c7e49447d98f tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] [instance: c88a5ff2-9789-4ee8-8283-6248bba6d66a] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:38:26 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: c88a5ff2-9789-4ee8-8283-6248bba6d66a] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:38:26 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-7ba59352-2ab5-4059-bc71-7eec77694a35 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance d66443a2-2dc1-46f6-9572-f0717f830927 {{(pid=72382) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 15:38:26 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: c88a5ff2-9789-4ee8-8283-6248bba6d66a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=72382) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 15:38:26 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: c88a5ff2-9789-4ee8-8283-6248bba6d66a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 15:38:26 user nova-compute[72382]: DEBUG nova.virt.driver [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Emitting event <LifecycleEvent: 1691595506.4559135, c88a5ff2-9789-4ee8-8283-6248bba6d66a => Started> {{(pid=72382) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 15:38:26 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: c88a5ff2-9789-4ee8-8283-6248bba6d66a] VM Started (Lifecycle Event)
Aug 09 15:38:26 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: c88a5ff2-9789-4ee8-8283-6248bba6d66a] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:38:26 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: c88a5ff2-9789-4ee8-8283-6248bba6d66a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=72382) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 15:38:26 user nova-compute[72382]: DEBUG nova.compute.manager [req-bd654b19-1237-465a-b8ca-eb94faf9765f req-725203fe-8895-4591-b911-2f270b70d5a0 service nova] [instance: 7949b7d0-2712-402f-86ee-30acaef2d3e7] Received event network-vif-plugged-bf6ac419-c6ba-4f01-b35a-4fa5e58913be {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:38:26 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-bd654b19-1237-465a-b8ca-eb94faf9765f req-725203fe-8895-4591-b911-2f270b70d5a0 service nova] Acquiring lock "7949b7d0-2712-402f-86ee-30acaef2d3e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:38:26 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-bd654b19-1237-465a-b8ca-eb94faf9765f req-725203fe-8895-4591-b911-2f270b70d5a0 service nova] Lock "7949b7d0-2712-402f-86ee-30acaef2d3e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:38:26 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-bd654b19-1237-465a-b8ca-eb94faf9765f req-725203fe-8895-4591-b911-2f270b70d5a0 service nova] Lock "7949b7d0-2712-402f-86ee-30acaef2d3e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:38:26 user nova-compute[72382]: DEBUG nova.compute.manager [req-bd654b19-1237-465a-b8ca-eb94faf9765f req-725203fe-8895-4591-b911-2f270b70d5a0 service nova] [instance: 7949b7d0-2712-402f-86ee-30acaef2d3e7] No waiting events found dispatching network-vif-plugged-bf6ac419-c6ba-4f01-b35a-4fa5e58913be {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:38:26 user nova-compute[72382]: WARNING nova.compute.manager [req-bd654b19-1237-465a-b8ca-eb94faf9765f req-725203fe-8895-4591-b911-2f270b70d5a0 service nova] [instance: 7949b7d0-2712-402f-86ee-30acaef2d3e7] Received unexpected event network-vif-plugged-bf6ac419-c6ba-4f01-b35a-4fa5e58913be for instance with vm_state active and task_state reboot_started_hard.
Aug 09 15:38:26 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-7813323f-510a-4504-a7df-c7e49447d98f tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] Lock "c88a5ff2-9789-4ee8-8283-6248bba6d66a" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 18.514s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:38:26 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Received event <DeviceRemovedEvent: 1691595506.4705875, d66443a2-2dc1-46f6-9572-f0717f830927 => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=72382) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 15:38:26 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-7ba59352-2ab5-4059-bc71-7eec77694a35 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Successfully detached device vdc from instance d66443a2-2dc1-46f6-9572-f0717f830927 from the live domain config.
Aug 09 15:38:26 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7ba59352-2ab5-4059-bc71-7eec77694a35 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] [instance: d66443a2-2dc1-46f6-9572-f0717f830927] calling os-brick to detach iSCSI Volume {{(pid=72382) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 15:38:26 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ba59352-2ab5-4059-bc71-7eec77694a35 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2a0c768340>, {'target_iqns': ['iqn.2010-10.org.openstack:34d84af2-674d-428b-ba0e-5759ed077c26'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xcISTdfm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 15:38:26 user nova-compute[72382]: WARNING os_brick.initiator.connectors.base [None req-7ba59352-2ab5-4059-bc71-7eec77694a35 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 15:38:26 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-7ba59352-2ab5-4059-bc71-7eec77694a35 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 15:38:26 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-7ba59352-2ab5-4059-bc71-7eec77694a35 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 15:38:26 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ba59352-2ab5-4059-bc71-7eec77694a35 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:34d84af2-674d-428b-ba0e-5759ed077c26', 0)] {{(pid=72382) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 15:38:26 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:38:26 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:38:26 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[47f29537-285e-42a4-a8c5-5b6b92e24153]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:170d7509-0928-4a87-9d9f-437977452501\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:34d84af2-674d-428b-ba0e-5759ed077c26\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3f58579c-f69a-4bee-b16e-970e5a8f590c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a0a612d6-0f3f-4d2c-9fb5-aff9384338de\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d2f5dbb5-f862-4389-b42a-872d5c94aa55\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:38:26 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:38:26 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:38:26 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dac99c5-3699-4abd-ad5b-1ec04f3aa0a7]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f58579c-f69a-4bee-b16e-970e5a8f590c (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0a612d6-0f3f-4d2c-9fb5-aff9384338de (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34d84af2-674d-428b-ba0e-5759ed077c26 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2f5dbb5-f862-4389-b42a-872d5c94aa55 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:170d7509-0928-4a87-9d9f-437977452501 (non-flash)\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:38:26 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ba59352-2ab5-4059-bc71-7eec77694a35 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f58579c-f69a-4bee-b16e-970e5a8f590c (non-flash)
Aug 09 15:38:26 user nova-compute[72382]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0a612d6-0f3f-4d2c-9fb5-aff9384338de (non-flash)
Aug 09 15:38:26 user nova-compute[72382]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34d84af2-674d-428b-ba0e-5759ed077c26 (non-flash)
Aug 09 15:38:26 user nova-compute[72382]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2f5dbb5-f862-4389-b42a-872d5c94aa55 (non-flash)
Aug 09 15:38:26 user nova-compute[72382]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:170d7509-0928-4a87-9d9f-437977452501 (non-flash)
Aug 09 15:38:26 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 15:38:26 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ba59352-2ab5-4059-bc71-7eec77694a35 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f58579c-f69a-4bee-b16e-970e5a8f590c (non-flash)
Aug 09 15:38:26 user nova-compute[72382]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0a612d6-0f3f-4d2c-9fb5-aff9384338de (non-flash)
Aug 09 15:38:26 user nova-compute[72382]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34d84af2-674d-428b-ba0e-5759ed077c26 (non-flash)
Aug 09 15:38:26 user nova-compute[72382]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2f5dbb5-f862-4389-b42a-872d5c94aa55 (non-flash)
Aug 09 15:38:26 user nova-compute[72382]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:170d7509-0928-4a87-9d9f-437977452501 (non-flash)
Aug 09 15:38:26 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 15:38:26 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ba59352-2ab5-4059-bc71-7eec77694a35 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2a0c1c6830>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:34d84af2-674d-428b-ba0e-5759ed077c26'): ({'sdf'}, set())}) {{(pid=72382) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 15:38:26 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-7ba59352-2ab5-4059-bc71-7eec77694a35 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Removing single pathed devices sdf {{(pid=72382) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 15:38:26 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:38:26 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.031s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:38:26 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec28995c-3be7-463f-9b24-5ac0a52e8cf2]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:38:26 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:38:26 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.025s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:38:26 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e17319b-03a8-4de4-a1aa-75f58245bf91]: (4, ('ok\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:38:26 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-7ba59352-2ab5-4059-bc71-7eec77694a35 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Flushing IO for device /dev/sdf {{(pid=72382) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 15:38:26 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:38:26 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.015s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:38:26 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee72469c-87e1-4e0f-8109-54c0175cd68d]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:38:26 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-7ba59352-2ab5-4059-bc71-7eec77694a35 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=72382) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 15:38:26 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:38:26 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.056s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:38:26 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[f051a308-48d4-48df-ba9f-1378e5fb86b8]: (4, ('1', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:38:26 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-7ba59352-2ab5-4059-bc71-7eec77694a35 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=72382) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 15:38:26 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-7ba59352-2ab5-4059-bc71-7eec77694a35 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] SCSI volumes sdf have been removed. {{(pid=72382) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 15:38:26 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ba59352-2ab5-4059-bc71-7eec77694a35 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:34d84af2-674d-428b-ba0e-5759ed077c26')] {{(pid=72382) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 15:38:26 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:34d84af2-674d-428b-ba0e-5759ed077c26 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:38:26 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:34d84af2-674d-428b-ba0e-5759ed077c26 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:38:26 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[3aa975f9-4e02-44d9-a31f-8ee3bb63d1de]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:38:26 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ba59352-2ab5-4059-bc71-7eec77694a35 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:38:26 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:34d84af2-674d-428b-ba0e-5759ed077c26 -p 172.16.0.220:3260 --logout {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:38:27 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:34d84af2-674d-428b-ba0e-5759ed077c26 -p 172.16.0.220:3260 --logout" returned: 0 in 0.095s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:38:27 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb65c187-5390-49e4-9be1-1c1d759789a2]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:34d84af2-674d-428b-ba0e-5759ed077c26, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:34d84af2-674d-428b-ba0e-5759ed077c26, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:38:27 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ba59352-2ab5-4059-bc71-7eec77694a35 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:34d84af2-674d-428b-ba0e-5759ed077c26, portal: 172.16.0.220,3260]
Aug 09 15:38:27 user nova-compute[72382]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:34d84af2-674d-428b-ba0e-5759ed077c26, portal: 172.16.0.220,3260] successful.
Aug 09 15:38:27 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:38:27 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:34d84af2-674d-428b-ba0e-5759ed077c26 -p 172.16.0.220:3260 --op delete {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:38:27 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:34d84af2-674d-428b-ba0e-5759ed077c26 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:38:27 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[af2a2dad-2913-4ef3-bab1-66469c0031bc]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:38:27 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ba59352-2ab5-4059-bc71-7eec77694a35 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:38:27 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-7ba59352-2ab5-4059-bc71-7eec77694a35 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.392s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 15:38:27 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ba59352-2ab5-4059-bc71-7eec77694a35 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] <== disconnect_volume: return (394ms) None {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 15:38:27 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7ba59352-2ab5-4059-bc71-7eec77694a35 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] [instance: d66443a2-2dc1-46f6-9572-f0717f830927] Disconnected iSCSI Volume {{(pid=72382) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 15:38:27 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:38:27 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:38:27 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:38:27 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:38:27 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:38:27 user nova-compute[72382]: DEBUG nova.objects.instance [None req-7ba59352-2ab5-4059-bc71-7eec77694a35 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Lazy-loading 'flavor' on Instance uuid d66443a2-2dc1-46f6-9572-f0717f830927 {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:38:27 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-7ba59352-2ab5-4059-bc71-7eec77694a35 tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Lock "d66443a2-2dc1-46f6-9572-f0717f830927" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.227s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:38:28 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-68f73b1b-49a0-4e77-bd22-a4f1f3d182cb tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Acquiring lock "d66443a2-2dc1-46f6-9572-f0717f830927" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:38:28 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-68f73b1b-49a0-4e77-bd22-a4f1f3d182cb tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Lock "d66443a2-2dc1-46f6-9572-f0717f830927" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:38:28 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-68f73b1b-49a0-4e77-bd22-a4f1f3d182cb tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Acquiring lock "d66443a2-2dc1-46f6-9572-f0717f830927-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:38:28 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-68f73b1b-49a0-4e77-bd22-a4f1f3d182cb tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Lock "d66443a2-2dc1-46f6-9572-f0717f830927-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:38:28 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-68f73b1b-49a0-4e77-bd22-a4f1f3d182cb tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Lock "d66443a2-2dc1-46f6-9572-f0717f830927-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:38:28 user nova-compute[72382]: INFO nova.compute.manager [None req-68f73b1b-49a0-4e77-bd22-a4f1f3d182cb tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] [instance: d66443a2-2dc1-46f6-9572-f0717f830927] Terminating instance
Aug 09 15:38:28 user nova-compute[72382]: DEBUG nova.compute.manager [None req-68f73b1b-49a0-4e77-bd22-a4f1f3d182cb tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] [instance: d66443a2-2dc1-46f6-9572-f0717f830927] Start destroying the instance on the hypervisor. {{(pid=72382) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 15:38:28 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:38:28 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:38:28 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:38:28 user nova-compute[72382]: DEBUG nova.compute.manager [req-c1ea729f-9705-4dc3-a37f-571ab54eac61 req-51435456-4526-47d9-b788-88e280f81338 service nova] [instance: 7949b7d0-2712-402f-86ee-30acaef2d3e7] Received event network-vif-plugged-bf6ac419-c6ba-4f01-b35a-4fa5e58913be {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:38:28 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-c1ea729f-9705-4dc3-a37f-571ab54eac61 req-51435456-4526-47d9-b788-88e280f81338 service nova] Acquiring lock "7949b7d0-2712-402f-86ee-30acaef2d3e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:38:28 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-c1ea729f-9705-4dc3-a37f-571ab54eac61 req-51435456-4526-47d9-b788-88e280f81338 service nova] Lock "7949b7d0-2712-402f-86ee-30acaef2d3e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:38:28 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-c1ea729f-9705-4dc3-a37f-571ab54eac61 req-51435456-4526-47d9-b788-88e280f81338 service nova] Lock "7949b7d0-2712-402f-86ee-30acaef2d3e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:38:28 user nova-compute[72382]: DEBUG nova.compute.manager [req-c1ea729f-9705-4dc3-a37f-571ab54eac61 req-51435456-4526-47d9-b788-88e280f81338 service nova] [instance: 7949b7d0-2712-402f-86ee-30acaef2d3e7] No waiting events found dispatching network-vif-plugged-bf6ac419-c6ba-4f01-b35a-4fa5e58913be {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:38:28 user nova-compute[72382]: WARNING nova.compute.manager [req-c1ea729f-9705-4dc3-a37f-571ab54eac61 req-51435456-4526-47d9-b788-88e280f81338 service nova] [instance: 7949b7d0-2712-402f-86ee-30acaef2d3e7] Received unexpected event network-vif-plugged-bf6ac419-c6ba-4f01-b35a-4fa5e58913be for instance with vm_state active and task_state reboot_started_hard.
Aug 09 15:38:28 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:38:29 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Removed pending event for 7949b7d0-2712-402f-86ee-30acaef2d3e7 due to event {{(pid=72382) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 09 15:38:29 user nova-compute[72382]: DEBUG nova.virt.driver [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Emitting event <LifecycleEvent: 1691595509.0016427, 7949b7d0-2712-402f-86ee-30acaef2d3e7 => Resumed> {{(pid=72382) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 15:38:29 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 7949b7d0-2712-402f-86ee-30acaef2d3e7] VM Resumed (Lifecycle Event)
Aug 09 15:38:29 user nova-compute[72382]: DEBUG nova.compute.manager [None req-3bd45d1e-2095-4ca5-9e52-6f0536ea6d9f tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] [instance: 7949b7d0-2712-402f-86ee-30acaef2d3e7] Instance event wait completed in 0 seconds for  {{(pid=72382) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 15:38:29 user nova-compute[72382]: INFO nova.virt.libvirt.driver [-] [instance: 7949b7d0-2712-402f-86ee-30acaef2d3e7] Instance rebooted successfully.
Aug 09 15:38:29 user nova-compute[72382]: DEBUG nova.compute.manager [None req-3bd45d1e-2095-4ca5-9e52-6f0536ea6d9f tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] [instance: 7949b7d0-2712-402f-86ee-30acaef2d3e7] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:38:29 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 7949b7d0-2712-402f-86ee-30acaef2d3e7] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:38:29 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 7949b7d0-2712-402f-86ee-30acaef2d3e7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=72382) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 15:38:29 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 7949b7d0-2712-402f-86ee-30acaef2d3e7] During sync_power_state the instance has a pending task (reboot_started_hard). Skip.
Aug 09 15:38:29 user nova-compute[72382]: DEBUG nova.virt.driver [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Emitting event <LifecycleEvent: 1691595509.0062308, 7949b7d0-2712-402f-86ee-30acaef2d3e7 => Started> {{(pid=72382) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 15:38:29 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 7949b7d0-2712-402f-86ee-30acaef2d3e7] VM Started (Lifecycle Event)
Aug 09 15:38:29 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 7949b7d0-2712-402f-86ee-30acaef2d3e7] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:38:29 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 7949b7d0-2712-402f-86ee-30acaef2d3e7] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=72382) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 15:38:29 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 7949b7d0-2712-402f-86ee-30acaef2d3e7] During sync_power_state the instance has a pending task (reboot_started_hard). Skip.
Aug 09 15:38:29 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-3bd45d1e-2095-4ca5-9e52-6f0536ea6d9f tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Lock "7949b7d0-2712-402f-86ee-30acaef2d3e7" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 10.386s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:38:29 user nova-compute[72382]: DEBUG nova.compute.manager [req-1db7b053-94d3-4733-88b1-236734792936 req-1b25d717-8433-422c-bd4a-87f554faf4c4 service nova] [instance: d66443a2-2dc1-46f6-9572-f0717f830927] Received event network-vif-unplugged-49ab3b4d-3d4b-41a6-bd6f-a1c1567ca7bd {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:38:29 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-1db7b053-94d3-4733-88b1-236734792936 req-1b25d717-8433-422c-bd4a-87f554faf4c4 service nova] Acquiring lock "d66443a2-2dc1-46f6-9572-f0717f830927-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:38:29 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-1db7b053-94d3-4733-88b1-236734792936 req-1b25d717-8433-422c-bd4a-87f554faf4c4 service nova] Lock "d66443a2-2dc1-46f6-9572-f0717f830927-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:38:29 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-1db7b053-94d3-4733-88b1-236734792936 req-1b25d717-8433-422c-bd4a-87f554faf4c4 service nova] Lock "d66443a2-2dc1-46f6-9572-f0717f830927-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:38:29 user nova-compute[72382]: DEBUG nova.compute.manager [req-1db7b053-94d3-4733-88b1-236734792936 req-1b25d717-8433-422c-bd4a-87f554faf4c4 service nova] [instance: d66443a2-2dc1-46f6-9572-f0717f830927] No waiting events found dispatching network-vif-unplugged-49ab3b4d-3d4b-41a6-bd6f-a1c1567ca7bd {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:38:29 user nova-compute[72382]: DEBUG nova.compute.manager [req-1db7b053-94d3-4733-88b1-236734792936 req-1b25d717-8433-422c-bd4a-87f554faf4c4 service nova] [instance: d66443a2-2dc1-46f6-9572-f0717f830927] Received event network-vif-unplugged-49ab3b4d-3d4b-41a6-bd6f-a1c1567ca7bd for instance with task_state deleting. {{(pid=72382) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 15:38:29 user nova-compute[72382]: INFO nova.virt.libvirt.driver [-] [instance: d66443a2-2dc1-46f6-9572-f0717f830927] Instance destroyed successfully.
Aug 09 15:38:29 user nova-compute[72382]: DEBUG nova.objects.instance [None req-68f73b1b-49a0-4e77-bd22-a4f1f3d182cb tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Lazy-loading 'resources' on Instance uuid d66443a2-2dc1-46f6-9572-f0717f830927 {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:38:29 user nova-compute[72382]: DEBUG nova.virt.libvirt.vif [None req-68f73b1b-49a0-4e77-bd22-a4f1f3d182cb tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T15:35:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1518587981',display_name='tempest-AttachVolumeTestJSON-server-1518587981',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1518587981',id=41,image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFdQaTnwnCVHk2ncC2uzyyfntHgY9kXYhsLJgEtQF4ih89XcG3fIJjKm0SGVQ51cVXX303KNnKW2jM0/vkRCAkoT48ShAsYx4mOluignojAPzQ+x4HPMNlFbEplwifLCIQ==',key_name='tempest-keypair-1834267699',keypairs=<?>,launch_index=0,launched_at=2023-08-09T15:36:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8c1a50eacfd0414bbc13e3fd4087e998',ramdisk_id='',reservation_id='r-syev47lw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-502043064',owner_user_name='tempest-AttachVolumeTestJSON-502043064-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T15:36:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='13c67153e9ec44029e8d80c09d405175',uuid=d66443a2-2dc1-46f6-9572-f0717f830927,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "49ab3b4d-3d4b-41a6-bd6f-a1c1567ca7bd", "address": "fa:16:3e:5a:e8:fb", "network": {"id": "a85a6e1f-20f5-4719-90d2-0dc23ce525cd", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-780716970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.79", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c1a50eacfd0414bbc13e3fd4087e998", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49ab3b4d-3d", "ovs_interfaceid": "49ab3b4d-3d4b-41a6-bd6f-a1c1567ca7bd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 15:38:29 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-68f73b1b-49a0-4e77-bd22-a4f1f3d182cb tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Converting VIF {"id": "49ab3b4d-3d4b-41a6-bd6f-a1c1567ca7bd", "address": "fa:16:3e:5a:e8:fb", "network": {"id": "a85a6e1f-20f5-4719-90d2-0dc23ce525cd", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-780716970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.79", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c1a50eacfd0414bbc13e3fd4087e998", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49ab3b4d-3d", "ovs_interfaceid": "49ab3b4d-3d4b-41a6-bd6f-a1c1567ca7bd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 15:38:29 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-68f73b1b-49a0-4e77-bd22-a4f1f3d182cb tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5a:e8:fb,bridge_name='br-int',has_traffic_filtering=True,id=49ab3b4d-3d4b-41a6-bd6f-a1c1567ca7bd,network=Network(a85a6e1f-20f5-4719-90d2-0dc23ce525cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49ab3b4d-3d') {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 15:38:29 user nova-compute[72382]: DEBUG os_vif [None req-68f73b1b-49a0-4e77-bd22-a4f1f3d182cb tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5a:e8:fb,bridge_name='br-int',has_traffic_filtering=True,id=49ab3b4d-3d4b-41a6-bd6f-a1c1567ca7bd,network=Network(a85a6e1f-20f5-4719-90d2-0dc23ce525cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49ab3b4d-3d') {{(pid=72382) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 15:38:29 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:38:29 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap49ab3b4d-3d, bridge=br-int, if_exists=True) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:38:29 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:38:29 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:38:29 user nova-compute[72382]: INFO os_vif [None req-68f73b1b-49a0-4e77-bd22-a4f1f3d182cb tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5a:e8:fb,bridge_name='br-int',has_traffic_filtering=True,id=49ab3b4d-3d4b-41a6-bd6f-a1c1567ca7bd,network=Network(a85a6e1f-20f5-4719-90d2-0dc23ce525cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49ab3b4d-3d')
Aug 09 15:38:29 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-68f73b1b-49a0-4e77-bd22-a4f1f3d182cb tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] [instance: d66443a2-2dc1-46f6-9572-f0717f830927] Deleting instance files /opt/stack/data/nova/instances/d66443a2-2dc1-46f6-9572-f0717f830927_del
Aug 09 15:38:29 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-68f73b1b-49a0-4e77-bd22-a4f1f3d182cb tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] [instance: d66443a2-2dc1-46f6-9572-f0717f830927] Deletion of /opt/stack/data/nova/instances/d66443a2-2dc1-46f6-9572-f0717f830927_del complete
Aug 09 15:38:29 user nova-compute[72382]: INFO nova.compute.manager [None req-68f73b1b-49a0-4e77-bd22-a4f1f3d182cb tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] [instance: d66443a2-2dc1-46f6-9572-f0717f830927] Took 0.95 seconds to destroy the instance on the hypervisor.
Aug 09 15:38:29 user nova-compute[72382]: DEBUG oslo.service.loopingcall [None req-68f73b1b-49a0-4e77-bd22-a4f1f3d182cb tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72382) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 15:38:29 user nova-compute[72382]: DEBUG nova.compute.manager [-] [instance: d66443a2-2dc1-46f6-9572-f0717f830927] Deallocating network for instance {{(pid=72382) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 15:38:29 user nova-compute[72382]: DEBUG nova.network.neutron [-] [instance: d66443a2-2dc1-46f6-9572-f0717f830927] deallocate_for_instance() {{(pid=72382) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 15:38:29 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:38:30 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:38:30 user nova-compute[72382]: DEBUG nova.network.neutron [-] [instance: d66443a2-2dc1-46f6-9572-f0717f830927] Updating instance_info_cache with network_info: [] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:38:30 user nova-compute[72382]: INFO nova.compute.manager [-] [instance: d66443a2-2dc1-46f6-9572-f0717f830927] Took 1.40 seconds to deallocate network for instance.
Aug 09 15:38:30 user nova-compute[72382]: DEBUG nova.compute.manager [req-aae15ed1-b71e-46e0-afef-afd1e8444fee req-b5da26cc-d2de-4eeb-9adc-dc131e58362f service nova] [instance: d66443a2-2dc1-46f6-9572-f0717f830927] Received event network-vif-deleted-49ab3b4d-3d4b-41a6-bd6f-a1c1567ca7bd {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:38:30 user nova-compute[72382]: INFO nova.compute.manager [req-aae15ed1-b71e-46e0-afef-afd1e8444fee req-b5da26cc-d2de-4eeb-9adc-dc131e58362f service nova] [instance: d66443a2-2dc1-46f6-9572-f0717f830927] Neutron deleted interface 49ab3b4d-3d4b-41a6-bd6f-a1c1567ca7bd; detaching it from the instance and deleting it from the info cache
Aug 09 15:38:30 user nova-compute[72382]: DEBUG nova.network.neutron [req-aae15ed1-b71e-46e0-afef-afd1e8444fee req-b5da26cc-d2de-4eeb-9adc-dc131e58362f service nova] [instance: d66443a2-2dc1-46f6-9572-f0717f830927] Updating instance_info_cache with network_info: [] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:38:30 user nova-compute[72382]: DEBUG nova.compute.manager [req-aae15ed1-b71e-46e0-afef-afd1e8444fee req-b5da26cc-d2de-4eeb-9adc-dc131e58362f service nova] [instance: d66443a2-2dc1-46f6-9572-f0717f830927] Detach interface failed, port_id=49ab3b4d-3d4b-41a6-bd6f-a1c1567ca7bd, reason: Instance d66443a2-2dc1-46f6-9572-f0717f830927 could not be found. {{(pid=72382) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 09 15:38:31 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-68f73b1b-49a0-4e77-bd22-a4f1f3d182cb tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:38:31 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-68f73b1b-49a0-4e77-bd22-a4f1f3d182cb tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:38:31 user nova-compute[72382]: DEBUG nova.compute.manager [req-cefdcb5b-6d88-4207-8871-884083f706ba req-382821df-dfe1-4433-b8d2-7f0816e3a5df service nova] [instance: d66443a2-2dc1-46f6-9572-f0717f830927] Received event network-vif-plugged-49ab3b4d-3d4b-41a6-bd6f-a1c1567ca7bd {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:38:31 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-cefdcb5b-6d88-4207-8871-884083f706ba req-382821df-dfe1-4433-b8d2-7f0816e3a5df service nova] Acquiring lock "d66443a2-2dc1-46f6-9572-f0717f830927-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:38:31 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-cefdcb5b-6d88-4207-8871-884083f706ba req-382821df-dfe1-4433-b8d2-7f0816e3a5df service nova] Lock "d66443a2-2dc1-46f6-9572-f0717f830927-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:38:31 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-cefdcb5b-6d88-4207-8871-884083f706ba req-382821df-dfe1-4433-b8d2-7f0816e3a5df service nova] Lock "d66443a2-2dc1-46f6-9572-f0717f830927-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:38:31 user nova-compute[72382]: DEBUG nova.compute.manager [req-cefdcb5b-6d88-4207-8871-884083f706ba req-382821df-dfe1-4433-b8d2-7f0816e3a5df service nova] [instance: d66443a2-2dc1-46f6-9572-f0717f830927] No waiting events found dispatching network-vif-plugged-49ab3b4d-3d4b-41a6-bd6f-a1c1567ca7bd {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:38:31 user nova-compute[72382]: WARNING nova.compute.manager [req-cefdcb5b-6d88-4207-8871-884083f706ba req-382821df-dfe1-4433-b8d2-7f0816e3a5df service nova] [instance: d66443a2-2dc1-46f6-9572-f0717f830927] Received unexpected event network-vif-plugged-49ab3b4d-3d4b-41a6-bd6f-a1c1567ca7bd for instance with vm_state deleted and task_state None.
Aug 09 15:38:31 user nova-compute[72382]: DEBUG nova.compute.provider_tree [None req-68f73b1b-49a0-4e77-bd22-a4f1f3d182cb tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Inventory has not changed in ProviderTree for provider: 7b15b0e5-df4d-49db-833b-2855d21d10ae {{(pid=72382) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 15:38:31 user nova-compute[72382]: DEBUG nova.scheduler.client.report [None req-68f73b1b-49a0-4e77-bd22-a4f1f3d182cb tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Inventory has not changed for provider 7b15b0e5-df4d-49db-833b-2855d21d10ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72382) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 15:38:31 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-68f73b1b-49a0-4e77-bd22-a4f1f3d182cb tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.356s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:38:31 user nova-compute[72382]: INFO nova.scheduler.client.report [None req-68f73b1b-49a0-4e77-bd22-a4f1f3d182cb tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Deleted allocations for instance d66443a2-2dc1-46f6-9572-f0717f830927
Aug 09 15:38:31 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-68f73b1b-49a0-4e77-bd22-a4f1f3d182cb tempest-AttachVolumeTestJSON-502043064 tempest-AttachVolumeTestJSON-502043064-project-member] Lock "d66443a2-2dc1-46f6-9572-f0717f830927" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.996s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:38:34 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:38:35 user nova-compute[72382]: DEBUG nova.compute.manager [req-73d7b91f-6fc7-48e3-9724-168a431513b7 req-d0f3690a-0e00-49e9-8d42-ffcd98db0316 service nova] [instance: 2158de7a-1e53-450a-80de-a5c56844feba] Received event network-changed-8fc3cbf4-d7ef-434b-a7b5-b611e919b364 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:38:35 user nova-compute[72382]: DEBUG nova.compute.manager [req-73d7b91f-6fc7-48e3-9724-168a431513b7 req-d0f3690a-0e00-49e9-8d42-ffcd98db0316 service nova] [instance: 2158de7a-1e53-450a-80de-a5c56844feba] Refreshing instance network info cache due to event network-changed-8fc3cbf4-d7ef-434b-a7b5-b611e919b364. {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 15:38:35 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-73d7b91f-6fc7-48e3-9724-168a431513b7 req-d0f3690a-0e00-49e9-8d42-ffcd98db0316 service nova] Acquiring lock "refresh_cache-2158de7a-1e53-450a-80de-a5c56844feba" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 15:38:35 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-73d7b91f-6fc7-48e3-9724-168a431513b7 req-d0f3690a-0e00-49e9-8d42-ffcd98db0316 service nova] Acquired lock "refresh_cache-2158de7a-1e53-450a-80de-a5c56844feba" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 15:38:35 user nova-compute[72382]: DEBUG nova.network.neutron [req-73d7b91f-6fc7-48e3-9724-168a431513b7 req-d0f3690a-0e00-49e9-8d42-ffcd98db0316 service nova] [instance: 2158de7a-1e53-450a-80de-a5c56844feba] Refreshing network info cache for port 8fc3cbf4-d7ef-434b-a7b5-b611e919b364 {{(pid=72382) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 15:38:36 user nova-compute[72382]: DEBUG nova.network.neutron [req-73d7b91f-6fc7-48e3-9724-168a431513b7 req-d0f3690a-0e00-49e9-8d42-ffcd98db0316 service nova] [instance: 2158de7a-1e53-450a-80de-a5c56844feba] Updated VIF entry in instance network info cache for port 8fc3cbf4-d7ef-434b-a7b5-b611e919b364. {{(pid=72382) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 15:38:36 user nova-compute[72382]: DEBUG nova.network.neutron [req-73d7b91f-6fc7-48e3-9724-168a431513b7 req-d0f3690a-0e00-49e9-8d42-ffcd98db0316 service nova] [instance: 2158de7a-1e53-450a-80de-a5c56844feba] Updating instance_info_cache with network_info: [{"id": "8fc3cbf4-d7ef-434b-a7b5-b611e919b364", "address": "fa:16:3e:c5:f7:64", "network": {"id": "a78e6cb6-feb7-4f64-a3c0-4900594b6e37", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-338007968-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70310b1af40b4d239fe5ea362972554b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fc3cbf4-d7", "ovs_interfaceid": "8fc3cbf4-d7ef-434b-a7b5-b611e919b364", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:38:36 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-73d7b91f-6fc7-48e3-9724-168a431513b7 req-d0f3690a-0e00-49e9-8d42-ffcd98db0316 service nova] Releasing lock "refresh_cache-2158de7a-1e53-450a-80de-a5c56844feba" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 15:38:36 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-522c017a-2be3-4203-8daa-aaab45062496 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Acquiring lock "2158de7a-1e53-450a-80de-a5c56844feba" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:38:36 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-522c017a-2be3-4203-8daa-aaab45062496 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Lock "2158de7a-1e53-450a-80de-a5c56844feba" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:38:36 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-522c017a-2be3-4203-8daa-aaab45062496 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Acquiring lock "2158de7a-1e53-450a-80de-a5c56844feba-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:38:36 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-522c017a-2be3-4203-8daa-aaab45062496 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Lock "2158de7a-1e53-450a-80de-a5c56844feba-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:38:36 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-522c017a-2be3-4203-8daa-aaab45062496 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Lock "2158de7a-1e53-450a-80de-a5c56844feba-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:38:36 user nova-compute[72382]: INFO nova.compute.manager [None req-522c017a-2be3-4203-8daa-aaab45062496 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: 2158de7a-1e53-450a-80de-a5c56844feba] Terminating instance
Aug 09 15:38:36 user nova-compute[72382]: DEBUG nova.compute.manager [None req-522c017a-2be3-4203-8daa-aaab45062496 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: 2158de7a-1e53-450a-80de-a5c56844feba] Start destroying the instance on the hypervisor. {{(pid=72382) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 15:38:36 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:38:36 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:38:36 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:38:36 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:38:36 user nova-compute[72382]: DEBUG nova.compute.manager [req-8233118c-e314-4a10-8ecd-babc665b27d4 req-2307c29c-55df-496f-96ce-ec638130c225 service nova] [instance: 2158de7a-1e53-450a-80de-a5c56844feba] Received event network-vif-unplugged-8fc3cbf4-d7ef-434b-a7b5-b611e919b364 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:38:36 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-8233118c-e314-4a10-8ecd-babc665b27d4 req-2307c29c-55df-496f-96ce-ec638130c225 service nova] Acquiring lock "2158de7a-1e53-450a-80de-a5c56844feba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:38:36 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-8233118c-e314-4a10-8ecd-babc665b27d4 req-2307c29c-55df-496f-96ce-ec638130c225 service nova] Lock "2158de7a-1e53-450a-80de-a5c56844feba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:38:36 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-8233118c-e314-4a10-8ecd-babc665b27d4 req-2307c29c-55df-496f-96ce-ec638130c225 service nova] Lock "2158de7a-1e53-450a-80de-a5c56844feba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:38:36 user nova-compute[72382]: DEBUG nova.compute.manager [req-8233118c-e314-4a10-8ecd-babc665b27d4 req-2307c29c-55df-496f-96ce-ec638130c225 service nova] [instance: 2158de7a-1e53-450a-80de-a5c56844feba] No waiting events found dispatching network-vif-unplugged-8fc3cbf4-d7ef-434b-a7b5-b611e919b364 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:38:36 user nova-compute[72382]: DEBUG nova.compute.manager [req-8233118c-e314-4a10-8ecd-babc665b27d4 req-2307c29c-55df-496f-96ce-ec638130c225 service nova] [instance: 2158de7a-1e53-450a-80de-a5c56844feba] Received event network-vif-unplugged-8fc3cbf4-d7ef-434b-a7b5-b611e919b364 for instance with task_state deleting. {{(pid=72382) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 15:38:37 user nova-compute[72382]: INFO nova.virt.libvirt.driver [-] [instance: 2158de7a-1e53-450a-80de-a5c56844feba] Instance destroyed successfully.
Aug 09 15:38:37 user nova-compute[72382]: DEBUG nova.objects.instance [None req-522c017a-2be3-4203-8daa-aaab45062496 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Lazy-loading 'resources' on Instance uuid 2158de7a-1e53-450a-80de-a5c56844feba {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:38:37 user nova-compute[72382]: DEBUG nova.virt.libvirt.vif [None req-522c017a-2be3-4203-8daa-aaab45062496 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T15:36:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-74396283',display_name='tempest-TestVolumeBootPattern-server-74396283',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-74396283',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE2Ft4ugcR+xm9FJQARVlCQBYm313gUcmopkZOKz9jwU+uIeLmDWZczJQzSvB2hHfGE3d6cxNwerl6nmxRdqMq6zUG8hCLpv56gJB1tj7Wzv5bBbh5m7r3DF8/P9Gg51AA==',key_name='tempest-TestVolumeBootPattern-1990844198',keypairs=<?>,launch_index=0,launched_at=2023-08-09T15:36:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='70310b1af40b4d239fe5ea362972554b',ramdisk_id='',reservation_id='r-8kyudepv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-451643589',owner_user_name='tempest-TestVolumeBootPattern-451643589-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T15:36:58Z,user_data=None,user_id='280bcf2afd7245a7bcd605e0db79c569',uuid=2158de7a-1e53-450a-80de-a5c56844feba,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8fc3cbf4-d7ef-434b-a7b5-b611e919b364", "address": "fa:16:3e:c5:f7:64", "network": {"id": "a78e6cb6-feb7-4f64-a3c0-4900594b6e37", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-338007968-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70310b1af40b4d239fe5ea362972554b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fc3cbf4-d7", "ovs_interfaceid": "8fc3cbf4-d7ef-434b-a7b5-b611e919b364", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 15:38:37 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-522c017a-2be3-4203-8daa-aaab45062496 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Converting VIF {"id": "8fc3cbf4-d7ef-434b-a7b5-b611e919b364", "address": "fa:16:3e:c5:f7:64", "network": {"id": "a78e6cb6-feb7-4f64-a3c0-4900594b6e37", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-338007968-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70310b1af40b4d239fe5ea362972554b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fc3cbf4-d7", "ovs_interfaceid": "8fc3cbf4-d7ef-434b-a7b5-b611e919b364", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 15:38:37 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-522c017a-2be3-4203-8daa-aaab45062496 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:f7:64,bridge_name='br-int',has_traffic_filtering=True,id=8fc3cbf4-d7ef-434b-a7b5-b611e919b364,network=Network(a78e6cb6-feb7-4f64-a3c0-4900594b6e37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fc3cbf4-d7') {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 15:38:37 user nova-compute[72382]: DEBUG os_vif [None req-522c017a-2be3-4203-8daa-aaab45062496 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:f7:64,bridge_name='br-int',has_traffic_filtering=True,id=8fc3cbf4-d7ef-434b-a7b5-b611e919b364,network=Network(a78e6cb6-feb7-4f64-a3c0-4900594b6e37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fc3cbf4-d7') {{(pid=72382) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 15:38:37 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:38:37 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8fc3cbf4-d7, bridge=br-int, if_exists=True) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:38:37 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:38:37 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:38:37 user nova-compute[72382]: INFO os_vif [None req-522c017a-2be3-4203-8daa-aaab45062496 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:f7:64,bridge_name='br-int',has_traffic_filtering=True,id=8fc3cbf4-d7ef-434b-a7b5-b611e919b364,network=Network(a78e6cb6-feb7-4f64-a3c0-4900594b6e37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fc3cbf4-d7')
Aug 09 15:38:37 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-522c017a-2be3-4203-8daa-aaab45062496 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: 2158de7a-1e53-450a-80de-a5c56844feba] calling os-brick to detach iSCSI Volume {{(pid=72382) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 15:38:37 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-522c017a-2be3-4203-8daa-aaab45062496 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2a0c768340>, {'target_iqns': ['iqn.2010-10.org.openstack:3f58579c-f69a-4bee-b16e-970e5a8f590c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sJYkmfxN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 15:38:37 user nova-compute[72382]: WARNING os_brick.initiator.connectors.base [None req-522c017a-2be3-4203-8daa-aaab45062496 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 15:38:37 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-522c017a-2be3-4203-8daa-aaab45062496 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 15:38:37 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-522c017a-2be3-4203-8daa-aaab45062496 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 15:38:37 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-522c017a-2be3-4203-8daa-aaab45062496 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3f58579c-f69a-4bee-b16e-970e5a8f590c', 0)] {{(pid=72382) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 15:38:37 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:38:37 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:38:37 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[28d35dc8-1493-4e3e-ba94-ad35921717c7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:170d7509-0928-4a87-9d9f-437977452501\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3f58579c-f69a-4bee-b16e-970e5a8f590c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a0a612d6-0f3f-4d2c-9fb5-aff9384338de\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d2f5dbb5-f862-4389-b42a-872d5c94aa55\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:38:37 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:38:37 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:38:37 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4ab8bdf-b106-4ccb-99df-0f54e4092acc]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f58579c-f69a-4bee-b16e-970e5a8f590c (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0a612d6-0f3f-4d2c-9fb5-aff9384338de (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2f5dbb5-f862-4389-b42a-872d5c94aa55 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:170d7509-0928-4a87-9d9f-437977452501 (non-flash)\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:38:37 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-522c017a-2be3-4203-8daa-aaab45062496 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f58579c-f69a-4bee-b16e-970e5a8f590c (non-flash)
Aug 09 15:38:37 user nova-compute[72382]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0a612d6-0f3f-4d2c-9fb5-aff9384338de (non-flash)
Aug 09 15:38:37 user nova-compute[72382]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2f5dbb5-f862-4389-b42a-872d5c94aa55 (non-flash)
Aug 09 15:38:37 user nova-compute[72382]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:170d7509-0928-4a87-9d9f-437977452501 (non-flash)
Aug 09 15:38:37 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 15:38:37 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-522c017a-2be3-4203-8daa-aaab45062496 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f58579c-f69a-4bee-b16e-970e5a8f590c (non-flash)
Aug 09 15:38:37 user nova-compute[72382]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0a612d6-0f3f-4d2c-9fb5-aff9384338de (non-flash)
Aug 09 15:38:37 user nova-compute[72382]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2f5dbb5-f862-4389-b42a-872d5c94aa55 (non-flash)
Aug 09 15:38:37 user nova-compute[72382]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:170d7509-0928-4a87-9d9f-437977452501 (non-flash)
Aug 09 15:38:37 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 15:38:37 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-522c017a-2be3-4203-8daa-aaab45062496 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f29ec705750>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3f58579c-f69a-4bee-b16e-970e5a8f590c'): ({'sdb'}, set())}) {{(pid=72382) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 15:38:37 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-522c017a-2be3-4203-8daa-aaab45062496 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Removing single pathed devices sdb {{(pid=72382) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 15:38:37 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:38:37 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.031s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:38:37 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[107578dc-2aaf-4eab-9e0b-97872aaebd0a]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:38:37 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:38:37 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:38:37 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd0bf035-a89a-4227-b26d-807b49c457c6]: (4, ('ok\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:38:37 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-522c017a-2be3-4203-8daa-aaab45062496 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Flushing IO for device /dev/sdb {{(pid=72382) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 15:38:37 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:38:37 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.031s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:38:37 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e060ba7-6310-44ee-87c0-e0043b146e17]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:38:37 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-522c017a-2be3-4203-8daa-aaab45062496 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72382) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 15:38:37 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:38:37 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.049s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:38:37 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[a950830c-7c5c-4d05-a9a2-2758f91031e0]: (4, ('1', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:38:37 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-522c017a-2be3-4203-8daa-aaab45062496 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72382) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 15:38:37 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-522c017a-2be3-4203-8daa-aaab45062496 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] SCSI volumes sdb have been removed. {{(pid=72382) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 15:38:37 user nova-compute[72382]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO2ea97126-4a20ca848fe7dcec', '/dev/disk/by-id/scsi-23461323063613834', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_2ea97126') {{(pid=83725) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Aug 09 15:38:37 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b8cb8b5-39c6-40f6-b41b-b76ec7a47535]: (4, None) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:38:37 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-522c017a-2be3-4203-8daa-aaab45062496 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3f58579c-f69a-4bee-b16e-970e5a8f590c')] {{(pid=72382) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 15:38:37 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f58579c-f69a-4bee-b16e-970e5a8f590c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:38:37 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f58579c-f69a-4bee-b16e-970e5a8f590c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:38:37 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[74daf068-fd86-4af1-adfc-dd0e4b13ab08]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:38:37 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-522c017a-2be3-4203-8daa-aaab45062496 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:38:37 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f58579c-f69a-4bee-b16e-970e5a8f590c -p 172.16.0.220:3260 --logout {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:38:37 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f58579c-f69a-4bee-b16e-970e5a8f590c -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:38:37 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[28f9f88f-7dda-40b7-a57d-4d1fa0a7f6be]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:3f58579c-f69a-4bee-b16e-970e5a8f590c, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:3f58579c-f69a-4bee-b16e-970e5a8f590c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:38:37 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-522c017a-2be3-4203-8daa-aaab45062496 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:3f58579c-f69a-4bee-b16e-970e5a8f590c, portal: 172.16.0.220,3260]
Aug 09 15:38:37 user nova-compute[72382]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:3f58579c-f69a-4bee-b16e-970e5a8f590c, portal: 172.16.0.220,3260] successful.
Aug 09 15:38:37 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:38:37 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f58579c-f69a-4bee-b16e-970e5a8f590c -p 172.16.0.220:3260 --op delete {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:38:37 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f58579c-f69a-4bee-b16e-970e5a8f590c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:38:37 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[552dc9e5-63be-47a5-b4de-0e5a11296b9e]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:38:37 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-522c017a-2be3-4203-8daa-aaab45062496 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:38:37 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-522c017a-2be3-4203-8daa-aaab45062496 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.349s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 15:38:37 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-522c017a-2be3-4203-8daa-aaab45062496 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] <== disconnect_volume: return (350ms) None {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 15:38:37 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-522c017a-2be3-4203-8daa-aaab45062496 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: 2158de7a-1e53-450a-80de-a5c56844feba] Disconnected iSCSI Volume {{(pid=72382) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 15:38:37 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-522c017a-2be3-4203-8daa-aaab45062496 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: 2158de7a-1e53-450a-80de-a5c56844feba] Deleting instance files /opt/stack/data/nova/instances/2158de7a-1e53-450a-80de-a5c56844feba_del
Aug 09 15:38:37 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-522c017a-2be3-4203-8daa-aaab45062496 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: 2158de7a-1e53-450a-80de-a5c56844feba] Deletion of /opt/stack/data/nova/instances/2158de7a-1e53-450a-80de-a5c56844feba_del complete
Aug 09 15:38:37 user nova-compute[72382]: INFO nova.compute.manager [None req-522c017a-2be3-4203-8daa-aaab45062496 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: 2158de7a-1e53-450a-80de-a5c56844feba] Took 1.25 seconds to destroy the instance on the hypervisor.
Aug 09 15:38:37 user nova-compute[72382]: DEBUG oslo.service.loopingcall [None req-522c017a-2be3-4203-8daa-aaab45062496 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72382) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 15:38:37 user nova-compute[72382]: DEBUG nova.compute.manager [-] [instance: 2158de7a-1e53-450a-80de-a5c56844feba] Deallocating network for instance {{(pid=72382) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 15:38:37 user nova-compute[72382]: DEBUG nova.network.neutron [-] [instance: 2158de7a-1e53-450a-80de-a5c56844feba] deallocate_for_instance() {{(pid=72382) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 15:38:37 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-6a6be019-fe8a-4374-9dda-e46f1f850424 tempest-VolumesActionsTest-1154417962 tempest-VolumesActionsTest-1154417962-project-member] Acquiring lock "5607360c-5f17-42b3-a373-6a33a183f92f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:38:37 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-6a6be019-fe8a-4374-9dda-e46f1f850424 tempest-VolumesActionsTest-1154417962 tempest-VolumesActionsTest-1154417962-project-member] Lock "5607360c-5f17-42b3-a373-6a33a183f92f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:38:37 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-6a6be019-fe8a-4374-9dda-e46f1f850424 tempest-VolumesActionsTest-1154417962 tempest-VolumesActionsTest-1154417962-project-member] Acquiring lock "5607360c-5f17-42b3-a373-6a33a183f92f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:38:37 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-6a6be019-fe8a-4374-9dda-e46f1f850424 tempest-VolumesActionsTest-1154417962 tempest-VolumesActionsTest-1154417962-project-member] Lock "5607360c-5f17-42b3-a373-6a33a183f92f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:38:37 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-6a6be019-fe8a-4374-9dda-e46f1f850424 tempest-VolumesActionsTest-1154417962 tempest-VolumesActionsTest-1154417962-project-member] Lock "5607360c-5f17-42b3-a373-6a33a183f92f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:38:37 user nova-compute[72382]: INFO nova.compute.manager [None req-6a6be019-fe8a-4374-9dda-e46f1f850424 tempest-VolumesActionsTest-1154417962 tempest-VolumesActionsTest-1154417962-project-member] [instance: 5607360c-5f17-42b3-a373-6a33a183f92f] Terminating instance
Aug 09 15:38:37 user nova-compute[72382]: DEBUG nova.compute.manager [None req-6a6be019-fe8a-4374-9dda-e46f1f850424 tempest-VolumesActionsTest-1154417962 tempest-VolumesActionsTest-1154417962-project-member] [instance: 5607360c-5f17-42b3-a373-6a33a183f92f] Start destroying the instance on the hypervisor. {{(pid=72382) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 15:38:37 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:38:37 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:38:38 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:38:38 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:38:38 user nova-compute[72382]: DEBUG nova.compute.manager [req-95ead2f6-dbc3-405b-aa78-5bd7efb7eb95 req-af628ad3-9de2-455c-9f1e-09a5c4bf57e7 service nova] [instance: 5607360c-5f17-42b3-a373-6a33a183f92f] Received event network-vif-unplugged-c8fa95b9-76c9-4eac-a049-660e46ab4f5e {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:38:38 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-95ead2f6-dbc3-405b-aa78-5bd7efb7eb95 req-af628ad3-9de2-455c-9f1e-09a5c4bf57e7 service nova] Acquiring lock "5607360c-5f17-42b3-a373-6a33a183f92f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:38:38 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-95ead2f6-dbc3-405b-aa78-5bd7efb7eb95 req-af628ad3-9de2-455c-9f1e-09a5c4bf57e7 service nova] Lock "5607360c-5f17-42b3-a373-6a33a183f92f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:38:38 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-95ead2f6-dbc3-405b-aa78-5bd7efb7eb95 req-af628ad3-9de2-455c-9f1e-09a5c4bf57e7 service nova] Lock "5607360c-5f17-42b3-a373-6a33a183f92f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:38:38 user nova-compute[72382]: DEBUG nova.compute.manager [req-95ead2f6-dbc3-405b-aa78-5bd7efb7eb95 req-af628ad3-9de2-455c-9f1e-09a5c4bf57e7 service nova] [instance: 5607360c-5f17-42b3-a373-6a33a183f92f] No waiting events found dispatching network-vif-unplugged-c8fa95b9-76c9-4eac-a049-660e46ab4f5e {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:38:38 user nova-compute[72382]: DEBUG nova.compute.manager [req-95ead2f6-dbc3-405b-aa78-5bd7efb7eb95 req-af628ad3-9de2-455c-9f1e-09a5c4bf57e7 service nova] [instance: 5607360c-5f17-42b3-a373-6a33a183f92f] Received event network-vif-unplugged-c8fa95b9-76c9-4eac-a049-660e46ab4f5e for instance with task_state deleting. {{(pid=72382) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 15:38:38 user nova-compute[72382]: INFO nova.virt.libvirt.driver [-] [instance: 5607360c-5f17-42b3-a373-6a33a183f92f] Instance destroyed successfully.
Aug 09 15:38:38 user nova-compute[72382]: DEBUG nova.objects.instance [None req-6a6be019-fe8a-4374-9dda-e46f1f850424 tempest-VolumesActionsTest-1154417962 tempest-VolumesActionsTest-1154417962-project-member] Lazy-loading 'resources' on Instance uuid 5607360c-5f17-42b3-a373-6a33a183f92f {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:38:38 user nova-compute[72382]: DEBUG nova.virt.libvirt.vif [None req-6a6be019-fe8a-4374-9dda-e46f1f850424 tempest-VolumesActionsTest-1154417962 tempest-VolumesActionsTest-1154417962-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T15:36:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1145669130',display_name='tempest-VolumesActionsTest-instance-1145669130',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1145669130',id=43,image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-09T15:36:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b7bd7707b7d84acdb15e5f89b6720ff7',ramdisk_id='',reservation_id='r-6ni53l5z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1154417962',owner_user_name='tempest-VolumesActionsTest-1154417962-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T15:36:54Z,user_data=None,user_id='a780bb50b3d54386b8ed790da8a6cbea',uuid=5607360c-5f17-42b3-a373-6a33a183f92f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c8fa95b9-76c9-4eac-a049-660e46ab4f5e", "address": "fa:16:3e:1b:c5:d0", "network": {"id": "7cba5169-ea03-4ec4-a7e4-11b56c637e26", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1109056022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7bd7707b7d84acdb15e5f89b6720ff7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8fa95b9-76", "ovs_interfaceid": "c8fa95b9-76c9-4eac-a049-660e46ab4f5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 15:38:38 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-6a6be019-fe8a-4374-9dda-e46f1f850424 tempest-VolumesActionsTest-1154417962 tempest-VolumesActionsTest-1154417962-project-member] Converting VIF {"id": "c8fa95b9-76c9-4eac-a049-660e46ab4f5e", "address": "fa:16:3e:1b:c5:d0", "network": {"id": "7cba5169-ea03-4ec4-a7e4-11b56c637e26", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1109056022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7bd7707b7d84acdb15e5f89b6720ff7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8fa95b9-76", "ovs_interfaceid": "c8fa95b9-76c9-4eac-a049-660e46ab4f5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 15:38:38 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-6a6be019-fe8a-4374-9dda-e46f1f850424 tempest-VolumesActionsTest-1154417962 tempest-VolumesActionsTest-1154417962-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1b:c5:d0,bridge_name='br-int',has_traffic_filtering=True,id=c8fa95b9-76c9-4eac-a049-660e46ab4f5e,network=Network(7cba5169-ea03-4ec4-a7e4-11b56c637e26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8fa95b9-76') {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 15:38:38 user nova-compute[72382]: DEBUG os_vif [None req-6a6be019-fe8a-4374-9dda-e46f1f850424 tempest-VolumesActionsTest-1154417962 tempest-VolumesActionsTest-1154417962-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:c5:d0,bridge_name='br-int',has_traffic_filtering=True,id=c8fa95b9-76c9-4eac-a049-660e46ab4f5e,network=Network(7cba5169-ea03-4ec4-a7e4-11b56c637e26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8fa95b9-76') {{(pid=72382) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 15:38:38 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:38:38 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc8fa95b9-76, bridge=br-int, if_exists=True) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:38:38 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:38:38 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:38:38 user nova-compute[72382]: INFO os_vif [None req-6a6be019-fe8a-4374-9dda-e46f1f850424 tempest-VolumesActionsTest-1154417962 tempest-VolumesActionsTest-1154417962-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:c5:d0,bridge_name='br-int',has_traffic_filtering=True,id=c8fa95b9-76c9-4eac-a049-660e46ab4f5e,network=Network(7cba5169-ea03-4ec4-a7e4-11b56c637e26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8fa95b9-76')
Aug 09 15:38:38 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-6a6be019-fe8a-4374-9dda-e46f1f850424 tempest-VolumesActionsTest-1154417962 tempest-VolumesActionsTest-1154417962-project-member] [instance: 5607360c-5f17-42b3-a373-6a33a183f92f] Deleting instance files /opt/stack/data/nova/instances/5607360c-5f17-42b3-a373-6a33a183f92f_del
Aug 09 15:38:38 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-6a6be019-fe8a-4374-9dda-e46f1f850424 tempest-VolumesActionsTest-1154417962 tempest-VolumesActionsTest-1154417962-project-member] [instance: 5607360c-5f17-42b3-a373-6a33a183f92f] Deletion of /opt/stack/data/nova/instances/5607360c-5f17-42b3-a373-6a33a183f92f_del complete
Aug 09 15:38:38 user nova-compute[72382]: DEBUG nova.network.neutron [-] [instance: 2158de7a-1e53-450a-80de-a5c56844feba] Updating instance_info_cache with network_info: [] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:38:38 user nova-compute[72382]: DEBUG nova.compute.manager [req-0194a896-7e42-4808-a27b-4558bf472e1f req-398d317b-b4bd-42e0-9b08-8e386c511969 service nova] [instance: 2158de7a-1e53-450a-80de-a5c56844feba] Received event network-vif-plugged-8fc3cbf4-d7ef-434b-a7b5-b611e919b364 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:38:38 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-0194a896-7e42-4808-a27b-4558bf472e1f req-398d317b-b4bd-42e0-9b08-8e386c511969 service nova] Acquiring lock "2158de7a-1e53-450a-80de-a5c56844feba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:38:38 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-0194a896-7e42-4808-a27b-4558bf472e1f req-398d317b-b4bd-42e0-9b08-8e386c511969 service nova] Lock "2158de7a-1e53-450a-80de-a5c56844feba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:38:38 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-0194a896-7e42-4808-a27b-4558bf472e1f req-398d317b-b4bd-42e0-9b08-8e386c511969 service nova] Lock "2158de7a-1e53-450a-80de-a5c56844feba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:38:38 user nova-compute[72382]: DEBUG nova.compute.manager [req-0194a896-7e42-4808-a27b-4558bf472e1f req-398d317b-b4bd-42e0-9b08-8e386c511969 service nova] [instance: 2158de7a-1e53-450a-80de-a5c56844feba] No waiting events found dispatching network-vif-plugged-8fc3cbf4-d7ef-434b-a7b5-b611e919b364 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:38:38 user nova-compute[72382]: WARNING nova.compute.manager [req-0194a896-7e42-4808-a27b-4558bf472e1f req-398d317b-b4bd-42e0-9b08-8e386c511969 service nova] [instance: 2158de7a-1e53-450a-80de-a5c56844feba] Received unexpected event network-vif-plugged-8fc3cbf4-d7ef-434b-a7b5-b611e919b364 for instance with vm_state active and task_state deleting.
Aug 09 15:38:38 user nova-compute[72382]: INFO nova.compute.manager [-] [instance: 2158de7a-1e53-450a-80de-a5c56844feba] Took 1.17 seconds to deallocate network for instance.
Aug 09 15:38:38 user nova-compute[72382]: DEBUG nova.compute.manager [req-562604c2-b12c-401f-964c-f333fad32d89 req-4e1f84da-adc3-4452-bbc3-4fc0c8a5958a service nova] [instance: 2158de7a-1e53-450a-80de-a5c56844feba] Received event network-vif-deleted-8fc3cbf4-d7ef-434b-a7b5-b611e919b364 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:38:38 user nova-compute[72382]: INFO nova.compute.manager [None req-6a6be019-fe8a-4374-9dda-e46f1f850424 tempest-VolumesActionsTest-1154417962 tempest-VolumesActionsTest-1154417962-project-member] [instance: 5607360c-5f17-42b3-a373-6a33a183f92f] Took 0.93 seconds to destroy the instance on the hypervisor.
Aug 09 15:38:38 user nova-compute[72382]: DEBUG oslo.service.loopingcall [None req-6a6be019-fe8a-4374-9dda-e46f1f850424 tempest-VolumesActionsTest-1154417962 tempest-VolumesActionsTest-1154417962-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72382) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 15:38:38 user nova-compute[72382]: DEBUG nova.compute.manager [-] [instance: 5607360c-5f17-42b3-a373-6a33a183f92f] Deallocating network for instance {{(pid=72382) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 15:38:38 user nova-compute[72382]: DEBUG nova.network.neutron [-] [instance: 5607360c-5f17-42b3-a373-6a33a183f92f] deallocate_for_instance() {{(pid=72382) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 15:38:39 user nova-compute[72382]: DEBUG nova.network.neutron [-] [instance: 5607360c-5f17-42b3-a373-6a33a183f92f] Updating instance_info_cache with network_info: [] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:38:39 user nova-compute[72382]: INFO nova.compute.manager [-] [instance: 5607360c-5f17-42b3-a373-6a33a183f92f] Took 0.54 seconds to deallocate network for instance.
Aug 09 15:38:39 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-6a6be019-fe8a-4374-9dda-e46f1f850424 tempest-VolumesActionsTest-1154417962 tempest-VolumesActionsTest-1154417962-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:38:39 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-6a6be019-fe8a-4374-9dda-e46f1f850424 tempest-VolumesActionsTest-1154417962 tempest-VolumesActionsTest-1154417962-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:38:39 user nova-compute[72382]: INFO nova.compute.manager [None req-522c017a-2be3-4203-8daa-aaab45062496 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: 2158de7a-1e53-450a-80de-a5c56844feba] Took 0.81 seconds to detach 1 volumes for instance.
Aug 09 15:38:39 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-522c017a-2be3-4203-8daa-aaab45062496 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:38:39 user nova-compute[72382]: DEBUG nova.compute.provider_tree [None req-6a6be019-fe8a-4374-9dda-e46f1f850424 tempest-VolumesActionsTest-1154417962 tempest-VolumesActionsTest-1154417962-project-member] Inventory has not changed in ProviderTree for provider: 7b15b0e5-df4d-49db-833b-2855d21d10ae {{(pid=72382) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 15:38:39 user nova-compute[72382]: DEBUG nova.scheduler.client.report [None req-6a6be019-fe8a-4374-9dda-e46f1f850424 tempest-VolumesActionsTest-1154417962 tempest-VolumesActionsTest-1154417962-project-member] Inventory has not changed for provider 7b15b0e5-df4d-49db-833b-2855d21d10ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72382) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 15:38:39 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-6a6be019-fe8a-4374-9dda-e46f1f850424 tempest-VolumesActionsTest-1154417962 tempest-VolumesActionsTest-1154417962-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.275s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:38:39 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-522c017a-2be3-4203-8daa-aaab45062496 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.092s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:38:39 user nova-compute[72382]: INFO nova.scheduler.client.report [None req-6a6be019-fe8a-4374-9dda-e46f1f850424 tempest-VolumesActionsTest-1154417962 tempest-VolumesActionsTest-1154417962-project-member] Deleted allocations for instance 5607360c-5f17-42b3-a373-6a33a183f92f
Aug 09 15:38:39 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:38:39 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-6a6be019-fe8a-4374-9dda-e46f1f850424 tempest-VolumesActionsTest-1154417962 tempest-VolumesActionsTest-1154417962-project-member] Lock "5607360c-5f17-42b3-a373-6a33a183f92f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.049s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:38:40 user nova-compute[72382]: DEBUG nova.compute.provider_tree [None req-522c017a-2be3-4203-8daa-aaab45062496 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Inventory has not changed in ProviderTree for provider: 7b15b0e5-df4d-49db-833b-2855d21d10ae {{(pid=72382) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 15:38:40 user nova-compute[72382]: DEBUG nova.scheduler.client.report [None req-522c017a-2be3-4203-8daa-aaab45062496 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Inventory has not changed for provider 7b15b0e5-df4d-49db-833b-2855d21d10ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72382) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 15:38:40 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-522c017a-2be3-4203-8daa-aaab45062496 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.380s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:38:40 user nova-compute[72382]: INFO nova.scheduler.client.report [None req-522c017a-2be3-4203-8daa-aaab45062496 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Deleted allocations for instance 2158de7a-1e53-450a-80de-a5c56844feba
Aug 09 15:38:40 user nova-compute[72382]: DEBUG nova.compute.manager [req-84f5a566-2605-4f90-8bf8-736989bcb335 req-562ed257-b013-411b-92e2-799f87334611 service nova] [instance: 5607360c-5f17-42b3-a373-6a33a183f92f] Received event network-vif-plugged-c8fa95b9-76c9-4eac-a049-660e46ab4f5e {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:38:40 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-84f5a566-2605-4f90-8bf8-736989bcb335 req-562ed257-b013-411b-92e2-799f87334611 service nova] Acquiring lock "5607360c-5f17-42b3-a373-6a33a183f92f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:38:40 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-84f5a566-2605-4f90-8bf8-736989bcb335 req-562ed257-b013-411b-92e2-799f87334611 service nova] Lock "5607360c-5f17-42b3-a373-6a33a183f92f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:38:40 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-84f5a566-2605-4f90-8bf8-736989bcb335 req-562ed257-b013-411b-92e2-799f87334611 service nova] Lock "5607360c-5f17-42b3-a373-6a33a183f92f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:38:40 user nova-compute[72382]: DEBUG nova.compute.manager [req-84f5a566-2605-4f90-8bf8-736989bcb335 req-562ed257-b013-411b-92e2-799f87334611 service nova] [instance: 5607360c-5f17-42b3-a373-6a33a183f92f] No waiting events found dispatching network-vif-plugged-c8fa95b9-76c9-4eac-a049-660e46ab4f5e {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:38:40 user nova-compute[72382]: WARNING nova.compute.manager [req-84f5a566-2605-4f90-8bf8-736989bcb335 req-562ed257-b013-411b-92e2-799f87334611 service nova] [instance: 5607360c-5f17-42b3-a373-6a33a183f92f] Received unexpected event network-vif-plugged-c8fa95b9-76c9-4eac-a049-660e46ab4f5e for instance with vm_state deleted and task_state None.
Aug 09 15:38:40 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-522c017a-2be3-4203-8daa-aaab45062496 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Lock "2158de7a-1e53-450a-80de-a5c56844feba" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.937s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:38:40 user nova-compute[72382]: DEBUG nova.compute.manager [req-17ce6e67-f3d6-4eac-a2ad-c5f70fbbac5a req-ee2eec52-cfe9-4003-988c-57476d7bda78 service nova] [instance: 5607360c-5f17-42b3-a373-6a33a183f92f] Received event network-vif-deleted-c8fa95b9-76c9-4eac-a049-660e46ab4f5e {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:38:43 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:38:44 user nova-compute[72382]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691595509.3414333, d66443a2-2dc1-46f6-9572-f0717f830927 => Stopped> {{(pid=72382) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 15:38:44 user nova-compute[72382]: INFO nova.compute.manager [-] [instance: d66443a2-2dc1-46f6-9572-f0717f830927] VM Stopped (Lifecycle Event)
Aug 09 15:38:44 user nova-compute[72382]: DEBUG nova.compute.manager [None req-dda6b194-ad4a-46ed-bede-873753be2b2d None None] [instance: d66443a2-2dc1-46f6-9572-f0717f830927] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:38:44 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:38:48 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:38:49 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:38:50 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-75c6fed7-2a80-47ba-a6dc-dd1c85d5fce6 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Acquiring lock "402ba448-a30a-45f2-a724-5a53cf584547" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:38:50 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-75c6fed7-2a80-47ba-a6dc-dd1c85d5fce6 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Lock "402ba448-a30a-45f2-a724-5a53cf584547" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:38:50 user nova-compute[72382]: INFO nova.compute.manager [None req-75c6fed7-2a80-47ba-a6dc-dd1c85d5fce6 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] [instance: 402ba448-a30a-45f2-a724-5a53cf584547] Unshelving
Aug 09 15:38:51 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-75c6fed7-2a80-47ba-a6dc-dd1c85d5fce6 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:38:51 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-75c6fed7-2a80-47ba-a6dc-dd1c85d5fce6 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:38:51 user nova-compute[72382]: DEBUG nova.objects.instance [None req-75c6fed7-2a80-47ba-a6dc-dd1c85d5fce6 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Lazy-loading 'pci_requests' on Instance uuid 402ba448-a30a-45f2-a724-5a53cf584547 {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:38:51 user nova-compute[72382]: DEBUG nova.objects.instance [None req-75c6fed7-2a80-47ba-a6dc-dd1c85d5fce6 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Lazy-loading 'numa_topology' on Instance uuid 402ba448-a30a-45f2-a724-5a53cf584547 {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:38:51 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-75c6fed7-2a80-47ba-a6dc-dd1c85d5fce6 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72382) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 15:38:51 user nova-compute[72382]: INFO nova.compute.claims [None req-75c6fed7-2a80-47ba-a6dc-dd1c85d5fce6 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] [instance: 402ba448-a30a-45f2-a724-5a53cf584547] Claim successful on node user
Aug 09 15:38:51 user nova-compute[72382]: DEBUG nova.compute.provider_tree [None req-75c6fed7-2a80-47ba-a6dc-dd1c85d5fce6 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Inventory has not changed in ProviderTree for provider: 7b15b0e5-df4d-49db-833b-2855d21d10ae {{(pid=72382) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 15:38:51 user nova-compute[72382]: DEBUG nova.scheduler.client.report [None req-75c6fed7-2a80-47ba-a6dc-dd1c85d5fce6 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Inventory has not changed for provider 7b15b0e5-df4d-49db-833b-2855d21d10ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72382) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 15:38:51 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-75c6fed7-2a80-47ba-a6dc-dd1c85d5fce6 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.316s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:38:51 user nova-compute[72382]: INFO nova.network.neutron [None req-75c6fed7-2a80-47ba-a6dc-dd1c85d5fce6 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] [instance: 402ba448-a30a-45f2-a724-5a53cf584547] Updating port a4cb9706-2448-4789-b7ef-8c4bef62e160 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Aug 09 15:38:52 user nova-compute[72382]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691595517.1240673, 2158de7a-1e53-450a-80de-a5c56844feba => Stopped> {{(pid=72382) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 15:38:52 user nova-compute[72382]: INFO nova.compute.manager [-] [instance: 2158de7a-1e53-450a-80de-a5c56844feba] VM Stopped (Lifecycle Event)
Aug 09 15:38:52 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-75c6fed7-2a80-47ba-a6dc-dd1c85d5fce6 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Acquiring lock "refresh_cache-402ba448-a30a-45f2-a724-5a53cf584547" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 15:38:52 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-75c6fed7-2a80-47ba-a6dc-dd1c85d5fce6 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Acquired lock "refresh_cache-402ba448-a30a-45f2-a724-5a53cf584547" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 15:38:52 user nova-compute[72382]: DEBUG nova.network.neutron [None req-75c6fed7-2a80-47ba-a6dc-dd1c85d5fce6 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] [instance: 402ba448-a30a-45f2-a724-5a53cf584547] Building network info cache for instance {{(pid=72382) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 15:38:52 user nova-compute[72382]: DEBUG nova.compute.manager [None req-965b2bd6-7021-49d8-b710-9f76e706639f None None] [instance: 2158de7a-1e53-450a-80de-a5c56844feba] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:38:52 user nova-compute[72382]: DEBUG nova.compute.manager [req-22bfecc1-e478-45a1-bb07-beeff269362d req-294138fd-4aba-46e8-90bb-3e71f5749e2a service nova] [instance: 402ba448-a30a-45f2-a724-5a53cf584547] Received event network-changed-a4cb9706-2448-4789-b7ef-8c4bef62e160 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:38:52 user nova-compute[72382]: DEBUG nova.compute.manager [req-22bfecc1-e478-45a1-bb07-beeff269362d req-294138fd-4aba-46e8-90bb-3e71f5749e2a service nova] [instance: 402ba448-a30a-45f2-a724-5a53cf584547] Refreshing instance network info cache due to event network-changed-a4cb9706-2448-4789-b7ef-8c4bef62e160. {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 15:38:52 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-22bfecc1-e478-45a1-bb07-beeff269362d req-294138fd-4aba-46e8-90bb-3e71f5749e2a service nova] Acquiring lock "refresh_cache-402ba448-a30a-45f2-a724-5a53cf584547" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 15:38:52 user nova-compute[72382]: DEBUG nova.network.neutron [None req-75c6fed7-2a80-47ba-a6dc-dd1c85d5fce6 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] [instance: 402ba448-a30a-45f2-a724-5a53cf584547] Updating instance_info_cache with network_info: [{"id": "a4cb9706-2448-4789-b7ef-8c4bef62e160", "address": "fa:16:3e:e7:e5:94", "network": {"id": "643703fd-46b7-4309-862c-109141cb008c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-512918576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa6db5fd3ce24c1cadbedd64757e219b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4cb9706-24", "ovs_interfaceid": "a4cb9706-2448-4789-b7ef-8c4bef62e160", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:38:52 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-75c6fed7-2a80-47ba-a6dc-dd1c85d5fce6 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Releasing lock "refresh_cache-402ba448-a30a-45f2-a724-5a53cf584547" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 15:38:52 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-75c6fed7-2a80-47ba-a6dc-dd1c85d5fce6 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] [instance: 402ba448-a30a-45f2-a724-5a53cf584547] Creating instance directory {{(pid=72382) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 15:38:52 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-75c6fed7-2a80-47ba-a6dc-dd1c85d5fce6 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] [instance: 402ba448-a30a-45f2-a724-5a53cf584547] Creating image(s)
Aug 09 15:38:52 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-75c6fed7-2a80-47ba-a6dc-dd1c85d5fce6 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Acquiring lock "/opt/stack/data/nova/instances/402ba448-a30a-45f2-a724-5a53cf584547/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:38:52 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-75c6fed7-2a80-47ba-a6dc-dd1c85d5fce6 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Lock "/opt/stack/data/nova/instances/402ba448-a30a-45f2-a724-5a53cf584547/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:38:52 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-75c6fed7-2a80-47ba-a6dc-dd1c85d5fce6 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Lock "/opt/stack/data/nova/instances/402ba448-a30a-45f2-a724-5a53cf584547/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:38:52 user nova-compute[72382]: DEBUG nova.objects.instance [None req-75c6fed7-2a80-47ba-a6dc-dd1c85d5fce6 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Lazy-loading 'trusted_certs' on Instance uuid 402ba448-a30a-45f2-a724-5a53cf584547 {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:38:52 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-22bfecc1-e478-45a1-bb07-beeff269362d req-294138fd-4aba-46e8-90bb-3e71f5749e2a service nova] Acquired lock "refresh_cache-402ba448-a30a-45f2-a724-5a53cf584547" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 15:38:52 user nova-compute[72382]: DEBUG nova.network.neutron [req-22bfecc1-e478-45a1-bb07-beeff269362d req-294138fd-4aba-46e8-90bb-3e71f5749e2a service nova] [instance: 402ba448-a30a-45f2-a724-5a53cf584547] Refreshing network info cache for port a4cb9706-2448-4789-b7ef-8c4bef62e160 {{(pid=72382) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 15:38:52 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-75c6fed7-2a80-47ba-a6dc-dd1c85d5fce6 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Acquiring lock "435c65483e1a876fffea900a5130565343079966" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:38:52 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-75c6fed7-2a80-47ba-a6dc-dd1c85d5fce6 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Lock "435c65483e1a876fffea900a5130565343079966" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:38:54 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-75c6fed7-2a80-47ba-a6dc-dd1c85d5fce6 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/435c65483e1a876fffea900a5130565343079966.part --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:38:54 user nova-compute[72382]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691595518.6662908, 5607360c-5f17-42b3-a373-6a33a183f92f => Stopped> {{(pid=72382) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 15:38:54 user nova-compute[72382]: INFO nova.compute.manager [-] [instance: 5607360c-5f17-42b3-a373-6a33a183f92f] VM Stopped (Lifecycle Event)
Aug 09 15:38:54 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:38:54 user nova-compute[72382]: DEBUG nova.compute.manager [None req-1a0b99f3-8cc3-4a6a-af78-3ef1b6178303 None None] [instance: 5607360c-5f17-42b3-a373-6a33a183f92f] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:38:54 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-75c6fed7-2a80-47ba-a6dc-dd1c85d5fce6 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/435c65483e1a876fffea900a5130565343079966.part --force-share --output=json" returned: 0 in 0.134s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:38:54 user nova-compute[72382]: DEBUG nova.virt.images [None req-75c6fed7-2a80-47ba-a6dc-dd1c85d5fce6 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] f59f6193-09d1-444a-b9c2-f9fccd2f1058 was qcow2, converting to raw {{(pid=72382) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 09 15:38:54 user nova-compute[72382]: DEBUG nova.privsep.utils [None req-75c6fed7-2a80-47ba-a6dc-dd1c85d5fce6 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72382) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 09 15:38:54 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-75c6fed7-2a80-47ba-a6dc-dd1c85d5fce6 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/435c65483e1a876fffea900a5130565343079966.part /opt/stack/data/nova/instances/_base/435c65483e1a876fffea900a5130565343079966.converted {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:38:54 user nova-compute[72382]: DEBUG nova.network.neutron [req-22bfecc1-e478-45a1-bb07-beeff269362d req-294138fd-4aba-46e8-90bb-3e71f5749e2a service nova] [instance: 402ba448-a30a-45f2-a724-5a53cf584547] Updated VIF entry in instance network info cache for port a4cb9706-2448-4789-b7ef-8c4bef62e160. {{(pid=72382) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 15:38:54 user nova-compute[72382]: DEBUG nova.network.neutron [req-22bfecc1-e478-45a1-bb07-beeff269362d req-294138fd-4aba-46e8-90bb-3e71f5749e2a service nova] [instance: 402ba448-a30a-45f2-a724-5a53cf584547] Updating instance_info_cache with network_info: [{"id": "a4cb9706-2448-4789-b7ef-8c4bef62e160", "address": "fa:16:3e:e7:e5:94", "network": {"id": "643703fd-46b7-4309-862c-109141cb008c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-512918576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa6db5fd3ce24c1cadbedd64757e219b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4cb9706-24", "ovs_interfaceid": "a4cb9706-2448-4789-b7ef-8c4bef62e160", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:38:54 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-22bfecc1-e478-45a1-bb07-beeff269362d req-294138fd-4aba-46e8-90bb-3e71f5749e2a service nova] Releasing lock "refresh_cache-402ba448-a30a-45f2-a724-5a53cf584547" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 15:38:54 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-75c6fed7-2a80-47ba-a6dc-dd1c85d5fce6 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/435c65483e1a876fffea900a5130565343079966.part /opt/stack/data/nova/instances/_base/435c65483e1a876fffea900a5130565343079966.converted" returned: 0 in 0.409s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:38:54 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-75c6fed7-2a80-47ba-a6dc-dd1c85d5fce6 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/435c65483e1a876fffea900a5130565343079966.converted --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:38:54 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-75c6fed7-2a80-47ba-a6dc-dd1c85d5fce6 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/435c65483e1a876fffea900a5130565343079966.converted --force-share --output=json" returned: 0 in 0.141s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:38:54 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-75c6fed7-2a80-47ba-a6dc-dd1c85d5fce6 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Lock "435c65483e1a876fffea900a5130565343079966" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.842s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:38:54 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-75c6fed7-2a80-47ba-a6dc-dd1c85d5fce6 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/435c65483e1a876fffea900a5130565343079966 --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:38:54 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:38:54 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-75c6fed7-2a80-47ba-a6dc-dd1c85d5fce6 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/435c65483e1a876fffea900a5130565343079966 --force-share --output=json" returned: 0 in 0.139s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:38:54 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-75c6fed7-2a80-47ba-a6dc-dd1c85d5fce6 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Acquiring lock "435c65483e1a876fffea900a5130565343079966" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:38:54 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-75c6fed7-2a80-47ba-a6dc-dd1c85d5fce6 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Lock "435c65483e1a876fffea900a5130565343079966" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:38:54 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-75c6fed7-2a80-47ba-a6dc-dd1c85d5fce6 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/435c65483e1a876fffea900a5130565343079966 --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:38:55 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-75c6fed7-2a80-47ba-a6dc-dd1c85d5fce6 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/435c65483e1a876fffea900a5130565343079966 --force-share --output=json" returned: 0 in 0.141s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:38:55 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-75c6fed7-2a80-47ba-a6dc-dd1c85d5fce6 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/435c65483e1a876fffea900a5130565343079966,backing_fmt=raw /opt/stack/data/nova/instances/402ba448-a30a-45f2-a724-5a53cf584547/disk 1073741824 {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:38:55 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-75c6fed7-2a80-47ba-a6dc-dd1c85d5fce6 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/435c65483e1a876fffea900a5130565343079966,backing_fmt=raw /opt/stack/data/nova/instances/402ba448-a30a-45f2-a724-5a53cf584547/disk 1073741824" returned: 0 in 0.053s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:38:55 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-75c6fed7-2a80-47ba-a6dc-dd1c85d5fce6 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Lock "435c65483e1a876fffea900a5130565343079966" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.202s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:38:55 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-75c6fed7-2a80-47ba-a6dc-dd1c85d5fce6 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/435c65483e1a876fffea900a5130565343079966 --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:38:55 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-75c6fed7-2a80-47ba-a6dc-dd1c85d5fce6 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/435c65483e1a876fffea900a5130565343079966 --force-share --output=json" returned: 0 in 0.135s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:38:55 user nova-compute[72382]: DEBUG nova.objects.instance [None req-75c6fed7-2a80-47ba-a6dc-dd1c85d5fce6 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Lazy-loading 'migration_context' on Instance uuid 402ba448-a30a-45f2-a724-5a53cf584547 {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:38:55 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-75c6fed7-2a80-47ba-a6dc-dd1c85d5fce6 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] [instance: 402ba448-a30a-45f2-a724-5a53cf584547] Rebasing disk image.
Aug 09 15:38:55 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-75c6fed7-2a80-47ba-a6dc-dd1c85d5fce6 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:38:55 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-75c6fed7-2a80-47ba-a6dc-dd1c85d5fce6 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b --force-share --output=json" returned: 0 in 0.161s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:38:55 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-75c6fed7-2a80-47ba-a6dc-dd1c85d5fce6 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b -F raw /opt/stack/data/nova/instances/402ba448-a30a-45f2-a724-5a53cf584547/disk {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:38:57 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-75c6fed7-2a80-47ba-a6dc-dd1c85d5fce6 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b -F raw /opt/stack/data/nova/instances/402ba448-a30a-45f2-a724-5a53cf584547/disk" returned: 0 in 2.214s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:38:57 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-75c6fed7-2a80-47ba-a6dc-dd1c85d5fce6 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] [instance: 402ba448-a30a-45f2-a724-5a53cf584547] Created local disks {{(pid=72382) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 15:38:57 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-75c6fed7-2a80-47ba-a6dc-dd1c85d5fce6 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] [instance: 402ba448-a30a-45f2-a724-5a53cf584547] Ensure instance console log exists: /opt/stack/data/nova/instances/402ba448-a30a-45f2-a724-5a53cf584547/console.log {{(pid=72382) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 15:38:57 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-75c6fed7-2a80-47ba-a6dc-dd1c85d5fce6 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:38:57 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-75c6fed7-2a80-47ba-a6dc-dd1c85d5fce6 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:38:57 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-75c6fed7-2a80-47ba-a6dc-dd1c85d5fce6 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:38:57 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-75c6fed7-2a80-47ba-a6dc-dd1c85d5fce6 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] [instance: 402ba448-a30a-45f2-a724-5a53cf584547] Start _get_guest_xml network_info=[{"id": "a4cb9706-2448-4789-b7ef-8c4bef62e160", "address": "fa:16:3e:e7:e5:94", "network": {"id": "643703fd-46b7-4309-862c-109141cb008c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-512918576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa6db5fd3ce24c1cadbedd64757e219b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4cb9706-24", "ovs_interfaceid": "a4cb9706-2448-4789-b7ef-8c4bef62e160", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='5b7b7d31fa524c30bc47992f47607763',container_format='bare',created_at=2023-08-09T15:36:58Z,direct_url=<?>,disk_format='qcow2',id=f59f6193-09d1-444a-b9c2-f9fccd2f1058,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-65834704-shelved',owner='aa6db5fd3ce24c1cadbedd64757e219b',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-09T15:37:02Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'a79f2cea-eb27-4631-aaf3-05e7d9e411b4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72382) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 15:38:57 user nova-compute[72382]: WARNING nova.virt.libvirt.driver [None req-75c6fed7-2a80-47ba-a6dc-dd1c85d5fce6 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 15:38:57 user nova-compute[72382]: WARNING nova.virt.libvirt.driver [None req-75c6fed7-2a80-47ba-a6dc-dd1c85d5fce6 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 15:38:57 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-75c6fed7-2a80-47ba-a6dc-dd1c85d5fce6 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72382) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 15:38:57 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-75c6fed7-2a80-47ba-a6dc-dd1c85d5fce6 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] CPU controller missing on host. {{(pid=72382) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 15:38:57 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-75c6fed7-2a80-47ba-a6dc-dd1c85d5fce6 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72382) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 15:38:57 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-75c6fed7-2a80-47ba-a6dc-dd1c85d5fce6 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] CPU controller found on host. {{(pid=72382) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 15:38:57 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-75c6fed7-2a80-47ba-a6dc-dd1c85d5fce6 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72382) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 15:38:57 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-75c6fed7-2a80-47ba-a6dc-dd1c85d5fce6 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T15:11:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='5b7b7d31fa524c30bc47992f47607763',container_format='bare',created_at=2023-08-09T15:36:58Z,direct_url=<?>,disk_format='qcow2',id=f59f6193-09d1-444a-b9c2-f9fccd2f1058,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-65834704-shelved',owner='aa6db5fd3ce24c1cadbedd64757e219b',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-09T15:37:02Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 15:38:57 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-75c6fed7-2a80-47ba-a6dc-dd1c85d5fce6 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Flavor limits 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 15:38:57 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-75c6fed7-2a80-47ba-a6dc-dd1c85d5fce6 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Image limits 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 15:38:57 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-75c6fed7-2a80-47ba-a6dc-dd1c85d5fce6 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Flavor pref 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 15:38:57 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-75c6fed7-2a80-47ba-a6dc-dd1c85d5fce6 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Image pref 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 15:38:57 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-75c6fed7-2a80-47ba-a6dc-dd1c85d5fce6 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 15:38:57 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-75c6fed7-2a80-47ba-a6dc-dd1c85d5fce6 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 15:38:57 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-75c6fed7-2a80-47ba-a6dc-dd1c85d5fce6 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72382) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 15:38:57 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-75c6fed7-2a80-47ba-a6dc-dd1c85d5fce6 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Got 1 possible topologies {{(pid=72382) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 15:38:57 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-75c6fed7-2a80-47ba-a6dc-dd1c85d5fce6 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 15:38:57 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-75c6fed7-2a80-47ba-a6dc-dd1c85d5fce6 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 15:38:57 user nova-compute[72382]: DEBUG nova.objects.instance [None req-75c6fed7-2a80-47ba-a6dc-dd1c85d5fce6 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Lazy-loading 'vcpu_model' on Instance uuid 402ba448-a30a-45f2-a724-5a53cf584547 {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:38:57 user nova-compute[72382]: DEBUG nova.virt.libvirt.vif [None req-75c6fed7-2a80-47ba-a6dc-dd1c85d5fce6 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-09T15:35:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-65834704',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-65834704',id=38,image_ref='f59f6193-09d1-444a-b9c2-f9fccd2f1058',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1104367240',keypairs=<?>,launch_index=0,launched_at=2023-08-09T15:35:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='aa6db5fd3ce24c1cadbedd64757e219b',ramdisk_id='',reservation_id='r-aqp1oexg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1817688709',owner_user_name='tempest-AttachVolumeShelveTestJSON-1817688709-project-member',shelved_at='2023-08-09T15:37:02.289294',shelved_host='user',shelved_image_id='f59f6193-09d1-444a-b9c2-f9fccd2f1058'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T15:38:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9f95e50aa6194e778dfaee31e6e2fa68',uuid=402ba448-a30a-45f2-a724-5a53cf584547,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "a4cb9706-2448-4789-b7ef-8c4bef62e160", "address": "fa:16:3e:e7:e5:94", "network": {"id": "643703fd-46b7-4309-862c-109141cb008c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-512918576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa6db5fd3ce24c1cadbedd64757e219b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4cb9706-24", "ovs_interfaceid": "a4cb9706-2448-4789-b7ef-8c4bef62e160", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72382) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 15:38:57 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-75c6fed7-2a80-47ba-a6dc-dd1c85d5fce6 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Converting VIF {"id": "a4cb9706-2448-4789-b7ef-8c4bef62e160", "address": "fa:16:3e:e7:e5:94", "network": {"id": "643703fd-46b7-4309-862c-109141cb008c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-512918576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa6db5fd3ce24c1cadbedd64757e219b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4cb9706-24", "ovs_interfaceid": "a4cb9706-2448-4789-b7ef-8c4bef62e160", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 15:38:57 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-75c6fed7-2a80-47ba-a6dc-dd1c85d5fce6 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:e5:94,bridge_name='br-int',has_traffic_filtering=True,id=a4cb9706-2448-4789-b7ef-8c4bef62e160,network=Network(643703fd-46b7-4309-862c-109141cb008c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4cb9706-24') {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 15:38:57 user nova-compute[72382]: DEBUG nova.objects.instance [None req-75c6fed7-2a80-47ba-a6dc-dd1c85d5fce6 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Lazy-loading 'pci_devices' on Instance uuid 402ba448-a30a-45f2-a724-5a53cf584547 {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:38:57 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-75c6fed7-2a80-47ba-a6dc-dd1c85d5fce6 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] [instance: 402ba448-a30a-45f2-a724-5a53cf584547] End _get_guest_xml xml=<domain type="kvm">
Aug 09 15:38:57 user nova-compute[72382]:   <uuid>402ba448-a30a-45f2-a724-5a53cf584547</uuid>
Aug 09 15:38:57 user nova-compute[72382]:   <name>instance-00000026</name>
Aug 09 15:38:57 user nova-compute[72382]:   <memory>524288</memory>
Aug 09 15:38:57 user nova-compute[72382]:   <vcpu>1</vcpu>
Aug 09 15:38:57 user nova-compute[72382]:   <metadata>
Aug 09 15:38:57 user nova-compute[72382]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 15:38:57 user nova-compute[72382]:       <nova:package version="0.0.0"/>
Aug 09 15:38:57 user nova-compute[72382]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-65834704</nova:name>
Aug 09 15:38:57 user nova-compute[72382]:       <nova:creationTime>2023-08-09 15:38:57</nova:creationTime>
Aug 09 15:38:57 user nova-compute[72382]:       <nova:flavor name="m1.tiny">
Aug 09 15:38:57 user nova-compute[72382]:         <nova:memory>512</nova:memory>
Aug 09 15:38:57 user nova-compute[72382]:         <nova:disk>1</nova:disk>
Aug 09 15:38:57 user nova-compute[72382]:         <nova:swap>0</nova:swap>
Aug 09 15:38:57 user nova-compute[72382]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 15:38:57 user nova-compute[72382]:         <nova:vcpus>1</nova:vcpus>
Aug 09 15:38:57 user nova-compute[72382]:       </nova:flavor>
Aug 09 15:38:57 user nova-compute[72382]:       <nova:owner>
Aug 09 15:38:57 user nova-compute[72382]:         <nova:user uuid="9f95e50aa6194e778dfaee31e6e2fa68">tempest-AttachVolumeShelveTestJSON-1817688709-project-member</nova:user>
Aug 09 15:38:57 user nova-compute[72382]:         <nova:project uuid="aa6db5fd3ce24c1cadbedd64757e219b">tempest-AttachVolumeShelveTestJSON-1817688709</nova:project>
Aug 09 15:38:57 user nova-compute[72382]:       </nova:owner>
Aug 09 15:38:57 user nova-compute[72382]:       <nova:root type="image" uuid="f59f6193-09d1-444a-b9c2-f9fccd2f1058"/>
Aug 09 15:38:57 user nova-compute[72382]:       <nova:ports>
Aug 09 15:38:57 user nova-compute[72382]:         <nova:port uuid="a4cb9706-2448-4789-b7ef-8c4bef62e160">
Aug 09 15:38:57 user nova-compute[72382]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 09 15:38:57 user nova-compute[72382]:         </nova:port>
Aug 09 15:38:57 user nova-compute[72382]:       </nova:ports>
Aug 09 15:38:57 user nova-compute[72382]:     </nova:instance>
Aug 09 15:38:57 user nova-compute[72382]:   </metadata>
Aug 09 15:38:57 user nova-compute[72382]:   <sysinfo type="smbios">
Aug 09 15:38:57 user nova-compute[72382]:     <system>
Aug 09 15:38:57 user nova-compute[72382]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 15:38:57 user nova-compute[72382]:       <entry name="product">OpenStack Nova</entry>
Aug 09 15:38:57 user nova-compute[72382]:       <entry name="version">0.0.0</entry>
Aug 09 15:38:57 user nova-compute[72382]:       <entry name="serial">402ba448-a30a-45f2-a724-5a53cf584547</entry>
Aug 09 15:38:57 user nova-compute[72382]:       <entry name="uuid">402ba448-a30a-45f2-a724-5a53cf584547</entry>
Aug 09 15:38:57 user nova-compute[72382]:       <entry name="family">Virtual Machine</entry>
Aug 09 15:38:57 user nova-compute[72382]:     </system>
Aug 09 15:38:57 user nova-compute[72382]:   </sysinfo>
Aug 09 15:38:57 user nova-compute[72382]:   <os>
Aug 09 15:38:57 user nova-compute[72382]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 15:38:57 user nova-compute[72382]:     <boot dev="hd"/>
Aug 09 15:38:57 user nova-compute[72382]:     <smbios mode="sysinfo"/>
Aug 09 15:38:57 user nova-compute[72382]:   </os>
Aug 09 15:38:57 user nova-compute[72382]:   <features>
Aug 09 15:38:57 user nova-compute[72382]:     <acpi/>
Aug 09 15:38:57 user nova-compute[72382]:     <apic/>
Aug 09 15:38:57 user nova-compute[72382]:     <vmcoreinfo/>
Aug 09 15:38:57 user nova-compute[72382]:   </features>
Aug 09 15:38:57 user nova-compute[72382]:   <clock offset="utc">
Aug 09 15:38:57 user nova-compute[72382]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 15:38:57 user nova-compute[72382]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 15:38:57 user nova-compute[72382]:     <timer name="hpet" present="no"/>
Aug 09 15:38:57 user nova-compute[72382]:   </clock>
Aug 09 15:38:57 user nova-compute[72382]:   <cpu mode="custom" match="exact">
Aug 09 15:38:57 user nova-compute[72382]:     <model>Nehalem</model>
Aug 09 15:38:57 user nova-compute[72382]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 15:38:57 user nova-compute[72382]:   </cpu>
Aug 09 15:38:57 user nova-compute[72382]:   <devices>
Aug 09 15:38:57 user nova-compute[72382]:     <disk type="file" device="disk">
Aug 09 15:38:57 user nova-compute[72382]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 15:38:57 user nova-compute[72382]:       <source file="/opt/stack/data/nova/instances/402ba448-a30a-45f2-a724-5a53cf584547/disk"/>
Aug 09 15:38:57 user nova-compute[72382]:       <target dev="vda" bus="virtio"/>
Aug 09 15:38:57 user nova-compute[72382]:     </disk>
Aug 09 15:38:57 user nova-compute[72382]:     <interface type="ethernet">
Aug 09 15:38:57 user nova-compute[72382]:       <mac address="fa:16:3e:e7:e5:94"/>
Aug 09 15:38:57 user nova-compute[72382]:       <model type="virtio"/>
Aug 09 15:38:57 user nova-compute[72382]:       <mtu size="1442"/>
Aug 09 15:38:57 user nova-compute[72382]:       <target dev="tapa4cb9706-24"/>
Aug 09 15:38:57 user nova-compute[72382]:     </interface>
Aug 09 15:38:57 user nova-compute[72382]:     <serial type="pty">
Aug 09 15:38:57 user nova-compute[72382]:       <log file="/opt/stack/data/nova/instances/402ba448-a30a-45f2-a724-5a53cf584547/console.log" append="off"/>
Aug 09 15:38:57 user nova-compute[72382]:     </serial>
Aug 09 15:38:57 user nova-compute[72382]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 15:38:57 user nova-compute[72382]:     <video>
Aug 09 15:38:57 user nova-compute[72382]:       <model type="virtio"/>
Aug 09 15:38:57 user nova-compute[72382]:     </video>
Aug 09 15:38:57 user nova-compute[72382]:     <rng model="virtio">
Aug 09 15:38:57 user nova-compute[72382]:       <backend model="random">/dev/urandom</backend>
Aug 09 15:38:57 user nova-compute[72382]:     </rng>
Aug 09 15:38:57 user nova-compute[72382]:     <controller type="usb" index="0" model="none"/>
Aug 09 15:38:57 user nova-compute[72382]:     <memballoon model="virtio">
Aug 09 15:38:57 user nova-compute[72382]:       <stats period="10"/>
Aug 09 15:38:57 user nova-compute[72382]:     </memballoon>
Aug 09 15:38:57 user nova-compute[72382]:   </devices>
Aug 09 15:38:57 user nova-compute[72382]: </domain>
Aug 09 15:38:57 user nova-compute[72382]:  {{(pid=72382) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 15:38:57 user nova-compute[72382]: DEBUG nova.virt.libvirt.vif [None req-75c6fed7-2a80-47ba-a6dc-dd1c85d5fce6 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-09T15:35:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-65834704',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-65834704',id=38,image_ref='f59f6193-09d1-444a-b9c2-f9fccd2f1058',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1104367240',keypairs=<?>,launch_index=0,launched_at=2023-08-09T15:35:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='aa6db5fd3ce24c1cadbedd64757e219b',ramdisk_id='',reservation_id='r-aqp1oexg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1817688709',owner_user_name='tempest-AttachVolumeShelveTestJSON-1817688709-project-member',shelved_at='2023-08-09T15:37:02.289294',shelved_host='user',shelved_image_id='f59f6193-09d1-444a-b9c2-f9fccd2f1058'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T15:38:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9f95e50aa6194e778dfaee31e6e2fa68',uuid=402ba448-a30a-45f2-a724-5a53cf584547,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "a4cb9706-2448-4789-b7ef-8c4bef62e160", "address": "fa:16:3e:e7:e5:94", "network": {"id": "643703fd-46b7-4309-862c-109141cb008c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-512918576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa6db5fd3ce24c1cadbedd64757e219b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4cb9706-24", "ovs_interfaceid": "a4cb9706-2448-4789-b7ef-8c4bef62e160", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 15:38:57 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-75c6fed7-2a80-47ba-a6dc-dd1c85d5fce6 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Converting VIF {"id": "a4cb9706-2448-4789-b7ef-8c4bef62e160", "address": "fa:16:3e:e7:e5:94", "network": {"id": "643703fd-46b7-4309-862c-109141cb008c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-512918576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa6db5fd3ce24c1cadbedd64757e219b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4cb9706-24", "ovs_interfaceid": "a4cb9706-2448-4789-b7ef-8c4bef62e160", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 15:38:57 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-75c6fed7-2a80-47ba-a6dc-dd1c85d5fce6 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:e5:94,bridge_name='br-int',has_traffic_filtering=True,id=a4cb9706-2448-4789-b7ef-8c4bef62e160,network=Network(643703fd-46b7-4309-862c-109141cb008c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4cb9706-24') {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 15:38:57 user nova-compute[72382]: DEBUG os_vif [None req-75c6fed7-2a80-47ba-a6dc-dd1c85d5fce6 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:e5:94,bridge_name='br-int',has_traffic_filtering=True,id=a4cb9706-2448-4789-b7ef-8c4bef62e160,network=Network(643703fd-46b7-4309-862c-109141cb008c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4cb9706-24') {{(pid=72382) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 15:38:57 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:38:57 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:38:57 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 15:38:57 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:38:57 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa4cb9706-24, may_exist=True, interface_attrs={}) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:38:57 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa4cb9706-24, col_values=(('external_ids', {'iface-id': 'a4cb9706-2448-4789-b7ef-8c4bef62e160', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e7:e5:94', 'vm-uuid': '402ba448-a30a-45f2-a724-5a53cf584547'}),), if_exists=True) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:38:57 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:38:57 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:38:57 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:38:57 user nova-compute[72382]: INFO os_vif [None req-75c6fed7-2a80-47ba-a6dc-dd1c85d5fce6 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:e5:94,bridge_name='br-int',has_traffic_filtering=True,id=a4cb9706-2448-4789-b7ef-8c4bef62e160,network=Network(643703fd-46b7-4309-862c-109141cb008c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4cb9706-24')
Aug 09 15:38:57 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-75c6fed7-2a80-47ba-a6dc-dd1c85d5fce6 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] No BDM found with device name vda, not building metadata. {{(pid=72382) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 15:38:57 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-75c6fed7-2a80-47ba-a6dc-dd1c85d5fce6 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] No VIF found with MAC fa:16:3e:e7:e5:94, not building metadata {{(pid=72382) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 15:38:59 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:38:59 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:38:59 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:38:59 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:38:59 user nova-compute[72382]: DEBUG nova.compute.manager [req-7f555542-82de-4030-8c95-2ee5e5f504e9 req-26928010-58f1-4d4c-96eb-bd5c5bebb0c6 service nova] [instance: 402ba448-a30a-45f2-a724-5a53cf584547] Received event network-vif-plugged-a4cb9706-2448-4789-b7ef-8c4bef62e160 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:38:59 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-7f555542-82de-4030-8c95-2ee5e5f504e9 req-26928010-58f1-4d4c-96eb-bd5c5bebb0c6 service nova] Acquiring lock "402ba448-a30a-45f2-a724-5a53cf584547-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:38:59 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-7f555542-82de-4030-8c95-2ee5e5f504e9 req-26928010-58f1-4d4c-96eb-bd5c5bebb0c6 service nova] Lock "402ba448-a30a-45f2-a724-5a53cf584547-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:38:59 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-7f555542-82de-4030-8c95-2ee5e5f504e9 req-26928010-58f1-4d4c-96eb-bd5c5bebb0c6 service nova] Lock "402ba448-a30a-45f2-a724-5a53cf584547-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:38:59 user nova-compute[72382]: DEBUG nova.compute.manager [req-7f555542-82de-4030-8c95-2ee5e5f504e9 req-26928010-58f1-4d4c-96eb-bd5c5bebb0c6 service nova] [instance: 402ba448-a30a-45f2-a724-5a53cf584547] No waiting events found dispatching network-vif-plugged-a4cb9706-2448-4789-b7ef-8c4bef62e160 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:38:59 user nova-compute[72382]: WARNING nova.compute.manager [req-7f555542-82de-4030-8c95-2ee5e5f504e9 req-26928010-58f1-4d4c-96eb-bd5c5bebb0c6 service nova] [instance: 402ba448-a30a-45f2-a724-5a53cf584547] Received unexpected event network-vif-plugged-a4cb9706-2448-4789-b7ef-8c4bef62e160 for instance with vm_state shelved_offloaded and task_state spawning.
Aug 09 15:38:59 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:38:59 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:38:59 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:38:59 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:39:01 user nova-compute[72382]: DEBUG nova.virt.driver [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Emitting event <LifecycleEvent: 1691595541.367598, 402ba448-a30a-45f2-a724-5a53cf584547 => Resumed> {{(pid=72382) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 15:39:01 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 402ba448-a30a-45f2-a724-5a53cf584547] VM Resumed (Lifecycle Event)
Aug 09 15:39:01 user nova-compute[72382]: DEBUG nova.compute.manager [None req-75c6fed7-2a80-47ba-a6dc-dd1c85d5fce6 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] [instance: 402ba448-a30a-45f2-a724-5a53cf584547] Instance event wait completed in 0 seconds for  {{(pid=72382) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 15:39:01 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-75c6fed7-2a80-47ba-a6dc-dd1c85d5fce6 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] [instance: 402ba448-a30a-45f2-a724-5a53cf584547] Guest created on hypervisor {{(pid=72382) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 15:39:01 user nova-compute[72382]: INFO nova.virt.libvirt.driver [-] [instance: 402ba448-a30a-45f2-a724-5a53cf584547] Instance spawned successfully.
Aug 09 15:39:01 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 402ba448-a30a-45f2-a724-5a53cf584547] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:39:01 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 402ba448-a30a-45f2-a724-5a53cf584547] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=72382) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 15:39:01 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 402ba448-a30a-45f2-a724-5a53cf584547] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 15:39:01 user nova-compute[72382]: DEBUG nova.virt.driver [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Emitting event <LifecycleEvent: 1691595541.3690174, 402ba448-a30a-45f2-a724-5a53cf584547 => Started> {{(pid=72382) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 15:39:01 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 402ba448-a30a-45f2-a724-5a53cf584547] VM Started (Lifecycle Event)
Aug 09 15:39:01 user nova-compute[72382]: DEBUG nova.compute.manager [req-f0a1aedb-10ff-4315-bd03-99596c392990 req-228c0245-ce9b-4273-948e-41094bd7518b service nova] [instance: 402ba448-a30a-45f2-a724-5a53cf584547] Received event network-vif-plugged-a4cb9706-2448-4789-b7ef-8c4bef62e160 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:39:01 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-f0a1aedb-10ff-4315-bd03-99596c392990 req-228c0245-ce9b-4273-948e-41094bd7518b service nova] Acquiring lock "402ba448-a30a-45f2-a724-5a53cf584547-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:39:01 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-f0a1aedb-10ff-4315-bd03-99596c392990 req-228c0245-ce9b-4273-948e-41094bd7518b service nova] Lock "402ba448-a30a-45f2-a724-5a53cf584547-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:39:01 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-f0a1aedb-10ff-4315-bd03-99596c392990 req-228c0245-ce9b-4273-948e-41094bd7518b service nova] Lock "402ba448-a30a-45f2-a724-5a53cf584547-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:39:01 user nova-compute[72382]: DEBUG nova.compute.manager [req-f0a1aedb-10ff-4315-bd03-99596c392990 req-228c0245-ce9b-4273-948e-41094bd7518b service nova] [instance: 402ba448-a30a-45f2-a724-5a53cf584547] No waiting events found dispatching network-vif-plugged-a4cb9706-2448-4789-b7ef-8c4bef62e160 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:39:01 user nova-compute[72382]: WARNING nova.compute.manager [req-f0a1aedb-10ff-4315-bd03-99596c392990 req-228c0245-ce9b-4273-948e-41094bd7518b service nova] [instance: 402ba448-a30a-45f2-a724-5a53cf584547] Received unexpected event network-vif-plugged-a4cb9706-2448-4789-b7ef-8c4bef62e160 for instance with vm_state shelved_offloaded and task_state spawning.
Aug 09 15:39:01 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 402ba448-a30a-45f2-a724-5a53cf584547] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:39:01 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 402ba448-a30a-45f2-a724-5a53cf584547] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=72382) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 15:39:01 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 402ba448-a30a-45f2-a724-5a53cf584547] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 15:39:01 user nova-compute[72382]: DEBUG nova.compute.manager [None req-75c6fed7-2a80-47ba-a6dc-dd1c85d5fce6 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] [instance: 402ba448-a30a-45f2-a724-5a53cf584547] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:39:01 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-75c6fed7-2a80-47ba-a6dc-dd1c85d5fce6 tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Lock "402ba448-a30a-45f2-a724-5a53cf584547" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 10.851s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:39:02 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:39:04 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:39:07 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:39:09 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-410b83db-df55-45d6-87ea-d541b78edab6 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Acquiring lock "54523d3e-bfae-4621-85cb-d6a7bc40abf5" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:39:09 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-410b83db-df55-45d6-87ea-d541b78edab6 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Lock "54523d3e-bfae-4621-85cb-d6a7bc40abf5" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:39:09 user nova-compute[72382]: DEBUG nova.compute.manager [None req-410b83db-df55-45d6-87ea-d541b78edab6 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] [instance: 54523d3e-bfae-4621-85cb-d6a7bc40abf5] Going to confirm migration 2 {{(pid=72382) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4694}}
Aug 09 15:39:09 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-410b83db-df55-45d6-87ea-d541b78edab6 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Acquiring lock "refresh_cache-54523d3e-bfae-4621-85cb-d6a7bc40abf5" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 15:39:09 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-410b83db-df55-45d6-87ea-d541b78edab6 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Acquired lock "refresh_cache-54523d3e-bfae-4621-85cb-d6a7bc40abf5" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 15:39:09 user nova-compute[72382]: DEBUG nova.network.neutron [None req-410b83db-df55-45d6-87ea-d541b78edab6 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] [instance: 54523d3e-bfae-4621-85cb-d6a7bc40abf5] Building network info cache for instance {{(pid=72382) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 15:39:09 user nova-compute[72382]: DEBUG nova.objects.instance [None req-410b83db-df55-45d6-87ea-d541b78edab6 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Lazy-loading 'info_cache' on Instance uuid 54523d3e-bfae-4621-85cb-d6a7bc40abf5 {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:39:10 user nova-compute[72382]: DEBUG nova.network.neutron [None req-410b83db-df55-45d6-87ea-d541b78edab6 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] [instance: 54523d3e-bfae-4621-85cb-d6a7bc40abf5] Updating instance_info_cache with network_info: [{"id": "8557ab28-9722-4e6e-a14d-f941e3b693c8", "address": "fa:16:3e:40:5f:a8", "network": {"id": "308641dc-cc18-41db-9baa-7cc880e594ad", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1932973397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb5bf3f95d2843af94dbcab2af932bd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8557ab28-97", "ovs_interfaceid": "8557ab28-9722-4e6e-a14d-f941e3b693c8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:39:10 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-410b83db-df55-45d6-87ea-d541b78edab6 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Releasing lock "refresh_cache-54523d3e-bfae-4621-85cb-d6a7bc40abf5" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 15:39:10 user nova-compute[72382]: DEBUG nova.objects.instance [None req-410b83db-df55-45d6-87ea-d541b78edab6 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Lazy-loading 'migration_context' on Instance uuid 54523d3e-bfae-4621-85cb-d6a7bc40abf5 {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:39:10 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-410b83db-df55-45d6-87ea-d541b78edab6 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:39:10 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-410b83db-df55-45d6-87ea-d541b78edab6 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:39:10 user nova-compute[72382]: DEBUG nova.compute.provider_tree [None req-410b83db-df55-45d6-87ea-d541b78edab6 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Inventory has not changed in ProviderTree for provider: 7b15b0e5-df4d-49db-833b-2855d21d10ae {{(pid=72382) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 15:39:10 user nova-compute[72382]: DEBUG nova.scheduler.client.report [None req-410b83db-df55-45d6-87ea-d541b78edab6 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Inventory has not changed for provider 7b15b0e5-df4d-49db-833b-2855d21d10ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72382) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 15:39:10 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-410b83db-df55-45d6-87ea-d541b78edab6 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.276s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:39:10 user nova-compute[72382]: INFO nova.scheduler.client.report [None req-410b83db-df55-45d6-87ea-d541b78edab6 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Deleted allocation for migration c31f6e97-fa8b-4d15-9ea5-540eb0d7d304
Aug 09 15:39:10 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-410b83db-df55-45d6-87ea-d541b78edab6 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Lock "54523d3e-bfae-4621-85cb-d6a7bc40abf5" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.351s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:39:12 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:39:14 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:39:14 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:39:14 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:39:14 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:39:14 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Auditing locally available compute resources for user (node: user) {{(pid=72382) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 15:39:15 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=72382) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 15:39:15 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7949b7d0-2712-402f-86ee-30acaef2d3e7/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:39:15 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7949b7d0-2712-402f-86ee-30acaef2d3e7/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:39:15 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7949b7d0-2712-402f-86ee-30acaef2d3e7/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:39:15 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7949b7d0-2712-402f-86ee-30acaef2d3e7/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:39:15 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72382) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 15:39:15 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/402ba448-a30a-45f2-a724-5a53cf584547/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:39:15 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/402ba448-a30a-45f2-a724-5a53cf584547/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:39:15 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/402ba448-a30a-45f2-a724-5a53cf584547/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:39:15 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/402ba448-a30a-45f2-a724-5a53cf584547/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:39:15 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ccbfda2-8bcd-4ec1-972a-cf49a62b1583/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:39:16 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ccbfda2-8bcd-4ec1-972a-cf49a62b1583/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:39:16 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ccbfda2-8bcd-4ec1-972a-cf49a62b1583/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:39:16 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ccbfda2-8bcd-4ec1-972a-cf49a62b1583/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:39:16 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72382) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 15:39:16 user nova-compute[72382]: WARNING nova.virt.libvirt.driver [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 15:39:16 user nova-compute[72382]: WARNING nova.virt.libvirt.driver [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 15:39:16 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Hypervisor/Node resource view: name=user free_ram=7999MB free_disk=25.372817993164062GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72382) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 15:39:16 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:39:16 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:39:16 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance 4ccbfda2-8bcd-4ec1-972a-cf49a62b1583 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:39:16 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance 7949b7d0-2712-402f-86ee-30acaef2d3e7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:39:16 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance 54523d3e-bfae-4621-85cb-d6a7bc40abf5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:39:16 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance c88a5ff2-9789-4ee8-8283-6248bba6d66a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:39:16 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance 402ba448-a30a-45f2-a724-5a53cf584547 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:39:16 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=72382) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 15:39:16 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=72382) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 15:39:16 user nova-compute[72382]: DEBUG nova.compute.provider_tree [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Inventory has not changed in ProviderTree for provider: 7b15b0e5-df4d-49db-833b-2855d21d10ae {{(pid=72382) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 15:39:16 user nova-compute[72382]: DEBUG nova.scheduler.client.report [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Inventory has not changed for provider 7b15b0e5-df4d-49db-833b-2855d21d10ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72382) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 15:39:16 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Compute_service record updated for user:user {{(pid=72382) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 15:39:16 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.368s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:39:17 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:39:17 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:39:17 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72382) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 15:39:17 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72382) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 15:39:17 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72382) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 15:39:17 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:39:19 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:39:19 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:39:20 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:39:20 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:39:21 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:39:21 user nova-compute[72382]: DEBUG nova.compute.manager [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Starting heal instance info cache {{(pid=72382) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 15:39:21 user nova-compute[72382]: DEBUG nova.compute.manager [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Didn't find any instances for network info cache update. {{(pid=72382) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 09 15:39:21 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:39:21 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:39:21 user nova-compute[72382]: DEBUG nova.compute.manager [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72382) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 15:39:22 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:39:24 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:39:24 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:39:25 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:39:27 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:39:27 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-eb1b8b3f-c181-4999-a926-673d5803ff97 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Acquiring lock "3855b76f-87cc-4be0-982c-4cc5cf5cd8aa" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:39:27 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-eb1b8b3f-c181-4999-a926-673d5803ff97 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Lock "3855b76f-87cc-4be0-982c-4cc5cf5cd8aa" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:39:27 user nova-compute[72382]: DEBUG nova.compute.manager [None req-eb1b8b3f-c181-4999-a926-673d5803ff97 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: 3855b76f-87cc-4be0-982c-4cc5cf5cd8aa] Starting instance... {{(pid=72382) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 15:39:28 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-eb1b8b3f-c181-4999-a926-673d5803ff97 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:39:28 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-eb1b8b3f-c181-4999-a926-673d5803ff97 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:39:28 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-eb1b8b3f-c181-4999-a926-673d5803ff97 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72382) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 15:39:28 user nova-compute[72382]: INFO nova.compute.claims [None req-eb1b8b3f-c181-4999-a926-673d5803ff97 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: 3855b76f-87cc-4be0-982c-4cc5cf5cd8aa] Claim successful on node user
Aug 09 15:39:28 user nova-compute[72382]: DEBUG nova.compute.provider_tree [None req-eb1b8b3f-c181-4999-a926-673d5803ff97 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Inventory has not changed in ProviderTree for provider: 7b15b0e5-df4d-49db-833b-2855d21d10ae {{(pid=72382) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 15:39:28 user nova-compute[72382]: DEBUG nova.scheduler.client.report [None req-eb1b8b3f-c181-4999-a926-673d5803ff97 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Inventory has not changed for provider 7b15b0e5-df4d-49db-833b-2855d21d10ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72382) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 15:39:28 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-eb1b8b3f-c181-4999-a926-673d5803ff97 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.380s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:39:28 user nova-compute[72382]: DEBUG nova.compute.manager [None req-eb1b8b3f-c181-4999-a926-673d5803ff97 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: 3855b76f-87cc-4be0-982c-4cc5cf5cd8aa] Start building networks asynchronously for instance. {{(pid=72382) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 15:39:28 user nova-compute[72382]: DEBUG nova.compute.manager [None req-eb1b8b3f-c181-4999-a926-673d5803ff97 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: 3855b76f-87cc-4be0-982c-4cc5cf5cd8aa] Allocating IP information in the background. {{(pid=72382) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 15:39:28 user nova-compute[72382]: DEBUG nova.network.neutron [None req-eb1b8b3f-c181-4999-a926-673d5803ff97 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: 3855b76f-87cc-4be0-982c-4cc5cf5cd8aa] allocate_for_instance() {{(pid=72382) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 15:39:28 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-eb1b8b3f-c181-4999-a926-673d5803ff97 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: 3855b76f-87cc-4be0-982c-4cc5cf5cd8aa] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 15:39:28 user nova-compute[72382]: DEBUG nova.compute.manager [None req-eb1b8b3f-c181-4999-a926-673d5803ff97 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: 3855b76f-87cc-4be0-982c-4cc5cf5cd8aa] Start building block device mappings for instance. {{(pid=72382) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 15:39:28 user nova-compute[72382]: INFO nova.virt.block_device [None req-eb1b8b3f-c181-4999-a926-673d5803ff97 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: 3855b76f-87cc-4be0-982c-4cc5cf5cd8aa] Booting with volume 3f58579c-f69a-4bee-b16e-970e5a8f590c at /dev/vda
Aug 09 15:39:28 user nova-compute[72382]: DEBUG nova.policy [None req-eb1b8b3f-c181-4999-a926-673d5803ff97 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '280bcf2afd7245a7bcd605e0db79c569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70310b1af40b4d239fe5ea362972554b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72382) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 15:39:28 user nova-compute[72382]: DEBUG os_brick.utils [None req-eb1b8b3f-c181-4999-a926-673d5803ff97 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 15:39:28 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:39:28 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:39:28 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8a55509-5faf-4491-b797-8fcb82b03e90]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d2cfa7015fe\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:39:28 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:39:28 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:39:28 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[93b3872a-0ef4-4319-80bf-a361371637be]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:39:28 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:39:28 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.045s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:39:28 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[119f10e2-e14c-4d8d-b0a9-7afac8bf030c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:39:28 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a468c6c-46bf-4633-9e31-f0bcf6ca5a59]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:39:28 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-eb1b8b3f-c181-4999-a926-673d5803ff97 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Running cmd (subprocess): nvme version {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:39:28 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-eb1b8b3f-c181-4999-a926-673d5803ff97 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] 'nvme version' failed. Not Retrying. {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 15:39:28 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.nvmeof [None req-eb1b8b3f-c181-4999-a926-673d5803ff97 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] nvme not present on system {{(pid=72382) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 15:39:28 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:39:28 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:39:28 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 15:39:28 user nova-compute[72382]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 15:39:28 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c0fdd1d-bf42-4097-a304-29972a78fe2e]: (4, '') {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:39:28 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.lightos [None req-eb1b8b3f-c181-4999-a926-673d5803ff97 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72382) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 15:39:28 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.lightos [None req-eb1b8b3f-c181-4999-a926-673d5803ff97 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72382) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 15:39:28 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.lightos [None req-eb1b8b3f-c181-4999-a926-673d5803ff97 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] LIGHTOS: no hostnqn found. {{(pid=72382) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 15:39:28 user nova-compute[72382]: DEBUG os_brick.utils [None req-eb1b8b3f-c181-4999-a926-673d5803ff97 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] <== get_connector_properties: return (171ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d2cfa7015fe', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 15:39:28 user nova-compute[72382]: DEBUG nova.virt.block_device [None req-eb1b8b3f-c181-4999-a926-673d5803ff97 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: 3855b76f-87cc-4be0-982c-4cc5cf5cd8aa] Updating existing volume attachment record: d108e99e-2b17-477e-bbe8-37249c07298a {{(pid=72382) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 15:39:29 user nova-compute[72382]: DEBUG nova.network.neutron [None req-eb1b8b3f-c181-4999-a926-673d5803ff97 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: 3855b76f-87cc-4be0-982c-4cc5cf5cd8aa] Successfully created port: b7c16d4a-24b4-4ba6-860a-d180123dd204 {{(pid=72382) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 15:39:29 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:39:29 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:39:29 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-c7e06127-d3d0-462e-80a9-f8713f5c2b72 tempest-VolumesActionsTest-1154417962 tempest-VolumesActionsTest-1154417962-project-member] Acquiring lock "b0da60bf-7468-4041-8016-54e3d82386b7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:39:29 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-c7e06127-d3d0-462e-80a9-f8713f5c2b72 tempest-VolumesActionsTest-1154417962 tempest-VolumesActionsTest-1154417962-project-member] Lock "b0da60bf-7468-4041-8016-54e3d82386b7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:39:29 user nova-compute[72382]: DEBUG nova.compute.manager [None req-c7e06127-d3d0-462e-80a9-f8713f5c2b72 tempest-VolumesActionsTest-1154417962 tempest-VolumesActionsTest-1154417962-project-member] [instance: b0da60bf-7468-4041-8016-54e3d82386b7] Starting instance... {{(pid=72382) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 15:39:29 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-c7e06127-d3d0-462e-80a9-f8713f5c2b72 tempest-VolumesActionsTest-1154417962 tempest-VolumesActionsTest-1154417962-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:39:29 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-c7e06127-d3d0-462e-80a9-f8713f5c2b72 tempest-VolumesActionsTest-1154417962 tempest-VolumesActionsTest-1154417962-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:39:30 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-c7e06127-d3d0-462e-80a9-f8713f5c2b72 tempest-VolumesActionsTest-1154417962 tempest-VolumesActionsTest-1154417962-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72382) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 15:39:30 user nova-compute[72382]: INFO nova.compute.claims [None req-c7e06127-d3d0-462e-80a9-f8713f5c2b72 tempest-VolumesActionsTest-1154417962 tempest-VolumesActionsTest-1154417962-project-member] [instance: b0da60bf-7468-4041-8016-54e3d82386b7] Claim successful on node user
Aug 09 15:39:30 user nova-compute[72382]: DEBUG nova.compute.provider_tree [None req-c7e06127-d3d0-462e-80a9-f8713f5c2b72 tempest-VolumesActionsTest-1154417962 tempest-VolumesActionsTest-1154417962-project-member] Inventory has not changed in ProviderTree for provider: 7b15b0e5-df4d-49db-833b-2855d21d10ae {{(pid=72382) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 15:39:30 user nova-compute[72382]: DEBUG nova.scheduler.client.report [None req-c7e06127-d3d0-462e-80a9-f8713f5c2b72 tempest-VolumesActionsTest-1154417962 tempest-VolumesActionsTest-1154417962-project-member] Inventory has not changed for provider 7b15b0e5-df4d-49db-833b-2855d21d10ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72382) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 15:39:30 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-c7e06127-d3d0-462e-80a9-f8713f5c2b72 tempest-VolumesActionsTest-1154417962 tempest-VolumesActionsTest-1154417962-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.382s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:39:30 user nova-compute[72382]: DEBUG nova.compute.manager [None req-c7e06127-d3d0-462e-80a9-f8713f5c2b72 tempest-VolumesActionsTest-1154417962 tempest-VolumesActionsTest-1154417962-project-member] [instance: b0da60bf-7468-4041-8016-54e3d82386b7] Start building networks asynchronously for instance. {{(pid=72382) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 15:39:30 user nova-compute[72382]: DEBUG nova.compute.manager [None req-c7e06127-d3d0-462e-80a9-f8713f5c2b72 tempest-VolumesActionsTest-1154417962 tempest-VolumesActionsTest-1154417962-project-member] [instance: b0da60bf-7468-4041-8016-54e3d82386b7] Allocating IP information in the background. {{(pid=72382) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 15:39:30 user nova-compute[72382]: DEBUG nova.network.neutron [None req-c7e06127-d3d0-462e-80a9-f8713f5c2b72 tempest-VolumesActionsTest-1154417962 tempest-VolumesActionsTest-1154417962-project-member] [instance: b0da60bf-7468-4041-8016-54e3d82386b7] allocate_for_instance() {{(pid=72382) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 15:39:30 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-c7e06127-d3d0-462e-80a9-f8713f5c2b72 tempest-VolumesActionsTest-1154417962 tempest-VolumesActionsTest-1154417962-project-member] [instance: b0da60bf-7468-4041-8016-54e3d82386b7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 15:39:30 user nova-compute[72382]: DEBUG nova.compute.manager [None req-c7e06127-d3d0-462e-80a9-f8713f5c2b72 tempest-VolumesActionsTest-1154417962 tempest-VolumesActionsTest-1154417962-project-member] [instance: b0da60bf-7468-4041-8016-54e3d82386b7] Start building block device mappings for instance. {{(pid=72382) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 15:39:30 user nova-compute[72382]: DEBUG nova.compute.manager [None req-c7e06127-d3d0-462e-80a9-f8713f5c2b72 tempest-VolumesActionsTest-1154417962 tempest-VolumesActionsTest-1154417962-project-member] [instance: b0da60bf-7468-4041-8016-54e3d82386b7] Start spawning the instance on the hypervisor. {{(pid=72382) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 15:39:30 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-c7e06127-d3d0-462e-80a9-f8713f5c2b72 tempest-VolumesActionsTest-1154417962 tempest-VolumesActionsTest-1154417962-project-member] [instance: b0da60bf-7468-4041-8016-54e3d82386b7] Creating instance directory {{(pid=72382) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 15:39:30 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-c7e06127-d3d0-462e-80a9-f8713f5c2b72 tempest-VolumesActionsTest-1154417962 tempest-VolumesActionsTest-1154417962-project-member] [instance: b0da60bf-7468-4041-8016-54e3d82386b7] Creating image(s)
Aug 09 15:39:30 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-c7e06127-d3d0-462e-80a9-f8713f5c2b72 tempest-VolumesActionsTest-1154417962 tempest-VolumesActionsTest-1154417962-project-member] Acquiring lock "/opt/stack/data/nova/instances/b0da60bf-7468-4041-8016-54e3d82386b7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:39:30 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-c7e06127-d3d0-462e-80a9-f8713f5c2b72 tempest-VolumesActionsTest-1154417962 tempest-VolumesActionsTest-1154417962-project-member] Lock "/opt/stack/data/nova/instances/b0da60bf-7468-4041-8016-54e3d82386b7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:39:30 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-c7e06127-d3d0-462e-80a9-f8713f5c2b72 tempest-VolumesActionsTest-1154417962 tempest-VolumesActionsTest-1154417962-project-member] Lock "/opt/stack/data/nova/instances/b0da60bf-7468-4041-8016-54e3d82386b7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:39:30 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-c7e06127-d3d0-462e-80a9-f8713f5c2b72 tempest-VolumesActionsTest-1154417962 tempest-VolumesActionsTest-1154417962-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:39:30 user nova-compute[72382]: DEBUG nova.policy [None req-c7e06127-d3d0-462e-80a9-f8713f5c2b72 tempest-VolumesActionsTest-1154417962 tempest-VolumesActionsTest-1154417962-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a780bb50b3d54386b8ed790da8a6cbea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7bd7707b7d84acdb15e5f89b6720ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72382) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 15:39:30 user nova-compute[72382]: DEBUG nova.network.neutron [None req-eb1b8b3f-c181-4999-a926-673d5803ff97 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: 3855b76f-87cc-4be0-982c-4cc5cf5cd8aa] Successfully updated port: b7c16d4a-24b4-4ba6-860a-d180123dd204 {{(pid=72382) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 15:39:30 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-eb1b8b3f-c181-4999-a926-673d5803ff97 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Acquiring lock "refresh_cache-3855b76f-87cc-4be0-982c-4cc5cf5cd8aa" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 15:39:30 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-eb1b8b3f-c181-4999-a926-673d5803ff97 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Acquired lock "refresh_cache-3855b76f-87cc-4be0-982c-4cc5cf5cd8aa" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 15:39:30 user nova-compute[72382]: DEBUG nova.network.neutron [None req-eb1b8b3f-c181-4999-a926-673d5803ff97 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: 3855b76f-87cc-4be0-982c-4cc5cf5cd8aa] Building network info cache for instance {{(pid=72382) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 15:39:30 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-c7e06127-d3d0-462e-80a9-f8713f5c2b72 tempest-VolumesActionsTest-1154417962 tempest-VolumesActionsTest-1154417962-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b --force-share --output=json" returned: 0 in 0.162s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:39:30 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-c7e06127-d3d0-462e-80a9-f8713f5c2b72 tempest-VolumesActionsTest-1154417962 tempest-VolumesActionsTest-1154417962-project-member] Acquiring lock "383812ff437283e0191ed5b9ecc04c27f1162b0b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:39:30 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-c7e06127-d3d0-462e-80a9-f8713f5c2b72 tempest-VolumesActionsTest-1154417962 tempest-VolumesActionsTest-1154417962-project-member] Lock "383812ff437283e0191ed5b9ecc04c27f1162b0b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:39:30 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-c7e06127-d3d0-462e-80a9-f8713f5c2b72 tempest-VolumesActionsTest-1154417962 tempest-VolumesActionsTest-1154417962-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:39:30 user nova-compute[72382]: DEBUG nova.compute.manager [req-30061a3c-2ebb-4279-896b-449079cf6aae req-71073262-2c62-4196-a6f6-6187d792165b service nova] [instance: 3855b76f-87cc-4be0-982c-4cc5cf5cd8aa] Received event network-changed-b7c16d4a-24b4-4ba6-860a-d180123dd204 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:39:30 user nova-compute[72382]: DEBUG nova.compute.manager [req-30061a3c-2ebb-4279-896b-449079cf6aae req-71073262-2c62-4196-a6f6-6187d792165b service nova] [instance: 3855b76f-87cc-4be0-982c-4cc5cf5cd8aa] Refreshing instance network info cache due to event network-changed-b7c16d4a-24b4-4ba6-860a-d180123dd204. {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 15:39:30 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-30061a3c-2ebb-4279-896b-449079cf6aae req-71073262-2c62-4196-a6f6-6187d792165b service nova] Acquiring lock "refresh_cache-3855b76f-87cc-4be0-982c-4cc5cf5cd8aa" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 15:39:30 user nova-compute[72382]: DEBUG nova.network.neutron [None req-eb1b8b3f-c181-4999-a926-673d5803ff97 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: 3855b76f-87cc-4be0-982c-4cc5cf5cd8aa] Instance cache missing network info. {{(pid=72382) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 15:39:30 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-c7e06127-d3d0-462e-80a9-f8713f5c2b72 tempest-VolumesActionsTest-1154417962 tempest-VolumesActionsTest-1154417962-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b --force-share --output=json" returned: 0 in 0.134s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:39:30 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-c7e06127-d3d0-462e-80a9-f8713f5c2b72 tempest-VolumesActionsTest-1154417962 tempest-VolumesActionsTest-1154417962-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b,backing_fmt=raw /opt/stack/data/nova/instances/b0da60bf-7468-4041-8016-54e3d82386b7/disk 1073741824 {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:39:30 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-c7e06127-d3d0-462e-80a9-f8713f5c2b72 tempest-VolumesActionsTest-1154417962 tempest-VolumesActionsTest-1154417962-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b,backing_fmt=raw /opt/stack/data/nova/instances/b0da60bf-7468-4041-8016-54e3d82386b7/disk 1073741824" returned: 0 in 0.050s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:39:30 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-c7e06127-d3d0-462e-80a9-f8713f5c2b72 tempest-VolumesActionsTest-1154417962 tempest-VolumesActionsTest-1154417962-project-member] Lock "383812ff437283e0191ed5b9ecc04c27f1162b0b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.189s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:39:30 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-c7e06127-d3d0-462e-80a9-f8713f5c2b72 tempest-VolumesActionsTest-1154417962 tempest-VolumesActionsTest-1154417962-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:39:31 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-c7e06127-d3d0-462e-80a9-f8713f5c2b72 tempest-VolumesActionsTest-1154417962 tempest-VolumesActionsTest-1154417962-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b --force-share --output=json" returned: 0 in 0.137s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:39:31 user nova-compute[72382]: DEBUG nova.virt.disk.api [None req-c7e06127-d3d0-462e-80a9-f8713f5c2b72 tempest-VolumesActionsTest-1154417962 tempest-VolumesActionsTest-1154417962-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b0da60bf-7468-4041-8016-54e3d82386b7/disk. size=1073741824 {{(pid=72382) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 15:39:31 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-c7e06127-d3d0-462e-80a9-f8713f5c2b72 tempest-VolumesActionsTest-1154417962 tempest-VolumesActionsTest-1154417962-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0da60bf-7468-4041-8016-54e3d82386b7/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:39:31 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-c7e06127-d3d0-462e-80a9-f8713f5c2b72 tempest-VolumesActionsTest-1154417962 tempest-VolumesActionsTest-1154417962-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0da60bf-7468-4041-8016-54e3d82386b7/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:39:31 user nova-compute[72382]: DEBUG nova.virt.disk.api [None req-c7e06127-d3d0-462e-80a9-f8713f5c2b72 tempest-VolumesActionsTest-1154417962 tempest-VolumesActionsTest-1154417962-project-member] Cannot resize image /opt/stack/data/nova/instances/b0da60bf-7468-4041-8016-54e3d82386b7/disk to a smaller size. {{(pid=72382) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 15:39:31 user nova-compute[72382]: DEBUG nova.objects.instance [None req-c7e06127-d3d0-462e-80a9-f8713f5c2b72 tempest-VolumesActionsTest-1154417962 tempest-VolumesActionsTest-1154417962-project-member] Lazy-loading 'migration_context' on Instance uuid b0da60bf-7468-4041-8016-54e3d82386b7 {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:39:31 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-c7e06127-d3d0-462e-80a9-f8713f5c2b72 tempest-VolumesActionsTest-1154417962 tempest-VolumesActionsTest-1154417962-project-member] [instance: b0da60bf-7468-4041-8016-54e3d82386b7] Created local disks {{(pid=72382) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 15:39:31 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-c7e06127-d3d0-462e-80a9-f8713f5c2b72 tempest-VolumesActionsTest-1154417962 tempest-VolumesActionsTest-1154417962-project-member] [instance: b0da60bf-7468-4041-8016-54e3d82386b7] Ensure instance console log exists: /opt/stack/data/nova/instances/b0da60bf-7468-4041-8016-54e3d82386b7/console.log {{(pid=72382) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 15:39:31 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-c7e06127-d3d0-462e-80a9-f8713f5c2b72 tempest-VolumesActionsTest-1154417962 tempest-VolumesActionsTest-1154417962-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:39:31 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-c7e06127-d3d0-462e-80a9-f8713f5c2b72 tempest-VolumesActionsTest-1154417962 tempest-VolumesActionsTest-1154417962-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:39:31 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-c7e06127-d3d0-462e-80a9-f8713f5c2b72 tempest-VolumesActionsTest-1154417962 tempest-VolumesActionsTest-1154417962-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:39:31 user nova-compute[72382]: DEBUG nova.network.neutron [None req-eb1b8b3f-c181-4999-a926-673d5803ff97 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: 3855b76f-87cc-4be0-982c-4cc5cf5cd8aa] Updating instance_info_cache with network_info: [{"id": "b7c16d4a-24b4-4ba6-860a-d180123dd204", "address": "fa:16:3e:01:6f:fa", "network": {"id": "a78e6cb6-feb7-4f64-a3c0-4900594b6e37", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-338007968-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70310b1af40b4d239fe5ea362972554b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7c16d4a-24", "ovs_interfaceid": "b7c16d4a-24b4-4ba6-860a-d180123dd204", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:39:31 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-eb1b8b3f-c181-4999-a926-673d5803ff97 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Releasing lock "refresh_cache-3855b76f-87cc-4be0-982c-4cc5cf5cd8aa" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 15:39:31 user nova-compute[72382]: DEBUG nova.compute.manager [None req-eb1b8b3f-c181-4999-a926-673d5803ff97 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: 3855b76f-87cc-4be0-982c-4cc5cf5cd8aa] Instance network_info: |[{"id": "b7c16d4a-24b4-4ba6-860a-d180123dd204", "address": "fa:16:3e:01:6f:fa", "network": {"id": "a78e6cb6-feb7-4f64-a3c0-4900594b6e37", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-338007968-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70310b1af40b4d239fe5ea362972554b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7c16d4a-24", "ovs_interfaceid": "b7c16d4a-24b4-4ba6-860a-d180123dd204", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72382) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 15:39:31 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-30061a3c-2ebb-4279-896b-449079cf6aae req-71073262-2c62-4196-a6f6-6187d792165b service nova] Acquired lock "refresh_cache-3855b76f-87cc-4be0-982c-4cc5cf5cd8aa" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 15:39:31 user nova-compute[72382]: DEBUG nova.network.neutron [req-30061a3c-2ebb-4279-896b-449079cf6aae req-71073262-2c62-4196-a6f6-6187d792165b service nova] [instance: 3855b76f-87cc-4be0-982c-4cc5cf5cd8aa] Refreshing network info cache for port b7c16d4a-24b4-4ba6-860a-d180123dd204 {{(pid=72382) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 15:39:32 user nova-compute[72382]: DEBUG nova.network.neutron [None req-c7e06127-d3d0-462e-80a9-f8713f5c2b72 tempest-VolumesActionsTest-1154417962 tempest-VolumesActionsTest-1154417962-project-member] [instance: b0da60bf-7468-4041-8016-54e3d82386b7] Successfully created port: 768b217d-898e-40e7-9af8-c8c0d9e88e89 {{(pid=72382) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 15:39:32 user nova-compute[72382]: DEBUG nova.network.neutron [req-30061a3c-2ebb-4279-896b-449079cf6aae req-71073262-2c62-4196-a6f6-6187d792165b service nova] [instance: 3855b76f-87cc-4be0-982c-4cc5cf5cd8aa] Updated VIF entry in instance network info cache for port b7c16d4a-24b4-4ba6-860a-d180123dd204. {{(pid=72382) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 15:39:32 user nova-compute[72382]: DEBUG nova.network.neutron [req-30061a3c-2ebb-4279-896b-449079cf6aae req-71073262-2c62-4196-a6f6-6187d792165b service nova] [instance: 3855b76f-87cc-4be0-982c-4cc5cf5cd8aa] Updating instance_info_cache with network_info: [{"id": "b7c16d4a-24b4-4ba6-860a-d180123dd204", "address": "fa:16:3e:01:6f:fa", "network": {"id": "a78e6cb6-feb7-4f64-a3c0-4900594b6e37", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-338007968-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70310b1af40b4d239fe5ea362972554b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7c16d4a-24", "ovs_interfaceid": "b7c16d4a-24b4-4ba6-860a-d180123dd204", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:39:32 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-30061a3c-2ebb-4279-896b-449079cf6aae req-71073262-2c62-4196-a6f6-6187d792165b service nova] Releasing lock "refresh_cache-3855b76f-87cc-4be0-982c-4cc5cf5cd8aa" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 15:39:32 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:39:33 user nova-compute[72382]: DEBUG nova.network.neutron [None req-c7e06127-d3d0-462e-80a9-f8713f5c2b72 tempest-VolumesActionsTest-1154417962 tempest-VolumesActionsTest-1154417962-project-member] [instance: b0da60bf-7468-4041-8016-54e3d82386b7] Successfully updated port: 768b217d-898e-40e7-9af8-c8c0d9e88e89 {{(pid=72382) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 15:39:33 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-c7e06127-d3d0-462e-80a9-f8713f5c2b72 tempest-VolumesActionsTest-1154417962 tempest-VolumesActionsTest-1154417962-project-member] Acquiring lock "refresh_cache-b0da60bf-7468-4041-8016-54e3d82386b7" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 15:39:33 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-c7e06127-d3d0-462e-80a9-f8713f5c2b72 tempest-VolumesActionsTest-1154417962 tempest-VolumesActionsTest-1154417962-project-member] Acquired lock "refresh_cache-b0da60bf-7468-4041-8016-54e3d82386b7" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 15:39:33 user nova-compute[72382]: DEBUG nova.network.neutron [None req-c7e06127-d3d0-462e-80a9-f8713f5c2b72 tempest-VolumesActionsTest-1154417962 tempest-VolumesActionsTest-1154417962-project-member] [instance: b0da60bf-7468-4041-8016-54e3d82386b7] Building network info cache for instance {{(pid=72382) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 15:39:33 user nova-compute[72382]: DEBUG nova.compute.manager [req-e2c10324-3b16-43a3-8dcd-a86519463d7e req-c2df59f0-8c54-48f2-944f-5cb5712dd021 service nova] [instance: b0da60bf-7468-4041-8016-54e3d82386b7] Received event network-changed-768b217d-898e-40e7-9af8-c8c0d9e88e89 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:39:33 user nova-compute[72382]: DEBUG nova.compute.manager [req-e2c10324-3b16-43a3-8dcd-a86519463d7e req-c2df59f0-8c54-48f2-944f-5cb5712dd021 service nova] [instance: b0da60bf-7468-4041-8016-54e3d82386b7] Refreshing instance network info cache due to event network-changed-768b217d-898e-40e7-9af8-c8c0d9e88e89. {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 15:39:33 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-e2c10324-3b16-43a3-8dcd-a86519463d7e req-c2df59f0-8c54-48f2-944f-5cb5712dd021 service nova] Acquiring lock "refresh_cache-b0da60bf-7468-4041-8016-54e3d82386b7" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 15:39:33 user nova-compute[72382]: DEBUG nova.network.neutron [None req-c7e06127-d3d0-462e-80a9-f8713f5c2b72 tempest-VolumesActionsTest-1154417962 tempest-VolumesActionsTest-1154417962-project-member] [instance: b0da60bf-7468-4041-8016-54e3d82386b7] Instance cache missing network info. {{(pid=72382) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 15:39:33 user nova-compute[72382]: DEBUG nova.network.neutron [None req-c7e06127-d3d0-462e-80a9-f8713f5c2b72 tempest-VolumesActionsTest-1154417962 tempest-VolumesActionsTest-1154417962-project-member] [instance: b0da60bf-7468-4041-8016-54e3d82386b7] Updating instance_info_cache with network_info: [{"id": "768b217d-898e-40e7-9af8-c8c0d9e88e89", "address": "fa:16:3e:7d:85:ab", "network": {"id": "7cba5169-ea03-4ec4-a7e4-11b56c637e26", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1109056022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7bd7707b7d84acdb15e5f89b6720ff7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap768b217d-89", "ovs_interfaceid": "768b217d-898e-40e7-9af8-c8c0d9e88e89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:39:33 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-c7e06127-d3d0-462e-80a9-f8713f5c2b72 tempest-VolumesActionsTest-1154417962 tempest-VolumesActionsTest-1154417962-project-member] Releasing lock "refresh_cache-b0da60bf-7468-4041-8016-54e3d82386b7" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 15:39:33 user nova-compute[72382]: DEBUG nova.compute.manager [None req-c7e06127-d3d0-462e-80a9-f8713f5c2b72 tempest-VolumesActionsTest-1154417962 tempest-VolumesActionsTest-1154417962-project-member] [instance: b0da60bf-7468-4041-8016-54e3d82386b7] Instance network_info: |[{"id": "768b217d-898e-40e7-9af8-c8c0d9e88e89", "address": "fa:16:3e:7d:85:ab", "network": {"id": "7cba5169-ea03-4ec4-a7e4-11b56c637e26", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1109056022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7bd7707b7d84acdb15e5f89b6720ff7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap768b217d-89", "ovs_interfaceid": "768b217d-898e-40e7-9af8-c8c0d9e88e89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72382) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 15:39:33 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-e2c10324-3b16-43a3-8dcd-a86519463d7e req-c2df59f0-8c54-48f2-944f-5cb5712dd021 service nova] Acquired lock "refresh_cache-b0da60bf-7468-4041-8016-54e3d82386b7" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 15:39:33 user nova-compute[72382]: DEBUG nova.network.neutron [req-e2c10324-3b16-43a3-8dcd-a86519463d7e req-c2df59f0-8c54-48f2-944f-5cb5712dd021 service nova] [instance: b0da60bf-7468-4041-8016-54e3d82386b7] Refreshing network info cache for port 768b217d-898e-40e7-9af8-c8c0d9e88e89 {{(pid=72382) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 15:39:33 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-c7e06127-d3d0-462e-80a9-f8713f5c2b72 tempest-VolumesActionsTest-1154417962 tempest-VolumesActionsTest-1154417962-project-member] [instance: b0da60bf-7468-4041-8016-54e3d82386b7] Start _get_guest_xml network_info=[{"id": "768b217d-898e-40e7-9af8-c8c0d9e88e89", "address": "fa:16:3e:7d:85:ab", "network": {"id": "7cba5169-ea03-4ec4-a7e4-11b56c637e26", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1109056022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7bd7707b7d84acdb15e5f89b6720ff7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap768b217d-89", "ovs_interfaceid": "768b217d-898e-40e7-9af8-c8c0d9e88e89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T15:11:25Z,direct_url=<?>,disk_format='qcow2',id=a79f2cea-eb27-4631-aaf3-05e7d9e411b4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a638990e12cc4d6eabb6d55e13be6bdf',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T15:11:27Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'a79f2cea-eb27-4631-aaf3-05e7d9e411b4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72382) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 15:39:33 user nova-compute[72382]: WARNING nova.virt.libvirt.driver [None req-c7e06127-d3d0-462e-80a9-f8713f5c2b72 tempest-VolumesActionsTest-1154417962 tempest-VolumesActionsTest-1154417962-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 15:39:33 user nova-compute[72382]: WARNING nova.virt.libvirt.driver [None req-c7e06127-d3d0-462e-80a9-f8713f5c2b72 tempest-VolumesActionsTest-1154417962 tempest-VolumesActionsTest-1154417962-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 15:39:33 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-c7e06127-d3d0-462e-80a9-f8713f5c2b72 tempest-VolumesActionsTest-1154417962 tempest-VolumesActionsTest-1154417962-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72382) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 15:39:33 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-c7e06127-d3d0-462e-80a9-f8713f5c2b72 tempest-VolumesActionsTest-1154417962 tempest-VolumesActionsTest-1154417962-project-member] CPU controller missing on host. {{(pid=72382) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 15:39:33 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-c7e06127-d3d0-462e-80a9-f8713f5c2b72 tempest-VolumesActionsTest-1154417962 tempest-VolumesActionsTest-1154417962-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72382) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 15:39:33 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-c7e06127-d3d0-462e-80a9-f8713f5c2b72 tempest-VolumesActionsTest-1154417962 tempest-VolumesActionsTest-1154417962-project-member] CPU controller found on host. {{(pid=72382) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 15:39:33 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-c7e06127-d3d0-462e-80a9-f8713f5c2b72 tempest-VolumesActionsTest-1154417962 tempest-VolumesActionsTest-1154417962-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72382) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 15:39:33 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-c7e06127-d3d0-462e-80a9-f8713f5c2b72 tempest-VolumesActionsTest-1154417962 tempest-VolumesActionsTest-1154417962-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T15:11:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T15:11:25Z,direct_url=<?>,disk_format='qcow2',id=a79f2cea-eb27-4631-aaf3-05e7d9e411b4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a638990e12cc4d6eabb6d55e13be6bdf',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T15:11:27Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 15:39:33 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-c7e06127-d3d0-462e-80a9-f8713f5c2b72 tempest-VolumesActionsTest-1154417962 tempest-VolumesActionsTest-1154417962-project-member] Flavor limits 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 15:39:33 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-c7e06127-d3d0-462e-80a9-f8713f5c2b72 tempest-VolumesActionsTest-1154417962 tempest-VolumesActionsTest-1154417962-project-member] Image limits 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 15:39:33 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-c7e06127-d3d0-462e-80a9-f8713f5c2b72 tempest-VolumesActionsTest-1154417962 tempest-VolumesActionsTest-1154417962-project-member] Flavor pref 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 15:39:33 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-c7e06127-d3d0-462e-80a9-f8713f5c2b72 tempest-VolumesActionsTest-1154417962 tempest-VolumesActionsTest-1154417962-project-member] Image pref 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 15:39:33 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-c7e06127-d3d0-462e-80a9-f8713f5c2b72 tempest-VolumesActionsTest-1154417962 tempest-VolumesActionsTest-1154417962-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 15:39:33 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-c7e06127-d3d0-462e-80a9-f8713f5c2b72 tempest-VolumesActionsTest-1154417962 tempest-VolumesActionsTest-1154417962-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 15:39:33 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-c7e06127-d3d0-462e-80a9-f8713f5c2b72 tempest-VolumesActionsTest-1154417962 tempest-VolumesActionsTest-1154417962-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72382) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 15:39:33 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-c7e06127-d3d0-462e-80a9-f8713f5c2b72 tempest-VolumesActionsTest-1154417962 tempest-VolumesActionsTest-1154417962-project-member] Got 1 possible topologies {{(pid=72382) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 15:39:33 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-c7e06127-d3d0-462e-80a9-f8713f5c2b72 tempest-VolumesActionsTest-1154417962 tempest-VolumesActionsTest-1154417962-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 15:39:33 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-c7e06127-d3d0-462e-80a9-f8713f5c2b72 tempest-VolumesActionsTest-1154417962 tempest-VolumesActionsTest-1154417962-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 15:39:33 user nova-compute[72382]: DEBUG nova.virt.libvirt.vif [None req-c7e06127-d3d0-462e-80a9-f8713f5c2b72 tempest-VolumesActionsTest-1154417962 tempest-VolumesActionsTest-1154417962-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T15:39:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-146743122',display_name='tempest-VolumesActionsTest-instance-146743122',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-146743122',id=45,image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b7bd7707b7d84acdb15e5f89b6720ff7',ramdisk_id='',reservation_id='r-kuwm44rz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1154417962',owner_user_name='tempest-VolumesActionsTest-1154417962-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T15:39:31Z,user_data=None,user_id='a780bb50b3d54386b8ed790da8a6cbea',uuid=b0da60bf-7468-4041-8016-54e3d82386b7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "768b217d-898e-40e7-9af8-c8c0d9e88e89", "address": "fa:16:3e:7d:85:ab", "network": {"id": "7cba5169-ea03-4ec4-a7e4-11b56c637e26", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1109056022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7bd7707b7d84acdb15e5f89b6720ff7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap768b217d-89", "ovs_interfaceid": "768b217d-898e-40e7-9af8-c8c0d9e88e89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72382) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 15:39:33 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-c7e06127-d3d0-462e-80a9-f8713f5c2b72 tempest-VolumesActionsTest-1154417962 tempest-VolumesActionsTest-1154417962-project-member] Converting VIF {"id": "768b217d-898e-40e7-9af8-c8c0d9e88e89", "address": "fa:16:3e:7d:85:ab", "network": {"id": "7cba5169-ea03-4ec4-a7e4-11b56c637e26", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1109056022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7bd7707b7d84acdb15e5f89b6720ff7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap768b217d-89", "ovs_interfaceid": "768b217d-898e-40e7-9af8-c8c0d9e88e89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 15:39:33 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-c7e06127-d3d0-462e-80a9-f8713f5c2b72 tempest-VolumesActionsTest-1154417962 tempest-VolumesActionsTest-1154417962-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:85:ab,bridge_name='br-int',has_traffic_filtering=True,id=768b217d-898e-40e7-9af8-c8c0d9e88e89,network=Network(7cba5169-ea03-4ec4-a7e4-11b56c637e26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap768b217d-89') {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 15:39:33 user nova-compute[72382]: DEBUG nova.objects.instance [None req-c7e06127-d3d0-462e-80a9-f8713f5c2b72 tempest-VolumesActionsTest-1154417962 tempest-VolumesActionsTest-1154417962-project-member] Lazy-loading 'pci_devices' on Instance uuid b0da60bf-7468-4041-8016-54e3d82386b7 {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:39:33 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-c7e06127-d3d0-462e-80a9-f8713f5c2b72 tempest-VolumesActionsTest-1154417962 tempest-VolumesActionsTest-1154417962-project-member] [instance: b0da60bf-7468-4041-8016-54e3d82386b7] End _get_guest_xml xml=<domain type="kvm">
Aug 09 15:39:33 user nova-compute[72382]:   <uuid>b0da60bf-7468-4041-8016-54e3d82386b7</uuid>
Aug 09 15:39:33 user nova-compute[72382]:   <name>instance-0000002d</name>
Aug 09 15:39:33 user nova-compute[72382]:   <memory>524288</memory>
Aug 09 15:39:33 user nova-compute[72382]:   <vcpu>1</vcpu>
Aug 09 15:39:33 user nova-compute[72382]:   <metadata>
Aug 09 15:39:33 user nova-compute[72382]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 15:39:33 user nova-compute[72382]:       <nova:package version="0.0.0"/>
Aug 09 15:39:33 user nova-compute[72382]:       <nova:name>tempest-VolumesActionsTest-instance-146743122</nova:name>
Aug 09 15:39:33 user nova-compute[72382]:       <nova:creationTime>2023-08-09 15:39:33</nova:creationTime>
Aug 09 15:39:33 user nova-compute[72382]:       <nova:flavor name="m1.tiny">
Aug 09 15:39:33 user nova-compute[72382]:         <nova:memory>512</nova:memory>
Aug 09 15:39:33 user nova-compute[72382]:         <nova:disk>1</nova:disk>
Aug 09 15:39:33 user nova-compute[72382]:         <nova:swap>0</nova:swap>
Aug 09 15:39:33 user nova-compute[72382]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 15:39:33 user nova-compute[72382]:         <nova:vcpus>1</nova:vcpus>
Aug 09 15:39:33 user nova-compute[72382]:       </nova:flavor>
Aug 09 15:39:33 user nova-compute[72382]:       <nova:owner>
Aug 09 15:39:33 user nova-compute[72382]:         <nova:user uuid="a780bb50b3d54386b8ed790da8a6cbea">tempest-VolumesActionsTest-1154417962-project-member</nova:user>
Aug 09 15:39:33 user nova-compute[72382]:         <nova:project uuid="b7bd7707b7d84acdb15e5f89b6720ff7">tempest-VolumesActionsTest-1154417962</nova:project>
Aug 09 15:39:33 user nova-compute[72382]:       </nova:owner>
Aug 09 15:39:33 user nova-compute[72382]:       <nova:root type="image" uuid="a79f2cea-eb27-4631-aaf3-05e7d9e411b4"/>
Aug 09 15:39:33 user nova-compute[72382]:       <nova:ports>
Aug 09 15:39:33 user nova-compute[72382]:         <nova:port uuid="768b217d-898e-40e7-9af8-c8c0d9e88e89">
Aug 09 15:39:33 user nova-compute[72382]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 09 15:39:33 user nova-compute[72382]:         </nova:port>
Aug 09 15:39:33 user nova-compute[72382]:       </nova:ports>
Aug 09 15:39:33 user nova-compute[72382]:     </nova:instance>
Aug 09 15:39:33 user nova-compute[72382]:   </metadata>
Aug 09 15:39:33 user nova-compute[72382]:   <sysinfo type="smbios">
Aug 09 15:39:33 user nova-compute[72382]:     <system>
Aug 09 15:39:33 user nova-compute[72382]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 15:39:33 user nova-compute[72382]:       <entry name="product">OpenStack Nova</entry>
Aug 09 15:39:33 user nova-compute[72382]:       <entry name="version">0.0.0</entry>
Aug 09 15:39:33 user nova-compute[72382]:       <entry name="serial">b0da60bf-7468-4041-8016-54e3d82386b7</entry>
Aug 09 15:39:33 user nova-compute[72382]:       <entry name="uuid">b0da60bf-7468-4041-8016-54e3d82386b7</entry>
Aug 09 15:39:33 user nova-compute[72382]:       <entry name="family">Virtual Machine</entry>
Aug 09 15:39:33 user nova-compute[72382]:     </system>
Aug 09 15:39:33 user nova-compute[72382]:   </sysinfo>
Aug 09 15:39:33 user nova-compute[72382]:   <os>
Aug 09 15:39:33 user nova-compute[72382]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 15:39:33 user nova-compute[72382]:     <boot dev="hd"/>
Aug 09 15:39:33 user nova-compute[72382]:     <smbios mode="sysinfo"/>
Aug 09 15:39:33 user nova-compute[72382]:   </os>
Aug 09 15:39:33 user nova-compute[72382]:   <features>
Aug 09 15:39:33 user nova-compute[72382]:     <acpi/>
Aug 09 15:39:33 user nova-compute[72382]:     <apic/>
Aug 09 15:39:33 user nova-compute[72382]:     <vmcoreinfo/>
Aug 09 15:39:33 user nova-compute[72382]:   </features>
Aug 09 15:39:33 user nova-compute[72382]:   <clock offset="utc">
Aug 09 15:39:33 user nova-compute[72382]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 15:39:33 user nova-compute[72382]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 15:39:33 user nova-compute[72382]:     <timer name="hpet" present="no"/>
Aug 09 15:39:33 user nova-compute[72382]:   </clock>
Aug 09 15:39:33 user nova-compute[72382]:   <cpu mode="custom" match="exact">
Aug 09 15:39:33 user nova-compute[72382]:     <model>Nehalem</model>
Aug 09 15:39:33 user nova-compute[72382]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 15:39:33 user nova-compute[72382]:   </cpu>
Aug 09 15:39:33 user nova-compute[72382]:   <devices>
Aug 09 15:39:33 user nova-compute[72382]:     <disk type="file" device="disk">
Aug 09 15:39:33 user nova-compute[72382]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 15:39:33 user nova-compute[72382]:       <source file="/opt/stack/data/nova/instances/b0da60bf-7468-4041-8016-54e3d82386b7/disk"/>
Aug 09 15:39:33 user nova-compute[72382]:       <target dev="vda" bus="virtio"/>
Aug 09 15:39:33 user nova-compute[72382]:     </disk>
Aug 09 15:39:33 user nova-compute[72382]:     <interface type="ethernet">
Aug 09 15:39:33 user nova-compute[72382]:       <mac address="fa:16:3e:7d:85:ab"/>
Aug 09 15:39:33 user nova-compute[72382]:       <model type="virtio"/>
Aug 09 15:39:33 user nova-compute[72382]:       <mtu size="1442"/>
Aug 09 15:39:33 user nova-compute[72382]:       <target dev="tap768b217d-89"/>
Aug 09 15:39:33 user nova-compute[72382]:     </interface>
Aug 09 15:39:33 user nova-compute[72382]:     <serial type="pty">
Aug 09 15:39:33 user nova-compute[72382]:       <log file="/opt/stack/data/nova/instances/b0da60bf-7468-4041-8016-54e3d82386b7/console.log" append="off"/>
Aug 09 15:39:33 user nova-compute[72382]:     </serial>
Aug 09 15:39:33 user nova-compute[72382]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 15:39:33 user nova-compute[72382]:     <video>
Aug 09 15:39:33 user nova-compute[72382]:       <model type="virtio"/>
Aug 09 15:39:33 user nova-compute[72382]:     </video>
Aug 09 15:39:33 user nova-compute[72382]:     <rng model="virtio">
Aug 09 15:39:33 user nova-compute[72382]:       <backend model="random">/dev/urandom</backend>
Aug 09 15:39:33 user nova-compute[72382]:     </rng>
Aug 09 15:39:33 user nova-compute[72382]:     <controller type="usb" index="0" model="none"/>
Aug 09 15:39:33 user nova-compute[72382]:     <memballoon model="virtio">
Aug 09 15:39:33 user nova-compute[72382]:       <stats period="10"/>
Aug 09 15:39:33 user nova-compute[72382]:     </memballoon>
Aug 09 15:39:33 user nova-compute[72382]:   </devices>
Aug 09 15:39:33 user nova-compute[72382]: </domain>
Aug 09 15:39:33 user nova-compute[72382]:  {{(pid=72382) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 15:39:33 user nova-compute[72382]: DEBUG nova.virt.libvirt.vif [None req-c7e06127-d3d0-462e-80a9-f8713f5c2b72 tempest-VolumesActionsTest-1154417962 tempest-VolumesActionsTest-1154417962-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T15:39:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-146743122',display_name='tempest-VolumesActionsTest-instance-146743122',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-146743122',id=45,image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b7bd7707b7d84acdb15e5f89b6720ff7',ramdisk_id='',reservation_id='r-kuwm44rz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1154417962',owner_user_name='tempest-VolumesActionsTest-1154417962-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T15:39:31Z,user_data=None,user_id='a780bb50b3d54386b8ed790da8a6cbea',uuid=b0da60bf-7468-4041-8016-54e3d82386b7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "768b217d-898e-40e7-9af8-c8c0d9e88e89", "address": "fa:16:3e:7d:85:ab", "network": {"id": "7cba5169-ea03-4ec4-a7e4-11b56c637e26", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1109056022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7bd7707b7d84acdb15e5f89b6720ff7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap768b217d-89", "ovs_interfaceid": "768b217d-898e-40e7-9af8-c8c0d9e88e89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 15:39:33 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-c7e06127-d3d0-462e-80a9-f8713f5c2b72 tempest-VolumesActionsTest-1154417962 tempest-VolumesActionsTest-1154417962-project-member] Converting VIF {"id": "768b217d-898e-40e7-9af8-c8c0d9e88e89", "address": "fa:16:3e:7d:85:ab", "network": {"id": "7cba5169-ea03-4ec4-a7e4-11b56c637e26", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1109056022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7bd7707b7d84acdb15e5f89b6720ff7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap768b217d-89", "ovs_interfaceid": "768b217d-898e-40e7-9af8-c8c0d9e88e89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 15:39:33 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-c7e06127-d3d0-462e-80a9-f8713f5c2b72 tempest-VolumesActionsTest-1154417962 tempest-VolumesActionsTest-1154417962-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:85:ab,bridge_name='br-int',has_traffic_filtering=True,id=768b217d-898e-40e7-9af8-c8c0d9e88e89,network=Network(7cba5169-ea03-4ec4-a7e4-11b56c637e26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap768b217d-89') {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 15:39:33 user nova-compute[72382]: DEBUG os_vif [None req-c7e06127-d3d0-462e-80a9-f8713f5c2b72 tempest-VolumesActionsTest-1154417962 tempest-VolumesActionsTest-1154417962-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:85:ab,bridge_name='br-int',has_traffic_filtering=True,id=768b217d-898e-40e7-9af8-c8c0d9e88e89,network=Network(7cba5169-ea03-4ec4-a7e4-11b56c637e26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap768b217d-89') {{(pid=72382) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 15:39:33 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:39:33 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:39:33 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 15:39:33 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:39:33 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap768b217d-89, may_exist=True, interface_attrs={}) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:39:33 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap768b217d-89, col_values=(('external_ids', {'iface-id': '768b217d-898e-40e7-9af8-c8c0d9e88e89', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7d:85:ab', 'vm-uuid': 'b0da60bf-7468-4041-8016-54e3d82386b7'}),), if_exists=True) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:39:33 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:39:33 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:39:33 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:39:33 user nova-compute[72382]: INFO os_vif [None req-c7e06127-d3d0-462e-80a9-f8713f5c2b72 tempest-VolumesActionsTest-1154417962 tempest-VolumesActionsTest-1154417962-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:85:ab,bridge_name='br-int',has_traffic_filtering=True,id=768b217d-898e-40e7-9af8-c8c0d9e88e89,network=Network(7cba5169-ea03-4ec4-a7e4-11b56c637e26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap768b217d-89')
Aug 09 15:39:33 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-c7e06127-d3d0-462e-80a9-f8713f5c2b72 tempest-VolumesActionsTest-1154417962 tempest-VolumesActionsTest-1154417962-project-member] No BDM found with device name vda, not building metadata. {{(pid=72382) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 15:39:33 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-c7e06127-d3d0-462e-80a9-f8713f5c2b72 tempest-VolumesActionsTest-1154417962 tempest-VolumesActionsTest-1154417962-project-member] No VIF found with MAC fa:16:3e:7d:85:ab, not building metadata {{(pid=72382) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 15:39:33 user nova-compute[72382]: DEBUG nova.network.neutron [req-e2c10324-3b16-43a3-8dcd-a86519463d7e req-c2df59f0-8c54-48f2-944f-5cb5712dd021 service nova] [instance: b0da60bf-7468-4041-8016-54e3d82386b7] Updated VIF entry in instance network info cache for port 768b217d-898e-40e7-9af8-c8c0d9e88e89. {{(pid=72382) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 15:39:33 user nova-compute[72382]: DEBUG nova.network.neutron [req-e2c10324-3b16-43a3-8dcd-a86519463d7e req-c2df59f0-8c54-48f2-944f-5cb5712dd021 service nova] [instance: b0da60bf-7468-4041-8016-54e3d82386b7] Updating instance_info_cache with network_info: [{"id": "768b217d-898e-40e7-9af8-c8c0d9e88e89", "address": "fa:16:3e:7d:85:ab", "network": {"id": "7cba5169-ea03-4ec4-a7e4-11b56c637e26", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1109056022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7bd7707b7d84acdb15e5f89b6720ff7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap768b217d-89", "ovs_interfaceid": "768b217d-898e-40e7-9af8-c8c0d9e88e89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:39:33 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-e2c10324-3b16-43a3-8dcd-a86519463d7e req-c2df59f0-8c54-48f2-944f-5cb5712dd021 service nova] Releasing lock "refresh_cache-b0da60bf-7468-4041-8016-54e3d82386b7" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 15:39:34 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:39:34 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:39:34 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:39:34 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:39:35 user nova-compute[72382]: DEBUG nova.compute.manager [req-9e727458-bc2d-4bb0-9844-b2ba56396c74 req-bf7cb15d-8c6b-4a19-94ff-27ab77a994a3 service nova] [instance: b0da60bf-7468-4041-8016-54e3d82386b7] Received event network-vif-plugged-768b217d-898e-40e7-9af8-c8c0d9e88e89 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:39:35 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-9e727458-bc2d-4bb0-9844-b2ba56396c74 req-bf7cb15d-8c6b-4a19-94ff-27ab77a994a3 service nova] Acquiring lock "b0da60bf-7468-4041-8016-54e3d82386b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:39:35 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-9e727458-bc2d-4bb0-9844-b2ba56396c74 req-bf7cb15d-8c6b-4a19-94ff-27ab77a994a3 service nova] Lock "b0da60bf-7468-4041-8016-54e3d82386b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:39:35 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-9e727458-bc2d-4bb0-9844-b2ba56396c74 req-bf7cb15d-8c6b-4a19-94ff-27ab77a994a3 service nova] Lock "b0da60bf-7468-4041-8016-54e3d82386b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:39:35 user nova-compute[72382]: DEBUG nova.compute.manager [req-9e727458-bc2d-4bb0-9844-b2ba56396c74 req-bf7cb15d-8c6b-4a19-94ff-27ab77a994a3 service nova] [instance: b0da60bf-7468-4041-8016-54e3d82386b7] No waiting events found dispatching network-vif-plugged-768b217d-898e-40e7-9af8-c8c0d9e88e89 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:39:35 user nova-compute[72382]: WARNING nova.compute.manager [req-9e727458-bc2d-4bb0-9844-b2ba56396c74 req-bf7cb15d-8c6b-4a19-94ff-27ab77a994a3 service nova] [instance: b0da60bf-7468-4041-8016-54e3d82386b7] Received unexpected event network-vif-plugged-768b217d-898e-40e7-9af8-c8c0d9e88e89 for instance with vm_state building and task_state spawning.
Aug 09 15:39:35 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:39:35 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:39:35 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:39:35 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:39:37 user nova-compute[72382]: DEBUG nova.virt.driver [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Emitting event <LifecycleEvent: 1691595577.0778246, b0da60bf-7468-4041-8016-54e3d82386b7 => Resumed> {{(pid=72382) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 15:39:37 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: b0da60bf-7468-4041-8016-54e3d82386b7] VM Resumed (Lifecycle Event)
Aug 09 15:39:37 user nova-compute[72382]: DEBUG nova.compute.manager [None req-c7e06127-d3d0-462e-80a9-f8713f5c2b72 tempest-VolumesActionsTest-1154417962 tempest-VolumesActionsTest-1154417962-project-member] [instance: b0da60bf-7468-4041-8016-54e3d82386b7] Instance event wait completed in 0 seconds for  {{(pid=72382) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 15:39:37 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-c7e06127-d3d0-462e-80a9-f8713f5c2b72 tempest-VolumesActionsTest-1154417962 tempest-VolumesActionsTest-1154417962-project-member] [instance: b0da60bf-7468-4041-8016-54e3d82386b7] Guest created on hypervisor {{(pid=72382) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 15:39:37 user nova-compute[72382]: INFO nova.virt.libvirt.driver [-] [instance: b0da60bf-7468-4041-8016-54e3d82386b7] Instance spawned successfully.
Aug 09 15:39:37 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-c7e06127-d3d0-462e-80a9-f8713f5c2b72 tempest-VolumesActionsTest-1154417962 tempest-VolumesActionsTest-1154417962-project-member] [instance: b0da60bf-7468-4041-8016-54e3d82386b7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 15:39:37 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: b0da60bf-7468-4041-8016-54e3d82386b7] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:39:37 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: b0da60bf-7468-4041-8016-54e3d82386b7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72382) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 15:39:37 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-c7e06127-d3d0-462e-80a9-f8713f5c2b72 tempest-VolumesActionsTest-1154417962 tempest-VolumesActionsTest-1154417962-project-member] [instance: b0da60bf-7468-4041-8016-54e3d82386b7] Found default for hw_cdrom_bus of ide {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:39:37 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-c7e06127-d3d0-462e-80a9-f8713f5c2b72 tempest-VolumesActionsTest-1154417962 tempest-VolumesActionsTest-1154417962-project-member] [instance: b0da60bf-7468-4041-8016-54e3d82386b7] Found default for hw_disk_bus of virtio {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:39:37 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-c7e06127-d3d0-462e-80a9-f8713f5c2b72 tempest-VolumesActionsTest-1154417962 tempest-VolumesActionsTest-1154417962-project-member] [instance: b0da60bf-7468-4041-8016-54e3d82386b7] Found default for hw_input_bus of None {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:39:37 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-c7e06127-d3d0-462e-80a9-f8713f5c2b72 tempest-VolumesActionsTest-1154417962 tempest-VolumesActionsTest-1154417962-project-member] [instance: b0da60bf-7468-4041-8016-54e3d82386b7] Found default for hw_pointer_model of None {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:39:37 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-c7e06127-d3d0-462e-80a9-f8713f5c2b72 tempest-VolumesActionsTest-1154417962 tempest-VolumesActionsTest-1154417962-project-member] [instance: b0da60bf-7468-4041-8016-54e3d82386b7] Found default for hw_video_model of virtio {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:39:37 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-c7e06127-d3d0-462e-80a9-f8713f5c2b72 tempest-VolumesActionsTest-1154417962 tempest-VolumesActionsTest-1154417962-project-member] [instance: b0da60bf-7468-4041-8016-54e3d82386b7] Found default for hw_vif_model of virtio {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:39:37 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: b0da60bf-7468-4041-8016-54e3d82386b7] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 15:39:37 user nova-compute[72382]: DEBUG nova.virt.driver [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Emitting event <LifecycleEvent: 1691595577.0792878, b0da60bf-7468-4041-8016-54e3d82386b7 => Started> {{(pid=72382) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 15:39:37 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: b0da60bf-7468-4041-8016-54e3d82386b7] VM Started (Lifecycle Event)
Aug 09 15:39:37 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: b0da60bf-7468-4041-8016-54e3d82386b7] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:39:37 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: b0da60bf-7468-4041-8016-54e3d82386b7] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72382) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 15:39:37 user nova-compute[72382]: DEBUG nova.compute.manager [req-bdbdf33a-7c7b-45f7-965c-908e8ef4e436 req-0ef02070-8c7f-40f2-897c-4fb85395ca6c service nova] [instance: b0da60bf-7468-4041-8016-54e3d82386b7] Received event network-vif-plugged-768b217d-898e-40e7-9af8-c8c0d9e88e89 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:39:37 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-bdbdf33a-7c7b-45f7-965c-908e8ef4e436 req-0ef02070-8c7f-40f2-897c-4fb85395ca6c service nova] Acquiring lock "b0da60bf-7468-4041-8016-54e3d82386b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:39:37 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-bdbdf33a-7c7b-45f7-965c-908e8ef4e436 req-0ef02070-8c7f-40f2-897c-4fb85395ca6c service nova] Lock "b0da60bf-7468-4041-8016-54e3d82386b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:39:37 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-bdbdf33a-7c7b-45f7-965c-908e8ef4e436 req-0ef02070-8c7f-40f2-897c-4fb85395ca6c service nova] Lock "b0da60bf-7468-4041-8016-54e3d82386b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:39:37 user nova-compute[72382]: DEBUG nova.compute.manager [req-bdbdf33a-7c7b-45f7-965c-908e8ef4e436 req-0ef02070-8c7f-40f2-897c-4fb85395ca6c service nova] [instance: b0da60bf-7468-4041-8016-54e3d82386b7] No waiting events found dispatching network-vif-plugged-768b217d-898e-40e7-9af8-c8c0d9e88e89 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:39:37 user nova-compute[72382]: WARNING nova.compute.manager [req-bdbdf33a-7c7b-45f7-965c-908e8ef4e436 req-0ef02070-8c7f-40f2-897c-4fb85395ca6c service nova] [instance: b0da60bf-7468-4041-8016-54e3d82386b7] Received unexpected event network-vif-plugged-768b217d-898e-40e7-9af8-c8c0d9e88e89 for instance with vm_state building and task_state spawning.
Aug 09 15:39:37 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: b0da60bf-7468-4041-8016-54e3d82386b7] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 15:39:37 user nova-compute[72382]: INFO nova.compute.manager [None req-c7e06127-d3d0-462e-80a9-f8713f5c2b72 tempest-VolumesActionsTest-1154417962 tempest-VolumesActionsTest-1154417962-project-member] [instance: b0da60bf-7468-4041-8016-54e3d82386b7] Took 6.60 seconds to spawn the instance on the hypervisor.
Aug 09 15:39:37 user nova-compute[72382]: DEBUG nova.compute.manager [None req-c7e06127-d3d0-462e-80a9-f8713f5c2b72 tempest-VolumesActionsTest-1154417962 tempest-VolumesActionsTest-1154417962-project-member] [instance: b0da60bf-7468-4041-8016-54e3d82386b7] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:39:37 user nova-compute[72382]: INFO nova.compute.manager [None req-c7e06127-d3d0-462e-80a9-f8713f5c2b72 tempest-VolumesActionsTest-1154417962 tempest-VolumesActionsTest-1154417962-project-member] [instance: b0da60bf-7468-4041-8016-54e3d82386b7] Took 7.34 seconds to build instance.
Aug 09 15:39:37 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-c7e06127-d3d0-462e-80a9-f8713f5c2b72 tempest-VolumesActionsTest-1154417962 tempest-VolumesActionsTest-1154417962-project-member] Lock "b0da60bf-7468-4041-8016-54e3d82386b7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.442s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:39:38 user nova-compute[72382]: DEBUG nova.compute.manager [None req-eb1b8b3f-c181-4999-a926-673d5803ff97 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: 3855b76f-87cc-4be0-982c-4cc5cf5cd8aa] Start spawning the instance on the hypervisor. {{(pid=72382) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 15:39:38 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-eb1b8b3f-c181-4999-a926-673d5803ff97 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: 3855b76f-87cc-4be0-982c-4cc5cf5cd8aa] Creating instance directory {{(pid=72382) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 15:39:38 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-eb1b8b3f-c181-4999-a926-673d5803ff97 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: 3855b76f-87cc-4be0-982c-4cc5cf5cd8aa] Creating image(s)
Aug 09 15:39:38 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-eb1b8b3f-c181-4999-a926-673d5803ff97 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: 3855b76f-87cc-4be0-982c-4cc5cf5cd8aa] Did not create local disks {{(pid=72382) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 09 15:39:38 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-eb1b8b3f-c181-4999-a926-673d5803ff97 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: 3855b76f-87cc-4be0-982c-4cc5cf5cd8aa] Ensure instance console log exists: /opt/stack/data/nova/instances/3855b76f-87cc-4be0-982c-4cc5cf5cd8aa/console.log {{(pid=72382) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 15:39:38 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-eb1b8b3f-c181-4999-a926-673d5803ff97 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:39:38 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-eb1b8b3f-c181-4999-a926-673d5803ff97 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:39:38 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-eb1b8b3f-c181-4999-a926-673d5803ff97 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:39:38 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-eb1b8b3f-c181-4999-a926-673d5803ff97 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: 3855b76f-87cc-4be0-982c-4cc5cf5cd8aa] Start _get_guest_xml network_info=[{"id": "b7c16d4a-24b4-4ba6-860a-d180123dd204", "address": "fa:16:3e:01:6f:fa", "network": {"id": "a78e6cb6-feb7-4f64-a3c0-4900594b6e37", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-338007968-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70310b1af40b4d239fe5ea362972554b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7c16d4a-24", "ovs_interfaceid": "b7c16d4a-24b4-4ba6-860a-d180123dd204", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:3f58579c-f69a-4bee-b16e-970e5a8f590c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sJYkmfxN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '3855b76f-87cc-4be0-982c-4cc5cf5cd8aa', 'attached_at': '', 'detached_at': '', 'volume_id': '3f58579c-f69a-4bee-b16e-970e5a8f590c', 'serial': '3f58579c-f69a-4bee-b16e-970e5a8f590c'}, 'disk_bus': 'virtio', 'attachment_id': 'd108e99e-2b17-477e-bbe8-37249c07298a', 'delete_on_termination': False, 'volume_type': None} {{(pid=72382) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 15:39:38 user nova-compute[72382]: WARNING nova.virt.libvirt.driver [None req-eb1b8b3f-c181-4999-a926-673d5803ff97 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 15:39:38 user nova-compute[72382]: WARNING nova.virt.libvirt.driver [None req-eb1b8b3f-c181-4999-a926-673d5803ff97 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 15:39:38 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-eb1b8b3f-c181-4999-a926-673d5803ff97 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72382) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 15:39:38 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-eb1b8b3f-c181-4999-a926-673d5803ff97 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] CPU controller missing on host. {{(pid=72382) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 15:39:38 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-eb1b8b3f-c181-4999-a926-673d5803ff97 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72382) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 15:39:38 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-eb1b8b3f-c181-4999-a926-673d5803ff97 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] CPU controller found on host. {{(pid=72382) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 15:39:38 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-eb1b8b3f-c181-4999-a926-673d5803ff97 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72382) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 15:39:38 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-eb1b8b3f-c181-4999-a926-673d5803ff97 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T15:11:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 15:39:38 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-eb1b8b3f-c181-4999-a926-673d5803ff97 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Flavor limits 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 15:39:38 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-eb1b8b3f-c181-4999-a926-673d5803ff97 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Image limits 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 15:39:38 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-eb1b8b3f-c181-4999-a926-673d5803ff97 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Flavor pref 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 15:39:38 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-eb1b8b3f-c181-4999-a926-673d5803ff97 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Image pref 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 15:39:38 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-eb1b8b3f-c181-4999-a926-673d5803ff97 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 15:39:38 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-eb1b8b3f-c181-4999-a926-673d5803ff97 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 15:39:38 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-eb1b8b3f-c181-4999-a926-673d5803ff97 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72382) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 15:39:38 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-eb1b8b3f-c181-4999-a926-673d5803ff97 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Got 1 possible topologies {{(pid=72382) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 15:39:38 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-eb1b8b3f-c181-4999-a926-673d5803ff97 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 15:39:38 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-eb1b8b3f-c181-4999-a926-673d5803ff97 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 15:39:38 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eb1b8b3f-c181-4999-a926-673d5803ff97 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: 3855b76f-87cc-4be0-982c-4cc5cf5cd8aa] Calling os-brick to attach iSCSI Volume {{(pid=72382) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 15:39:38 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb1b8b3f-c181-4999-a926-673d5803ff97 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2a0c768340>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:3f58579c-f69a-4bee-b16e-970e5a8f590c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sJYkmfxN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 15:39:38 user nova-compute[72382]: WARNING os_brick.initiator.connectors.base [None req-eb1b8b3f-c181-4999-a926-673d5803ff97 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 15:39:38 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-eb1b8b3f-c181-4999-a926-673d5803ff97 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 15:39:38 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-eb1b8b3f-c181-4999-a926-673d5803ff97 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 15:39:38 user nova-compute[72382]: WARNING os_brick.initiator.connectors.base [None req-eb1b8b3f-c181-4999-a926-673d5803ff97 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 15:39:38 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-eb1b8b3f-c181-4999-a926-673d5803ff97 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3f58579c-f69a-4bee-b16e-970e5a8f590c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 15:39:38 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-eb1b8b3f-c181-4999-a926-673d5803ff97 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3f58579c-f69a-4bee-b16e-970e5a8f590c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 15:39:38 user nova-compute[72382]: INFO os_brick.initiator.connectors.iscsi [None req-eb1b8b3f-c181-4999-a926-673d5803ff97 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 15:39:38 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f58579c-f69a-4bee-b16e-970e5a8f590c -p 172.16.0.220:3260 {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:39:38 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f58579c-f69a-4bee-b16e-970e5a8f590c -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:39:38 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb1d04ab-e807-4722-a091-7ece42b81ff3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:39:38 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb1b8b3f-c181-4999-a926-673d5803ff97 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 15:39:38 user nova-compute[72382]:  {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:39:38 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f58579c-f69a-4bee-b16e-970e5a8f590c -p 172.16.0.220:3260 --interface default --op new {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:39:38 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f58579c-f69a-4bee-b16e-970e5a8f590c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:39:38 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[1006fd53-371c-4bc8-96fc-38c6e2bc0ba5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3f58579c-f69a-4bee-b16e-970e5a8f590c] added\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:39:38 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb1b8b3f-c181-4999-a926-673d5803ff97 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3f58579c-f69a-4bee-b16e-970e5a8f590c] added
Aug 09 15:39:38 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:39:38 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f58579c-f69a-4bee-b16e-970e5a8f590c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:39:38 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f58579c-f69a-4bee-b16e-970e5a8f590c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:39:38 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f8e8408-565f-42ea-91d0-737ebc44f145]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:39:38 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb1b8b3f-c181-4999-a926-673d5803ff97 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:39:38 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f58579c-f69a-4bee-b16e-970e5a8f590c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:39:38 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f58579c-f69a-4bee-b16e-970e5a8f590c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:39:38 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c898d45-dfbd-4c0e-87d8-4255823da5f8]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:39:38 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb1b8b3f-c181-4999-a926-673d5803ff97 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:39:38 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f58579c-f69a-4bee-b16e-970e5a8f590c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sJYkmfxN {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:39:38 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f58579c-f69a-4bee-b16e-970e5a8f590c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sJYkmfxN" returned: 0 in 0.021s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:39:38 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4e81b0c-047c-4b98-ab9a-dbb3c38ddad4]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:39:38 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb1b8b3f-c181-4999-a926-673d5803ff97 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'sJYkmfxN'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:39:38 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f58579c-f69a-4bee-b16e-970e5a8f590c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:39:38 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f58579c-f69a-4bee-b16e-970e5a8f590c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:39:38 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4cb1da9-9b59-4ff5-8a99-d1db1832a17c]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:39:38 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb1b8b3f-c181-4999-a926-673d5803ff97 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:39:38 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:39:38 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:39:38 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[50576871-3159-4a79-8507-117dd6473b26]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0a612d6-0f3f-4d2c-9fb5-aff9384338de (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2f5dbb5-f862-4389-b42a-872d5c94aa55 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:170d7509-0928-4a87-9d9f-437977452501 (non-flash)\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:39:38 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb1b8b3f-c181-4999-a926-673d5803ff97 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0a612d6-0f3f-4d2c-9fb5-aff9384338de (non-flash)
Aug 09 15:39:38 user nova-compute[72382]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2f5dbb5-f862-4389-b42a-872d5c94aa55 (non-flash)
Aug 09 15:39:38 user nova-compute[72382]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:170d7509-0928-4a87-9d9f-437977452501 (non-flash)
Aug 09 15:39:38 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 15:39:38 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb1b8b3f-c181-4999-a926-673d5803ff97 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0a612d6-0f3f-4d2c-9fb5-aff9384338de (non-flash)
Aug 09 15:39:38 user nova-compute[72382]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2f5dbb5-f862-4389-b42a-872d5c94aa55 (non-flash)
Aug 09 15:39:38 user nova-compute[72382]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:170d7509-0928-4a87-9d9f-437977452501 (non-flash)
Aug 09 15:39:38 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 15:39:38 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f58579c-f69a-4bee-b16e-970e5a8f590c -p 172.16.0.220:3260 --login {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:39:38 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:39:38 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f58579c-f69a-4bee-b16e-970e5a8f590c -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:39:38 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2172409-b6fb-4730-a0fa-cbc5f6710fe2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3f58579c-f69a-4bee-b16e-970e5a8f590c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3f58579c-f69a-4bee-b16e-970e5a8f590c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:39:38 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb1b8b3f-c181-4999-a926-673d5803ff97 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3f58579c-f69a-4bee-b16e-970e5a8f590c, portal: 172.16.0.220,3260]
Aug 09 15:39:38 user nova-compute[72382]: Login to [iface: default, target: iqn.2010-10.org.openstack:3f58579c-f69a-4bee-b16e-970e5a8f590c, portal: 172.16.0.220,3260] successful.
Aug 09 15:39:38 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:39:38 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f58579c-f69a-4bee-b16e-970e5a8f590c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:39:38 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f58579c-f69a-4bee-b16e-970e5a8f590c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:39:38 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[141f63ec-28ab-4dd0-a971-1025ec33de82]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:39:38 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb1b8b3f-c181-4999-a926-673d5803ff97 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:39:38 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:39:38 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:39:38 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d3d5ef1-c75c-495e-9ad2-52862585af23]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0a612d6-0f3f-4d2c-9fb5-aff9384338de (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2f5dbb5-f862-4389-b42a-872d5c94aa55 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:170d7509-0928-4a87-9d9f-437977452501 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f58579c-f69a-4bee-b16e-970e5a8f590c (non-flash)\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:39:38 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb1b8b3f-c181-4999-a926-673d5803ff97 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0a612d6-0f3f-4d2c-9fb5-aff9384338de (non-flash)
Aug 09 15:39:38 user nova-compute[72382]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2f5dbb5-f862-4389-b42a-872d5c94aa55 (non-flash)
Aug 09 15:39:38 user nova-compute[72382]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:170d7509-0928-4a87-9d9f-437977452501 (non-flash)
Aug 09 15:39:38 user nova-compute[72382]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f58579c-f69a-4bee-b16e-970e5a8f590c (non-flash)
Aug 09 15:39:38 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 15:39:38 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb1b8b3f-c181-4999-a926-673d5803ff97 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0a612d6-0f3f-4d2c-9fb5-aff9384338de (non-flash)
Aug 09 15:39:38 user nova-compute[72382]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2f5dbb5-f862-4389-b42a-872d5c94aa55 (non-flash)
Aug 09 15:39:38 user nova-compute[72382]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:170d7509-0928-4a87-9d9f-437977452501 (non-flash)
Aug 09 15:39:38 user nova-compute[72382]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f58579c-f69a-4bee-b16e-970e5a8f590c (non-flash)
Aug 09 15:39:38 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 15:39:38 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-eb1b8b3f-c181-4999-a926-673d5803ff97 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3f58579c-f69a-4bee-b16e-970e5a8f590c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.306s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 15:39:38 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb1b8b3f-c181-4999-a926-673d5803ff97 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Connected to 172.16.0.220:3260 {{(pid=72382) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 15:39:38 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-eb1b8b3f-c181-4999-a926-673d5803ff97 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] HCTL ('33', '-', '-', 0) found on session 55 with lun 0 {{(pid=72382) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 15:39:38 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-eb1b8b3f-c181-4999-a926-673d5803ff97 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72382) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 15:39:38 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:39:38 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:39:38 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3bf1379-bde4-4cd3-bce3-1eacc72b5d60]: (4, ('- - 0', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:39:38 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-eb1b8b3f-c181-4999-a926-673d5803ff97 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Searching for a device in session 55 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72382) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 15:39:38 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb1b8b3f-c181-4999-a926-673d5803ff97 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sJYkmfxN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72382) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 15:39:39 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-eb1b8b3f-c181-4999-a926-673d5803ff97 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.344s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 15:39:39 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb1b8b3f-c181-4999-a926-673d5803ff97 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] <== connect_volume: return (1346ms) {'type': 'block', 'scsi_wwn': '23461323063613834', 'path': '/dev/sdb'} {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 15:39:39 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eb1b8b3f-c181-4999-a926-673d5803ff97 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: 3855b76f-87cc-4be0-982c-4cc5cf5cd8aa] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23461323063613834', 'path': '/dev/sdb'} {{(pid=72382) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 15:39:39 user nova-compute[72382]: DEBUG nova.virt.libvirt.vif [None req-eb1b8b3f-c181-4999-a926-673d5803ff97 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T15:39:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-384154320',display_name='tempest-TestVolumeBootPattern-server-384154320',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-384154320',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE2Ft4ugcR+xm9FJQARVlCQBYm313gUcmopkZOKz9jwU+uIeLmDWZczJQzSvB2hHfGE3d6cxNwerl6nmxRdqMq6zUG8hCLpv56gJB1tj7Wzv5bBbh5m7r3DF8/P9Gg51AA==',key_name='tempest-TestVolumeBootPattern-1990844198',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='70310b1af40b4d239fe5ea362972554b',ramdisk_id='',reservation_id='r-j7vw3np4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-451643589',owner_user_name='tempest-TestVolumeBootPattern-451643589-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T15:39:29Z,user_data=None,user_id='280bcf2afd7245a7bcd605e0db79c569',uuid=3855b76f-87cc-4be0-982c-4cc5cf5cd8aa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b7c16d4a-24b4-4ba6-860a-d180123dd204", "address": "fa:16:3e:01:6f:fa", "network": {"id": "a78e6cb6-feb7-4f64-a3c0-4900594b6e37", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-338007968-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70310b1af40b4d239fe5ea362972554b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7c16d4a-24", "ovs_interfaceid": "b7c16d4a-24b4-4ba6-860a-d180123dd204", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72382) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 15:39:39 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-eb1b8b3f-c181-4999-a926-673d5803ff97 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Converting VIF {"id": "b7c16d4a-24b4-4ba6-860a-d180123dd204", "address": "fa:16:3e:01:6f:fa", "network": {"id": "a78e6cb6-feb7-4f64-a3c0-4900594b6e37", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-338007968-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70310b1af40b4d239fe5ea362972554b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7c16d4a-24", "ovs_interfaceid": "b7c16d4a-24b4-4ba6-860a-d180123dd204", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 15:39:39 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-eb1b8b3f-c181-4999-a926-673d5803ff97 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:01:6f:fa,bridge_name='br-int',has_traffic_filtering=True,id=b7c16d4a-24b4-4ba6-860a-d180123dd204,network=Network(a78e6cb6-feb7-4f64-a3c0-4900594b6e37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7c16d4a-24') {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 15:39:39 user nova-compute[72382]: DEBUG nova.objects.instance [None req-eb1b8b3f-c181-4999-a926-673d5803ff97 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Lazy-loading 'pci_devices' on Instance uuid 3855b76f-87cc-4be0-982c-4cc5cf5cd8aa {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:39:39 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-eb1b8b3f-c181-4999-a926-673d5803ff97 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: 3855b76f-87cc-4be0-982c-4cc5cf5cd8aa] End _get_guest_xml xml=<domain type="kvm">
Aug 09 15:39:39 user nova-compute[72382]:   <uuid>3855b76f-87cc-4be0-982c-4cc5cf5cd8aa</uuid>
Aug 09 15:39:39 user nova-compute[72382]:   <name>instance-0000002c</name>
Aug 09 15:39:39 user nova-compute[72382]:   <memory>524288</memory>
Aug 09 15:39:39 user nova-compute[72382]:   <vcpu>1</vcpu>
Aug 09 15:39:39 user nova-compute[72382]:   <metadata>
Aug 09 15:39:39 user nova-compute[72382]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 15:39:39 user nova-compute[72382]:       <nova:package version="0.0.0"/>
Aug 09 15:39:39 user nova-compute[72382]:       <nova:name>tempest-TestVolumeBootPattern-server-384154320</nova:name>
Aug 09 15:39:39 user nova-compute[72382]:       <nova:creationTime>2023-08-09 15:39:38</nova:creationTime>
Aug 09 15:39:39 user nova-compute[72382]:       <nova:flavor name="m1.tiny">
Aug 09 15:39:39 user nova-compute[72382]:         <nova:memory>512</nova:memory>
Aug 09 15:39:39 user nova-compute[72382]:         <nova:disk>1</nova:disk>
Aug 09 15:39:39 user nova-compute[72382]:         <nova:swap>0</nova:swap>
Aug 09 15:39:39 user nova-compute[72382]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 15:39:39 user nova-compute[72382]:         <nova:vcpus>1</nova:vcpus>
Aug 09 15:39:39 user nova-compute[72382]:       </nova:flavor>
Aug 09 15:39:39 user nova-compute[72382]:       <nova:owner>
Aug 09 15:39:39 user nova-compute[72382]:         <nova:user uuid="280bcf2afd7245a7bcd605e0db79c569">tempest-TestVolumeBootPattern-451643589-project-member</nova:user>
Aug 09 15:39:39 user nova-compute[72382]:         <nova:project uuid="70310b1af40b4d239fe5ea362972554b">tempest-TestVolumeBootPattern-451643589</nova:project>
Aug 09 15:39:39 user nova-compute[72382]:       </nova:owner>
Aug 09 15:39:39 user nova-compute[72382]:       <nova:ports>
Aug 09 15:39:39 user nova-compute[72382]:         <nova:port uuid="b7c16d4a-24b4-4ba6-860a-d180123dd204">
Aug 09 15:39:39 user nova-compute[72382]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 09 15:39:39 user nova-compute[72382]:         </nova:port>
Aug 09 15:39:39 user nova-compute[72382]:       </nova:ports>
Aug 09 15:39:39 user nova-compute[72382]:     </nova:instance>
Aug 09 15:39:39 user nova-compute[72382]:   </metadata>
Aug 09 15:39:39 user nova-compute[72382]:   <sysinfo type="smbios">
Aug 09 15:39:39 user nova-compute[72382]:     <system>
Aug 09 15:39:39 user nova-compute[72382]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 15:39:39 user nova-compute[72382]:       <entry name="product">OpenStack Nova</entry>
Aug 09 15:39:39 user nova-compute[72382]:       <entry name="version">0.0.0</entry>
Aug 09 15:39:39 user nova-compute[72382]:       <entry name="serial">3855b76f-87cc-4be0-982c-4cc5cf5cd8aa</entry>
Aug 09 15:39:39 user nova-compute[72382]:       <entry name="uuid">3855b76f-87cc-4be0-982c-4cc5cf5cd8aa</entry>
Aug 09 15:39:39 user nova-compute[72382]:       <entry name="family">Virtual Machine</entry>
Aug 09 15:39:39 user nova-compute[72382]:     </system>
Aug 09 15:39:39 user nova-compute[72382]:   </sysinfo>
Aug 09 15:39:39 user nova-compute[72382]:   <os>
Aug 09 15:39:39 user nova-compute[72382]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 15:39:39 user nova-compute[72382]:     <boot dev="hd"/>
Aug 09 15:39:39 user nova-compute[72382]:     <smbios mode="sysinfo"/>
Aug 09 15:39:39 user nova-compute[72382]:   </os>
Aug 09 15:39:39 user nova-compute[72382]:   <features>
Aug 09 15:39:39 user nova-compute[72382]:     <acpi/>
Aug 09 15:39:39 user nova-compute[72382]:     <apic/>
Aug 09 15:39:39 user nova-compute[72382]:     <vmcoreinfo/>
Aug 09 15:39:39 user nova-compute[72382]:   </features>
Aug 09 15:39:39 user nova-compute[72382]:   <clock offset="utc">
Aug 09 15:39:39 user nova-compute[72382]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 15:39:39 user nova-compute[72382]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 15:39:39 user nova-compute[72382]:     <timer name="hpet" present="no"/>
Aug 09 15:39:39 user nova-compute[72382]:   </clock>
Aug 09 15:39:39 user nova-compute[72382]:   <cpu mode="custom" match="exact">
Aug 09 15:39:39 user nova-compute[72382]:     <model>Nehalem</model>
Aug 09 15:39:39 user nova-compute[72382]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 15:39:39 user nova-compute[72382]:   </cpu>
Aug 09 15:39:39 user nova-compute[72382]:   <devices>
Aug 09 15:39:39 user nova-compute[72382]:     <disk type="block" device="disk">
Aug 09 15:39:39 user nova-compute[72382]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 15:39:39 user nova-compute[72382]:       <source dev="/dev/sdb"/>
Aug 09 15:39:39 user nova-compute[72382]:       <target dev="vda" bus="virtio"/>
Aug 09 15:39:39 user nova-compute[72382]:       <serial>3f58579c-f69a-4bee-b16e-970e5a8f590c</serial>
Aug 09 15:39:39 user nova-compute[72382]:     </disk>
Aug 09 15:39:39 user nova-compute[72382]:     <interface type="ethernet">
Aug 09 15:39:39 user nova-compute[72382]:       <mac address="fa:16:3e:01:6f:fa"/>
Aug 09 15:39:39 user nova-compute[72382]:       <model type="virtio"/>
Aug 09 15:39:39 user nova-compute[72382]:       <mtu size="1442"/>
Aug 09 15:39:39 user nova-compute[72382]:       <target dev="tapb7c16d4a-24"/>
Aug 09 15:39:39 user nova-compute[72382]:     </interface>
Aug 09 15:39:39 user nova-compute[72382]:     <serial type="pty">
Aug 09 15:39:39 user nova-compute[72382]:       <log file="/opt/stack/data/nova/instances/3855b76f-87cc-4be0-982c-4cc5cf5cd8aa/console.log" append="off"/>
Aug 09 15:39:39 user nova-compute[72382]:     </serial>
Aug 09 15:39:39 user nova-compute[72382]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 15:39:39 user nova-compute[72382]:     <video>
Aug 09 15:39:39 user nova-compute[72382]:       <model type="virtio"/>
Aug 09 15:39:39 user nova-compute[72382]:     </video>
Aug 09 15:39:39 user nova-compute[72382]:     <rng model="virtio">
Aug 09 15:39:39 user nova-compute[72382]:       <backend model="random">/dev/urandom</backend>
Aug 09 15:39:39 user nova-compute[72382]:     </rng>
Aug 09 15:39:39 user nova-compute[72382]:     <controller type="usb" index="0" model="none"/>
Aug 09 15:39:39 user nova-compute[72382]:     <memballoon model="virtio">
Aug 09 15:39:39 user nova-compute[72382]:       <stats period="10"/>
Aug 09 15:39:39 user nova-compute[72382]:     </memballoon>
Aug 09 15:39:39 user nova-compute[72382]:   </devices>
Aug 09 15:39:39 user nova-compute[72382]: </domain>
Aug 09 15:39:39 user nova-compute[72382]:  {{(pid=72382) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 15:39:39 user nova-compute[72382]: DEBUG nova.virt.libvirt.vif [None req-eb1b8b3f-c181-4999-a926-673d5803ff97 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T15:39:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-384154320',display_name='tempest-TestVolumeBootPattern-server-384154320',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-384154320',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE2Ft4ugcR+xm9FJQARVlCQBYm313gUcmopkZOKz9jwU+uIeLmDWZczJQzSvB2hHfGE3d6cxNwerl6nmxRdqMq6zUG8hCLpv56gJB1tj7Wzv5bBbh5m7r3DF8/P9Gg51AA==',key_name='tempest-TestVolumeBootPattern-1990844198',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='70310b1af40b4d239fe5ea362972554b',ramdisk_id='',reservation_id='r-j7vw3np4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-451643589',owner_user_name='tempest-TestVolumeBootPattern-451643589-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T15:39:29Z,user_data=None,user_id='280bcf2afd7245a7bcd605e0db79c569',uuid=3855b76f-87cc-4be0-982c-4cc5cf5cd8aa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b7c16d4a-24b4-4ba6-860a-d180123dd204", "address": "fa:16:3e:01:6f:fa", "network": {"id": "a78e6cb6-feb7-4f64-a3c0-4900594b6e37", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-338007968-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70310b1af40b4d239fe5ea362972554b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7c16d4a-24", "ovs_interfaceid": "b7c16d4a-24b4-4ba6-860a-d180123dd204", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 15:39:39 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-eb1b8b3f-c181-4999-a926-673d5803ff97 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Converting VIF {"id": "b7c16d4a-24b4-4ba6-860a-d180123dd204", "address": "fa:16:3e:01:6f:fa", "network": {"id": "a78e6cb6-feb7-4f64-a3c0-4900594b6e37", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-338007968-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70310b1af40b4d239fe5ea362972554b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7c16d4a-24", "ovs_interfaceid": "b7c16d4a-24b4-4ba6-860a-d180123dd204", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 15:39:39 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-eb1b8b3f-c181-4999-a926-673d5803ff97 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:01:6f:fa,bridge_name='br-int',has_traffic_filtering=True,id=b7c16d4a-24b4-4ba6-860a-d180123dd204,network=Network(a78e6cb6-feb7-4f64-a3c0-4900594b6e37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7c16d4a-24') {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 15:39:39 user nova-compute[72382]: DEBUG os_vif [None req-eb1b8b3f-c181-4999-a926-673d5803ff97 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:01:6f:fa,bridge_name='br-int',has_traffic_filtering=True,id=b7c16d4a-24b4-4ba6-860a-d180123dd204,network=Network(a78e6cb6-feb7-4f64-a3c0-4900594b6e37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7c16d4a-24') {{(pid=72382) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 15:39:39 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:39:39 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:39:39 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 15:39:39 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:39:39 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb7c16d4a-24, may_exist=True, interface_attrs={}) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:39:39 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb7c16d4a-24, col_values=(('external_ids', {'iface-id': 'b7c16d4a-24b4-4ba6-860a-d180123dd204', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:01:6f:fa', 'vm-uuid': '3855b76f-87cc-4be0-982c-4cc5cf5cd8aa'}),), if_exists=True) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:39:39 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:39:39 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:39:39 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:39:39 user nova-compute[72382]: INFO os_vif [None req-eb1b8b3f-c181-4999-a926-673d5803ff97 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:01:6f:fa,bridge_name='br-int',has_traffic_filtering=True,id=b7c16d4a-24b4-4ba6-860a-d180123dd204,network=Network(a78e6cb6-feb7-4f64-a3c0-4900594b6e37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7c16d4a-24')
Aug 09 15:39:39 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-eb1b8b3f-c181-4999-a926-673d5803ff97 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] No BDM found with device name vda, not building metadata. {{(pid=72382) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 15:39:39 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-eb1b8b3f-c181-4999-a926-673d5803ff97 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] No VIF found with MAC fa:16:3e:01:6f:fa, not building metadata {{(pid=72382) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 15:39:41 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:39:41 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:39:41 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:39:41 user nova-compute[72382]: DEBUG nova.compute.manager [req-f55288df-ef47-4138-a37d-32cffcde8057 req-b8e3f15d-2923-4012-80e9-570014267c1e service nova] [instance: 3855b76f-87cc-4be0-982c-4cc5cf5cd8aa] Received event network-vif-plugged-b7c16d4a-24b4-4ba6-860a-d180123dd204 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:39:41 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-f55288df-ef47-4138-a37d-32cffcde8057 req-b8e3f15d-2923-4012-80e9-570014267c1e service nova] Acquiring lock "3855b76f-87cc-4be0-982c-4cc5cf5cd8aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:39:41 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-f55288df-ef47-4138-a37d-32cffcde8057 req-b8e3f15d-2923-4012-80e9-570014267c1e service nova] Lock "3855b76f-87cc-4be0-982c-4cc5cf5cd8aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:39:41 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-f55288df-ef47-4138-a37d-32cffcde8057 req-b8e3f15d-2923-4012-80e9-570014267c1e service nova] Lock "3855b76f-87cc-4be0-982c-4cc5cf5cd8aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:39:41 user nova-compute[72382]: DEBUG nova.compute.manager [req-f55288df-ef47-4138-a37d-32cffcde8057 req-b8e3f15d-2923-4012-80e9-570014267c1e service nova] [instance: 3855b76f-87cc-4be0-982c-4cc5cf5cd8aa] No waiting events found dispatching network-vif-plugged-b7c16d4a-24b4-4ba6-860a-d180123dd204 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:39:41 user nova-compute[72382]: WARNING nova.compute.manager [req-f55288df-ef47-4138-a37d-32cffcde8057 req-b8e3f15d-2923-4012-80e9-570014267c1e service nova] [instance: 3855b76f-87cc-4be0-982c-4cc5cf5cd8aa] Received unexpected event network-vif-plugged-b7c16d4a-24b4-4ba6-860a-d180123dd204 for instance with vm_state building and task_state spawning.
Aug 09 15:39:42 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:39:42 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:39:42 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:39:42 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:39:43 user nova-compute[72382]: DEBUG nova.compute.manager [req-768c3c47-6ce7-448b-bfa4-c45c1f0f7727 req-6cc009d6-6ba7-4058-8d1d-29a319247f84 service nova] [instance: 3855b76f-87cc-4be0-982c-4cc5cf5cd8aa] Received event network-vif-plugged-b7c16d4a-24b4-4ba6-860a-d180123dd204 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:39:43 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-768c3c47-6ce7-448b-bfa4-c45c1f0f7727 req-6cc009d6-6ba7-4058-8d1d-29a319247f84 service nova] Acquiring lock "3855b76f-87cc-4be0-982c-4cc5cf5cd8aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:39:43 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-768c3c47-6ce7-448b-bfa4-c45c1f0f7727 req-6cc009d6-6ba7-4058-8d1d-29a319247f84 service nova] Lock "3855b76f-87cc-4be0-982c-4cc5cf5cd8aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:39:43 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-768c3c47-6ce7-448b-bfa4-c45c1f0f7727 req-6cc009d6-6ba7-4058-8d1d-29a319247f84 service nova] Lock "3855b76f-87cc-4be0-982c-4cc5cf5cd8aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:39:43 user nova-compute[72382]: DEBUG nova.compute.manager [req-768c3c47-6ce7-448b-bfa4-c45c1f0f7727 req-6cc009d6-6ba7-4058-8d1d-29a319247f84 service nova] [instance: 3855b76f-87cc-4be0-982c-4cc5cf5cd8aa] No waiting events found dispatching network-vif-plugged-b7c16d4a-24b4-4ba6-860a-d180123dd204 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:39:43 user nova-compute[72382]: WARNING nova.compute.manager [req-768c3c47-6ce7-448b-bfa4-c45c1f0f7727 req-6cc009d6-6ba7-4058-8d1d-29a319247f84 service nova] [instance: 3855b76f-87cc-4be0-982c-4cc5cf5cd8aa] Received unexpected event network-vif-plugged-b7c16d4a-24b4-4ba6-860a-d180123dd204 for instance with vm_state building and task_state spawning.
Aug 09 15:39:44 user nova-compute[72382]: DEBUG nova.virt.driver [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Emitting event <LifecycleEvent: 1691595584.2987266, 3855b76f-87cc-4be0-982c-4cc5cf5cd8aa => Resumed> {{(pid=72382) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 15:39:44 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 3855b76f-87cc-4be0-982c-4cc5cf5cd8aa] VM Resumed (Lifecycle Event)
Aug 09 15:39:44 user nova-compute[72382]: DEBUG nova.compute.manager [None req-eb1b8b3f-c181-4999-a926-673d5803ff97 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: 3855b76f-87cc-4be0-982c-4cc5cf5cd8aa] Instance event wait completed in 0 seconds for  {{(pid=72382) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 15:39:44 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-eb1b8b3f-c181-4999-a926-673d5803ff97 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: 3855b76f-87cc-4be0-982c-4cc5cf5cd8aa] Guest created on hypervisor {{(pid=72382) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 15:39:44 user nova-compute[72382]: INFO nova.virt.libvirt.driver [-] [instance: 3855b76f-87cc-4be0-982c-4cc5cf5cd8aa] Instance spawned successfully.
Aug 09 15:39:44 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-eb1b8b3f-c181-4999-a926-673d5803ff97 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: 3855b76f-87cc-4be0-982c-4cc5cf5cd8aa] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 15:39:44 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 3855b76f-87cc-4be0-982c-4cc5cf5cd8aa] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:39:44 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-eb1b8b3f-c181-4999-a926-673d5803ff97 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: 3855b76f-87cc-4be0-982c-4cc5cf5cd8aa] Found default for hw_cdrom_bus of ide {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:39:44 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-eb1b8b3f-c181-4999-a926-673d5803ff97 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: 3855b76f-87cc-4be0-982c-4cc5cf5cd8aa] Found default for hw_disk_bus of virtio {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:39:44 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-eb1b8b3f-c181-4999-a926-673d5803ff97 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: 3855b76f-87cc-4be0-982c-4cc5cf5cd8aa] Found default for hw_input_bus of None {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:39:44 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-eb1b8b3f-c181-4999-a926-673d5803ff97 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: 3855b76f-87cc-4be0-982c-4cc5cf5cd8aa] Found default for hw_pointer_model of None {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:39:44 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-eb1b8b3f-c181-4999-a926-673d5803ff97 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: 3855b76f-87cc-4be0-982c-4cc5cf5cd8aa] Found default for hw_video_model of virtio {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:39:44 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-eb1b8b3f-c181-4999-a926-673d5803ff97 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: 3855b76f-87cc-4be0-982c-4cc5cf5cd8aa] Found default for hw_vif_model of virtio {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:39:44 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 3855b76f-87cc-4be0-982c-4cc5cf5cd8aa] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72382) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 15:39:44 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 3855b76f-87cc-4be0-982c-4cc5cf5cd8aa] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 15:39:44 user nova-compute[72382]: DEBUG nova.virt.driver [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Emitting event <LifecycleEvent: 1691595584.3021681, 3855b76f-87cc-4be0-982c-4cc5cf5cd8aa => Started> {{(pid=72382) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 15:39:44 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 3855b76f-87cc-4be0-982c-4cc5cf5cd8aa] VM Started (Lifecycle Event)
Aug 09 15:39:44 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 3855b76f-87cc-4be0-982c-4cc5cf5cd8aa] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:39:44 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 3855b76f-87cc-4be0-982c-4cc5cf5cd8aa] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72382) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 15:39:44 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 3855b76f-87cc-4be0-982c-4cc5cf5cd8aa] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 15:39:44 user nova-compute[72382]: INFO nova.compute.manager [None req-eb1b8b3f-c181-4999-a926-673d5803ff97 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: 3855b76f-87cc-4be0-982c-4cc5cf5cd8aa] Took 6.10 seconds to spawn the instance on the hypervisor.
Aug 09 15:39:44 user nova-compute[72382]: DEBUG nova.compute.manager [None req-eb1b8b3f-c181-4999-a926-673d5803ff97 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: 3855b76f-87cc-4be0-982c-4cc5cf5cd8aa] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:39:44 user nova-compute[72382]: INFO nova.compute.manager [None req-eb1b8b3f-c181-4999-a926-673d5803ff97 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: 3855b76f-87cc-4be0-982c-4cc5cf5cd8aa] Took 16.51 seconds to build instance.
Aug 09 15:39:44 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-eb1b8b3f-c181-4999-a926-673d5803ff97 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Lock "3855b76f-87cc-4be0-982c-4cc5cf5cd8aa" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.611s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:39:44 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:39:44 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:39:45 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:39:49 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:39:54 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:39:54 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:39:54 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72382) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 15:39:54 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72382) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 15:39:54 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72382) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 15:39:54 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:39:54 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:39:59 user nova-compute[72382]: DEBUG nova.compute.manager [req-a59dfa56-0f34-4968-8c7a-728b5bc0e438 req-b6dd9eeb-f40b-493c-8e4c-5cb50cadd835 service nova] [instance: c88a5ff2-9789-4ee8-8283-6248bba6d66a] Received event network-changed-4f9e0eae-81c7-4a91-8ac1-51459e231532 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:39:59 user nova-compute[72382]: DEBUG nova.compute.manager [req-a59dfa56-0f34-4968-8c7a-728b5bc0e438 req-b6dd9eeb-f40b-493c-8e4c-5cb50cadd835 service nova] [instance: c88a5ff2-9789-4ee8-8283-6248bba6d66a] Refreshing instance network info cache due to event network-changed-4f9e0eae-81c7-4a91-8ac1-51459e231532. {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 15:39:59 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-a59dfa56-0f34-4968-8c7a-728b5bc0e438 req-b6dd9eeb-f40b-493c-8e4c-5cb50cadd835 service nova] Acquiring lock "refresh_cache-c88a5ff2-9789-4ee8-8283-6248bba6d66a" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 15:39:59 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-a59dfa56-0f34-4968-8c7a-728b5bc0e438 req-b6dd9eeb-f40b-493c-8e4c-5cb50cadd835 service nova] Acquired lock "refresh_cache-c88a5ff2-9789-4ee8-8283-6248bba6d66a" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 15:39:59 user nova-compute[72382]: DEBUG nova.network.neutron [req-a59dfa56-0f34-4968-8c7a-728b5bc0e438 req-b6dd9eeb-f40b-493c-8e4c-5cb50cadd835 service nova] [instance: c88a5ff2-9789-4ee8-8283-6248bba6d66a] Refreshing network info cache for port 4f9e0eae-81c7-4a91-8ac1-51459e231532 {{(pid=72382) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 15:39:59 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-c5228df6-c629-4b15-a6da-c99840991d82 tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] Acquiring lock "c88a5ff2-9789-4ee8-8283-6248bba6d66a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:39:59 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-c5228df6-c629-4b15-a6da-c99840991d82 tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] Lock "c88a5ff2-9789-4ee8-8283-6248bba6d66a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:39:59 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-c5228df6-c629-4b15-a6da-c99840991d82 tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] Acquiring lock "c88a5ff2-9789-4ee8-8283-6248bba6d66a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:39:59 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-c5228df6-c629-4b15-a6da-c99840991d82 tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] Lock "c88a5ff2-9789-4ee8-8283-6248bba6d66a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:39:59 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-c5228df6-c629-4b15-a6da-c99840991d82 tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] Lock "c88a5ff2-9789-4ee8-8283-6248bba6d66a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:39:59 user nova-compute[72382]: INFO nova.compute.manager [None req-c5228df6-c629-4b15-a6da-c99840991d82 tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] [instance: c88a5ff2-9789-4ee8-8283-6248bba6d66a] Terminating instance
Aug 09 15:39:59 user nova-compute[72382]: DEBUG nova.compute.manager [None req-c5228df6-c629-4b15-a6da-c99840991d82 tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] [instance: c88a5ff2-9789-4ee8-8283-6248bba6d66a] Start destroying the instance on the hypervisor. {{(pid=72382) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 15:39:59 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:39:59 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:39:59 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:39:59 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:40:00 user nova-compute[72382]: DEBUG nova.network.neutron [req-a59dfa56-0f34-4968-8c7a-728b5bc0e438 req-b6dd9eeb-f40b-493c-8e4c-5cb50cadd835 service nova] [instance: c88a5ff2-9789-4ee8-8283-6248bba6d66a] Updated VIF entry in instance network info cache for port 4f9e0eae-81c7-4a91-8ac1-51459e231532. {{(pid=72382) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 15:40:00 user nova-compute[72382]: DEBUG nova.network.neutron [req-a59dfa56-0f34-4968-8c7a-728b5bc0e438 req-b6dd9eeb-f40b-493c-8e4c-5cb50cadd835 service nova] [instance: c88a5ff2-9789-4ee8-8283-6248bba6d66a] Updating instance_info_cache with network_info: [{"id": "4f9e0eae-81c7-4a91-8ac1-51459e231532", "address": "fa:16:3e:b2:aa:71", "network": {"id": "5f3f6e0f-94b3-4a66-9839-763a2e2d259c", "bridge": "br-int", "label": "tempest-TestShelveInstance-338163972-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "108a420b4c6e451d8429d21665e12fb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f9e0eae-81", "ovs_interfaceid": "4f9e0eae-81c7-4a91-8ac1-51459e231532", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:40:00 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-a59dfa56-0f34-4968-8c7a-728b5bc0e438 req-b6dd9eeb-f40b-493c-8e4c-5cb50cadd835 service nova] Releasing lock "refresh_cache-c88a5ff2-9789-4ee8-8283-6248bba6d66a" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 15:40:00 user nova-compute[72382]: INFO nova.virt.libvirt.driver [-] [instance: c88a5ff2-9789-4ee8-8283-6248bba6d66a] Instance destroyed successfully.
Aug 09 15:40:00 user nova-compute[72382]: DEBUG nova.objects.instance [None req-c5228df6-c629-4b15-a6da-c99840991d82 tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] Lazy-loading 'resources' on Instance uuid c88a5ff2-9789-4ee8-8283-6248bba6d66a {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:40:00 user nova-compute[72382]: DEBUG nova.virt.libvirt.vif [None req-c5228df6-c629-4b15-a6da-c99840991d82 tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-09T15:34:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1501121398',display_name='tempest-TestShelveInstance-server-1501121398',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1501121398',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCQeChkkmZm29XyCKvIOrSdRJlcr1oiXG61vF6rcJ4b2pFtnXlLbiZxIkRlmPJGbv2kd4U6HD3QswG5kTgi7CPYGFQie1zKygmhXmMi1vEfJ/SAk2GycDqgaYBJJp6hk9A==',key_name='tempest-TestShelveInstance-1348374500',keypairs=<?>,launch_index=0,launched_at=2023-08-09T15:38:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='108a420b4c6e451d8429d21665e12fb9',ramdisk_id='',reservation_id='r-3ps4xjyg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1984291610',owner_user_name='tempest-TestShelveInstance-1984291610-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T15:38:27Z,user_data=None,user_id='827f726259fb452aad32077e24ec4fc2',uuid=c88a5ff2-9789-4ee8-8283-6248bba6d66a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4f9e0eae-81c7-4a91-8ac1-51459e231532", "address": "fa:16:3e:b2:aa:71", "network": {"id": "5f3f6e0f-94b3-4a66-9839-763a2e2d259c", "bridge": "br-int", "label": "tempest-TestShelveInstance-338163972-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "108a420b4c6e451d8429d21665e12fb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f9e0eae-81", "ovs_interfaceid": "4f9e0eae-81c7-4a91-8ac1-51459e231532", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 15:40:00 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-c5228df6-c629-4b15-a6da-c99840991d82 tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] Converting VIF {"id": "4f9e0eae-81c7-4a91-8ac1-51459e231532", "address": "fa:16:3e:b2:aa:71", "network": {"id": "5f3f6e0f-94b3-4a66-9839-763a2e2d259c", "bridge": "br-int", "label": "tempest-TestShelveInstance-338163972-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "108a420b4c6e451d8429d21665e12fb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f9e0eae-81", "ovs_interfaceid": "4f9e0eae-81c7-4a91-8ac1-51459e231532", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 15:40:00 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-c5228df6-c629-4b15-a6da-c99840991d82 tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:aa:71,bridge_name='br-int',has_traffic_filtering=True,id=4f9e0eae-81c7-4a91-8ac1-51459e231532,network=Network(5f3f6e0f-94b3-4a66-9839-763a2e2d259c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f9e0eae-81') {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 15:40:00 user nova-compute[72382]: DEBUG os_vif [None req-c5228df6-c629-4b15-a6da-c99840991d82 tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:aa:71,bridge_name='br-int',has_traffic_filtering=True,id=4f9e0eae-81c7-4a91-8ac1-51459e231532,network=Network(5f3f6e0f-94b3-4a66-9839-763a2e2d259c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f9e0eae-81') {{(pid=72382) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 15:40:00 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:40:00 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4f9e0eae-81, bridge=br-int, if_exists=True) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:40:00 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:40:00 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:40:00 user nova-compute[72382]: INFO os_vif [None req-c5228df6-c629-4b15-a6da-c99840991d82 tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:aa:71,bridge_name='br-int',has_traffic_filtering=True,id=4f9e0eae-81c7-4a91-8ac1-51459e231532,network=Network(5f3f6e0f-94b3-4a66-9839-763a2e2d259c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f9e0eae-81')
Aug 09 15:40:00 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c5228df6-c629-4b15-a6da-c99840991d82 tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] [instance: c88a5ff2-9789-4ee8-8283-6248bba6d66a] calling os-brick to detach iSCSI Volume {{(pid=72382) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 15:40:00 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5228df6-c629-4b15-a6da-c99840991d82 tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2a0c768340>, {'target_iqns': ['iqn.2010-10.org.openstack:d2f5dbb5-f862-4389-b42a-872d5c94aa55'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JoLXOIMx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 15:40:00 user nova-compute[72382]: WARNING os_brick.initiator.connectors.base [None req-c5228df6-c629-4b15-a6da-c99840991d82 tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 15:40:00 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-c5228df6-c629-4b15-a6da-c99840991d82 tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 15:40:00 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-c5228df6-c629-4b15-a6da-c99840991d82 tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 15:40:00 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5228df6-c629-4b15-a6da-c99840991d82 tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d2f5dbb5-f862-4389-b42a-872d5c94aa55', 0)] {{(pid=72382) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 15:40:00 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:40:00 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:40:00 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[307c78f5-1c18-4e00-90c0-e3e794abcb1b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:170d7509-0928-4a87-9d9f-437977452501\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3f58579c-f69a-4bee-b16e-970e5a8f590c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a0a612d6-0f3f-4d2c-9fb5-aff9384338de\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d2f5dbb5-f862-4389-b42a-872d5c94aa55\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:40:00 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:40:00 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:40:00 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[0df67376-8ad0-40df-b269-b396b64f3538]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0a612d6-0f3f-4d2c-9fb5-aff9384338de (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2f5dbb5-f862-4389-b42a-872d5c94aa55 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:170d7509-0928-4a87-9d9f-437977452501 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f58579c-f69a-4bee-b16e-970e5a8f590c (non-flash)\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:40:00 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5228df6-c629-4b15-a6da-c99840991d82 tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0a612d6-0f3f-4d2c-9fb5-aff9384338de (non-flash)
Aug 09 15:40:00 user nova-compute[72382]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2f5dbb5-f862-4389-b42a-872d5c94aa55 (non-flash)
Aug 09 15:40:00 user nova-compute[72382]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:170d7509-0928-4a87-9d9f-437977452501 (non-flash)
Aug 09 15:40:00 user nova-compute[72382]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f58579c-f69a-4bee-b16e-970e5a8f590c (non-flash)
Aug 09 15:40:00 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 15:40:00 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5228df6-c629-4b15-a6da-c99840991d82 tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0a612d6-0f3f-4d2c-9fb5-aff9384338de (non-flash)
Aug 09 15:40:00 user nova-compute[72382]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2f5dbb5-f862-4389-b42a-872d5c94aa55 (non-flash)
Aug 09 15:40:00 user nova-compute[72382]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:170d7509-0928-4a87-9d9f-437977452501 (non-flash)
Aug 09 15:40:00 user nova-compute[72382]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f58579c-f69a-4bee-b16e-970e5a8f590c (non-flash)
Aug 09 15:40:00 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 15:40:00 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5228df6-c629-4b15-a6da-c99840991d82 tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2a243068c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d2f5dbb5-f862-4389-b42a-872d5c94aa55'): ({'sdg'}, set())}) {{(pid=72382) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 15:40:00 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-c5228df6-c629-4b15-a6da-c99840991d82 tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] Removing single pathed devices sdg {{(pid=72382) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 15:40:00 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:40:00 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:40:00 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3ef87ba-d58e-4c1d-8bfd-2e5fca221371]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:40:00 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:40:00 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.020s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:40:00 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec1ad77c-94d2-4167-b469-954402542158]: (4, ('ok\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:40:00 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-c5228df6-c629-4b15-a6da-c99840991d82 tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] Flushing IO for device /dev/sdg {{(pid=72382) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 15:40:00 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:40:00 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.013s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:40:00 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b93b14e-42ed-4aeb-ac22-bb05ad791e86]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:40:00 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-c5228df6-c629-4b15-a6da-c99840991d82 tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=72382) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 15:40:00 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:40:00 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.101s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:40:00 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f106690-708a-434c-bc04-727614690872]: (4, ('1', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:40:00 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-c5228df6-c629-4b15-a6da-c99840991d82 tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=72382) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 15:40:00 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-c5228df6-c629-4b15-a6da-c99840991d82 tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] SCSI volumes sdg have been removed. {{(pid=72382) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 15:40:00 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5228df6-c629-4b15-a6da-c99840991d82 tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d2f5dbb5-f862-4389-b42a-872d5c94aa55')] {{(pid=72382) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 15:40:00 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2f5dbb5-f862-4389-b42a-872d5c94aa55 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:40:00 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2f5dbb5-f862-4389-b42a-872d5c94aa55 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:40:00 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbd758e9-c482-4a93-a0fc-d58bb4cccb83]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:40:00 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5228df6-c629-4b15-a6da-c99840991d82 tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:40:00 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2f5dbb5-f862-4389-b42a-872d5c94aa55 -p 172.16.0.220:3260 --logout {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:40:00 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2f5dbb5-f862-4389-b42a-872d5c94aa55 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:40:00 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[587e5bc6-2520-4014-96f6-6029478b68ff]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:d2f5dbb5-f862-4389-b42a-872d5c94aa55, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:d2f5dbb5-f862-4389-b42a-872d5c94aa55, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:40:00 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5228df6-c629-4b15-a6da-c99840991d82 tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:d2f5dbb5-f862-4389-b42a-872d5c94aa55, portal: 172.16.0.220,3260]
Aug 09 15:40:00 user nova-compute[72382]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:d2f5dbb5-f862-4389-b42a-872d5c94aa55, portal: 172.16.0.220,3260] successful.
Aug 09 15:40:00 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:40:00 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2f5dbb5-f862-4389-b42a-872d5c94aa55 -p 172.16.0.220:3260 --op delete {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:40:00 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2f5dbb5-f862-4389-b42a-872d5c94aa55 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:40:00 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[c645a26d-aeb4-4e28-82a7-87ae852b7b8e]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:40:00 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5228df6-c629-4b15-a6da-c99840991d82 tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:40:00 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-c5228df6-c629-4b15-a6da-c99840991d82 tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.349s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 15:40:00 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5228df6-c629-4b15-a6da-c99840991d82 tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] <== disconnect_volume: return (350ms) None {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 15:40:00 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c5228df6-c629-4b15-a6da-c99840991d82 tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] [instance: c88a5ff2-9789-4ee8-8283-6248bba6d66a] Disconnected iSCSI Volume {{(pid=72382) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 15:40:00 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-c5228df6-c629-4b15-a6da-c99840991d82 tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] [instance: c88a5ff2-9789-4ee8-8283-6248bba6d66a] Deleting instance files /opt/stack/data/nova/instances/c88a5ff2-9789-4ee8-8283-6248bba6d66a_del
Aug 09 15:40:00 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-c5228df6-c629-4b15-a6da-c99840991d82 tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] [instance: c88a5ff2-9789-4ee8-8283-6248bba6d66a] Deletion of /opt/stack/data/nova/instances/c88a5ff2-9789-4ee8-8283-6248bba6d66a_del complete
Aug 09 15:40:00 user nova-compute[72382]: INFO nova.compute.manager [None req-c5228df6-c629-4b15-a6da-c99840991d82 tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] [instance: c88a5ff2-9789-4ee8-8283-6248bba6d66a] Took 1.22 seconds to destroy the instance on the hypervisor.
Aug 09 15:40:00 user nova-compute[72382]: DEBUG oslo.service.loopingcall [None req-c5228df6-c629-4b15-a6da-c99840991d82 tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72382) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 15:40:00 user nova-compute[72382]: DEBUG nova.compute.manager [-] [instance: c88a5ff2-9789-4ee8-8283-6248bba6d66a] Deallocating network for instance {{(pid=72382) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 15:40:00 user nova-compute[72382]: DEBUG nova.network.neutron [-] [instance: c88a5ff2-9789-4ee8-8283-6248bba6d66a] deallocate_for_instance() {{(pid=72382) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 15:40:01 user nova-compute[72382]: DEBUG nova.network.neutron [-] [instance: c88a5ff2-9789-4ee8-8283-6248bba6d66a] Updating instance_info_cache with network_info: [] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:40:01 user nova-compute[72382]: INFO nova.compute.manager [-] [instance: c88a5ff2-9789-4ee8-8283-6248bba6d66a] Took 0.65 seconds to deallocate network for instance.
Aug 09 15:40:01 user nova-compute[72382]: DEBUG nova.compute.manager [req-3a986cad-a17b-4996-ad0e-d7b4a8d19b75 req-3791b852-305a-4cf8-9eaf-d7176438b1e6 service nova] [instance: c88a5ff2-9789-4ee8-8283-6248bba6d66a] Received event network-vif-deleted-4f9e0eae-81c7-4a91-8ac1-51459e231532 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:40:01 user nova-compute[72382]: INFO nova.compute.manager [req-3a986cad-a17b-4996-ad0e-d7b4a8d19b75 req-3791b852-305a-4cf8-9eaf-d7176438b1e6 service nova] [instance: c88a5ff2-9789-4ee8-8283-6248bba6d66a] Neutron deleted interface 4f9e0eae-81c7-4a91-8ac1-51459e231532; detaching it from the instance and deleting it from the info cache
Aug 09 15:40:01 user nova-compute[72382]: DEBUG nova.network.neutron [req-3a986cad-a17b-4996-ad0e-d7b4a8d19b75 req-3791b852-305a-4cf8-9eaf-d7176438b1e6 service nova] [instance: c88a5ff2-9789-4ee8-8283-6248bba6d66a] Updating instance_info_cache with network_info: [] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:40:01 user nova-compute[72382]: DEBUG nova.compute.manager [req-f4149705-65cf-4c91-9d4e-f44a20e1fd41 req-74f483d3-91ea-4dd1-a0a1-f7b87b5cfe9b service nova] [instance: c88a5ff2-9789-4ee8-8283-6248bba6d66a] Received event network-vif-unplugged-4f9e0eae-81c7-4a91-8ac1-51459e231532 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:40:01 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-f4149705-65cf-4c91-9d4e-f44a20e1fd41 req-74f483d3-91ea-4dd1-a0a1-f7b87b5cfe9b service nova] Acquiring lock "c88a5ff2-9789-4ee8-8283-6248bba6d66a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:40:01 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-f4149705-65cf-4c91-9d4e-f44a20e1fd41 req-74f483d3-91ea-4dd1-a0a1-f7b87b5cfe9b service nova] Lock "c88a5ff2-9789-4ee8-8283-6248bba6d66a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:40:01 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-f4149705-65cf-4c91-9d4e-f44a20e1fd41 req-74f483d3-91ea-4dd1-a0a1-f7b87b5cfe9b service nova] Lock "c88a5ff2-9789-4ee8-8283-6248bba6d66a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:40:01 user nova-compute[72382]: DEBUG nova.compute.manager [req-f4149705-65cf-4c91-9d4e-f44a20e1fd41 req-74f483d3-91ea-4dd1-a0a1-f7b87b5cfe9b service nova] [instance: c88a5ff2-9789-4ee8-8283-6248bba6d66a] No waiting events found dispatching network-vif-unplugged-4f9e0eae-81c7-4a91-8ac1-51459e231532 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:40:01 user nova-compute[72382]: DEBUG nova.compute.manager [req-f4149705-65cf-4c91-9d4e-f44a20e1fd41 req-74f483d3-91ea-4dd1-a0a1-f7b87b5cfe9b service nova] [instance: c88a5ff2-9789-4ee8-8283-6248bba6d66a] Received event network-vif-unplugged-4f9e0eae-81c7-4a91-8ac1-51459e231532 for instance with task_state deleting. {{(pid=72382) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 15:40:01 user nova-compute[72382]: DEBUG nova.compute.manager [req-f4149705-65cf-4c91-9d4e-f44a20e1fd41 req-74f483d3-91ea-4dd1-a0a1-f7b87b5cfe9b service nova] [instance: c88a5ff2-9789-4ee8-8283-6248bba6d66a] Received event network-vif-plugged-4f9e0eae-81c7-4a91-8ac1-51459e231532 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:40:01 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-f4149705-65cf-4c91-9d4e-f44a20e1fd41 req-74f483d3-91ea-4dd1-a0a1-f7b87b5cfe9b service nova] Acquiring lock "c88a5ff2-9789-4ee8-8283-6248bba6d66a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:40:01 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-f4149705-65cf-4c91-9d4e-f44a20e1fd41 req-74f483d3-91ea-4dd1-a0a1-f7b87b5cfe9b service nova] Lock "c88a5ff2-9789-4ee8-8283-6248bba6d66a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:40:01 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-f4149705-65cf-4c91-9d4e-f44a20e1fd41 req-74f483d3-91ea-4dd1-a0a1-f7b87b5cfe9b service nova] Lock "c88a5ff2-9789-4ee8-8283-6248bba6d66a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:40:01 user nova-compute[72382]: DEBUG nova.compute.manager [req-f4149705-65cf-4c91-9d4e-f44a20e1fd41 req-74f483d3-91ea-4dd1-a0a1-f7b87b5cfe9b service nova] [instance: c88a5ff2-9789-4ee8-8283-6248bba6d66a] No waiting events found dispatching network-vif-plugged-4f9e0eae-81c7-4a91-8ac1-51459e231532 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:40:01 user nova-compute[72382]: WARNING nova.compute.manager [req-f4149705-65cf-4c91-9d4e-f44a20e1fd41 req-74f483d3-91ea-4dd1-a0a1-f7b87b5cfe9b service nova] [instance: c88a5ff2-9789-4ee8-8283-6248bba6d66a] Received unexpected event network-vif-plugged-4f9e0eae-81c7-4a91-8ac1-51459e231532 for instance with vm_state active and task_state deleting.
Aug 09 15:40:01 user nova-compute[72382]: DEBUG nova.compute.manager [req-3a986cad-a17b-4996-ad0e-d7b4a8d19b75 req-3791b852-305a-4cf8-9eaf-d7176438b1e6 service nova] [instance: c88a5ff2-9789-4ee8-8283-6248bba6d66a] Detach interface failed, port_id=4f9e0eae-81c7-4a91-8ac1-51459e231532, reason: Instance c88a5ff2-9789-4ee8-8283-6248bba6d66a could not be found. {{(pid=72382) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 09 15:40:02 user nova-compute[72382]: INFO nova.compute.manager [None req-c5228df6-c629-4b15-a6da-c99840991d82 tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] [instance: c88a5ff2-9789-4ee8-8283-6248bba6d66a] Took 0.75 seconds to detach 1 volumes for instance.
Aug 09 15:40:02 user nova-compute[72382]: DEBUG nova.compute.manager [None req-c5228df6-c629-4b15-a6da-c99840991d82 tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] [instance: c88a5ff2-9789-4ee8-8283-6248bba6d66a] Deleting volume: d2f5dbb5-f862-4389-b42a-872d5c94aa55 {{(pid=72382) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 09 15:40:02 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-c5228df6-c629-4b15-a6da-c99840991d82 tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:40:02 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-c5228df6-c629-4b15-a6da-c99840991d82 tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:40:02 user nova-compute[72382]: DEBUG nova.compute.provider_tree [None req-c5228df6-c629-4b15-a6da-c99840991d82 tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] Inventory has not changed in ProviderTree for provider: 7b15b0e5-df4d-49db-833b-2855d21d10ae {{(pid=72382) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 15:40:02 user nova-compute[72382]: DEBUG nova.scheduler.client.report [None req-c5228df6-c629-4b15-a6da-c99840991d82 tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] Inventory has not changed for provider 7b15b0e5-df4d-49db-833b-2855d21d10ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72382) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 15:40:02 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-c5228df6-c629-4b15-a6da-c99840991d82 tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.282s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:40:02 user nova-compute[72382]: INFO nova.scheduler.client.report [None req-c5228df6-c629-4b15-a6da-c99840991d82 tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] Deleted allocations for instance c88a5ff2-9789-4ee8-8283-6248bba6d66a
Aug 09 15:40:03 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-c5228df6-c629-4b15-a6da-c99840991d82 tempest-TestShelveInstance-1984291610 tempest-TestShelveInstance-1984291610-project-member] Lock "c88a5ff2-9789-4ee8-8283-6248bba6d66a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.272s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:40:04 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:40:05 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:40:09 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:40:10 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:40:11 user nova-compute[72382]: DEBUG nova.compute.manager [req-0b2d63e6-b4a8-49e9-bf90-a1db4f78febf req-717e9859-cbb6-4746-ab70-7377253ea44b service nova] [instance: 7949b7d0-2712-402f-86ee-30acaef2d3e7] Received event network-changed-bf6ac419-c6ba-4f01-b35a-4fa5e58913be {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:40:11 user nova-compute[72382]: DEBUG nova.compute.manager [req-0b2d63e6-b4a8-49e9-bf90-a1db4f78febf req-717e9859-cbb6-4746-ab70-7377253ea44b service nova] [instance: 7949b7d0-2712-402f-86ee-30acaef2d3e7] Refreshing instance network info cache due to event network-changed-bf6ac419-c6ba-4f01-b35a-4fa5e58913be. {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 15:40:11 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-0b2d63e6-b4a8-49e9-bf90-a1db4f78febf req-717e9859-cbb6-4746-ab70-7377253ea44b service nova] Acquiring lock "refresh_cache-7949b7d0-2712-402f-86ee-30acaef2d3e7" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 15:40:11 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-0b2d63e6-b4a8-49e9-bf90-a1db4f78febf req-717e9859-cbb6-4746-ab70-7377253ea44b service nova] Acquired lock "refresh_cache-7949b7d0-2712-402f-86ee-30acaef2d3e7" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 15:40:11 user nova-compute[72382]: DEBUG nova.network.neutron [req-0b2d63e6-b4a8-49e9-bf90-a1db4f78febf req-717e9859-cbb6-4746-ab70-7377253ea44b service nova] [instance: 7949b7d0-2712-402f-86ee-30acaef2d3e7] Refreshing network info cache for port bf6ac419-c6ba-4f01-b35a-4fa5e58913be {{(pid=72382) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 15:40:12 user nova-compute[72382]: DEBUG nova.network.neutron [req-0b2d63e6-b4a8-49e9-bf90-a1db4f78febf req-717e9859-cbb6-4746-ab70-7377253ea44b service nova] [instance: 7949b7d0-2712-402f-86ee-30acaef2d3e7] Updated VIF entry in instance network info cache for port bf6ac419-c6ba-4f01-b35a-4fa5e58913be. {{(pid=72382) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 15:40:12 user nova-compute[72382]: DEBUG nova.network.neutron [req-0b2d63e6-b4a8-49e9-bf90-a1db4f78febf req-717e9859-cbb6-4746-ab70-7377253ea44b service nova] [instance: 7949b7d0-2712-402f-86ee-30acaef2d3e7] Updating instance_info_cache with network_info: [{"id": "bf6ac419-c6ba-4f01-b35a-4fa5e58913be", "address": "fa:16:3e:26:fd:d1", "network": {"id": "8d929426-09f7-49b5-a79e-711e20e00750", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1307802727-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.154", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93c87775443b4abd987197c4b46693bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf6ac419-c6", "ovs_interfaceid": "bf6ac419-c6ba-4f01-b35a-4fa5e58913be", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:40:12 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-0b2d63e6-b4a8-49e9-bf90-a1db4f78febf req-717e9859-cbb6-4746-ab70-7377253ea44b service nova] Releasing lock "refresh_cache-7949b7d0-2712-402f-86ee-30acaef2d3e7" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 15:40:12 user nova-compute[72382]: DEBUG nova.compute.manager [req-5d05130a-816f-46ff-8193-945b5fd856b6 req-5780e576-1b09-4a81-98ca-eb2a0a12cd47 service nova] [instance: 7949b7d0-2712-402f-86ee-30acaef2d3e7] Received event network-changed-bf6ac419-c6ba-4f01-b35a-4fa5e58913be {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:40:12 user nova-compute[72382]: DEBUG nova.compute.manager [req-5d05130a-816f-46ff-8193-945b5fd856b6 req-5780e576-1b09-4a81-98ca-eb2a0a12cd47 service nova] [instance: 7949b7d0-2712-402f-86ee-30acaef2d3e7] Refreshing instance network info cache due to event network-changed-bf6ac419-c6ba-4f01-b35a-4fa5e58913be. {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 15:40:12 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-5d05130a-816f-46ff-8193-945b5fd856b6 req-5780e576-1b09-4a81-98ca-eb2a0a12cd47 service nova] Acquiring lock "refresh_cache-7949b7d0-2712-402f-86ee-30acaef2d3e7" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 15:40:12 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-5d05130a-816f-46ff-8193-945b5fd856b6 req-5780e576-1b09-4a81-98ca-eb2a0a12cd47 service nova] Acquired lock "refresh_cache-7949b7d0-2712-402f-86ee-30acaef2d3e7" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 15:40:12 user nova-compute[72382]: DEBUG nova.network.neutron [req-5d05130a-816f-46ff-8193-945b5fd856b6 req-5780e576-1b09-4a81-98ca-eb2a0a12cd47 service nova] [instance: 7949b7d0-2712-402f-86ee-30acaef2d3e7] Refreshing network info cache for port bf6ac419-c6ba-4f01-b35a-4fa5e58913be {{(pid=72382) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 15:40:12 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-2a86677c-27b7-4563-bec6-670613386e5d tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Acquiring lock "7949b7d0-2712-402f-86ee-30acaef2d3e7" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:40:12 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-2a86677c-27b7-4563-bec6-670613386e5d tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Lock "7949b7d0-2712-402f-86ee-30acaef2d3e7" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:40:13 user nova-compute[72382]: INFO nova.compute.manager [None req-2a86677c-27b7-4563-bec6-670613386e5d tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] [instance: 7949b7d0-2712-402f-86ee-30acaef2d3e7] Detaching volume 170d7509-0928-4a87-9d9f-437977452501
Aug 09 15:40:13 user nova-compute[72382]: INFO nova.virt.block_device [None req-2a86677c-27b7-4563-bec6-670613386e5d tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] [instance: 7949b7d0-2712-402f-86ee-30acaef2d3e7] Attempting to driver detach volume 170d7509-0928-4a87-9d9f-437977452501 from mountpoint /dev/vdb
Aug 09 15:40:13 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-2a86677c-27b7-4563-bec6-670613386e5d tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Attempting to detach device vdb from instance 7949b7d0-2712-402f-86ee-30acaef2d3e7 from the persistent domain config. {{(pid=72382) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 15:40:13 user nova-compute[72382]: DEBUG nova.virt.libvirt.guest [None req-2a86677c-27b7-4563-bec6-670613386e5d tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 15:40:13 user nova-compute[72382]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 15:40:13 user nova-compute[72382]:   <source dev="/dev/sdd"/>
Aug 09 15:40:13 user nova-compute[72382]:   <target dev="vdb" bus="virtio"/>
Aug 09 15:40:13 user nova-compute[72382]:   <serial>170d7509-0928-4a87-9d9f-437977452501</serial>
Aug 09 15:40:13 user nova-compute[72382]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 09 15:40:13 user nova-compute[72382]: </disk>
Aug 09 15:40:13 user nova-compute[72382]:  {{(pid=72382) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 15:40:13 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-2a86677c-27b7-4563-bec6-670613386e5d tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Successfully detached device vdb from instance 7949b7d0-2712-402f-86ee-30acaef2d3e7 from the persistent domain config.
Aug 09 15:40:13 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-2a86677c-27b7-4563-bec6-670613386e5d tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 7949b7d0-2712-402f-86ee-30acaef2d3e7 from the live domain config. {{(pid=72382) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 15:40:13 user nova-compute[72382]: DEBUG nova.virt.libvirt.guest [None req-2a86677c-27b7-4563-bec6-670613386e5d tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 15:40:13 user nova-compute[72382]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 15:40:13 user nova-compute[72382]:   <source dev="/dev/sdd"/>
Aug 09 15:40:13 user nova-compute[72382]:   <target dev="vdb" bus="virtio"/>
Aug 09 15:40:13 user nova-compute[72382]:   <serial>170d7509-0928-4a87-9d9f-437977452501</serial>
Aug 09 15:40:13 user nova-compute[72382]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 09 15:40:13 user nova-compute[72382]: </disk>
Aug 09 15:40:13 user nova-compute[72382]:  {{(pid=72382) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 15:40:13 user nova-compute[72382]: DEBUG nova.network.neutron [req-5d05130a-816f-46ff-8193-945b5fd856b6 req-5780e576-1b09-4a81-98ca-eb2a0a12cd47 service nova] [instance: 7949b7d0-2712-402f-86ee-30acaef2d3e7] Updated VIF entry in instance network info cache for port bf6ac419-c6ba-4f01-b35a-4fa5e58913be. {{(pid=72382) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 15:40:13 user nova-compute[72382]: DEBUG nova.network.neutron [req-5d05130a-816f-46ff-8193-945b5fd856b6 req-5780e576-1b09-4a81-98ca-eb2a0a12cd47 service nova] [instance: 7949b7d0-2712-402f-86ee-30acaef2d3e7] Updating instance_info_cache with network_info: [{"id": "bf6ac419-c6ba-4f01-b35a-4fa5e58913be", "address": "fa:16:3e:26:fd:d1", "network": {"id": "8d929426-09f7-49b5-a79e-711e20e00750", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1307802727-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93c87775443b4abd987197c4b46693bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf6ac419-c6", "ovs_interfaceid": "bf6ac419-c6ba-4f01-b35a-4fa5e58913be", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:40:13 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-5d05130a-816f-46ff-8193-945b5fd856b6 req-5780e576-1b09-4a81-98ca-eb2a0a12cd47 service nova] Releasing lock "refresh_cache-7949b7d0-2712-402f-86ee-30acaef2d3e7" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 15:40:13 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Received event <DeviceRemovedEvent: 1691595613.6948664, 7949b7d0-2712-402f-86ee-30acaef2d3e7 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72382) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 15:40:13 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-2a86677c-27b7-4563-bec6-670613386e5d tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 7949b7d0-2712-402f-86ee-30acaef2d3e7 {{(pid=72382) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 15:40:13 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-2a86677c-27b7-4563-bec6-670613386e5d tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Successfully detached device vdb from instance 7949b7d0-2712-402f-86ee-30acaef2d3e7 from the live domain config.
Aug 09 15:40:13 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2a86677c-27b7-4563-bec6-670613386e5d tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] [instance: 7949b7d0-2712-402f-86ee-30acaef2d3e7] calling os-brick to detach iSCSI Volume {{(pid=72382) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 15:40:13 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a86677c-27b7-4563-bec6-670613386e5d tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2a0c768340>, {'target_iqns': ['iqn.2010-10.org.openstack:170d7509-0928-4a87-9d9f-437977452501'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IeCsFWVU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 15:40:13 user nova-compute[72382]: WARNING os_brick.initiator.connectors.base [None req-2a86677c-27b7-4563-bec6-670613386e5d tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 15:40:13 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-2a86677c-27b7-4563-bec6-670613386e5d tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 15:40:13 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-2a86677c-27b7-4563-bec6-670613386e5d tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 15:40:13 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a86677c-27b7-4563-bec6-670613386e5d tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:170d7509-0928-4a87-9d9f-437977452501', 0)] {{(pid=72382) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 15:40:13 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:40:13 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:40:13 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ca0cae7-f172-4e4b-9d3f-8eb097e11891]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:170d7509-0928-4a87-9d9f-437977452501\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3f58579c-f69a-4bee-b16e-970e5a8f590c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a0a612d6-0f3f-4d2c-9fb5-aff9384338de\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:40:13 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:40:13 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:40:13 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[917fe5a1-2e7c-445c-bc71-5c9fb65e4474]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0a612d6-0f3f-4d2c-9fb5-aff9384338de (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:170d7509-0928-4a87-9d9f-437977452501 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f58579c-f69a-4bee-b16e-970e5a8f590c (non-flash)\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:40:13 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a86677c-27b7-4563-bec6-670613386e5d tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0a612d6-0f3f-4d2c-9fb5-aff9384338de (non-flash)
Aug 09 15:40:13 user nova-compute[72382]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:170d7509-0928-4a87-9d9f-437977452501 (non-flash)
Aug 09 15:40:13 user nova-compute[72382]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f58579c-f69a-4bee-b16e-970e5a8f590c (non-flash)
Aug 09 15:40:13 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 15:40:13 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a86677c-27b7-4563-bec6-670613386e5d tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0a612d6-0f3f-4d2c-9fb5-aff9384338de (non-flash)
Aug 09 15:40:13 user nova-compute[72382]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:170d7509-0928-4a87-9d9f-437977452501 (non-flash)
Aug 09 15:40:13 user nova-compute[72382]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f58579c-f69a-4bee-b16e-970e5a8f590c (non-flash)
Aug 09 15:40:13 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 15:40:13 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a86677c-27b7-4563-bec6-670613386e5d tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2a241467a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:170d7509-0928-4a87-9d9f-437977452501'): ({'sdd'}, set())}) {{(pid=72382) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 15:40:13 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-2a86677c-27b7-4563-bec6-670613386e5d tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Removing single pathed devices sdd {{(pid=72382) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 15:40:13 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:40:13 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:40:13 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[18e2b2ef-d195-4f83-a482-c1af7c8f4ba4]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:40:13 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:40:13 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:40:13 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb94a7bd-c396-4a1d-a34e-bc852e0791f5]: (4, ('ok\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:40:13 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-2a86677c-27b7-4563-bec6-670613386e5d tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Flushing IO for device /dev/sdd {{(pid=72382) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 15:40:13 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:40:13 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:40:13 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[71fe3da9-124a-441c-ab1f-60c0f77aff28]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:40:13 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-2a86677c-27b7-4563-bec6-670613386e5d tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72382) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 15:40:13 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:40:13 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.037s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:40:13 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e491d7c-501f-41ee-bd70-7994c52cb60b]: (4, ('1', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:40:13 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-2a86677c-27b7-4563-bec6-670613386e5d tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72382) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 15:40:13 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-2a86677c-27b7-4563-bec6-670613386e5d tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] SCSI volumes sdd have been removed. {{(pid=72382) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 15:40:13 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a86677c-27b7-4563-bec6-670613386e5d tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:170d7509-0928-4a87-9d9f-437977452501')] {{(pid=72382) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 15:40:13 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:170d7509-0928-4a87-9d9f-437977452501 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:40:13 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:170d7509-0928-4a87-9d9f-437977452501 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:40:13 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[12c898b3-a51a-4c37-9262-e36ddc2e3c89]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:40:13 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a86677c-27b7-4563-bec6-670613386e5d tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:40:13 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:170d7509-0928-4a87-9d9f-437977452501 -p 172.16.0.220:3260 --logout {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:40:13 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:170d7509-0928-4a87-9d9f-437977452501 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:40:13 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[a117a5c8-5471-4927-aac9-855818e51a5c]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:170d7509-0928-4a87-9d9f-437977452501, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:170d7509-0928-4a87-9d9f-437977452501, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:40:13 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a86677c-27b7-4563-bec6-670613386e5d tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:170d7509-0928-4a87-9d9f-437977452501, portal: 172.16.0.220,3260]
Aug 09 15:40:13 user nova-compute[72382]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:170d7509-0928-4a87-9d9f-437977452501, portal: 172.16.0.220,3260] successful.
Aug 09 15:40:13 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:40:13 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:170d7509-0928-4a87-9d9f-437977452501 -p 172.16.0.220:3260 --op delete {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:40:13 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:170d7509-0928-4a87-9d9f-437977452501 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:40:13 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3276ceb-16ea-49e8-b68b-3218d020645a]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:40:13 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a86677c-27b7-4563-bec6-670613386e5d tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:40:13 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-2a86677c-27b7-4563-bec6-670613386e5d tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.267s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 15:40:13 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a86677c-27b7-4563-bec6-670613386e5d tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] <== disconnect_volume: return (269ms) None {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 15:40:13 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2a86677c-27b7-4563-bec6-670613386e5d tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] [instance: 7949b7d0-2712-402f-86ee-30acaef2d3e7] Disconnected iSCSI Volume {{(pid=72382) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 15:40:14 user nova-compute[72382]: DEBUG nova.objects.instance [None req-2a86677c-27b7-4563-bec6-670613386e5d tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Lazy-loading 'flavor' on Instance uuid 7949b7d0-2712-402f-86ee-30acaef2d3e7 {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:40:14 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-2a86677c-27b7-4563-bec6-670613386e5d tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Lock "7949b7d0-2712-402f-86ee-30acaef2d3e7" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.837s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:40:14 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:40:15 user nova-compute[72382]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691595600.5140853, c88a5ff2-9789-4ee8-8283-6248bba6d66a => Stopped> {{(pid=72382) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 15:40:15 user nova-compute[72382]: INFO nova.compute.manager [-] [instance: c88a5ff2-9789-4ee8-8283-6248bba6d66a] VM Stopped (Lifecycle Event)
Aug 09 15:40:15 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8c471184-e638-4f6d-890e-9e49773bef5a None None] [instance: c88a5ff2-9789-4ee8-8283-6248bba6d66a] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:40:15 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:40:16 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:40:16 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:40:16 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:40:16 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:40:16 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Auditing locally available compute resources for user (node: user) {{(pid=72382) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 15:40:17 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7949b7d0-2712-402f-86ee-30acaef2d3e7/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:40:17 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7949b7d0-2712-402f-86ee-30acaef2d3e7/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:40:17 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7949b7d0-2712-402f-86ee-30acaef2d3e7/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:40:17 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7949b7d0-2712-402f-86ee-30acaef2d3e7/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:40:17 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/402ba448-a30a-45f2-a724-5a53cf584547/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:40:17 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/402ba448-a30a-45f2-a724-5a53cf584547/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:40:17 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/402ba448-a30a-45f2-a724-5a53cf584547/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:40:17 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/402ba448-a30a-45f2-a724-5a53cf584547/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:40:17 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0da60bf-7468-4041-8016-54e3d82386b7/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:40:17 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0da60bf-7468-4041-8016-54e3d82386b7/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:40:17 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0da60bf-7468-4041-8016-54e3d82386b7/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:40:18 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0da60bf-7468-4041-8016-54e3d82386b7/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:40:18 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ccbfda2-8bcd-4ec1-972a-cf49a62b1583/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:40:18 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ccbfda2-8bcd-4ec1-972a-cf49a62b1583/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:40:18 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ccbfda2-8bcd-4ec1-972a-cf49a62b1583/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:40:18 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ccbfda2-8bcd-4ec1-972a-cf49a62b1583/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:40:18 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72382) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 15:40:18 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72382) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 15:40:18 user nova-compute[72382]: WARNING nova.virt.libvirt.driver [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 15:40:18 user nova-compute[72382]: WARNING nova.virt.libvirt.driver [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 15:40:18 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Hypervisor/Node resource view: name=user free_ram=7746MB free_disk=25.315204620361328GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72382) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 15:40:18 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:40:18 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:40:18 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance 4ccbfda2-8bcd-4ec1-972a-cf49a62b1583 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:40:18 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance 7949b7d0-2712-402f-86ee-30acaef2d3e7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:40:18 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance 54523d3e-bfae-4621-85cb-d6a7bc40abf5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:40:18 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance 402ba448-a30a-45f2-a724-5a53cf584547 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:40:18 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance 3855b76f-87cc-4be0-982c-4cc5cf5cd8aa actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:40:18 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance b0da60bf-7468-4041-8016-54e3d82386b7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:40:18 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=72382) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 15:40:18 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=72382) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 15:40:19 user nova-compute[72382]: DEBUG nova.compute.provider_tree [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Inventory has not changed in ProviderTree for provider: 7b15b0e5-df4d-49db-833b-2855d21d10ae {{(pid=72382) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 15:40:19 user nova-compute[72382]: DEBUG nova.scheduler.client.report [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Inventory has not changed for provider 7b15b0e5-df4d-49db-833b-2855d21d10ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72382) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 15:40:19 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Compute_service record updated for user:user {{(pid=72382) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 15:40:19 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.356s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:40:20 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:40:21 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:40:21 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:40:22 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:40:22 user nova-compute[72382]: DEBUG nova.compute.manager [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72382) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 15:40:23 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:40:23 user nova-compute[72382]: DEBUG nova.compute.manager [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Starting heal instance info cache {{(pid=72382) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 15:40:23 user nova-compute[72382]: DEBUG nova.compute.manager [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Rebuilding the list of instances to heal {{(pid=72382) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 09 15:40:23 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Acquiring lock "refresh_cache-4ccbfda2-8bcd-4ec1-972a-cf49a62b1583" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 15:40:23 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Acquired lock "refresh_cache-4ccbfda2-8bcd-4ec1-972a-cf49a62b1583" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 15:40:23 user nova-compute[72382]: DEBUG nova.network.neutron [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] [instance: 4ccbfda2-8bcd-4ec1-972a-cf49a62b1583] Forcefully refreshing network info cache for instance {{(pid=72382) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 15:40:23 user nova-compute[72382]: DEBUG nova.objects.instance [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lazy-loading 'info_cache' on Instance uuid 4ccbfda2-8bcd-4ec1-972a-cf49a62b1583 {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:40:24 user nova-compute[72382]: DEBUG nova.network.neutron [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] [instance: 4ccbfda2-8bcd-4ec1-972a-cf49a62b1583] Updating instance_info_cache with network_info: [{"id": "2d07e6a3-03b7-4035-bdd2-a95435b99852", "address": "fa:16:3e:9a:d4:3a", "network": {"id": "308641dc-cc18-41db-9baa-7cc880e594ad", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1932973397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb5bf3f95d2843af94dbcab2af932bd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d07e6a3-03", "ovs_interfaceid": "2d07e6a3-03b7-4035-bdd2-a95435b99852", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:40:24 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Releasing lock "refresh_cache-4ccbfda2-8bcd-4ec1-972a-cf49a62b1583" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 15:40:24 user nova-compute[72382]: DEBUG nova.compute.manager [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] [instance: 4ccbfda2-8bcd-4ec1-972a-cf49a62b1583] Updated the network info_cache for instance {{(pid=72382) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 15:40:24 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:40:25 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:40:25 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:40:27 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:40:29 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:40:30 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:40:30 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:40:30 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72382) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 15:40:30 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72382) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 15:40:30 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72382) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 15:40:30 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:40:35 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:40:40 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:40:41 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-d97b2119-1b03-4beb-b8cb-d65224444b2b tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Acquiring lock "402ba448-a30a-45f2-a724-5a53cf584547" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:40:41 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-d97b2119-1b03-4beb-b8cb-d65224444b2b tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Lock "402ba448-a30a-45f2-a724-5a53cf584547" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:40:41 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-d97b2119-1b03-4beb-b8cb-d65224444b2b tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Acquiring lock "402ba448-a30a-45f2-a724-5a53cf584547-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:40:41 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-d97b2119-1b03-4beb-b8cb-d65224444b2b tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Lock "402ba448-a30a-45f2-a724-5a53cf584547-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:40:41 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-d97b2119-1b03-4beb-b8cb-d65224444b2b tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Lock "402ba448-a30a-45f2-a724-5a53cf584547-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:40:41 user nova-compute[72382]: INFO nova.compute.manager [None req-d97b2119-1b03-4beb-b8cb-d65224444b2b tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] [instance: 402ba448-a30a-45f2-a724-5a53cf584547] Terminating instance
Aug 09 15:40:41 user nova-compute[72382]: DEBUG nova.compute.manager [None req-d97b2119-1b03-4beb-b8cb-d65224444b2b tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] [instance: 402ba448-a30a-45f2-a724-5a53cf584547] Start destroying the instance on the hypervisor. {{(pid=72382) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 15:40:41 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:40:41 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:40:41 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:40:41 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:40:41 user nova-compute[72382]: DEBUG nova.compute.manager [req-e20fc3bc-0e47-4b0e-b6b4-00eb3f0f3caf req-bc440369-ca6e-4119-82a7-07627e1f5acd service nova] [instance: 402ba448-a30a-45f2-a724-5a53cf584547] Received event network-vif-unplugged-a4cb9706-2448-4789-b7ef-8c4bef62e160 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:40:41 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-e20fc3bc-0e47-4b0e-b6b4-00eb3f0f3caf req-bc440369-ca6e-4119-82a7-07627e1f5acd service nova] Acquiring lock "402ba448-a30a-45f2-a724-5a53cf584547-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:40:41 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-e20fc3bc-0e47-4b0e-b6b4-00eb3f0f3caf req-bc440369-ca6e-4119-82a7-07627e1f5acd service nova] Lock "402ba448-a30a-45f2-a724-5a53cf584547-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:40:41 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-e20fc3bc-0e47-4b0e-b6b4-00eb3f0f3caf req-bc440369-ca6e-4119-82a7-07627e1f5acd service nova] Lock "402ba448-a30a-45f2-a724-5a53cf584547-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:40:41 user nova-compute[72382]: DEBUG nova.compute.manager [req-e20fc3bc-0e47-4b0e-b6b4-00eb3f0f3caf req-bc440369-ca6e-4119-82a7-07627e1f5acd service nova] [instance: 402ba448-a30a-45f2-a724-5a53cf584547] No waiting events found dispatching network-vif-unplugged-a4cb9706-2448-4789-b7ef-8c4bef62e160 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:40:41 user nova-compute[72382]: DEBUG nova.compute.manager [req-e20fc3bc-0e47-4b0e-b6b4-00eb3f0f3caf req-bc440369-ca6e-4119-82a7-07627e1f5acd service nova] [instance: 402ba448-a30a-45f2-a724-5a53cf584547] Received event network-vif-unplugged-a4cb9706-2448-4789-b7ef-8c4bef62e160 for instance with task_state deleting. {{(pid=72382) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 15:40:42 user nova-compute[72382]: INFO nova.virt.libvirt.driver [-] [instance: 402ba448-a30a-45f2-a724-5a53cf584547] Instance destroyed successfully.
Aug 09 15:40:42 user nova-compute[72382]: DEBUG nova.objects.instance [None req-d97b2119-1b03-4beb-b8cb-d65224444b2b tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Lazy-loading 'resources' on Instance uuid 402ba448-a30a-45f2-a724-5a53cf584547 {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:40:42 user nova-compute[72382]: DEBUG nova.virt.libvirt.vif [None req-d97b2119-1b03-4beb-b8cb-d65224444b2b tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-09T15:35:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-65834704',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-65834704',id=38,image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMF6jGuDbbrqZljy46Ffz2lajM02q0PiUP2BGfP6v9JYu5Gi8oDy4mKIbO973B9Z4PvoU5+/eMR9OoifcYq5Mmsc7SREeeJyOCsTarAp00BSYBslt/NAoCbi98+xt4jnRg==',key_name='tempest-keypair-1104367240',keypairs=<?>,launch_index=0,launched_at=2023-08-09T15:39:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='aa6db5fd3ce24c1cadbedd64757e219b',ramdisk_id='',reservation_id='r-aqp1oexg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1817688709',owner_user_name='tempest-AttachVolumeShelveTestJSON-1817688709-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T15:39:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9f95e50aa6194e778dfaee31e6e2fa68',uuid=402ba448-a30a-45f2-a724-5a53cf584547,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a4cb9706-2448-4789-b7ef-8c4bef62e160", "address": "fa:16:3e:e7:e5:94", "network": {"id": "643703fd-46b7-4309-862c-109141cb008c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-512918576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa6db5fd3ce24c1cadbedd64757e219b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4cb9706-24", "ovs_interfaceid": "a4cb9706-2448-4789-b7ef-8c4bef62e160", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 15:40:42 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-d97b2119-1b03-4beb-b8cb-d65224444b2b tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Converting VIF {"id": "a4cb9706-2448-4789-b7ef-8c4bef62e160", "address": "fa:16:3e:e7:e5:94", "network": {"id": "643703fd-46b7-4309-862c-109141cb008c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-512918576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa6db5fd3ce24c1cadbedd64757e219b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4cb9706-24", "ovs_interfaceid": "a4cb9706-2448-4789-b7ef-8c4bef62e160", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 15:40:42 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-d97b2119-1b03-4beb-b8cb-d65224444b2b tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:e5:94,bridge_name='br-int',has_traffic_filtering=True,id=a4cb9706-2448-4789-b7ef-8c4bef62e160,network=Network(643703fd-46b7-4309-862c-109141cb008c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4cb9706-24') {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 15:40:42 user nova-compute[72382]: DEBUG os_vif [None req-d97b2119-1b03-4beb-b8cb-d65224444b2b tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:e5:94,bridge_name='br-int',has_traffic_filtering=True,id=a4cb9706-2448-4789-b7ef-8c4bef62e160,network=Network(643703fd-46b7-4309-862c-109141cb008c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4cb9706-24') {{(pid=72382) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 15:40:42 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:40:42 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa4cb9706-24, bridge=br-int, if_exists=True) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:40:42 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:40:42 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:40:42 user nova-compute[72382]: INFO os_vif [None req-d97b2119-1b03-4beb-b8cb-d65224444b2b tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:e5:94,bridge_name='br-int',has_traffic_filtering=True,id=a4cb9706-2448-4789-b7ef-8c4bef62e160,network=Network(643703fd-46b7-4309-862c-109141cb008c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4cb9706-24')
Aug 09 15:40:42 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-d97b2119-1b03-4beb-b8cb-d65224444b2b tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] [instance: 402ba448-a30a-45f2-a724-5a53cf584547] Deleting instance files /opt/stack/data/nova/instances/402ba448-a30a-45f2-a724-5a53cf584547_del
Aug 09 15:40:42 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-d97b2119-1b03-4beb-b8cb-d65224444b2b tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] [instance: 402ba448-a30a-45f2-a724-5a53cf584547] Deletion of /opt/stack/data/nova/instances/402ba448-a30a-45f2-a724-5a53cf584547_del complete
Aug 09 15:40:42 user nova-compute[72382]: INFO nova.compute.manager [None req-d97b2119-1b03-4beb-b8cb-d65224444b2b tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] [instance: 402ba448-a30a-45f2-a724-5a53cf584547] Took 0.87 seconds to destroy the instance on the hypervisor.
Aug 09 15:40:42 user nova-compute[72382]: DEBUG oslo.service.loopingcall [None req-d97b2119-1b03-4beb-b8cb-d65224444b2b tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72382) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 15:40:42 user nova-compute[72382]: DEBUG nova.compute.manager [-] [instance: 402ba448-a30a-45f2-a724-5a53cf584547] Deallocating network for instance {{(pid=72382) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 15:40:42 user nova-compute[72382]: DEBUG nova.network.neutron [-] [instance: 402ba448-a30a-45f2-a724-5a53cf584547] deallocate_for_instance() {{(pid=72382) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 15:40:43 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:40:43 user nova-compute[72382]: DEBUG nova.network.neutron [-] [instance: 402ba448-a30a-45f2-a724-5a53cf584547] Updating instance_info_cache with network_info: [] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:40:43 user nova-compute[72382]: INFO nova.compute.manager [-] [instance: 402ba448-a30a-45f2-a724-5a53cf584547] Took 1.48 seconds to deallocate network for instance.
Aug 09 15:40:43 user nova-compute[72382]: DEBUG nova.compute.manager [req-8743d066-f452-4efe-ba58-b4a30cdd7edc req-2c05f879-dda7-439b-a0ee-05886402814f service nova] [instance: 402ba448-a30a-45f2-a724-5a53cf584547] Received event network-vif-deleted-a4cb9706-2448-4789-b7ef-8c4bef62e160 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:40:43 user nova-compute[72382]: INFO nova.compute.manager [req-8743d066-f452-4efe-ba58-b4a30cdd7edc req-2c05f879-dda7-439b-a0ee-05886402814f service nova] [instance: 402ba448-a30a-45f2-a724-5a53cf584547] Neutron deleted interface a4cb9706-2448-4789-b7ef-8c4bef62e160; detaching it from the instance and deleting it from the info cache
Aug 09 15:40:43 user nova-compute[72382]: DEBUG nova.network.neutron [req-8743d066-f452-4efe-ba58-b4a30cdd7edc req-2c05f879-dda7-439b-a0ee-05886402814f service nova] [instance: 402ba448-a30a-45f2-a724-5a53cf584547] Updating instance_info_cache with network_info: [] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:40:43 user nova-compute[72382]: DEBUG nova.compute.manager [req-07b7dc7b-2ca2-4a72-8a2c-ec1100799a88 req-e5ba6276-9b46-4a3c-a57f-dddb84819f5d service nova] [instance: 402ba448-a30a-45f2-a724-5a53cf584547] Received event network-vif-plugged-a4cb9706-2448-4789-b7ef-8c4bef62e160 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:40:43 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-07b7dc7b-2ca2-4a72-8a2c-ec1100799a88 req-e5ba6276-9b46-4a3c-a57f-dddb84819f5d service nova] Acquiring lock "402ba448-a30a-45f2-a724-5a53cf584547-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:40:43 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-07b7dc7b-2ca2-4a72-8a2c-ec1100799a88 req-e5ba6276-9b46-4a3c-a57f-dddb84819f5d service nova] Lock "402ba448-a30a-45f2-a724-5a53cf584547-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:40:43 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-07b7dc7b-2ca2-4a72-8a2c-ec1100799a88 req-e5ba6276-9b46-4a3c-a57f-dddb84819f5d service nova] Lock "402ba448-a30a-45f2-a724-5a53cf584547-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:40:43 user nova-compute[72382]: DEBUG nova.compute.manager [req-07b7dc7b-2ca2-4a72-8a2c-ec1100799a88 req-e5ba6276-9b46-4a3c-a57f-dddb84819f5d service nova] [instance: 402ba448-a30a-45f2-a724-5a53cf584547] No waiting events found dispatching network-vif-plugged-a4cb9706-2448-4789-b7ef-8c4bef62e160 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:40:43 user nova-compute[72382]: WARNING nova.compute.manager [req-07b7dc7b-2ca2-4a72-8a2c-ec1100799a88 req-e5ba6276-9b46-4a3c-a57f-dddb84819f5d service nova] [instance: 402ba448-a30a-45f2-a724-5a53cf584547] Received unexpected event network-vif-plugged-a4cb9706-2448-4789-b7ef-8c4bef62e160 for instance with vm_state active and task_state deleting.
Aug 09 15:40:43 user nova-compute[72382]: DEBUG nova.compute.manager [req-8743d066-f452-4efe-ba58-b4a30cdd7edc req-2c05f879-dda7-439b-a0ee-05886402814f service nova] [instance: 402ba448-a30a-45f2-a724-5a53cf584547] Detach interface failed, port_id=a4cb9706-2448-4789-b7ef-8c4bef62e160, reason: Instance 402ba448-a30a-45f2-a724-5a53cf584547 could not be found. {{(pid=72382) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 09 15:40:43 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-d97b2119-1b03-4beb-b8cb-d65224444b2b tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:40:43 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-d97b2119-1b03-4beb-b8cb-d65224444b2b tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:40:43 user nova-compute[72382]: DEBUG nova.compute.provider_tree [None req-d97b2119-1b03-4beb-b8cb-d65224444b2b tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Inventory has not changed in ProviderTree for provider: 7b15b0e5-df4d-49db-833b-2855d21d10ae {{(pid=72382) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 15:40:43 user nova-compute[72382]: DEBUG nova.scheduler.client.report [None req-d97b2119-1b03-4beb-b8cb-d65224444b2b tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Inventory has not changed for provider 7b15b0e5-df4d-49db-833b-2855d21d10ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72382) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 15:40:43 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-d97b2119-1b03-4beb-b8cb-d65224444b2b tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.211s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:40:43 user nova-compute[72382]: INFO nova.scheduler.client.report [None req-d97b2119-1b03-4beb-b8cb-d65224444b2b tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Deleted allocations for instance 402ba448-a30a-45f2-a724-5a53cf584547
Aug 09 15:40:44 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-d97b2119-1b03-4beb-b8cb-d65224444b2b tempest-AttachVolumeShelveTestJSON-1817688709 tempest-AttachVolumeShelveTestJSON-1817688709-project-member] Lock "402ba448-a30a-45f2-a724-5a53cf584547" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.749s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:40:44 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:40:47 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:40:52 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:40:53 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:40:56 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:40:57 user nova-compute[72382]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691595642.018501, 402ba448-a30a-45f2-a724-5a53cf584547 => Stopped> {{(pid=72382) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 15:40:57 user nova-compute[72382]: INFO nova.compute.manager [-] [instance: 402ba448-a30a-45f2-a724-5a53cf584547] VM Stopped (Lifecycle Event)
Aug 09 15:40:57 user nova-compute[72382]: DEBUG nova.compute.manager [None req-56135c17-b187-42c6-9cdc-34b132205af3 None None] [instance: 402ba448-a30a-45f2-a724-5a53cf584547] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:40:57 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:41:00 user nova-compute[72382]: INFO nova.compute.manager [None req-6a27ad19-8aa4-409e-aca5-bcffbda6ff90 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] [instance: 54523d3e-bfae-4621-85cb-d6a7bc40abf5] Get console output
Aug 09 15:41:00 user nova-compute[72382]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Aug 09 15:41:02 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:41:03 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:41:04 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:41:06 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:41:07 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:41:09 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:41:11 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:41:12 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:41:12 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-393cde67-ebfb-496e-be14-911ea570cccb tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Acquiring lock "7949b7d0-2712-402f-86ee-30acaef2d3e7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:41:12 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-393cde67-ebfb-496e-be14-911ea570cccb tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Lock "7949b7d0-2712-402f-86ee-30acaef2d3e7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:41:12 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-393cde67-ebfb-496e-be14-911ea570cccb tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Acquiring lock "7949b7d0-2712-402f-86ee-30acaef2d3e7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:41:12 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-393cde67-ebfb-496e-be14-911ea570cccb tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Lock "7949b7d0-2712-402f-86ee-30acaef2d3e7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:41:12 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-393cde67-ebfb-496e-be14-911ea570cccb tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Lock "7949b7d0-2712-402f-86ee-30acaef2d3e7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:41:12 user nova-compute[72382]: INFO nova.compute.manager [None req-393cde67-ebfb-496e-be14-911ea570cccb tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] [instance: 7949b7d0-2712-402f-86ee-30acaef2d3e7] Terminating instance
Aug 09 15:41:12 user nova-compute[72382]: DEBUG nova.compute.manager [None req-393cde67-ebfb-496e-be14-911ea570cccb tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] [instance: 7949b7d0-2712-402f-86ee-30acaef2d3e7] Start destroying the instance on the hypervisor. {{(pid=72382) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 15:41:12 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:41:12 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:41:12 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:41:12 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:41:12 user nova-compute[72382]: DEBUG nova.compute.manager [req-29681765-77a2-4124-a29c-953b0c877372 req-0b2afe58-e3d7-406e-8970-99fb73df67d1 service nova] [instance: 7949b7d0-2712-402f-86ee-30acaef2d3e7] Received event network-vif-unplugged-bf6ac419-c6ba-4f01-b35a-4fa5e58913be {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:41:12 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-29681765-77a2-4124-a29c-953b0c877372 req-0b2afe58-e3d7-406e-8970-99fb73df67d1 service nova] Acquiring lock "7949b7d0-2712-402f-86ee-30acaef2d3e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:41:12 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-29681765-77a2-4124-a29c-953b0c877372 req-0b2afe58-e3d7-406e-8970-99fb73df67d1 service nova] Lock "7949b7d0-2712-402f-86ee-30acaef2d3e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:41:12 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-29681765-77a2-4124-a29c-953b0c877372 req-0b2afe58-e3d7-406e-8970-99fb73df67d1 service nova] Lock "7949b7d0-2712-402f-86ee-30acaef2d3e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:41:12 user nova-compute[72382]: DEBUG nova.compute.manager [req-29681765-77a2-4124-a29c-953b0c877372 req-0b2afe58-e3d7-406e-8970-99fb73df67d1 service nova] [instance: 7949b7d0-2712-402f-86ee-30acaef2d3e7] No waiting events found dispatching network-vif-unplugged-bf6ac419-c6ba-4f01-b35a-4fa5e58913be {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:41:12 user nova-compute[72382]: DEBUG nova.compute.manager [req-29681765-77a2-4124-a29c-953b0c877372 req-0b2afe58-e3d7-406e-8970-99fb73df67d1 service nova] [instance: 7949b7d0-2712-402f-86ee-30acaef2d3e7] Received event network-vif-unplugged-bf6ac419-c6ba-4f01-b35a-4fa5e58913be for instance with task_state deleting. {{(pid=72382) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 15:41:12 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:41:12 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:41:13 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:41:13 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:41:13 user nova-compute[72382]: INFO nova.virt.libvirt.driver [-] [instance: 7949b7d0-2712-402f-86ee-30acaef2d3e7] Instance destroyed successfully.
Aug 09 15:41:13 user nova-compute[72382]: DEBUG nova.objects.instance [None req-393cde67-ebfb-496e-be14-911ea570cccb tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Lazy-loading 'resources' on Instance uuid 7949b7d0-2712-402f-86ee-30acaef2d3e7 {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:41:13 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:41:13 user nova-compute[72382]: DEBUG nova.virt.libvirt.vif [None req-393cde67-ebfb-496e-be14-911ea570cccb tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T15:35:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1437781387',display_name='tempest-TestMinimumBasicScenario-server-1437781387',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1437781387',id=40,image_ref='cc9c1e6c-3869-41a3-8884-92bc10fd88dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE7fZdqwv14TbpkokOGrZLxteONCsQhHwHtSkm0iehxIvEwr8CDGRfFb4MKI0stgbdIk1yccqk1l+GgnPmgswjQ9PIPDbFPc3f6proZobtF+S6ZVWml9M9bSSrAd7AGo5w==',key_name='tempest-TestMinimumBasicScenario-63485549',keypairs=<?>,launch_index=0,launched_at=2023-08-09T15:36:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='93c87775443b4abd987197c4b46693bc',ramdisk_id='',reservation_id='r-oo0ozxn0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cc9c1e6c-3869-41a3-8884-92bc10fd88dd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-389394165',owner_user_name='tempest-TestMinimumBasicScenario-389394165-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T15:38:29Z,user_data=None,user_id='12ac8eca784e480d86c8fff801e73d2d',uuid=7949b7d0-2712-402f-86ee-30acaef2d3e7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bf6ac419-c6ba-4f01-b35a-4fa5e58913be", "address": "fa:16:3e:26:fd:d1", "network": {"id": "8d929426-09f7-49b5-a79e-711e20e00750", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1307802727-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93c87775443b4abd987197c4b46693bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf6ac419-c6", "ovs_interfaceid": "bf6ac419-c6ba-4f01-b35a-4fa5e58913be", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 15:41:13 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-393cde67-ebfb-496e-be14-911ea570cccb tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Converting VIF {"id": "bf6ac419-c6ba-4f01-b35a-4fa5e58913be", "address": "fa:16:3e:26:fd:d1", "network": {"id": "8d929426-09f7-49b5-a79e-711e20e00750", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1307802727-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93c87775443b4abd987197c4b46693bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf6ac419-c6", "ovs_interfaceid": "bf6ac419-c6ba-4f01-b35a-4fa5e58913be", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 15:41:13 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-393cde67-ebfb-496e-be14-911ea570cccb tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:26:fd:d1,bridge_name='br-int',has_traffic_filtering=True,id=bf6ac419-c6ba-4f01-b35a-4fa5e58913be,network=Network(8d929426-09f7-49b5-a79e-711e20e00750),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf6ac419-c6') {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 15:41:13 user nova-compute[72382]: DEBUG os_vif [None req-393cde67-ebfb-496e-be14-911ea570cccb tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:26:fd:d1,bridge_name='br-int',has_traffic_filtering=True,id=bf6ac419-c6ba-4f01-b35a-4fa5e58913be,network=Network(8d929426-09f7-49b5-a79e-711e20e00750),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf6ac419-c6') {{(pid=72382) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 15:41:13 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:41:13 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbf6ac419-c6, bridge=br-int, if_exists=True) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:41:13 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:41:13 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:41:13 user nova-compute[72382]: INFO os_vif [None req-393cde67-ebfb-496e-be14-911ea570cccb tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:26:fd:d1,bridge_name='br-int',has_traffic_filtering=True,id=bf6ac419-c6ba-4f01-b35a-4fa5e58913be,network=Network(8d929426-09f7-49b5-a79e-711e20e00750),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf6ac419-c6')
Aug 09 15:41:13 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-393cde67-ebfb-496e-be14-911ea570cccb tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] [instance: 7949b7d0-2712-402f-86ee-30acaef2d3e7] Deleting instance files /opt/stack/data/nova/instances/7949b7d0-2712-402f-86ee-30acaef2d3e7_del
Aug 09 15:41:13 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-393cde67-ebfb-496e-be14-911ea570cccb tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] [instance: 7949b7d0-2712-402f-86ee-30acaef2d3e7] Deletion of /opt/stack/data/nova/instances/7949b7d0-2712-402f-86ee-30acaef2d3e7_del complete
Aug 09 15:41:13 user nova-compute[72382]: INFO nova.compute.manager [None req-393cde67-ebfb-496e-be14-911ea570cccb tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] [instance: 7949b7d0-2712-402f-86ee-30acaef2d3e7] Took 0.95 seconds to destroy the instance on the hypervisor.
Aug 09 15:41:13 user nova-compute[72382]: DEBUG oslo.service.loopingcall [None req-393cde67-ebfb-496e-be14-911ea570cccb tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72382) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 15:41:13 user nova-compute[72382]: DEBUG nova.compute.manager [-] [instance: 7949b7d0-2712-402f-86ee-30acaef2d3e7] Deallocating network for instance {{(pid=72382) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 15:41:13 user nova-compute[72382]: DEBUG nova.network.neutron [-] [instance: 7949b7d0-2712-402f-86ee-30acaef2d3e7] deallocate_for_instance() {{(pid=72382) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 15:41:13 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:41:13 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:41:13 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:41:13 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:41:13 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:41:14 user nova-compute[72382]: DEBUG nova.network.neutron [-] [instance: 7949b7d0-2712-402f-86ee-30acaef2d3e7] Updating instance_info_cache with network_info: [] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:41:14 user nova-compute[72382]: INFO nova.compute.manager [-] [instance: 7949b7d0-2712-402f-86ee-30acaef2d3e7] Took 1.12 seconds to deallocate network for instance.
Aug 09 15:41:14 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-393cde67-ebfb-496e-be14-911ea570cccb tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:41:14 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-393cde67-ebfb-496e-be14-911ea570cccb tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:41:14 user nova-compute[72382]: DEBUG nova.compute.provider_tree [None req-393cde67-ebfb-496e-be14-911ea570cccb tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Inventory has not changed in ProviderTree for provider: 7b15b0e5-df4d-49db-833b-2855d21d10ae {{(pid=72382) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 15:41:14 user nova-compute[72382]: DEBUG nova.scheduler.client.report [None req-393cde67-ebfb-496e-be14-911ea570cccb tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Inventory has not changed for provider 7b15b0e5-df4d-49db-833b-2855d21d10ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72382) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 15:41:14 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-393cde67-ebfb-496e-be14-911ea570cccb tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.213s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:41:14 user nova-compute[72382]: INFO nova.scheduler.client.report [None req-393cde67-ebfb-496e-be14-911ea570cccb tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Deleted allocations for instance 7949b7d0-2712-402f-86ee-30acaef2d3e7
Aug 09 15:41:14 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-393cde67-ebfb-496e-be14-911ea570cccb tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Lock "7949b7d0-2712-402f-86ee-30acaef2d3e7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.526s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:41:14 user nova-compute[72382]: DEBUG nova.compute.manager [req-044e73f7-6595-4acd-b6eb-c3a5219993f4 req-0d6d8067-273d-4cf7-b758-86707cfc683d service nova] [instance: 7949b7d0-2712-402f-86ee-30acaef2d3e7] Received event network-vif-plugged-bf6ac419-c6ba-4f01-b35a-4fa5e58913be {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:41:14 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-044e73f7-6595-4acd-b6eb-c3a5219993f4 req-0d6d8067-273d-4cf7-b758-86707cfc683d service nova] Acquiring lock "7949b7d0-2712-402f-86ee-30acaef2d3e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:41:14 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-044e73f7-6595-4acd-b6eb-c3a5219993f4 req-0d6d8067-273d-4cf7-b758-86707cfc683d service nova] Lock "7949b7d0-2712-402f-86ee-30acaef2d3e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:41:14 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-044e73f7-6595-4acd-b6eb-c3a5219993f4 req-0d6d8067-273d-4cf7-b758-86707cfc683d service nova] Lock "7949b7d0-2712-402f-86ee-30acaef2d3e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:41:14 user nova-compute[72382]: DEBUG nova.compute.manager [req-044e73f7-6595-4acd-b6eb-c3a5219993f4 req-0d6d8067-273d-4cf7-b758-86707cfc683d service nova] [instance: 7949b7d0-2712-402f-86ee-30acaef2d3e7] No waiting events found dispatching network-vif-plugged-bf6ac419-c6ba-4f01-b35a-4fa5e58913be {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:41:14 user nova-compute[72382]: WARNING nova.compute.manager [req-044e73f7-6595-4acd-b6eb-c3a5219993f4 req-0d6d8067-273d-4cf7-b758-86707cfc683d service nova] [instance: 7949b7d0-2712-402f-86ee-30acaef2d3e7] Received unexpected event network-vif-plugged-bf6ac419-c6ba-4f01-b35a-4fa5e58913be for instance with vm_state deleted and task_state None.
Aug 09 15:41:14 user nova-compute[72382]: DEBUG nova.compute.manager [req-044e73f7-6595-4acd-b6eb-c3a5219993f4 req-0d6d8067-273d-4cf7-b758-86707cfc683d service nova] [instance: 7949b7d0-2712-402f-86ee-30acaef2d3e7] Received event network-vif-deleted-bf6ac419-c6ba-4f01-b35a-4fa5e58913be {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:41:14 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:41:15 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:41:16 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:41:16 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:41:16 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:41:16 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:41:16 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Auditing locally available compute resources for user (node: user) {{(pid=72382) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 15:41:17 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0da60bf-7468-4041-8016-54e3d82386b7/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:41:17 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0da60bf-7468-4041-8016-54e3d82386b7/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:41:17 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0da60bf-7468-4041-8016-54e3d82386b7/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:41:17 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0da60bf-7468-4041-8016-54e3d82386b7/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:41:17 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ccbfda2-8bcd-4ec1-972a-cf49a62b1583/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:41:17 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ccbfda2-8bcd-4ec1-972a-cf49a62b1583/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:41:17 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ccbfda2-8bcd-4ec1-972a-cf49a62b1583/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:41:17 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ccbfda2-8bcd-4ec1-972a-cf49a62b1583/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:41:17 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72382) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 15:41:17 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72382) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 15:41:18 user nova-compute[72382]: WARNING nova.virt.libvirt.driver [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 15:41:18 user nova-compute[72382]: WARNING nova.virt.libvirt.driver [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 15:41:18 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Hypervisor/Node resource view: name=user free_ram=8034MB free_disk=25.35904312133789GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72382) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 15:41:18 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:41:18 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:41:18 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:41:18 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance 4ccbfda2-8bcd-4ec1-972a-cf49a62b1583 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:41:18 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance 54523d3e-bfae-4621-85cb-d6a7bc40abf5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:41:18 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance 3855b76f-87cc-4be0-982c-4cc5cf5cd8aa actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:41:18 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance b0da60bf-7468-4041-8016-54e3d82386b7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:41:18 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=72382) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 15:41:18 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=72382) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 15:41:18 user nova-compute[72382]: DEBUG nova.compute.provider_tree [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Inventory has not changed in ProviderTree for provider: 7b15b0e5-df4d-49db-833b-2855d21d10ae {{(pid=72382) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 15:41:18 user nova-compute[72382]: DEBUG nova.scheduler.client.report [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Inventory has not changed for provider 7b15b0e5-df4d-49db-833b-2855d21d10ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72382) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 15:41:18 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Compute_service record updated for user:user {{(pid=72382) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 15:41:18 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.297s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:41:18 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-d47e9ca5-4b02-4b11-89c3-d9ff5190ac74 tempest-TestServerVolumeAttachScenarioOldVersion-787688685 tempest-TestServerVolumeAttachScenarioOldVersion-787688685-project-member] Acquiring lock "5c914d94-5bfd-4984-8937-37bdf02e9674" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:41:18 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-d47e9ca5-4b02-4b11-89c3-d9ff5190ac74 tempest-TestServerVolumeAttachScenarioOldVersion-787688685 tempest-TestServerVolumeAttachScenarioOldVersion-787688685-project-member] Lock "5c914d94-5bfd-4984-8937-37bdf02e9674" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:41:18 user nova-compute[72382]: DEBUG nova.compute.manager [None req-d47e9ca5-4b02-4b11-89c3-d9ff5190ac74 tempest-TestServerVolumeAttachScenarioOldVersion-787688685 tempest-TestServerVolumeAttachScenarioOldVersion-787688685-project-member] [instance: 5c914d94-5bfd-4984-8937-37bdf02e9674] Starting instance... {{(pid=72382) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 15:41:18 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-d47e9ca5-4b02-4b11-89c3-d9ff5190ac74 tempest-TestServerVolumeAttachScenarioOldVersion-787688685 tempest-TestServerVolumeAttachScenarioOldVersion-787688685-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:41:18 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-d47e9ca5-4b02-4b11-89c3-d9ff5190ac74 tempest-TestServerVolumeAttachScenarioOldVersion-787688685 tempest-TestServerVolumeAttachScenarioOldVersion-787688685-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:41:18 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-d47e9ca5-4b02-4b11-89c3-d9ff5190ac74 tempest-TestServerVolumeAttachScenarioOldVersion-787688685 tempest-TestServerVolumeAttachScenarioOldVersion-787688685-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72382) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 15:41:18 user nova-compute[72382]: INFO nova.compute.claims [None req-d47e9ca5-4b02-4b11-89c3-d9ff5190ac74 tempest-TestServerVolumeAttachScenarioOldVersion-787688685 tempest-TestServerVolumeAttachScenarioOldVersion-787688685-project-member] [instance: 5c914d94-5bfd-4984-8937-37bdf02e9674] Claim successful on node user
Aug 09 15:41:18 user nova-compute[72382]: DEBUG nova.compute.provider_tree [None req-d47e9ca5-4b02-4b11-89c3-d9ff5190ac74 tempest-TestServerVolumeAttachScenarioOldVersion-787688685 tempest-TestServerVolumeAttachScenarioOldVersion-787688685-project-member] Inventory has not changed in ProviderTree for provider: 7b15b0e5-df4d-49db-833b-2855d21d10ae {{(pid=72382) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 15:41:18 user nova-compute[72382]: DEBUG nova.scheduler.client.report [None req-d47e9ca5-4b02-4b11-89c3-d9ff5190ac74 tempest-TestServerVolumeAttachScenarioOldVersion-787688685 tempest-TestServerVolumeAttachScenarioOldVersion-787688685-project-member] Inventory has not changed for provider 7b15b0e5-df4d-49db-833b-2855d21d10ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72382) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 15:41:18 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-d47e9ca5-4b02-4b11-89c3-d9ff5190ac74 tempest-TestServerVolumeAttachScenarioOldVersion-787688685 tempest-TestServerVolumeAttachScenarioOldVersion-787688685-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.301s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:41:18 user nova-compute[72382]: DEBUG nova.compute.manager [None req-d47e9ca5-4b02-4b11-89c3-d9ff5190ac74 tempest-TestServerVolumeAttachScenarioOldVersion-787688685 tempest-TestServerVolumeAttachScenarioOldVersion-787688685-project-member] [instance: 5c914d94-5bfd-4984-8937-37bdf02e9674] Start building networks asynchronously for instance. {{(pid=72382) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 15:41:19 user nova-compute[72382]: DEBUG nova.compute.manager [None req-d47e9ca5-4b02-4b11-89c3-d9ff5190ac74 tempest-TestServerVolumeAttachScenarioOldVersion-787688685 tempest-TestServerVolumeAttachScenarioOldVersion-787688685-project-member] [instance: 5c914d94-5bfd-4984-8937-37bdf02e9674] Allocating IP information in the background. {{(pid=72382) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 15:41:19 user nova-compute[72382]: DEBUG nova.network.neutron [None req-d47e9ca5-4b02-4b11-89c3-d9ff5190ac74 tempest-TestServerVolumeAttachScenarioOldVersion-787688685 tempest-TestServerVolumeAttachScenarioOldVersion-787688685-project-member] [instance: 5c914d94-5bfd-4984-8937-37bdf02e9674] allocate_for_instance() {{(pid=72382) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 15:41:19 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-d47e9ca5-4b02-4b11-89c3-d9ff5190ac74 tempest-TestServerVolumeAttachScenarioOldVersion-787688685 tempest-TestServerVolumeAttachScenarioOldVersion-787688685-project-member] [instance: 5c914d94-5bfd-4984-8937-37bdf02e9674] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 15:41:19 user nova-compute[72382]: DEBUG nova.compute.manager [None req-d47e9ca5-4b02-4b11-89c3-d9ff5190ac74 tempest-TestServerVolumeAttachScenarioOldVersion-787688685 tempest-TestServerVolumeAttachScenarioOldVersion-787688685-project-member] [instance: 5c914d94-5bfd-4984-8937-37bdf02e9674] Start building block device mappings for instance. {{(pid=72382) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 15:41:19 user nova-compute[72382]: DEBUG nova.policy [None req-d47e9ca5-4b02-4b11-89c3-d9ff5190ac74 tempest-TestServerVolumeAttachScenarioOldVersion-787688685 tempest-TestServerVolumeAttachScenarioOldVersion-787688685-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '05b8aec03cb54887a02ac4a0c6a1c80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f0a8014c8bb4f4b80617a5516539994', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72382) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 15:41:19 user nova-compute[72382]: DEBUG nova.compute.manager [None req-d47e9ca5-4b02-4b11-89c3-d9ff5190ac74 tempest-TestServerVolumeAttachScenarioOldVersion-787688685 tempest-TestServerVolumeAttachScenarioOldVersion-787688685-project-member] [instance: 5c914d94-5bfd-4984-8937-37bdf02e9674] Start spawning the instance on the hypervisor. {{(pid=72382) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 15:41:19 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-d47e9ca5-4b02-4b11-89c3-d9ff5190ac74 tempest-TestServerVolumeAttachScenarioOldVersion-787688685 tempest-TestServerVolumeAttachScenarioOldVersion-787688685-project-member] [instance: 5c914d94-5bfd-4984-8937-37bdf02e9674] Creating instance directory {{(pid=72382) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 15:41:19 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-d47e9ca5-4b02-4b11-89c3-d9ff5190ac74 tempest-TestServerVolumeAttachScenarioOldVersion-787688685 tempest-TestServerVolumeAttachScenarioOldVersion-787688685-project-member] [instance: 5c914d94-5bfd-4984-8937-37bdf02e9674] Creating image(s)
Aug 09 15:41:19 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-d47e9ca5-4b02-4b11-89c3-d9ff5190ac74 tempest-TestServerVolumeAttachScenarioOldVersion-787688685 tempest-TestServerVolumeAttachScenarioOldVersion-787688685-project-member] Acquiring lock "/opt/stack/data/nova/instances/5c914d94-5bfd-4984-8937-37bdf02e9674/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:41:19 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-d47e9ca5-4b02-4b11-89c3-d9ff5190ac74 tempest-TestServerVolumeAttachScenarioOldVersion-787688685 tempest-TestServerVolumeAttachScenarioOldVersion-787688685-project-member] Lock "/opt/stack/data/nova/instances/5c914d94-5bfd-4984-8937-37bdf02e9674/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:41:19 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-d47e9ca5-4b02-4b11-89c3-d9ff5190ac74 tempest-TestServerVolumeAttachScenarioOldVersion-787688685 tempest-TestServerVolumeAttachScenarioOldVersion-787688685-project-member] Lock "/opt/stack/data/nova/instances/5c914d94-5bfd-4984-8937-37bdf02e9674/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:41:19 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-d47e9ca5-4b02-4b11-89c3-d9ff5190ac74 tempest-TestServerVolumeAttachScenarioOldVersion-787688685 tempest-TestServerVolumeAttachScenarioOldVersion-787688685-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:41:19 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-d47e9ca5-4b02-4b11-89c3-d9ff5190ac74 tempest-TestServerVolumeAttachScenarioOldVersion-787688685 tempest-TestServerVolumeAttachScenarioOldVersion-787688685-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b --force-share --output=json" returned: 0 in 0.153s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:41:19 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-d47e9ca5-4b02-4b11-89c3-d9ff5190ac74 tempest-TestServerVolumeAttachScenarioOldVersion-787688685 tempest-TestServerVolumeAttachScenarioOldVersion-787688685-project-member] Acquiring lock "383812ff437283e0191ed5b9ecc04c27f1162b0b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:41:19 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-d47e9ca5-4b02-4b11-89c3-d9ff5190ac74 tempest-TestServerVolumeAttachScenarioOldVersion-787688685 tempest-TestServerVolumeAttachScenarioOldVersion-787688685-project-member] Lock "383812ff437283e0191ed5b9ecc04c27f1162b0b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:41:19 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-d47e9ca5-4b02-4b11-89c3-d9ff5190ac74 tempest-TestServerVolumeAttachScenarioOldVersion-787688685 tempest-TestServerVolumeAttachScenarioOldVersion-787688685-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:41:19 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-d47e9ca5-4b02-4b11-89c3-d9ff5190ac74 tempest-TestServerVolumeAttachScenarioOldVersion-787688685 tempest-TestServerVolumeAttachScenarioOldVersion-787688685-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b --force-share --output=json" returned: 0 in 0.132s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:41:19 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-d47e9ca5-4b02-4b11-89c3-d9ff5190ac74 tempest-TestServerVolumeAttachScenarioOldVersion-787688685 tempest-TestServerVolumeAttachScenarioOldVersion-787688685-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b,backing_fmt=raw /opt/stack/data/nova/instances/5c914d94-5bfd-4984-8937-37bdf02e9674/disk 1073741824 {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:41:19 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-d47e9ca5-4b02-4b11-89c3-d9ff5190ac74 tempest-TestServerVolumeAttachScenarioOldVersion-787688685 tempest-TestServerVolumeAttachScenarioOldVersion-787688685-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b,backing_fmt=raw /opt/stack/data/nova/instances/5c914d94-5bfd-4984-8937-37bdf02e9674/disk 1073741824" returned: 0 in 0.051s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:41:19 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-d47e9ca5-4b02-4b11-89c3-d9ff5190ac74 tempest-TestServerVolumeAttachScenarioOldVersion-787688685 tempest-TestServerVolumeAttachScenarioOldVersion-787688685-project-member] Lock "383812ff437283e0191ed5b9ecc04c27f1162b0b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.190s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:41:19 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-d47e9ca5-4b02-4b11-89c3-d9ff5190ac74 tempest-TestServerVolumeAttachScenarioOldVersion-787688685 tempest-TestServerVolumeAttachScenarioOldVersion-787688685-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:41:19 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-d47e9ca5-4b02-4b11-89c3-d9ff5190ac74 tempest-TestServerVolumeAttachScenarioOldVersion-787688685 tempest-TestServerVolumeAttachScenarioOldVersion-787688685-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b --force-share --output=json" returned: 0 in 0.144s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:41:19 user nova-compute[72382]: DEBUG nova.virt.disk.api [None req-d47e9ca5-4b02-4b11-89c3-d9ff5190ac74 tempest-TestServerVolumeAttachScenarioOldVersion-787688685 tempest-TestServerVolumeAttachScenarioOldVersion-787688685-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5c914d94-5bfd-4984-8937-37bdf02e9674/disk. size=1073741824 {{(pid=72382) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 15:41:19 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-d47e9ca5-4b02-4b11-89c3-d9ff5190ac74 tempest-TestServerVolumeAttachScenarioOldVersion-787688685 tempest-TestServerVolumeAttachScenarioOldVersion-787688685-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c914d94-5bfd-4984-8937-37bdf02e9674/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:41:19 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-d47e9ca5-4b02-4b11-89c3-d9ff5190ac74 tempest-TestServerVolumeAttachScenarioOldVersion-787688685 tempest-TestServerVolumeAttachScenarioOldVersion-787688685-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c914d94-5bfd-4984-8937-37bdf02e9674/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:41:19 user nova-compute[72382]: DEBUG nova.virt.disk.api [None req-d47e9ca5-4b02-4b11-89c3-d9ff5190ac74 tempest-TestServerVolumeAttachScenarioOldVersion-787688685 tempest-TestServerVolumeAttachScenarioOldVersion-787688685-project-member] Cannot resize image /opt/stack/data/nova/instances/5c914d94-5bfd-4984-8937-37bdf02e9674/disk to a smaller size. {{(pid=72382) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 15:41:19 user nova-compute[72382]: DEBUG nova.objects.instance [None req-d47e9ca5-4b02-4b11-89c3-d9ff5190ac74 tempest-TestServerVolumeAttachScenarioOldVersion-787688685 tempest-TestServerVolumeAttachScenarioOldVersion-787688685-project-member] Lazy-loading 'migration_context' on Instance uuid 5c914d94-5bfd-4984-8937-37bdf02e9674 {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:41:19 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:41:19 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-d47e9ca5-4b02-4b11-89c3-d9ff5190ac74 tempest-TestServerVolumeAttachScenarioOldVersion-787688685 tempest-TestServerVolumeAttachScenarioOldVersion-787688685-project-member] [instance: 5c914d94-5bfd-4984-8937-37bdf02e9674] Created local disks {{(pid=72382) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 15:41:19 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-d47e9ca5-4b02-4b11-89c3-d9ff5190ac74 tempest-TestServerVolumeAttachScenarioOldVersion-787688685 tempest-TestServerVolumeAttachScenarioOldVersion-787688685-project-member] [instance: 5c914d94-5bfd-4984-8937-37bdf02e9674] Ensure instance console log exists: /opt/stack/data/nova/instances/5c914d94-5bfd-4984-8937-37bdf02e9674/console.log {{(pid=72382) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 15:41:19 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-d47e9ca5-4b02-4b11-89c3-d9ff5190ac74 tempest-TestServerVolumeAttachScenarioOldVersion-787688685 tempest-TestServerVolumeAttachScenarioOldVersion-787688685-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:41:19 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-d47e9ca5-4b02-4b11-89c3-d9ff5190ac74 tempest-TestServerVolumeAttachScenarioOldVersion-787688685 tempest-TestServerVolumeAttachScenarioOldVersion-787688685-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:41:19 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-d47e9ca5-4b02-4b11-89c3-d9ff5190ac74 tempest-TestServerVolumeAttachScenarioOldVersion-787688685 tempest-TestServerVolumeAttachScenarioOldVersion-787688685-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:41:19 user nova-compute[72382]: DEBUG nova.compute.manager [req-ddb438d3-528f-4ba7-8ba1-5332b6463e98 req-06176f16-6517-49ad-9741-0d82a5c46883 service nova] [instance: 3855b76f-87cc-4be0-982c-4cc5cf5cd8aa] Received event network-changed-b7c16d4a-24b4-4ba6-860a-d180123dd204 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:41:19 user nova-compute[72382]: DEBUG nova.compute.manager [req-ddb438d3-528f-4ba7-8ba1-5332b6463e98 req-06176f16-6517-49ad-9741-0d82a5c46883 service nova] [instance: 3855b76f-87cc-4be0-982c-4cc5cf5cd8aa] Refreshing instance network info cache due to event network-changed-b7c16d4a-24b4-4ba6-860a-d180123dd204. {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 15:41:19 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-ddb438d3-528f-4ba7-8ba1-5332b6463e98 req-06176f16-6517-49ad-9741-0d82a5c46883 service nova] Acquiring lock "refresh_cache-3855b76f-87cc-4be0-982c-4cc5cf5cd8aa" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 15:41:19 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-ddb438d3-528f-4ba7-8ba1-5332b6463e98 req-06176f16-6517-49ad-9741-0d82a5c46883 service nova] Acquired lock "refresh_cache-3855b76f-87cc-4be0-982c-4cc5cf5cd8aa" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 15:41:19 user nova-compute[72382]: DEBUG nova.network.neutron [req-ddb438d3-528f-4ba7-8ba1-5332b6463e98 req-06176f16-6517-49ad-9741-0d82a5c46883 service nova] [instance: 3855b76f-87cc-4be0-982c-4cc5cf5cd8aa] Refreshing network info cache for port b7c16d4a-24b4-4ba6-860a-d180123dd204 {{(pid=72382) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 15:41:20 user nova-compute[72382]: DEBUG nova.network.neutron [None req-d47e9ca5-4b02-4b11-89c3-d9ff5190ac74 tempest-TestServerVolumeAttachScenarioOldVersion-787688685 tempest-TestServerVolumeAttachScenarioOldVersion-787688685-project-member] [instance: 5c914d94-5bfd-4984-8937-37bdf02e9674] Successfully created port: 0ac76bca-773f-4a75-8811-c9839f549726 {{(pid=72382) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 15:41:21 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:41:21 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:41:21 user nova-compute[72382]: DEBUG nova.network.neutron [req-ddb438d3-528f-4ba7-8ba1-5332b6463e98 req-06176f16-6517-49ad-9741-0d82a5c46883 service nova] [instance: 3855b76f-87cc-4be0-982c-4cc5cf5cd8aa] Updated VIF entry in instance network info cache for port b7c16d4a-24b4-4ba6-860a-d180123dd204. {{(pid=72382) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 15:41:21 user nova-compute[72382]: DEBUG nova.network.neutron [req-ddb438d3-528f-4ba7-8ba1-5332b6463e98 req-06176f16-6517-49ad-9741-0d82a5c46883 service nova] [instance: 3855b76f-87cc-4be0-982c-4cc5cf5cd8aa] Updating instance_info_cache with network_info: [{"id": "b7c16d4a-24b4-4ba6-860a-d180123dd204", "address": "fa:16:3e:01:6f:fa", "network": {"id": "a78e6cb6-feb7-4f64-a3c0-4900594b6e37", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-338007968-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70310b1af40b4d239fe5ea362972554b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7c16d4a-24", "ovs_interfaceid": "b7c16d4a-24b4-4ba6-860a-d180123dd204", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:41:21 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-ddb438d3-528f-4ba7-8ba1-5332b6463e98 req-06176f16-6517-49ad-9741-0d82a5c46883 service nova] Releasing lock "refresh_cache-3855b76f-87cc-4be0-982c-4cc5cf5cd8aa" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 15:41:21 user nova-compute[72382]: DEBUG nova.network.neutron [None req-d47e9ca5-4b02-4b11-89c3-d9ff5190ac74 tempest-TestServerVolumeAttachScenarioOldVersion-787688685 tempest-TestServerVolumeAttachScenarioOldVersion-787688685-project-member] [instance: 5c914d94-5bfd-4984-8937-37bdf02e9674] Successfully updated port: 0ac76bca-773f-4a75-8811-c9839f549726 {{(pid=72382) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 15:41:22 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-d47e9ca5-4b02-4b11-89c3-d9ff5190ac74 tempest-TestServerVolumeAttachScenarioOldVersion-787688685 tempest-TestServerVolumeAttachScenarioOldVersion-787688685-project-member] Acquiring lock "refresh_cache-5c914d94-5bfd-4984-8937-37bdf02e9674" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 15:41:22 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-d47e9ca5-4b02-4b11-89c3-d9ff5190ac74 tempest-TestServerVolumeAttachScenarioOldVersion-787688685 tempest-TestServerVolumeAttachScenarioOldVersion-787688685-project-member] Acquired lock "refresh_cache-5c914d94-5bfd-4984-8937-37bdf02e9674" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 15:41:22 user nova-compute[72382]: DEBUG nova.network.neutron [None req-d47e9ca5-4b02-4b11-89c3-d9ff5190ac74 tempest-TestServerVolumeAttachScenarioOldVersion-787688685 tempest-TestServerVolumeAttachScenarioOldVersion-787688685-project-member] [instance: 5c914d94-5bfd-4984-8937-37bdf02e9674] Building network info cache for instance {{(pid=72382) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 15:41:22 user nova-compute[72382]: DEBUG nova.compute.manager [req-a1adf5fa-78ad-413f-ad45-2eedabfdaaa8 req-2f9bd426-e1e1-433f-a9ae-b3120bb7fc21 service nova] [instance: 5c914d94-5bfd-4984-8937-37bdf02e9674] Received event network-changed-0ac76bca-773f-4a75-8811-c9839f549726 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:41:22 user nova-compute[72382]: DEBUG nova.compute.manager [req-a1adf5fa-78ad-413f-ad45-2eedabfdaaa8 req-2f9bd426-e1e1-433f-a9ae-b3120bb7fc21 service nova] [instance: 5c914d94-5bfd-4984-8937-37bdf02e9674] Refreshing instance network info cache due to event network-changed-0ac76bca-773f-4a75-8811-c9839f549726. {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 15:41:22 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-a1adf5fa-78ad-413f-ad45-2eedabfdaaa8 req-2f9bd426-e1e1-433f-a9ae-b3120bb7fc21 service nova] Acquiring lock "refresh_cache-5c914d94-5bfd-4984-8937-37bdf02e9674" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 15:41:22 user nova-compute[72382]: DEBUG nova.network.neutron [None req-d47e9ca5-4b02-4b11-89c3-d9ff5190ac74 tempest-TestServerVolumeAttachScenarioOldVersion-787688685 tempest-TestServerVolumeAttachScenarioOldVersion-787688685-project-member] [instance: 5c914d94-5bfd-4984-8937-37bdf02e9674] Instance cache missing network info. {{(pid=72382) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 15:41:22 user nova-compute[72382]: DEBUG nova.network.neutron [None req-d47e9ca5-4b02-4b11-89c3-d9ff5190ac74 tempest-TestServerVolumeAttachScenarioOldVersion-787688685 tempest-TestServerVolumeAttachScenarioOldVersion-787688685-project-member] [instance: 5c914d94-5bfd-4984-8937-37bdf02e9674] Updating instance_info_cache with network_info: [{"id": "0ac76bca-773f-4a75-8811-c9839f549726", "address": "fa:16:3e:4a:5b:a7", "network": {"id": "67846b1f-41a7-4942-b9d2-0e41417d5ecf", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1653397054-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f0a8014c8bb4f4b80617a5516539994", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ac76bca-77", "ovs_interfaceid": "0ac76bca-773f-4a75-8811-c9839f549726", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:41:22 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-d47e9ca5-4b02-4b11-89c3-d9ff5190ac74 tempest-TestServerVolumeAttachScenarioOldVersion-787688685 tempest-TestServerVolumeAttachScenarioOldVersion-787688685-project-member] Releasing lock "refresh_cache-5c914d94-5bfd-4984-8937-37bdf02e9674" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 15:41:22 user nova-compute[72382]: DEBUG nova.compute.manager [None req-d47e9ca5-4b02-4b11-89c3-d9ff5190ac74 tempest-TestServerVolumeAttachScenarioOldVersion-787688685 tempest-TestServerVolumeAttachScenarioOldVersion-787688685-project-member] [instance: 5c914d94-5bfd-4984-8937-37bdf02e9674] Instance network_info: |[{"id": "0ac76bca-773f-4a75-8811-c9839f549726", "address": "fa:16:3e:4a:5b:a7", "network": {"id": "67846b1f-41a7-4942-b9d2-0e41417d5ecf", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1653397054-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f0a8014c8bb4f4b80617a5516539994", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ac76bca-77", "ovs_interfaceid": "0ac76bca-773f-4a75-8811-c9839f549726", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72382) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 15:41:22 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-a1adf5fa-78ad-413f-ad45-2eedabfdaaa8 req-2f9bd426-e1e1-433f-a9ae-b3120bb7fc21 service nova] Acquired lock "refresh_cache-5c914d94-5bfd-4984-8937-37bdf02e9674" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 15:41:22 user nova-compute[72382]: DEBUG nova.network.neutron [req-a1adf5fa-78ad-413f-ad45-2eedabfdaaa8 req-2f9bd426-e1e1-433f-a9ae-b3120bb7fc21 service nova] [instance: 5c914d94-5bfd-4984-8937-37bdf02e9674] Refreshing network info cache for port 0ac76bca-773f-4a75-8811-c9839f549726 {{(pid=72382) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 15:41:22 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-d47e9ca5-4b02-4b11-89c3-d9ff5190ac74 tempest-TestServerVolumeAttachScenarioOldVersion-787688685 tempest-TestServerVolumeAttachScenarioOldVersion-787688685-project-member] [instance: 5c914d94-5bfd-4984-8937-37bdf02e9674] Start _get_guest_xml network_info=[{"id": "0ac76bca-773f-4a75-8811-c9839f549726", "address": "fa:16:3e:4a:5b:a7", "network": {"id": "67846b1f-41a7-4942-b9d2-0e41417d5ecf", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1653397054-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f0a8014c8bb4f4b80617a5516539994", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ac76bca-77", "ovs_interfaceid": "0ac76bca-773f-4a75-8811-c9839f549726", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T15:11:25Z,direct_url=<?>,disk_format='qcow2',id=a79f2cea-eb27-4631-aaf3-05e7d9e411b4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a638990e12cc4d6eabb6d55e13be6bdf',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T15:11:27Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'a79f2cea-eb27-4631-aaf3-05e7d9e411b4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72382) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 15:41:22 user nova-compute[72382]: WARNING nova.virt.libvirt.driver [None req-d47e9ca5-4b02-4b11-89c3-d9ff5190ac74 tempest-TestServerVolumeAttachScenarioOldVersion-787688685 tempest-TestServerVolumeAttachScenarioOldVersion-787688685-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 15:41:22 user nova-compute[72382]: WARNING nova.virt.libvirt.driver [None req-d47e9ca5-4b02-4b11-89c3-d9ff5190ac74 tempest-TestServerVolumeAttachScenarioOldVersion-787688685 tempest-TestServerVolumeAttachScenarioOldVersion-787688685-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 15:41:22 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-d47e9ca5-4b02-4b11-89c3-d9ff5190ac74 tempest-TestServerVolumeAttachScenarioOldVersion-787688685 tempest-TestServerVolumeAttachScenarioOldVersion-787688685-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72382) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 15:41:22 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-d47e9ca5-4b02-4b11-89c3-d9ff5190ac74 tempest-TestServerVolumeAttachScenarioOldVersion-787688685 tempest-TestServerVolumeAttachScenarioOldVersion-787688685-project-member] CPU controller missing on host. {{(pid=72382) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 15:41:22 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-d47e9ca5-4b02-4b11-89c3-d9ff5190ac74 tempest-TestServerVolumeAttachScenarioOldVersion-787688685 tempest-TestServerVolumeAttachScenarioOldVersion-787688685-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72382) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 15:41:22 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-d47e9ca5-4b02-4b11-89c3-d9ff5190ac74 tempest-TestServerVolumeAttachScenarioOldVersion-787688685 tempest-TestServerVolumeAttachScenarioOldVersion-787688685-project-member] CPU controller found on host. {{(pid=72382) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 15:41:22 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-d47e9ca5-4b02-4b11-89c3-d9ff5190ac74 tempest-TestServerVolumeAttachScenarioOldVersion-787688685 tempest-TestServerVolumeAttachScenarioOldVersion-787688685-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72382) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 15:41:22 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-d47e9ca5-4b02-4b11-89c3-d9ff5190ac74 tempest-TestServerVolumeAttachScenarioOldVersion-787688685 tempest-TestServerVolumeAttachScenarioOldVersion-787688685-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T15:11:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T15:11:25Z,direct_url=<?>,disk_format='qcow2',id=a79f2cea-eb27-4631-aaf3-05e7d9e411b4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a638990e12cc4d6eabb6d55e13be6bdf',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T15:11:27Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 15:41:22 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-d47e9ca5-4b02-4b11-89c3-d9ff5190ac74 tempest-TestServerVolumeAttachScenarioOldVersion-787688685 tempest-TestServerVolumeAttachScenarioOldVersion-787688685-project-member] Flavor limits 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 15:41:22 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-d47e9ca5-4b02-4b11-89c3-d9ff5190ac74 tempest-TestServerVolumeAttachScenarioOldVersion-787688685 tempest-TestServerVolumeAttachScenarioOldVersion-787688685-project-member] Image limits 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 15:41:22 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-d47e9ca5-4b02-4b11-89c3-d9ff5190ac74 tempest-TestServerVolumeAttachScenarioOldVersion-787688685 tempest-TestServerVolumeAttachScenarioOldVersion-787688685-project-member] Flavor pref 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 15:41:22 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-d47e9ca5-4b02-4b11-89c3-d9ff5190ac74 tempest-TestServerVolumeAttachScenarioOldVersion-787688685 tempest-TestServerVolumeAttachScenarioOldVersion-787688685-project-member] Image pref 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 15:41:22 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-d47e9ca5-4b02-4b11-89c3-d9ff5190ac74 tempest-TestServerVolumeAttachScenarioOldVersion-787688685 tempest-TestServerVolumeAttachScenarioOldVersion-787688685-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 15:41:22 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-d47e9ca5-4b02-4b11-89c3-d9ff5190ac74 tempest-TestServerVolumeAttachScenarioOldVersion-787688685 tempest-TestServerVolumeAttachScenarioOldVersion-787688685-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 15:41:22 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-d47e9ca5-4b02-4b11-89c3-d9ff5190ac74 tempest-TestServerVolumeAttachScenarioOldVersion-787688685 tempest-TestServerVolumeAttachScenarioOldVersion-787688685-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72382) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 15:41:22 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-d47e9ca5-4b02-4b11-89c3-d9ff5190ac74 tempest-TestServerVolumeAttachScenarioOldVersion-787688685 tempest-TestServerVolumeAttachScenarioOldVersion-787688685-project-member] Got 1 possible topologies {{(pid=72382) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 15:41:22 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-d47e9ca5-4b02-4b11-89c3-d9ff5190ac74 tempest-TestServerVolumeAttachScenarioOldVersion-787688685 tempest-TestServerVolumeAttachScenarioOldVersion-787688685-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 15:41:22 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-d47e9ca5-4b02-4b11-89c3-d9ff5190ac74 tempest-TestServerVolumeAttachScenarioOldVersion-787688685 tempest-TestServerVolumeAttachScenarioOldVersion-787688685-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 15:41:22 user nova-compute[72382]: DEBUG nova.virt.libvirt.vif [None req-d47e9ca5-4b02-4b11-89c3-d9ff5190ac74 tempest-TestServerVolumeAttachScenarioOldVersion-787688685 tempest-TestServerVolumeAttachScenarioOldVersion-787688685-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T15:41:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1605899925',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1605899925',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1605899',id=46,image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK4B9xaCIZerorj9Fvsw1WllwqEYvVTXL3D94j/E97x0EmsRhRlUlcbuXKO3snnMCRPhifzERLvpn7ECLZDzzc8v/7KlrftxNJkcaplrYZmxLvF+zkksn66csb2TO5pwBA==',key_name='tempest-keypair-233444206',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1f0a8014c8bb4f4b80617a5516539994',ramdisk_id='',reservation_id='r-0rz2h6vx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-787688685',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-787688685-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T15:41:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='05b8aec03cb54887a02ac4a0c6a1c80a',uuid=5c914d94-5bfd-4984-8937-37bdf02e9674,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0ac76bca-773f-4a75-8811-c9839f549726", "address": "fa:16:3e:4a:5b:a7", "network": {"id": "67846b1f-41a7-4942-b9d2-0e41417d5ecf", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1653397054-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f0a8014c8bb4f4b80617a5516539994", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ac76bca-77", "ovs_interfaceid": "0ac76bca-773f-4a75-8811-c9839f549726", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72382) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 15:41:22 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-d47e9ca5-4b02-4b11-89c3-d9ff5190ac74 tempest-TestServerVolumeAttachScenarioOldVersion-787688685 tempest-TestServerVolumeAttachScenarioOldVersion-787688685-project-member] Converting VIF {"id": "0ac76bca-773f-4a75-8811-c9839f549726", "address": "fa:16:3e:4a:5b:a7", "network": {"id": "67846b1f-41a7-4942-b9d2-0e41417d5ecf", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1653397054-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f0a8014c8bb4f4b80617a5516539994", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ac76bca-77", "ovs_interfaceid": "0ac76bca-773f-4a75-8811-c9839f549726", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 15:41:22 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-d47e9ca5-4b02-4b11-89c3-d9ff5190ac74 tempest-TestServerVolumeAttachScenarioOldVersion-787688685 tempest-TestServerVolumeAttachScenarioOldVersion-787688685-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4a:5b:a7,bridge_name='br-int',has_traffic_filtering=True,id=0ac76bca-773f-4a75-8811-c9839f549726,network=Network(67846b1f-41a7-4942-b9d2-0e41417d5ecf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ac76bca-77') {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 15:41:22 user nova-compute[72382]: DEBUG nova.objects.instance [None req-d47e9ca5-4b02-4b11-89c3-d9ff5190ac74 tempest-TestServerVolumeAttachScenarioOldVersion-787688685 tempest-TestServerVolumeAttachScenarioOldVersion-787688685-project-member] Lazy-loading 'pci_devices' on Instance uuid 5c914d94-5bfd-4984-8937-37bdf02e9674 {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:41:22 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-d47e9ca5-4b02-4b11-89c3-d9ff5190ac74 tempest-TestServerVolumeAttachScenarioOldVersion-787688685 tempest-TestServerVolumeAttachScenarioOldVersion-787688685-project-member] [instance: 5c914d94-5bfd-4984-8937-37bdf02e9674] End _get_guest_xml xml=<domain type="kvm">
Aug 09 15:41:22 user nova-compute[72382]:   <uuid>5c914d94-5bfd-4984-8937-37bdf02e9674</uuid>
Aug 09 15:41:22 user nova-compute[72382]:   <name>instance-0000002e</name>
Aug 09 15:41:22 user nova-compute[72382]:   <memory>524288</memory>
Aug 09 15:41:22 user nova-compute[72382]:   <vcpu>1</vcpu>
Aug 09 15:41:22 user nova-compute[72382]:   <metadata>
Aug 09 15:41:22 user nova-compute[72382]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 15:41:22 user nova-compute[72382]:       <nova:package version="0.0.0"/>
Aug 09 15:41:22 user nova-compute[72382]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-1605899925</nova:name>
Aug 09 15:41:22 user nova-compute[72382]:       <nova:creationTime>2023-08-09 15:41:22</nova:creationTime>
Aug 09 15:41:22 user nova-compute[72382]:       <nova:flavor name="m1.tiny">
Aug 09 15:41:22 user nova-compute[72382]:         <nova:memory>512</nova:memory>
Aug 09 15:41:22 user nova-compute[72382]:         <nova:disk>1</nova:disk>
Aug 09 15:41:22 user nova-compute[72382]:         <nova:swap>0</nova:swap>
Aug 09 15:41:22 user nova-compute[72382]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 15:41:22 user nova-compute[72382]:         <nova:vcpus>1</nova:vcpus>
Aug 09 15:41:22 user nova-compute[72382]:       </nova:flavor>
Aug 09 15:41:22 user nova-compute[72382]:       <nova:owner>
Aug 09 15:41:22 user nova-compute[72382]:         <nova:user uuid="05b8aec03cb54887a02ac4a0c6a1c80a">tempest-TestServerVolumeAttachScenarioOldVersion-787688685-project-member</nova:user>
Aug 09 15:41:22 user nova-compute[72382]:         <nova:project uuid="1f0a8014c8bb4f4b80617a5516539994">tempest-TestServerVolumeAttachScenarioOldVersion-787688685</nova:project>
Aug 09 15:41:22 user nova-compute[72382]:       </nova:owner>
Aug 09 15:41:22 user nova-compute[72382]:       <nova:root type="image" uuid="a79f2cea-eb27-4631-aaf3-05e7d9e411b4"/>
Aug 09 15:41:22 user nova-compute[72382]:       <nova:ports>
Aug 09 15:41:22 user nova-compute[72382]:         <nova:port uuid="0ac76bca-773f-4a75-8811-c9839f549726">
Aug 09 15:41:22 user nova-compute[72382]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 09 15:41:22 user nova-compute[72382]:         </nova:port>
Aug 09 15:41:22 user nova-compute[72382]:       </nova:ports>
Aug 09 15:41:22 user nova-compute[72382]:     </nova:instance>
Aug 09 15:41:22 user nova-compute[72382]:   </metadata>
Aug 09 15:41:22 user nova-compute[72382]:   <sysinfo type="smbios">
Aug 09 15:41:22 user nova-compute[72382]:     <system>
Aug 09 15:41:22 user nova-compute[72382]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 15:41:22 user nova-compute[72382]:       <entry name="product">OpenStack Nova</entry>
Aug 09 15:41:22 user nova-compute[72382]:       <entry name="version">0.0.0</entry>
Aug 09 15:41:22 user nova-compute[72382]:       <entry name="serial">5c914d94-5bfd-4984-8937-37bdf02e9674</entry>
Aug 09 15:41:22 user nova-compute[72382]:       <entry name="uuid">5c914d94-5bfd-4984-8937-37bdf02e9674</entry>
Aug 09 15:41:22 user nova-compute[72382]:       <entry name="family">Virtual Machine</entry>
Aug 09 15:41:22 user nova-compute[72382]:     </system>
Aug 09 15:41:22 user nova-compute[72382]:   </sysinfo>
Aug 09 15:41:22 user nova-compute[72382]:   <os>
Aug 09 15:41:22 user nova-compute[72382]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 15:41:22 user nova-compute[72382]:     <boot dev="hd"/>
Aug 09 15:41:22 user nova-compute[72382]:     <smbios mode="sysinfo"/>
Aug 09 15:41:22 user nova-compute[72382]:   </os>
Aug 09 15:41:22 user nova-compute[72382]:   <features>
Aug 09 15:41:22 user nova-compute[72382]:     <acpi/>
Aug 09 15:41:22 user nova-compute[72382]:     <apic/>
Aug 09 15:41:22 user nova-compute[72382]:     <vmcoreinfo/>
Aug 09 15:41:22 user nova-compute[72382]:   </features>
Aug 09 15:41:22 user nova-compute[72382]:   <clock offset="utc">
Aug 09 15:41:22 user nova-compute[72382]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 15:41:22 user nova-compute[72382]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 15:41:22 user nova-compute[72382]:     <timer name="hpet" present="no"/>
Aug 09 15:41:22 user nova-compute[72382]:   </clock>
Aug 09 15:41:22 user nova-compute[72382]:   <cpu mode="custom" match="exact">
Aug 09 15:41:22 user nova-compute[72382]:     <model>Nehalem</model>
Aug 09 15:41:22 user nova-compute[72382]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 15:41:22 user nova-compute[72382]:   </cpu>
Aug 09 15:41:22 user nova-compute[72382]:   <devices>
Aug 09 15:41:22 user nova-compute[72382]:     <disk type="file" device="disk">
Aug 09 15:41:22 user nova-compute[72382]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 15:41:22 user nova-compute[72382]:       <source file="/opt/stack/data/nova/instances/5c914d94-5bfd-4984-8937-37bdf02e9674/disk"/>
Aug 09 15:41:22 user nova-compute[72382]:       <target dev="vda" bus="virtio"/>
Aug 09 15:41:22 user nova-compute[72382]:     </disk>
Aug 09 15:41:22 user nova-compute[72382]:     <interface type="ethernet">
Aug 09 15:41:22 user nova-compute[72382]:       <mac address="fa:16:3e:4a:5b:a7"/>
Aug 09 15:41:22 user nova-compute[72382]:       <model type="virtio"/>
Aug 09 15:41:22 user nova-compute[72382]:       <mtu size="1442"/>
Aug 09 15:41:22 user nova-compute[72382]:       <target dev="tap0ac76bca-77"/>
Aug 09 15:41:22 user nova-compute[72382]:     </interface>
Aug 09 15:41:22 user nova-compute[72382]:     <serial type="pty">
Aug 09 15:41:22 user nova-compute[72382]:       <log file="/opt/stack/data/nova/instances/5c914d94-5bfd-4984-8937-37bdf02e9674/console.log" append="off"/>
Aug 09 15:41:22 user nova-compute[72382]:     </serial>
Aug 09 15:41:22 user nova-compute[72382]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 15:41:22 user nova-compute[72382]:     <video>
Aug 09 15:41:22 user nova-compute[72382]:       <model type="virtio"/>
Aug 09 15:41:22 user nova-compute[72382]:     </video>
Aug 09 15:41:22 user nova-compute[72382]:     <rng model="virtio">
Aug 09 15:41:22 user nova-compute[72382]:       <backend model="random">/dev/urandom</backend>
Aug 09 15:41:22 user nova-compute[72382]:     </rng>
Aug 09 15:41:22 user nova-compute[72382]:     <controller type="usb" index="0" model="none"/>
Aug 09 15:41:22 user nova-compute[72382]:     <memballoon model="virtio">
Aug 09 15:41:22 user nova-compute[72382]:       <stats period="10"/>
Aug 09 15:41:22 user nova-compute[72382]:     </memballoon>
Aug 09 15:41:22 user nova-compute[72382]:   </devices>
Aug 09 15:41:22 user nova-compute[72382]: </domain>
Aug 09 15:41:22 user nova-compute[72382]:  {{(pid=72382) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 15:41:22 user nova-compute[72382]: DEBUG nova.virt.libvirt.vif [None req-d47e9ca5-4b02-4b11-89c3-d9ff5190ac74 tempest-TestServerVolumeAttachScenarioOldVersion-787688685 tempest-TestServerVolumeAttachScenarioOldVersion-787688685-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T15:41:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1605899925',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1605899925',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1605899',id=46,image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK4B9xaCIZerorj9Fvsw1WllwqEYvVTXL3D94j/E97x0EmsRhRlUlcbuXKO3snnMCRPhifzERLvpn7ECLZDzzc8v/7KlrftxNJkcaplrYZmxLvF+zkksn66csb2TO5pwBA==',key_name='tempest-keypair-233444206',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1f0a8014c8bb4f4b80617a5516539994',ramdisk_id='',reservation_id='r-0rz2h6vx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-787688685',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-787688685-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T15:41:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='05b8aec03cb54887a02ac4a0c6a1c80a',uuid=5c914d94-5bfd-4984-8937-37bdf02e9674,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0ac76bca-773f-4a75-8811-c9839f549726", "address": "fa:16:3e:4a:5b:a7", "network": {"id": "67846b1f-41a7-4942-b9d2-0e41417d5ecf", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1653397054-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f0a8014c8bb4f4b80617a5516539994", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ac76bca-77", "ovs_interfaceid": "0ac76bca-773f-4a75-8811-c9839f549726", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 15:41:22 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-d47e9ca5-4b02-4b11-89c3-d9ff5190ac74 tempest-TestServerVolumeAttachScenarioOldVersion-787688685 tempest-TestServerVolumeAttachScenarioOldVersion-787688685-project-member] Converting VIF {"id": "0ac76bca-773f-4a75-8811-c9839f549726", "address": "fa:16:3e:4a:5b:a7", "network": {"id": "67846b1f-41a7-4942-b9d2-0e41417d5ecf", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1653397054-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f0a8014c8bb4f4b80617a5516539994", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ac76bca-77", "ovs_interfaceid": "0ac76bca-773f-4a75-8811-c9839f549726", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 15:41:22 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-d47e9ca5-4b02-4b11-89c3-d9ff5190ac74 tempest-TestServerVolumeAttachScenarioOldVersion-787688685 tempest-TestServerVolumeAttachScenarioOldVersion-787688685-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4a:5b:a7,bridge_name='br-int',has_traffic_filtering=True,id=0ac76bca-773f-4a75-8811-c9839f549726,network=Network(67846b1f-41a7-4942-b9d2-0e41417d5ecf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ac76bca-77') {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 15:41:22 user nova-compute[72382]: DEBUG os_vif [None req-d47e9ca5-4b02-4b11-89c3-d9ff5190ac74 tempest-TestServerVolumeAttachScenarioOldVersion-787688685 tempest-TestServerVolumeAttachScenarioOldVersion-787688685-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:5b:a7,bridge_name='br-int',has_traffic_filtering=True,id=0ac76bca-773f-4a75-8811-c9839f549726,network=Network(67846b1f-41a7-4942-b9d2-0e41417d5ecf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ac76bca-77') {{(pid=72382) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 15:41:22 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:41:22 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:41:22 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 15:41:22 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:41:22 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0ac76bca-77, may_exist=True, interface_attrs={}) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:41:22 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0ac76bca-77, col_values=(('external_ids', {'iface-id': '0ac76bca-773f-4a75-8811-c9839f549726', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4a:5b:a7', 'vm-uuid': '5c914d94-5bfd-4984-8937-37bdf02e9674'}),), if_exists=True) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:41:22 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:41:22 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:41:22 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:41:22 user nova-compute[72382]: INFO os_vif [None req-d47e9ca5-4b02-4b11-89c3-d9ff5190ac74 tempest-TestServerVolumeAttachScenarioOldVersion-787688685 tempest-TestServerVolumeAttachScenarioOldVersion-787688685-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:5b:a7,bridge_name='br-int',has_traffic_filtering=True,id=0ac76bca-773f-4a75-8811-c9839f549726,network=Network(67846b1f-41a7-4942-b9d2-0e41417d5ecf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ac76bca-77')
Aug 09 15:41:22 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-d47e9ca5-4b02-4b11-89c3-d9ff5190ac74 tempest-TestServerVolumeAttachScenarioOldVersion-787688685 tempest-TestServerVolumeAttachScenarioOldVersion-787688685-project-member] No BDM found with device name vda, not building metadata. {{(pid=72382) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 15:41:22 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-d47e9ca5-4b02-4b11-89c3-d9ff5190ac74 tempest-TestServerVolumeAttachScenarioOldVersion-787688685 tempest-TestServerVolumeAttachScenarioOldVersion-787688685-project-member] No VIF found with MAC fa:16:3e:4a:5b:a7, not building metadata {{(pid=72382) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 15:41:23 user nova-compute[72382]: DEBUG nova.network.neutron [req-a1adf5fa-78ad-413f-ad45-2eedabfdaaa8 req-2f9bd426-e1e1-433f-a9ae-b3120bb7fc21 service nova] [instance: 5c914d94-5bfd-4984-8937-37bdf02e9674] Updated VIF entry in instance network info cache for port 0ac76bca-773f-4a75-8811-c9839f549726. {{(pid=72382) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 15:41:23 user nova-compute[72382]: DEBUG nova.network.neutron [req-a1adf5fa-78ad-413f-ad45-2eedabfdaaa8 req-2f9bd426-e1e1-433f-a9ae-b3120bb7fc21 service nova] [instance: 5c914d94-5bfd-4984-8937-37bdf02e9674] Updating instance_info_cache with network_info: [{"id": "0ac76bca-773f-4a75-8811-c9839f549726", "address": "fa:16:3e:4a:5b:a7", "network": {"id": "67846b1f-41a7-4942-b9d2-0e41417d5ecf", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1653397054-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f0a8014c8bb4f4b80617a5516539994", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ac76bca-77", "ovs_interfaceid": "0ac76bca-773f-4a75-8811-c9839f549726", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:41:23 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-a1adf5fa-78ad-413f-ad45-2eedabfdaaa8 req-2f9bd426-e1e1-433f-a9ae-b3120bb7fc21 service nova] Releasing lock "refresh_cache-5c914d94-5bfd-4984-8937-37bdf02e9674" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 15:41:23 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:41:24 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:41:24 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-95667c4c-50ad-4f21-8055-cc1253f6a3ef tempest-VolumesActionsTest-1154417962 tempest-VolumesActionsTest-1154417962-project-member] Acquiring lock "b0da60bf-7468-4041-8016-54e3d82386b7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:41:24 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-95667c4c-50ad-4f21-8055-cc1253f6a3ef tempest-VolumesActionsTest-1154417962 tempest-VolumesActionsTest-1154417962-project-member] Lock "b0da60bf-7468-4041-8016-54e3d82386b7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:41:24 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-95667c4c-50ad-4f21-8055-cc1253f6a3ef tempest-VolumesActionsTest-1154417962 tempest-VolumesActionsTest-1154417962-project-member] Acquiring lock "b0da60bf-7468-4041-8016-54e3d82386b7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:41:24 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-95667c4c-50ad-4f21-8055-cc1253f6a3ef tempest-VolumesActionsTest-1154417962 tempest-VolumesActionsTest-1154417962-project-member] Lock "b0da60bf-7468-4041-8016-54e3d82386b7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:41:24 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-95667c4c-50ad-4f21-8055-cc1253f6a3ef tempest-VolumesActionsTest-1154417962 tempest-VolumesActionsTest-1154417962-project-member] Lock "b0da60bf-7468-4041-8016-54e3d82386b7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:41:24 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:41:24 user nova-compute[72382]: INFO nova.compute.manager [None req-95667c4c-50ad-4f21-8055-cc1253f6a3ef tempest-VolumesActionsTest-1154417962 tempest-VolumesActionsTest-1154417962-project-member] [instance: b0da60bf-7468-4041-8016-54e3d82386b7] Terminating instance
Aug 09 15:41:24 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:41:24 user nova-compute[72382]: DEBUG nova.compute.manager [None req-95667c4c-50ad-4f21-8055-cc1253f6a3ef tempest-VolumesActionsTest-1154417962 tempest-VolumesActionsTest-1154417962-project-member] [instance: b0da60bf-7468-4041-8016-54e3d82386b7] Start destroying the instance on the hypervisor. {{(pid=72382) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 15:41:24 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:41:24 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:41:24 user nova-compute[72382]: DEBUG nova.compute.manager [req-b4e7fba5-a595-417d-907b-70cb62c0dd85 req-51151ca7-828d-4558-b13c-5a806b1f528e service nova] [instance: b0da60bf-7468-4041-8016-54e3d82386b7] Received event network-vif-unplugged-768b217d-898e-40e7-9af8-c8c0d9e88e89 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:41:24 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-b4e7fba5-a595-417d-907b-70cb62c0dd85 req-51151ca7-828d-4558-b13c-5a806b1f528e service nova] Acquiring lock "b0da60bf-7468-4041-8016-54e3d82386b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:41:24 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-b4e7fba5-a595-417d-907b-70cb62c0dd85 req-51151ca7-828d-4558-b13c-5a806b1f528e service nova] Lock "b0da60bf-7468-4041-8016-54e3d82386b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:41:24 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-b4e7fba5-a595-417d-907b-70cb62c0dd85 req-51151ca7-828d-4558-b13c-5a806b1f528e service nova] Lock "b0da60bf-7468-4041-8016-54e3d82386b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:41:24 user nova-compute[72382]: DEBUG nova.compute.manager [req-b4e7fba5-a595-417d-907b-70cb62c0dd85 req-51151ca7-828d-4558-b13c-5a806b1f528e service nova] [instance: b0da60bf-7468-4041-8016-54e3d82386b7] No waiting events found dispatching network-vif-unplugged-768b217d-898e-40e7-9af8-c8c0d9e88e89 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:41:24 user nova-compute[72382]: DEBUG nova.compute.manager [req-b4e7fba5-a595-417d-907b-70cb62c0dd85 req-51151ca7-828d-4558-b13c-5a806b1f528e service nova] [instance: b0da60bf-7468-4041-8016-54e3d82386b7] Received event network-vif-unplugged-768b217d-898e-40e7-9af8-c8c0d9e88e89 for instance with task_state deleting. {{(pid=72382) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 15:41:24 user nova-compute[72382]: DEBUG nova.compute.manager [req-f9fc5094-d816-4510-a503-64ed6e9668bf req-6a6488a3-edfa-481b-a266-4ad1f873ed3b service nova] [instance: 5c914d94-5bfd-4984-8937-37bdf02e9674] Received event network-vif-plugged-0ac76bca-773f-4a75-8811-c9839f549726 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:41:24 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-f9fc5094-d816-4510-a503-64ed6e9668bf req-6a6488a3-edfa-481b-a266-4ad1f873ed3b service nova] Acquiring lock "5c914d94-5bfd-4984-8937-37bdf02e9674-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:41:24 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-f9fc5094-d816-4510-a503-64ed6e9668bf req-6a6488a3-edfa-481b-a266-4ad1f873ed3b service nova] Lock "5c914d94-5bfd-4984-8937-37bdf02e9674-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:41:24 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-f9fc5094-d816-4510-a503-64ed6e9668bf req-6a6488a3-edfa-481b-a266-4ad1f873ed3b service nova] Lock "5c914d94-5bfd-4984-8937-37bdf02e9674-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:41:24 user nova-compute[72382]: DEBUG nova.compute.manager [req-f9fc5094-d816-4510-a503-64ed6e9668bf req-6a6488a3-edfa-481b-a266-4ad1f873ed3b service nova] [instance: 5c914d94-5bfd-4984-8937-37bdf02e9674] No waiting events found dispatching network-vif-plugged-0ac76bca-773f-4a75-8811-c9839f549726 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:41:24 user nova-compute[72382]: WARNING nova.compute.manager [req-f9fc5094-d816-4510-a503-64ed6e9668bf req-6a6488a3-edfa-481b-a266-4ad1f873ed3b service nova] [instance: 5c914d94-5bfd-4984-8937-37bdf02e9674] Received unexpected event network-vif-plugged-0ac76bca-773f-4a75-8811-c9839f549726 for instance with vm_state building and task_state spawning.
Aug 09 15:41:24 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:41:24 user nova-compute[72382]: DEBUG nova.compute.manager [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72382) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 15:41:24 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:41:24 user nova-compute[72382]: INFO nova.virt.libvirt.driver [-] [instance: b0da60bf-7468-4041-8016-54e3d82386b7] Instance destroyed successfully.
Aug 09 15:41:24 user nova-compute[72382]: DEBUG nova.objects.instance [None req-95667c4c-50ad-4f21-8055-cc1253f6a3ef tempest-VolumesActionsTest-1154417962 tempest-VolumesActionsTest-1154417962-project-member] Lazy-loading 'resources' on Instance uuid b0da60bf-7468-4041-8016-54e3d82386b7 {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:41:24 user nova-compute[72382]: DEBUG nova.virt.libvirt.vif [None req-95667c4c-50ad-4f21-8055-cc1253f6a3ef tempest-VolumesActionsTest-1154417962 tempest-VolumesActionsTest-1154417962-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T15:39:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-146743122',display_name='tempest-VolumesActionsTest-instance-146743122',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-146743122',id=45,image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-09T15:39:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b7bd7707b7d84acdb15e5f89b6720ff7',ramdisk_id='',reservation_id='r-kuwm44rz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1154417962',owner_user_name='tempest-VolumesActionsTest-1154417962-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T15:39:37Z,user_data=None,user_id='a780bb50b3d54386b8ed790da8a6cbea',uuid=b0da60bf-7468-4041-8016-54e3d82386b7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "768b217d-898e-40e7-9af8-c8c0d9e88e89", "address": "fa:16:3e:7d:85:ab", "network": {"id": "7cba5169-ea03-4ec4-a7e4-11b56c637e26", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1109056022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7bd7707b7d84acdb15e5f89b6720ff7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap768b217d-89", "ovs_interfaceid": "768b217d-898e-40e7-9af8-c8c0d9e88e89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 15:41:24 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-95667c4c-50ad-4f21-8055-cc1253f6a3ef tempest-VolumesActionsTest-1154417962 tempest-VolumesActionsTest-1154417962-project-member] Converting VIF {"id": "768b217d-898e-40e7-9af8-c8c0d9e88e89", "address": "fa:16:3e:7d:85:ab", "network": {"id": "7cba5169-ea03-4ec4-a7e4-11b56c637e26", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1109056022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7bd7707b7d84acdb15e5f89b6720ff7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap768b217d-89", "ovs_interfaceid": "768b217d-898e-40e7-9af8-c8c0d9e88e89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 15:41:24 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-95667c4c-50ad-4f21-8055-cc1253f6a3ef tempest-VolumesActionsTest-1154417962 tempest-VolumesActionsTest-1154417962-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:85:ab,bridge_name='br-int',has_traffic_filtering=True,id=768b217d-898e-40e7-9af8-c8c0d9e88e89,network=Network(7cba5169-ea03-4ec4-a7e4-11b56c637e26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap768b217d-89') {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 15:41:24 user nova-compute[72382]: DEBUG os_vif [None req-95667c4c-50ad-4f21-8055-cc1253f6a3ef tempest-VolumesActionsTest-1154417962 tempest-VolumesActionsTest-1154417962-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:85:ab,bridge_name='br-int',has_traffic_filtering=True,id=768b217d-898e-40e7-9af8-c8c0d9e88e89,network=Network(7cba5169-ea03-4ec4-a7e4-11b56c637e26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap768b217d-89') {{(pid=72382) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 15:41:24 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:41:24 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap768b217d-89, bridge=br-int, if_exists=True) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:41:24 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:41:24 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:41:24 user nova-compute[72382]: INFO os_vif [None req-95667c4c-50ad-4f21-8055-cc1253f6a3ef tempest-VolumesActionsTest-1154417962 tempest-VolumesActionsTest-1154417962-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:85:ab,bridge_name='br-int',has_traffic_filtering=True,id=768b217d-898e-40e7-9af8-c8c0d9e88e89,network=Network(7cba5169-ea03-4ec4-a7e4-11b56c637e26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap768b217d-89')
Aug 09 15:41:24 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-95667c4c-50ad-4f21-8055-cc1253f6a3ef tempest-VolumesActionsTest-1154417962 tempest-VolumesActionsTest-1154417962-project-member] [instance: b0da60bf-7468-4041-8016-54e3d82386b7] Deleting instance files /opt/stack/data/nova/instances/b0da60bf-7468-4041-8016-54e3d82386b7_del
Aug 09 15:41:24 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-95667c4c-50ad-4f21-8055-cc1253f6a3ef tempest-VolumesActionsTest-1154417962 tempest-VolumesActionsTest-1154417962-project-member] [instance: b0da60bf-7468-4041-8016-54e3d82386b7] Deletion of /opt/stack/data/nova/instances/b0da60bf-7468-4041-8016-54e3d82386b7_del complete
Aug 09 15:41:24 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:41:25 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:41:25 user nova-compute[72382]: INFO nova.compute.manager [None req-95667c4c-50ad-4f21-8055-cc1253f6a3ef tempest-VolumesActionsTest-1154417962 tempest-VolumesActionsTest-1154417962-project-member] [instance: b0da60bf-7468-4041-8016-54e3d82386b7] Took 0.89 seconds to destroy the instance on the hypervisor.
Aug 09 15:41:25 user nova-compute[72382]: DEBUG oslo.service.loopingcall [None req-95667c4c-50ad-4f21-8055-cc1253f6a3ef tempest-VolumesActionsTest-1154417962 tempest-VolumesActionsTest-1154417962-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72382) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 15:41:25 user nova-compute[72382]: DEBUG nova.compute.manager [-] [instance: b0da60bf-7468-4041-8016-54e3d82386b7] Deallocating network for instance {{(pid=72382) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 15:41:25 user nova-compute[72382]: DEBUG nova.network.neutron [-] [instance: b0da60bf-7468-4041-8016-54e3d82386b7] deallocate_for_instance() {{(pid=72382) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 15:41:25 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:41:25 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:41:25 user nova-compute[72382]: DEBUG nova.network.neutron [-] [instance: b0da60bf-7468-4041-8016-54e3d82386b7] Updating instance_info_cache with network_info: [] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:41:25 user nova-compute[72382]: INFO nova.compute.manager [-] [instance: b0da60bf-7468-4041-8016-54e3d82386b7] Took 0.60 seconds to deallocate network for instance.
Aug 09 15:41:25 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-95667c4c-50ad-4f21-8055-cc1253f6a3ef tempest-VolumesActionsTest-1154417962 tempest-VolumesActionsTest-1154417962-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:41:25 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-95667c4c-50ad-4f21-8055-cc1253f6a3ef tempest-VolumesActionsTest-1154417962 tempest-VolumesActionsTest-1154417962-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:41:25 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:41:25 user nova-compute[72382]: DEBUG nova.compute.manager [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Starting heal instance info cache {{(pid=72382) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 15:41:25 user nova-compute[72382]: DEBUG nova.compute.provider_tree [None req-95667c4c-50ad-4f21-8055-cc1253f6a3ef tempest-VolumesActionsTest-1154417962 tempest-VolumesActionsTest-1154417962-project-member] Inventory has not changed in ProviderTree for provider: 7b15b0e5-df4d-49db-833b-2855d21d10ae {{(pid=72382) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 15:41:25 user nova-compute[72382]: DEBUG nova.scheduler.client.report [None req-95667c4c-50ad-4f21-8055-cc1253f6a3ef tempest-VolumesActionsTest-1154417962 tempest-VolumesActionsTest-1154417962-project-member] Inventory has not changed for provider 7b15b0e5-df4d-49db-833b-2855d21d10ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72382) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 15:41:25 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-95667c4c-50ad-4f21-8055-cc1253f6a3ef tempest-VolumesActionsTest-1154417962 tempest-VolumesActionsTest-1154417962-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.235s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:41:26 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Acquiring lock "refresh_cache-54523d3e-bfae-4621-85cb-d6a7bc40abf5" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 15:41:26 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Acquired lock "refresh_cache-54523d3e-bfae-4621-85cb-d6a7bc40abf5" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 15:41:26 user nova-compute[72382]: DEBUG nova.network.neutron [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] [instance: 54523d3e-bfae-4621-85cb-d6a7bc40abf5] Forcefully refreshing network info cache for instance {{(pid=72382) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 15:41:26 user nova-compute[72382]: INFO nova.scheduler.client.report [None req-95667c4c-50ad-4f21-8055-cc1253f6a3ef tempest-VolumesActionsTest-1154417962 tempest-VolumesActionsTest-1154417962-project-member] Deleted allocations for instance b0da60bf-7468-4041-8016-54e3d82386b7
Aug 09 15:41:26 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-95667c4c-50ad-4f21-8055-cc1253f6a3ef tempest-VolumesActionsTest-1154417962 tempest-VolumesActionsTest-1154417962-project-member] Lock "b0da60bf-7468-4041-8016-54e3d82386b7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.978s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:41:26 user nova-compute[72382]: DEBUG nova.virt.driver [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Emitting event <LifecycleEvent: 1691595686.3768272, 5c914d94-5bfd-4984-8937-37bdf02e9674 => Resumed> {{(pid=72382) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 15:41:26 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 5c914d94-5bfd-4984-8937-37bdf02e9674] VM Resumed (Lifecycle Event)
Aug 09 15:41:26 user nova-compute[72382]: DEBUG nova.compute.manager [None req-d47e9ca5-4b02-4b11-89c3-d9ff5190ac74 tempest-TestServerVolumeAttachScenarioOldVersion-787688685 tempest-TestServerVolumeAttachScenarioOldVersion-787688685-project-member] [instance: 5c914d94-5bfd-4984-8937-37bdf02e9674] Instance event wait completed in 0 seconds for  {{(pid=72382) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 15:41:26 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-d47e9ca5-4b02-4b11-89c3-d9ff5190ac74 tempest-TestServerVolumeAttachScenarioOldVersion-787688685 tempest-TestServerVolumeAttachScenarioOldVersion-787688685-project-member] [instance: 5c914d94-5bfd-4984-8937-37bdf02e9674] Guest created on hypervisor {{(pid=72382) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 15:41:26 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 5c914d94-5bfd-4984-8937-37bdf02e9674] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:41:26 user nova-compute[72382]: INFO nova.virt.libvirt.driver [-] [instance: 5c914d94-5bfd-4984-8937-37bdf02e9674] Instance spawned successfully.
Aug 09 15:41:26 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-d47e9ca5-4b02-4b11-89c3-d9ff5190ac74 tempest-TestServerVolumeAttachScenarioOldVersion-787688685 tempest-TestServerVolumeAttachScenarioOldVersion-787688685-project-member] [instance: 5c914d94-5bfd-4984-8937-37bdf02e9674] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 15:41:26 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 5c914d94-5bfd-4984-8937-37bdf02e9674] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72382) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 15:41:26 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 5c914d94-5bfd-4984-8937-37bdf02e9674] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 15:41:26 user nova-compute[72382]: DEBUG nova.virt.driver [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Emitting event <LifecycleEvent: 1691595686.3786812, 5c914d94-5bfd-4984-8937-37bdf02e9674 => Started> {{(pid=72382) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 15:41:26 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 5c914d94-5bfd-4984-8937-37bdf02e9674] VM Started (Lifecycle Event)
Aug 09 15:41:26 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-d47e9ca5-4b02-4b11-89c3-d9ff5190ac74 tempest-TestServerVolumeAttachScenarioOldVersion-787688685 tempest-TestServerVolumeAttachScenarioOldVersion-787688685-project-member] [instance: 5c914d94-5bfd-4984-8937-37bdf02e9674] Found default for hw_cdrom_bus of ide {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:41:26 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-d47e9ca5-4b02-4b11-89c3-d9ff5190ac74 tempest-TestServerVolumeAttachScenarioOldVersion-787688685 tempest-TestServerVolumeAttachScenarioOldVersion-787688685-project-member] [instance: 5c914d94-5bfd-4984-8937-37bdf02e9674] Found default for hw_disk_bus of virtio {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:41:26 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-d47e9ca5-4b02-4b11-89c3-d9ff5190ac74 tempest-TestServerVolumeAttachScenarioOldVersion-787688685 tempest-TestServerVolumeAttachScenarioOldVersion-787688685-project-member] [instance: 5c914d94-5bfd-4984-8937-37bdf02e9674] Found default for hw_input_bus of None {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:41:26 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-d47e9ca5-4b02-4b11-89c3-d9ff5190ac74 tempest-TestServerVolumeAttachScenarioOldVersion-787688685 tempest-TestServerVolumeAttachScenarioOldVersion-787688685-project-member] [instance: 5c914d94-5bfd-4984-8937-37bdf02e9674] Found default for hw_pointer_model of None {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:41:26 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-d47e9ca5-4b02-4b11-89c3-d9ff5190ac74 tempest-TestServerVolumeAttachScenarioOldVersion-787688685 tempest-TestServerVolumeAttachScenarioOldVersion-787688685-project-member] [instance: 5c914d94-5bfd-4984-8937-37bdf02e9674] Found default for hw_video_model of virtio {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:41:26 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-d47e9ca5-4b02-4b11-89c3-d9ff5190ac74 tempest-TestServerVolumeAttachScenarioOldVersion-787688685 tempest-TestServerVolumeAttachScenarioOldVersion-787688685-project-member] [instance: 5c914d94-5bfd-4984-8937-37bdf02e9674] Found default for hw_vif_model of virtio {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:41:26 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 5c914d94-5bfd-4984-8937-37bdf02e9674] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:41:26 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 5c914d94-5bfd-4984-8937-37bdf02e9674] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72382) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 15:41:26 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 5c914d94-5bfd-4984-8937-37bdf02e9674] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 15:41:26 user nova-compute[72382]: INFO nova.compute.manager [None req-d47e9ca5-4b02-4b11-89c3-d9ff5190ac74 tempest-TestServerVolumeAttachScenarioOldVersion-787688685 tempest-TestServerVolumeAttachScenarioOldVersion-787688685-project-member] [instance: 5c914d94-5bfd-4984-8937-37bdf02e9674] Took 7.32 seconds to spawn the instance on the hypervisor.
Aug 09 15:41:26 user nova-compute[72382]: DEBUG nova.compute.manager [None req-d47e9ca5-4b02-4b11-89c3-d9ff5190ac74 tempest-TestServerVolumeAttachScenarioOldVersion-787688685 tempest-TestServerVolumeAttachScenarioOldVersion-787688685-project-member] [instance: 5c914d94-5bfd-4984-8937-37bdf02e9674] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:41:26 user nova-compute[72382]: DEBUG nova.network.neutron [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] [instance: 54523d3e-bfae-4621-85cb-d6a7bc40abf5] Updating instance_info_cache with network_info: [{"id": "8557ab28-9722-4e6e-a14d-f941e3b693c8", "address": "fa:16:3e:40:5f:a8", "network": {"id": "308641dc-cc18-41db-9baa-7cc880e594ad", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1932973397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb5bf3f95d2843af94dbcab2af932bd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8557ab28-97", "ovs_interfaceid": "8557ab28-9722-4e6e-a14d-f941e3b693c8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:41:26 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Releasing lock "refresh_cache-54523d3e-bfae-4621-85cb-d6a7bc40abf5" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 15:41:26 user nova-compute[72382]: DEBUG nova.compute.manager [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] [instance: 54523d3e-bfae-4621-85cb-d6a7bc40abf5] Updated the network info_cache for instance {{(pid=72382) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 15:41:26 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:41:26 user nova-compute[72382]: INFO nova.compute.manager [None req-d47e9ca5-4b02-4b11-89c3-d9ff5190ac74 tempest-TestServerVolumeAttachScenarioOldVersion-787688685 tempest-TestServerVolumeAttachScenarioOldVersion-787688685-project-member] [instance: 5c914d94-5bfd-4984-8937-37bdf02e9674] Took 8.01 seconds to build instance.
Aug 09 15:41:26 user nova-compute[72382]: DEBUG nova.compute.manager [req-c3252d73-8aa3-4e18-a3ac-c68301a428e1 req-da15a4e4-fce2-45c2-8965-6a1a571f708a service nova] [instance: b0da60bf-7468-4041-8016-54e3d82386b7] Received event network-vif-plugged-768b217d-898e-40e7-9af8-c8c0d9e88e89 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:41:26 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-c3252d73-8aa3-4e18-a3ac-c68301a428e1 req-da15a4e4-fce2-45c2-8965-6a1a571f708a service nova] Acquiring lock "b0da60bf-7468-4041-8016-54e3d82386b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:41:26 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-c3252d73-8aa3-4e18-a3ac-c68301a428e1 req-da15a4e4-fce2-45c2-8965-6a1a571f708a service nova] Lock "b0da60bf-7468-4041-8016-54e3d82386b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:41:26 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-c3252d73-8aa3-4e18-a3ac-c68301a428e1 req-da15a4e4-fce2-45c2-8965-6a1a571f708a service nova] Lock "b0da60bf-7468-4041-8016-54e3d82386b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:41:26 user nova-compute[72382]: DEBUG nova.compute.manager [req-c3252d73-8aa3-4e18-a3ac-c68301a428e1 req-da15a4e4-fce2-45c2-8965-6a1a571f708a service nova] [instance: b0da60bf-7468-4041-8016-54e3d82386b7] No waiting events found dispatching network-vif-plugged-768b217d-898e-40e7-9af8-c8c0d9e88e89 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:41:26 user nova-compute[72382]: WARNING nova.compute.manager [req-c3252d73-8aa3-4e18-a3ac-c68301a428e1 req-da15a4e4-fce2-45c2-8965-6a1a571f708a service nova] [instance: b0da60bf-7468-4041-8016-54e3d82386b7] Received unexpected event network-vif-plugged-768b217d-898e-40e7-9af8-c8c0d9e88e89 for instance with vm_state deleted and task_state None.
Aug 09 15:41:26 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-d47e9ca5-4b02-4b11-89c3-d9ff5190ac74 tempest-TestServerVolumeAttachScenarioOldVersion-787688685 tempest-TestServerVolumeAttachScenarioOldVersion-787688685-project-member] Lock "5c914d94-5bfd-4984-8937-37bdf02e9674" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.122s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:41:26 user nova-compute[72382]: DEBUG nova.compute.manager [req-a61fd516-7171-456c-9103-17a1f0651529 req-18d182df-b1b5-4cd6-85d3-5c2bd1ac4850 service nova] [instance: 5c914d94-5bfd-4984-8937-37bdf02e9674] Received event network-vif-plugged-0ac76bca-773f-4a75-8811-c9839f549726 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:41:26 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-a61fd516-7171-456c-9103-17a1f0651529 req-18d182df-b1b5-4cd6-85d3-5c2bd1ac4850 service nova] Acquiring lock "5c914d94-5bfd-4984-8937-37bdf02e9674-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:41:26 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-a61fd516-7171-456c-9103-17a1f0651529 req-18d182df-b1b5-4cd6-85d3-5c2bd1ac4850 service nova] Lock "5c914d94-5bfd-4984-8937-37bdf02e9674-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:41:26 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-a61fd516-7171-456c-9103-17a1f0651529 req-18d182df-b1b5-4cd6-85d3-5c2bd1ac4850 service nova] Lock "5c914d94-5bfd-4984-8937-37bdf02e9674-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:41:26 user nova-compute[72382]: DEBUG nova.compute.manager [req-a61fd516-7171-456c-9103-17a1f0651529 req-18d182df-b1b5-4cd6-85d3-5c2bd1ac4850 service nova] [instance: 5c914d94-5bfd-4984-8937-37bdf02e9674] No waiting events found dispatching network-vif-plugged-0ac76bca-773f-4a75-8811-c9839f549726 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:41:26 user nova-compute[72382]: WARNING nova.compute.manager [req-a61fd516-7171-456c-9103-17a1f0651529 req-18d182df-b1b5-4cd6-85d3-5c2bd1ac4850 service nova] [instance: 5c914d94-5bfd-4984-8937-37bdf02e9674] Received unexpected event network-vif-plugged-0ac76bca-773f-4a75-8811-c9839f549726 for instance with vm_state active and task_state None.
Aug 09 15:41:26 user nova-compute[72382]: DEBUG nova.compute.manager [req-a61fd516-7171-456c-9103-17a1f0651529 req-18d182df-b1b5-4cd6-85d3-5c2bd1ac4850 service nova] [instance: b0da60bf-7468-4041-8016-54e3d82386b7] Received event network-vif-deleted-768b217d-898e-40e7-9af8-c8c0d9e88e89 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:41:28 user nova-compute[72382]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691595673.0563684, 7949b7d0-2712-402f-86ee-30acaef2d3e7 => Stopped> {{(pid=72382) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 15:41:28 user nova-compute[72382]: INFO nova.compute.manager [-] [instance: 7949b7d0-2712-402f-86ee-30acaef2d3e7] VM Stopped (Lifecycle Event)
Aug 09 15:41:28 user nova-compute[72382]: DEBUG nova.compute.manager [None req-50c01843-a22c-440f-bd23-6ba341aea19a None None] [instance: 7949b7d0-2712-402f-86ee-30acaef2d3e7] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:41:29 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:41:29 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:41:29 user nova-compute[72382]: DEBUG nova.compute.manager [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Cleaning up deleted instances {{(pid=72382) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 09 15:41:29 user nova-compute[72382]: DEBUG nova.compute.manager [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] There are 0 instances to clean {{(pid=72382) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 09 15:41:29 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:41:29 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:41:30 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:41:30 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:41:31 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:41:32 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-c9d067e6-bb5e-4fe4-b919-6218383c6b88 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Acquiring lock "f49b5daf-d39d-496f-97d7-a0d9fd67d66d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:41:32 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-c9d067e6-bb5e-4fe4-b919-6218383c6b88 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Lock "f49b5daf-d39d-496f-97d7-a0d9fd67d66d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:41:32 user nova-compute[72382]: DEBUG nova.compute.manager [None req-c9d067e6-bb5e-4fe4-b919-6218383c6b88 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: f49b5daf-d39d-496f-97d7-a0d9fd67d66d] Starting instance... {{(pid=72382) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 15:41:32 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-c9d067e6-bb5e-4fe4-b919-6218383c6b88 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:41:32 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-c9d067e6-bb5e-4fe4-b919-6218383c6b88 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:41:32 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-c9d067e6-bb5e-4fe4-b919-6218383c6b88 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72382) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 15:41:32 user nova-compute[72382]: INFO nova.compute.claims [None req-c9d067e6-bb5e-4fe4-b919-6218383c6b88 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: f49b5daf-d39d-496f-97d7-a0d9fd67d66d] Claim successful on node user
Aug 09 15:41:33 user nova-compute[72382]: DEBUG nova.compute.provider_tree [None req-c9d067e6-bb5e-4fe4-b919-6218383c6b88 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Inventory has not changed in ProviderTree for provider: 7b15b0e5-df4d-49db-833b-2855d21d10ae {{(pid=72382) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 15:41:33 user nova-compute[72382]: DEBUG nova.scheduler.client.report [None req-c9d067e6-bb5e-4fe4-b919-6218383c6b88 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Inventory has not changed for provider 7b15b0e5-df4d-49db-833b-2855d21d10ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72382) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 15:41:33 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-c9d067e6-bb5e-4fe4-b919-6218383c6b88 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.327s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:41:33 user nova-compute[72382]: DEBUG nova.compute.manager [None req-c9d067e6-bb5e-4fe4-b919-6218383c6b88 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: f49b5daf-d39d-496f-97d7-a0d9fd67d66d] Start building networks asynchronously for instance. {{(pid=72382) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 15:41:33 user nova-compute[72382]: DEBUG nova.compute.manager [None req-c9d067e6-bb5e-4fe4-b919-6218383c6b88 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: f49b5daf-d39d-496f-97d7-a0d9fd67d66d] Allocating IP information in the background. {{(pid=72382) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 15:41:33 user nova-compute[72382]: DEBUG nova.network.neutron [None req-c9d067e6-bb5e-4fe4-b919-6218383c6b88 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: f49b5daf-d39d-496f-97d7-a0d9fd67d66d] allocate_for_instance() {{(pid=72382) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 15:41:33 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-c9d067e6-bb5e-4fe4-b919-6218383c6b88 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: f49b5daf-d39d-496f-97d7-a0d9fd67d66d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 15:41:33 user nova-compute[72382]: DEBUG nova.compute.manager [None req-c9d067e6-bb5e-4fe4-b919-6218383c6b88 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: f49b5daf-d39d-496f-97d7-a0d9fd67d66d] Start building block device mappings for instance. {{(pid=72382) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 15:41:33 user nova-compute[72382]: DEBUG nova.policy [None req-c9d067e6-bb5e-4fe4-b919-6218383c6b88 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '280bcf2afd7245a7bcd605e0db79c569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70310b1af40b4d239fe5ea362972554b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72382) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 15:41:33 user nova-compute[72382]: INFO nova.virt.block_device [None req-c9d067e6-bb5e-4fe4-b919-6218383c6b88 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: f49b5daf-d39d-496f-97d7-a0d9fd67d66d] Booting with volume 38d0b588-2e6f-4ebb-84a1-8a928e923cd7 at /dev/vda
Aug 09 15:41:33 user nova-compute[72382]: DEBUG os_brick.utils [None req-c9d067e6-bb5e-4fe4-b919-6218383c6b88 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 15:41:33 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:41:33 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:41:33 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bc355f5-5c18-45d4-9ba4-93159ce28d86]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d2cfa7015fe\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:41:33 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:41:33 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:41:33 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[11636a28-a8f1-4953-9ba5-debd2a7b0e1d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:41:33 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:41:33 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:41:33 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5b06bc9-be89-486f-813f-043dc7131726]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:41:33 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[79d53323-3743-4a98-8d2f-a465ee8b3b65]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:41:33 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-c9d067e6-bb5e-4fe4-b919-6218383c6b88 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Running cmd (subprocess): nvme version {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:41:33 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-c9d067e6-bb5e-4fe4-b919-6218383c6b88 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] 'nvme version' failed. Not Retrying. {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 15:41:33 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c9d067e6-bb5e-4fe4-b919-6218383c6b88 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] nvme not present on system {{(pid=72382) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 15:41:33 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:41:33 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 15:41:33 user nova-compute[72382]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 15:41:33 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[18b93944-b9ac-4d35-ab38-075d18823e68]: (4, '') {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:41:33 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.lightos [None req-c9d067e6-bb5e-4fe4-b919-6218383c6b88 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72382) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 15:41:33 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.lightos [None req-c9d067e6-bb5e-4fe4-b919-6218383c6b88 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72382) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 15:41:33 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.lightos [None req-c9d067e6-bb5e-4fe4-b919-6218383c6b88 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] LIGHTOS: no hostnqn found. {{(pid=72382) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 15:41:33 user nova-compute[72382]: DEBUG os_brick.utils [None req-c9d067e6-bb5e-4fe4-b919-6218383c6b88 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] <== get_connector_properties: return (148ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d2cfa7015fe', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 15:41:33 user nova-compute[72382]: DEBUG nova.virt.block_device [None req-c9d067e6-bb5e-4fe4-b919-6218383c6b88 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: f49b5daf-d39d-496f-97d7-a0d9fd67d66d] Updating existing volume attachment record: a07a5f5f-baf5-46f3-9a07-e4faf529d8bf {{(pid=72382) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 15:41:34 user nova-compute[72382]: DEBUG nova.network.neutron [None req-c9d067e6-bb5e-4fe4-b919-6218383c6b88 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: f49b5daf-d39d-496f-97d7-a0d9fd67d66d] Successfully created port: 409cb778-13bd-425b-bb7b-90643706b023 {{(pid=72382) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 15:41:34 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:41:34 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:41:35 user nova-compute[72382]: DEBUG nova.network.neutron [None req-c9d067e6-bb5e-4fe4-b919-6218383c6b88 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: f49b5daf-d39d-496f-97d7-a0d9fd67d66d] Successfully updated port: 409cb778-13bd-425b-bb7b-90643706b023 {{(pid=72382) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 15:41:35 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-c9d067e6-bb5e-4fe4-b919-6218383c6b88 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Acquiring lock "refresh_cache-f49b5daf-d39d-496f-97d7-a0d9fd67d66d" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 15:41:35 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-c9d067e6-bb5e-4fe4-b919-6218383c6b88 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Acquired lock "refresh_cache-f49b5daf-d39d-496f-97d7-a0d9fd67d66d" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 15:41:35 user nova-compute[72382]: DEBUG nova.network.neutron [None req-c9d067e6-bb5e-4fe4-b919-6218383c6b88 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: f49b5daf-d39d-496f-97d7-a0d9fd67d66d] Building network info cache for instance {{(pid=72382) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 15:41:35 user nova-compute[72382]: DEBUG nova.compute.manager [req-182695df-1def-4473-baee-fd27650245f6 req-e22786f3-5351-4584-bb98-95f9e2f6991a service nova] [instance: f49b5daf-d39d-496f-97d7-a0d9fd67d66d] Received event network-changed-409cb778-13bd-425b-bb7b-90643706b023 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:41:35 user nova-compute[72382]: DEBUG nova.compute.manager [req-182695df-1def-4473-baee-fd27650245f6 req-e22786f3-5351-4584-bb98-95f9e2f6991a service nova] [instance: f49b5daf-d39d-496f-97d7-a0d9fd67d66d] Refreshing instance network info cache due to event network-changed-409cb778-13bd-425b-bb7b-90643706b023. {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 15:41:35 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-182695df-1def-4473-baee-fd27650245f6 req-e22786f3-5351-4584-bb98-95f9e2f6991a service nova] Acquiring lock "refresh_cache-f49b5daf-d39d-496f-97d7-a0d9fd67d66d" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 15:41:35 user nova-compute[72382]: DEBUG nova.network.neutron [None req-c9d067e6-bb5e-4fe4-b919-6218383c6b88 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: f49b5daf-d39d-496f-97d7-a0d9fd67d66d] Instance cache missing network info. {{(pid=72382) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 15:41:35 user nova-compute[72382]: DEBUG nova.network.neutron [None req-c9d067e6-bb5e-4fe4-b919-6218383c6b88 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: f49b5daf-d39d-496f-97d7-a0d9fd67d66d] Updating instance_info_cache with network_info: [{"id": "409cb778-13bd-425b-bb7b-90643706b023", "address": "fa:16:3e:f1:a9:bc", "network": {"id": "a78e6cb6-feb7-4f64-a3c0-4900594b6e37", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-338007968-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70310b1af40b4d239fe5ea362972554b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap409cb778-13", "ovs_interfaceid": "409cb778-13bd-425b-bb7b-90643706b023", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:41:35 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-c9d067e6-bb5e-4fe4-b919-6218383c6b88 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Releasing lock "refresh_cache-f49b5daf-d39d-496f-97d7-a0d9fd67d66d" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 15:41:35 user nova-compute[72382]: DEBUG nova.compute.manager [None req-c9d067e6-bb5e-4fe4-b919-6218383c6b88 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: f49b5daf-d39d-496f-97d7-a0d9fd67d66d] Instance network_info: |[{"id": "409cb778-13bd-425b-bb7b-90643706b023", "address": "fa:16:3e:f1:a9:bc", "network": {"id": "a78e6cb6-feb7-4f64-a3c0-4900594b6e37", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-338007968-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70310b1af40b4d239fe5ea362972554b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap409cb778-13", "ovs_interfaceid": "409cb778-13bd-425b-bb7b-90643706b023", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72382) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 15:41:35 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-182695df-1def-4473-baee-fd27650245f6 req-e22786f3-5351-4584-bb98-95f9e2f6991a service nova] Acquired lock "refresh_cache-f49b5daf-d39d-496f-97d7-a0d9fd67d66d" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 15:41:35 user nova-compute[72382]: DEBUG nova.network.neutron [req-182695df-1def-4473-baee-fd27650245f6 req-e22786f3-5351-4584-bb98-95f9e2f6991a service nova] [instance: f49b5daf-d39d-496f-97d7-a0d9fd67d66d] Refreshing network info cache for port 409cb778-13bd-425b-bb7b-90643706b023 {{(pid=72382) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 15:41:35 user nova-compute[72382]: DEBUG nova.network.neutron [req-182695df-1def-4473-baee-fd27650245f6 req-e22786f3-5351-4584-bb98-95f9e2f6991a service nova] [instance: f49b5daf-d39d-496f-97d7-a0d9fd67d66d] Updated VIF entry in instance network info cache for port 409cb778-13bd-425b-bb7b-90643706b023. {{(pid=72382) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 15:41:35 user nova-compute[72382]: DEBUG nova.network.neutron [req-182695df-1def-4473-baee-fd27650245f6 req-e22786f3-5351-4584-bb98-95f9e2f6991a service nova] [instance: f49b5daf-d39d-496f-97d7-a0d9fd67d66d] Updating instance_info_cache with network_info: [{"id": "409cb778-13bd-425b-bb7b-90643706b023", "address": "fa:16:3e:f1:a9:bc", "network": {"id": "a78e6cb6-feb7-4f64-a3c0-4900594b6e37", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-338007968-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70310b1af40b4d239fe5ea362972554b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap409cb778-13", "ovs_interfaceid": "409cb778-13bd-425b-bb7b-90643706b023", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:41:35 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:41:35 user nova-compute[72382]: DEBUG nova.compute.manager [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Cleaning up deleted instances with incomplete migration  {{(pid=72382) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 09 15:41:35 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-182695df-1def-4473-baee-fd27650245f6 req-e22786f3-5351-4584-bb98-95f9e2f6991a service nova] Releasing lock "refresh_cache-f49b5daf-d39d-496f-97d7-a0d9fd67d66d" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 15:41:39 user nova-compute[72382]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691595684.931193, b0da60bf-7468-4041-8016-54e3d82386b7 => Stopped> {{(pid=72382) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 15:41:39 user nova-compute[72382]: INFO nova.compute.manager [-] [instance: b0da60bf-7468-4041-8016-54e3d82386b7] VM Stopped (Lifecycle Event)
Aug 09 15:41:39 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:41:39 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:41:39 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72382) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 15:41:39 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72382) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 15:41:39 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72382) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 15:41:39 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:41:39 user nova-compute[72382]: DEBUG nova.compute.manager [None req-ce42bbdd-6c2f-4a5f-9379-96d18f8b6bde None None] [instance: b0da60bf-7468-4041-8016-54e3d82386b7] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:41:43 user nova-compute[72382]: DEBUG nova.compute.manager [None req-c9d067e6-bb5e-4fe4-b919-6218383c6b88 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: f49b5daf-d39d-496f-97d7-a0d9fd67d66d] Start spawning the instance on the hypervisor. {{(pid=72382) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 15:41:43 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-c9d067e6-bb5e-4fe4-b919-6218383c6b88 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: f49b5daf-d39d-496f-97d7-a0d9fd67d66d] Creating instance directory {{(pid=72382) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 15:41:43 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-c9d067e6-bb5e-4fe4-b919-6218383c6b88 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: f49b5daf-d39d-496f-97d7-a0d9fd67d66d] Creating image(s)
Aug 09 15:41:43 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-c9d067e6-bb5e-4fe4-b919-6218383c6b88 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: f49b5daf-d39d-496f-97d7-a0d9fd67d66d] Did not create local disks {{(pid=72382) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 09 15:41:43 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-c9d067e6-bb5e-4fe4-b919-6218383c6b88 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: f49b5daf-d39d-496f-97d7-a0d9fd67d66d] Ensure instance console log exists: /opt/stack/data/nova/instances/f49b5daf-d39d-496f-97d7-a0d9fd67d66d/console.log {{(pid=72382) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 15:41:43 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-c9d067e6-bb5e-4fe4-b919-6218383c6b88 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:41:43 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-c9d067e6-bb5e-4fe4-b919-6218383c6b88 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:41:43 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-c9d067e6-bb5e-4fe4-b919-6218383c6b88 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:41:43 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-c9d067e6-bb5e-4fe4-b919-6218383c6b88 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: f49b5daf-d39d-496f-97d7-a0d9fd67d66d] Start _get_guest_xml network_info=[{"id": "409cb778-13bd-425b-bb7b-90643706b023", "address": "fa:16:3e:f1:a9:bc", "network": {"id": "a78e6cb6-feb7-4f64-a3c0-4900594b6e37", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-338007968-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70310b1af40b4d239fe5ea362972554b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap409cb778-13", "ovs_interfaceid": "409cb778-13bd-425b-bb7b-90643706b023", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:38d0b588-2e6f-4ebb-84a1-8a928e923cd7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zTeQNpsu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'f49b5daf-d39d-496f-97d7-a0d9fd67d66d', 'attached_at': '', 'detached_at': '', 'volume_id': '38d0b588-2e6f-4ebb-84a1-8a928e923cd7', 'serial': '38d0b588-2e6f-4ebb-84a1-8a928e923cd7'}, 'disk_bus': 'virtio', 'attachment_id': 'a07a5f5f-baf5-46f3-9a07-e4faf529d8bf', 'delete_on_termination': False, 'volume_type': None} {{(pid=72382) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 15:41:43 user nova-compute[72382]: WARNING nova.virt.libvirt.driver [None req-c9d067e6-bb5e-4fe4-b919-6218383c6b88 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 15:41:43 user nova-compute[72382]: WARNING nova.virt.libvirt.driver [None req-c9d067e6-bb5e-4fe4-b919-6218383c6b88 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 15:41:43 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-c9d067e6-bb5e-4fe4-b919-6218383c6b88 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72382) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 15:41:43 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-c9d067e6-bb5e-4fe4-b919-6218383c6b88 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] CPU controller missing on host. {{(pid=72382) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 15:41:43 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-c9d067e6-bb5e-4fe4-b919-6218383c6b88 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72382) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 15:41:43 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-c9d067e6-bb5e-4fe4-b919-6218383c6b88 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] CPU controller found on host. {{(pid=72382) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 15:41:43 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-c9d067e6-bb5e-4fe4-b919-6218383c6b88 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72382) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 15:41:43 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-c9d067e6-bb5e-4fe4-b919-6218383c6b88 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T15:11:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 15:41:43 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-c9d067e6-bb5e-4fe4-b919-6218383c6b88 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Flavor limits 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 15:41:43 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-c9d067e6-bb5e-4fe4-b919-6218383c6b88 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Image limits 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 15:41:43 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-c9d067e6-bb5e-4fe4-b919-6218383c6b88 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Flavor pref 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 15:41:43 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-c9d067e6-bb5e-4fe4-b919-6218383c6b88 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Image pref 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 15:41:43 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-c9d067e6-bb5e-4fe4-b919-6218383c6b88 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 15:41:43 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-c9d067e6-bb5e-4fe4-b919-6218383c6b88 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 15:41:43 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-c9d067e6-bb5e-4fe4-b919-6218383c6b88 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72382) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 15:41:43 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-c9d067e6-bb5e-4fe4-b919-6218383c6b88 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Got 1 possible topologies {{(pid=72382) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 15:41:43 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-c9d067e6-bb5e-4fe4-b919-6218383c6b88 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 15:41:43 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-c9d067e6-bb5e-4fe4-b919-6218383c6b88 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 15:41:43 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c9d067e6-bb5e-4fe4-b919-6218383c6b88 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: f49b5daf-d39d-496f-97d7-a0d9fd67d66d] Calling os-brick to attach iSCSI Volume {{(pid=72382) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 15:41:43 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9d067e6-bb5e-4fe4-b919-6218383c6b88 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2a0c768340>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:38d0b588-2e6f-4ebb-84a1-8a928e923cd7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zTeQNpsu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 15:41:43 user nova-compute[72382]: WARNING os_brick.initiator.connectors.base [None req-c9d067e6-bb5e-4fe4-b919-6218383c6b88 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 15:41:43 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-c9d067e6-bb5e-4fe4-b919-6218383c6b88 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 15:41:43 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-c9d067e6-bb5e-4fe4-b919-6218383c6b88 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 15:41:43 user nova-compute[72382]: WARNING os_brick.initiator.connectors.base [None req-c9d067e6-bb5e-4fe4-b919-6218383c6b88 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 15:41:43 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-c9d067e6-bb5e-4fe4-b919-6218383c6b88 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:38d0b588-2e6f-4ebb-84a1-8a928e923cd7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 15:41:43 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-c9d067e6-bb5e-4fe4-b919-6218383c6b88 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:38d0b588-2e6f-4ebb-84a1-8a928e923cd7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 15:41:43 user nova-compute[72382]: INFO os_brick.initiator.connectors.iscsi [None req-c9d067e6-bb5e-4fe4-b919-6218383c6b88 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 15:41:43 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38d0b588-2e6f-4ebb-84a1-8a928e923cd7 -p 172.16.0.220:3260 {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:41:43 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38d0b588-2e6f-4ebb-84a1-8a928e923cd7 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:41:43 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4921891-08df-4918-a25f-1ca78090d7a0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:41:43 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9d067e6-bb5e-4fe4-b919-6218383c6b88 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 15:41:43 user nova-compute[72382]:  {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:41:43 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38d0b588-2e6f-4ebb-84a1-8a928e923cd7 -p 172.16.0.220:3260 --interface default --op new {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:41:43 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38d0b588-2e6f-4ebb-84a1-8a928e923cd7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:41:43 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c872021-9a00-41d7-88ad-a3fd82e5910e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:38d0b588-2e6f-4ebb-84a1-8a928e923cd7] added\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:41:43 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9d067e6-bb5e-4fe4-b919-6218383c6b88 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:38d0b588-2e6f-4ebb-84a1-8a928e923cd7] added
Aug 09 15:41:43 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:41:43 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38d0b588-2e6f-4ebb-84a1-8a928e923cd7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:41:43 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38d0b588-2e6f-4ebb-84a1-8a928e923cd7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:41:43 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[606126ff-90fd-44bf-a55a-0b86bdefbe5e]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:41:43 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9d067e6-bb5e-4fe4-b919-6218383c6b88 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:41:43 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38d0b588-2e6f-4ebb-84a1-8a928e923cd7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:41:43 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38d0b588-2e6f-4ebb-84a1-8a928e923cd7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:41:43 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8b57c62-66ad-4caf-8d02-5bdb58b7ec3c]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:41:43 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9d067e6-bb5e-4fe4-b919-6218383c6b88 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:41:43 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38d0b588-2e6f-4ebb-84a1-8a928e923cd7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zTeQNpsu {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:41:43 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38d0b588-2e6f-4ebb-84a1-8a928e923cd7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zTeQNpsu" returned: 0 in 0.023s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:41:43 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[23047d18-87d8-4343-b867-775a30d97223]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:41:43 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9d067e6-bb5e-4fe4-b919-6218383c6b88 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zTeQNpsu'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:41:43 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38d0b588-2e6f-4ebb-84a1-8a928e923cd7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:41:43 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38d0b588-2e6f-4ebb-84a1-8a928e923cd7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:41:43 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a13b3df-2498-456a-9d8a-f29a7ed4f1ad]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:41:43 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9d067e6-bb5e-4fe4-b919-6218383c6b88 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:41:43 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:41:43 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:41:43 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7320b6c-80b2-423f-a66a-358e9623b738]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0a612d6-0f3f-4d2c-9fb5-aff9384338de (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f58579c-f69a-4bee-b16e-970e5a8f590c (non-flash)\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:41:43 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9d067e6-bb5e-4fe4-b919-6218383c6b88 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0a612d6-0f3f-4d2c-9fb5-aff9384338de (non-flash)
Aug 09 15:41:43 user nova-compute[72382]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f58579c-f69a-4bee-b16e-970e5a8f590c (non-flash)
Aug 09 15:41:43 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 15:41:43 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9d067e6-bb5e-4fe4-b919-6218383c6b88 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0a612d6-0f3f-4d2c-9fb5-aff9384338de (non-flash)
Aug 09 15:41:43 user nova-compute[72382]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f58579c-f69a-4bee-b16e-970e5a8f590c (non-flash)
Aug 09 15:41:43 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 15:41:43 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38d0b588-2e6f-4ebb-84a1-8a928e923cd7 -p 172.16.0.220:3260 --login {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:41:43 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38d0b588-2e6f-4ebb-84a1-8a928e923cd7 -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:41:43 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9c32da3-63df-4f23-ad1c-49999a55b238]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:38d0b588-2e6f-4ebb-84a1-8a928e923cd7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:38d0b588-2e6f-4ebb-84a1-8a928e923cd7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:41:43 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9d067e6-bb5e-4fe4-b919-6218383c6b88 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:38d0b588-2e6f-4ebb-84a1-8a928e923cd7, portal: 172.16.0.220,3260]
Aug 09 15:41:43 user nova-compute[72382]: Login to [iface: default, target: iqn.2010-10.org.openstack:38d0b588-2e6f-4ebb-84a1-8a928e923cd7, portal: 172.16.0.220,3260] successful.
Aug 09 15:41:43 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:41:43 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38d0b588-2e6f-4ebb-84a1-8a928e923cd7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:41:43 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38d0b588-2e6f-4ebb-84a1-8a928e923cd7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:41:43 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dc4888c-ec30-4921-93e4-03462176dc8b]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:41:43 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9d067e6-bb5e-4fe4-b919-6218383c6b88 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:41:43 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:41:43 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:41:43 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bb0858c-759d-460b-bcf2-dd422621f863]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0a612d6-0f3f-4d2c-9fb5-aff9384338de (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f58579c-f69a-4bee-b16e-970e5a8f590c (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38d0b588-2e6f-4ebb-84a1-8a928e923cd7 (non-flash)\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:41:43 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9d067e6-bb5e-4fe4-b919-6218383c6b88 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0a612d6-0f3f-4d2c-9fb5-aff9384338de (non-flash)
Aug 09 15:41:43 user nova-compute[72382]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f58579c-f69a-4bee-b16e-970e5a8f590c (non-flash)
Aug 09 15:41:43 user nova-compute[72382]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38d0b588-2e6f-4ebb-84a1-8a928e923cd7 (non-flash)
Aug 09 15:41:43 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 15:41:43 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9d067e6-bb5e-4fe4-b919-6218383c6b88 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0a612d6-0f3f-4d2c-9fb5-aff9384338de (non-flash)
Aug 09 15:41:43 user nova-compute[72382]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f58579c-f69a-4bee-b16e-970e5a8f590c (non-flash)
Aug 09 15:41:43 user nova-compute[72382]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38d0b588-2e6f-4ebb-84a1-8a928e923cd7 (non-flash)
Aug 09 15:41:43 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 15:41:43 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-c9d067e6-bb5e-4fe4-b919-6218383c6b88 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:38d0b588-2e6f-4ebb-84a1-8a928e923cd7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.332s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 15:41:43 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9d067e6-bb5e-4fe4-b919-6218383c6b88 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Connected to 172.16.0.220:3260 {{(pid=72382) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 15:41:43 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-c9d067e6-bb5e-4fe4-b919-6218383c6b88 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] HCTL ('35', '-', '-', 0) found on session 56 with lun 0 {{(pid=72382) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 15:41:43 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-c9d067e6-bb5e-4fe4-b919-6218383c6b88 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72382) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 15:41:43 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:41:43 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:41:43 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a429d95-5a06-4206-b12b-527e43ff0a16]: (4, ('- - 0', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:41:43 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-c9d067e6-bb5e-4fe4-b919-6218383c6b88 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Searching for a device in session 56 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72382) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 15:41:43 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9d067e6-bb5e-4fe4-b919-6218383c6b88 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zTeQNpsu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72382) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 15:41:43 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:41:44 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-c9d067e6-bb5e-4fe4-b919-6218383c6b88 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.371s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 15:41:44 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9d067e6-bb5e-4fe4-b919-6218383c6b88 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] <== connect_volume: return (1372ms) {'type': 'block', 'scsi_wwn': '26135623035643237', 'path': '/dev/sdd'} {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 15:41:44 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c9d067e6-bb5e-4fe4-b919-6218383c6b88 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: f49b5daf-d39d-496f-97d7-a0d9fd67d66d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26135623035643237', 'path': '/dev/sdd'} {{(pid=72382) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 15:41:44 user nova-compute[72382]: DEBUG nova.virt.libvirt.vif [None req-c9d067e6-bb5e-4fe4-b919-6218383c6b88 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T15:41:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1980844139',display_name='tempest-TestVolumeBootPattern-server-1980844139',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1980844139',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE2Ft4ugcR+xm9FJQARVlCQBYm313gUcmopkZOKz9jwU+uIeLmDWZczJQzSvB2hHfGE3d6cxNwerl6nmxRdqMq6zUG8hCLpv56gJB1tj7Wzv5bBbh5m7r3DF8/P9Gg51AA==',key_name='tempest-TestVolumeBootPattern-1990844198',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='70310b1af40b4d239fe5ea362972554b',ramdisk_id='',reservation_id='r-ynegf0et',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-451643589',owner_user_name='tempest-TestVolumeBootPattern-451643589-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T15:41:33Z,user_data=None,user_id='280bcf2afd7245a7bcd605e0db79c569',uuid=f49b5daf-d39d-496f-97d7-a0d9fd67d66d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "409cb778-13bd-425b-bb7b-90643706b023", "address": "fa:16:3e:f1:a9:bc", "network": {"id": "a78e6cb6-feb7-4f64-a3c0-4900594b6e37", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-338007968-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70310b1af40b4d239fe5ea362972554b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap409cb778-13", "ovs_interfaceid": "409cb778-13bd-425b-bb7b-90643706b023", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72382) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 15:41:44 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-c9d067e6-bb5e-4fe4-b919-6218383c6b88 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Converting VIF {"id": "409cb778-13bd-425b-bb7b-90643706b023", "address": "fa:16:3e:f1:a9:bc", "network": {"id": "a78e6cb6-feb7-4f64-a3c0-4900594b6e37", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-338007968-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70310b1af40b4d239fe5ea362972554b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap409cb778-13", "ovs_interfaceid": "409cb778-13bd-425b-bb7b-90643706b023", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 15:41:44 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-c9d067e6-bb5e-4fe4-b919-6218383c6b88 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f1:a9:bc,bridge_name='br-int',has_traffic_filtering=True,id=409cb778-13bd-425b-bb7b-90643706b023,network=Network(a78e6cb6-feb7-4f64-a3c0-4900594b6e37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap409cb778-13') {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 15:41:44 user nova-compute[72382]: DEBUG nova.objects.instance [None req-c9d067e6-bb5e-4fe4-b919-6218383c6b88 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Lazy-loading 'pci_devices' on Instance uuid f49b5daf-d39d-496f-97d7-a0d9fd67d66d {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:41:44 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-c9d067e6-bb5e-4fe4-b919-6218383c6b88 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: f49b5daf-d39d-496f-97d7-a0d9fd67d66d] End _get_guest_xml xml=<domain type="kvm">
Aug 09 15:41:44 user nova-compute[72382]:   <uuid>f49b5daf-d39d-496f-97d7-a0d9fd67d66d</uuid>
Aug 09 15:41:44 user nova-compute[72382]:   <name>instance-0000002f</name>
Aug 09 15:41:44 user nova-compute[72382]:   <memory>524288</memory>
Aug 09 15:41:44 user nova-compute[72382]:   <vcpu>1</vcpu>
Aug 09 15:41:44 user nova-compute[72382]:   <metadata>
Aug 09 15:41:44 user nova-compute[72382]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 15:41:44 user nova-compute[72382]:       <nova:package version="0.0.0"/>
Aug 09 15:41:44 user nova-compute[72382]:       <nova:name>tempest-TestVolumeBootPattern-server-1980844139</nova:name>
Aug 09 15:41:44 user nova-compute[72382]:       <nova:creationTime>2023-08-09 15:41:43</nova:creationTime>
Aug 09 15:41:44 user nova-compute[72382]:       <nova:flavor name="m1.tiny">
Aug 09 15:41:44 user nova-compute[72382]:         <nova:memory>512</nova:memory>
Aug 09 15:41:44 user nova-compute[72382]:         <nova:disk>1</nova:disk>
Aug 09 15:41:44 user nova-compute[72382]:         <nova:swap>0</nova:swap>
Aug 09 15:41:44 user nova-compute[72382]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 15:41:44 user nova-compute[72382]:         <nova:vcpus>1</nova:vcpus>
Aug 09 15:41:44 user nova-compute[72382]:       </nova:flavor>
Aug 09 15:41:44 user nova-compute[72382]:       <nova:owner>
Aug 09 15:41:44 user nova-compute[72382]:         <nova:user uuid="280bcf2afd7245a7bcd605e0db79c569">tempest-TestVolumeBootPattern-451643589-project-member</nova:user>
Aug 09 15:41:44 user nova-compute[72382]:         <nova:project uuid="70310b1af40b4d239fe5ea362972554b">tempest-TestVolumeBootPattern-451643589</nova:project>
Aug 09 15:41:44 user nova-compute[72382]:       </nova:owner>
Aug 09 15:41:44 user nova-compute[72382]:       <nova:ports>
Aug 09 15:41:44 user nova-compute[72382]:         <nova:port uuid="409cb778-13bd-425b-bb7b-90643706b023">
Aug 09 15:41:44 user nova-compute[72382]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 09 15:41:44 user nova-compute[72382]:         </nova:port>
Aug 09 15:41:44 user nova-compute[72382]:       </nova:ports>
Aug 09 15:41:44 user nova-compute[72382]:     </nova:instance>
Aug 09 15:41:44 user nova-compute[72382]:   </metadata>
Aug 09 15:41:44 user nova-compute[72382]:   <sysinfo type="smbios">
Aug 09 15:41:44 user nova-compute[72382]:     <system>
Aug 09 15:41:44 user nova-compute[72382]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 15:41:44 user nova-compute[72382]:       <entry name="product">OpenStack Nova</entry>
Aug 09 15:41:44 user nova-compute[72382]:       <entry name="version">0.0.0</entry>
Aug 09 15:41:44 user nova-compute[72382]:       <entry name="serial">f49b5daf-d39d-496f-97d7-a0d9fd67d66d</entry>
Aug 09 15:41:44 user nova-compute[72382]:       <entry name="uuid">f49b5daf-d39d-496f-97d7-a0d9fd67d66d</entry>
Aug 09 15:41:44 user nova-compute[72382]:       <entry name="family">Virtual Machine</entry>
Aug 09 15:41:44 user nova-compute[72382]:     </system>
Aug 09 15:41:44 user nova-compute[72382]:   </sysinfo>
Aug 09 15:41:44 user nova-compute[72382]:   <os>
Aug 09 15:41:44 user nova-compute[72382]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 15:41:44 user nova-compute[72382]:     <boot dev="hd"/>
Aug 09 15:41:44 user nova-compute[72382]:     <smbios mode="sysinfo"/>
Aug 09 15:41:44 user nova-compute[72382]:   </os>
Aug 09 15:41:44 user nova-compute[72382]:   <features>
Aug 09 15:41:44 user nova-compute[72382]:     <acpi/>
Aug 09 15:41:44 user nova-compute[72382]:     <apic/>
Aug 09 15:41:44 user nova-compute[72382]:     <vmcoreinfo/>
Aug 09 15:41:44 user nova-compute[72382]:   </features>
Aug 09 15:41:44 user nova-compute[72382]:   <clock offset="utc">
Aug 09 15:41:44 user nova-compute[72382]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 15:41:44 user nova-compute[72382]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 15:41:44 user nova-compute[72382]:     <timer name="hpet" present="no"/>
Aug 09 15:41:44 user nova-compute[72382]:   </clock>
Aug 09 15:41:44 user nova-compute[72382]:   <cpu mode="custom" match="exact">
Aug 09 15:41:44 user nova-compute[72382]:     <model>Nehalem</model>
Aug 09 15:41:44 user nova-compute[72382]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 15:41:44 user nova-compute[72382]:   </cpu>
Aug 09 15:41:44 user nova-compute[72382]:   <devices>
Aug 09 15:41:44 user nova-compute[72382]:     <disk type="block" device="disk">
Aug 09 15:41:44 user nova-compute[72382]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 15:41:44 user nova-compute[72382]:       <source dev="/dev/sdd"/>
Aug 09 15:41:44 user nova-compute[72382]:       <target dev="vda" bus="virtio"/>
Aug 09 15:41:44 user nova-compute[72382]:       <serial>38d0b588-2e6f-4ebb-84a1-8a928e923cd7</serial>
Aug 09 15:41:44 user nova-compute[72382]:     </disk>
Aug 09 15:41:44 user nova-compute[72382]:     <interface type="ethernet">
Aug 09 15:41:44 user nova-compute[72382]:       <mac address="fa:16:3e:f1:a9:bc"/>
Aug 09 15:41:44 user nova-compute[72382]:       <model type="virtio"/>
Aug 09 15:41:44 user nova-compute[72382]:       <mtu size="1442"/>
Aug 09 15:41:44 user nova-compute[72382]:       <target dev="tap409cb778-13"/>
Aug 09 15:41:44 user nova-compute[72382]:     </interface>
Aug 09 15:41:44 user nova-compute[72382]:     <serial type="pty">
Aug 09 15:41:44 user nova-compute[72382]:       <log file="/opt/stack/data/nova/instances/f49b5daf-d39d-496f-97d7-a0d9fd67d66d/console.log" append="off"/>
Aug 09 15:41:44 user nova-compute[72382]:     </serial>
Aug 09 15:41:44 user nova-compute[72382]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 15:41:44 user nova-compute[72382]:     <video>
Aug 09 15:41:44 user nova-compute[72382]:       <model type="virtio"/>
Aug 09 15:41:44 user nova-compute[72382]:     </video>
Aug 09 15:41:44 user nova-compute[72382]:     <rng model="virtio">
Aug 09 15:41:44 user nova-compute[72382]:       <backend model="random">/dev/urandom</backend>
Aug 09 15:41:44 user nova-compute[72382]:     </rng>
Aug 09 15:41:44 user nova-compute[72382]:     <controller type="usb" index="0" model="none"/>
Aug 09 15:41:44 user nova-compute[72382]:     <memballoon model="virtio">
Aug 09 15:41:44 user nova-compute[72382]:       <stats period="10"/>
Aug 09 15:41:44 user nova-compute[72382]:     </memballoon>
Aug 09 15:41:44 user nova-compute[72382]:   </devices>
Aug 09 15:41:44 user nova-compute[72382]: </domain>
Aug 09 15:41:44 user nova-compute[72382]:  {{(pid=72382) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 15:41:44 user nova-compute[72382]: DEBUG nova.virt.libvirt.vif [None req-c9d067e6-bb5e-4fe4-b919-6218383c6b88 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T15:41:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1980844139',display_name='tempest-TestVolumeBootPattern-server-1980844139',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1980844139',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE2Ft4ugcR+xm9FJQARVlCQBYm313gUcmopkZOKz9jwU+uIeLmDWZczJQzSvB2hHfGE3d6cxNwerl6nmxRdqMq6zUG8hCLpv56gJB1tj7Wzv5bBbh5m7r3DF8/P9Gg51AA==',key_name='tempest-TestVolumeBootPattern-1990844198',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='70310b1af40b4d239fe5ea362972554b',ramdisk_id='',reservation_id='r-ynegf0et',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-451643589',owner_user_name='tempest-TestVolumeBootPattern-451643589-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T15:41:33Z,user_data=None,user_id='280bcf2afd7245a7bcd605e0db79c569',uuid=f49b5daf-d39d-496f-97d7-a0d9fd67d66d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "409cb778-13bd-425b-bb7b-90643706b023", "address": "fa:16:3e:f1:a9:bc", "network": {"id": "a78e6cb6-feb7-4f64-a3c0-4900594b6e37", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-338007968-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70310b1af40b4d239fe5ea362972554b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap409cb778-13", "ovs_interfaceid": "409cb778-13bd-425b-bb7b-90643706b023", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 15:41:44 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-c9d067e6-bb5e-4fe4-b919-6218383c6b88 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Converting VIF {"id": "409cb778-13bd-425b-bb7b-90643706b023", "address": "fa:16:3e:f1:a9:bc", "network": {"id": "a78e6cb6-feb7-4f64-a3c0-4900594b6e37", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-338007968-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70310b1af40b4d239fe5ea362972554b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap409cb778-13", "ovs_interfaceid": "409cb778-13bd-425b-bb7b-90643706b023", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 15:41:44 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-c9d067e6-bb5e-4fe4-b919-6218383c6b88 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f1:a9:bc,bridge_name='br-int',has_traffic_filtering=True,id=409cb778-13bd-425b-bb7b-90643706b023,network=Network(a78e6cb6-feb7-4f64-a3c0-4900594b6e37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap409cb778-13') {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 15:41:44 user nova-compute[72382]: DEBUG os_vif [None req-c9d067e6-bb5e-4fe4-b919-6218383c6b88 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:a9:bc,bridge_name='br-int',has_traffic_filtering=True,id=409cb778-13bd-425b-bb7b-90643706b023,network=Network(a78e6cb6-feb7-4f64-a3c0-4900594b6e37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap409cb778-13') {{(pid=72382) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 15:41:44 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:41:44 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:41:44 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 15:41:44 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:41:44 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap409cb778-13, may_exist=True, interface_attrs={}) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:41:44 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap409cb778-13, col_values=(('external_ids', {'iface-id': '409cb778-13bd-425b-bb7b-90643706b023', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f1:a9:bc', 'vm-uuid': 'f49b5daf-d39d-496f-97d7-a0d9fd67d66d'}),), if_exists=True) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:41:44 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:41:44 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:41:44 user nova-compute[72382]: INFO os_vif [None req-c9d067e6-bb5e-4fe4-b919-6218383c6b88 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:a9:bc,bridge_name='br-int',has_traffic_filtering=True,id=409cb778-13bd-425b-bb7b-90643706b023,network=Network(a78e6cb6-feb7-4f64-a3c0-4900594b6e37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap409cb778-13')
Aug 09 15:41:44 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-c9d067e6-bb5e-4fe4-b919-6218383c6b88 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] No BDM found with device name vda, not building metadata. {{(pid=72382) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 15:41:44 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-c9d067e6-bb5e-4fe4-b919-6218383c6b88 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] No VIF found with MAC fa:16:3e:f1:a9:bc, not building metadata {{(pid=72382) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 15:41:44 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:41:44 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:41:46 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:41:46 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:41:46 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:41:46 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:41:46 user nova-compute[72382]: DEBUG nova.compute.manager [req-5c223bc4-f914-4071-a7c5-f30e76ddffbf req-adb516a4-3ed7-4fcb-816e-b4f42b592914 service nova] [instance: f49b5daf-d39d-496f-97d7-a0d9fd67d66d] Received event network-vif-plugged-409cb778-13bd-425b-bb7b-90643706b023 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:41:46 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-5c223bc4-f914-4071-a7c5-f30e76ddffbf req-adb516a4-3ed7-4fcb-816e-b4f42b592914 service nova] Acquiring lock "f49b5daf-d39d-496f-97d7-a0d9fd67d66d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:41:46 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-5c223bc4-f914-4071-a7c5-f30e76ddffbf req-adb516a4-3ed7-4fcb-816e-b4f42b592914 service nova] Lock "f49b5daf-d39d-496f-97d7-a0d9fd67d66d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:41:46 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-5c223bc4-f914-4071-a7c5-f30e76ddffbf req-adb516a4-3ed7-4fcb-816e-b4f42b592914 service nova] Lock "f49b5daf-d39d-496f-97d7-a0d9fd67d66d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:41:46 user nova-compute[72382]: DEBUG nova.compute.manager [req-5c223bc4-f914-4071-a7c5-f30e76ddffbf req-adb516a4-3ed7-4fcb-816e-b4f42b592914 service nova] [instance: f49b5daf-d39d-496f-97d7-a0d9fd67d66d] No waiting events found dispatching network-vif-plugged-409cb778-13bd-425b-bb7b-90643706b023 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:41:46 user nova-compute[72382]: WARNING nova.compute.manager [req-5c223bc4-f914-4071-a7c5-f30e76ddffbf req-adb516a4-3ed7-4fcb-816e-b4f42b592914 service nova] [instance: f49b5daf-d39d-496f-97d7-a0d9fd67d66d] Received unexpected event network-vif-plugged-409cb778-13bd-425b-bb7b-90643706b023 for instance with vm_state building and task_state spawning.
Aug 09 15:41:47 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:41:48 user nova-compute[72382]: DEBUG nova.virt.driver [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Emitting event <LifecycleEvent: 1691595708.1999657, f49b5daf-d39d-496f-97d7-a0d9fd67d66d => Resumed> {{(pid=72382) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 15:41:48 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: f49b5daf-d39d-496f-97d7-a0d9fd67d66d] VM Resumed (Lifecycle Event)
Aug 09 15:41:48 user nova-compute[72382]: DEBUG nova.compute.manager [None req-c9d067e6-bb5e-4fe4-b919-6218383c6b88 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: f49b5daf-d39d-496f-97d7-a0d9fd67d66d] Instance event wait completed in 0 seconds for  {{(pid=72382) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 15:41:48 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-c9d067e6-bb5e-4fe4-b919-6218383c6b88 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: f49b5daf-d39d-496f-97d7-a0d9fd67d66d] Guest created on hypervisor {{(pid=72382) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 15:41:48 user nova-compute[72382]: INFO nova.virt.libvirt.driver [-] [instance: f49b5daf-d39d-496f-97d7-a0d9fd67d66d] Instance spawned successfully.
Aug 09 15:41:48 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-c9d067e6-bb5e-4fe4-b919-6218383c6b88 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: f49b5daf-d39d-496f-97d7-a0d9fd67d66d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 15:41:48 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: f49b5daf-d39d-496f-97d7-a0d9fd67d66d] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:41:48 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: f49b5daf-d39d-496f-97d7-a0d9fd67d66d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72382) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 15:41:48 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-c9d067e6-bb5e-4fe4-b919-6218383c6b88 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: f49b5daf-d39d-496f-97d7-a0d9fd67d66d] Found default for hw_cdrom_bus of ide {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:41:48 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-c9d067e6-bb5e-4fe4-b919-6218383c6b88 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: f49b5daf-d39d-496f-97d7-a0d9fd67d66d] Found default for hw_disk_bus of virtio {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:41:48 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-c9d067e6-bb5e-4fe4-b919-6218383c6b88 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: f49b5daf-d39d-496f-97d7-a0d9fd67d66d] Found default for hw_input_bus of None {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:41:48 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-c9d067e6-bb5e-4fe4-b919-6218383c6b88 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: f49b5daf-d39d-496f-97d7-a0d9fd67d66d] Found default for hw_pointer_model of None {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:41:48 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-c9d067e6-bb5e-4fe4-b919-6218383c6b88 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: f49b5daf-d39d-496f-97d7-a0d9fd67d66d] Found default for hw_video_model of virtio {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:41:48 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-c9d067e6-bb5e-4fe4-b919-6218383c6b88 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: f49b5daf-d39d-496f-97d7-a0d9fd67d66d] Found default for hw_vif_model of virtio {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:41:48 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: f49b5daf-d39d-496f-97d7-a0d9fd67d66d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 15:41:48 user nova-compute[72382]: DEBUG nova.virt.driver [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Emitting event <LifecycleEvent: 1691595708.2013707, f49b5daf-d39d-496f-97d7-a0d9fd67d66d => Started> {{(pid=72382) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 15:41:48 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: f49b5daf-d39d-496f-97d7-a0d9fd67d66d] VM Started (Lifecycle Event)
Aug 09 15:41:48 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: f49b5daf-d39d-496f-97d7-a0d9fd67d66d] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:41:48 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: f49b5daf-d39d-496f-97d7-a0d9fd67d66d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72382) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 15:41:48 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: f49b5daf-d39d-496f-97d7-a0d9fd67d66d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 15:41:48 user nova-compute[72382]: INFO nova.compute.manager [None req-c9d067e6-bb5e-4fe4-b919-6218383c6b88 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: f49b5daf-d39d-496f-97d7-a0d9fd67d66d] Took 5.10 seconds to spawn the instance on the hypervisor.
Aug 09 15:41:48 user nova-compute[72382]: DEBUG nova.compute.manager [None req-c9d067e6-bb5e-4fe4-b919-6218383c6b88 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: f49b5daf-d39d-496f-97d7-a0d9fd67d66d] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:41:48 user nova-compute[72382]: INFO nova.compute.manager [None req-c9d067e6-bb5e-4fe4-b919-6218383c6b88 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: f49b5daf-d39d-496f-97d7-a0d9fd67d66d] Took 15.61 seconds to build instance.
Aug 09 15:41:48 user nova-compute[72382]: DEBUG nova.compute.manager [req-f3a69d04-a84a-496e-bdff-3dd0cc6d2b1a req-1576a167-379a-43c7-bb6e-17d48d33c5d1 service nova] [instance: f49b5daf-d39d-496f-97d7-a0d9fd67d66d] Received event network-vif-plugged-409cb778-13bd-425b-bb7b-90643706b023 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:41:48 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-f3a69d04-a84a-496e-bdff-3dd0cc6d2b1a req-1576a167-379a-43c7-bb6e-17d48d33c5d1 service nova] Acquiring lock "f49b5daf-d39d-496f-97d7-a0d9fd67d66d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:41:48 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-f3a69d04-a84a-496e-bdff-3dd0cc6d2b1a req-1576a167-379a-43c7-bb6e-17d48d33c5d1 service nova] Lock "f49b5daf-d39d-496f-97d7-a0d9fd67d66d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:41:48 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-f3a69d04-a84a-496e-bdff-3dd0cc6d2b1a req-1576a167-379a-43c7-bb6e-17d48d33c5d1 service nova] Lock "f49b5daf-d39d-496f-97d7-a0d9fd67d66d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:41:48 user nova-compute[72382]: DEBUG nova.compute.manager [req-f3a69d04-a84a-496e-bdff-3dd0cc6d2b1a req-1576a167-379a-43c7-bb6e-17d48d33c5d1 service nova] [instance: f49b5daf-d39d-496f-97d7-a0d9fd67d66d] No waiting events found dispatching network-vif-plugged-409cb778-13bd-425b-bb7b-90643706b023 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:41:48 user nova-compute[72382]: WARNING nova.compute.manager [req-f3a69d04-a84a-496e-bdff-3dd0cc6d2b1a req-1576a167-379a-43c7-bb6e-17d48d33c5d1 service nova] [instance: f49b5daf-d39d-496f-97d7-a0d9fd67d66d] Received unexpected event network-vif-plugged-409cb778-13bd-425b-bb7b-90643706b023 for instance with vm_state active and task_state None.
Aug 09 15:41:48 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-c9d067e6-bb5e-4fe4-b919-6218383c6b88 tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Lock "f49b5daf-d39d-496f-97d7-a0d9fd67d66d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.952s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:41:49 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:41:49 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:41:49 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:41:50 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:41:52 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:41:54 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:41:54 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:41:54 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:41:57 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-86ec8d01-1a83-4f88-8982-020cc3452f30 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] Acquiring lock "4d27c5a4-9a88-423b-9c48-9224e8248f8c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:41:57 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-86ec8d01-1a83-4f88-8982-020cc3452f30 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] Lock "4d27c5a4-9a88-423b-9c48-9224e8248f8c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:41:57 user nova-compute[72382]: DEBUG nova.compute.manager [None req-86ec8d01-1a83-4f88-8982-020cc3452f30 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] [instance: 4d27c5a4-9a88-423b-9c48-9224e8248f8c] Starting instance... {{(pid=72382) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 15:41:57 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-86ec8d01-1a83-4f88-8982-020cc3452f30 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:41:57 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-86ec8d01-1a83-4f88-8982-020cc3452f30 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:41:57 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-86ec8d01-1a83-4f88-8982-020cc3452f30 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72382) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 15:41:57 user nova-compute[72382]: INFO nova.compute.claims [None req-86ec8d01-1a83-4f88-8982-020cc3452f30 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] [instance: 4d27c5a4-9a88-423b-9c48-9224e8248f8c] Claim successful on node user
Aug 09 15:41:57 user nova-compute[72382]: DEBUG nova.scheduler.client.report [None req-86ec8d01-1a83-4f88-8982-020cc3452f30 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] Refreshing inventories for resource provider 7b15b0e5-df4d-49db-833b-2855d21d10ae {{(pid=72382) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 09 15:41:57 user nova-compute[72382]: DEBUG nova.scheduler.client.report [None req-86ec8d01-1a83-4f88-8982-020cc3452f30 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] Updating ProviderTree inventory for provider 7b15b0e5-df4d-49db-833b-2855d21d10ae from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72382) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 09 15:41:57 user nova-compute[72382]: DEBUG nova.compute.provider_tree [None req-86ec8d01-1a83-4f88-8982-020cc3452f30 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] Updating inventory in ProviderTree for provider 7b15b0e5-df4d-49db-833b-2855d21d10ae with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72382) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 09 15:41:57 user nova-compute[72382]: DEBUG nova.scheduler.client.report [None req-86ec8d01-1a83-4f88-8982-020cc3452f30 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] Refreshing aggregate associations for resource provider 7b15b0e5-df4d-49db-833b-2855d21d10ae, aggregates: None {{(pid=72382) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 09 15:41:57 user nova-compute[72382]: DEBUG nova.scheduler.client.report [None req-86ec8d01-1a83-4f88-8982-020cc3452f30 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] Refreshing trait associations for resource provider 7b15b0e5-df4d-49db-833b-2855d21d10ae, traits: COMPUTE_DEVICE_TAGGING,COMPUTE_NODE,COMPUTE_VOLUME_EXTEND,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE42,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_MMX,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE2 {{(pid=72382) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 09 15:41:58 user nova-compute[72382]: DEBUG nova.compute.provider_tree [None req-86ec8d01-1a83-4f88-8982-020cc3452f30 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] Inventory has not changed in ProviderTree for provider: 7b15b0e5-df4d-49db-833b-2855d21d10ae {{(pid=72382) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 15:41:58 user nova-compute[72382]: DEBUG nova.scheduler.client.report [None req-86ec8d01-1a83-4f88-8982-020cc3452f30 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] Inventory has not changed for provider 7b15b0e5-df4d-49db-833b-2855d21d10ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72382) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 15:41:58 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-86ec8d01-1a83-4f88-8982-020cc3452f30 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.489s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:41:58 user nova-compute[72382]: DEBUG nova.compute.manager [None req-86ec8d01-1a83-4f88-8982-020cc3452f30 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] [instance: 4d27c5a4-9a88-423b-9c48-9224e8248f8c] Start building networks asynchronously for instance. {{(pid=72382) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 15:41:58 user nova-compute[72382]: DEBUG nova.compute.manager [None req-86ec8d01-1a83-4f88-8982-020cc3452f30 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] [instance: 4d27c5a4-9a88-423b-9c48-9224e8248f8c] Allocating IP information in the background. {{(pid=72382) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 15:41:58 user nova-compute[72382]: DEBUG nova.network.neutron [None req-86ec8d01-1a83-4f88-8982-020cc3452f30 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] [instance: 4d27c5a4-9a88-423b-9c48-9224e8248f8c] allocate_for_instance() {{(pid=72382) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 15:41:58 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-86ec8d01-1a83-4f88-8982-020cc3452f30 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] [instance: 4d27c5a4-9a88-423b-9c48-9224e8248f8c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 15:41:58 user nova-compute[72382]: DEBUG nova.compute.manager [None req-86ec8d01-1a83-4f88-8982-020cc3452f30 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] [instance: 4d27c5a4-9a88-423b-9c48-9224e8248f8c] Start building block device mappings for instance. {{(pid=72382) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 15:41:58 user nova-compute[72382]: DEBUG nova.policy [None req-86ec8d01-1a83-4f88-8982-020cc3452f30 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '273d16c265ae4868a371889eae528d02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826d26871fb474ba904e1550f9ee103', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72382) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 15:41:58 user nova-compute[72382]: DEBUG nova.compute.manager [None req-86ec8d01-1a83-4f88-8982-020cc3452f30 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] [instance: 4d27c5a4-9a88-423b-9c48-9224e8248f8c] Start spawning the instance on the hypervisor. {{(pid=72382) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 15:41:58 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-86ec8d01-1a83-4f88-8982-020cc3452f30 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] [instance: 4d27c5a4-9a88-423b-9c48-9224e8248f8c] Creating instance directory {{(pid=72382) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 15:41:58 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-86ec8d01-1a83-4f88-8982-020cc3452f30 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] [instance: 4d27c5a4-9a88-423b-9c48-9224e8248f8c] Creating image(s)
Aug 09 15:41:58 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-86ec8d01-1a83-4f88-8982-020cc3452f30 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] Acquiring lock "/opt/stack/data/nova/instances/4d27c5a4-9a88-423b-9c48-9224e8248f8c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:41:58 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-86ec8d01-1a83-4f88-8982-020cc3452f30 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] Lock "/opt/stack/data/nova/instances/4d27c5a4-9a88-423b-9c48-9224e8248f8c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:41:58 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-86ec8d01-1a83-4f88-8982-020cc3452f30 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] Lock "/opt/stack/data/nova/instances/4d27c5a4-9a88-423b-9c48-9224e8248f8c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:41:58 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-86ec8d01-1a83-4f88-8982-020cc3452f30 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:41:58 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-86ec8d01-1a83-4f88-8982-020cc3452f30 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b --force-share --output=json" returned: 0 in 0.141s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:41:58 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-86ec8d01-1a83-4f88-8982-020cc3452f30 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] Acquiring lock "383812ff437283e0191ed5b9ecc04c27f1162b0b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:41:58 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-86ec8d01-1a83-4f88-8982-020cc3452f30 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] Lock "383812ff437283e0191ed5b9ecc04c27f1162b0b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:41:58 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-86ec8d01-1a83-4f88-8982-020cc3452f30 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:41:58 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-86ec8d01-1a83-4f88-8982-020cc3452f30 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b --force-share --output=json" returned: 0 in 0.149s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:41:58 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-86ec8d01-1a83-4f88-8982-020cc3452f30 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b,backing_fmt=raw /opt/stack/data/nova/instances/4d27c5a4-9a88-423b-9c48-9224e8248f8c/disk 1073741824 {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:41:58 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-86ec8d01-1a83-4f88-8982-020cc3452f30 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b,backing_fmt=raw /opt/stack/data/nova/instances/4d27c5a4-9a88-423b-9c48-9224e8248f8c/disk 1073741824" returned: 0 in 0.050s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:41:58 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-86ec8d01-1a83-4f88-8982-020cc3452f30 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] Lock "383812ff437283e0191ed5b9ecc04c27f1162b0b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.205s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:41:58 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-86ec8d01-1a83-4f88-8982-020cc3452f30 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:41:58 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-86ec8d01-1a83-4f88-8982-020cc3452f30 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b --force-share --output=json" returned: 0 in 0.139s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:41:58 user nova-compute[72382]: DEBUG nova.virt.disk.api [None req-86ec8d01-1a83-4f88-8982-020cc3452f30 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4d27c5a4-9a88-423b-9c48-9224e8248f8c/disk. size=1073741824 {{(pid=72382) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 15:41:58 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-86ec8d01-1a83-4f88-8982-020cc3452f30 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d27c5a4-9a88-423b-9c48-9224e8248f8c/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:41:59 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-86ec8d01-1a83-4f88-8982-020cc3452f30 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d27c5a4-9a88-423b-9c48-9224e8248f8c/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:41:59 user nova-compute[72382]: DEBUG nova.virt.disk.api [None req-86ec8d01-1a83-4f88-8982-020cc3452f30 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] Cannot resize image /opt/stack/data/nova/instances/4d27c5a4-9a88-423b-9c48-9224e8248f8c/disk to a smaller size. {{(pid=72382) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 15:41:59 user nova-compute[72382]: DEBUG nova.objects.instance [None req-86ec8d01-1a83-4f88-8982-020cc3452f30 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] Lazy-loading 'migration_context' on Instance uuid 4d27c5a4-9a88-423b-9c48-9224e8248f8c {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:41:59 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-86ec8d01-1a83-4f88-8982-020cc3452f30 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] [instance: 4d27c5a4-9a88-423b-9c48-9224e8248f8c] Created local disks {{(pid=72382) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 15:41:59 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-86ec8d01-1a83-4f88-8982-020cc3452f30 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] [instance: 4d27c5a4-9a88-423b-9c48-9224e8248f8c] Ensure instance console log exists: /opt/stack/data/nova/instances/4d27c5a4-9a88-423b-9c48-9224e8248f8c/console.log {{(pid=72382) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 15:41:59 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-86ec8d01-1a83-4f88-8982-020cc3452f30 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:41:59 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-86ec8d01-1a83-4f88-8982-020cc3452f30 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:41:59 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-86ec8d01-1a83-4f88-8982-020cc3452f30 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:41:59 user nova-compute[72382]: DEBUG nova.network.neutron [None req-86ec8d01-1a83-4f88-8982-020cc3452f30 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] [instance: 4d27c5a4-9a88-423b-9c48-9224e8248f8c] Successfully created port: b14bc813-7a4e-413c-9b5f-4c34080790b6 {{(pid=72382) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 15:41:59 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:41:59 user nova-compute[72382]: DEBUG nova.network.neutron [None req-86ec8d01-1a83-4f88-8982-020cc3452f30 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] [instance: 4d27c5a4-9a88-423b-9c48-9224e8248f8c] Successfully updated port: b14bc813-7a4e-413c-9b5f-4c34080790b6 {{(pid=72382) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 15:41:59 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-86ec8d01-1a83-4f88-8982-020cc3452f30 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] Acquiring lock "refresh_cache-4d27c5a4-9a88-423b-9c48-9224e8248f8c" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 15:41:59 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-86ec8d01-1a83-4f88-8982-020cc3452f30 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] Acquired lock "refresh_cache-4d27c5a4-9a88-423b-9c48-9224e8248f8c" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 15:41:59 user nova-compute[72382]: DEBUG nova.network.neutron [None req-86ec8d01-1a83-4f88-8982-020cc3452f30 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] [instance: 4d27c5a4-9a88-423b-9c48-9224e8248f8c] Building network info cache for instance {{(pid=72382) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 15:41:59 user nova-compute[72382]: DEBUG nova.compute.manager [req-9ede01c7-e360-4df5-a646-48b86c126462 req-d0af3a25-61e5-4656-966c-c49f97b17f83 service nova] [instance: 4d27c5a4-9a88-423b-9c48-9224e8248f8c] Received event network-changed-b14bc813-7a4e-413c-9b5f-4c34080790b6 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:41:59 user nova-compute[72382]: DEBUG nova.compute.manager [req-9ede01c7-e360-4df5-a646-48b86c126462 req-d0af3a25-61e5-4656-966c-c49f97b17f83 service nova] [instance: 4d27c5a4-9a88-423b-9c48-9224e8248f8c] Refreshing instance network info cache due to event network-changed-b14bc813-7a4e-413c-9b5f-4c34080790b6. {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 15:41:59 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-9ede01c7-e360-4df5-a646-48b86c126462 req-d0af3a25-61e5-4656-966c-c49f97b17f83 service nova] Acquiring lock "refresh_cache-4d27c5a4-9a88-423b-9c48-9224e8248f8c" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 15:41:59 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:41:59 user nova-compute[72382]: DEBUG nova.network.neutron [None req-86ec8d01-1a83-4f88-8982-020cc3452f30 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] [instance: 4d27c5a4-9a88-423b-9c48-9224e8248f8c] Instance cache missing network info. {{(pid=72382) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 15:42:00 user nova-compute[72382]: DEBUG nova.network.neutron [None req-86ec8d01-1a83-4f88-8982-020cc3452f30 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] [instance: 4d27c5a4-9a88-423b-9c48-9224e8248f8c] Updating instance_info_cache with network_info: [{"id": "b14bc813-7a4e-413c-9b5f-4c34080790b6", "address": "fa:16:3e:a6:b1:fa", "network": {"id": "ca2010c6-c431-44c8-8742-22a4fcf15754", "bridge": "br-int", "label": "tempest-TestStampPattern-1529830938-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a826d26871fb474ba904e1550f9ee103", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb14bc813-7a", "ovs_interfaceid": "b14bc813-7a4e-413c-9b5f-4c34080790b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:42:00 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-86ec8d01-1a83-4f88-8982-020cc3452f30 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] Releasing lock "refresh_cache-4d27c5a4-9a88-423b-9c48-9224e8248f8c" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 15:42:00 user nova-compute[72382]: DEBUG nova.compute.manager [None req-86ec8d01-1a83-4f88-8982-020cc3452f30 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] [instance: 4d27c5a4-9a88-423b-9c48-9224e8248f8c] Instance network_info: |[{"id": "b14bc813-7a4e-413c-9b5f-4c34080790b6", "address": "fa:16:3e:a6:b1:fa", "network": {"id": "ca2010c6-c431-44c8-8742-22a4fcf15754", "bridge": "br-int", "label": "tempest-TestStampPattern-1529830938-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a826d26871fb474ba904e1550f9ee103", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb14bc813-7a", "ovs_interfaceid": "b14bc813-7a4e-413c-9b5f-4c34080790b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72382) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 15:42:00 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-9ede01c7-e360-4df5-a646-48b86c126462 req-d0af3a25-61e5-4656-966c-c49f97b17f83 service nova] Acquired lock "refresh_cache-4d27c5a4-9a88-423b-9c48-9224e8248f8c" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 15:42:00 user nova-compute[72382]: DEBUG nova.network.neutron [req-9ede01c7-e360-4df5-a646-48b86c126462 req-d0af3a25-61e5-4656-966c-c49f97b17f83 service nova] [instance: 4d27c5a4-9a88-423b-9c48-9224e8248f8c] Refreshing network info cache for port b14bc813-7a4e-413c-9b5f-4c34080790b6 {{(pid=72382) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 15:42:00 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-86ec8d01-1a83-4f88-8982-020cc3452f30 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] [instance: 4d27c5a4-9a88-423b-9c48-9224e8248f8c] Start _get_guest_xml network_info=[{"id": "b14bc813-7a4e-413c-9b5f-4c34080790b6", "address": "fa:16:3e:a6:b1:fa", "network": {"id": "ca2010c6-c431-44c8-8742-22a4fcf15754", "bridge": "br-int", "label": "tempest-TestStampPattern-1529830938-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a826d26871fb474ba904e1550f9ee103", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb14bc813-7a", "ovs_interfaceid": "b14bc813-7a4e-413c-9b5f-4c34080790b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T15:11:25Z,direct_url=<?>,disk_format='qcow2',id=a79f2cea-eb27-4631-aaf3-05e7d9e411b4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a638990e12cc4d6eabb6d55e13be6bdf',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T15:11:27Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'a79f2cea-eb27-4631-aaf3-05e7d9e411b4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72382) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 15:42:00 user nova-compute[72382]: WARNING nova.virt.libvirt.driver [None req-86ec8d01-1a83-4f88-8982-020cc3452f30 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 15:42:00 user nova-compute[72382]: WARNING nova.virt.libvirt.driver [None req-86ec8d01-1a83-4f88-8982-020cc3452f30 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 15:42:00 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-86ec8d01-1a83-4f88-8982-020cc3452f30 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72382) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 15:42:00 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-86ec8d01-1a83-4f88-8982-020cc3452f30 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] CPU controller missing on host. {{(pid=72382) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 15:42:00 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-86ec8d01-1a83-4f88-8982-020cc3452f30 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72382) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 15:42:00 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-86ec8d01-1a83-4f88-8982-020cc3452f30 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] CPU controller found on host. {{(pid=72382) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 15:42:00 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-86ec8d01-1a83-4f88-8982-020cc3452f30 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72382) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 15:42:00 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-86ec8d01-1a83-4f88-8982-020cc3452f30 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T15:11:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T15:11:25Z,direct_url=<?>,disk_format='qcow2',id=a79f2cea-eb27-4631-aaf3-05e7d9e411b4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a638990e12cc4d6eabb6d55e13be6bdf',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T15:11:27Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 15:42:00 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-86ec8d01-1a83-4f88-8982-020cc3452f30 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] Flavor limits 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 15:42:00 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-86ec8d01-1a83-4f88-8982-020cc3452f30 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] Image limits 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 15:42:00 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-86ec8d01-1a83-4f88-8982-020cc3452f30 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] Flavor pref 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 15:42:00 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-86ec8d01-1a83-4f88-8982-020cc3452f30 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] Image pref 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 15:42:00 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-86ec8d01-1a83-4f88-8982-020cc3452f30 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 15:42:00 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-86ec8d01-1a83-4f88-8982-020cc3452f30 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 15:42:00 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-86ec8d01-1a83-4f88-8982-020cc3452f30 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72382) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 15:42:00 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-86ec8d01-1a83-4f88-8982-020cc3452f30 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] Got 1 possible topologies {{(pid=72382) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 15:42:00 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-86ec8d01-1a83-4f88-8982-020cc3452f30 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 15:42:00 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-86ec8d01-1a83-4f88-8982-020cc3452f30 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 15:42:00 user nova-compute[72382]: DEBUG nova.virt.libvirt.vif [None req-86ec8d01-1a83-4f88-8982-020cc3452f30 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T15:41:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1127199979',display_name='tempest-TestStampPattern-server-1127199979',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1127199979',id=48,image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNjio106iFL2RPDY5bqMxL7i3075CQY3HKpCfye/tyKn/rCQ1aG3GTM2r91qUJoQ3mYw8uvX3PtnblDrXm52Mqz8hUv4zCfERch5RpCXfjm7fb1444d3HAmk/t6Po924mA==',key_name='tempest-TestStampPattern-1060048663',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a826d26871fb474ba904e1550f9ee103',ramdisk_id='',reservation_id='r-9l71hd2g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1111267616',owner_user_name='tempest-TestStampPattern-1111267616-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T15:41:58Z,user_data=None,user_id='273d16c265ae4868a371889eae528d02',uuid=4d27c5a4-9a88-423b-9c48-9224e8248f8c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b14bc813-7a4e-413c-9b5f-4c34080790b6", "address": "fa:16:3e:a6:b1:fa", "network": {"id": "ca2010c6-c431-44c8-8742-22a4fcf15754", "bridge": "br-int", "label": "tempest-TestStampPattern-1529830938-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a826d26871fb474ba904e1550f9ee103", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb14bc813-7a", "ovs_interfaceid": "b14bc813-7a4e-413c-9b5f-4c34080790b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72382) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 15:42:00 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-86ec8d01-1a83-4f88-8982-020cc3452f30 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] Converting VIF {"id": "b14bc813-7a4e-413c-9b5f-4c34080790b6", "address": "fa:16:3e:a6:b1:fa", "network": {"id": "ca2010c6-c431-44c8-8742-22a4fcf15754", "bridge": "br-int", "label": "tempest-TestStampPattern-1529830938-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a826d26871fb474ba904e1550f9ee103", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb14bc813-7a", "ovs_interfaceid": "b14bc813-7a4e-413c-9b5f-4c34080790b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 15:42:00 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-86ec8d01-1a83-4f88-8982-020cc3452f30 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a6:b1:fa,bridge_name='br-int',has_traffic_filtering=True,id=b14bc813-7a4e-413c-9b5f-4c34080790b6,network=Network(ca2010c6-c431-44c8-8742-22a4fcf15754),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb14bc813-7a') {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 15:42:00 user nova-compute[72382]: DEBUG nova.objects.instance [None req-86ec8d01-1a83-4f88-8982-020cc3452f30 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] Lazy-loading 'pci_devices' on Instance uuid 4d27c5a4-9a88-423b-9c48-9224e8248f8c {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:42:00 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-86ec8d01-1a83-4f88-8982-020cc3452f30 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] [instance: 4d27c5a4-9a88-423b-9c48-9224e8248f8c] End _get_guest_xml xml=<domain type="kvm">
Aug 09 15:42:00 user nova-compute[72382]:   <uuid>4d27c5a4-9a88-423b-9c48-9224e8248f8c</uuid>
Aug 09 15:42:00 user nova-compute[72382]:   <name>instance-00000030</name>
Aug 09 15:42:00 user nova-compute[72382]:   <memory>524288</memory>
Aug 09 15:42:00 user nova-compute[72382]:   <vcpu>1</vcpu>
Aug 09 15:42:00 user nova-compute[72382]:   <metadata>
Aug 09 15:42:00 user nova-compute[72382]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 15:42:00 user nova-compute[72382]:       <nova:package version="0.0.0"/>
Aug 09 15:42:00 user nova-compute[72382]:       <nova:name>tempest-TestStampPattern-server-1127199979</nova:name>
Aug 09 15:42:00 user nova-compute[72382]:       <nova:creationTime>2023-08-09 15:42:00</nova:creationTime>
Aug 09 15:42:00 user nova-compute[72382]:       <nova:flavor name="m1.tiny">
Aug 09 15:42:00 user nova-compute[72382]:         <nova:memory>512</nova:memory>
Aug 09 15:42:00 user nova-compute[72382]:         <nova:disk>1</nova:disk>
Aug 09 15:42:00 user nova-compute[72382]:         <nova:swap>0</nova:swap>
Aug 09 15:42:00 user nova-compute[72382]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 15:42:00 user nova-compute[72382]:         <nova:vcpus>1</nova:vcpus>
Aug 09 15:42:00 user nova-compute[72382]:       </nova:flavor>
Aug 09 15:42:00 user nova-compute[72382]:       <nova:owner>
Aug 09 15:42:00 user nova-compute[72382]:         <nova:user uuid="273d16c265ae4868a371889eae528d02">tempest-TestStampPattern-1111267616-project-member</nova:user>
Aug 09 15:42:00 user nova-compute[72382]:         <nova:project uuid="a826d26871fb474ba904e1550f9ee103">tempest-TestStampPattern-1111267616</nova:project>
Aug 09 15:42:00 user nova-compute[72382]:       </nova:owner>
Aug 09 15:42:00 user nova-compute[72382]:       <nova:root type="image" uuid="a79f2cea-eb27-4631-aaf3-05e7d9e411b4"/>
Aug 09 15:42:00 user nova-compute[72382]:       <nova:ports>
Aug 09 15:42:00 user nova-compute[72382]:         <nova:port uuid="b14bc813-7a4e-413c-9b5f-4c34080790b6">
Aug 09 15:42:00 user nova-compute[72382]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 09 15:42:00 user nova-compute[72382]:         </nova:port>
Aug 09 15:42:00 user nova-compute[72382]:       </nova:ports>
Aug 09 15:42:00 user nova-compute[72382]:     </nova:instance>
Aug 09 15:42:00 user nova-compute[72382]:   </metadata>
Aug 09 15:42:00 user nova-compute[72382]:   <sysinfo type="smbios">
Aug 09 15:42:00 user nova-compute[72382]:     <system>
Aug 09 15:42:00 user nova-compute[72382]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 15:42:00 user nova-compute[72382]:       <entry name="product">OpenStack Nova</entry>
Aug 09 15:42:00 user nova-compute[72382]:       <entry name="version">0.0.0</entry>
Aug 09 15:42:00 user nova-compute[72382]:       <entry name="serial">4d27c5a4-9a88-423b-9c48-9224e8248f8c</entry>
Aug 09 15:42:00 user nova-compute[72382]:       <entry name="uuid">4d27c5a4-9a88-423b-9c48-9224e8248f8c</entry>
Aug 09 15:42:00 user nova-compute[72382]:       <entry name="family">Virtual Machine</entry>
Aug 09 15:42:00 user nova-compute[72382]:     </system>
Aug 09 15:42:00 user nova-compute[72382]:   </sysinfo>
Aug 09 15:42:00 user nova-compute[72382]:   <os>
Aug 09 15:42:00 user nova-compute[72382]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 15:42:00 user nova-compute[72382]:     <boot dev="hd"/>
Aug 09 15:42:00 user nova-compute[72382]:     <smbios mode="sysinfo"/>
Aug 09 15:42:00 user nova-compute[72382]:   </os>
Aug 09 15:42:00 user nova-compute[72382]:   <features>
Aug 09 15:42:00 user nova-compute[72382]:     <acpi/>
Aug 09 15:42:00 user nova-compute[72382]:     <apic/>
Aug 09 15:42:00 user nova-compute[72382]:     <vmcoreinfo/>
Aug 09 15:42:00 user nova-compute[72382]:   </features>
Aug 09 15:42:00 user nova-compute[72382]:   <clock offset="utc">
Aug 09 15:42:00 user nova-compute[72382]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 15:42:00 user nova-compute[72382]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 15:42:00 user nova-compute[72382]:     <timer name="hpet" present="no"/>
Aug 09 15:42:00 user nova-compute[72382]:   </clock>
Aug 09 15:42:00 user nova-compute[72382]:   <cpu mode="custom" match="exact">
Aug 09 15:42:00 user nova-compute[72382]:     <model>Nehalem</model>
Aug 09 15:42:00 user nova-compute[72382]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 15:42:00 user nova-compute[72382]:   </cpu>
Aug 09 15:42:00 user nova-compute[72382]:   <devices>
Aug 09 15:42:00 user nova-compute[72382]:     <disk type="file" device="disk">
Aug 09 15:42:00 user nova-compute[72382]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 15:42:00 user nova-compute[72382]:       <source file="/opt/stack/data/nova/instances/4d27c5a4-9a88-423b-9c48-9224e8248f8c/disk"/>
Aug 09 15:42:00 user nova-compute[72382]:       <target dev="vda" bus="virtio"/>
Aug 09 15:42:00 user nova-compute[72382]:     </disk>
Aug 09 15:42:00 user nova-compute[72382]:     <interface type="ethernet">
Aug 09 15:42:00 user nova-compute[72382]:       <mac address="fa:16:3e:a6:b1:fa"/>
Aug 09 15:42:00 user nova-compute[72382]:       <model type="virtio"/>
Aug 09 15:42:00 user nova-compute[72382]:       <mtu size="1442"/>
Aug 09 15:42:00 user nova-compute[72382]:       <target dev="tapb14bc813-7a"/>
Aug 09 15:42:00 user nova-compute[72382]:     </interface>
Aug 09 15:42:00 user nova-compute[72382]:     <serial type="pty">
Aug 09 15:42:00 user nova-compute[72382]:       <log file="/opt/stack/data/nova/instances/4d27c5a4-9a88-423b-9c48-9224e8248f8c/console.log" append="off"/>
Aug 09 15:42:00 user nova-compute[72382]:     </serial>
Aug 09 15:42:00 user nova-compute[72382]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 15:42:00 user nova-compute[72382]:     <video>
Aug 09 15:42:00 user nova-compute[72382]:       <model type="virtio"/>
Aug 09 15:42:00 user nova-compute[72382]:     </video>
Aug 09 15:42:00 user nova-compute[72382]:     <rng model="virtio">
Aug 09 15:42:00 user nova-compute[72382]:       <backend model="random">/dev/urandom</backend>
Aug 09 15:42:00 user nova-compute[72382]:     </rng>
Aug 09 15:42:00 user nova-compute[72382]:     <controller type="usb" index="0" model="none"/>
Aug 09 15:42:00 user nova-compute[72382]:     <memballoon model="virtio">
Aug 09 15:42:00 user nova-compute[72382]:       <stats period="10"/>
Aug 09 15:42:00 user nova-compute[72382]:     </memballoon>
Aug 09 15:42:00 user nova-compute[72382]:   </devices>
Aug 09 15:42:00 user nova-compute[72382]: </domain>
Aug 09 15:42:00 user nova-compute[72382]:  {{(pid=72382) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 15:42:00 user nova-compute[72382]: DEBUG nova.virt.libvirt.vif [None req-86ec8d01-1a83-4f88-8982-020cc3452f30 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T15:41:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1127199979',display_name='tempest-TestStampPattern-server-1127199979',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1127199979',id=48,image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNjio106iFL2RPDY5bqMxL7i3075CQY3HKpCfye/tyKn/rCQ1aG3GTM2r91qUJoQ3mYw8uvX3PtnblDrXm52Mqz8hUv4zCfERch5RpCXfjm7fb1444d3HAmk/t6Po924mA==',key_name='tempest-TestStampPattern-1060048663',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a826d26871fb474ba904e1550f9ee103',ramdisk_id='',reservation_id='r-9l71hd2g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1111267616',owner_user_name='tempest-TestStampPattern-1111267616-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T15:41:58Z,user_data=None,user_id='273d16c265ae4868a371889eae528d02',uuid=4d27c5a4-9a88-423b-9c48-9224e8248f8c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b14bc813-7a4e-413c-9b5f-4c34080790b6", "address": "fa:16:3e:a6:b1:fa", "network": {"id": "ca2010c6-c431-44c8-8742-22a4fcf15754", "bridge": "br-int", "label": "tempest-TestStampPattern-1529830938-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a826d26871fb474ba904e1550f9ee103", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb14bc813-7a", "ovs_interfaceid": "b14bc813-7a4e-413c-9b5f-4c34080790b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 15:42:00 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-86ec8d01-1a83-4f88-8982-020cc3452f30 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] Converting VIF {"id": "b14bc813-7a4e-413c-9b5f-4c34080790b6", "address": "fa:16:3e:a6:b1:fa", "network": {"id": "ca2010c6-c431-44c8-8742-22a4fcf15754", "bridge": "br-int", "label": "tempest-TestStampPattern-1529830938-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a826d26871fb474ba904e1550f9ee103", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb14bc813-7a", "ovs_interfaceid": "b14bc813-7a4e-413c-9b5f-4c34080790b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 15:42:00 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-86ec8d01-1a83-4f88-8982-020cc3452f30 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a6:b1:fa,bridge_name='br-int',has_traffic_filtering=True,id=b14bc813-7a4e-413c-9b5f-4c34080790b6,network=Network(ca2010c6-c431-44c8-8742-22a4fcf15754),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb14bc813-7a') {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 15:42:00 user nova-compute[72382]: DEBUG os_vif [None req-86ec8d01-1a83-4f88-8982-020cc3452f30 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:b1:fa,bridge_name='br-int',has_traffic_filtering=True,id=b14bc813-7a4e-413c-9b5f-4c34080790b6,network=Network(ca2010c6-c431-44c8-8742-22a4fcf15754),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb14bc813-7a') {{(pid=72382) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 15:42:00 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:42:00 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:42:00 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 15:42:00 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:42:00 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb14bc813-7a, may_exist=True, interface_attrs={}) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:42:00 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb14bc813-7a, col_values=(('external_ids', {'iface-id': 'b14bc813-7a4e-413c-9b5f-4c34080790b6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a6:b1:fa', 'vm-uuid': '4d27c5a4-9a88-423b-9c48-9224e8248f8c'}),), if_exists=True) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:42:00 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:42:00 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:42:00 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:42:00 user nova-compute[72382]: INFO os_vif [None req-86ec8d01-1a83-4f88-8982-020cc3452f30 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:b1:fa,bridge_name='br-int',has_traffic_filtering=True,id=b14bc813-7a4e-413c-9b5f-4c34080790b6,network=Network(ca2010c6-c431-44c8-8742-22a4fcf15754),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb14bc813-7a')
Aug 09 15:42:00 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-86ec8d01-1a83-4f88-8982-020cc3452f30 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] No BDM found with device name vda, not building metadata. {{(pid=72382) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 15:42:00 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-86ec8d01-1a83-4f88-8982-020cc3452f30 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] No VIF found with MAC fa:16:3e:a6:b1:fa, not building metadata {{(pid=72382) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 15:42:00 user nova-compute[72382]: DEBUG nova.network.neutron [req-9ede01c7-e360-4df5-a646-48b86c126462 req-d0af3a25-61e5-4656-966c-c49f97b17f83 service nova] [instance: 4d27c5a4-9a88-423b-9c48-9224e8248f8c] Updated VIF entry in instance network info cache for port b14bc813-7a4e-413c-9b5f-4c34080790b6. {{(pid=72382) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 15:42:00 user nova-compute[72382]: DEBUG nova.network.neutron [req-9ede01c7-e360-4df5-a646-48b86c126462 req-d0af3a25-61e5-4656-966c-c49f97b17f83 service nova] [instance: 4d27c5a4-9a88-423b-9c48-9224e8248f8c] Updating instance_info_cache with network_info: [{"id": "b14bc813-7a4e-413c-9b5f-4c34080790b6", "address": "fa:16:3e:a6:b1:fa", "network": {"id": "ca2010c6-c431-44c8-8742-22a4fcf15754", "bridge": "br-int", "label": "tempest-TestStampPattern-1529830938-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a826d26871fb474ba904e1550f9ee103", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb14bc813-7a", "ovs_interfaceid": "b14bc813-7a4e-413c-9b5f-4c34080790b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:42:00 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-9ede01c7-e360-4df5-a646-48b86c126462 req-d0af3a25-61e5-4656-966c-c49f97b17f83 service nova] Releasing lock "refresh_cache-4d27c5a4-9a88-423b-9c48-9224e8248f8c" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 15:42:01 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:42:01 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:42:01 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:42:01 user nova-compute[72382]: DEBUG nova.compute.manager [req-c596bcb1-3e2b-4623-8b72-61d4643b5169 req-e9998a87-527b-4627-b7d8-281699809989 service nova] [instance: 4d27c5a4-9a88-423b-9c48-9224e8248f8c] Received event network-vif-plugged-b14bc813-7a4e-413c-9b5f-4c34080790b6 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:42:01 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-c596bcb1-3e2b-4623-8b72-61d4643b5169 req-e9998a87-527b-4627-b7d8-281699809989 service nova] Acquiring lock "4d27c5a4-9a88-423b-9c48-9224e8248f8c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:42:01 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-c596bcb1-3e2b-4623-8b72-61d4643b5169 req-e9998a87-527b-4627-b7d8-281699809989 service nova] Lock "4d27c5a4-9a88-423b-9c48-9224e8248f8c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:42:01 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-c596bcb1-3e2b-4623-8b72-61d4643b5169 req-e9998a87-527b-4627-b7d8-281699809989 service nova] Lock "4d27c5a4-9a88-423b-9c48-9224e8248f8c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:42:01 user nova-compute[72382]: DEBUG nova.compute.manager [req-c596bcb1-3e2b-4623-8b72-61d4643b5169 req-e9998a87-527b-4627-b7d8-281699809989 service nova] [instance: 4d27c5a4-9a88-423b-9c48-9224e8248f8c] No waiting events found dispatching network-vif-plugged-b14bc813-7a4e-413c-9b5f-4c34080790b6 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:42:01 user nova-compute[72382]: WARNING nova.compute.manager [req-c596bcb1-3e2b-4623-8b72-61d4643b5169 req-e9998a87-527b-4627-b7d8-281699809989 service nova] [instance: 4d27c5a4-9a88-423b-9c48-9224e8248f8c] Received unexpected event network-vif-plugged-b14bc813-7a4e-413c-9b5f-4c34080790b6 for instance with vm_state building and task_state spawning.
Aug 09 15:42:02 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-bb0f25c0-60e5-44d7-967d-a14846d8eb55 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Acquiring lock "54523d3e-bfae-4621-85cb-d6a7bc40abf5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:42:02 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-bb0f25c0-60e5-44d7-967d-a14846d8eb55 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Lock "54523d3e-bfae-4621-85cb-d6a7bc40abf5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:42:02 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-bb0f25c0-60e5-44d7-967d-a14846d8eb55 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Acquiring lock "54523d3e-bfae-4621-85cb-d6a7bc40abf5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:42:02 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-bb0f25c0-60e5-44d7-967d-a14846d8eb55 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Lock "54523d3e-bfae-4621-85cb-d6a7bc40abf5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:42:02 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-bb0f25c0-60e5-44d7-967d-a14846d8eb55 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Lock "54523d3e-bfae-4621-85cb-d6a7bc40abf5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:42:02 user nova-compute[72382]: INFO nova.compute.manager [None req-bb0f25c0-60e5-44d7-967d-a14846d8eb55 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] [instance: 54523d3e-bfae-4621-85cb-d6a7bc40abf5] Terminating instance
Aug 09 15:42:02 user nova-compute[72382]: DEBUG nova.compute.manager [None req-bb0f25c0-60e5-44d7-967d-a14846d8eb55 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] [instance: 54523d3e-bfae-4621-85cb-d6a7bc40abf5] Start destroying the instance on the hypervisor. {{(pid=72382) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 15:42:02 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:42:02 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:42:02 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:42:02 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:42:02 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:42:02 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:42:02 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:42:02 user nova-compute[72382]: DEBUG nova.compute.manager [req-91eb2a46-9baa-4a09-8d9f-43c493feebca req-2539fc87-c91e-49fa-b818-db12eb96557a service nova] [instance: 54523d3e-bfae-4621-85cb-d6a7bc40abf5] Received event network-vif-unplugged-8557ab28-9722-4e6e-a14d-f941e3b693c8 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:42:02 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-91eb2a46-9baa-4a09-8d9f-43c493feebca req-2539fc87-c91e-49fa-b818-db12eb96557a service nova] Acquiring lock "54523d3e-bfae-4621-85cb-d6a7bc40abf5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:42:02 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-91eb2a46-9baa-4a09-8d9f-43c493feebca req-2539fc87-c91e-49fa-b818-db12eb96557a service nova] Lock "54523d3e-bfae-4621-85cb-d6a7bc40abf5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:42:02 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-91eb2a46-9baa-4a09-8d9f-43c493feebca req-2539fc87-c91e-49fa-b818-db12eb96557a service nova] Lock "54523d3e-bfae-4621-85cb-d6a7bc40abf5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:42:02 user nova-compute[72382]: DEBUG nova.compute.manager [req-91eb2a46-9baa-4a09-8d9f-43c493feebca req-2539fc87-c91e-49fa-b818-db12eb96557a service nova] [instance: 54523d3e-bfae-4621-85cb-d6a7bc40abf5] No waiting events found dispatching network-vif-unplugged-8557ab28-9722-4e6e-a14d-f941e3b693c8 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:42:02 user nova-compute[72382]: DEBUG nova.compute.manager [req-91eb2a46-9baa-4a09-8d9f-43c493feebca req-2539fc87-c91e-49fa-b818-db12eb96557a service nova] [instance: 54523d3e-bfae-4621-85cb-d6a7bc40abf5] Received event network-vif-unplugged-8557ab28-9722-4e6e-a14d-f941e3b693c8 for instance with task_state deleting. {{(pid=72382) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 15:42:02 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:42:02 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:42:02 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:42:02 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:42:02 user nova-compute[72382]: INFO nova.virt.libvirt.driver [-] [instance: 54523d3e-bfae-4621-85cb-d6a7bc40abf5] Instance destroyed successfully.
Aug 09 15:42:02 user nova-compute[72382]: DEBUG nova.objects.instance [None req-bb0f25c0-60e5-44d7-967d-a14846d8eb55 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Lazy-loading 'resources' on Instance uuid 54523d3e-bfae-4621-85cb-d6a7bc40abf5 {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:42:02 user nova-compute[72382]: DEBUG nova.virt.libvirt.vif [None req-bb0f25c0-60e5-44d7-967d-a14846d8eb55 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T15:35:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1481123959',display_name='tempest-ServerActionsTestOtherA-server-1481123959',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1481123959',id=39,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCmuVV1ynikE+pH75fjLIal2KFmSgV7eQmOTfU0+P2w2YCXfBWnAu9n1cQQTYYTDt/aP+JsGjkRdlSPqvnnG5WbnlJT+9aj9SfyqprOo87kqF8CD2U4mVDTvv+6ADzXJvQ==',key_name='tempest-keypair-568328368',keypairs=<?>,launch_index=0,launched_at=2023-08-09T15:37:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='eb5bf3f95d2843af94dbcab2af932bd1',ramdisk_id='',reservation_id='r-f5r16m9c',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1899577274',owner_user_name='tempest-ServerActionsTestOtherA-1899577274-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T15:39:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2cca9aef887b4b91a46ff4bd5cd32302',uuid=54523d3e-bfae-4621-85cb-d6a7bc40abf5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8557ab28-9722-4e6e-a14d-f941e3b693c8", "address": "fa:16:3e:40:5f:a8", "network": {"id": "308641dc-cc18-41db-9baa-7cc880e594ad", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1932973397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb5bf3f95d2843af94dbcab2af932bd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8557ab28-97", "ovs_interfaceid": "8557ab28-9722-4e6e-a14d-f941e3b693c8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 15:42:02 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-bb0f25c0-60e5-44d7-967d-a14846d8eb55 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Converting VIF {"id": "8557ab28-9722-4e6e-a14d-f941e3b693c8", "address": "fa:16:3e:40:5f:a8", "network": {"id": "308641dc-cc18-41db-9baa-7cc880e594ad", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1932973397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb5bf3f95d2843af94dbcab2af932bd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8557ab28-97", "ovs_interfaceid": "8557ab28-9722-4e6e-a14d-f941e3b693c8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 15:42:02 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-bb0f25c0-60e5-44d7-967d-a14846d8eb55 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:40:5f:a8,bridge_name='br-int',has_traffic_filtering=True,id=8557ab28-9722-4e6e-a14d-f941e3b693c8,network=Network(308641dc-cc18-41db-9baa-7cc880e594ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8557ab28-97') {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 15:42:02 user nova-compute[72382]: DEBUG os_vif [None req-bb0f25c0-60e5-44d7-967d-a14846d8eb55 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:40:5f:a8,bridge_name='br-int',has_traffic_filtering=True,id=8557ab28-9722-4e6e-a14d-f941e3b693c8,network=Network(308641dc-cc18-41db-9baa-7cc880e594ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8557ab28-97') {{(pid=72382) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 15:42:02 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:42:02 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8557ab28-97, bridge=br-int, if_exists=True) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:42:02 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:42:02 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:42:02 user nova-compute[72382]: INFO os_vif [None req-bb0f25c0-60e5-44d7-967d-a14846d8eb55 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:40:5f:a8,bridge_name='br-int',has_traffic_filtering=True,id=8557ab28-9722-4e6e-a14d-f941e3b693c8,network=Network(308641dc-cc18-41db-9baa-7cc880e594ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8557ab28-97')
Aug 09 15:42:02 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bb0f25c0-60e5-44d7-967d-a14846d8eb55 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] [instance: 54523d3e-bfae-4621-85cb-d6a7bc40abf5] calling os-brick to detach iSCSI Volume {{(pid=72382) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 15:42:02 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb0f25c0-60e5-44d7-967d-a14846d8eb55 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2a0c768340>, {'target_iqns': ['iqn.2010-10.org.openstack:a0a612d6-0f3f-4d2c-9fb5-aff9384338de'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kCZuiYgU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 15:42:02 user nova-compute[72382]: WARNING os_brick.initiator.connectors.base [None req-bb0f25c0-60e5-44d7-967d-a14846d8eb55 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 15:42:02 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-bb0f25c0-60e5-44d7-967d-a14846d8eb55 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 15:42:02 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-bb0f25c0-60e5-44d7-967d-a14846d8eb55 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 15:42:02 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb0f25c0-60e5-44d7-967d-a14846d8eb55 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a0a612d6-0f3f-4d2c-9fb5-aff9384338de', 0)] {{(pid=72382) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 15:42:02 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:42:02 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:42:02 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[06484d3c-f9bc-4eb1-9a7a-087f11d2dc32]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:38d0b588-2e6f-4ebb-84a1-8a928e923cd7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3f58579c-f69a-4bee-b16e-970e5a8f590c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a0a612d6-0f3f-4d2c-9fb5-aff9384338de\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:42:02 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:42:03 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:42:03 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[71075b61-9fbd-4d57-ae04-d0a56331ca99]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0a612d6-0f3f-4d2c-9fb5-aff9384338de (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f58579c-f69a-4bee-b16e-970e5a8f590c (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38d0b588-2e6f-4ebb-84a1-8a928e923cd7 (non-flash)\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:42:03 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb0f25c0-60e5-44d7-967d-a14846d8eb55 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0a612d6-0f3f-4d2c-9fb5-aff9384338de (non-flash)
Aug 09 15:42:03 user nova-compute[72382]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f58579c-f69a-4bee-b16e-970e5a8f590c (non-flash)
Aug 09 15:42:03 user nova-compute[72382]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38d0b588-2e6f-4ebb-84a1-8a928e923cd7 (non-flash)
Aug 09 15:42:03 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 15:42:03 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb0f25c0-60e5-44d7-967d-a14846d8eb55 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0a612d6-0f3f-4d2c-9fb5-aff9384338de (non-flash)
Aug 09 15:42:03 user nova-compute[72382]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f58579c-f69a-4bee-b16e-970e5a8f590c (non-flash)
Aug 09 15:42:03 user nova-compute[72382]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38d0b588-2e6f-4ebb-84a1-8a928e923cd7 (non-flash)
Aug 09 15:42:03 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 15:42:03 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb0f25c0-60e5-44d7-967d-a14846d8eb55 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2a0c37a830>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a0a612d6-0f3f-4d2c-9fb5-aff9384338de'): ({'sdc'}, set())}) {{(pid=72382) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 15:42:03 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-bb0f25c0-60e5-44d7-967d-a14846d8eb55 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Removing single pathed devices sdc {{(pid=72382) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 15:42:03 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:42:03 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.028s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:42:03 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[3681baea-f511-47b2-b54e-f8be9959ccfb]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:42:03 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:42:03 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.026s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:42:03 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[e30e5d90-04d7-45de-810d-cb2df0c66a7d]: (4, ('ok\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:42:03 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-bb0f25c0-60e5-44d7-967d-a14846d8eb55 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Flushing IO for device /dev/sdc {{(pid=72382) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 15:42:03 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:42:03 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.025s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:42:03 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0283b2e-295f-4699-af44-65560a35f670]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:42:03 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-bb0f25c0-60e5-44d7-967d-a14846d8eb55 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72382) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 15:42:03 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:42:03 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.048s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:42:03 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaf254f3-0c64-4083-8fa8-ccecbc45a235]: (4, ('1', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:42:03 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-bb0f25c0-60e5-44d7-967d-a14846d8eb55 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72382) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 15:42:03 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-bb0f25c0-60e5-44d7-967d-a14846d8eb55 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] SCSI volumes sdc have been removed. {{(pid=72382) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 15:42:03 user nova-compute[72382]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO8d6caf7a-962c64ea10580b15', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_8d6caf7a', '/dev/disk/by-id/scsi-23936326336346561') {{(pid=83725) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Aug 09 15:42:03 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[db747450-86e9-4344-84a4-c6b3c938e0a3]: (4, None) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:42:03 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb0f25c0-60e5-44d7-967d-a14846d8eb55 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a0a612d6-0f3f-4d2c-9fb5-aff9384338de')] {{(pid=72382) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 15:42:03 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0a612d6-0f3f-4d2c-9fb5-aff9384338de -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:42:03 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0a612d6-0f3f-4d2c-9fb5-aff9384338de -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:42:03 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f5028c3-6a48-4849-a775-711b6f78fcac]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:42:03 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb0f25c0-60e5-44d7-967d-a14846d8eb55 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:42:03 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0a612d6-0f3f-4d2c-9fb5-aff9384338de -p 172.16.0.220:3260 --logout {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:42:03 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0a612d6-0f3f-4d2c-9fb5-aff9384338de -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:42:03 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[cefd506d-7a0a-49b8-9935-4d19861685cd]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:a0a612d6-0f3f-4d2c-9fb5-aff9384338de, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:a0a612d6-0f3f-4d2c-9fb5-aff9384338de, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:42:03 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb0f25c0-60e5-44d7-967d-a14846d8eb55 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:a0a612d6-0f3f-4d2c-9fb5-aff9384338de, portal: 172.16.0.220,3260]
Aug 09 15:42:03 user nova-compute[72382]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:a0a612d6-0f3f-4d2c-9fb5-aff9384338de, portal: 172.16.0.220,3260] successful.
Aug 09 15:42:03 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:42:03 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0a612d6-0f3f-4d2c-9fb5-aff9384338de -p 172.16.0.220:3260 --op delete {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:42:03 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0a612d6-0f3f-4d2c-9fb5-aff9384338de -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:42:03 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[8149ac9c-33d8-409e-b4ed-bbdca09d4feb]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:42:03 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb0f25c0-60e5-44d7-967d-a14846d8eb55 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:42:03 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-bb0f25c0-60e5-44d7-967d-a14846d8eb55 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.333s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 15:42:03 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb0f25c0-60e5-44d7-967d-a14846d8eb55 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] <== disconnect_volume: return (335ms) None {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 15:42:03 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bb0f25c0-60e5-44d7-967d-a14846d8eb55 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] [instance: 54523d3e-bfae-4621-85cb-d6a7bc40abf5] Disconnected iSCSI Volume {{(pid=72382) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 15:42:03 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-bb0f25c0-60e5-44d7-967d-a14846d8eb55 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] [instance: 54523d3e-bfae-4621-85cb-d6a7bc40abf5] Deleting instance files /opt/stack/data/nova/instances/54523d3e-bfae-4621-85cb-d6a7bc40abf5_del
Aug 09 15:42:03 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-bb0f25c0-60e5-44d7-967d-a14846d8eb55 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] [instance: 54523d3e-bfae-4621-85cb-d6a7bc40abf5] Deletion of /opt/stack/data/nova/instances/54523d3e-bfae-4621-85cb-d6a7bc40abf5_del complete
Aug 09 15:42:03 user nova-compute[72382]: INFO nova.compute.manager [None req-bb0f25c0-60e5-44d7-967d-a14846d8eb55 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] [instance: 54523d3e-bfae-4621-85cb-d6a7bc40abf5] Took 1.21 seconds to destroy the instance on the hypervisor.
Aug 09 15:42:03 user nova-compute[72382]: DEBUG oslo.service.loopingcall [None req-bb0f25c0-60e5-44d7-967d-a14846d8eb55 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72382) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 15:42:03 user nova-compute[72382]: DEBUG nova.compute.manager [-] [instance: 54523d3e-bfae-4621-85cb-d6a7bc40abf5] Deallocating network for instance {{(pid=72382) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 15:42:03 user nova-compute[72382]: DEBUG nova.network.neutron [-] [instance: 54523d3e-bfae-4621-85cb-d6a7bc40abf5] deallocate_for_instance() {{(pid=72382) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 15:42:03 user nova-compute[72382]: DEBUG nova.virt.driver [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Emitting event <LifecycleEvent: 1691595723.9483683, 4d27c5a4-9a88-423b-9c48-9224e8248f8c => Resumed> {{(pid=72382) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 15:42:03 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 4d27c5a4-9a88-423b-9c48-9224e8248f8c] VM Resumed (Lifecycle Event)
Aug 09 15:42:03 user nova-compute[72382]: DEBUG nova.compute.manager [None req-86ec8d01-1a83-4f88-8982-020cc3452f30 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] [instance: 4d27c5a4-9a88-423b-9c48-9224e8248f8c] Instance event wait completed in 0 seconds for  {{(pid=72382) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 15:42:03 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-86ec8d01-1a83-4f88-8982-020cc3452f30 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] [instance: 4d27c5a4-9a88-423b-9c48-9224e8248f8c] Guest created on hypervisor {{(pid=72382) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 15:42:03 user nova-compute[72382]: INFO nova.virt.libvirt.driver [-] [instance: 4d27c5a4-9a88-423b-9c48-9224e8248f8c] Instance spawned successfully.
Aug 09 15:42:03 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-86ec8d01-1a83-4f88-8982-020cc3452f30 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] [instance: 4d27c5a4-9a88-423b-9c48-9224e8248f8c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 15:42:03 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 4d27c5a4-9a88-423b-9c48-9224e8248f8c] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:42:03 user nova-compute[72382]: DEBUG nova.compute.manager [req-db3ce6d9-b860-46a7-b2b4-5492dd3e7b85 req-3b201f43-30a9-4359-a960-2430e9943fab service nova] [instance: 4d27c5a4-9a88-423b-9c48-9224e8248f8c] Received event network-vif-plugged-b14bc813-7a4e-413c-9b5f-4c34080790b6 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:42:03 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-db3ce6d9-b860-46a7-b2b4-5492dd3e7b85 req-3b201f43-30a9-4359-a960-2430e9943fab service nova] Acquiring lock "4d27c5a4-9a88-423b-9c48-9224e8248f8c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:42:03 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-db3ce6d9-b860-46a7-b2b4-5492dd3e7b85 req-3b201f43-30a9-4359-a960-2430e9943fab service nova] Lock "4d27c5a4-9a88-423b-9c48-9224e8248f8c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:42:03 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-db3ce6d9-b860-46a7-b2b4-5492dd3e7b85 req-3b201f43-30a9-4359-a960-2430e9943fab service nova] Lock "4d27c5a4-9a88-423b-9c48-9224e8248f8c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:42:03 user nova-compute[72382]: DEBUG nova.compute.manager [req-db3ce6d9-b860-46a7-b2b4-5492dd3e7b85 req-3b201f43-30a9-4359-a960-2430e9943fab service nova] [instance: 4d27c5a4-9a88-423b-9c48-9224e8248f8c] No waiting events found dispatching network-vif-plugged-b14bc813-7a4e-413c-9b5f-4c34080790b6 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:42:03 user nova-compute[72382]: WARNING nova.compute.manager [req-db3ce6d9-b860-46a7-b2b4-5492dd3e7b85 req-3b201f43-30a9-4359-a960-2430e9943fab service nova] [instance: 4d27c5a4-9a88-423b-9c48-9224e8248f8c] Received unexpected event network-vif-plugged-b14bc813-7a4e-413c-9b5f-4c34080790b6 for instance with vm_state building and task_state spawning.
Aug 09 15:42:03 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 4d27c5a4-9a88-423b-9c48-9224e8248f8c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72382) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 15:42:03 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-86ec8d01-1a83-4f88-8982-020cc3452f30 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] [instance: 4d27c5a4-9a88-423b-9c48-9224e8248f8c] Found default for hw_cdrom_bus of ide {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:42:03 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-86ec8d01-1a83-4f88-8982-020cc3452f30 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] [instance: 4d27c5a4-9a88-423b-9c48-9224e8248f8c] Found default for hw_disk_bus of virtio {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:42:03 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-86ec8d01-1a83-4f88-8982-020cc3452f30 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] [instance: 4d27c5a4-9a88-423b-9c48-9224e8248f8c] Found default for hw_input_bus of None {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:42:03 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-86ec8d01-1a83-4f88-8982-020cc3452f30 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] [instance: 4d27c5a4-9a88-423b-9c48-9224e8248f8c] Found default for hw_pointer_model of None {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:42:03 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-86ec8d01-1a83-4f88-8982-020cc3452f30 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] [instance: 4d27c5a4-9a88-423b-9c48-9224e8248f8c] Found default for hw_video_model of virtio {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:42:03 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-86ec8d01-1a83-4f88-8982-020cc3452f30 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] [instance: 4d27c5a4-9a88-423b-9c48-9224e8248f8c] Found default for hw_vif_model of virtio {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:42:04 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 4d27c5a4-9a88-423b-9c48-9224e8248f8c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 15:42:04 user nova-compute[72382]: DEBUG nova.virt.driver [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Emitting event <LifecycleEvent: 1691595723.9514701, 4d27c5a4-9a88-423b-9c48-9224e8248f8c => Started> {{(pid=72382) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 15:42:04 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 4d27c5a4-9a88-423b-9c48-9224e8248f8c] VM Started (Lifecycle Event)
Aug 09 15:42:04 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 4d27c5a4-9a88-423b-9c48-9224e8248f8c] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:42:04 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 4d27c5a4-9a88-423b-9c48-9224e8248f8c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72382) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 15:42:04 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 4d27c5a4-9a88-423b-9c48-9224e8248f8c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 15:42:04 user nova-compute[72382]: INFO nova.compute.manager [None req-86ec8d01-1a83-4f88-8982-020cc3452f30 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] [instance: 4d27c5a4-9a88-423b-9c48-9224e8248f8c] Took 5.69 seconds to spawn the instance on the hypervisor.
Aug 09 15:42:04 user nova-compute[72382]: DEBUG nova.compute.manager [None req-86ec8d01-1a83-4f88-8982-020cc3452f30 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] [instance: 4d27c5a4-9a88-423b-9c48-9224e8248f8c] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:42:04 user nova-compute[72382]: DEBUG nova.network.neutron [-] [instance: 54523d3e-bfae-4621-85cb-d6a7bc40abf5] Updating instance_info_cache with network_info: [] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:42:04 user nova-compute[72382]: INFO nova.compute.manager [-] [instance: 54523d3e-bfae-4621-85cb-d6a7bc40abf5] Took 0.86 seconds to deallocate network for instance.
Aug 09 15:42:04 user nova-compute[72382]: INFO nova.compute.manager [None req-86ec8d01-1a83-4f88-8982-020cc3452f30 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] [instance: 4d27c5a4-9a88-423b-9c48-9224e8248f8c] Took 6.64 seconds to build instance.
Aug 09 15:42:04 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-86ec8d01-1a83-4f88-8982-020cc3452f30 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] Lock "4d27c5a4-9a88-423b-9c48-9224e8248f8c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.743s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:42:04 user nova-compute[72382]: DEBUG nova.compute.manager [req-0dcd255a-9ce6-47c2-b017-39f6d7baee5e req-a497fac7-256d-4d3b-af93-a7796ae68c77 service nova] [instance: 54523d3e-bfae-4621-85cb-d6a7bc40abf5] Received event network-vif-plugged-8557ab28-9722-4e6e-a14d-f941e3b693c8 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:42:04 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-0dcd255a-9ce6-47c2-b017-39f6d7baee5e req-a497fac7-256d-4d3b-af93-a7796ae68c77 service nova] Acquiring lock "54523d3e-bfae-4621-85cb-d6a7bc40abf5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:42:04 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-0dcd255a-9ce6-47c2-b017-39f6d7baee5e req-a497fac7-256d-4d3b-af93-a7796ae68c77 service nova] Lock "54523d3e-bfae-4621-85cb-d6a7bc40abf5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:42:04 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-0dcd255a-9ce6-47c2-b017-39f6d7baee5e req-a497fac7-256d-4d3b-af93-a7796ae68c77 service nova] Lock "54523d3e-bfae-4621-85cb-d6a7bc40abf5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:42:04 user nova-compute[72382]: DEBUG nova.compute.manager [req-0dcd255a-9ce6-47c2-b017-39f6d7baee5e req-a497fac7-256d-4d3b-af93-a7796ae68c77 service nova] [instance: 54523d3e-bfae-4621-85cb-d6a7bc40abf5] No waiting events found dispatching network-vif-plugged-8557ab28-9722-4e6e-a14d-f941e3b693c8 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:42:04 user nova-compute[72382]: WARNING nova.compute.manager [req-0dcd255a-9ce6-47c2-b017-39f6d7baee5e req-a497fac7-256d-4d3b-af93-a7796ae68c77 service nova] [instance: 54523d3e-bfae-4621-85cb-d6a7bc40abf5] Received unexpected event network-vif-plugged-8557ab28-9722-4e6e-a14d-f941e3b693c8 for instance with vm_state active and task_state deleting.
Aug 09 15:42:04 user nova-compute[72382]: DEBUG nova.compute.manager [req-0dcd255a-9ce6-47c2-b017-39f6d7baee5e req-a497fac7-256d-4d3b-af93-a7796ae68c77 service nova] [instance: 54523d3e-bfae-4621-85cb-d6a7bc40abf5] Received event network-vif-deleted-8557ab28-9722-4e6e-a14d-f941e3b693c8 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:42:04 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:42:05 user nova-compute[72382]: INFO nova.compute.manager [None req-bb0f25c0-60e5-44d7-967d-a14846d8eb55 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] [instance: 54523d3e-bfae-4621-85cb-d6a7bc40abf5] Took 0.84 seconds to detach 1 volumes for instance.
Aug 09 15:42:05 user nova-compute[72382]: DEBUG nova.compute.manager [None req-bb0f25c0-60e5-44d7-967d-a14846d8eb55 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] [instance: 54523d3e-bfae-4621-85cb-d6a7bc40abf5] Deleting volume: a0a612d6-0f3f-4d2c-9fb5-aff9384338de {{(pid=72382) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 09 15:42:05 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-bb0f25c0-60e5-44d7-967d-a14846d8eb55 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:42:05 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-bb0f25c0-60e5-44d7-967d-a14846d8eb55 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:42:05 user nova-compute[72382]: DEBUG nova.compute.provider_tree [None req-bb0f25c0-60e5-44d7-967d-a14846d8eb55 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Inventory has not changed in ProviderTree for provider: 7b15b0e5-df4d-49db-833b-2855d21d10ae {{(pid=72382) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 15:42:05 user nova-compute[72382]: DEBUG nova.scheduler.client.report [None req-bb0f25c0-60e5-44d7-967d-a14846d8eb55 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Inventory has not changed for provider 7b15b0e5-df4d-49db-833b-2855d21d10ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72382) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 15:42:05 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-bb0f25c0-60e5-44d7-967d-a14846d8eb55 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.234s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:42:05 user nova-compute[72382]: INFO nova.scheduler.client.report [None req-bb0f25c0-60e5-44d7-967d-a14846d8eb55 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Deleted allocations for instance 54523d3e-bfae-4621-85cb-d6a7bc40abf5
Aug 09 15:42:05 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-bb0f25c0-60e5-44d7-967d-a14846d8eb55 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Lock "54523d3e-bfae-4621-85cb-d6a7bc40abf5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.437s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:42:06 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-8af4a51f-51bc-40d4-b90b-d4a8af8ad6f1 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Acquiring lock "0c1b05ee-4fc3-44b9-b689-52d07841da4c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:42:06 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-8af4a51f-51bc-40d4-b90b-d4a8af8ad6f1 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Lock "0c1b05ee-4fc3-44b9-b689-52d07841da4c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:42:06 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8af4a51f-51bc-40d4-b90b-d4a8af8ad6f1 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] [instance: 0c1b05ee-4fc3-44b9-b689-52d07841da4c] Starting instance... {{(pid=72382) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 15:42:06 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-8af4a51f-51bc-40d4-b90b-d4a8af8ad6f1 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:42:06 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-8af4a51f-51bc-40d4-b90b-d4a8af8ad6f1 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:42:06 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-8af4a51f-51bc-40d4-b90b-d4a8af8ad6f1 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72382) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 15:42:06 user nova-compute[72382]: INFO nova.compute.claims [None req-8af4a51f-51bc-40d4-b90b-d4a8af8ad6f1 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] [instance: 0c1b05ee-4fc3-44b9-b689-52d07841da4c] Claim successful on node user
Aug 09 15:42:07 user nova-compute[72382]: DEBUG nova.compute.provider_tree [None req-8af4a51f-51bc-40d4-b90b-d4a8af8ad6f1 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Inventory has not changed in ProviderTree for provider: 7b15b0e5-df4d-49db-833b-2855d21d10ae {{(pid=72382) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 15:42:07 user nova-compute[72382]: DEBUG nova.scheduler.client.report [None req-8af4a51f-51bc-40d4-b90b-d4a8af8ad6f1 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Inventory has not changed for provider 7b15b0e5-df4d-49db-833b-2855d21d10ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72382) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 15:42:07 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-8af4a51f-51bc-40d4-b90b-d4a8af8ad6f1 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.340s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:42:07 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8af4a51f-51bc-40d4-b90b-d4a8af8ad6f1 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] [instance: 0c1b05ee-4fc3-44b9-b689-52d07841da4c] Start building networks asynchronously for instance. {{(pid=72382) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 15:42:07 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8af4a51f-51bc-40d4-b90b-d4a8af8ad6f1 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] [instance: 0c1b05ee-4fc3-44b9-b689-52d07841da4c] Allocating IP information in the background. {{(pid=72382) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 15:42:07 user nova-compute[72382]: DEBUG nova.network.neutron [None req-8af4a51f-51bc-40d4-b90b-d4a8af8ad6f1 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] [instance: 0c1b05ee-4fc3-44b9-b689-52d07841da4c] allocate_for_instance() {{(pid=72382) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 15:42:07 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-8af4a51f-51bc-40d4-b90b-d4a8af8ad6f1 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] [instance: 0c1b05ee-4fc3-44b9-b689-52d07841da4c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 15:42:07 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8af4a51f-51bc-40d4-b90b-d4a8af8ad6f1 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] [instance: 0c1b05ee-4fc3-44b9-b689-52d07841da4c] Start building block device mappings for instance. {{(pid=72382) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 15:42:07 user nova-compute[72382]: DEBUG nova.policy [None req-8af4a51f-51bc-40d4-b90b-d4a8af8ad6f1 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '12ac8eca784e480d86c8fff801e73d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c87775443b4abd987197c4b46693bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72382) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 15:42:07 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8af4a51f-51bc-40d4-b90b-d4a8af8ad6f1 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] [instance: 0c1b05ee-4fc3-44b9-b689-52d07841da4c] Start spawning the instance on the hypervisor. {{(pid=72382) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 15:42:07 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-8af4a51f-51bc-40d4-b90b-d4a8af8ad6f1 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] [instance: 0c1b05ee-4fc3-44b9-b689-52d07841da4c] Creating instance directory {{(pid=72382) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 15:42:07 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-8af4a51f-51bc-40d4-b90b-d4a8af8ad6f1 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] [instance: 0c1b05ee-4fc3-44b9-b689-52d07841da4c] Creating image(s)
Aug 09 15:42:07 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-8af4a51f-51bc-40d4-b90b-d4a8af8ad6f1 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Acquiring lock "/opt/stack/data/nova/instances/0c1b05ee-4fc3-44b9-b689-52d07841da4c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:42:07 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-8af4a51f-51bc-40d4-b90b-d4a8af8ad6f1 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Lock "/opt/stack/data/nova/instances/0c1b05ee-4fc3-44b9-b689-52d07841da4c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:42:07 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-8af4a51f-51bc-40d4-b90b-d4a8af8ad6f1 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Lock "/opt/stack/data/nova/instances/0c1b05ee-4fc3-44b9-b689-52d07841da4c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:42:07 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-8af4a51f-51bc-40d4-b90b-d4a8af8ad6f1 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Acquiring lock "a6d49bd7165865a8e14e8df0bdc9c9aa25a1c1eb" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:42:07 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-8af4a51f-51bc-40d4-b90b-d4a8af8ad6f1 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Lock "a6d49bd7165865a8e14e8df0bdc9c9aa25a1c1eb" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:42:08 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-8af4a51f-51bc-40d4-b90b-d4a8af8ad6f1 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a6d49bd7165865a8e14e8df0bdc9c9aa25a1c1eb.part --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:42:08 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:42:08 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-8af4a51f-51bc-40d4-b90b-d4a8af8ad6f1 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a6d49bd7165865a8e14e8df0bdc9c9aa25a1c1eb.part --force-share --output=json" returned: 0 in 0.159s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:42:08 user nova-compute[72382]: DEBUG nova.virt.images [None req-8af4a51f-51bc-40d4-b90b-d4a8af8ad6f1 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] 1acc9c2a-7ce4-4608-9bd6-0fad9daed3a6 was qcow2, converting to raw {{(pid=72382) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 09 15:42:08 user nova-compute[72382]: DEBUG nova.privsep.utils [None req-8af4a51f-51bc-40d4-b90b-d4a8af8ad6f1 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72382) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 09 15:42:08 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-8af4a51f-51bc-40d4-b90b-d4a8af8ad6f1 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a6d49bd7165865a8e14e8df0bdc9c9aa25a1c1eb.part /opt/stack/data/nova/instances/_base/a6d49bd7165865a8e14e8df0bdc9c9aa25a1c1eb.converted {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:42:08 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-8af4a51f-51bc-40d4-b90b-d4a8af8ad6f1 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a6d49bd7165865a8e14e8df0bdc9c9aa25a1c1eb.part /opt/stack/data/nova/instances/_base/a6d49bd7165865a8e14e8df0bdc9c9aa25a1c1eb.converted" returned: 0 in 0.394s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:42:08 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-8af4a51f-51bc-40d4-b90b-d4a8af8ad6f1 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a6d49bd7165865a8e14e8df0bdc9c9aa25a1c1eb.converted --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:42:08 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-8af4a51f-51bc-40d4-b90b-d4a8af8ad6f1 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a6d49bd7165865a8e14e8df0bdc9c9aa25a1c1eb.converted --force-share --output=json" returned: 0 in 0.164s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:42:08 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-8af4a51f-51bc-40d4-b90b-d4a8af8ad6f1 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Lock "a6d49bd7165865a8e14e8df0bdc9c9aa25a1c1eb" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.323s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:42:08 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-8af4a51f-51bc-40d4-b90b-d4a8af8ad6f1 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a6d49bd7165865a8e14e8df0bdc9c9aa25a1c1eb --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:42:09 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-8af4a51f-51bc-40d4-b90b-d4a8af8ad6f1 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a6d49bd7165865a8e14e8df0bdc9c9aa25a1c1eb --force-share --output=json" returned: 0 in 0.136s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:42:09 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-8af4a51f-51bc-40d4-b90b-d4a8af8ad6f1 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Acquiring lock "a6d49bd7165865a8e14e8df0bdc9c9aa25a1c1eb" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:42:09 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-8af4a51f-51bc-40d4-b90b-d4a8af8ad6f1 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Lock "a6d49bd7165865a8e14e8df0bdc9c9aa25a1c1eb" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:42:09 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-8af4a51f-51bc-40d4-b90b-d4a8af8ad6f1 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a6d49bd7165865a8e14e8df0bdc9c9aa25a1c1eb --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:42:09 user nova-compute[72382]: DEBUG nova.network.neutron [None req-8af4a51f-51bc-40d4-b90b-d4a8af8ad6f1 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] [instance: 0c1b05ee-4fc3-44b9-b689-52d07841da4c] Successfully created port: b339298b-9a14-4a36-a53e-7d1e6a2d85ff {{(pid=72382) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 15:42:09 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._sync_power_states {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:42:09 user nova-compute[72382]: WARNING nova.compute.manager [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] While synchronizing instance power states, found 6 instances in the database and 5 instances on the hypervisor.
Aug 09 15:42:09 user nova-compute[72382]: DEBUG nova.compute.manager [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Triggering sync for uuid 4ccbfda2-8bcd-4ec1-972a-cf49a62b1583 {{(pid=72382) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 09 15:42:09 user nova-compute[72382]: DEBUG nova.compute.manager [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Triggering sync for uuid 3855b76f-87cc-4be0-982c-4cc5cf5cd8aa {{(pid=72382) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 09 15:42:09 user nova-compute[72382]: DEBUG nova.compute.manager [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Triggering sync for uuid 5c914d94-5bfd-4984-8937-37bdf02e9674 {{(pid=72382) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 09 15:42:09 user nova-compute[72382]: DEBUG nova.compute.manager [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Triggering sync for uuid f49b5daf-d39d-496f-97d7-a0d9fd67d66d {{(pid=72382) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 09 15:42:09 user nova-compute[72382]: DEBUG nova.compute.manager [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Triggering sync for uuid 4d27c5a4-9a88-423b-9c48-9224e8248f8c {{(pid=72382) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 09 15:42:09 user nova-compute[72382]: DEBUG nova.compute.manager [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Triggering sync for uuid 0c1b05ee-4fc3-44b9-b689-52d07841da4c {{(pid=72382) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 09 15:42:09 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Acquiring lock "4ccbfda2-8bcd-4ec1-972a-cf49a62b1583" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:42:09 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "4ccbfda2-8bcd-4ec1-972a-cf49a62b1583" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:42:09 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Acquiring lock "3855b76f-87cc-4be0-982c-4cc5cf5cd8aa" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:42:09 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "3855b76f-87cc-4be0-982c-4cc5cf5cd8aa" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:42:09 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Acquiring lock "5c914d94-5bfd-4984-8937-37bdf02e9674" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:42:09 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "5c914d94-5bfd-4984-8937-37bdf02e9674" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:42:09 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Acquiring lock "f49b5daf-d39d-496f-97d7-a0d9fd67d66d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:42:09 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "f49b5daf-d39d-496f-97d7-a0d9fd67d66d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:42:09 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Acquiring lock "4d27c5a4-9a88-423b-9c48-9224e8248f8c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:42:09 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "4d27c5a4-9a88-423b-9c48-9224e8248f8c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:42:09 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Acquiring lock "0c1b05ee-4fc3-44b9-b689-52d07841da4c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:42:09 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-8af4a51f-51bc-40d4-b90b-d4a8af8ad6f1 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a6d49bd7165865a8e14e8df0bdc9c9aa25a1c1eb --force-share --output=json" returned: 0 in 0.185s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:42:09 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-8af4a51f-51bc-40d4-b90b-d4a8af8ad6f1 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a6d49bd7165865a8e14e8df0bdc9c9aa25a1c1eb,backing_fmt=raw /opt/stack/data/nova/instances/0c1b05ee-4fc3-44b9-b689-52d07841da4c/disk 1073741824 {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:42:09 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "3855b76f-87cc-4be0-982c-4cc5cf5cd8aa" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.086s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:42:09 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "5c914d94-5bfd-4984-8937-37bdf02e9674" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.088s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:42:09 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "4d27c5a4-9a88-423b-9c48-9224e8248f8c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.087s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:42:09 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "4ccbfda2-8bcd-4ec1-972a-cf49a62b1583" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.091s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:42:09 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "f49b5daf-d39d-496f-97d7-a0d9fd67d66d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.089s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:42:09 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-8af4a51f-51bc-40d4-b90b-d4a8af8ad6f1 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a6d49bd7165865a8e14e8df0bdc9c9aa25a1c1eb,backing_fmt=raw /opt/stack/data/nova/instances/0c1b05ee-4fc3-44b9-b689-52d07841da4c/disk 1073741824" returned: 0 in 0.051s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:42:09 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-8af4a51f-51bc-40d4-b90b-d4a8af8ad6f1 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Lock "a6d49bd7165865a8e14e8df0bdc9c9aa25a1c1eb" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.239s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:42:09 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-8af4a51f-51bc-40d4-b90b-d4a8af8ad6f1 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a6d49bd7165865a8e14e8df0bdc9c9aa25a1c1eb --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:42:09 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-8af4a51f-51bc-40d4-b90b-d4a8af8ad6f1 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a6d49bd7165865a8e14e8df0bdc9c9aa25a1c1eb --force-share --output=json" returned: 0 in 0.149s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:42:09 user nova-compute[72382]: DEBUG nova.virt.disk.api [None req-8af4a51f-51bc-40d4-b90b-d4a8af8ad6f1 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0c1b05ee-4fc3-44b9-b689-52d07841da4c/disk. size=1073741824 {{(pid=72382) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 15:42:09 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-8af4a51f-51bc-40d4-b90b-d4a8af8ad6f1 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c1b05ee-4fc3-44b9-b689-52d07841da4c/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:42:09 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-8af4a51f-51bc-40d4-b90b-d4a8af8ad6f1 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c1b05ee-4fc3-44b9-b689-52d07841da4c/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:42:09 user nova-compute[72382]: DEBUG nova.virt.disk.api [None req-8af4a51f-51bc-40d4-b90b-d4a8af8ad6f1 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Cannot resize image /opt/stack/data/nova/instances/0c1b05ee-4fc3-44b9-b689-52d07841da4c/disk to a smaller size. {{(pid=72382) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 15:42:09 user nova-compute[72382]: DEBUG nova.objects.instance [None req-8af4a51f-51bc-40d4-b90b-d4a8af8ad6f1 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Lazy-loading 'migration_context' on Instance uuid 0c1b05ee-4fc3-44b9-b689-52d07841da4c {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:42:09 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-8af4a51f-51bc-40d4-b90b-d4a8af8ad6f1 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] [instance: 0c1b05ee-4fc3-44b9-b689-52d07841da4c] Created local disks {{(pid=72382) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 15:42:09 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-8af4a51f-51bc-40d4-b90b-d4a8af8ad6f1 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] [instance: 0c1b05ee-4fc3-44b9-b689-52d07841da4c] Ensure instance console log exists: /opt/stack/data/nova/instances/0c1b05ee-4fc3-44b9-b689-52d07841da4c/console.log {{(pid=72382) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 15:42:09 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-8af4a51f-51bc-40d4-b90b-d4a8af8ad6f1 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:42:09 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-8af4a51f-51bc-40d4-b90b-d4a8af8ad6f1 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:42:09 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-8af4a51f-51bc-40d4-b90b-d4a8af8ad6f1 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:42:09 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:42:09 user nova-compute[72382]: DEBUG nova.network.neutron [None req-8af4a51f-51bc-40d4-b90b-d4a8af8ad6f1 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] [instance: 0c1b05ee-4fc3-44b9-b689-52d07841da4c] Successfully updated port: b339298b-9a14-4a36-a53e-7d1e6a2d85ff {{(pid=72382) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 15:42:09 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-8af4a51f-51bc-40d4-b90b-d4a8af8ad6f1 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Acquiring lock "refresh_cache-0c1b05ee-4fc3-44b9-b689-52d07841da4c" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 15:42:09 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-8af4a51f-51bc-40d4-b90b-d4a8af8ad6f1 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Acquired lock "refresh_cache-0c1b05ee-4fc3-44b9-b689-52d07841da4c" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 15:42:09 user nova-compute[72382]: DEBUG nova.network.neutron [None req-8af4a51f-51bc-40d4-b90b-d4a8af8ad6f1 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] [instance: 0c1b05ee-4fc3-44b9-b689-52d07841da4c] Building network info cache for instance {{(pid=72382) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 15:42:10 user nova-compute[72382]: DEBUG nova.compute.manager [req-00cf9ace-9277-4cea-a934-723c1ca0544f req-42be24cc-4e3b-476a-95a7-237ffc1412d4 service nova] [instance: 0c1b05ee-4fc3-44b9-b689-52d07841da4c] Received event network-changed-b339298b-9a14-4a36-a53e-7d1e6a2d85ff {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:42:10 user nova-compute[72382]: DEBUG nova.compute.manager [req-00cf9ace-9277-4cea-a934-723c1ca0544f req-42be24cc-4e3b-476a-95a7-237ffc1412d4 service nova] [instance: 0c1b05ee-4fc3-44b9-b689-52d07841da4c] Refreshing instance network info cache due to event network-changed-b339298b-9a14-4a36-a53e-7d1e6a2d85ff. {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 15:42:10 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-00cf9ace-9277-4cea-a934-723c1ca0544f req-42be24cc-4e3b-476a-95a7-237ffc1412d4 service nova] Acquiring lock "refresh_cache-0c1b05ee-4fc3-44b9-b689-52d07841da4c" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 15:42:10 user nova-compute[72382]: DEBUG nova.network.neutron [None req-8af4a51f-51bc-40d4-b90b-d4a8af8ad6f1 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] [instance: 0c1b05ee-4fc3-44b9-b689-52d07841da4c] Instance cache missing network info. {{(pid=72382) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 15:42:10 user nova-compute[72382]: DEBUG nova.network.neutron [None req-8af4a51f-51bc-40d4-b90b-d4a8af8ad6f1 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] [instance: 0c1b05ee-4fc3-44b9-b689-52d07841da4c] Updating instance_info_cache with network_info: [{"id": "b339298b-9a14-4a36-a53e-7d1e6a2d85ff", "address": "fa:16:3e:d4:06:6f", "network": {"id": "8d929426-09f7-49b5-a79e-711e20e00750", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1307802727-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93c87775443b4abd987197c4b46693bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb339298b-9a", "ovs_interfaceid": "b339298b-9a14-4a36-a53e-7d1e6a2d85ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:42:10 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-8af4a51f-51bc-40d4-b90b-d4a8af8ad6f1 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Releasing lock "refresh_cache-0c1b05ee-4fc3-44b9-b689-52d07841da4c" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 15:42:10 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8af4a51f-51bc-40d4-b90b-d4a8af8ad6f1 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] [instance: 0c1b05ee-4fc3-44b9-b689-52d07841da4c] Instance network_info: |[{"id": "b339298b-9a14-4a36-a53e-7d1e6a2d85ff", "address": "fa:16:3e:d4:06:6f", "network": {"id": "8d929426-09f7-49b5-a79e-711e20e00750", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1307802727-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93c87775443b4abd987197c4b46693bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb339298b-9a", "ovs_interfaceid": "b339298b-9a14-4a36-a53e-7d1e6a2d85ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72382) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 15:42:10 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-00cf9ace-9277-4cea-a934-723c1ca0544f req-42be24cc-4e3b-476a-95a7-237ffc1412d4 service nova] Acquired lock "refresh_cache-0c1b05ee-4fc3-44b9-b689-52d07841da4c" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 15:42:10 user nova-compute[72382]: DEBUG nova.network.neutron [req-00cf9ace-9277-4cea-a934-723c1ca0544f req-42be24cc-4e3b-476a-95a7-237ffc1412d4 service nova] [instance: 0c1b05ee-4fc3-44b9-b689-52d07841da4c] Refreshing network info cache for port b339298b-9a14-4a36-a53e-7d1e6a2d85ff {{(pid=72382) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 15:42:10 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-8af4a51f-51bc-40d4-b90b-d4a8af8ad6f1 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] [instance: 0c1b05ee-4fc3-44b9-b689-52d07841da4c] Start _get_guest_xml network_info=[{"id": "b339298b-9a14-4a36-a53e-7d1e6a2d85ff", "address": "fa:16:3e:d4:06:6f", "network": {"id": "8d929426-09f7-49b5-a79e-711e20e00750", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1307802727-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93c87775443b4abd987197c4b46693bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb339298b-9a", "ovs_interfaceid": "b339298b-9a14-4a36-a53e-7d1e6a2d85ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T15:42:04Z,direct_url=<?>,disk_format='qcow2',id=1acc9c2a-7ce4-4608-9bd6-0fad9daed3a6,min_disk=0,min_ram=0,name='tempest-scenario-img--2029930307',owner='93c87775443b4abd987197c4b46693bc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T15:42:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': '1acc9c2a-7ce4-4608-9bd6-0fad9daed3a6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72382) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 15:42:10 user nova-compute[72382]: WARNING nova.virt.libvirt.driver [None req-8af4a51f-51bc-40d4-b90b-d4a8af8ad6f1 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 15:42:10 user nova-compute[72382]: WARNING nova.virt.libvirt.driver [None req-8af4a51f-51bc-40d4-b90b-d4a8af8ad6f1 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 15:42:10 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-8af4a51f-51bc-40d4-b90b-d4a8af8ad6f1 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72382) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 15:42:10 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-8af4a51f-51bc-40d4-b90b-d4a8af8ad6f1 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] CPU controller missing on host. {{(pid=72382) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 15:42:10 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-8af4a51f-51bc-40d4-b90b-d4a8af8ad6f1 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72382) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 15:42:10 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-8af4a51f-51bc-40d4-b90b-d4a8af8ad6f1 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] CPU controller found on host. {{(pid=72382) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 15:42:10 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-8af4a51f-51bc-40d4-b90b-d4a8af8ad6f1 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72382) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 15:42:10 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-8af4a51f-51bc-40d4-b90b-d4a8af8ad6f1 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T15:11:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T15:42:04Z,direct_url=<?>,disk_format='qcow2',id=1acc9c2a-7ce4-4608-9bd6-0fad9daed3a6,min_disk=0,min_ram=0,name='tempest-scenario-img--2029930307',owner='93c87775443b4abd987197c4b46693bc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T15:42:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 15:42:10 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-8af4a51f-51bc-40d4-b90b-d4a8af8ad6f1 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Flavor limits 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 15:42:10 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-8af4a51f-51bc-40d4-b90b-d4a8af8ad6f1 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Image limits 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 15:42:10 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-8af4a51f-51bc-40d4-b90b-d4a8af8ad6f1 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Flavor pref 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 15:42:10 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-8af4a51f-51bc-40d4-b90b-d4a8af8ad6f1 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Image pref 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 15:42:10 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-8af4a51f-51bc-40d4-b90b-d4a8af8ad6f1 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 15:42:10 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-8af4a51f-51bc-40d4-b90b-d4a8af8ad6f1 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 15:42:10 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-8af4a51f-51bc-40d4-b90b-d4a8af8ad6f1 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72382) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 15:42:10 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-8af4a51f-51bc-40d4-b90b-d4a8af8ad6f1 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Got 1 possible topologies {{(pid=72382) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 15:42:10 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-8af4a51f-51bc-40d4-b90b-d4a8af8ad6f1 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 15:42:10 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-8af4a51f-51bc-40d4-b90b-d4a8af8ad6f1 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 15:42:10 user nova-compute[72382]: DEBUG nova.virt.libvirt.vif [None req-8af4a51f-51bc-40d4-b90b-d4a8af8ad6f1 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T15:42:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1772014179',display_name='tempest-TestMinimumBasicScenario-server-1772014179',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1772014179',id=49,image_ref='1acc9c2a-7ce4-4608-9bd6-0fad9daed3a6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA0Q7q04BVtFxGwVhvVPP37gEOF8Ej3PCxEU0HRUacrq6aiMHnSYiLIplHUzjNSR09VO3ZAOR9JDYeWh9QUge+3OwvRdDFkfbjvfVygyBrvBfOOD23ZlsyvcAc+lY1yEdQ==',key_name='tempest-TestMinimumBasicScenario-1554981330',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='93c87775443b4abd987197c4b46693bc',ramdisk_id='',reservation_id='r-d86xbslt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1acc9c2a-7ce4-4608-9bd6-0fad9daed3a6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-389394165',owner_user_name='tempest-TestMinimumBasicScenario-389394165-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T15:42:07Z,user_data=None,user_id='12ac8eca784e480d86c8fff801e73d2d',uuid=0c1b05ee-4fc3-44b9-b689-52d07841da4c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b339298b-9a14-4a36-a53e-7d1e6a2d85ff", "address": "fa:16:3e:d4:06:6f", "network": {"id": "8d929426-09f7-49b5-a79e-711e20e00750", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1307802727-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93c87775443b4abd987197c4b46693bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb339298b-9a", "ovs_interfaceid": "b339298b-9a14-4a36-a53e-7d1e6a2d85ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72382) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 15:42:10 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-8af4a51f-51bc-40d4-b90b-d4a8af8ad6f1 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Converting VIF {"id": "b339298b-9a14-4a36-a53e-7d1e6a2d85ff", "address": "fa:16:3e:d4:06:6f", "network": {"id": "8d929426-09f7-49b5-a79e-711e20e00750", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1307802727-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93c87775443b4abd987197c4b46693bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb339298b-9a", "ovs_interfaceid": "b339298b-9a14-4a36-a53e-7d1e6a2d85ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 15:42:10 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-8af4a51f-51bc-40d4-b90b-d4a8af8ad6f1 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d4:06:6f,bridge_name='br-int',has_traffic_filtering=True,id=b339298b-9a14-4a36-a53e-7d1e6a2d85ff,network=Network(8d929426-09f7-49b5-a79e-711e20e00750),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb339298b-9a') {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 15:42:10 user nova-compute[72382]: DEBUG nova.objects.instance [None req-8af4a51f-51bc-40d4-b90b-d4a8af8ad6f1 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Lazy-loading 'pci_devices' on Instance uuid 0c1b05ee-4fc3-44b9-b689-52d07841da4c {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:42:10 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-8af4a51f-51bc-40d4-b90b-d4a8af8ad6f1 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] [instance: 0c1b05ee-4fc3-44b9-b689-52d07841da4c] End _get_guest_xml xml=<domain type="kvm">
Aug 09 15:42:10 user nova-compute[72382]:   <uuid>0c1b05ee-4fc3-44b9-b689-52d07841da4c</uuid>
Aug 09 15:42:10 user nova-compute[72382]:   <name>instance-00000031</name>
Aug 09 15:42:10 user nova-compute[72382]:   <memory>524288</memory>
Aug 09 15:42:10 user nova-compute[72382]:   <vcpu>1</vcpu>
Aug 09 15:42:10 user nova-compute[72382]:   <metadata>
Aug 09 15:42:10 user nova-compute[72382]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 15:42:10 user nova-compute[72382]:       <nova:package version="0.0.0"/>
Aug 09 15:42:10 user nova-compute[72382]:       <nova:name>tempest-TestMinimumBasicScenario-server-1772014179</nova:name>
Aug 09 15:42:10 user nova-compute[72382]:       <nova:creationTime>2023-08-09 15:42:10</nova:creationTime>
Aug 09 15:42:10 user nova-compute[72382]:       <nova:flavor name="m1.tiny">
Aug 09 15:42:10 user nova-compute[72382]:         <nova:memory>512</nova:memory>
Aug 09 15:42:10 user nova-compute[72382]:         <nova:disk>1</nova:disk>
Aug 09 15:42:10 user nova-compute[72382]:         <nova:swap>0</nova:swap>
Aug 09 15:42:10 user nova-compute[72382]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 15:42:10 user nova-compute[72382]:         <nova:vcpus>1</nova:vcpus>
Aug 09 15:42:10 user nova-compute[72382]:       </nova:flavor>
Aug 09 15:42:10 user nova-compute[72382]:       <nova:owner>
Aug 09 15:42:10 user nova-compute[72382]:         <nova:user uuid="12ac8eca784e480d86c8fff801e73d2d">tempest-TestMinimumBasicScenario-389394165-project-member</nova:user>
Aug 09 15:42:10 user nova-compute[72382]:         <nova:project uuid="93c87775443b4abd987197c4b46693bc">tempest-TestMinimumBasicScenario-389394165</nova:project>
Aug 09 15:42:10 user nova-compute[72382]:       </nova:owner>
Aug 09 15:42:10 user nova-compute[72382]:       <nova:root type="image" uuid="1acc9c2a-7ce4-4608-9bd6-0fad9daed3a6"/>
Aug 09 15:42:10 user nova-compute[72382]:       <nova:ports>
Aug 09 15:42:10 user nova-compute[72382]:         <nova:port uuid="b339298b-9a14-4a36-a53e-7d1e6a2d85ff">
Aug 09 15:42:10 user nova-compute[72382]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 09 15:42:10 user nova-compute[72382]:         </nova:port>
Aug 09 15:42:10 user nova-compute[72382]:       </nova:ports>
Aug 09 15:42:10 user nova-compute[72382]:     </nova:instance>
Aug 09 15:42:10 user nova-compute[72382]:   </metadata>
Aug 09 15:42:10 user nova-compute[72382]:   <sysinfo type="smbios">
Aug 09 15:42:10 user nova-compute[72382]:     <system>
Aug 09 15:42:10 user nova-compute[72382]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 15:42:10 user nova-compute[72382]:       <entry name="product">OpenStack Nova</entry>
Aug 09 15:42:10 user nova-compute[72382]:       <entry name="version">0.0.0</entry>
Aug 09 15:42:10 user nova-compute[72382]:       <entry name="serial">0c1b05ee-4fc3-44b9-b689-52d07841da4c</entry>
Aug 09 15:42:10 user nova-compute[72382]:       <entry name="uuid">0c1b05ee-4fc3-44b9-b689-52d07841da4c</entry>
Aug 09 15:42:10 user nova-compute[72382]:       <entry name="family">Virtual Machine</entry>
Aug 09 15:42:10 user nova-compute[72382]:     </system>
Aug 09 15:42:10 user nova-compute[72382]:   </sysinfo>
Aug 09 15:42:10 user nova-compute[72382]:   <os>
Aug 09 15:42:10 user nova-compute[72382]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 15:42:10 user nova-compute[72382]:     <boot dev="hd"/>
Aug 09 15:42:10 user nova-compute[72382]:     <smbios mode="sysinfo"/>
Aug 09 15:42:10 user nova-compute[72382]:   </os>
Aug 09 15:42:10 user nova-compute[72382]:   <features>
Aug 09 15:42:10 user nova-compute[72382]:     <acpi/>
Aug 09 15:42:10 user nova-compute[72382]:     <apic/>
Aug 09 15:42:10 user nova-compute[72382]:     <vmcoreinfo/>
Aug 09 15:42:10 user nova-compute[72382]:   </features>
Aug 09 15:42:10 user nova-compute[72382]:   <clock offset="utc">
Aug 09 15:42:10 user nova-compute[72382]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 15:42:10 user nova-compute[72382]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 15:42:10 user nova-compute[72382]:     <timer name="hpet" present="no"/>
Aug 09 15:42:10 user nova-compute[72382]:   </clock>
Aug 09 15:42:10 user nova-compute[72382]:   <cpu mode="custom" match="exact">
Aug 09 15:42:10 user nova-compute[72382]:     <model>Nehalem</model>
Aug 09 15:42:10 user nova-compute[72382]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 15:42:10 user nova-compute[72382]:   </cpu>
Aug 09 15:42:10 user nova-compute[72382]:   <devices>
Aug 09 15:42:10 user nova-compute[72382]:     <disk type="file" device="disk">
Aug 09 15:42:10 user nova-compute[72382]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 15:42:10 user nova-compute[72382]:       <source file="/opt/stack/data/nova/instances/0c1b05ee-4fc3-44b9-b689-52d07841da4c/disk"/>
Aug 09 15:42:10 user nova-compute[72382]:       <target dev="vda" bus="virtio"/>
Aug 09 15:42:10 user nova-compute[72382]:     </disk>
Aug 09 15:42:10 user nova-compute[72382]:     <interface type="ethernet">
Aug 09 15:42:10 user nova-compute[72382]:       <mac address="fa:16:3e:d4:06:6f"/>
Aug 09 15:42:10 user nova-compute[72382]:       <model type="virtio"/>
Aug 09 15:42:10 user nova-compute[72382]:       <mtu size="1442"/>
Aug 09 15:42:10 user nova-compute[72382]:       <target dev="tapb339298b-9a"/>
Aug 09 15:42:10 user nova-compute[72382]:     </interface>
Aug 09 15:42:10 user nova-compute[72382]:     <serial type="pty">
Aug 09 15:42:10 user nova-compute[72382]:       <log file="/opt/stack/data/nova/instances/0c1b05ee-4fc3-44b9-b689-52d07841da4c/console.log" append="off"/>
Aug 09 15:42:10 user nova-compute[72382]:     </serial>
Aug 09 15:42:10 user nova-compute[72382]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 15:42:10 user nova-compute[72382]:     <video>
Aug 09 15:42:10 user nova-compute[72382]:       <model type="virtio"/>
Aug 09 15:42:10 user nova-compute[72382]:     </video>
Aug 09 15:42:10 user nova-compute[72382]:     <rng model="virtio">
Aug 09 15:42:10 user nova-compute[72382]:       <backend model="random">/dev/urandom</backend>
Aug 09 15:42:10 user nova-compute[72382]:     </rng>
Aug 09 15:42:10 user nova-compute[72382]:     <controller type="usb" index="0" model="none"/>
Aug 09 15:42:10 user nova-compute[72382]:     <memballoon model="virtio">
Aug 09 15:42:10 user nova-compute[72382]:       <stats period="10"/>
Aug 09 15:42:10 user nova-compute[72382]:     </memballoon>
Aug 09 15:42:10 user nova-compute[72382]:   </devices>
Aug 09 15:42:10 user nova-compute[72382]: </domain>
Aug 09 15:42:10 user nova-compute[72382]:  {{(pid=72382) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 15:42:10 user nova-compute[72382]: DEBUG nova.virt.libvirt.vif [None req-8af4a51f-51bc-40d4-b90b-d4a8af8ad6f1 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T15:42:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1772014179',display_name='tempest-TestMinimumBasicScenario-server-1772014179',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1772014179',id=49,image_ref='1acc9c2a-7ce4-4608-9bd6-0fad9daed3a6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA0Q7q04BVtFxGwVhvVPP37gEOF8Ej3PCxEU0HRUacrq6aiMHnSYiLIplHUzjNSR09VO3ZAOR9JDYeWh9QUge+3OwvRdDFkfbjvfVygyBrvBfOOD23ZlsyvcAc+lY1yEdQ==',key_name='tempest-TestMinimumBasicScenario-1554981330',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='93c87775443b4abd987197c4b46693bc',ramdisk_id='',reservation_id='r-d86xbslt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1acc9c2a-7ce4-4608-9bd6-0fad9daed3a6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-389394165',owner_user_name='tempest-TestMinimumBasicScenario-389394165-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T15:42:07Z,user_data=None,user_id='12ac8eca784e480d86c8fff801e73d2d',uuid=0c1b05ee-4fc3-44b9-b689-52d07841da4c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b339298b-9a14-4a36-a53e-7d1e6a2d85ff", "address": "fa:16:3e:d4:06:6f", "network": {"id": "8d929426-09f7-49b5-a79e-711e20e00750", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1307802727-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93c87775443b4abd987197c4b46693bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb339298b-9a", "ovs_interfaceid": "b339298b-9a14-4a36-a53e-7d1e6a2d85ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 15:42:10 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-8af4a51f-51bc-40d4-b90b-d4a8af8ad6f1 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Converting VIF {"id": "b339298b-9a14-4a36-a53e-7d1e6a2d85ff", "address": "fa:16:3e:d4:06:6f", "network": {"id": "8d929426-09f7-49b5-a79e-711e20e00750", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1307802727-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93c87775443b4abd987197c4b46693bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb339298b-9a", "ovs_interfaceid": "b339298b-9a14-4a36-a53e-7d1e6a2d85ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 15:42:10 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-8af4a51f-51bc-40d4-b90b-d4a8af8ad6f1 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d4:06:6f,bridge_name='br-int',has_traffic_filtering=True,id=b339298b-9a14-4a36-a53e-7d1e6a2d85ff,network=Network(8d929426-09f7-49b5-a79e-711e20e00750),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb339298b-9a') {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 15:42:10 user nova-compute[72382]: DEBUG os_vif [None req-8af4a51f-51bc-40d4-b90b-d4a8af8ad6f1 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:06:6f,bridge_name='br-int',has_traffic_filtering=True,id=b339298b-9a14-4a36-a53e-7d1e6a2d85ff,network=Network(8d929426-09f7-49b5-a79e-711e20e00750),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb339298b-9a') {{(pid=72382) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 15:42:10 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:42:10 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:42:10 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 15:42:10 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:42:10 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb339298b-9a, may_exist=True, interface_attrs={}) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:42:10 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb339298b-9a, col_values=(('external_ids', {'iface-id': 'b339298b-9a14-4a36-a53e-7d1e6a2d85ff', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d4:06:6f', 'vm-uuid': '0c1b05ee-4fc3-44b9-b689-52d07841da4c'}),), if_exists=True) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:42:10 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:42:10 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:42:10 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:42:10 user nova-compute[72382]: INFO os_vif [None req-8af4a51f-51bc-40d4-b90b-d4a8af8ad6f1 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:06:6f,bridge_name='br-int',has_traffic_filtering=True,id=b339298b-9a14-4a36-a53e-7d1e6a2d85ff,network=Network(8d929426-09f7-49b5-a79e-711e20e00750),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb339298b-9a')
Aug 09 15:42:10 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-8af4a51f-51bc-40d4-b90b-d4a8af8ad6f1 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] No BDM found with device name vda, not building metadata. {{(pid=72382) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 15:42:10 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-8af4a51f-51bc-40d4-b90b-d4a8af8ad6f1 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] No VIF found with MAC fa:16:3e:d4:06:6f, not building metadata {{(pid=72382) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 15:42:10 user nova-compute[72382]: DEBUG nova.network.neutron [req-00cf9ace-9277-4cea-a934-723c1ca0544f req-42be24cc-4e3b-476a-95a7-237ffc1412d4 service nova] [instance: 0c1b05ee-4fc3-44b9-b689-52d07841da4c] Updated VIF entry in instance network info cache for port b339298b-9a14-4a36-a53e-7d1e6a2d85ff. {{(pid=72382) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 15:42:10 user nova-compute[72382]: DEBUG nova.network.neutron [req-00cf9ace-9277-4cea-a934-723c1ca0544f req-42be24cc-4e3b-476a-95a7-237ffc1412d4 service nova] [instance: 0c1b05ee-4fc3-44b9-b689-52d07841da4c] Updating instance_info_cache with network_info: [{"id": "b339298b-9a14-4a36-a53e-7d1e6a2d85ff", "address": "fa:16:3e:d4:06:6f", "network": {"id": "8d929426-09f7-49b5-a79e-711e20e00750", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1307802727-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93c87775443b4abd987197c4b46693bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb339298b-9a", "ovs_interfaceid": "b339298b-9a14-4a36-a53e-7d1e6a2d85ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:42:10 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-00cf9ace-9277-4cea-a934-723c1ca0544f req-42be24cc-4e3b-476a-95a7-237ffc1412d4 service nova] Releasing lock "refresh_cache-0c1b05ee-4fc3-44b9-b689-52d07841da4c" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 15:42:11 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:42:11 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:42:12 user nova-compute[72382]: DEBUG nova.compute.manager [req-45d63e86-2aaf-4be7-b9af-a0417004b5a4 req-ab502845-032d-4395-9d69-67cf2ab73478 service nova] [instance: 0c1b05ee-4fc3-44b9-b689-52d07841da4c] Received event network-vif-plugged-b339298b-9a14-4a36-a53e-7d1e6a2d85ff {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:42:12 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-45d63e86-2aaf-4be7-b9af-a0417004b5a4 req-ab502845-032d-4395-9d69-67cf2ab73478 service nova] Acquiring lock "0c1b05ee-4fc3-44b9-b689-52d07841da4c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:42:12 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-45d63e86-2aaf-4be7-b9af-a0417004b5a4 req-ab502845-032d-4395-9d69-67cf2ab73478 service nova] Lock "0c1b05ee-4fc3-44b9-b689-52d07841da4c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:42:12 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-45d63e86-2aaf-4be7-b9af-a0417004b5a4 req-ab502845-032d-4395-9d69-67cf2ab73478 service nova] Lock "0c1b05ee-4fc3-44b9-b689-52d07841da4c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:42:12 user nova-compute[72382]: DEBUG nova.compute.manager [req-45d63e86-2aaf-4be7-b9af-a0417004b5a4 req-ab502845-032d-4395-9d69-67cf2ab73478 service nova] [instance: 0c1b05ee-4fc3-44b9-b689-52d07841da4c] No waiting events found dispatching network-vif-plugged-b339298b-9a14-4a36-a53e-7d1e6a2d85ff {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:42:12 user nova-compute[72382]: WARNING nova.compute.manager [req-45d63e86-2aaf-4be7-b9af-a0417004b5a4 req-ab502845-032d-4395-9d69-67cf2ab73478 service nova] [instance: 0c1b05ee-4fc3-44b9-b689-52d07841da4c] Received unexpected event network-vif-plugged-b339298b-9a14-4a36-a53e-7d1e6a2d85ff for instance with vm_state building and task_state spawning.
Aug 09 15:42:12 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:42:12 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:42:12 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:42:12 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:42:14 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8af4a51f-51bc-40d4-b90b-d4a8af8ad6f1 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] [instance: 0c1b05ee-4fc3-44b9-b689-52d07841da4c] Instance event wait completed in 0 seconds for  {{(pid=72382) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 15:42:14 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-8af4a51f-51bc-40d4-b90b-d4a8af8ad6f1 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] [instance: 0c1b05ee-4fc3-44b9-b689-52d07841da4c] Guest created on hypervisor {{(pid=72382) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 15:42:14 user nova-compute[72382]: DEBUG nova.virt.driver [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Emitting event <LifecycleEvent: 1691595734.1464412, 0c1b05ee-4fc3-44b9-b689-52d07841da4c => Resumed> {{(pid=72382) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 15:42:14 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 0c1b05ee-4fc3-44b9-b689-52d07841da4c] VM Resumed (Lifecycle Event)
Aug 09 15:42:14 user nova-compute[72382]: INFO nova.virt.libvirt.driver [-] [instance: 0c1b05ee-4fc3-44b9-b689-52d07841da4c] Instance spawned successfully.
Aug 09 15:42:14 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-8af4a51f-51bc-40d4-b90b-d4a8af8ad6f1 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] [instance: 0c1b05ee-4fc3-44b9-b689-52d07841da4c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 15:42:14 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 0c1b05ee-4fc3-44b9-b689-52d07841da4c] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:42:14 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 0c1b05ee-4fc3-44b9-b689-52d07841da4c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72382) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 15:42:14 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-8af4a51f-51bc-40d4-b90b-d4a8af8ad6f1 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] [instance: 0c1b05ee-4fc3-44b9-b689-52d07841da4c] Found default for hw_cdrom_bus of ide {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:42:14 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-8af4a51f-51bc-40d4-b90b-d4a8af8ad6f1 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] [instance: 0c1b05ee-4fc3-44b9-b689-52d07841da4c] Found default for hw_disk_bus of virtio {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:42:14 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-8af4a51f-51bc-40d4-b90b-d4a8af8ad6f1 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] [instance: 0c1b05ee-4fc3-44b9-b689-52d07841da4c] Found default for hw_input_bus of None {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:42:14 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-8af4a51f-51bc-40d4-b90b-d4a8af8ad6f1 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] [instance: 0c1b05ee-4fc3-44b9-b689-52d07841da4c] Found default for hw_pointer_model of None {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:42:14 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-8af4a51f-51bc-40d4-b90b-d4a8af8ad6f1 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] [instance: 0c1b05ee-4fc3-44b9-b689-52d07841da4c] Found default for hw_video_model of virtio {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:42:14 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-8af4a51f-51bc-40d4-b90b-d4a8af8ad6f1 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] [instance: 0c1b05ee-4fc3-44b9-b689-52d07841da4c] Found default for hw_vif_model of virtio {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:42:14 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 0c1b05ee-4fc3-44b9-b689-52d07841da4c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 15:42:14 user nova-compute[72382]: DEBUG nova.virt.driver [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Emitting event <LifecycleEvent: 1691595734.146566, 0c1b05ee-4fc3-44b9-b689-52d07841da4c => Started> {{(pid=72382) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 15:42:14 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 0c1b05ee-4fc3-44b9-b689-52d07841da4c] VM Started (Lifecycle Event)
Aug 09 15:42:14 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 0c1b05ee-4fc3-44b9-b689-52d07841da4c] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:42:14 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 0c1b05ee-4fc3-44b9-b689-52d07841da4c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72382) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 15:42:14 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 0c1b05ee-4fc3-44b9-b689-52d07841da4c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 15:42:14 user nova-compute[72382]: INFO nova.compute.manager [None req-8af4a51f-51bc-40d4-b90b-d4a8af8ad6f1 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] [instance: 0c1b05ee-4fc3-44b9-b689-52d07841da4c] Took 6.79 seconds to spawn the instance on the hypervisor.
Aug 09 15:42:14 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8af4a51f-51bc-40d4-b90b-d4a8af8ad6f1 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] [instance: 0c1b05ee-4fc3-44b9-b689-52d07841da4c] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:42:14 user nova-compute[72382]: INFO nova.compute.manager [None req-8af4a51f-51bc-40d4-b90b-d4a8af8ad6f1 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] [instance: 0c1b05ee-4fc3-44b9-b689-52d07841da4c] Took 7.47 seconds to build instance.
Aug 09 15:42:14 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-8af4a51f-51bc-40d4-b90b-d4a8af8ad6f1 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Lock "0c1b05ee-4fc3-44b9-b689-52d07841da4c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.565s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:42:14 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "0c1b05ee-4fc3-44b9-b689-52d07841da4c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 5.276s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:42:14 user nova-compute[72382]: INFO nova.compute.manager [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] [instance: 0c1b05ee-4fc3-44b9-b689-52d07841da4c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 15:42:14 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "0c1b05ee-4fc3-44b9-b689-52d07841da4c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:42:14 user nova-compute[72382]: DEBUG nova.compute.manager [req-4c8bc27a-6823-43e2-9c7a-6be61a63e776 req-27eb60d2-cb27-4d68-b756-6c0ccc04c469 service nova] [instance: 0c1b05ee-4fc3-44b9-b689-52d07841da4c] Received event network-vif-plugged-b339298b-9a14-4a36-a53e-7d1e6a2d85ff {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:42:14 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-4c8bc27a-6823-43e2-9c7a-6be61a63e776 req-27eb60d2-cb27-4d68-b756-6c0ccc04c469 service nova] Acquiring lock "0c1b05ee-4fc3-44b9-b689-52d07841da4c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:42:14 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-4c8bc27a-6823-43e2-9c7a-6be61a63e776 req-27eb60d2-cb27-4d68-b756-6c0ccc04c469 service nova] Lock "0c1b05ee-4fc3-44b9-b689-52d07841da4c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:42:14 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-4c8bc27a-6823-43e2-9c7a-6be61a63e776 req-27eb60d2-cb27-4d68-b756-6c0ccc04c469 service nova] Lock "0c1b05ee-4fc3-44b9-b689-52d07841da4c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:42:14 user nova-compute[72382]: DEBUG nova.compute.manager [req-4c8bc27a-6823-43e2-9c7a-6be61a63e776 req-27eb60d2-cb27-4d68-b756-6c0ccc04c469 service nova] [instance: 0c1b05ee-4fc3-44b9-b689-52d07841da4c] No waiting events found dispatching network-vif-plugged-b339298b-9a14-4a36-a53e-7d1e6a2d85ff {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:42:14 user nova-compute[72382]: WARNING nova.compute.manager [req-4c8bc27a-6823-43e2-9c7a-6be61a63e776 req-27eb60d2-cb27-4d68-b756-6c0ccc04c469 service nova] [instance: 0c1b05ee-4fc3-44b9-b689-52d07841da4c] Received unexpected event network-vif-plugged-b339298b-9a14-4a36-a53e-7d1e6a2d85ff for instance with vm_state active and task_state None.
Aug 09 15:42:14 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:42:15 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:42:17 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:42:17 user nova-compute[72382]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691595722.8908136, 54523d3e-bfae-4621-85cb-d6a7bc40abf5 => Stopped> {{(pid=72382) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 15:42:17 user nova-compute[72382]: INFO nova.compute.manager [-] [instance: 54523d3e-bfae-4621-85cb-d6a7bc40abf5] VM Stopped (Lifecycle Event)
Aug 09 15:42:17 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:42:17 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:42:17 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:42:17 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Auditing locally available compute resources for user (node: user) {{(pid=72382) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 15:42:17 user nova-compute[72382]: DEBUG nova.compute.manager [None req-7e5ab59d-825e-44e3-929e-608bba0682c0 None None] [instance: 54523d3e-bfae-4621-85cb-d6a7bc40abf5] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:42:18 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c914d94-5bfd-4984-8937-37bdf02e9674/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:42:18 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c914d94-5bfd-4984-8937-37bdf02e9674/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:42:18 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c914d94-5bfd-4984-8937-37bdf02e9674/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:42:18 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c914d94-5bfd-4984-8937-37bdf02e9674/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:42:18 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ccbfda2-8bcd-4ec1-972a-cf49a62b1583/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:42:18 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ccbfda2-8bcd-4ec1-972a-cf49a62b1583/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:42:18 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ccbfda2-8bcd-4ec1-972a-cf49a62b1583/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:42:18 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ccbfda2-8bcd-4ec1-972a-cf49a62b1583/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:42:18 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c1b05ee-4fc3-44b9-b689-52d07841da4c/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:42:18 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c1b05ee-4fc3-44b9-b689-52d07841da4c/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:42:18 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c1b05ee-4fc3-44b9-b689-52d07841da4c/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:42:19 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c1b05ee-4fc3-44b9-b689-52d07841da4c/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:42:19 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72382) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 15:42:19 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72382) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 15:42:19 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d27c5a4-9a88-423b-9c48-9224e8248f8c/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:42:19 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d27c5a4-9a88-423b-9c48-9224e8248f8c/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:42:19 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d27c5a4-9a88-423b-9c48-9224e8248f8c/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:42:19 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d27c5a4-9a88-423b-9c48-9224e8248f8c/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:42:19 user nova-compute[72382]: WARNING nova.virt.libvirt.driver [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 15:42:19 user nova-compute[72382]: WARNING nova.virt.libvirt.driver [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 15:42:19 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Hypervisor/Node resource view: name=user free_ram=7962MB free_disk=25.321102142333984GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72382) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 15:42:19 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:42:19 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:42:19 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:42:19 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance 4ccbfda2-8bcd-4ec1-972a-cf49a62b1583 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:42:19 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance 3855b76f-87cc-4be0-982c-4cc5cf5cd8aa actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:42:19 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance 5c914d94-5bfd-4984-8937-37bdf02e9674 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:42:19 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance f49b5daf-d39d-496f-97d7-a0d9fd67d66d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:42:19 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance 4d27c5a4-9a88-423b-9c48-9224e8248f8c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:42:19 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance 0c1b05ee-4fc3-44b9-b689-52d07841da4c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:42:19 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=72382) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 15:42:19 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=72382) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 15:42:20 user nova-compute[72382]: DEBUG nova.compute.provider_tree [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Inventory has not changed in ProviderTree for provider: 7b15b0e5-df4d-49db-833b-2855d21d10ae {{(pid=72382) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 15:42:20 user nova-compute[72382]: DEBUG nova.scheduler.client.report [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Inventory has not changed for provider 7b15b0e5-df4d-49db-833b-2855d21d10ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72382) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 15:42:20 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Compute_service record updated for user:user {{(pid=72382) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 15:42:20 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.423s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:42:20 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:42:23 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:42:23 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:42:23 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:42:24 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:42:25 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-56b60306-edd9-47fb-9857-bb6e3b48952f tempest-VolumesNegativeTest-369748005 tempest-VolumesNegativeTest-369748005-project-member] Acquiring lock "6cfe9b0a-4ee9-4b4e-a8ac-d492937113ae" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:42:25 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-56b60306-edd9-47fb-9857-bb6e3b48952f tempest-VolumesNegativeTest-369748005 tempest-VolumesNegativeTest-369748005-project-member] Lock "6cfe9b0a-4ee9-4b4e-a8ac-d492937113ae" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:42:25 user nova-compute[72382]: DEBUG nova.compute.manager [None req-56b60306-edd9-47fb-9857-bb6e3b48952f tempest-VolumesNegativeTest-369748005 tempest-VolumesNegativeTest-369748005-project-member] [instance: 6cfe9b0a-4ee9-4b4e-a8ac-d492937113ae] Starting instance... {{(pid=72382) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 15:42:25 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-56b60306-edd9-47fb-9857-bb6e3b48952f tempest-VolumesNegativeTest-369748005 tempest-VolumesNegativeTest-369748005-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:42:25 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-56b60306-edd9-47fb-9857-bb6e3b48952f tempest-VolumesNegativeTest-369748005 tempest-VolumesNegativeTest-369748005-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:42:25 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-56b60306-edd9-47fb-9857-bb6e3b48952f tempest-VolumesNegativeTest-369748005 tempest-VolumesNegativeTest-369748005-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72382) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 15:42:25 user nova-compute[72382]: INFO nova.compute.claims [None req-56b60306-edd9-47fb-9857-bb6e3b48952f tempest-VolumesNegativeTest-369748005 tempest-VolumesNegativeTest-369748005-project-member] [instance: 6cfe9b0a-4ee9-4b4e-a8ac-d492937113ae] Claim successful on node user
Aug 09 15:42:25 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:42:25 user nova-compute[72382]: DEBUG nova.compute.provider_tree [None req-56b60306-edd9-47fb-9857-bb6e3b48952f tempest-VolumesNegativeTest-369748005 tempest-VolumesNegativeTest-369748005-project-member] Inventory has not changed in ProviderTree for provider: 7b15b0e5-df4d-49db-833b-2855d21d10ae {{(pid=72382) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 15:42:25 user nova-compute[72382]: DEBUG nova.scheduler.client.report [None req-56b60306-edd9-47fb-9857-bb6e3b48952f tempest-VolumesNegativeTest-369748005 tempest-VolumesNegativeTest-369748005-project-member] Inventory has not changed for provider 7b15b0e5-df4d-49db-833b-2855d21d10ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72382) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 15:42:25 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-56b60306-edd9-47fb-9857-bb6e3b48952f tempest-VolumesNegativeTest-369748005 tempest-VolumesNegativeTest-369748005-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.330s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:42:25 user nova-compute[72382]: DEBUG nova.compute.manager [None req-56b60306-edd9-47fb-9857-bb6e3b48952f tempest-VolumesNegativeTest-369748005 tempest-VolumesNegativeTest-369748005-project-member] [instance: 6cfe9b0a-4ee9-4b4e-a8ac-d492937113ae] Start building networks asynchronously for instance. {{(pid=72382) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 15:42:25 user nova-compute[72382]: DEBUG nova.compute.manager [None req-56b60306-edd9-47fb-9857-bb6e3b48952f tempest-VolumesNegativeTest-369748005 tempest-VolumesNegativeTest-369748005-project-member] [instance: 6cfe9b0a-4ee9-4b4e-a8ac-d492937113ae] Allocating IP information in the background. {{(pid=72382) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 15:42:25 user nova-compute[72382]: DEBUG nova.network.neutron [None req-56b60306-edd9-47fb-9857-bb6e3b48952f tempest-VolumesNegativeTest-369748005 tempest-VolumesNegativeTest-369748005-project-member] [instance: 6cfe9b0a-4ee9-4b4e-a8ac-d492937113ae] allocate_for_instance() {{(pid=72382) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 15:42:25 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-56b60306-edd9-47fb-9857-bb6e3b48952f tempest-VolumesNegativeTest-369748005 tempest-VolumesNegativeTest-369748005-project-member] [instance: 6cfe9b0a-4ee9-4b4e-a8ac-d492937113ae] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 15:42:25 user nova-compute[72382]: DEBUG nova.compute.manager [None req-56b60306-edd9-47fb-9857-bb6e3b48952f tempest-VolumesNegativeTest-369748005 tempest-VolumesNegativeTest-369748005-project-member] [instance: 6cfe9b0a-4ee9-4b4e-a8ac-d492937113ae] Start building block device mappings for instance. {{(pid=72382) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 15:42:25 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:42:25 user nova-compute[72382]: DEBUG nova.compute.manager [None req-56b60306-edd9-47fb-9857-bb6e3b48952f tempest-VolumesNegativeTest-369748005 tempest-VolumesNegativeTest-369748005-project-member] [instance: 6cfe9b0a-4ee9-4b4e-a8ac-d492937113ae] Start spawning the instance on the hypervisor. {{(pid=72382) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 15:42:25 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-56b60306-edd9-47fb-9857-bb6e3b48952f tempest-VolumesNegativeTest-369748005 tempest-VolumesNegativeTest-369748005-project-member] [instance: 6cfe9b0a-4ee9-4b4e-a8ac-d492937113ae] Creating instance directory {{(pid=72382) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 15:42:25 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-56b60306-edd9-47fb-9857-bb6e3b48952f tempest-VolumesNegativeTest-369748005 tempest-VolumesNegativeTest-369748005-project-member] [instance: 6cfe9b0a-4ee9-4b4e-a8ac-d492937113ae] Creating image(s)
Aug 09 15:42:25 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-56b60306-edd9-47fb-9857-bb6e3b48952f tempest-VolumesNegativeTest-369748005 tempest-VolumesNegativeTest-369748005-project-member] Acquiring lock "/opt/stack/data/nova/instances/6cfe9b0a-4ee9-4b4e-a8ac-d492937113ae/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:42:25 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-56b60306-edd9-47fb-9857-bb6e3b48952f tempest-VolumesNegativeTest-369748005 tempest-VolumesNegativeTest-369748005-project-member] Lock "/opt/stack/data/nova/instances/6cfe9b0a-4ee9-4b4e-a8ac-d492937113ae/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:42:25 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-56b60306-edd9-47fb-9857-bb6e3b48952f tempest-VolumesNegativeTest-369748005 tempest-VolumesNegativeTest-369748005-project-member] Lock "/opt/stack/data/nova/instances/6cfe9b0a-4ee9-4b4e-a8ac-d492937113ae/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:42:25 user nova-compute[72382]: DEBUG nova.policy [None req-56b60306-edd9-47fb-9857-bb6e3b48952f tempest-VolumesNegativeTest-369748005 tempest-VolumesNegativeTest-369748005-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '594ec45a7fb54111a8f8c58629857d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c352a05f6bf84d689287ff9df7b2c2e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72382) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 15:42:25 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-56b60306-edd9-47fb-9857-bb6e3b48952f tempest-VolumesNegativeTest-369748005 tempest-VolumesNegativeTest-369748005-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:42:26 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-56b60306-edd9-47fb-9857-bb6e3b48952f tempest-VolumesNegativeTest-369748005 tempest-VolumesNegativeTest-369748005-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b --force-share --output=json" returned: 0 in 0.139s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:42:26 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-56b60306-edd9-47fb-9857-bb6e3b48952f tempest-VolumesNegativeTest-369748005 tempest-VolumesNegativeTest-369748005-project-member] Acquiring lock "383812ff437283e0191ed5b9ecc04c27f1162b0b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:42:26 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-56b60306-edd9-47fb-9857-bb6e3b48952f tempest-VolumesNegativeTest-369748005 tempest-VolumesNegativeTest-369748005-project-member] Lock "383812ff437283e0191ed5b9ecc04c27f1162b0b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:42:26 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-56b60306-edd9-47fb-9857-bb6e3b48952f tempest-VolumesNegativeTest-369748005 tempest-VolumesNegativeTest-369748005-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:42:26 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-56b60306-edd9-47fb-9857-bb6e3b48952f tempest-VolumesNegativeTest-369748005 tempest-VolumesNegativeTest-369748005-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b --force-share --output=json" returned: 0 in 0.170s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:42:26 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-56b60306-edd9-47fb-9857-bb6e3b48952f tempest-VolumesNegativeTest-369748005 tempest-VolumesNegativeTest-369748005-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b,backing_fmt=raw /opt/stack/data/nova/instances/6cfe9b0a-4ee9-4b4e-a8ac-d492937113ae/disk 1073741824 {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:42:26 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-56b60306-edd9-47fb-9857-bb6e3b48952f tempest-VolumesNegativeTest-369748005 tempest-VolumesNegativeTest-369748005-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b,backing_fmt=raw /opt/stack/data/nova/instances/6cfe9b0a-4ee9-4b4e-a8ac-d492937113ae/disk 1073741824" returned: 0 in 0.058s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:42:26 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-56b60306-edd9-47fb-9857-bb6e3b48952f tempest-VolumesNegativeTest-369748005 tempest-VolumesNegativeTest-369748005-project-member] Lock "383812ff437283e0191ed5b9ecc04c27f1162b0b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.235s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:42:26 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-56b60306-edd9-47fb-9857-bb6e3b48952f tempest-VolumesNegativeTest-369748005 tempest-VolumesNegativeTest-369748005-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:42:26 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-56b60306-edd9-47fb-9857-bb6e3b48952f tempest-VolumesNegativeTest-369748005 tempest-VolumesNegativeTest-369748005-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b --force-share --output=json" returned: 0 in 0.142s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:42:26 user nova-compute[72382]: DEBUG nova.virt.disk.api [None req-56b60306-edd9-47fb-9857-bb6e3b48952f tempest-VolumesNegativeTest-369748005 tempest-VolumesNegativeTest-369748005-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6cfe9b0a-4ee9-4b4e-a8ac-d492937113ae/disk. size=1073741824 {{(pid=72382) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 15:42:26 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-56b60306-edd9-47fb-9857-bb6e3b48952f tempest-VolumesNegativeTest-369748005 tempest-VolumesNegativeTest-369748005-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cfe9b0a-4ee9-4b4e-a8ac-d492937113ae/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:42:26 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-56b60306-edd9-47fb-9857-bb6e3b48952f tempest-VolumesNegativeTest-369748005 tempest-VolumesNegativeTest-369748005-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cfe9b0a-4ee9-4b4e-a8ac-d492937113ae/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:42:26 user nova-compute[72382]: DEBUG nova.virt.disk.api [None req-56b60306-edd9-47fb-9857-bb6e3b48952f tempest-VolumesNegativeTest-369748005 tempest-VolumesNegativeTest-369748005-project-member] Cannot resize image /opt/stack/data/nova/instances/6cfe9b0a-4ee9-4b4e-a8ac-d492937113ae/disk to a smaller size. {{(pid=72382) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 15:42:26 user nova-compute[72382]: DEBUG nova.objects.instance [None req-56b60306-edd9-47fb-9857-bb6e3b48952f tempest-VolumesNegativeTest-369748005 tempest-VolumesNegativeTest-369748005-project-member] Lazy-loading 'migration_context' on Instance uuid 6cfe9b0a-4ee9-4b4e-a8ac-d492937113ae {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:42:26 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-56b60306-edd9-47fb-9857-bb6e3b48952f tempest-VolumesNegativeTest-369748005 tempest-VolumesNegativeTest-369748005-project-member] [instance: 6cfe9b0a-4ee9-4b4e-a8ac-d492937113ae] Created local disks {{(pid=72382) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 15:42:26 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-56b60306-edd9-47fb-9857-bb6e3b48952f tempest-VolumesNegativeTest-369748005 tempest-VolumesNegativeTest-369748005-project-member] [instance: 6cfe9b0a-4ee9-4b4e-a8ac-d492937113ae] Ensure instance console log exists: /opt/stack/data/nova/instances/6cfe9b0a-4ee9-4b4e-a8ac-d492937113ae/console.log {{(pid=72382) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 15:42:26 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-56b60306-edd9-47fb-9857-bb6e3b48952f tempest-VolumesNegativeTest-369748005 tempest-VolumesNegativeTest-369748005-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:42:26 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-56b60306-edd9-47fb-9857-bb6e3b48952f tempest-VolumesNegativeTest-369748005 tempest-VolumesNegativeTest-369748005-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:42:26 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-56b60306-edd9-47fb-9857-bb6e3b48952f tempest-VolumesNegativeTest-369748005 tempest-VolumesNegativeTest-369748005-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:42:26 user nova-compute[72382]: DEBUG nova.network.neutron [None req-56b60306-edd9-47fb-9857-bb6e3b48952f tempest-VolumesNegativeTest-369748005 tempest-VolumesNegativeTest-369748005-project-member] [instance: 6cfe9b0a-4ee9-4b4e-a8ac-d492937113ae] Successfully created port: 833ca878-3d8d-441d-9b9e-7810c1c8c837 {{(pid=72382) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 15:42:26 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:42:26 user nova-compute[72382]: DEBUG nova.compute.manager [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72382) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 15:42:27 user nova-compute[72382]: DEBUG nova.network.neutron [None req-56b60306-edd9-47fb-9857-bb6e3b48952f tempest-VolumesNegativeTest-369748005 tempest-VolumesNegativeTest-369748005-project-member] [instance: 6cfe9b0a-4ee9-4b4e-a8ac-d492937113ae] Successfully updated port: 833ca878-3d8d-441d-9b9e-7810c1c8c837 {{(pid=72382) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 15:42:27 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-56b60306-edd9-47fb-9857-bb6e3b48952f tempest-VolumesNegativeTest-369748005 tempest-VolumesNegativeTest-369748005-project-member] Acquiring lock "refresh_cache-6cfe9b0a-4ee9-4b4e-a8ac-d492937113ae" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 15:42:27 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-56b60306-edd9-47fb-9857-bb6e3b48952f tempest-VolumesNegativeTest-369748005 tempest-VolumesNegativeTest-369748005-project-member] Acquired lock "refresh_cache-6cfe9b0a-4ee9-4b4e-a8ac-d492937113ae" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 15:42:27 user nova-compute[72382]: DEBUG nova.network.neutron [None req-56b60306-edd9-47fb-9857-bb6e3b48952f tempest-VolumesNegativeTest-369748005 tempest-VolumesNegativeTest-369748005-project-member] [instance: 6cfe9b0a-4ee9-4b4e-a8ac-d492937113ae] Building network info cache for instance {{(pid=72382) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 15:42:27 user nova-compute[72382]: DEBUG nova.compute.manager [req-27feafb9-ee90-4585-825e-71fd0cb9df4e req-4b805e29-271b-40cc-911e-a25656bde71a service nova] [instance: 6cfe9b0a-4ee9-4b4e-a8ac-d492937113ae] Received event network-changed-833ca878-3d8d-441d-9b9e-7810c1c8c837 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:42:27 user nova-compute[72382]: DEBUG nova.compute.manager [req-27feafb9-ee90-4585-825e-71fd0cb9df4e req-4b805e29-271b-40cc-911e-a25656bde71a service nova] [instance: 6cfe9b0a-4ee9-4b4e-a8ac-d492937113ae] Refreshing instance network info cache due to event network-changed-833ca878-3d8d-441d-9b9e-7810c1c8c837. {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 15:42:27 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-27feafb9-ee90-4585-825e-71fd0cb9df4e req-4b805e29-271b-40cc-911e-a25656bde71a service nova] Acquiring lock "refresh_cache-6cfe9b0a-4ee9-4b4e-a8ac-d492937113ae" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 15:42:27 user nova-compute[72382]: DEBUG nova.network.neutron [None req-56b60306-edd9-47fb-9857-bb6e3b48952f tempest-VolumesNegativeTest-369748005 tempest-VolumesNegativeTest-369748005-project-member] [instance: 6cfe9b0a-4ee9-4b4e-a8ac-d492937113ae] Instance cache missing network info. {{(pid=72382) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 15:42:27 user nova-compute[72382]: DEBUG nova.network.neutron [None req-56b60306-edd9-47fb-9857-bb6e3b48952f tempest-VolumesNegativeTest-369748005 tempest-VolumesNegativeTest-369748005-project-member] [instance: 6cfe9b0a-4ee9-4b4e-a8ac-d492937113ae] Updating instance_info_cache with network_info: [{"id": "833ca878-3d8d-441d-9b9e-7810c1c8c837", "address": "fa:16:3e:5a:ee:7a", "network": {"id": "ee1c2221-0f61-44cb-9ecf-b55dc8b55c94", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.204", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "a638990e12cc4d6eabb6d55e13be6bdf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap833ca878-3d", "ovs_interfaceid": "833ca878-3d8d-441d-9b9e-7810c1c8c837", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:42:27 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-56b60306-edd9-47fb-9857-bb6e3b48952f tempest-VolumesNegativeTest-369748005 tempest-VolumesNegativeTest-369748005-project-member] Releasing lock "refresh_cache-6cfe9b0a-4ee9-4b4e-a8ac-d492937113ae" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 15:42:27 user nova-compute[72382]: DEBUG nova.compute.manager [None req-56b60306-edd9-47fb-9857-bb6e3b48952f tempest-VolumesNegativeTest-369748005 tempest-VolumesNegativeTest-369748005-project-member] [instance: 6cfe9b0a-4ee9-4b4e-a8ac-d492937113ae] Instance network_info: |[{"id": "833ca878-3d8d-441d-9b9e-7810c1c8c837", "address": "fa:16:3e:5a:ee:7a", "network": {"id": "ee1c2221-0f61-44cb-9ecf-b55dc8b55c94", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.204", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "a638990e12cc4d6eabb6d55e13be6bdf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap833ca878-3d", "ovs_interfaceid": "833ca878-3d8d-441d-9b9e-7810c1c8c837", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72382) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 15:42:27 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-27feafb9-ee90-4585-825e-71fd0cb9df4e req-4b805e29-271b-40cc-911e-a25656bde71a service nova] Acquired lock "refresh_cache-6cfe9b0a-4ee9-4b4e-a8ac-d492937113ae" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 15:42:27 user nova-compute[72382]: DEBUG nova.network.neutron [req-27feafb9-ee90-4585-825e-71fd0cb9df4e req-4b805e29-271b-40cc-911e-a25656bde71a service nova] [instance: 6cfe9b0a-4ee9-4b4e-a8ac-d492937113ae] Refreshing network info cache for port 833ca878-3d8d-441d-9b9e-7810c1c8c837 {{(pid=72382) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 15:42:27 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-56b60306-edd9-47fb-9857-bb6e3b48952f tempest-VolumesNegativeTest-369748005 tempest-VolumesNegativeTest-369748005-project-member] [instance: 6cfe9b0a-4ee9-4b4e-a8ac-d492937113ae] Start _get_guest_xml network_info=[{"id": "833ca878-3d8d-441d-9b9e-7810c1c8c837", "address": "fa:16:3e:5a:ee:7a", "network": {"id": "ee1c2221-0f61-44cb-9ecf-b55dc8b55c94", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.204", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "a638990e12cc4d6eabb6d55e13be6bdf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap833ca878-3d", "ovs_interfaceid": "833ca878-3d8d-441d-9b9e-7810c1c8c837", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T15:11:25Z,direct_url=<?>,disk_format='qcow2',id=a79f2cea-eb27-4631-aaf3-05e7d9e411b4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a638990e12cc4d6eabb6d55e13be6bdf',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T15:11:27Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'a79f2cea-eb27-4631-aaf3-05e7d9e411b4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72382) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 15:42:27 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:42:27 user nova-compute[72382]: DEBUG nova.compute.manager [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Starting heal instance info cache {{(pid=72382) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 15:42:27 user nova-compute[72382]: WARNING nova.virt.libvirt.driver [None req-56b60306-edd9-47fb-9857-bb6e3b48952f tempest-VolumesNegativeTest-369748005 tempest-VolumesNegativeTest-369748005-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 15:42:27 user nova-compute[72382]: WARNING nova.virt.libvirt.driver [None req-56b60306-edd9-47fb-9857-bb6e3b48952f tempest-VolumesNegativeTest-369748005 tempest-VolumesNegativeTest-369748005-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 15:42:27 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-56b60306-edd9-47fb-9857-bb6e3b48952f tempest-VolumesNegativeTest-369748005 tempest-VolumesNegativeTest-369748005-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72382) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 15:42:27 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-56b60306-edd9-47fb-9857-bb6e3b48952f tempest-VolumesNegativeTest-369748005 tempest-VolumesNegativeTest-369748005-project-member] CPU controller missing on host. {{(pid=72382) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 15:42:27 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-56b60306-edd9-47fb-9857-bb6e3b48952f tempest-VolumesNegativeTest-369748005 tempest-VolumesNegativeTest-369748005-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72382) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 15:42:27 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-56b60306-edd9-47fb-9857-bb6e3b48952f tempest-VolumesNegativeTest-369748005 tempest-VolumesNegativeTest-369748005-project-member] CPU controller found on host. {{(pid=72382) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 15:42:27 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-56b60306-edd9-47fb-9857-bb6e3b48952f tempest-VolumesNegativeTest-369748005 tempest-VolumesNegativeTest-369748005-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72382) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 15:42:27 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-56b60306-edd9-47fb-9857-bb6e3b48952f tempest-VolumesNegativeTest-369748005 tempest-VolumesNegativeTest-369748005-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T15:11:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T15:11:25Z,direct_url=<?>,disk_format='qcow2',id=a79f2cea-eb27-4631-aaf3-05e7d9e411b4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a638990e12cc4d6eabb6d55e13be6bdf',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T15:11:27Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 15:42:27 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-56b60306-edd9-47fb-9857-bb6e3b48952f tempest-VolumesNegativeTest-369748005 tempest-VolumesNegativeTest-369748005-project-member] Flavor limits 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 15:42:27 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-56b60306-edd9-47fb-9857-bb6e3b48952f tempest-VolumesNegativeTest-369748005 tempest-VolumesNegativeTest-369748005-project-member] Image limits 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 15:42:27 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-56b60306-edd9-47fb-9857-bb6e3b48952f tempest-VolumesNegativeTest-369748005 tempest-VolumesNegativeTest-369748005-project-member] Flavor pref 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 15:42:27 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-56b60306-edd9-47fb-9857-bb6e3b48952f tempest-VolumesNegativeTest-369748005 tempest-VolumesNegativeTest-369748005-project-member] Image pref 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 15:42:27 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-56b60306-edd9-47fb-9857-bb6e3b48952f tempest-VolumesNegativeTest-369748005 tempest-VolumesNegativeTest-369748005-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 15:42:27 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-56b60306-edd9-47fb-9857-bb6e3b48952f tempest-VolumesNegativeTest-369748005 tempest-VolumesNegativeTest-369748005-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 15:42:27 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-56b60306-edd9-47fb-9857-bb6e3b48952f tempest-VolumesNegativeTest-369748005 tempest-VolumesNegativeTest-369748005-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72382) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 15:42:27 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-56b60306-edd9-47fb-9857-bb6e3b48952f tempest-VolumesNegativeTest-369748005 tempest-VolumesNegativeTest-369748005-project-member] Got 1 possible topologies {{(pid=72382) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 15:42:27 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-56b60306-edd9-47fb-9857-bb6e3b48952f tempest-VolumesNegativeTest-369748005 tempest-VolumesNegativeTest-369748005-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 15:42:27 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-56b60306-edd9-47fb-9857-bb6e3b48952f tempest-VolumesNegativeTest-369748005 tempest-VolumesNegativeTest-369748005-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 15:42:27 user nova-compute[72382]: DEBUG nova.virt.libvirt.vif [None req-56b60306-edd9-47fb-9857-bb6e3b48952f tempest-VolumesNegativeTest-369748005 tempest-VolumesNegativeTest-369748005-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T15:42:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1847595310',display_name='tempest-VolumesNegativeTest-instance-1847595310',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1847595310',id=50,image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c352a05f6bf84d689287ff9df7b2c2e2',ramdisk_id='',reservation_id='r-k7a1zwnv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-369748005',owner_user_name='tempest-VolumesNegativeTest-369748005-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T15:42:26Z,user_data=None,user_id='594ec45a7fb54111a8f8c58629857d1e',uuid=6cfe9b0a-4ee9-4b4e-a8ac-d492937113ae,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "833ca878-3d8d-441d-9b9e-7810c1c8c837", "address": "fa:16:3e:5a:ee:7a", "network": {"id": "ee1c2221-0f61-44cb-9ecf-b55dc8b55c94", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.204", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "a638990e12cc4d6eabb6d55e13be6bdf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap833ca878-3d", "ovs_interfaceid": "833ca878-3d8d-441d-9b9e-7810c1c8c837", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72382) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 15:42:27 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-56b60306-edd9-47fb-9857-bb6e3b48952f tempest-VolumesNegativeTest-369748005 tempest-VolumesNegativeTest-369748005-project-member] Converting VIF {"id": "833ca878-3d8d-441d-9b9e-7810c1c8c837", "address": "fa:16:3e:5a:ee:7a", "network": {"id": "ee1c2221-0f61-44cb-9ecf-b55dc8b55c94", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.204", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "a638990e12cc4d6eabb6d55e13be6bdf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap833ca878-3d", "ovs_interfaceid": "833ca878-3d8d-441d-9b9e-7810c1c8c837", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 15:42:27 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-56b60306-edd9-47fb-9857-bb6e3b48952f tempest-VolumesNegativeTest-369748005 tempest-VolumesNegativeTest-369748005-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5a:ee:7a,bridge_name='br-int',has_traffic_filtering=True,id=833ca878-3d8d-441d-9b9e-7810c1c8c837,network=Network(ee1c2221-0f61-44cb-9ecf-b55dc8b55c94),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap833ca878-3d') {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 15:42:27 user nova-compute[72382]: DEBUG nova.objects.instance [None req-56b60306-edd9-47fb-9857-bb6e3b48952f tempest-VolumesNegativeTest-369748005 tempest-VolumesNegativeTest-369748005-project-member] Lazy-loading 'pci_devices' on Instance uuid 6cfe9b0a-4ee9-4b4e-a8ac-d492937113ae {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:42:27 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-56b60306-edd9-47fb-9857-bb6e3b48952f tempest-VolumesNegativeTest-369748005 tempest-VolumesNegativeTest-369748005-project-member] [instance: 6cfe9b0a-4ee9-4b4e-a8ac-d492937113ae] End _get_guest_xml xml=<domain type="kvm">
Aug 09 15:42:27 user nova-compute[72382]:   <uuid>6cfe9b0a-4ee9-4b4e-a8ac-d492937113ae</uuid>
Aug 09 15:42:27 user nova-compute[72382]:   <name>instance-00000032</name>
Aug 09 15:42:27 user nova-compute[72382]:   <memory>524288</memory>
Aug 09 15:42:27 user nova-compute[72382]:   <vcpu>1</vcpu>
Aug 09 15:42:27 user nova-compute[72382]:   <metadata>
Aug 09 15:42:27 user nova-compute[72382]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 15:42:27 user nova-compute[72382]:       <nova:package version="0.0.0"/>
Aug 09 15:42:27 user nova-compute[72382]:       <nova:name>tempest-VolumesNegativeTest-instance-1847595310</nova:name>
Aug 09 15:42:27 user nova-compute[72382]:       <nova:creationTime>2023-08-09 15:42:27</nova:creationTime>
Aug 09 15:42:27 user nova-compute[72382]:       <nova:flavor name="m1.tiny">
Aug 09 15:42:27 user nova-compute[72382]:         <nova:memory>512</nova:memory>
Aug 09 15:42:27 user nova-compute[72382]:         <nova:disk>1</nova:disk>
Aug 09 15:42:27 user nova-compute[72382]:         <nova:swap>0</nova:swap>
Aug 09 15:42:27 user nova-compute[72382]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 15:42:27 user nova-compute[72382]:         <nova:vcpus>1</nova:vcpus>
Aug 09 15:42:27 user nova-compute[72382]:       </nova:flavor>
Aug 09 15:42:27 user nova-compute[72382]:       <nova:owner>
Aug 09 15:42:27 user nova-compute[72382]:         <nova:user uuid="594ec45a7fb54111a8f8c58629857d1e">tempest-VolumesNegativeTest-369748005-project-member</nova:user>
Aug 09 15:42:27 user nova-compute[72382]:         <nova:project uuid="c352a05f6bf84d689287ff9df7b2c2e2">tempest-VolumesNegativeTest-369748005</nova:project>
Aug 09 15:42:27 user nova-compute[72382]:       </nova:owner>
Aug 09 15:42:27 user nova-compute[72382]:       <nova:root type="image" uuid="a79f2cea-eb27-4631-aaf3-05e7d9e411b4"/>
Aug 09 15:42:27 user nova-compute[72382]:       <nova:ports>
Aug 09 15:42:27 user nova-compute[72382]:         <nova:port uuid="833ca878-3d8d-441d-9b9e-7810c1c8c837">
Aug 09 15:42:27 user nova-compute[72382]:           <nova:ip type="fixed" address="192.168.233.204" ipVersion="4"/>
Aug 09 15:42:27 user nova-compute[72382]:         </nova:port>
Aug 09 15:42:27 user nova-compute[72382]:       </nova:ports>
Aug 09 15:42:27 user nova-compute[72382]:     </nova:instance>
Aug 09 15:42:27 user nova-compute[72382]:   </metadata>
Aug 09 15:42:27 user nova-compute[72382]:   <sysinfo type="smbios">
Aug 09 15:42:27 user nova-compute[72382]:     <system>
Aug 09 15:42:27 user nova-compute[72382]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 15:42:27 user nova-compute[72382]:       <entry name="product">OpenStack Nova</entry>
Aug 09 15:42:27 user nova-compute[72382]:       <entry name="version">0.0.0</entry>
Aug 09 15:42:27 user nova-compute[72382]:       <entry name="serial">6cfe9b0a-4ee9-4b4e-a8ac-d492937113ae</entry>
Aug 09 15:42:27 user nova-compute[72382]:       <entry name="uuid">6cfe9b0a-4ee9-4b4e-a8ac-d492937113ae</entry>
Aug 09 15:42:27 user nova-compute[72382]:       <entry name="family">Virtual Machine</entry>
Aug 09 15:42:27 user nova-compute[72382]:     </system>
Aug 09 15:42:27 user nova-compute[72382]:   </sysinfo>
Aug 09 15:42:27 user nova-compute[72382]:   <os>
Aug 09 15:42:27 user nova-compute[72382]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 15:42:27 user nova-compute[72382]:     <boot dev="hd"/>
Aug 09 15:42:27 user nova-compute[72382]:     <smbios mode="sysinfo"/>
Aug 09 15:42:27 user nova-compute[72382]:   </os>
Aug 09 15:42:27 user nova-compute[72382]:   <features>
Aug 09 15:42:27 user nova-compute[72382]:     <acpi/>
Aug 09 15:42:27 user nova-compute[72382]:     <apic/>
Aug 09 15:42:27 user nova-compute[72382]:     <vmcoreinfo/>
Aug 09 15:42:27 user nova-compute[72382]:   </features>
Aug 09 15:42:27 user nova-compute[72382]:   <clock offset="utc">
Aug 09 15:42:27 user nova-compute[72382]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 15:42:27 user nova-compute[72382]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 15:42:27 user nova-compute[72382]:     <timer name="hpet" present="no"/>
Aug 09 15:42:27 user nova-compute[72382]:   </clock>
Aug 09 15:42:27 user nova-compute[72382]:   <cpu mode="custom" match="exact">
Aug 09 15:42:27 user nova-compute[72382]:     <model>Nehalem</model>
Aug 09 15:42:27 user nova-compute[72382]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 15:42:27 user nova-compute[72382]:   </cpu>
Aug 09 15:42:27 user nova-compute[72382]:   <devices>
Aug 09 15:42:27 user nova-compute[72382]:     <disk type="file" device="disk">
Aug 09 15:42:27 user nova-compute[72382]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 15:42:27 user nova-compute[72382]:       <source file="/opt/stack/data/nova/instances/6cfe9b0a-4ee9-4b4e-a8ac-d492937113ae/disk"/>
Aug 09 15:42:27 user nova-compute[72382]:       <target dev="vda" bus="virtio"/>
Aug 09 15:42:27 user nova-compute[72382]:     </disk>
Aug 09 15:42:27 user nova-compute[72382]:     <interface type="ethernet">
Aug 09 15:42:27 user nova-compute[72382]:       <mac address="fa:16:3e:5a:ee:7a"/>
Aug 09 15:42:27 user nova-compute[72382]:       <model type="virtio"/>
Aug 09 15:42:27 user nova-compute[72382]:       <mtu size="1442"/>
Aug 09 15:42:27 user nova-compute[72382]:       <target dev="tap833ca878-3d"/>
Aug 09 15:42:27 user nova-compute[72382]:     </interface>
Aug 09 15:42:27 user nova-compute[72382]:     <serial type="pty">
Aug 09 15:42:27 user nova-compute[72382]:       <log file="/opt/stack/data/nova/instances/6cfe9b0a-4ee9-4b4e-a8ac-d492937113ae/console.log" append="off"/>
Aug 09 15:42:27 user nova-compute[72382]:     </serial>
Aug 09 15:42:27 user nova-compute[72382]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 15:42:27 user nova-compute[72382]:     <video>
Aug 09 15:42:27 user nova-compute[72382]:       <model type="virtio"/>
Aug 09 15:42:27 user nova-compute[72382]:     </video>
Aug 09 15:42:27 user nova-compute[72382]:     <rng model="virtio">
Aug 09 15:42:27 user nova-compute[72382]:       <backend model="random">/dev/urandom</backend>
Aug 09 15:42:27 user nova-compute[72382]:     </rng>
Aug 09 15:42:27 user nova-compute[72382]:     <controller type="usb" index="0" model="none"/>
Aug 09 15:42:27 user nova-compute[72382]:     <memballoon model="virtio">
Aug 09 15:42:27 user nova-compute[72382]:       <stats period="10"/>
Aug 09 15:42:27 user nova-compute[72382]:     </memballoon>
Aug 09 15:42:27 user nova-compute[72382]:   </devices>
Aug 09 15:42:27 user nova-compute[72382]: </domain>
Aug 09 15:42:27 user nova-compute[72382]:  {{(pid=72382) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 15:42:28 user nova-compute[72382]: DEBUG nova.virt.libvirt.vif [None req-56b60306-edd9-47fb-9857-bb6e3b48952f tempest-VolumesNegativeTest-369748005 tempest-VolumesNegativeTest-369748005-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T15:42:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1847595310',display_name='tempest-VolumesNegativeTest-instance-1847595310',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1847595310',id=50,image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c352a05f6bf84d689287ff9df7b2c2e2',ramdisk_id='',reservation_id='r-k7a1zwnv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-369748005',owner_user_name='tempest-VolumesNegativeTest-369748005-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T15:42:26Z,user_data=None,user_id='594ec45a7fb54111a8f8c58629857d1e',uuid=6cfe9b0a-4ee9-4b4e-a8ac-d492937113ae,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "833ca878-3d8d-441d-9b9e-7810c1c8c837", "address": "fa:16:3e:5a:ee:7a", "network": {"id": "ee1c2221-0f61-44cb-9ecf-b55dc8b55c94", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.204", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "a638990e12cc4d6eabb6d55e13be6bdf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap833ca878-3d", "ovs_interfaceid": "833ca878-3d8d-441d-9b9e-7810c1c8c837", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 15:42:28 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-56b60306-edd9-47fb-9857-bb6e3b48952f tempest-VolumesNegativeTest-369748005 tempest-VolumesNegativeTest-369748005-project-member] Converting VIF {"id": "833ca878-3d8d-441d-9b9e-7810c1c8c837", "address": "fa:16:3e:5a:ee:7a", "network": {"id": "ee1c2221-0f61-44cb-9ecf-b55dc8b55c94", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.204", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "a638990e12cc4d6eabb6d55e13be6bdf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap833ca878-3d", "ovs_interfaceid": "833ca878-3d8d-441d-9b9e-7810c1c8c837", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 15:42:28 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-56b60306-edd9-47fb-9857-bb6e3b48952f tempest-VolumesNegativeTest-369748005 tempest-VolumesNegativeTest-369748005-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5a:ee:7a,bridge_name='br-int',has_traffic_filtering=True,id=833ca878-3d8d-441d-9b9e-7810c1c8c837,network=Network(ee1c2221-0f61-44cb-9ecf-b55dc8b55c94),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap833ca878-3d') {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 15:42:28 user nova-compute[72382]: DEBUG os_vif [None req-56b60306-edd9-47fb-9857-bb6e3b48952f tempest-VolumesNegativeTest-369748005 tempest-VolumesNegativeTest-369748005-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:ee:7a,bridge_name='br-int',has_traffic_filtering=True,id=833ca878-3d8d-441d-9b9e-7810c1c8c837,network=Network(ee1c2221-0f61-44cb-9ecf-b55dc8b55c94),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap833ca878-3d') {{(pid=72382) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 15:42:28 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:42:28 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:42:28 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 15:42:28 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:42:28 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap833ca878-3d, may_exist=True, interface_attrs={}) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:42:28 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap833ca878-3d, col_values=(('external_ids', {'iface-id': '833ca878-3d8d-441d-9b9e-7810c1c8c837', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5a:ee:7a', 'vm-uuid': '6cfe9b0a-4ee9-4b4e-a8ac-d492937113ae'}),), if_exists=True) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:42:28 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:42:28 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:42:28 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:42:28 user nova-compute[72382]: INFO os_vif [None req-56b60306-edd9-47fb-9857-bb6e3b48952f tempest-VolumesNegativeTest-369748005 tempest-VolumesNegativeTest-369748005-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:ee:7a,bridge_name='br-int',has_traffic_filtering=True,id=833ca878-3d8d-441d-9b9e-7810c1c8c837,network=Network(ee1c2221-0f61-44cb-9ecf-b55dc8b55c94),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap833ca878-3d')
Aug 09 15:42:28 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-56b60306-edd9-47fb-9857-bb6e3b48952f tempest-VolumesNegativeTest-369748005 tempest-VolumesNegativeTest-369748005-project-member] No BDM found with device name vda, not building metadata. {{(pid=72382) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 15:42:28 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-56b60306-edd9-47fb-9857-bb6e3b48952f tempest-VolumesNegativeTest-369748005 tempest-VolumesNegativeTest-369748005-project-member] No VIF found with MAC fa:16:3e:5a:ee:7a, not building metadata {{(pid=72382) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 15:42:28 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Acquiring lock "refresh_cache-3855b76f-87cc-4be0-982c-4cc5cf5cd8aa" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 15:42:28 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Acquired lock "refresh_cache-3855b76f-87cc-4be0-982c-4cc5cf5cd8aa" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 15:42:28 user nova-compute[72382]: DEBUG nova.network.neutron [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] [instance: 3855b76f-87cc-4be0-982c-4cc5cf5cd8aa] Forcefully refreshing network info cache for instance {{(pid=72382) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 15:42:28 user nova-compute[72382]: DEBUG nova.network.neutron [req-27feafb9-ee90-4585-825e-71fd0cb9df4e req-4b805e29-271b-40cc-911e-a25656bde71a service nova] [instance: 6cfe9b0a-4ee9-4b4e-a8ac-d492937113ae] Updated VIF entry in instance network info cache for port 833ca878-3d8d-441d-9b9e-7810c1c8c837. {{(pid=72382) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 15:42:28 user nova-compute[72382]: DEBUG nova.network.neutron [req-27feafb9-ee90-4585-825e-71fd0cb9df4e req-4b805e29-271b-40cc-911e-a25656bde71a service nova] [instance: 6cfe9b0a-4ee9-4b4e-a8ac-d492937113ae] Updating instance_info_cache with network_info: [{"id": "833ca878-3d8d-441d-9b9e-7810c1c8c837", "address": "fa:16:3e:5a:ee:7a", "network": {"id": "ee1c2221-0f61-44cb-9ecf-b55dc8b55c94", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.204", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "a638990e12cc4d6eabb6d55e13be6bdf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap833ca878-3d", "ovs_interfaceid": "833ca878-3d8d-441d-9b9e-7810c1c8c837", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:42:28 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-27feafb9-ee90-4585-825e-71fd0cb9df4e req-4b805e29-271b-40cc-911e-a25656bde71a service nova] Releasing lock "refresh_cache-6cfe9b0a-4ee9-4b4e-a8ac-d492937113ae" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 15:42:28 user nova-compute[72382]: DEBUG nova.network.neutron [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] [instance: 3855b76f-87cc-4be0-982c-4cc5cf5cd8aa] Updating instance_info_cache with network_info: [{"id": "b7c16d4a-24b4-4ba6-860a-d180123dd204", "address": "fa:16:3e:01:6f:fa", "network": {"id": "a78e6cb6-feb7-4f64-a3c0-4900594b6e37", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-338007968-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70310b1af40b4d239fe5ea362972554b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7c16d4a-24", "ovs_interfaceid": "b7c16d4a-24b4-4ba6-860a-d180123dd204", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:42:28 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Releasing lock "refresh_cache-3855b76f-87cc-4be0-982c-4cc5cf5cd8aa" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 15:42:28 user nova-compute[72382]: DEBUG nova.compute.manager [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] [instance: 3855b76f-87cc-4be0-982c-4cc5cf5cd8aa] Updated the network info_cache for instance {{(pid=72382) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 15:42:29 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:42:29 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:42:29 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:42:29 user nova-compute[72382]: DEBUG nova.compute.manager [req-119a8d10-535d-4587-9ed4-c432708a8062 req-7870f29c-d6de-4e79-8ca7-f0ff588db7f0 service nova] [instance: 6cfe9b0a-4ee9-4b4e-a8ac-d492937113ae] Received event network-vif-plugged-833ca878-3d8d-441d-9b9e-7810c1c8c837 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:42:29 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-119a8d10-535d-4587-9ed4-c432708a8062 req-7870f29c-d6de-4e79-8ca7-f0ff588db7f0 service nova] Acquiring lock "6cfe9b0a-4ee9-4b4e-a8ac-d492937113ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:42:29 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-119a8d10-535d-4587-9ed4-c432708a8062 req-7870f29c-d6de-4e79-8ca7-f0ff588db7f0 service nova] Lock "6cfe9b0a-4ee9-4b4e-a8ac-d492937113ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:42:29 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-119a8d10-535d-4587-9ed4-c432708a8062 req-7870f29c-d6de-4e79-8ca7-f0ff588db7f0 service nova] Lock "6cfe9b0a-4ee9-4b4e-a8ac-d492937113ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:42:29 user nova-compute[72382]: DEBUG nova.compute.manager [req-119a8d10-535d-4587-9ed4-c432708a8062 req-7870f29c-d6de-4e79-8ca7-f0ff588db7f0 service nova] [instance: 6cfe9b0a-4ee9-4b4e-a8ac-d492937113ae] No waiting events found dispatching network-vif-plugged-833ca878-3d8d-441d-9b9e-7810c1c8c837 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:42:29 user nova-compute[72382]: WARNING nova.compute.manager [req-119a8d10-535d-4587-9ed4-c432708a8062 req-7870f29c-d6de-4e79-8ca7-f0ff588db7f0 service nova] [instance: 6cfe9b0a-4ee9-4b4e-a8ac-d492937113ae] Received unexpected event network-vif-plugged-833ca878-3d8d-441d-9b9e-7810c1c8c837 for instance with vm_state building and task_state spawning.
Aug 09 15:42:29 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:42:30 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:42:30 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:42:30 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:42:30 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:42:30 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:42:31 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:42:31 user nova-compute[72382]: DEBUG nova.compute.manager [req-d449eaa0-28f6-4b1d-8f28-0b77379730f2 req-ffda6ab3-d40e-4c22-b08a-a548019e9821 service nova] [instance: 6cfe9b0a-4ee9-4b4e-a8ac-d492937113ae] Received event network-vif-plugged-833ca878-3d8d-441d-9b9e-7810c1c8c837 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:42:31 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-d449eaa0-28f6-4b1d-8f28-0b77379730f2 req-ffda6ab3-d40e-4c22-b08a-a548019e9821 service nova] Acquiring lock "6cfe9b0a-4ee9-4b4e-a8ac-d492937113ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:42:31 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-d449eaa0-28f6-4b1d-8f28-0b77379730f2 req-ffda6ab3-d40e-4c22-b08a-a548019e9821 service nova] Lock "6cfe9b0a-4ee9-4b4e-a8ac-d492937113ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:42:31 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-d449eaa0-28f6-4b1d-8f28-0b77379730f2 req-ffda6ab3-d40e-4c22-b08a-a548019e9821 service nova] Lock "6cfe9b0a-4ee9-4b4e-a8ac-d492937113ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:42:31 user nova-compute[72382]: DEBUG nova.compute.manager [req-d449eaa0-28f6-4b1d-8f28-0b77379730f2 req-ffda6ab3-d40e-4c22-b08a-a548019e9821 service nova] [instance: 6cfe9b0a-4ee9-4b4e-a8ac-d492937113ae] No waiting events found dispatching network-vif-plugged-833ca878-3d8d-441d-9b9e-7810c1c8c837 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:42:31 user nova-compute[72382]: WARNING nova.compute.manager [req-d449eaa0-28f6-4b1d-8f28-0b77379730f2 req-ffda6ab3-d40e-4c22-b08a-a548019e9821 service nova] [instance: 6cfe9b0a-4ee9-4b4e-a8ac-d492937113ae] Received unexpected event network-vif-plugged-833ca878-3d8d-441d-9b9e-7810c1c8c837 for instance with vm_state building and task_state spawning.
Aug 09 15:42:32 user nova-compute[72382]: DEBUG nova.compute.manager [None req-56b60306-edd9-47fb-9857-bb6e3b48952f tempest-VolumesNegativeTest-369748005 tempest-VolumesNegativeTest-369748005-project-member] [instance: 6cfe9b0a-4ee9-4b4e-a8ac-d492937113ae] Instance event wait completed in 0 seconds for  {{(pid=72382) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 15:42:32 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-56b60306-edd9-47fb-9857-bb6e3b48952f tempest-VolumesNegativeTest-369748005 tempest-VolumesNegativeTest-369748005-project-member] [instance: 6cfe9b0a-4ee9-4b4e-a8ac-d492937113ae] Guest created on hypervisor {{(pid=72382) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 15:42:32 user nova-compute[72382]: DEBUG nova.virt.driver [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Emitting event <LifecycleEvent: 1691595752.3041356, 6cfe9b0a-4ee9-4b4e-a8ac-d492937113ae => Resumed> {{(pid=72382) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 15:42:32 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 6cfe9b0a-4ee9-4b4e-a8ac-d492937113ae] VM Resumed (Lifecycle Event)
Aug 09 15:42:32 user nova-compute[72382]: INFO nova.virt.libvirt.driver [-] [instance: 6cfe9b0a-4ee9-4b4e-a8ac-d492937113ae] Instance spawned successfully.
Aug 09 15:42:32 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-56b60306-edd9-47fb-9857-bb6e3b48952f tempest-VolumesNegativeTest-369748005 tempest-VolumesNegativeTest-369748005-project-member] [instance: 6cfe9b0a-4ee9-4b4e-a8ac-d492937113ae] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 15:42:32 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 6cfe9b0a-4ee9-4b4e-a8ac-d492937113ae] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:42:32 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 6cfe9b0a-4ee9-4b4e-a8ac-d492937113ae] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72382) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 15:42:32 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-56b60306-edd9-47fb-9857-bb6e3b48952f tempest-VolumesNegativeTest-369748005 tempest-VolumesNegativeTest-369748005-project-member] [instance: 6cfe9b0a-4ee9-4b4e-a8ac-d492937113ae] Found default for hw_cdrom_bus of ide {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:42:32 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-56b60306-edd9-47fb-9857-bb6e3b48952f tempest-VolumesNegativeTest-369748005 tempest-VolumesNegativeTest-369748005-project-member] [instance: 6cfe9b0a-4ee9-4b4e-a8ac-d492937113ae] Found default for hw_disk_bus of virtio {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:42:32 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-56b60306-edd9-47fb-9857-bb6e3b48952f tempest-VolumesNegativeTest-369748005 tempest-VolumesNegativeTest-369748005-project-member] [instance: 6cfe9b0a-4ee9-4b4e-a8ac-d492937113ae] Found default for hw_input_bus of None {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:42:32 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-56b60306-edd9-47fb-9857-bb6e3b48952f tempest-VolumesNegativeTest-369748005 tempest-VolumesNegativeTest-369748005-project-member] [instance: 6cfe9b0a-4ee9-4b4e-a8ac-d492937113ae] Found default for hw_pointer_model of None {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:42:32 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-56b60306-edd9-47fb-9857-bb6e3b48952f tempest-VolumesNegativeTest-369748005 tempest-VolumesNegativeTest-369748005-project-member] [instance: 6cfe9b0a-4ee9-4b4e-a8ac-d492937113ae] Found default for hw_video_model of virtio {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:42:32 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-56b60306-edd9-47fb-9857-bb6e3b48952f tempest-VolumesNegativeTest-369748005 tempest-VolumesNegativeTest-369748005-project-member] [instance: 6cfe9b0a-4ee9-4b4e-a8ac-d492937113ae] Found default for hw_vif_model of virtio {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:42:32 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 6cfe9b0a-4ee9-4b4e-a8ac-d492937113ae] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 15:42:32 user nova-compute[72382]: DEBUG nova.virt.driver [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Emitting event <LifecycleEvent: 1691595752.3057349, 6cfe9b0a-4ee9-4b4e-a8ac-d492937113ae => Started> {{(pid=72382) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 15:42:32 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 6cfe9b0a-4ee9-4b4e-a8ac-d492937113ae] VM Started (Lifecycle Event)
Aug 09 15:42:32 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 6cfe9b0a-4ee9-4b4e-a8ac-d492937113ae] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:42:32 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 6cfe9b0a-4ee9-4b4e-a8ac-d492937113ae] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72382) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 15:42:32 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 6cfe9b0a-4ee9-4b4e-a8ac-d492937113ae] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 15:42:32 user nova-compute[72382]: INFO nova.compute.manager [None req-56b60306-edd9-47fb-9857-bb6e3b48952f tempest-VolumesNegativeTest-369748005 tempest-VolumesNegativeTest-369748005-project-member] [instance: 6cfe9b0a-4ee9-4b4e-a8ac-d492937113ae] Took 6.54 seconds to spawn the instance on the hypervisor.
Aug 09 15:42:32 user nova-compute[72382]: DEBUG nova.compute.manager [None req-56b60306-edd9-47fb-9857-bb6e3b48952f tempest-VolumesNegativeTest-369748005 tempest-VolumesNegativeTest-369748005-project-member] [instance: 6cfe9b0a-4ee9-4b4e-a8ac-d492937113ae] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:42:32 user nova-compute[72382]: INFO nova.compute.manager [None req-56b60306-edd9-47fb-9857-bb6e3b48952f tempest-VolumesNegativeTest-369748005 tempest-VolumesNegativeTest-369748005-project-member] [instance: 6cfe9b0a-4ee9-4b4e-a8ac-d492937113ae] Took 7.25 seconds to build instance.
Aug 09 15:42:32 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-56b60306-edd9-47fb-9857-bb6e3b48952f tempest-VolumesNegativeTest-369748005 tempest-VolumesNegativeTest-369748005-project-member] Lock "6cfe9b0a-4ee9-4b4e-a8ac-d492937113ae" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.360s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:42:32 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:42:33 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:42:34 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:42:38 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:42:39 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:42:43 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:42:44 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:42:48 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:42:50 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:42:53 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:42:53 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:42:55 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:42:56 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:42:58 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:42:59 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-05b3b692-2881-45cd-81df-e32fb249ce87 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Acquiring lock "4ccbfda2-8bcd-4ec1-972a-cf49a62b1583" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:42:59 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-05b3b692-2881-45cd-81df-e32fb249ce87 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Lock "4ccbfda2-8bcd-4ec1-972a-cf49a62b1583" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:42:59 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-05b3b692-2881-45cd-81df-e32fb249ce87 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Acquiring lock "4ccbfda2-8bcd-4ec1-972a-cf49a62b1583-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:42:59 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-05b3b692-2881-45cd-81df-e32fb249ce87 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Lock "4ccbfda2-8bcd-4ec1-972a-cf49a62b1583-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:42:59 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-05b3b692-2881-45cd-81df-e32fb249ce87 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Lock "4ccbfda2-8bcd-4ec1-972a-cf49a62b1583-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:42:59 user nova-compute[72382]: INFO nova.compute.manager [None req-05b3b692-2881-45cd-81df-e32fb249ce87 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] [instance: 4ccbfda2-8bcd-4ec1-972a-cf49a62b1583] Terminating instance
Aug 09 15:42:59 user nova-compute[72382]: DEBUG nova.compute.manager [None req-05b3b692-2881-45cd-81df-e32fb249ce87 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] [instance: 4ccbfda2-8bcd-4ec1-972a-cf49a62b1583] Start destroying the instance on the hypervisor. {{(pid=72382) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 15:42:59 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:42:59 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:42:59 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:42:59 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:43:00 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:43:00 user nova-compute[72382]: DEBUG nova.compute.manager [req-ba80ab14-722b-4ae6-925e-e61c3d43ce6b req-f34b37f3-ad5f-4e72-a736-4901a780c4eb service nova] [instance: 4ccbfda2-8bcd-4ec1-972a-cf49a62b1583] Received event network-vif-unplugged-2d07e6a3-03b7-4035-bdd2-a95435b99852 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:43:00 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-ba80ab14-722b-4ae6-925e-e61c3d43ce6b req-f34b37f3-ad5f-4e72-a736-4901a780c4eb service nova] Acquiring lock "4ccbfda2-8bcd-4ec1-972a-cf49a62b1583-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:43:00 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-ba80ab14-722b-4ae6-925e-e61c3d43ce6b req-f34b37f3-ad5f-4e72-a736-4901a780c4eb service nova] Lock "4ccbfda2-8bcd-4ec1-972a-cf49a62b1583-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:43:00 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-ba80ab14-722b-4ae6-925e-e61c3d43ce6b req-f34b37f3-ad5f-4e72-a736-4901a780c4eb service nova] Lock "4ccbfda2-8bcd-4ec1-972a-cf49a62b1583-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:43:00 user nova-compute[72382]: DEBUG nova.compute.manager [req-ba80ab14-722b-4ae6-925e-e61c3d43ce6b req-f34b37f3-ad5f-4e72-a736-4901a780c4eb service nova] [instance: 4ccbfda2-8bcd-4ec1-972a-cf49a62b1583] No waiting events found dispatching network-vif-unplugged-2d07e6a3-03b7-4035-bdd2-a95435b99852 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:43:00 user nova-compute[72382]: DEBUG nova.compute.manager [req-ba80ab14-722b-4ae6-925e-e61c3d43ce6b req-f34b37f3-ad5f-4e72-a736-4901a780c4eb service nova] [instance: 4ccbfda2-8bcd-4ec1-972a-cf49a62b1583] Received event network-vif-unplugged-2d07e6a3-03b7-4035-bdd2-a95435b99852 for instance with task_state deleting. {{(pid=72382) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 15:43:00 user nova-compute[72382]: INFO nova.virt.libvirt.driver [-] [instance: 4ccbfda2-8bcd-4ec1-972a-cf49a62b1583] Instance destroyed successfully.
Aug 09 15:43:00 user nova-compute[72382]: DEBUG nova.objects.instance [None req-05b3b692-2881-45cd-81df-e32fb249ce87 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Lazy-loading 'resources' on Instance uuid 4ccbfda2-8bcd-4ec1-972a-cf49a62b1583 {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:43:00 user nova-compute[72382]: DEBUG nova.virt.libvirt.vif [None req-05b3b692-2881-45cd-81df-e32fb249ce87 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-09T15:26:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-726596602',display_name='tempest-ServerActionsTestOtherA-server-662551681',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-726596602',id=27,image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCmuVV1ynikE+pH75fjLIal2KFmSgV7eQmOTfU0+P2w2YCXfBWnAu9n1cQQTYYTDt/aP+JsGjkRdlSPqvnnG5WbnlJT+9aj9SfyqprOo87kqF8CD2U4mVDTvv+6ADzXJvQ==',key_name='tempest-keypair-568328368',keypairs=<?>,launch_index=0,launched_at=2023-08-09T15:30:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='eb5bf3f95d2843af94dbcab2af932bd1',ramdisk_id='',reservation_id='r-169g26o6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1899577274',owner_user_name='tempest-ServerActionsTestOtherA-1899577274-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T15:30:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2cca9aef887b4b91a46ff4bd5cd32302',uuid=4ccbfda2-8bcd-4ec1-972a-cf49a62b1583,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2d07e6a3-03b7-4035-bdd2-a95435b99852", "address": "fa:16:3e:9a:d4:3a", "network": {"id": "308641dc-cc18-41db-9baa-7cc880e594ad", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1932973397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb5bf3f95d2843af94dbcab2af932bd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d07e6a3-03", "ovs_interfaceid": "2d07e6a3-03b7-4035-bdd2-a95435b99852", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 15:43:00 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-05b3b692-2881-45cd-81df-e32fb249ce87 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Converting VIF {"id": "2d07e6a3-03b7-4035-bdd2-a95435b99852", "address": "fa:16:3e:9a:d4:3a", "network": {"id": "308641dc-cc18-41db-9baa-7cc880e594ad", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1932973397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb5bf3f95d2843af94dbcab2af932bd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d07e6a3-03", "ovs_interfaceid": "2d07e6a3-03b7-4035-bdd2-a95435b99852", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 15:43:00 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-05b3b692-2881-45cd-81df-e32fb249ce87 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9a:d4:3a,bridge_name='br-int',has_traffic_filtering=True,id=2d07e6a3-03b7-4035-bdd2-a95435b99852,network=Network(308641dc-cc18-41db-9baa-7cc880e594ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d07e6a3-03') {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 15:43:00 user nova-compute[72382]: DEBUG os_vif [None req-05b3b692-2881-45cd-81df-e32fb249ce87 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9a:d4:3a,bridge_name='br-int',has_traffic_filtering=True,id=2d07e6a3-03b7-4035-bdd2-a95435b99852,network=Network(308641dc-cc18-41db-9baa-7cc880e594ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d07e6a3-03') {{(pid=72382) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 15:43:00 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:43:00 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2d07e6a3-03, bridge=br-int, if_exists=True) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:43:00 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:43:00 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:43:00 user nova-compute[72382]: INFO os_vif [None req-05b3b692-2881-45cd-81df-e32fb249ce87 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9a:d4:3a,bridge_name='br-int',has_traffic_filtering=True,id=2d07e6a3-03b7-4035-bdd2-a95435b99852,network=Network(308641dc-cc18-41db-9baa-7cc880e594ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d07e6a3-03')
Aug 09 15:43:00 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-05b3b692-2881-45cd-81df-e32fb249ce87 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] [instance: 4ccbfda2-8bcd-4ec1-972a-cf49a62b1583] Deleting instance files /opt/stack/data/nova/instances/4ccbfda2-8bcd-4ec1-972a-cf49a62b1583_del
Aug 09 15:43:00 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-05b3b692-2881-45cd-81df-e32fb249ce87 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] [instance: 4ccbfda2-8bcd-4ec1-972a-cf49a62b1583] Deletion of /opt/stack/data/nova/instances/4ccbfda2-8bcd-4ec1-972a-cf49a62b1583_del complete
Aug 09 15:43:00 user nova-compute[72382]: INFO nova.compute.manager [None req-05b3b692-2881-45cd-81df-e32fb249ce87 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] [instance: 4ccbfda2-8bcd-4ec1-972a-cf49a62b1583] Took 0.82 seconds to destroy the instance on the hypervisor.
Aug 09 15:43:00 user nova-compute[72382]: DEBUG oslo.service.loopingcall [None req-05b3b692-2881-45cd-81df-e32fb249ce87 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72382) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 15:43:00 user nova-compute[72382]: DEBUG nova.compute.manager [-] [instance: 4ccbfda2-8bcd-4ec1-972a-cf49a62b1583] Deallocating network for instance {{(pid=72382) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 15:43:00 user nova-compute[72382]: DEBUG nova.network.neutron [-] [instance: 4ccbfda2-8bcd-4ec1-972a-cf49a62b1583] deallocate_for_instance() {{(pid=72382) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 15:43:01 user nova-compute[72382]: DEBUG nova.network.neutron [-] [instance: 4ccbfda2-8bcd-4ec1-972a-cf49a62b1583] Updating instance_info_cache with network_info: [] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:43:01 user nova-compute[72382]: INFO nova.compute.manager [-] [instance: 4ccbfda2-8bcd-4ec1-972a-cf49a62b1583] Took 0.68 seconds to deallocate network for instance.
Aug 09 15:43:01 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-05b3b692-2881-45cd-81df-e32fb249ce87 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:43:01 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-05b3b692-2881-45cd-81df-e32fb249ce87 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:43:01 user nova-compute[72382]: DEBUG nova.compute.provider_tree [None req-05b3b692-2881-45cd-81df-e32fb249ce87 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Inventory has not changed in ProviderTree for provider: 7b15b0e5-df4d-49db-833b-2855d21d10ae {{(pid=72382) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 15:43:01 user nova-compute[72382]: DEBUG nova.scheduler.client.report [None req-05b3b692-2881-45cd-81df-e32fb249ce87 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Inventory has not changed for provider 7b15b0e5-df4d-49db-833b-2855d21d10ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72382) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 15:43:01 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-05b3b692-2881-45cd-81df-e32fb249ce87 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.262s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:43:01 user nova-compute[72382]: INFO nova.scheduler.client.report [None req-05b3b692-2881-45cd-81df-e32fb249ce87 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Deleted allocations for instance 4ccbfda2-8bcd-4ec1-972a-cf49a62b1583
Aug 09 15:43:01 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-05b3b692-2881-45cd-81df-e32fb249ce87 tempest-ServerActionsTestOtherA-1899577274 tempest-ServerActionsTestOtherA-1899577274-project-member] Lock "4ccbfda2-8bcd-4ec1-972a-cf49a62b1583" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.951s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:43:02 user nova-compute[72382]: DEBUG nova.compute.manager [req-afaf1843-8f2f-45e4-8083-9a061db732a2 req-377d6e4f-fb8a-49c4-9baf-a9b3510177a9 service nova] [instance: 4ccbfda2-8bcd-4ec1-972a-cf49a62b1583] Received event network-vif-plugged-2d07e6a3-03b7-4035-bdd2-a95435b99852 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:43:02 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-afaf1843-8f2f-45e4-8083-9a061db732a2 req-377d6e4f-fb8a-49c4-9baf-a9b3510177a9 service nova] Acquiring lock "4ccbfda2-8bcd-4ec1-972a-cf49a62b1583-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:43:02 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-afaf1843-8f2f-45e4-8083-9a061db732a2 req-377d6e4f-fb8a-49c4-9baf-a9b3510177a9 service nova] Lock "4ccbfda2-8bcd-4ec1-972a-cf49a62b1583-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:43:02 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-afaf1843-8f2f-45e4-8083-9a061db732a2 req-377d6e4f-fb8a-49c4-9baf-a9b3510177a9 service nova] Lock "4ccbfda2-8bcd-4ec1-972a-cf49a62b1583-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:43:02 user nova-compute[72382]: DEBUG nova.compute.manager [req-afaf1843-8f2f-45e4-8083-9a061db732a2 req-377d6e4f-fb8a-49c4-9baf-a9b3510177a9 service nova] [instance: 4ccbfda2-8bcd-4ec1-972a-cf49a62b1583] No waiting events found dispatching network-vif-plugged-2d07e6a3-03b7-4035-bdd2-a95435b99852 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:43:02 user nova-compute[72382]: WARNING nova.compute.manager [req-afaf1843-8f2f-45e4-8083-9a061db732a2 req-377d6e4f-fb8a-49c4-9baf-a9b3510177a9 service nova] [instance: 4ccbfda2-8bcd-4ec1-972a-cf49a62b1583] Received unexpected event network-vif-plugged-2d07e6a3-03b7-4035-bdd2-a95435b99852 for instance with vm_state deleted and task_state None.
Aug 09 15:43:02 user nova-compute[72382]: DEBUG nova.compute.manager [req-afaf1843-8f2f-45e4-8083-9a061db732a2 req-377d6e4f-fb8a-49c4-9baf-a9b3510177a9 service nova] [instance: 4ccbfda2-8bcd-4ec1-972a-cf49a62b1583] Received event network-vif-deleted-2d07e6a3-03b7-4035-bdd2-a95435b99852 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:43:05 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:43:05 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:43:09 user nova-compute[72382]: DEBUG nova.compute.manager [req-3c76aed7-72f9-4606-a6a8-259df4d16f1c req-462c6b29-1a7f-4b38-a664-8641c10405e7 service nova] [instance: 5c914d94-5bfd-4984-8937-37bdf02e9674] Received event network-changed-0ac76bca-773f-4a75-8811-c9839f549726 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:43:09 user nova-compute[72382]: DEBUG nova.compute.manager [req-3c76aed7-72f9-4606-a6a8-259df4d16f1c req-462c6b29-1a7f-4b38-a664-8641c10405e7 service nova] [instance: 5c914d94-5bfd-4984-8937-37bdf02e9674] Refreshing instance network info cache due to event network-changed-0ac76bca-773f-4a75-8811-c9839f549726. {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 15:43:09 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-3c76aed7-72f9-4606-a6a8-259df4d16f1c req-462c6b29-1a7f-4b38-a664-8641c10405e7 service nova] Acquiring lock "refresh_cache-5c914d94-5bfd-4984-8937-37bdf02e9674" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 15:43:09 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-3c76aed7-72f9-4606-a6a8-259df4d16f1c req-462c6b29-1a7f-4b38-a664-8641c10405e7 service nova] Acquired lock "refresh_cache-5c914d94-5bfd-4984-8937-37bdf02e9674" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 15:43:09 user nova-compute[72382]: DEBUG nova.network.neutron [req-3c76aed7-72f9-4606-a6a8-259df4d16f1c req-462c6b29-1a7f-4b38-a664-8641c10405e7 service nova] [instance: 5c914d94-5bfd-4984-8937-37bdf02e9674] Refreshing network info cache for port 0ac76bca-773f-4a75-8811-c9839f549726 {{(pid=72382) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 15:43:10 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:43:10 user nova-compute[72382]: DEBUG nova.network.neutron [req-3c76aed7-72f9-4606-a6a8-259df4d16f1c req-462c6b29-1a7f-4b38-a664-8641c10405e7 service nova] [instance: 5c914d94-5bfd-4984-8937-37bdf02e9674] Updated VIF entry in instance network info cache for port 0ac76bca-773f-4a75-8811-c9839f549726. {{(pid=72382) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 15:43:10 user nova-compute[72382]: DEBUG nova.network.neutron [req-3c76aed7-72f9-4606-a6a8-259df4d16f1c req-462c6b29-1a7f-4b38-a664-8641c10405e7 service nova] [instance: 5c914d94-5bfd-4984-8937-37bdf02e9674] Updating instance_info_cache with network_info: [{"id": "0ac76bca-773f-4a75-8811-c9839f549726", "address": "fa:16:3e:4a:5b:a7", "network": {"id": "67846b1f-41a7-4942-b9d2-0e41417d5ecf", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1653397054-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f0a8014c8bb4f4b80617a5516539994", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ac76bca-77", "ovs_interfaceid": "0ac76bca-773f-4a75-8811-c9839f549726", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:43:10 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-3c76aed7-72f9-4606-a6a8-259df4d16f1c req-462c6b29-1a7f-4b38-a664-8641c10405e7 service nova] Releasing lock "refresh_cache-5c914d94-5bfd-4984-8937-37bdf02e9674" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 15:43:10 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:43:14 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-fd472108-36b3-4ad1-acc9-24179039fc58 tempest-TestServerVolumeAttachScenarioOldVersion-787688685 tempest-TestServerVolumeAttachScenarioOldVersion-787688685-project-member] Acquiring lock "5c914d94-5bfd-4984-8937-37bdf02e9674" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:43:14 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-fd472108-36b3-4ad1-acc9-24179039fc58 tempest-TestServerVolumeAttachScenarioOldVersion-787688685 tempest-TestServerVolumeAttachScenarioOldVersion-787688685-project-member] Lock "5c914d94-5bfd-4984-8937-37bdf02e9674" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:43:14 user nova-compute[72382]: DEBUG nova.objects.instance [None req-fd472108-36b3-4ad1-acc9-24179039fc58 tempest-TestServerVolumeAttachScenarioOldVersion-787688685 tempest-TestServerVolumeAttachScenarioOldVersion-787688685-project-member] Lazy-loading 'flavor' on Instance uuid 5c914d94-5bfd-4984-8937-37bdf02e9674 {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:43:14 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-fd472108-36b3-4ad1-acc9-24179039fc58 tempest-TestServerVolumeAttachScenarioOldVersion-787688685 tempest-TestServerVolumeAttachScenarioOldVersion-787688685-project-member] Lock "5c914d94-5bfd-4984-8937-37bdf02e9674" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:43:14 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-fd472108-36b3-4ad1-acc9-24179039fc58 tempest-TestServerVolumeAttachScenarioOldVersion-787688685 tempest-TestServerVolumeAttachScenarioOldVersion-787688685-project-member] Acquiring lock "5c914d94-5bfd-4984-8937-37bdf02e9674" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:43:14 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-fd472108-36b3-4ad1-acc9-24179039fc58 tempest-TestServerVolumeAttachScenarioOldVersion-787688685 tempest-TestServerVolumeAttachScenarioOldVersion-787688685-project-member] Lock "5c914d94-5bfd-4984-8937-37bdf02e9674" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:43:14 user nova-compute[72382]: INFO nova.compute.manager [None req-fd472108-36b3-4ad1-acc9-24179039fc58 tempest-TestServerVolumeAttachScenarioOldVersion-787688685 tempest-TestServerVolumeAttachScenarioOldVersion-787688685-project-member] [instance: 5c914d94-5bfd-4984-8937-37bdf02e9674] Attaching volume 5e4a3c00-af87-4059-b7b4-332fdcac9629 to /dev/vdb
Aug 09 15:43:14 user nova-compute[72382]: DEBUG os_brick.utils [None req-fd472108-36b3-4ad1-acc9-24179039fc58 tempest-TestServerVolumeAttachScenarioOldVersion-787688685 tempest-TestServerVolumeAttachScenarioOldVersion-787688685-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 15:43:14 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:43:14 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:43:14 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8348b6b-9beb-4e75-ad68-e845861e7026]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d2cfa7015fe\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:43:14 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:43:14 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:43:14 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9734aab-7f3b-46eb-9da1-a2490fe14baf]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:43:14 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:43:14 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:43:14 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[08c82873-fd39-463e-81e2-06ea70617ebe]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:43:14 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbca9a02-79a4-4e1e-8050-07355afd2197]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:43:14 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-fd472108-36b3-4ad1-acc9-24179039fc58 tempest-TestServerVolumeAttachScenarioOldVersion-787688685 tempest-TestServerVolumeAttachScenarioOldVersion-787688685-project-member] Running cmd (subprocess): nvme version {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:43:14 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-fd472108-36b3-4ad1-acc9-24179039fc58 tempest-TestServerVolumeAttachScenarioOldVersion-787688685 tempest-TestServerVolumeAttachScenarioOldVersion-787688685-project-member] 'nvme version' failed. Not Retrying. {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 15:43:14 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fd472108-36b3-4ad1-acc9-24179039fc58 tempest-TestServerVolumeAttachScenarioOldVersion-787688685 tempest-TestServerVolumeAttachScenarioOldVersion-787688685-project-member] nvme not present on system {{(pid=72382) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 15:43:14 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:43:14 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 15:43:14 user nova-compute[72382]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 15:43:14 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca0c57ff-f1d6-4109-ace7-443941df2b10]: (4, '') {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:43:14 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.lightos [None req-fd472108-36b3-4ad1-acc9-24179039fc58 tempest-TestServerVolumeAttachScenarioOldVersion-787688685 tempest-TestServerVolumeAttachScenarioOldVersion-787688685-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72382) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 15:43:14 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.lightos [None req-fd472108-36b3-4ad1-acc9-24179039fc58 tempest-TestServerVolumeAttachScenarioOldVersion-787688685 tempest-TestServerVolumeAttachScenarioOldVersion-787688685-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72382) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 15:43:14 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.lightos [None req-fd472108-36b3-4ad1-acc9-24179039fc58 tempest-TestServerVolumeAttachScenarioOldVersion-787688685 tempest-TestServerVolumeAttachScenarioOldVersion-787688685-project-member] LIGHTOS: no hostnqn found. {{(pid=72382) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 15:43:14 user nova-compute[72382]: DEBUG os_brick.utils [None req-fd472108-36b3-4ad1-acc9-24179039fc58 tempest-TestServerVolumeAttachScenarioOldVersion-787688685 tempest-TestServerVolumeAttachScenarioOldVersion-787688685-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d2cfa7015fe', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 15:43:14 user nova-compute[72382]: DEBUG nova.virt.block_device [None req-fd472108-36b3-4ad1-acc9-24179039fc58 tempest-TestServerVolumeAttachScenarioOldVersion-787688685 tempest-TestServerVolumeAttachScenarioOldVersion-787688685-project-member] [instance: 5c914d94-5bfd-4984-8937-37bdf02e9674] Updating existing volume attachment record: cc080952-af55-42df-8972-fbafbd98676d {{(pid=72382) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 15:43:15 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:43:15 user nova-compute[72382]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691595780.5646524, 4ccbfda2-8bcd-4ec1-972a-cf49a62b1583 => Stopped> {{(pid=72382) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 15:43:15 user nova-compute[72382]: INFO nova.compute.manager [-] [instance: 4ccbfda2-8bcd-4ec1-972a-cf49a62b1583] VM Stopped (Lifecycle Event)
Aug 09 15:43:15 user nova-compute[72382]: DEBUG nova.compute.manager [None req-a38b6ecf-742b-4a2b-94e1-3a7d390a40e9 None None] [instance: 4ccbfda2-8bcd-4ec1-972a-cf49a62b1583] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:43:15 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:43:19 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:43:19 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:43:19 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:43:19 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:43:19 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Auditing locally available compute resources for user (node: user) {{(pid=72382) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 15:43:20 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:43:20 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c914d94-5bfd-4984-8937-37bdf02e9674/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:43:20 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c914d94-5bfd-4984-8937-37bdf02e9674/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:43:20 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c914d94-5bfd-4984-8937-37bdf02e9674/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:43:20 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c914d94-5bfd-4984-8937-37bdf02e9674/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:43:20 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cfe9b0a-4ee9-4b4e-a8ac-d492937113ae/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:43:20 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cfe9b0a-4ee9-4b4e-a8ac-d492937113ae/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:43:20 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cfe9b0a-4ee9-4b4e-a8ac-d492937113ae/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:43:20 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:43:20 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cfe9b0a-4ee9-4b4e-a8ac-d492937113ae/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:43:20 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c1b05ee-4fc3-44b9-b689-52d07841da4c/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:43:20 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c1b05ee-4fc3-44b9-b689-52d07841da4c/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:43:20 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c1b05ee-4fc3-44b9-b689-52d07841da4c/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:43:21 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c1b05ee-4fc3-44b9-b689-52d07841da4c/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:43:21 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72382) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 15:43:21 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72382) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 15:43:21 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d27c5a4-9a88-423b-9c48-9224e8248f8c/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:43:21 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d27c5a4-9a88-423b-9c48-9224e8248f8c/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:43:21 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d27c5a4-9a88-423b-9c48-9224e8248f8c/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:43:21 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d27c5a4-9a88-423b-9c48-9224e8248f8c/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:43:21 user nova-compute[72382]: WARNING nova.virt.libvirt.driver [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 15:43:21 user nova-compute[72382]: WARNING nova.virt.libvirt.driver [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 15:43:21 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Hypervisor/Node resource view: name=user free_ram=7896MB free_disk=25.26253890991211GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72382) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 15:43:21 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:43:21 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:43:21 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance 3855b76f-87cc-4be0-982c-4cc5cf5cd8aa actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:43:21 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance 5c914d94-5bfd-4984-8937-37bdf02e9674 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:43:21 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance f49b5daf-d39d-496f-97d7-a0d9fd67d66d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:43:21 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance 4d27c5a4-9a88-423b-9c48-9224e8248f8c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:43:21 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance 0c1b05ee-4fc3-44b9-b689-52d07841da4c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:43:21 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance 6cfe9b0a-4ee9-4b4e-a8ac-d492937113ae actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:43:21 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=72382) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 15:43:21 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=72382) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 15:43:22 user nova-compute[72382]: DEBUG nova.compute.provider_tree [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Inventory has not changed in ProviderTree for provider: 7b15b0e5-df4d-49db-833b-2855d21d10ae {{(pid=72382) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 15:43:22 user nova-compute[72382]: DEBUG nova.scheduler.client.report [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Inventory has not changed for provider 7b15b0e5-df4d-49db-833b-2855d21d10ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72382) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 15:43:22 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Compute_service record updated for user:user {{(pid=72382) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 15:43:22 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.392s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:43:22 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fd472108-36b3-4ad1-acc9-24179039fc58 tempest-TestServerVolumeAttachScenarioOldVersion-787688685 tempest-TestServerVolumeAttachScenarioOldVersion-787688685-project-member] [instance: 5c914d94-5bfd-4984-8937-37bdf02e9674] Calling os-brick to attach iSCSI Volume {{(pid=72382) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 15:43:22 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd472108-36b3-4ad1-acc9-24179039fc58 tempest-TestServerVolumeAttachScenarioOldVersion-787688685 tempest-TestServerVolumeAttachScenarioOldVersion-787688685-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2a0c768340>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:5e4a3c00-af87-4059-b7b4-332fdcac9629'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kEjWlsnK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 15:43:22 user nova-compute[72382]: WARNING os_brick.initiator.connectors.base [None req-fd472108-36b3-4ad1-acc9-24179039fc58 tempest-TestServerVolumeAttachScenarioOldVersion-787688685 tempest-TestServerVolumeAttachScenarioOldVersion-787688685-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 15:43:22 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-fd472108-36b3-4ad1-acc9-24179039fc58 tempest-TestServerVolumeAttachScenarioOldVersion-787688685 tempest-TestServerVolumeAttachScenarioOldVersion-787688685-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 15:43:22 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-fd472108-36b3-4ad1-acc9-24179039fc58 tempest-TestServerVolumeAttachScenarioOldVersion-787688685 tempest-TestServerVolumeAttachScenarioOldVersion-787688685-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 15:43:22 user nova-compute[72382]: WARNING os_brick.initiator.connectors.base [None req-fd472108-36b3-4ad1-acc9-24179039fc58 tempest-TestServerVolumeAttachScenarioOldVersion-787688685 tempest-TestServerVolumeAttachScenarioOldVersion-787688685-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 15:43:22 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-fd472108-36b3-4ad1-acc9-24179039fc58 tempest-TestServerVolumeAttachScenarioOldVersion-787688685 tempest-TestServerVolumeAttachScenarioOldVersion-787688685-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5e4a3c00-af87-4059-b7b4-332fdcac9629" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 15:43:22 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-fd472108-36b3-4ad1-acc9-24179039fc58 tempest-TestServerVolumeAttachScenarioOldVersion-787688685 tempest-TestServerVolumeAttachScenarioOldVersion-787688685-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5e4a3c00-af87-4059-b7b4-332fdcac9629" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 15:43:22 user nova-compute[72382]: INFO os_brick.initiator.connectors.iscsi [None req-fd472108-36b3-4ad1-acc9-24179039fc58 tempest-TestServerVolumeAttachScenarioOldVersion-787688685 tempest-TestServerVolumeAttachScenarioOldVersion-787688685-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 15:43:22 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e4a3c00-af87-4059-b7b4-332fdcac9629 -p 172.16.0.220:3260 {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:43:22 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e4a3c00-af87-4059-b7b4-332fdcac9629 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:43:22 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[81f14a32-c8c2-47ea-9caf-e38c635259a8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:43:22 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd472108-36b3-4ad1-acc9-24179039fc58 tempest-TestServerVolumeAttachScenarioOldVersion-787688685 tempest-TestServerVolumeAttachScenarioOldVersion-787688685-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 15:43:22 user nova-compute[72382]:  {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:43:22 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e4a3c00-af87-4059-b7b4-332fdcac9629 -p 172.16.0.220:3260 --interface default --op new {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:43:22 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e4a3c00-af87-4059-b7b4-332fdcac9629 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:43:22 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[f66523f5-4be7-4115-b628-197fa17718b2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5e4a3c00-af87-4059-b7b4-332fdcac9629] added\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:43:22 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd472108-36b3-4ad1-acc9-24179039fc58 tempest-TestServerVolumeAttachScenarioOldVersion-787688685 tempest-TestServerVolumeAttachScenarioOldVersion-787688685-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5e4a3c00-af87-4059-b7b4-332fdcac9629] added
Aug 09 15:43:22 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:43:22 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e4a3c00-af87-4059-b7b4-332fdcac9629 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:43:22 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e4a3c00-af87-4059-b7b4-332fdcac9629 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:43:22 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[98a4c766-3b0a-419f-8bee-2bbc0d7c44ed]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:43:22 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd472108-36b3-4ad1-acc9-24179039fc58 tempest-TestServerVolumeAttachScenarioOldVersion-787688685 tempest-TestServerVolumeAttachScenarioOldVersion-787688685-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:43:22 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e4a3c00-af87-4059-b7b4-332fdcac9629 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:43:22 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e4a3c00-af87-4059-b7b4-332fdcac9629 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.047s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:43:22 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[febf096e-c9fb-4b3d-92e7-99e6bf24a8f9]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:43:22 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd472108-36b3-4ad1-acc9-24179039fc58 tempest-TestServerVolumeAttachScenarioOldVersion-787688685 tempest-TestServerVolumeAttachScenarioOldVersion-787688685-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:43:22 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e4a3c00-af87-4059-b7b4-332fdcac9629 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kEjWlsnK {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:43:22 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e4a3c00-af87-4059-b7b4-332fdcac9629 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kEjWlsnK" returned: 0 in 0.024s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:43:22 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[c499ceae-1474-405c-b5fe-a3fbbffb883f]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:43:22 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd472108-36b3-4ad1-acc9-24179039fc58 tempest-TestServerVolumeAttachScenarioOldVersion-787688685 tempest-TestServerVolumeAttachScenarioOldVersion-787688685-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kEjWlsnK'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:43:22 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e4a3c00-af87-4059-b7b4-332fdcac9629 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:43:22 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e4a3c00-af87-4059-b7b4-332fdcac9629 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:43:22 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[fab1f270-6c42-43fe-971d-dbf861269733]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:43:22 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd472108-36b3-4ad1-acc9-24179039fc58 tempest-TestServerVolumeAttachScenarioOldVersion-787688685 tempest-TestServerVolumeAttachScenarioOldVersion-787688685-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:43:22 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:43:22 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:43:22 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[440ff999-defc-4f47-b768-ac3eb420b663]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f58579c-f69a-4bee-b16e-970e5a8f590c (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38d0b588-2e6f-4ebb-84a1-8a928e923cd7 (non-flash)\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:43:22 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd472108-36b3-4ad1-acc9-24179039fc58 tempest-TestServerVolumeAttachScenarioOldVersion-787688685 tempest-TestServerVolumeAttachScenarioOldVersion-787688685-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f58579c-f69a-4bee-b16e-970e5a8f590c (non-flash)
Aug 09 15:43:22 user nova-compute[72382]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38d0b588-2e6f-4ebb-84a1-8a928e923cd7 (non-flash)
Aug 09 15:43:22 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 15:43:22 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd472108-36b3-4ad1-acc9-24179039fc58 tempest-TestServerVolumeAttachScenarioOldVersion-787688685 tempest-TestServerVolumeAttachScenarioOldVersion-787688685-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f58579c-f69a-4bee-b16e-970e5a8f590c (non-flash)
Aug 09 15:43:22 user nova-compute[72382]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38d0b588-2e6f-4ebb-84a1-8a928e923cd7 (non-flash)
Aug 09 15:43:22 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 15:43:22 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e4a3c00-af87-4059-b7b4-332fdcac9629 -p 172.16.0.220:3260 --login {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:43:22 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e4a3c00-af87-4059-b7b4-332fdcac9629 -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:43:22 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[d55115ee-3074-45ad-a82e-81677b46693e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5e4a3c00-af87-4059-b7b4-332fdcac9629, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5e4a3c00-af87-4059-b7b4-332fdcac9629, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:43:22 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd472108-36b3-4ad1-acc9-24179039fc58 tempest-TestServerVolumeAttachScenarioOldVersion-787688685 tempest-TestServerVolumeAttachScenarioOldVersion-787688685-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5e4a3c00-af87-4059-b7b4-332fdcac9629, portal: 172.16.0.220,3260]
Aug 09 15:43:22 user nova-compute[72382]: Login to [iface: default, target: iqn.2010-10.org.openstack:5e4a3c00-af87-4059-b7b4-332fdcac9629, portal: 172.16.0.220,3260] successful.
Aug 09 15:43:22 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:43:22 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e4a3c00-af87-4059-b7b4-332fdcac9629 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:43:22 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e4a3c00-af87-4059-b7b4-332fdcac9629 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:43:22 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6d748fa-f107-4d85-a355-41ccf1f30e1f]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:43:22 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd472108-36b3-4ad1-acc9-24179039fc58 tempest-TestServerVolumeAttachScenarioOldVersion-787688685 tempest-TestServerVolumeAttachScenarioOldVersion-787688685-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:43:22 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:43:22 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:43:22 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[945194bf-20e8-497c-9409-b81a2f5d308e]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f58579c-f69a-4bee-b16e-970e5a8f590c (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38d0b588-2e6f-4ebb-84a1-8a928e923cd7 (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e4a3c00-af87-4059-b7b4-332fdcac9629 (non-flash)\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:43:22 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd472108-36b3-4ad1-acc9-24179039fc58 tempest-TestServerVolumeAttachScenarioOldVersion-787688685 tempest-TestServerVolumeAttachScenarioOldVersion-787688685-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f58579c-f69a-4bee-b16e-970e5a8f590c (non-flash)
Aug 09 15:43:22 user nova-compute[72382]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38d0b588-2e6f-4ebb-84a1-8a928e923cd7 (non-flash)
Aug 09 15:43:22 user nova-compute[72382]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e4a3c00-af87-4059-b7b4-332fdcac9629 (non-flash)
Aug 09 15:43:22 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 15:43:22 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd472108-36b3-4ad1-acc9-24179039fc58 tempest-TestServerVolumeAttachScenarioOldVersion-787688685 tempest-TestServerVolumeAttachScenarioOldVersion-787688685-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f58579c-f69a-4bee-b16e-970e5a8f590c (non-flash)
Aug 09 15:43:22 user nova-compute[72382]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38d0b588-2e6f-4ebb-84a1-8a928e923cd7 (non-flash)
Aug 09 15:43:22 user nova-compute[72382]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e4a3c00-af87-4059-b7b4-332fdcac9629 (non-flash)
Aug 09 15:43:22 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 15:43:22 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-fd472108-36b3-4ad1-acc9-24179039fc58 tempest-TestServerVolumeAttachScenarioOldVersion-787688685 tempest-TestServerVolumeAttachScenarioOldVersion-787688685-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5e4a3c00-af87-4059-b7b4-332fdcac9629" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.304s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 15:43:22 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd472108-36b3-4ad1-acc9-24179039fc58 tempest-TestServerVolumeAttachScenarioOldVersion-787688685 tempest-TestServerVolumeAttachScenarioOldVersion-787688685-project-member] Connected to 172.16.0.220:3260 {{(pid=72382) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 15:43:22 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-fd472108-36b3-4ad1-acc9-24179039fc58 tempest-TestServerVolumeAttachScenarioOldVersion-787688685 tempest-TestServerVolumeAttachScenarioOldVersion-787688685-project-member] HCTL ('34', '-', '-', 0) found on session 58 with lun 0 {{(pid=72382) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 15:43:22 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-fd472108-36b3-4ad1-acc9-24179039fc58 tempest-TestServerVolumeAttachScenarioOldVersion-787688685 tempest-TestServerVolumeAttachScenarioOldVersion-787688685-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72382) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 15:43:22 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:43:22 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:43:22 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[55dafb09-5e83-4ec6-9bc6-df67418dc029]: (4, ('- - 0', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:43:22 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-fd472108-36b3-4ad1-acc9-24179039fc58 tempest-TestServerVolumeAttachScenarioOldVersion-787688685 tempest-TestServerVolumeAttachScenarioOldVersion-787688685-project-member] Searching for a device in session 58 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72382) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 15:43:22 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd472108-36b3-4ad1-acc9-24179039fc58 tempest-TestServerVolumeAttachScenarioOldVersion-787688685 tempest-TestServerVolumeAttachScenarioOldVersion-787688685-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kEjWlsnK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72382) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 15:43:23 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-fd472108-36b3-4ad1-acc9-24179039fc58 tempest-TestServerVolumeAttachScenarioOldVersion-787688685 tempest-TestServerVolumeAttachScenarioOldVersion-787688685-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.339s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 15:43:23 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd472108-36b3-4ad1-acc9-24179039fc58 tempest-TestServerVolumeAttachScenarioOldVersion-787688685 tempest-TestServerVolumeAttachScenarioOldVersion-787688685-project-member] <== connect_volume: return (1341ms) {'type': 'block', 'scsi_wwn': '23865363139613237', 'path': '/dev/sdc'} {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 15:43:23 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fd472108-36b3-4ad1-acc9-24179039fc58 tempest-TestServerVolumeAttachScenarioOldVersion-787688685 tempest-TestServerVolumeAttachScenarioOldVersion-787688685-project-member] [instance: 5c914d94-5bfd-4984-8937-37bdf02e9674] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23865363139613237', 'path': '/dev/sdc'} {{(pid=72382) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 15:43:23 user nova-compute[72382]: DEBUG nova.objects.instance [None req-fd472108-36b3-4ad1-acc9-24179039fc58 tempest-TestServerVolumeAttachScenarioOldVersion-787688685 tempest-TestServerVolumeAttachScenarioOldVersion-787688685-project-member] Lazy-loading 'flavor' on Instance uuid 5c914d94-5bfd-4984-8937-37bdf02e9674 {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:43:23 user nova-compute[72382]: DEBUG nova.virt.libvirt.guest [None req-fd472108-36b3-4ad1-acc9-24179039fc58 tempest-TestServerVolumeAttachScenarioOldVersion-787688685 tempest-TestServerVolumeAttachScenarioOldVersion-787688685-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 15:43:23 user nova-compute[72382]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 15:43:23 user nova-compute[72382]:   <source dev="/dev/sdc"/>
Aug 09 15:43:23 user nova-compute[72382]:   <target dev="vdb" bus="virtio"/>
Aug 09 15:43:23 user nova-compute[72382]:   <serial>5e4a3c00-af87-4059-b7b4-332fdcac9629</serial>
Aug 09 15:43:23 user nova-compute[72382]: </disk>
Aug 09 15:43:23 user nova-compute[72382]:  {{(pid=72382) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 15:43:24 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-fd472108-36b3-4ad1-acc9-24179039fc58 tempest-TestServerVolumeAttachScenarioOldVersion-787688685 tempest-TestServerVolumeAttachScenarioOldVersion-787688685-project-member] No BDM found with device name vda, not building metadata. {{(pid=72382) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 15:43:24 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-fd472108-36b3-4ad1-acc9-24179039fc58 tempest-TestServerVolumeAttachScenarioOldVersion-787688685 tempest-TestServerVolumeAttachScenarioOldVersion-787688685-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72382) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 15:43:24 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-fd472108-36b3-4ad1-acc9-24179039fc58 tempest-TestServerVolumeAttachScenarioOldVersion-787688685 tempest-TestServerVolumeAttachScenarioOldVersion-787688685-project-member] No VIF found with MAC fa:16:3e:4a:5b:a7, not building metadata {{(pid=72382) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 15:43:24 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:43:24 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:43:24 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:43:24 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-fd472108-36b3-4ad1-acc9-24179039fc58 tempest-TestServerVolumeAttachScenarioOldVersion-787688685 tempest-TestServerVolumeAttachScenarioOldVersion-787688685-project-member] Lock "5c914d94-5bfd-4984-8937-37bdf02e9674" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.007s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:43:24 user nova-compute[72382]: DEBUG nova.compute.manager [req-e80b16e2-56d7-4338-9b7f-5e1183459f83 req-52968ff9-0ed5-4f3e-907c-c475abe15900 service nova] [instance: f49b5daf-d39d-496f-97d7-a0d9fd67d66d] Received event network-changed-409cb778-13bd-425b-bb7b-90643706b023 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:43:24 user nova-compute[72382]: DEBUG nova.compute.manager [req-e80b16e2-56d7-4338-9b7f-5e1183459f83 req-52968ff9-0ed5-4f3e-907c-c475abe15900 service nova] [instance: f49b5daf-d39d-496f-97d7-a0d9fd67d66d] Refreshing instance network info cache due to event network-changed-409cb778-13bd-425b-bb7b-90643706b023. {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 15:43:24 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-e80b16e2-56d7-4338-9b7f-5e1183459f83 req-52968ff9-0ed5-4f3e-907c-c475abe15900 service nova] Acquiring lock "refresh_cache-f49b5daf-d39d-496f-97d7-a0d9fd67d66d" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 15:43:24 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-e80b16e2-56d7-4338-9b7f-5e1183459f83 req-52968ff9-0ed5-4f3e-907c-c475abe15900 service nova] Acquired lock "refresh_cache-f49b5daf-d39d-496f-97d7-a0d9fd67d66d" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 15:43:24 user nova-compute[72382]: DEBUG nova.network.neutron [req-e80b16e2-56d7-4338-9b7f-5e1183459f83 req-52968ff9-0ed5-4f3e-907c-c475abe15900 service nova] [instance: f49b5daf-d39d-496f-97d7-a0d9fd67d66d] Refreshing network info cache for port 409cb778-13bd-425b-bb7b-90643706b023 {{(pid=72382) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 15:43:24 user nova-compute[72382]: DEBUG nova.network.neutron [req-e80b16e2-56d7-4338-9b7f-5e1183459f83 req-52968ff9-0ed5-4f3e-907c-c475abe15900 service nova] [instance: f49b5daf-d39d-496f-97d7-a0d9fd67d66d] Updated VIF entry in instance network info cache for port 409cb778-13bd-425b-bb7b-90643706b023. {{(pid=72382) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 15:43:25 user nova-compute[72382]: DEBUG nova.network.neutron [req-e80b16e2-56d7-4338-9b7f-5e1183459f83 req-52968ff9-0ed5-4f3e-907c-c475abe15900 service nova] [instance: f49b5daf-d39d-496f-97d7-a0d9fd67d66d] Updating instance_info_cache with network_info: [{"id": "409cb778-13bd-425b-bb7b-90643706b023", "address": "fa:16:3e:f1:a9:bc", "network": {"id": "a78e6cb6-feb7-4f64-a3c0-4900594b6e37", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-338007968-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70310b1af40b4d239fe5ea362972554b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap409cb778-13", "ovs_interfaceid": "409cb778-13bd-425b-bb7b-90643706b023", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:43:25 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-e80b16e2-56d7-4338-9b7f-5e1183459f83 req-52968ff9-0ed5-4f3e-907c-c475abe15900 service nova] Releasing lock "refresh_cache-f49b5daf-d39d-496f-97d7-a0d9fd67d66d" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 15:43:25 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:43:25 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-cf36d157-3ccf-432b-af5f-20861e9f526e tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Acquiring lock "f49b5daf-d39d-496f-97d7-a0d9fd67d66d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:43:25 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-cf36d157-3ccf-432b-af5f-20861e9f526e tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Lock "f49b5daf-d39d-496f-97d7-a0d9fd67d66d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:43:25 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-cf36d157-3ccf-432b-af5f-20861e9f526e tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Acquiring lock "f49b5daf-d39d-496f-97d7-a0d9fd67d66d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:43:25 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-cf36d157-3ccf-432b-af5f-20861e9f526e tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Lock "f49b5daf-d39d-496f-97d7-a0d9fd67d66d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:43:25 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-cf36d157-3ccf-432b-af5f-20861e9f526e tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Lock "f49b5daf-d39d-496f-97d7-a0d9fd67d66d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:43:25 user nova-compute[72382]: INFO nova.compute.manager [None req-cf36d157-3ccf-432b-af5f-20861e9f526e tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: f49b5daf-d39d-496f-97d7-a0d9fd67d66d] Terminating instance
Aug 09 15:43:25 user nova-compute[72382]: DEBUG nova.compute.manager [None req-cf36d157-3ccf-432b-af5f-20861e9f526e tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: f49b5daf-d39d-496f-97d7-a0d9fd67d66d] Start destroying the instance on the hypervisor. {{(pid=72382) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 15:43:25 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:43:25 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:43:25 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:43:25 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-5c07d6a8-9ee1-4927-b999-0cf09390e2ce tempest-TestServerVolumeAttachScenarioOldVersion-787688685 tempest-TestServerVolumeAttachScenarioOldVersion-787688685-project-member] Acquiring lock "5c914d94-5bfd-4984-8937-37bdf02e9674" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:43:25 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-5c07d6a8-9ee1-4927-b999-0cf09390e2ce tempest-TestServerVolumeAttachScenarioOldVersion-787688685 tempest-TestServerVolumeAttachScenarioOldVersion-787688685-project-member] Lock "5c914d94-5bfd-4984-8937-37bdf02e9674" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:43:25 user nova-compute[72382]: INFO nova.compute.manager [None req-5c07d6a8-9ee1-4927-b999-0cf09390e2ce tempest-TestServerVolumeAttachScenarioOldVersion-787688685 tempest-TestServerVolumeAttachScenarioOldVersion-787688685-project-member] [instance: 5c914d94-5bfd-4984-8937-37bdf02e9674] Detaching volume 5e4a3c00-af87-4059-b7b4-332fdcac9629
Aug 09 15:43:25 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:43:25 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:43:25 user nova-compute[72382]: INFO nova.virt.block_device [None req-5c07d6a8-9ee1-4927-b999-0cf09390e2ce tempest-TestServerVolumeAttachScenarioOldVersion-787688685 tempest-TestServerVolumeAttachScenarioOldVersion-787688685-project-member] [instance: 5c914d94-5bfd-4984-8937-37bdf02e9674] Attempting to driver detach volume 5e4a3c00-af87-4059-b7b4-332fdcac9629 from mountpoint /dev/vdb
Aug 09 15:43:25 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-5c07d6a8-9ee1-4927-b999-0cf09390e2ce tempest-TestServerVolumeAttachScenarioOldVersion-787688685 tempest-TestServerVolumeAttachScenarioOldVersion-787688685-project-member] Attempting to detach device vdb from instance 5c914d94-5bfd-4984-8937-37bdf02e9674 from the persistent domain config. {{(pid=72382) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 15:43:25 user nova-compute[72382]: DEBUG nova.virt.libvirt.guest [None req-5c07d6a8-9ee1-4927-b999-0cf09390e2ce tempest-TestServerVolumeAttachScenarioOldVersion-787688685 tempest-TestServerVolumeAttachScenarioOldVersion-787688685-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 15:43:25 user nova-compute[72382]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 15:43:25 user nova-compute[72382]:   <source dev="/dev/sdc"/>
Aug 09 15:43:25 user nova-compute[72382]:   <target dev="vdb" bus="virtio"/>
Aug 09 15:43:25 user nova-compute[72382]:   <serial>5e4a3c00-af87-4059-b7b4-332fdcac9629</serial>
Aug 09 15:43:25 user nova-compute[72382]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 15:43:25 user nova-compute[72382]: </disk>
Aug 09 15:43:25 user nova-compute[72382]:  {{(pid=72382) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 15:43:25 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-5c07d6a8-9ee1-4927-b999-0cf09390e2ce tempest-TestServerVolumeAttachScenarioOldVersion-787688685 tempest-TestServerVolumeAttachScenarioOldVersion-787688685-project-member] Successfully detached device vdb from instance 5c914d94-5bfd-4984-8937-37bdf02e9674 from the persistent domain config.
Aug 09 15:43:25 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-5c07d6a8-9ee1-4927-b999-0cf09390e2ce tempest-TestServerVolumeAttachScenarioOldVersion-787688685 tempest-TestServerVolumeAttachScenarioOldVersion-787688685-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 5c914d94-5bfd-4984-8937-37bdf02e9674 from the live domain config. {{(pid=72382) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 15:43:25 user nova-compute[72382]: DEBUG nova.virt.libvirt.guest [None req-5c07d6a8-9ee1-4927-b999-0cf09390e2ce tempest-TestServerVolumeAttachScenarioOldVersion-787688685 tempest-TestServerVolumeAttachScenarioOldVersion-787688685-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 15:43:25 user nova-compute[72382]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 15:43:25 user nova-compute[72382]:   <source dev="/dev/sdc"/>
Aug 09 15:43:25 user nova-compute[72382]:   <target dev="vdb" bus="virtio"/>
Aug 09 15:43:25 user nova-compute[72382]:   <serial>5e4a3c00-af87-4059-b7b4-332fdcac9629</serial>
Aug 09 15:43:25 user nova-compute[72382]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 15:43:25 user nova-compute[72382]: </disk>
Aug 09 15:43:25 user nova-compute[72382]:  {{(pid=72382) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 15:43:26 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Received event <DeviceRemovedEvent: 1691595806.5765374, 5c914d94-5bfd-4984-8937-37bdf02e9674 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72382) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 15:43:26 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-5c07d6a8-9ee1-4927-b999-0cf09390e2ce tempest-TestServerVolumeAttachScenarioOldVersion-787688685 tempest-TestServerVolumeAttachScenarioOldVersion-787688685-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 5c914d94-5bfd-4984-8937-37bdf02e9674 {{(pid=72382) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 15:43:26 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-5c07d6a8-9ee1-4927-b999-0cf09390e2ce tempest-TestServerVolumeAttachScenarioOldVersion-787688685 tempest-TestServerVolumeAttachScenarioOldVersion-787688685-project-member] Successfully detached device vdb from instance 5c914d94-5bfd-4984-8937-37bdf02e9674 from the live domain config.
Aug 09 15:43:26 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5c07d6a8-9ee1-4927-b999-0cf09390e2ce tempest-TestServerVolumeAttachScenarioOldVersion-787688685 tempest-TestServerVolumeAttachScenarioOldVersion-787688685-project-member] [instance: 5c914d94-5bfd-4984-8937-37bdf02e9674] calling os-brick to detach iSCSI Volume {{(pid=72382) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 15:43:26 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c07d6a8-9ee1-4927-b999-0cf09390e2ce tempest-TestServerVolumeAttachScenarioOldVersion-787688685 tempest-TestServerVolumeAttachScenarioOldVersion-787688685-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2a0c768340>, {'target_iqns': ['iqn.2010-10.org.openstack:5e4a3c00-af87-4059-b7b4-332fdcac9629'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kEjWlsnK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 15:43:26 user nova-compute[72382]: WARNING os_brick.initiator.connectors.base [None req-5c07d6a8-9ee1-4927-b999-0cf09390e2ce tempest-TestServerVolumeAttachScenarioOldVersion-787688685 tempest-TestServerVolumeAttachScenarioOldVersion-787688685-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 15:43:26 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-5c07d6a8-9ee1-4927-b999-0cf09390e2ce tempest-TestServerVolumeAttachScenarioOldVersion-787688685 tempest-TestServerVolumeAttachScenarioOldVersion-787688685-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 15:43:26 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-5c07d6a8-9ee1-4927-b999-0cf09390e2ce tempest-TestServerVolumeAttachScenarioOldVersion-787688685 tempest-TestServerVolumeAttachScenarioOldVersion-787688685-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 15:43:26 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c07d6a8-9ee1-4927-b999-0cf09390e2ce tempest-TestServerVolumeAttachScenarioOldVersion-787688685 tempest-TestServerVolumeAttachScenarioOldVersion-787688685-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5e4a3c00-af87-4059-b7b4-332fdcac9629', 0)] {{(pid=72382) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 15:43:26 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:43:26 user nova-compute[72382]: INFO nova.virt.libvirt.driver [-] [instance: f49b5daf-d39d-496f-97d7-a0d9fd67d66d] Instance destroyed successfully.
Aug 09 15:43:26 user nova-compute[72382]: DEBUG nova.objects.instance [None req-cf36d157-3ccf-432b-af5f-20861e9f526e tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Lazy-loading 'resources' on Instance uuid f49b5daf-d39d-496f-97d7-a0d9fd67d66d {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:43:26 user nova-compute[72382]: DEBUG nova.virt.libvirt.vif [None req-cf36d157-3ccf-432b-af5f-20861e9f526e tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T15:41:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1980844139',display_name='tempest-TestVolumeBootPattern-server-1980844139',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1980844139',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE2Ft4ugcR+xm9FJQARVlCQBYm313gUcmopkZOKz9jwU+uIeLmDWZczJQzSvB2hHfGE3d6cxNwerl6nmxRdqMq6zUG8hCLpv56gJB1tj7Wzv5bBbh5m7r3DF8/P9Gg51AA==',key_name='tempest-TestVolumeBootPattern-1990844198',keypairs=<?>,launch_index=0,launched_at=2023-08-09T15:41:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='70310b1af40b4d239fe5ea362972554b',ramdisk_id='',reservation_id='r-ynegf0et',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-451643589',owner_user_name='tempest-TestVolumeBootPattern-451643589-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T15:41:48Z,user_data=None,user_id='280bcf2afd7245a7bcd605e0db79c569',uuid=f49b5daf-d39d-496f-97d7-a0d9fd67d66d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "409cb778-13bd-425b-bb7b-90643706b023", "address": "fa:16:3e:f1:a9:bc", "network": {"id": "a78e6cb6-feb7-4f64-a3c0-4900594b6e37", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-338007968-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70310b1af40b4d239fe5ea362972554b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap409cb778-13", "ovs_interfaceid": "409cb778-13bd-425b-bb7b-90643706b023", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 15:43:26 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-cf36d157-3ccf-432b-af5f-20861e9f526e tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Converting VIF {"id": "409cb778-13bd-425b-bb7b-90643706b023", "address": "fa:16:3e:f1:a9:bc", "network": {"id": "a78e6cb6-feb7-4f64-a3c0-4900594b6e37", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-338007968-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70310b1af40b4d239fe5ea362972554b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap409cb778-13", "ovs_interfaceid": "409cb778-13bd-425b-bb7b-90643706b023", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 15:43:26 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-cf36d157-3ccf-432b-af5f-20861e9f526e tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f1:a9:bc,bridge_name='br-int',has_traffic_filtering=True,id=409cb778-13bd-425b-bb7b-90643706b023,network=Network(a78e6cb6-feb7-4f64-a3c0-4900594b6e37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap409cb778-13') {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 15:43:26 user nova-compute[72382]: DEBUG os_vif [None req-cf36d157-3ccf-432b-af5f-20861e9f526e tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f1:a9:bc,bridge_name='br-int',has_traffic_filtering=True,id=409cb778-13bd-425b-bb7b-90643706b023,network=Network(a78e6cb6-feb7-4f64-a3c0-4900594b6e37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap409cb778-13') {{(pid=72382) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 15:43:26 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:43:26 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[093499bb-7f54-4654-bdf7-c0e97c841ad8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:38d0b588-2e6f-4ebb-84a1-8a928e923cd7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3f58579c-f69a-4bee-b16e-970e5a8f590c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5e4a3c00-af87-4059-b7b4-332fdcac9629\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:43:26 user nova-compute[72382]: DEBUG nova.compute.manager [req-4a9111ef-8602-4257-b4c4-2cfb1de43dde req-b908a685-221b-4cdb-a3d7-ab1158e34fa9 service nova] [instance: f49b5daf-d39d-496f-97d7-a0d9fd67d66d] Received event network-changed-409cb778-13bd-425b-bb7b-90643706b023 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:43:26 user nova-compute[72382]: DEBUG nova.compute.manager [req-4a9111ef-8602-4257-b4c4-2cfb1de43dde req-b908a685-221b-4cdb-a3d7-ab1158e34fa9 service nova] [instance: f49b5daf-d39d-496f-97d7-a0d9fd67d66d] Refreshing instance network info cache due to event network-changed-409cb778-13bd-425b-bb7b-90643706b023. {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 15:43:26 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-4a9111ef-8602-4257-b4c4-2cfb1de43dde req-b908a685-221b-4cdb-a3d7-ab1158e34fa9 service nova] Acquiring lock "refresh_cache-f49b5daf-d39d-496f-97d7-a0d9fd67d66d" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 15:43:26 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-4a9111ef-8602-4257-b4c4-2cfb1de43dde req-b908a685-221b-4cdb-a3d7-ab1158e34fa9 service nova] Acquired lock "refresh_cache-f49b5daf-d39d-496f-97d7-a0d9fd67d66d" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 15:43:26 user nova-compute[72382]: DEBUG nova.network.neutron [req-4a9111ef-8602-4257-b4c4-2cfb1de43dde req-b908a685-221b-4cdb-a3d7-ab1158e34fa9 service nova] [instance: f49b5daf-d39d-496f-97d7-a0d9fd67d66d] Refreshing network info cache for port 409cb778-13bd-425b-bb7b-90643706b023 {{(pid=72382) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 15:43:26 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:43:26 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:43:26 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap409cb778-13, bridge=br-int, if_exists=True) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:43:26 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:43:26 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:43:26 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:43:26 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ca48695-3bcb-40de-af8d-ecf547a178a9]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f58579c-f69a-4bee-b16e-970e5a8f590c (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38d0b588-2e6f-4ebb-84a1-8a928e923cd7 (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e4a3c00-af87-4059-b7b4-332fdcac9629 (non-flash)\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:43:26 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c07d6a8-9ee1-4927-b999-0cf09390e2ce tempest-TestServerVolumeAttachScenarioOldVersion-787688685 tempest-TestServerVolumeAttachScenarioOldVersion-787688685-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f58579c-f69a-4bee-b16e-970e5a8f590c (non-flash)
Aug 09 15:43:26 user nova-compute[72382]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38d0b588-2e6f-4ebb-84a1-8a928e923cd7 (non-flash)
Aug 09 15:43:26 user nova-compute[72382]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e4a3c00-af87-4059-b7b4-332fdcac9629 (non-flash)
Aug 09 15:43:26 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 15:43:26 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c07d6a8-9ee1-4927-b999-0cf09390e2ce tempest-TestServerVolumeAttachScenarioOldVersion-787688685 tempest-TestServerVolumeAttachScenarioOldVersion-787688685-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f58579c-f69a-4bee-b16e-970e5a8f590c (non-flash)
Aug 09 15:43:26 user nova-compute[72382]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38d0b588-2e6f-4ebb-84a1-8a928e923cd7 (non-flash)
Aug 09 15:43:26 user nova-compute[72382]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e4a3c00-af87-4059-b7b4-332fdcac9629 (non-flash)
Aug 09 15:43:26 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 15:43:26 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c07d6a8-9ee1-4927-b999-0cf09390e2ce tempest-TestServerVolumeAttachScenarioOldVersion-787688685 tempest-TestServerVolumeAttachScenarioOldVersion-787688685-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2a0c365120>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5e4a3c00-af87-4059-b7b4-332fdcac9629'): ({'sdc'}, set())}) {{(pid=72382) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 15:43:26 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-5c07d6a8-9ee1-4927-b999-0cf09390e2ce tempest-TestServerVolumeAttachScenarioOldVersion-787688685 tempest-TestServerVolumeAttachScenarioOldVersion-787688685-project-member] Removing single pathed devices sdc {{(pid=72382) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 15:43:26 user nova-compute[72382]: INFO os_vif [None req-cf36d157-3ccf-432b-af5f-20861e9f526e tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f1:a9:bc,bridge_name='br-int',has_traffic_filtering=True,id=409cb778-13bd-425b-bb7b-90643706b023,network=Network(a78e6cb6-feb7-4f64-a3c0-4900594b6e37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap409cb778-13')
Aug 09 15:43:26 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:43:26 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cf36d157-3ccf-432b-af5f-20861e9f526e tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: f49b5daf-d39d-496f-97d7-a0d9fd67d66d] calling os-brick to detach iSCSI Volume {{(pid=72382) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 15:43:26 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf36d157-3ccf-432b-af5f-20861e9f526e tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2a0c768340>, {'target_iqns': ['iqn.2010-10.org.openstack:38d0b588-2e6f-4ebb-84a1-8a928e923cd7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zTeQNpsu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 15:43:26 user nova-compute[72382]: WARNING os_brick.initiator.connectors.base [None req-cf36d157-3ccf-432b-af5f-20861e9f526e tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 15:43:26 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-cf36d157-3ccf-432b-af5f-20861e9f526e tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 15:43:26 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:43:26 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d9588ad-debb-4b32-9223-7d10a8e7a267]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:43:26 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:43:26 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:43:26 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[01d51cf1-6954-4b90-91e8-b0b8d8cca444]: (4, ('ok\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:43:26 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-5c07d6a8-9ee1-4927-b999-0cf09390e2ce tempest-TestServerVolumeAttachScenarioOldVersion-787688685 tempest-TestServerVolumeAttachScenarioOldVersion-787688685-project-member] Flushing IO for device /dev/sdc {{(pid=72382) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 15:43:26 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:43:26 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.017s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:43:26 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[108b3e8c-1c83-45a5-b66f-e4aadbce1b84]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:43:26 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-5c07d6a8-9ee1-4927-b999-0cf09390e2ce tempest-TestServerVolumeAttachScenarioOldVersion-787688685 tempest-TestServerVolumeAttachScenarioOldVersion-787688685-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72382) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 15:43:26 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:43:26 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.038s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:43:26 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d95bcff-7b43-4646-86cc-cee3414a34c9]: (4, ('1', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:43:26 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-5c07d6a8-9ee1-4927-b999-0cf09390e2ce tempest-TestServerVolumeAttachScenarioOldVersion-787688685 tempest-TestServerVolumeAttachScenarioOldVersion-787688685-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72382) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 15:43:26 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-5c07d6a8-9ee1-4927-b999-0cf09390e2ce tempest-TestServerVolumeAttachScenarioOldVersion-787688685 tempest-TestServerVolumeAttachScenarioOldVersion-787688685-project-member] SCSI volumes sdc have been removed. {{(pid=72382) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 15:43:26 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c07d6a8-9ee1-4927-b999-0cf09390e2ce tempest-TestServerVolumeAttachScenarioOldVersion-787688685 tempest-TestServerVolumeAttachScenarioOldVersion-787688685-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5e4a3c00-af87-4059-b7b4-332fdcac9629')] {{(pid=72382) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 15:43:26 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e4a3c00-af87-4059-b7b4-332fdcac9629 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:43:26 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e4a3c00-af87-4059-b7b4-332fdcac9629 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:43:26 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d3e77bd-bc0e-405c-8459-55b65632bb06]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:43:26 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c07d6a8-9ee1-4927-b999-0cf09390e2ce tempest-TestServerVolumeAttachScenarioOldVersion-787688685 tempest-TestServerVolumeAttachScenarioOldVersion-787688685-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:43:26 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e4a3c00-af87-4059-b7b4-332fdcac9629 -p 172.16.0.220:3260 --logout {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:43:26 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e4a3c00-af87-4059-b7b4-332fdcac9629 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:43:26 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[a195cd17-cc88-453f-bf21-fa121dfdd5a2]: (4, ('Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:5e4a3c00-af87-4059-b7b4-332fdcac9629, portal: 172.16.0.220,3260]\nLogout of [sid: 58, target: iqn.2010-10.org.openstack:5e4a3c00-af87-4059-b7b4-332fdcac9629, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:43:26 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c07d6a8-9ee1-4927-b999-0cf09390e2ce tempest-TestServerVolumeAttachScenarioOldVersion-787688685 tempest-TestServerVolumeAttachScenarioOldVersion-787688685-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:5e4a3c00-af87-4059-b7b4-332fdcac9629, portal: 172.16.0.220,3260]
Aug 09 15:43:26 user nova-compute[72382]: Logout of [sid: 58, target: iqn.2010-10.org.openstack:5e4a3c00-af87-4059-b7b4-332fdcac9629, portal: 172.16.0.220,3260] successful.
Aug 09 15:43:26 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:43:26 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e4a3c00-af87-4059-b7b4-332fdcac9629 -p 172.16.0.220:3260 --op delete {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:43:26 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:43:26 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:43:26 user nova-compute[72382]: DEBUG nova.compute.manager [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72382) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 15:43:26 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e4a3c00-af87-4059-b7b4-332fdcac9629 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:43:26 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[c392056c-93f6-4207-a5b6-9acecebb53b9]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:43:26 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c07d6a8-9ee1-4927-b999-0cf09390e2ce tempest-TestServerVolumeAttachScenarioOldVersion-787688685 tempest-TestServerVolumeAttachScenarioOldVersion-787688685-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:43:26 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-5c07d6a8-9ee1-4927-b999-0cf09390e2ce tempest-TestServerVolumeAttachScenarioOldVersion-787688685 tempest-TestServerVolumeAttachScenarioOldVersion-787688685-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.303s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 15:43:26 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c07d6a8-9ee1-4927-b999-0cf09390e2ce tempest-TestServerVolumeAttachScenarioOldVersion-787688685 tempest-TestServerVolumeAttachScenarioOldVersion-787688685-project-member] <== disconnect_volume: return (305ms) None {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 15:43:26 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5c07d6a8-9ee1-4927-b999-0cf09390e2ce tempest-TestServerVolumeAttachScenarioOldVersion-787688685 tempest-TestServerVolumeAttachScenarioOldVersion-787688685-project-member] [instance: 5c914d94-5bfd-4984-8937-37bdf02e9674] Disconnected iSCSI Volume {{(pid=72382) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 15:43:26 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-cf36d157-3ccf-432b-af5f-20861e9f526e tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.241s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 15:43:26 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf36d157-3ccf-432b-af5f-20861e9f526e tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:38d0b588-2e6f-4ebb-84a1-8a928e923cd7', 0)] {{(pid=72382) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 15:43:26 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:43:26 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:43:26 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[b69d1a56-82e0-41d5-a132-34049b38d518]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:38d0b588-2e6f-4ebb-84a1-8a928e923cd7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3f58579c-f69a-4bee-b16e-970e5a8f590c\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:43:26 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:43:26 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:43:26 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[9764afae-20f0-4c96-9612-b73737a1cf43]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f58579c-f69a-4bee-b16e-970e5a8f590c (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38d0b588-2e6f-4ebb-84a1-8a928e923cd7 (non-flash)\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:43:26 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf36d157-3ccf-432b-af5f-20861e9f526e tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f58579c-f69a-4bee-b16e-970e5a8f590c (non-flash)
Aug 09 15:43:26 user nova-compute[72382]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38d0b588-2e6f-4ebb-84a1-8a928e923cd7 (non-flash)
Aug 09 15:43:26 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 15:43:26 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf36d157-3ccf-432b-af5f-20861e9f526e tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f58579c-f69a-4bee-b16e-970e5a8f590c (non-flash)
Aug 09 15:43:26 user nova-compute[72382]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38d0b588-2e6f-4ebb-84a1-8a928e923cd7 (non-flash)
Aug 09 15:43:26 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 15:43:26 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf36d157-3ccf-432b-af5f-20861e9f526e tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2a0c395000>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:38d0b588-2e6f-4ebb-84a1-8a928e923cd7'): ({'sdd'}, set())}) {{(pid=72382) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 15:43:26 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-cf36d157-3ccf-432b-af5f-20861e9f526e tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Removing single pathed devices sdd {{(pid=72382) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 15:43:26 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:43:26 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:43:26 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b1ffb61-f223-4697-a1f2-4d087c699389]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:43:26 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:43:27 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.017s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:43:27 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab28b850-6310-44ad-a56e-b588b790a976]: (4, ('ok\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:43:27 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-cf36d157-3ccf-432b-af5f-20861e9f526e tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Flushing IO for device /dev/sdd {{(pid=72382) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 15:43:27 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:43:27 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:43:27 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[3899402a-a38b-4111-9a3f-3b1c0e3afe25]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:43:27 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-cf36d157-3ccf-432b-af5f-20861e9f526e tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72382) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 15:43:27 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:43:27 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.045s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:43:27 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[b56adbdb-2ff8-4990-b148-39aec0d18f9e]: (4, ('1', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:43:27 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-cf36d157-3ccf-432b-af5f-20861e9f526e tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72382) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 15:43:27 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-cf36d157-3ccf-432b-af5f-20861e9f526e tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] SCSI volumes sdd have been removed. {{(pid=72382) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 15:43:27 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf36d157-3ccf-432b-af5f-20861e9f526e tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:38d0b588-2e6f-4ebb-84a1-8a928e923cd7')] {{(pid=72382) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 15:43:27 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38d0b588-2e6f-4ebb-84a1-8a928e923cd7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:43:27 user nova-compute[72382]: DEBUG nova.network.neutron [req-4a9111ef-8602-4257-b4c4-2cfb1de43dde req-b908a685-221b-4cdb-a3d7-ab1158e34fa9 service nova] [instance: f49b5daf-d39d-496f-97d7-a0d9fd67d66d] Updated VIF entry in instance network info cache for port 409cb778-13bd-425b-bb7b-90643706b023. {{(pid=72382) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 15:43:27 user nova-compute[72382]: DEBUG nova.network.neutron [req-4a9111ef-8602-4257-b4c4-2cfb1de43dde req-b908a685-221b-4cdb-a3d7-ab1158e34fa9 service nova] [instance: f49b5daf-d39d-496f-97d7-a0d9fd67d66d] Updating instance_info_cache with network_info: [{"id": "409cb778-13bd-425b-bb7b-90643706b023", "address": "fa:16:3e:f1:a9:bc", "network": {"id": "a78e6cb6-feb7-4f64-a3c0-4900594b6e37", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-338007968-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70310b1af40b4d239fe5ea362972554b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap409cb778-13", "ovs_interfaceid": "409cb778-13bd-425b-bb7b-90643706b023", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:43:27 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38d0b588-2e6f-4ebb-84a1-8a928e923cd7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:43:27 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8a8c480-d39f-4587-9f9b-88e87a3922e4]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:43:27 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf36d157-3ccf-432b-af5f-20861e9f526e tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:43:27 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38d0b588-2e6f-4ebb-84a1-8a928e923cd7 -p 172.16.0.220:3260 --logout {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:43:27 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-4a9111ef-8602-4257-b4c4-2cfb1de43dde req-b908a685-221b-4cdb-a3d7-ab1158e34fa9 service nova] Releasing lock "refresh_cache-f49b5daf-d39d-496f-97d7-a0d9fd67d66d" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 15:43:27 user nova-compute[72382]: DEBUG nova.compute.manager [req-4a9111ef-8602-4257-b4c4-2cfb1de43dde req-b908a685-221b-4cdb-a3d7-ab1158e34fa9 service nova] [instance: f49b5daf-d39d-496f-97d7-a0d9fd67d66d] Received event network-vif-unplugged-409cb778-13bd-425b-bb7b-90643706b023 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:43:27 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-4a9111ef-8602-4257-b4c4-2cfb1de43dde req-b908a685-221b-4cdb-a3d7-ab1158e34fa9 service nova] Acquiring lock "f49b5daf-d39d-496f-97d7-a0d9fd67d66d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:43:27 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-4a9111ef-8602-4257-b4c4-2cfb1de43dde req-b908a685-221b-4cdb-a3d7-ab1158e34fa9 service nova] Lock "f49b5daf-d39d-496f-97d7-a0d9fd67d66d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:43:27 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-4a9111ef-8602-4257-b4c4-2cfb1de43dde req-b908a685-221b-4cdb-a3d7-ab1158e34fa9 service nova] Lock "f49b5daf-d39d-496f-97d7-a0d9fd67d66d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:43:27 user nova-compute[72382]: DEBUG nova.compute.manager [req-4a9111ef-8602-4257-b4c4-2cfb1de43dde req-b908a685-221b-4cdb-a3d7-ab1158e34fa9 service nova] [instance: f49b5daf-d39d-496f-97d7-a0d9fd67d66d] No waiting events found dispatching network-vif-unplugged-409cb778-13bd-425b-bb7b-90643706b023 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:43:27 user nova-compute[72382]: DEBUG nova.compute.manager [req-4a9111ef-8602-4257-b4c4-2cfb1de43dde req-b908a685-221b-4cdb-a3d7-ab1158e34fa9 service nova] [instance: f49b5daf-d39d-496f-97d7-a0d9fd67d66d] Received event network-vif-unplugged-409cb778-13bd-425b-bb7b-90643706b023 for instance with task_state deleting. {{(pid=72382) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 15:43:27 user nova-compute[72382]: DEBUG nova.compute.manager [req-4a9111ef-8602-4257-b4c4-2cfb1de43dde req-b908a685-221b-4cdb-a3d7-ab1158e34fa9 service nova] [instance: f49b5daf-d39d-496f-97d7-a0d9fd67d66d] Received event network-vif-plugged-409cb778-13bd-425b-bb7b-90643706b023 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:43:27 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-4a9111ef-8602-4257-b4c4-2cfb1de43dde req-b908a685-221b-4cdb-a3d7-ab1158e34fa9 service nova] Acquiring lock "f49b5daf-d39d-496f-97d7-a0d9fd67d66d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:43:27 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-4a9111ef-8602-4257-b4c4-2cfb1de43dde req-b908a685-221b-4cdb-a3d7-ab1158e34fa9 service nova] Lock "f49b5daf-d39d-496f-97d7-a0d9fd67d66d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:43:27 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-4a9111ef-8602-4257-b4c4-2cfb1de43dde req-b908a685-221b-4cdb-a3d7-ab1158e34fa9 service nova] Lock "f49b5daf-d39d-496f-97d7-a0d9fd67d66d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:43:27 user nova-compute[72382]: DEBUG nova.compute.manager [req-4a9111ef-8602-4257-b4c4-2cfb1de43dde req-b908a685-221b-4cdb-a3d7-ab1158e34fa9 service nova] [instance: f49b5daf-d39d-496f-97d7-a0d9fd67d66d] No waiting events found dispatching network-vif-plugged-409cb778-13bd-425b-bb7b-90643706b023 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:43:27 user nova-compute[72382]: WARNING nova.compute.manager [req-4a9111ef-8602-4257-b4c4-2cfb1de43dde req-b908a685-221b-4cdb-a3d7-ab1158e34fa9 service nova] [instance: f49b5daf-d39d-496f-97d7-a0d9fd67d66d] Received unexpected event network-vif-plugged-409cb778-13bd-425b-bb7b-90643706b023 for instance with vm_state active and task_state deleting.
Aug 09 15:43:27 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38d0b588-2e6f-4ebb-84a1-8a928e923cd7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:43:27 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8e3bea0-4f70-4abb-aff4-c3a103de6263]: (4, ('Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:38d0b588-2e6f-4ebb-84a1-8a928e923cd7, portal: 172.16.0.220,3260]\nLogout of [sid: 56, target: iqn.2010-10.org.openstack:38d0b588-2e6f-4ebb-84a1-8a928e923cd7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:43:27 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf36d157-3ccf-432b-af5f-20861e9f526e tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:38d0b588-2e6f-4ebb-84a1-8a928e923cd7, portal: 172.16.0.220,3260]
Aug 09 15:43:27 user nova-compute[72382]: Logout of [sid: 56, target: iqn.2010-10.org.openstack:38d0b588-2e6f-4ebb-84a1-8a928e923cd7, portal: 172.16.0.220,3260] successful.
Aug 09 15:43:27 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:43:27 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38d0b588-2e6f-4ebb-84a1-8a928e923cd7 -p 172.16.0.220:3260 --op delete {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:43:27 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38d0b588-2e6f-4ebb-84a1-8a928e923cd7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:43:27 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6a49724-e39f-4e37-b006-254a963fca47]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:43:27 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf36d157-3ccf-432b-af5f-20861e9f526e tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:43:27 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-cf36d157-3ccf-432b-af5f-20861e9f526e tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.285s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 15:43:27 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf36d157-3ccf-432b-af5f-20861e9f526e tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] <== disconnect_volume: return (527ms) None {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 15:43:27 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cf36d157-3ccf-432b-af5f-20861e9f526e tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: f49b5daf-d39d-496f-97d7-a0d9fd67d66d] Disconnected iSCSI Volume {{(pid=72382) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 15:43:27 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-cf36d157-3ccf-432b-af5f-20861e9f526e tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: f49b5daf-d39d-496f-97d7-a0d9fd67d66d] Deleting instance files /opt/stack/data/nova/instances/f49b5daf-d39d-496f-97d7-a0d9fd67d66d_del
Aug 09 15:43:27 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-cf36d157-3ccf-432b-af5f-20861e9f526e tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: f49b5daf-d39d-496f-97d7-a0d9fd67d66d] Deletion of /opt/stack/data/nova/instances/f49b5daf-d39d-496f-97d7-a0d9fd67d66d_del complete
Aug 09 15:43:27 user nova-compute[72382]: INFO nova.compute.manager [None req-cf36d157-3ccf-432b-af5f-20861e9f526e tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: f49b5daf-d39d-496f-97d7-a0d9fd67d66d] Took 1.65 seconds to destroy the instance on the hypervisor.
Aug 09 15:43:27 user nova-compute[72382]: DEBUG oslo.service.loopingcall [None req-cf36d157-3ccf-432b-af5f-20861e9f526e tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72382) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 15:43:27 user nova-compute[72382]: DEBUG nova.compute.manager [-] [instance: f49b5daf-d39d-496f-97d7-a0d9fd67d66d] Deallocating network for instance {{(pid=72382) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 15:43:27 user nova-compute[72382]: DEBUG nova.network.neutron [-] [instance: f49b5daf-d39d-496f-97d7-a0d9fd67d66d] deallocate_for_instance() {{(pid=72382) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 15:43:27 user nova-compute[72382]: DEBUG nova.objects.instance [None req-5c07d6a8-9ee1-4927-b999-0cf09390e2ce tempest-TestServerVolumeAttachScenarioOldVersion-787688685 tempest-TestServerVolumeAttachScenarioOldVersion-787688685-project-member] Lazy-loading 'flavor' on Instance uuid 5c914d94-5bfd-4984-8937-37bdf02e9674 {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:43:27 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-5c07d6a8-9ee1-4927-b999-0cf09390e2ce tempest-TestServerVolumeAttachScenarioOldVersion-787688685 tempest-TestServerVolumeAttachScenarioOldVersion-787688685-project-member] Lock "5c914d94-5bfd-4984-8937-37bdf02e9674" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.837s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:43:27 user nova-compute[72382]: DEBUG nova.network.neutron [-] [instance: f49b5daf-d39d-496f-97d7-a0d9fd67d66d] Updating instance_info_cache with network_info: [] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:43:27 user nova-compute[72382]: INFO nova.compute.manager [-] [instance: f49b5daf-d39d-496f-97d7-a0d9fd67d66d] Took 0.51 seconds to deallocate network for instance.
Aug 09 15:43:27 user nova-compute[72382]: DEBUG nova.compute.manager [req-3b8819df-cae7-489c-8fc6-a836de75300b req-73d95b36-a258-413a-9a69-7c09c1986d23 service nova] [instance: f49b5daf-d39d-496f-97d7-a0d9fd67d66d] Received event network-vif-deleted-409cb778-13bd-425b-bb7b-90643706b023 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:43:28 user nova-compute[72382]: INFO nova.compute.manager [None req-cf36d157-3ccf-432b-af5f-20861e9f526e tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: f49b5daf-d39d-496f-97d7-a0d9fd67d66d] Took 0.72 seconds to detach 1 volumes for instance.
Aug 09 15:43:28 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-cf36d157-3ccf-432b-af5f-20861e9f526e tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:43:28 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-cf36d157-3ccf-432b-af5f-20861e9f526e tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:43:28 user nova-compute[72382]: DEBUG nova.compute.provider_tree [None req-cf36d157-3ccf-432b-af5f-20861e9f526e tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Inventory has not changed in ProviderTree for provider: 7b15b0e5-df4d-49db-833b-2855d21d10ae {{(pid=72382) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 15:43:28 user nova-compute[72382]: DEBUG nova.scheduler.client.report [None req-cf36d157-3ccf-432b-af5f-20861e9f526e tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Inventory has not changed for provider 7b15b0e5-df4d-49db-833b-2855d21d10ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72382) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 15:43:28 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-cf36d157-3ccf-432b-af5f-20861e9f526e tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.228s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:43:28 user nova-compute[72382]: INFO nova.scheduler.client.report [None req-cf36d157-3ccf-432b-af5f-20861e9f526e tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Deleted allocations for instance f49b5daf-d39d-496f-97d7-a0d9fd67d66d
Aug 09 15:43:28 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:43:28 user nova-compute[72382]: DEBUG nova.compute.manager [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Starting heal instance info cache {{(pid=72382) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 15:43:28 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-cf36d157-3ccf-432b-af5f-20861e9f526e tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Lock "f49b5daf-d39d-496f-97d7-a0d9fd67d66d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.296s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:43:28 user nova-compute[72382]: DEBUG nova.compute.manager [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Didn't find any instances for network info cache update. {{(pid=72382) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 09 15:43:30 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:43:30 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:43:31 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:43:31 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:43:32 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:43:36 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:43:41 user nova-compute[72382]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691595806.5842052, f49b5daf-d39d-496f-97d7-a0d9fd67d66d => Stopped> {{(pid=72382) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 15:43:41 user nova-compute[72382]: INFO nova.compute.manager [-] [instance: f49b5daf-d39d-496f-97d7-a0d9fd67d66d] VM Stopped (Lifecycle Event)
Aug 09 15:43:41 user nova-compute[72382]: DEBUG nova.compute.manager [None req-e6197bd4-b501-48f5-a018-f8636a773814 None None] [instance: f49b5daf-d39d-496f-97d7-a0d9fd67d66d] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:43:41 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:43:41 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:43:41 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72382) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 15:43:41 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72382) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 15:43:41 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72382) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 15:43:41 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:43:45 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:43:46 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:43:49 user nova-compute[72382]: DEBUG nova.compute.manager [req-c481936b-9334-4572-b341-1b45a8be6a16 req-3025bc37-cad6-4378-84c7-a4fadf754ae6 service nova] [instance: 4d27c5a4-9a88-423b-9c48-9224e8248f8c] Received event network-changed-b14bc813-7a4e-413c-9b5f-4c34080790b6 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:43:49 user nova-compute[72382]: DEBUG nova.compute.manager [req-c481936b-9334-4572-b341-1b45a8be6a16 req-3025bc37-cad6-4378-84c7-a4fadf754ae6 service nova] [instance: 4d27c5a4-9a88-423b-9c48-9224e8248f8c] Refreshing instance network info cache due to event network-changed-b14bc813-7a4e-413c-9b5f-4c34080790b6. {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 15:43:49 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-c481936b-9334-4572-b341-1b45a8be6a16 req-3025bc37-cad6-4378-84c7-a4fadf754ae6 service nova] Acquiring lock "refresh_cache-4d27c5a4-9a88-423b-9c48-9224e8248f8c" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 15:43:49 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-c481936b-9334-4572-b341-1b45a8be6a16 req-3025bc37-cad6-4378-84c7-a4fadf754ae6 service nova] Acquired lock "refresh_cache-4d27c5a4-9a88-423b-9c48-9224e8248f8c" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 15:43:49 user nova-compute[72382]: DEBUG nova.network.neutron [req-c481936b-9334-4572-b341-1b45a8be6a16 req-3025bc37-cad6-4378-84c7-a4fadf754ae6 service nova] [instance: 4d27c5a4-9a88-423b-9c48-9224e8248f8c] Refreshing network info cache for port b14bc813-7a4e-413c-9b5f-4c34080790b6 {{(pid=72382) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 15:43:50 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-957ed285-53b9-4f57-b7e7-7cc4b7dd678f tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] Acquiring lock "4d27c5a4-9a88-423b-9c48-9224e8248f8c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:43:50 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-957ed285-53b9-4f57-b7e7-7cc4b7dd678f tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] Lock "4d27c5a4-9a88-423b-9c48-9224e8248f8c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:43:50 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:43:50 user nova-compute[72382]: DEBUG nova.objects.instance [None req-957ed285-53b9-4f57-b7e7-7cc4b7dd678f tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] Lazy-loading 'flavor' on Instance uuid 4d27c5a4-9a88-423b-9c48-9224e8248f8c {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:43:50 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-957ed285-53b9-4f57-b7e7-7cc4b7dd678f tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] Lock "4d27c5a4-9a88-423b-9c48-9224e8248f8c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.066s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:43:50 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-957ed285-53b9-4f57-b7e7-7cc4b7dd678f tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] Acquiring lock "4d27c5a4-9a88-423b-9c48-9224e8248f8c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:43:50 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-957ed285-53b9-4f57-b7e7-7cc4b7dd678f tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] Lock "4d27c5a4-9a88-423b-9c48-9224e8248f8c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:43:50 user nova-compute[72382]: INFO nova.compute.manager [None req-957ed285-53b9-4f57-b7e7-7cc4b7dd678f tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] [instance: 4d27c5a4-9a88-423b-9c48-9224e8248f8c] Attaching volume 988ca541-8c8f-4738-bd46-a9169e063bfa to /dev/vdb
Aug 09 15:43:50 user nova-compute[72382]: DEBUG os_brick.utils [None req-957ed285-53b9-4f57-b7e7-7cc4b7dd678f tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 15:43:50 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:43:50 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:43:50 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb2f79c0-7f0f-4a63-803f-8a9fa09eb0ff]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d2cfa7015fe\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:43:50 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:43:50 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:43:50 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dfbe27a-36c3-47c8-a18c-e49d59f97457]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:43:50 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:43:50 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:43:50 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[00287871-24a6-4dfe-aedc-a06d1dc8e892]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:43:50 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[d837c249-461f-4a51-969a-25c842e800f0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:43:50 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-957ed285-53b9-4f57-b7e7-7cc4b7dd678f tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] Running cmd (subprocess): nvme version {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:43:50 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-957ed285-53b9-4f57-b7e7-7cc4b7dd678f tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] 'nvme version' failed. Not Retrying. {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 15:43:50 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.nvmeof [None req-957ed285-53b9-4f57-b7e7-7cc4b7dd678f tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] nvme not present on system {{(pid=72382) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 15:43:50 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:43:50 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 15:43:50 user nova-compute[72382]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 15:43:50 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2aa18c3-0b44-43cb-af92-71d5433caada]: (4, '') {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:43:50 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.lightos [None req-957ed285-53b9-4f57-b7e7-7cc4b7dd678f tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72382) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 15:43:50 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.lightos [None req-957ed285-53b9-4f57-b7e7-7cc4b7dd678f tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72382) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 15:43:50 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.lightos [None req-957ed285-53b9-4f57-b7e7-7cc4b7dd678f tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] LIGHTOS: no hostnqn found. {{(pid=72382) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 15:43:50 user nova-compute[72382]: DEBUG os_brick.utils [None req-957ed285-53b9-4f57-b7e7-7cc4b7dd678f tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d2cfa7015fe', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 15:43:50 user nova-compute[72382]: DEBUG nova.virt.block_device [None req-957ed285-53b9-4f57-b7e7-7cc4b7dd678f tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] [instance: 4d27c5a4-9a88-423b-9c48-9224e8248f8c] Updating existing volume attachment record: d07b4e4a-081f-4b74-ab86-6f33320bba77 {{(pid=72382) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 15:43:50 user nova-compute[72382]: DEBUG nova.network.neutron [req-c481936b-9334-4572-b341-1b45a8be6a16 req-3025bc37-cad6-4378-84c7-a4fadf754ae6 service nova] [instance: 4d27c5a4-9a88-423b-9c48-9224e8248f8c] Updated VIF entry in instance network info cache for port b14bc813-7a4e-413c-9b5f-4c34080790b6. {{(pid=72382) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 15:43:50 user nova-compute[72382]: DEBUG nova.network.neutron [req-c481936b-9334-4572-b341-1b45a8be6a16 req-3025bc37-cad6-4378-84c7-a4fadf754ae6 service nova] [instance: 4d27c5a4-9a88-423b-9c48-9224e8248f8c] Updating instance_info_cache with network_info: [{"id": "b14bc813-7a4e-413c-9b5f-4c34080790b6", "address": "fa:16:3e:a6:b1:fa", "network": {"id": "ca2010c6-c431-44c8-8742-22a4fcf15754", "bridge": "br-int", "label": "tempest-TestStampPattern-1529830938-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a826d26871fb474ba904e1550f9ee103", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb14bc813-7a", "ovs_interfaceid": "b14bc813-7a4e-413c-9b5f-4c34080790b6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:43:50 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-c481936b-9334-4572-b341-1b45a8be6a16 req-3025bc37-cad6-4378-84c7-a4fadf754ae6 service nova] Releasing lock "refresh_cache-4d27c5a4-9a88-423b-9c48-9224e8248f8c" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 15:43:51 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:43:53 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:43:55 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:43:56 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:43:58 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-957ed285-53b9-4f57-b7e7-7cc4b7dd678f tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] [instance: 4d27c5a4-9a88-423b-9c48-9224e8248f8c] Calling os-brick to attach iSCSI Volume {{(pid=72382) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 15:43:58 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-957ed285-53b9-4f57-b7e7-7cc4b7dd678f tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2a0c768340>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:988ca541-8c8f-4738-bd46-a9169e063bfa'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eCNRyMsc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 15:43:58 user nova-compute[72382]: WARNING os_brick.initiator.connectors.base [None req-957ed285-53b9-4f57-b7e7-7cc4b7dd678f tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 15:43:58 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-957ed285-53b9-4f57-b7e7-7cc4b7dd678f tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 15:43:58 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-957ed285-53b9-4f57-b7e7-7cc4b7dd678f tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 15:43:58 user nova-compute[72382]: WARNING os_brick.initiator.connectors.base [None req-957ed285-53b9-4f57-b7e7-7cc4b7dd678f tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 15:43:58 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-957ed285-53b9-4f57-b7e7-7cc4b7dd678f tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:988ca541-8c8f-4738-bd46-a9169e063bfa" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 15:43:58 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-957ed285-53b9-4f57-b7e7-7cc4b7dd678f tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:988ca541-8c8f-4738-bd46-a9169e063bfa" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 15:43:58 user nova-compute[72382]: INFO os_brick.initiator.connectors.iscsi [None req-957ed285-53b9-4f57-b7e7-7cc4b7dd678f tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 15:43:58 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:988ca541-8c8f-4738-bd46-a9169e063bfa -p 172.16.0.220:3260 {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:43:58 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:988ca541-8c8f-4738-bd46-a9169e063bfa -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:43:58 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[49f66166-9213-44d0-8a3f-2889d309321a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:43:58 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-957ed285-53b9-4f57-b7e7-7cc4b7dd678f tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 15:43:58 user nova-compute[72382]:  {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:43:58 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:988ca541-8c8f-4738-bd46-a9169e063bfa -p 172.16.0.220:3260 --interface default --op new {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:43:58 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:988ca541-8c8f-4738-bd46-a9169e063bfa -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:43:58 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[92626b1f-703e-4028-8d79-9afeb9da1c9d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:988ca541-8c8f-4738-bd46-a9169e063bfa] added\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:43:58 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-957ed285-53b9-4f57-b7e7-7cc4b7dd678f tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:988ca541-8c8f-4738-bd46-a9169e063bfa] added
Aug 09 15:43:58 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:43:58 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:988ca541-8c8f-4738-bd46-a9169e063bfa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:43:58 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:988ca541-8c8f-4738-bd46-a9169e063bfa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:43:58 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c10b4ee-6d74-48f5-af4f-45fbf03bc8b9]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:43:58 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-957ed285-53b9-4f57-b7e7-7cc4b7dd678f tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:43:58 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:988ca541-8c8f-4738-bd46-a9169e063bfa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:43:58 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:988ca541-8c8f-4738-bd46-a9169e063bfa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:43:58 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cf92fa8-45d7-4f14-a6b2-c83ff0dd72ba]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:43:58 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-957ed285-53b9-4f57-b7e7-7cc4b7dd678f tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:43:58 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:988ca541-8c8f-4738-bd46-a9169e063bfa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eCNRyMsc {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:43:58 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:988ca541-8c8f-4738-bd46-a9169e063bfa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eCNRyMsc" returned: 0 in 0.024s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:43:58 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[491358dc-5d17-4469-9558-f79d060ea7cc]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:43:58 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-957ed285-53b9-4f57-b7e7-7cc4b7dd678f tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'eCNRyMsc'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:43:58 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:988ca541-8c8f-4738-bd46-a9169e063bfa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:43:58 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:988ca541-8c8f-4738-bd46-a9169e063bfa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:43:58 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[f655a098-a852-41e3-8429-7c158c733bda]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:43:58 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-957ed285-53b9-4f57-b7e7-7cc4b7dd678f tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:43:58 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:43:58 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:43:58 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bdef3e3-4b93-4766-b4f9-41254c34c3e6]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f58579c-f69a-4bee-b16e-970e5a8f590c (non-flash)\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:43:58 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-957ed285-53b9-4f57-b7e7-7cc4b7dd678f tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f58579c-f69a-4bee-b16e-970e5a8f590c (non-flash)
Aug 09 15:43:58 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 15:43:58 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-957ed285-53b9-4f57-b7e7-7cc4b7dd678f tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f58579c-f69a-4bee-b16e-970e5a8f590c (non-flash)
Aug 09 15:43:58 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 15:43:58 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:988ca541-8c8f-4738-bd46-a9169e063bfa -p 172.16.0.220:3260 --login {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:43:58 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:988ca541-8c8f-4738-bd46-a9169e063bfa -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:43:58 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b12e23c-7152-49ba-af35-9afd8dfb483e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:988ca541-8c8f-4738-bd46-a9169e063bfa, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:988ca541-8c8f-4738-bd46-a9169e063bfa, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:43:58 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-957ed285-53b9-4f57-b7e7-7cc4b7dd678f tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:988ca541-8c8f-4738-bd46-a9169e063bfa, portal: 172.16.0.220,3260]
Aug 09 15:43:58 user nova-compute[72382]: Login to [iface: default, target: iqn.2010-10.org.openstack:988ca541-8c8f-4738-bd46-a9169e063bfa, portal: 172.16.0.220,3260] successful.
Aug 09 15:43:58 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:43:58 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:988ca541-8c8f-4738-bd46-a9169e063bfa -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:43:58 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:988ca541-8c8f-4738-bd46-a9169e063bfa -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:43:58 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[623e87f4-9af7-4162-b8c2-05d1747c39eb]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:43:58 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-957ed285-53b9-4f57-b7e7-7cc4b7dd678f tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:43:58 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:43:58 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:43:58 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[acc72a66-4313-4e87-a5a5-9590028249c6]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f58579c-f69a-4bee-b16e-970e5a8f590c (non-flash)\ntcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:988ca541-8c8f-4738-bd46-a9169e063bfa (non-flash)\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:43:58 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-957ed285-53b9-4f57-b7e7-7cc4b7dd678f tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f58579c-f69a-4bee-b16e-970e5a8f590c (non-flash)
Aug 09 15:43:58 user nova-compute[72382]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:988ca541-8c8f-4738-bd46-a9169e063bfa (non-flash)
Aug 09 15:43:58 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 15:43:58 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-957ed285-53b9-4f57-b7e7-7cc4b7dd678f tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f58579c-f69a-4bee-b16e-970e5a8f590c (non-flash)
Aug 09 15:43:58 user nova-compute[72382]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:988ca541-8c8f-4738-bd46-a9169e063bfa (non-flash)
Aug 09 15:43:58 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 15:43:58 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-957ed285-53b9-4f57-b7e7-7cc4b7dd678f tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:988ca541-8c8f-4738-bd46-a9169e063bfa" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.264s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 15:43:58 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-957ed285-53b9-4f57-b7e7-7cc4b7dd678f tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] Connected to 172.16.0.220:3260 {{(pid=72382) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 15:43:58 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-957ed285-53b9-4f57-b7e7-7cc4b7dd678f tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] HCTL ('34', '-', '-', 0) found on session 59 with lun 0 {{(pid=72382) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 15:43:58 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-957ed285-53b9-4f57-b7e7-7cc4b7dd678f tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72382) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 15:43:58 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:43:58 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:43:58 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[e84f7783-75c5-4347-ae7a-59843ec0c0c5]: (4, ('- - 0', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:43:58 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-957ed285-53b9-4f57-b7e7-7cc4b7dd678f tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] Searching for a device in session 59 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72382) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 15:43:58 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-957ed285-53b9-4f57-b7e7-7cc4b7dd678f tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eCNRyMsc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72382) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 15:43:59 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-957ed285-53b9-4f57-b7e7-7cc4b7dd678f tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.295s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 15:43:59 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-957ed285-53b9-4f57-b7e7-7cc4b7dd678f tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] <== connect_volume: return (1297ms) {'type': 'block', 'scsi_wwn': '23138613131363739', 'path': '/dev/sdc'} {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 15:43:59 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-957ed285-53b9-4f57-b7e7-7cc4b7dd678f tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] [instance: 4d27c5a4-9a88-423b-9c48-9224e8248f8c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23138613131363739', 'path': '/dev/sdc'} {{(pid=72382) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 15:43:59 user nova-compute[72382]: DEBUG nova.objects.instance [None req-957ed285-53b9-4f57-b7e7-7cc4b7dd678f tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] Lazy-loading 'flavor' on Instance uuid 4d27c5a4-9a88-423b-9c48-9224e8248f8c {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:43:59 user nova-compute[72382]: DEBUG nova.virt.libvirt.guest [None req-957ed285-53b9-4f57-b7e7-7cc4b7dd678f tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 15:43:59 user nova-compute[72382]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 15:43:59 user nova-compute[72382]:   <source dev="/dev/sdc"/>
Aug 09 15:43:59 user nova-compute[72382]:   <target dev="vdb" bus="virtio"/>
Aug 09 15:43:59 user nova-compute[72382]:   <serial>988ca541-8c8f-4738-bd46-a9169e063bfa</serial>
Aug 09 15:43:59 user nova-compute[72382]: </disk>
Aug 09 15:43:59 user nova-compute[72382]:  {{(pid=72382) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 15:44:00 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:44:00 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-957ed285-53b9-4f57-b7e7-7cc4b7dd678f tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] No BDM found with device name vda, not building metadata. {{(pid=72382) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 15:44:00 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-957ed285-53b9-4f57-b7e7-7cc4b7dd678f tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72382) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 15:44:00 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-957ed285-53b9-4f57-b7e7-7cc4b7dd678f tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] No VIF found with MAC fa:16:3e:a6:b1:fa, not building metadata {{(pid=72382) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 15:44:00 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-957ed285-53b9-4f57-b7e7-7cc4b7dd678f tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] Lock "4d27c5a4-9a88-423b-9c48-9224e8248f8c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.297s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:44:01 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-130883d9-c541-4991-9c95-a409e7740a07 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Acquiring lock "0c1b05ee-4fc3-44b9-b689-52d07841da4c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:44:01 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-130883d9-c541-4991-9c95-a409e7740a07 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Lock "0c1b05ee-4fc3-44b9-b689-52d07841da4c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:44:01 user nova-compute[72382]: DEBUG nova.objects.instance [None req-130883d9-c541-4991-9c95-a409e7740a07 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Lazy-loading 'flavor' on Instance uuid 0c1b05ee-4fc3-44b9-b689-52d07841da4c {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:44:01 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-130883d9-c541-4991-9c95-a409e7740a07 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Lock "0c1b05ee-4fc3-44b9-b689-52d07841da4c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:44:01 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-130883d9-c541-4991-9c95-a409e7740a07 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Acquiring lock "0c1b05ee-4fc3-44b9-b689-52d07841da4c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:44:01 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-130883d9-c541-4991-9c95-a409e7740a07 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Lock "0c1b05ee-4fc3-44b9-b689-52d07841da4c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:44:01 user nova-compute[72382]: INFO nova.compute.manager [None req-130883d9-c541-4991-9c95-a409e7740a07 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] [instance: 0c1b05ee-4fc3-44b9-b689-52d07841da4c] Attaching volume 9503780b-a02c-404a-986e-922be3e3f527 to /dev/vdb
Aug 09 15:44:01 user nova-compute[72382]: DEBUG os_brick.utils [None req-130883d9-c541-4991-9c95-a409e7740a07 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 15:44:01 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:44:01 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:44:01 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e1507ad-2397-4887-bbff-44df3f79cf09]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d2cfa7015fe\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:44:01 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:44:01 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:44:01 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:44:01 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[dca28e7c-86cc-432f-b6c5-ff5fc98ce759]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:44:01 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:44:01 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:44:01 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cbb03b7-fd3c-4d94-a688-97c3a42ea459]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:44:01 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[60964f9e-f7de-4e47-b7bc-2daa4d2ab103]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:44:01 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-130883d9-c541-4991-9c95-a409e7740a07 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Running cmd (subprocess): nvme version {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:44:01 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-130883d9-c541-4991-9c95-a409e7740a07 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] 'nvme version' failed. Not Retrying. {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 15:44:01 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.nvmeof [None req-130883d9-c541-4991-9c95-a409e7740a07 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] nvme not present on system {{(pid=72382) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 15:44:01 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:44:01 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 15:44:01 user nova-compute[72382]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 15:44:01 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceaf04e9-a0f8-4fd9-8ae1-bc779814e95f]: (4, '') {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:44:01 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.lightos [None req-130883d9-c541-4991-9c95-a409e7740a07 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72382) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 15:44:01 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.lightos [None req-130883d9-c541-4991-9c95-a409e7740a07 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72382) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 15:44:01 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.lightos [None req-130883d9-c541-4991-9c95-a409e7740a07 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] LIGHTOS: no hostnqn found. {{(pid=72382) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 15:44:01 user nova-compute[72382]: DEBUG os_brick.utils [None req-130883d9-c541-4991-9c95-a409e7740a07 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d2cfa7015fe', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 15:44:01 user nova-compute[72382]: DEBUG nova.virt.block_device [None req-130883d9-c541-4991-9c95-a409e7740a07 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] [instance: 0c1b05ee-4fc3-44b9-b689-52d07841da4c] Updating existing volume attachment record: fefcc8f1-471d-453b-9a92-e5da1b28f91f {{(pid=72382) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 15:44:02 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-a3af9750-bb7a-4fe7-b607-9e340a55e8a9 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] Acquiring lock "4d27c5a4-9a88-423b-9c48-9224e8248f8c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:44:02 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-a3af9750-bb7a-4fe7-b607-9e340a55e8a9 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] Lock "4d27c5a4-9a88-423b-9c48-9224e8248f8c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:44:02 user nova-compute[72382]: INFO nova.compute.manager [None req-a3af9750-bb7a-4fe7-b607-9e340a55e8a9 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] [instance: 4d27c5a4-9a88-423b-9c48-9224e8248f8c] Detaching volume 988ca541-8c8f-4738-bd46-a9169e063bfa
Aug 09 15:44:02 user nova-compute[72382]: INFO nova.virt.block_device [None req-a3af9750-bb7a-4fe7-b607-9e340a55e8a9 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] [instance: 4d27c5a4-9a88-423b-9c48-9224e8248f8c] Attempting to driver detach volume 988ca541-8c8f-4738-bd46-a9169e063bfa from mountpoint /dev/vdb
Aug 09 15:44:02 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-a3af9750-bb7a-4fe7-b607-9e340a55e8a9 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] Attempting to detach device vdb from instance 4d27c5a4-9a88-423b-9c48-9224e8248f8c from the persistent domain config. {{(pid=72382) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 15:44:02 user nova-compute[72382]: DEBUG nova.virt.libvirt.guest [None req-a3af9750-bb7a-4fe7-b607-9e340a55e8a9 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 15:44:02 user nova-compute[72382]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 15:44:02 user nova-compute[72382]:   <source dev="/dev/sdc"/>
Aug 09 15:44:02 user nova-compute[72382]:   <target dev="vdb" bus="virtio"/>
Aug 09 15:44:02 user nova-compute[72382]:   <serial>988ca541-8c8f-4738-bd46-a9169e063bfa</serial>
Aug 09 15:44:02 user nova-compute[72382]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 15:44:02 user nova-compute[72382]: </disk>
Aug 09 15:44:02 user nova-compute[72382]:  {{(pid=72382) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 15:44:02 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-a3af9750-bb7a-4fe7-b607-9e340a55e8a9 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] Successfully detached device vdb from instance 4d27c5a4-9a88-423b-9c48-9224e8248f8c from the persistent domain config.
Aug 09 15:44:02 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-a3af9750-bb7a-4fe7-b607-9e340a55e8a9 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 4d27c5a4-9a88-423b-9c48-9224e8248f8c from the live domain config. {{(pid=72382) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 15:44:02 user nova-compute[72382]: DEBUG nova.virt.libvirt.guest [None req-a3af9750-bb7a-4fe7-b607-9e340a55e8a9 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 15:44:02 user nova-compute[72382]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 15:44:02 user nova-compute[72382]:   <source dev="/dev/sdc"/>
Aug 09 15:44:02 user nova-compute[72382]:   <target dev="vdb" bus="virtio"/>
Aug 09 15:44:02 user nova-compute[72382]:   <serial>988ca541-8c8f-4738-bd46-a9169e063bfa</serial>
Aug 09 15:44:02 user nova-compute[72382]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 15:44:02 user nova-compute[72382]: </disk>
Aug 09 15:44:02 user nova-compute[72382]:  {{(pid=72382) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 15:44:03 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Received event <DeviceRemovedEvent: 1691595843.3578188, 4d27c5a4-9a88-423b-9c48-9224e8248f8c => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72382) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 15:44:03 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-a3af9750-bb7a-4fe7-b607-9e340a55e8a9 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 4d27c5a4-9a88-423b-9c48-9224e8248f8c {{(pid=72382) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 15:44:03 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-a3af9750-bb7a-4fe7-b607-9e340a55e8a9 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] Successfully detached device vdb from instance 4d27c5a4-9a88-423b-9c48-9224e8248f8c from the live domain config.
Aug 09 15:44:03 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a3af9750-bb7a-4fe7-b607-9e340a55e8a9 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] [instance: 4d27c5a4-9a88-423b-9c48-9224e8248f8c] calling os-brick to detach iSCSI Volume {{(pid=72382) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 15:44:03 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3af9750-bb7a-4fe7-b607-9e340a55e8a9 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2a0c768340>, {'target_iqns': ['iqn.2010-10.org.openstack:988ca541-8c8f-4738-bd46-a9169e063bfa'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eCNRyMsc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 15:44:03 user nova-compute[72382]: WARNING os_brick.initiator.connectors.base [None req-a3af9750-bb7a-4fe7-b607-9e340a55e8a9 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 15:44:03 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-a3af9750-bb7a-4fe7-b607-9e340a55e8a9 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 15:44:03 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-a3af9750-bb7a-4fe7-b607-9e340a55e8a9 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 15:44:03 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3af9750-bb7a-4fe7-b607-9e340a55e8a9 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:988ca541-8c8f-4738-bd46-a9169e063bfa', 0)] {{(pid=72382) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 15:44:03 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:44:03 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:44:03 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[deea6706-dea8-42e9-817f-c989afc76bfb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3f58579c-f69a-4bee-b16e-970e5a8f590c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:988ca541-8c8f-4738-bd46-a9169e063bfa\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:44:03 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:44:03 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:44:03 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[673d8fb9-b52c-47bd-8408-a8142b35ebef]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f58579c-f69a-4bee-b16e-970e5a8f590c (non-flash)\ntcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:988ca541-8c8f-4738-bd46-a9169e063bfa (non-flash)\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:44:03 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3af9750-bb7a-4fe7-b607-9e340a55e8a9 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f58579c-f69a-4bee-b16e-970e5a8f590c (non-flash)
Aug 09 15:44:03 user nova-compute[72382]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:988ca541-8c8f-4738-bd46-a9169e063bfa (non-flash)
Aug 09 15:44:03 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 15:44:03 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3af9750-bb7a-4fe7-b607-9e340a55e8a9 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f58579c-f69a-4bee-b16e-970e5a8f590c (non-flash)
Aug 09 15:44:03 user nova-compute[72382]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:988ca541-8c8f-4738-bd46-a9169e063bfa (non-flash)
Aug 09 15:44:03 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 15:44:03 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3af9750-bb7a-4fe7-b607-9e340a55e8a9 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2a241ecf70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:988ca541-8c8f-4738-bd46-a9169e063bfa'): ({'sdc'}, set())}) {{(pid=72382) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 15:44:03 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-a3af9750-bb7a-4fe7-b607-9e340a55e8a9 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] Removing single pathed devices sdc {{(pid=72382) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 15:44:03 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:44:03 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:44:03 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9ea3a3b-a919-430d-a906-a158b3e3ab50]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:44:03 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:44:03 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:44:03 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[0addd70c-d697-42bf-8add-642a1de1679c]: (4, ('ok\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:44:03 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-a3af9750-bb7a-4fe7-b607-9e340a55e8a9 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] Flushing IO for device /dev/sdc {{(pid=72382) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 15:44:03 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:44:03 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:44:03 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9abb63a-060b-4e8c-8853-519348d1c331]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:44:03 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-a3af9750-bb7a-4fe7-b607-9e340a55e8a9 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72382) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 15:44:03 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:44:03 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.041s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:44:03 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1b619b3-9b0b-4747-aec6-45604420d353]: (4, ('1', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:44:03 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-a3af9750-bb7a-4fe7-b607-9e340a55e8a9 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72382) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 15:44:03 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-a3af9750-bb7a-4fe7-b607-9e340a55e8a9 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] SCSI volumes sdc have been removed. {{(pid=72382) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 15:44:03 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3af9750-bb7a-4fe7-b607-9e340a55e8a9 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:988ca541-8c8f-4738-bd46-a9169e063bfa')] {{(pid=72382) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 15:44:03 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:988ca541-8c8f-4738-bd46-a9169e063bfa -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:44:03 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:988ca541-8c8f-4738-bd46-a9169e063bfa -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:44:03 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[e54025b4-f170-4f4f-b20f-886712bcb986]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:44:03 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3af9750-bb7a-4fe7-b607-9e340a55e8a9 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:44:03 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:988ca541-8c8f-4738-bd46-a9169e063bfa -p 172.16.0.220:3260 --logout {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:44:03 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:988ca541-8c8f-4738-bd46-a9169e063bfa -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:44:03 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[5af64e5f-f619-4770-a42a-e0d3757f8773]: (4, ('Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:988ca541-8c8f-4738-bd46-a9169e063bfa, portal: 172.16.0.220,3260]\nLogout of [sid: 59, target: iqn.2010-10.org.openstack:988ca541-8c8f-4738-bd46-a9169e063bfa, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:44:03 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3af9750-bb7a-4fe7-b607-9e340a55e8a9 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:988ca541-8c8f-4738-bd46-a9169e063bfa, portal: 172.16.0.220,3260]
Aug 09 15:44:03 user nova-compute[72382]: Logout of [sid: 59, target: iqn.2010-10.org.openstack:988ca541-8c8f-4738-bd46-a9169e063bfa, portal: 172.16.0.220,3260] successful.
Aug 09 15:44:03 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:44:03 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:988ca541-8c8f-4738-bd46-a9169e063bfa -p 172.16.0.220:3260 --op delete {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:44:03 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:988ca541-8c8f-4738-bd46-a9169e063bfa -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:44:03 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bd7ea00-5ebf-4aba-89b0-75e33c59609a]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:44:03 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3af9750-bb7a-4fe7-b607-9e340a55e8a9 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:44:03 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-a3af9750-bb7a-4fe7-b607-9e340a55e8a9 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.277s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 15:44:03 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3af9750-bb7a-4fe7-b607-9e340a55e8a9 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] <== disconnect_volume: return (278ms) None {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 15:44:03 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a3af9750-bb7a-4fe7-b607-9e340a55e8a9 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] [instance: 4d27c5a4-9a88-423b-9c48-9224e8248f8c] Disconnected iSCSI Volume {{(pid=72382) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 15:44:04 user nova-compute[72382]: DEBUG nova.objects.instance [None req-a3af9750-bb7a-4fe7-b607-9e340a55e8a9 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] Lazy-loading 'flavor' on Instance uuid 4d27c5a4-9a88-423b-9c48-9224e8248f8c {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:44:04 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-a3af9750-bb7a-4fe7-b607-9e340a55e8a9 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] Lock "4d27c5a4-9a88-423b-9c48-9224e8248f8c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.575s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:44:05 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:44:06 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:44:09 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-130883d9-c541-4991-9c95-a409e7740a07 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] [instance: 0c1b05ee-4fc3-44b9-b689-52d07841da4c] Calling os-brick to attach iSCSI Volume {{(pid=72382) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 15:44:09 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-130883d9-c541-4991-9c95-a409e7740a07 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2a0c768340>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:9503780b-a02c-404a-986e-922be3e3f527'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'voMhRUZV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 15:44:09 user nova-compute[72382]: WARNING os_brick.initiator.connectors.base [None req-130883d9-c541-4991-9c95-a409e7740a07 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 15:44:09 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-130883d9-c541-4991-9c95-a409e7740a07 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 15:44:09 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-130883d9-c541-4991-9c95-a409e7740a07 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 15:44:09 user nova-compute[72382]: WARNING os_brick.initiator.connectors.base [None req-130883d9-c541-4991-9c95-a409e7740a07 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 15:44:09 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-130883d9-c541-4991-9c95-a409e7740a07 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9503780b-a02c-404a-986e-922be3e3f527" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 15:44:09 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-130883d9-c541-4991-9c95-a409e7740a07 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9503780b-a02c-404a-986e-922be3e3f527" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 15:44:09 user nova-compute[72382]: INFO os_brick.initiator.connectors.iscsi [None req-130883d9-c541-4991-9c95-a409e7740a07 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 15:44:09 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9503780b-a02c-404a-986e-922be3e3f527 -p 172.16.0.220:3260 {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:44:09 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9503780b-a02c-404a-986e-922be3e3f527 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:44:09 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[942fd1c9-6211-4808-9011-de355a3be6ce]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:44:09 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-130883d9-c541-4991-9c95-a409e7740a07 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 15:44:09 user nova-compute[72382]:  {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:44:09 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9503780b-a02c-404a-986e-922be3e3f527 -p 172.16.0.220:3260 --interface default --op new {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:44:09 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9503780b-a02c-404a-986e-922be3e3f527 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:44:09 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8d3b784-569e-4ec3-b83f-ac19ea410e26]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9503780b-a02c-404a-986e-922be3e3f527] added\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:44:09 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-130883d9-c541-4991-9c95-a409e7740a07 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9503780b-a02c-404a-986e-922be3e3f527] added
Aug 09 15:44:09 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:44:09 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9503780b-a02c-404a-986e-922be3e3f527 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:44:09 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9503780b-a02c-404a-986e-922be3e3f527 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.016s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:44:09 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[9238410f-cd9f-47dc-8896-c4cc5d0f3af7]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:44:09 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-130883d9-c541-4991-9c95-a409e7740a07 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:44:09 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9503780b-a02c-404a-986e-922be3e3f527 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:44:09 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9503780b-a02c-404a-986e-922be3e3f527 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:44:09 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[90cffd75-2aeb-4565-a0b0-8ddba5095b77]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:44:09 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-130883d9-c541-4991-9c95-a409e7740a07 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:44:09 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9503780b-a02c-404a-986e-922be3e3f527 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v voMhRUZV {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:44:09 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9503780b-a02c-404a-986e-922be3e3f527 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v voMhRUZV" returned: 0 in 0.020s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:44:09 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cc5d48b-f53a-4179-9f0f-ca11d7db8137]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:44:09 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-130883d9-c541-4991-9c95-a409e7740a07 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'voMhRUZV'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:44:09 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9503780b-a02c-404a-986e-922be3e3f527 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:44:09 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9503780b-a02c-404a-986e-922be3e3f527 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:44:09 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b91a8ce-e732-42a1-bd49-afa4a2f53932]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:44:09 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-130883d9-c541-4991-9c95-a409e7740a07 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:44:09 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:44:09 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:44:09 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[db8631f9-4954-48e6-b403-75a24ec0af14]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f58579c-f69a-4bee-b16e-970e5a8f590c (non-flash)\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:44:09 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-130883d9-c541-4991-9c95-a409e7740a07 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f58579c-f69a-4bee-b16e-970e5a8f590c (non-flash)
Aug 09 15:44:09 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 15:44:09 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-130883d9-c541-4991-9c95-a409e7740a07 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f58579c-f69a-4bee-b16e-970e5a8f590c (non-flash)
Aug 09 15:44:09 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 15:44:09 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9503780b-a02c-404a-986e-922be3e3f527 -p 172.16.0.220:3260 --login {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:44:09 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9503780b-a02c-404a-986e-922be3e3f527 -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:44:09 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[795ae640-ecf2-4743-831b-edfc45c49a94]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9503780b-a02c-404a-986e-922be3e3f527, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9503780b-a02c-404a-986e-922be3e3f527, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:44:09 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-130883d9-c541-4991-9c95-a409e7740a07 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9503780b-a02c-404a-986e-922be3e3f527, portal: 172.16.0.220,3260]
Aug 09 15:44:09 user nova-compute[72382]: Login to [iface: default, target: iqn.2010-10.org.openstack:9503780b-a02c-404a-986e-922be3e3f527, portal: 172.16.0.220,3260] successful.
Aug 09 15:44:09 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:44:09 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9503780b-a02c-404a-986e-922be3e3f527 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:44:09 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9503780b-a02c-404a-986e-922be3e3f527 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.030s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:44:09 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[a40da97f-ec05-4453-ab89-96c0b4241f42]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:44:09 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-130883d9-c541-4991-9c95-a409e7740a07 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:44:09 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:44:09 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:44:09 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[07122d00-eb67-4c13-b3ce-3351fce4d441]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f58579c-f69a-4bee-b16e-970e5a8f590c (non-flash)\ntcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9503780b-a02c-404a-986e-922be3e3f527 (non-flash)\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:44:09 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-130883d9-c541-4991-9c95-a409e7740a07 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f58579c-f69a-4bee-b16e-970e5a8f590c (non-flash)
Aug 09 15:44:09 user nova-compute[72382]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9503780b-a02c-404a-986e-922be3e3f527 (non-flash)
Aug 09 15:44:09 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 15:44:09 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-130883d9-c541-4991-9c95-a409e7740a07 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f58579c-f69a-4bee-b16e-970e5a8f590c (non-flash)
Aug 09 15:44:09 user nova-compute[72382]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9503780b-a02c-404a-986e-922be3e3f527 (non-flash)
Aug 09 15:44:09 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 15:44:10 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-130883d9-c541-4991-9c95-a409e7740a07 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9503780b-a02c-404a-986e-922be3e3f527" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.268s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 15:44:10 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-130883d9-c541-4991-9c95-a409e7740a07 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Connected to 172.16.0.220:3260 {{(pid=72382) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 15:44:10 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-130883d9-c541-4991-9c95-a409e7740a07 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] HCTL ('34', '-', '-', 0) found on session 60 with lun 0 {{(pid=72382) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 15:44:10 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-130883d9-c541-4991-9c95-a409e7740a07 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72382) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 15:44:10 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:44:10 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:44:10 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[07e9843c-16b3-4b9a-a46a-057d8bd27be2]: (4, ('- - 0', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:44:10 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-130883d9-c541-4991-9c95-a409e7740a07 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Searching for a device in session 60 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72382) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 15:44:10 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-130883d9-c541-4991-9c95-a409e7740a07 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'voMhRUZV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72382) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 15:44:11 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-130883d9-c541-4991-9c95-a409e7740a07 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.300s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 15:44:11 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-130883d9-c541-4991-9c95-a409e7740a07 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] <== connect_volume: return (1300ms) {'type': 'block', 'scsi_wwn': '23961613731346538', 'path': '/dev/sdc'} {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 15:44:11 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-130883d9-c541-4991-9c95-a409e7740a07 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] [instance: 0c1b05ee-4fc3-44b9-b689-52d07841da4c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23961613731346538', 'path': '/dev/sdc'} {{(pid=72382) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 15:44:11 user nova-compute[72382]: DEBUG nova.objects.instance [None req-130883d9-c541-4991-9c95-a409e7740a07 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Lazy-loading 'flavor' on Instance uuid 0c1b05ee-4fc3-44b9-b689-52d07841da4c {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:44:11 user nova-compute[72382]: DEBUG nova.virt.libvirt.guest [None req-130883d9-c541-4991-9c95-a409e7740a07 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 15:44:11 user nova-compute[72382]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 15:44:11 user nova-compute[72382]:   <source dev="/dev/sdc"/>
Aug 09 15:44:11 user nova-compute[72382]:   <target dev="vdb" bus="virtio"/>
Aug 09 15:44:11 user nova-compute[72382]:   <serial>9503780b-a02c-404a-986e-922be3e3f527</serial>
Aug 09 15:44:11 user nova-compute[72382]: </disk>
Aug 09 15:44:11 user nova-compute[72382]:  {{(pid=72382) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 15:44:11 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-130883d9-c541-4991-9c95-a409e7740a07 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] No BDM found with device name vda, not building metadata. {{(pid=72382) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 15:44:11 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-130883d9-c541-4991-9c95-a409e7740a07 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72382) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 15:44:11 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-130883d9-c541-4991-9c95-a409e7740a07 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] No VIF found with MAC fa:16:3e:d4:06:6f, not building metadata {{(pid=72382) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 15:44:11 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-130883d9-c541-4991-9c95-a409e7740a07 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Lock "0c1b05ee-4fc3-44b9-b689-52d07841da4c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.077s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:44:11 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:44:13 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:44:14 user nova-compute[72382]: DEBUG nova.compute.manager [req-35910054-bbcd-42a7-a493-54dd5bfa98a5 req-8fb422a0-a42f-4e4d-8cff-c08e21ad3a1a service nova] [instance: 0c1b05ee-4fc3-44b9-b689-52d07841da4c] Received event network-changed-b339298b-9a14-4a36-a53e-7d1e6a2d85ff {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:44:14 user nova-compute[72382]: DEBUG nova.compute.manager [req-35910054-bbcd-42a7-a493-54dd5bfa98a5 req-8fb422a0-a42f-4e4d-8cff-c08e21ad3a1a service nova] [instance: 0c1b05ee-4fc3-44b9-b689-52d07841da4c] Refreshing instance network info cache due to event network-changed-b339298b-9a14-4a36-a53e-7d1e6a2d85ff. {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 15:44:14 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-35910054-bbcd-42a7-a493-54dd5bfa98a5 req-8fb422a0-a42f-4e4d-8cff-c08e21ad3a1a service nova] Acquiring lock "refresh_cache-0c1b05ee-4fc3-44b9-b689-52d07841da4c" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 15:44:14 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-35910054-bbcd-42a7-a493-54dd5bfa98a5 req-8fb422a0-a42f-4e4d-8cff-c08e21ad3a1a service nova] Acquired lock "refresh_cache-0c1b05ee-4fc3-44b9-b689-52d07841da4c" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 15:44:14 user nova-compute[72382]: DEBUG nova.network.neutron [req-35910054-bbcd-42a7-a493-54dd5bfa98a5 req-8fb422a0-a42f-4e4d-8cff-c08e21ad3a1a service nova] [instance: 0c1b05ee-4fc3-44b9-b689-52d07841da4c] Refreshing network info cache for port b339298b-9a14-4a36-a53e-7d1e6a2d85ff {{(pid=72382) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 15:44:14 user nova-compute[72382]: DEBUG nova.network.neutron [req-35910054-bbcd-42a7-a493-54dd5bfa98a5 req-8fb422a0-a42f-4e4d-8cff-c08e21ad3a1a service nova] [instance: 0c1b05ee-4fc3-44b9-b689-52d07841da4c] Updated VIF entry in instance network info cache for port b339298b-9a14-4a36-a53e-7d1e6a2d85ff. {{(pid=72382) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 15:44:14 user nova-compute[72382]: DEBUG nova.network.neutron [req-35910054-bbcd-42a7-a493-54dd5bfa98a5 req-8fb422a0-a42f-4e4d-8cff-c08e21ad3a1a service nova] [instance: 0c1b05ee-4fc3-44b9-b689-52d07841da4c] Updating instance_info_cache with network_info: [{"id": "b339298b-9a14-4a36-a53e-7d1e6a2d85ff", "address": "fa:16:3e:d4:06:6f", "network": {"id": "8d929426-09f7-49b5-a79e-711e20e00750", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1307802727-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93c87775443b4abd987197c4b46693bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb339298b-9a", "ovs_interfaceid": "b339298b-9a14-4a36-a53e-7d1e6a2d85ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:44:14 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-35910054-bbcd-42a7-a493-54dd5bfa98a5 req-8fb422a0-a42f-4e4d-8cff-c08e21ad3a1a service nova] Releasing lock "refresh_cache-0c1b05ee-4fc3-44b9-b689-52d07841da4c" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 15:44:15 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-54faf7a2-b6a5-41af-b86e-9f4d1e19cb54 tempest-VolumesNegativeTest-369748005 tempest-VolumesNegativeTest-369748005-project-member] Acquiring lock "6cfe9b0a-4ee9-4b4e-a8ac-d492937113ae" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:44:15 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-54faf7a2-b6a5-41af-b86e-9f4d1e19cb54 tempest-VolumesNegativeTest-369748005 tempest-VolumesNegativeTest-369748005-project-member] Lock "6cfe9b0a-4ee9-4b4e-a8ac-d492937113ae" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:44:15 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-54faf7a2-b6a5-41af-b86e-9f4d1e19cb54 tempest-VolumesNegativeTest-369748005 tempest-VolumesNegativeTest-369748005-project-member] Acquiring lock "6cfe9b0a-4ee9-4b4e-a8ac-d492937113ae-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:44:15 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-54faf7a2-b6a5-41af-b86e-9f4d1e19cb54 tempest-VolumesNegativeTest-369748005 tempest-VolumesNegativeTest-369748005-project-member] Lock "6cfe9b0a-4ee9-4b4e-a8ac-d492937113ae-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:44:15 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-54faf7a2-b6a5-41af-b86e-9f4d1e19cb54 tempest-VolumesNegativeTest-369748005 tempest-VolumesNegativeTest-369748005-project-member] Lock "6cfe9b0a-4ee9-4b4e-a8ac-d492937113ae-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:44:15 user nova-compute[72382]: INFO nova.compute.manager [None req-54faf7a2-b6a5-41af-b86e-9f4d1e19cb54 tempest-VolumesNegativeTest-369748005 tempest-VolumesNegativeTest-369748005-project-member] [instance: 6cfe9b0a-4ee9-4b4e-a8ac-d492937113ae] Terminating instance
Aug 09 15:44:15 user nova-compute[72382]: DEBUG nova.compute.manager [None req-54faf7a2-b6a5-41af-b86e-9f4d1e19cb54 tempest-VolumesNegativeTest-369748005 tempest-VolumesNegativeTest-369748005-project-member] [instance: 6cfe9b0a-4ee9-4b4e-a8ac-d492937113ae] Start destroying the instance on the hypervisor. {{(pid=72382) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 15:44:15 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:44:15 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:44:15 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:44:16 user nova-compute[72382]: INFO nova.virt.libvirt.driver [-] [instance: 6cfe9b0a-4ee9-4b4e-a8ac-d492937113ae] Instance destroyed successfully.
Aug 09 15:44:16 user nova-compute[72382]: DEBUG nova.objects.instance [None req-54faf7a2-b6a5-41af-b86e-9f4d1e19cb54 tempest-VolumesNegativeTest-369748005 tempest-VolumesNegativeTest-369748005-project-member] Lazy-loading 'resources' on Instance uuid 6cfe9b0a-4ee9-4b4e-a8ac-d492937113ae {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:44:16 user nova-compute[72382]: DEBUG nova.virt.libvirt.vif [None req-54faf7a2-b6a5-41af-b86e-9f4d1e19cb54 tempest-VolumesNegativeTest-369748005 tempest-VolumesNegativeTest-369748005-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T15:42:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1847595310',display_name='tempest-VolumesNegativeTest-instance-1847595310',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1847595310',id=50,image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-09T15:42:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c352a05f6bf84d689287ff9df7b2c2e2',ramdisk_id='',reservation_id='r-k7a1zwnv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-369748005',owner_user_name='tempest-VolumesNegativeTest-369748005-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T15:42:33Z,user_data=None,user_id='594ec45a7fb54111a8f8c58629857d1e',uuid=6cfe9b0a-4ee9-4b4e-a8ac-d492937113ae,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "833ca878-3d8d-441d-9b9e-7810c1c8c837", "address": "fa:16:3e:5a:ee:7a", "network": {"id": "ee1c2221-0f61-44cb-9ecf-b55dc8b55c94", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.204", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "a638990e12cc4d6eabb6d55e13be6bdf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap833ca878-3d", "ovs_interfaceid": "833ca878-3d8d-441d-9b9e-7810c1c8c837", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 15:44:16 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-54faf7a2-b6a5-41af-b86e-9f4d1e19cb54 tempest-VolumesNegativeTest-369748005 tempest-VolumesNegativeTest-369748005-project-member] Converting VIF {"id": "833ca878-3d8d-441d-9b9e-7810c1c8c837", "address": "fa:16:3e:5a:ee:7a", "network": {"id": "ee1c2221-0f61-44cb-9ecf-b55dc8b55c94", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.204", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "a638990e12cc4d6eabb6d55e13be6bdf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap833ca878-3d", "ovs_interfaceid": "833ca878-3d8d-441d-9b9e-7810c1c8c837", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 15:44:16 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-54faf7a2-b6a5-41af-b86e-9f4d1e19cb54 tempest-VolumesNegativeTest-369748005 tempest-VolumesNegativeTest-369748005-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5a:ee:7a,bridge_name='br-int',has_traffic_filtering=True,id=833ca878-3d8d-441d-9b9e-7810c1c8c837,network=Network(ee1c2221-0f61-44cb-9ecf-b55dc8b55c94),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap833ca878-3d') {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 15:44:16 user nova-compute[72382]: DEBUG os_vif [None req-54faf7a2-b6a5-41af-b86e-9f4d1e19cb54 tempest-VolumesNegativeTest-369748005 tempest-VolumesNegativeTest-369748005-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:ee:7a,bridge_name='br-int',has_traffic_filtering=True,id=833ca878-3d8d-441d-9b9e-7810c1c8c837,network=Network(ee1c2221-0f61-44cb-9ecf-b55dc8b55c94),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap833ca878-3d') {{(pid=72382) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 15:44:16 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:44:16 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap833ca878-3d, bridge=br-int, if_exists=True) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:44:16 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:44:16 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:44:16 user nova-compute[72382]: INFO os_vif [None req-54faf7a2-b6a5-41af-b86e-9f4d1e19cb54 tempest-VolumesNegativeTest-369748005 tempest-VolumesNegativeTest-369748005-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:ee:7a,bridge_name='br-int',has_traffic_filtering=True,id=833ca878-3d8d-441d-9b9e-7810c1c8c837,network=Network(ee1c2221-0f61-44cb-9ecf-b55dc8b55c94),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap833ca878-3d')
Aug 09 15:44:16 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-54faf7a2-b6a5-41af-b86e-9f4d1e19cb54 tempest-VolumesNegativeTest-369748005 tempest-VolumesNegativeTest-369748005-project-member] [instance: 6cfe9b0a-4ee9-4b4e-a8ac-d492937113ae] Deleting instance files /opt/stack/data/nova/instances/6cfe9b0a-4ee9-4b4e-a8ac-d492937113ae_del
Aug 09 15:44:16 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-54faf7a2-b6a5-41af-b86e-9f4d1e19cb54 tempest-VolumesNegativeTest-369748005 tempest-VolumesNegativeTest-369748005-project-member] [instance: 6cfe9b0a-4ee9-4b4e-a8ac-d492937113ae] Deletion of /opt/stack/data/nova/instances/6cfe9b0a-4ee9-4b4e-a8ac-d492937113ae_del complete
Aug 09 15:44:16 user nova-compute[72382]: INFO nova.compute.manager [None req-54faf7a2-b6a5-41af-b86e-9f4d1e19cb54 tempest-VolumesNegativeTest-369748005 tempest-VolumesNegativeTest-369748005-project-member] [instance: 6cfe9b0a-4ee9-4b4e-a8ac-d492937113ae] Took 0.89 seconds to destroy the instance on the hypervisor.
Aug 09 15:44:16 user nova-compute[72382]: DEBUG oslo.service.loopingcall [None req-54faf7a2-b6a5-41af-b86e-9f4d1e19cb54 tempest-VolumesNegativeTest-369748005 tempest-VolumesNegativeTest-369748005-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72382) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 15:44:16 user nova-compute[72382]: DEBUG nova.compute.manager [-] [instance: 6cfe9b0a-4ee9-4b4e-a8ac-d492937113ae] Deallocating network for instance {{(pid=72382) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 15:44:16 user nova-compute[72382]: DEBUG nova.network.neutron [-] [instance: 6cfe9b0a-4ee9-4b4e-a8ac-d492937113ae] deallocate_for_instance() {{(pid=72382) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 15:44:16 user nova-compute[72382]: DEBUG nova.compute.manager [req-bb322750-e33f-4d41-8cdd-c61b3e284308 req-b076d88d-3243-4f52-b4ee-495cb4c1432a service nova] [instance: 6cfe9b0a-4ee9-4b4e-a8ac-d492937113ae] Received event network-vif-unplugged-833ca878-3d8d-441d-9b9e-7810c1c8c837 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:44:16 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-bb322750-e33f-4d41-8cdd-c61b3e284308 req-b076d88d-3243-4f52-b4ee-495cb4c1432a service nova] Acquiring lock "6cfe9b0a-4ee9-4b4e-a8ac-d492937113ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:44:16 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-bb322750-e33f-4d41-8cdd-c61b3e284308 req-b076d88d-3243-4f52-b4ee-495cb4c1432a service nova] Lock "6cfe9b0a-4ee9-4b4e-a8ac-d492937113ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:44:16 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-bb322750-e33f-4d41-8cdd-c61b3e284308 req-b076d88d-3243-4f52-b4ee-495cb4c1432a service nova] Lock "6cfe9b0a-4ee9-4b4e-a8ac-d492937113ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:44:16 user nova-compute[72382]: DEBUG nova.compute.manager [req-bb322750-e33f-4d41-8cdd-c61b3e284308 req-b076d88d-3243-4f52-b4ee-495cb4c1432a service nova] [instance: 6cfe9b0a-4ee9-4b4e-a8ac-d492937113ae] No waiting events found dispatching network-vif-unplugged-833ca878-3d8d-441d-9b9e-7810c1c8c837 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:44:16 user nova-compute[72382]: DEBUG nova.compute.manager [req-bb322750-e33f-4d41-8cdd-c61b3e284308 req-b076d88d-3243-4f52-b4ee-495cb4c1432a service nova] [instance: 6cfe9b0a-4ee9-4b4e-a8ac-d492937113ae] Received event network-vif-unplugged-833ca878-3d8d-441d-9b9e-7810c1c8c837 for instance with task_state deleting. {{(pid=72382) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 15:44:16 user nova-compute[72382]: DEBUG nova.compute.manager [req-bb322750-e33f-4d41-8cdd-c61b3e284308 req-b076d88d-3243-4f52-b4ee-495cb4c1432a service nova] [instance: 6cfe9b0a-4ee9-4b4e-a8ac-d492937113ae] Received event network-vif-plugged-833ca878-3d8d-441d-9b9e-7810c1c8c837 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:44:16 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-bb322750-e33f-4d41-8cdd-c61b3e284308 req-b076d88d-3243-4f52-b4ee-495cb4c1432a service nova] Acquiring lock "6cfe9b0a-4ee9-4b4e-a8ac-d492937113ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:44:16 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-bb322750-e33f-4d41-8cdd-c61b3e284308 req-b076d88d-3243-4f52-b4ee-495cb4c1432a service nova] Lock "6cfe9b0a-4ee9-4b4e-a8ac-d492937113ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:44:16 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-bb322750-e33f-4d41-8cdd-c61b3e284308 req-b076d88d-3243-4f52-b4ee-495cb4c1432a service nova] Lock "6cfe9b0a-4ee9-4b4e-a8ac-d492937113ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:44:16 user nova-compute[72382]: DEBUG nova.compute.manager [req-bb322750-e33f-4d41-8cdd-c61b3e284308 req-b076d88d-3243-4f52-b4ee-495cb4c1432a service nova] [instance: 6cfe9b0a-4ee9-4b4e-a8ac-d492937113ae] No waiting events found dispatching network-vif-plugged-833ca878-3d8d-441d-9b9e-7810c1c8c837 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:44:16 user nova-compute[72382]: WARNING nova.compute.manager [req-bb322750-e33f-4d41-8cdd-c61b3e284308 req-b076d88d-3243-4f52-b4ee-495cb4c1432a service nova] [instance: 6cfe9b0a-4ee9-4b4e-a8ac-d492937113ae] Received unexpected event network-vif-plugged-833ca878-3d8d-441d-9b9e-7810c1c8c837 for instance with vm_state active and task_state deleting.
Aug 09 15:44:17 user nova-compute[72382]: DEBUG nova.network.neutron [-] [instance: 6cfe9b0a-4ee9-4b4e-a8ac-d492937113ae] Updating instance_info_cache with network_info: [] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:44:17 user nova-compute[72382]: INFO nova.compute.manager [-] [instance: 6cfe9b0a-4ee9-4b4e-a8ac-d492937113ae] Took 0.82 seconds to deallocate network for instance.
Aug 09 15:44:17 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-54faf7a2-b6a5-41af-b86e-9f4d1e19cb54 tempest-VolumesNegativeTest-369748005 tempest-VolumesNegativeTest-369748005-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:44:17 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-54faf7a2-b6a5-41af-b86e-9f4d1e19cb54 tempest-VolumesNegativeTest-369748005 tempest-VolumesNegativeTest-369748005-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:44:17 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-91cbb44f-770a-4375-9428-a384d3106f53 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Acquiring lock "0c1b05ee-4fc3-44b9-b689-52d07841da4c" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:44:17 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-91cbb44f-770a-4375-9428-a384d3106f53 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Lock "0c1b05ee-4fc3-44b9-b689-52d07841da4c" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:44:17 user nova-compute[72382]: INFO nova.compute.manager [None req-91cbb44f-770a-4375-9428-a384d3106f53 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] [instance: 0c1b05ee-4fc3-44b9-b689-52d07841da4c] Rebooting instance
Aug 09 15:44:17 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-91cbb44f-770a-4375-9428-a384d3106f53 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Acquiring lock "refresh_cache-0c1b05ee-4fc3-44b9-b689-52d07841da4c" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 15:44:17 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-91cbb44f-770a-4375-9428-a384d3106f53 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Acquired lock "refresh_cache-0c1b05ee-4fc3-44b9-b689-52d07841da4c" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 15:44:17 user nova-compute[72382]: DEBUG nova.network.neutron [None req-91cbb44f-770a-4375-9428-a384d3106f53 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] [instance: 0c1b05ee-4fc3-44b9-b689-52d07841da4c] Building network info cache for instance {{(pid=72382) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 15:44:17 user nova-compute[72382]: DEBUG nova.compute.provider_tree [None req-54faf7a2-b6a5-41af-b86e-9f4d1e19cb54 tempest-VolumesNegativeTest-369748005 tempest-VolumesNegativeTest-369748005-project-member] Inventory has not changed in ProviderTree for provider: 7b15b0e5-df4d-49db-833b-2855d21d10ae {{(pid=72382) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 15:44:17 user nova-compute[72382]: DEBUG nova.scheduler.client.report [None req-54faf7a2-b6a5-41af-b86e-9f4d1e19cb54 tempest-VolumesNegativeTest-369748005 tempest-VolumesNegativeTest-369748005-project-member] Inventory has not changed for provider 7b15b0e5-df4d-49db-833b-2855d21d10ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72382) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 15:44:17 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-54faf7a2-b6a5-41af-b86e-9f4d1e19cb54 tempest-VolumesNegativeTest-369748005 tempest-VolumesNegativeTest-369748005-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.239s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:44:17 user nova-compute[72382]: INFO nova.scheduler.client.report [None req-54faf7a2-b6a5-41af-b86e-9f4d1e19cb54 tempest-VolumesNegativeTest-369748005 tempest-VolumesNegativeTest-369748005-project-member] Deleted allocations for instance 6cfe9b0a-4ee9-4b4e-a8ac-d492937113ae
Aug 09 15:44:17 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-54faf7a2-b6a5-41af-b86e-9f4d1e19cb54 tempest-VolumesNegativeTest-369748005 tempest-VolumesNegativeTest-369748005-project-member] Lock "6cfe9b0a-4ee9-4b4e-a8ac-d492937113ae" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.176s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:44:17 user nova-compute[72382]: DEBUG nova.network.neutron [None req-91cbb44f-770a-4375-9428-a384d3106f53 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] [instance: 0c1b05ee-4fc3-44b9-b689-52d07841da4c] Updating instance_info_cache with network_info: [{"id": "b339298b-9a14-4a36-a53e-7d1e6a2d85ff", "address": "fa:16:3e:d4:06:6f", "network": {"id": "8d929426-09f7-49b5-a79e-711e20e00750", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1307802727-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93c87775443b4abd987197c4b46693bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb339298b-9a", "ovs_interfaceid": "b339298b-9a14-4a36-a53e-7d1e6a2d85ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:44:17 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-91cbb44f-770a-4375-9428-a384d3106f53 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Releasing lock "refresh_cache-0c1b05ee-4fc3-44b9-b689-52d07841da4c" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 15:44:17 user nova-compute[72382]: DEBUG nova.compute.manager [None req-91cbb44f-770a-4375-9428-a384d3106f53 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] [instance: 0c1b05ee-4fc3-44b9-b689-52d07841da4c] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:44:18 user nova-compute[72382]: DEBUG nova.compute.manager [req-5ece755f-7f9e-4ae8-8517-9307af9ed034 req-1b2fdd8d-fd00-444a-832c-fd545cba7ab6 service nova] [instance: 0c1b05ee-4fc3-44b9-b689-52d07841da4c] Received event network-changed-b339298b-9a14-4a36-a53e-7d1e6a2d85ff {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:44:18 user nova-compute[72382]: DEBUG nova.compute.manager [req-5ece755f-7f9e-4ae8-8517-9307af9ed034 req-1b2fdd8d-fd00-444a-832c-fd545cba7ab6 service nova] [instance: 0c1b05ee-4fc3-44b9-b689-52d07841da4c] Refreshing instance network info cache due to event network-changed-b339298b-9a14-4a36-a53e-7d1e6a2d85ff. {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 15:44:18 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-5ece755f-7f9e-4ae8-8517-9307af9ed034 req-1b2fdd8d-fd00-444a-832c-fd545cba7ab6 service nova] Acquiring lock "refresh_cache-0c1b05ee-4fc3-44b9-b689-52d07841da4c" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 15:44:18 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-5ece755f-7f9e-4ae8-8517-9307af9ed034 req-1b2fdd8d-fd00-444a-832c-fd545cba7ab6 service nova] Acquired lock "refresh_cache-0c1b05ee-4fc3-44b9-b689-52d07841da4c" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 15:44:18 user nova-compute[72382]: DEBUG nova.network.neutron [req-5ece755f-7f9e-4ae8-8517-9307af9ed034 req-1b2fdd8d-fd00-444a-832c-fd545cba7ab6 service nova] [instance: 0c1b05ee-4fc3-44b9-b689-52d07841da4c] Refreshing network info cache for port b339298b-9a14-4a36-a53e-7d1e6a2d85ff {{(pid=72382) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 15:44:19 user nova-compute[72382]: DEBUG nova.network.neutron [req-5ece755f-7f9e-4ae8-8517-9307af9ed034 req-1b2fdd8d-fd00-444a-832c-fd545cba7ab6 service nova] [instance: 0c1b05ee-4fc3-44b9-b689-52d07841da4c] Updated VIF entry in instance network info cache for port b339298b-9a14-4a36-a53e-7d1e6a2d85ff. {{(pid=72382) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 15:44:19 user nova-compute[72382]: DEBUG nova.network.neutron [req-5ece755f-7f9e-4ae8-8517-9307af9ed034 req-1b2fdd8d-fd00-444a-832c-fd545cba7ab6 service nova] [instance: 0c1b05ee-4fc3-44b9-b689-52d07841da4c] Updating instance_info_cache with network_info: [{"id": "b339298b-9a14-4a36-a53e-7d1e6a2d85ff", "address": "fa:16:3e:d4:06:6f", "network": {"id": "8d929426-09f7-49b5-a79e-711e20e00750", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1307802727-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93c87775443b4abd987197c4b46693bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb339298b-9a", "ovs_interfaceid": "b339298b-9a14-4a36-a53e-7d1e6a2d85ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:44:19 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-5ece755f-7f9e-4ae8-8517-9307af9ed034 req-1b2fdd8d-fd00-444a-832c-fd545cba7ab6 service nova] Releasing lock "refresh_cache-0c1b05ee-4fc3-44b9-b689-52d07841da4c" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 15:44:19 user nova-compute[72382]: DEBUG nova.compute.manager [req-5ece755f-7f9e-4ae8-8517-9307af9ed034 req-1b2fdd8d-fd00-444a-832c-fd545cba7ab6 service nova] [instance: 6cfe9b0a-4ee9-4b4e-a8ac-d492937113ae] Received event network-vif-deleted-833ca878-3d8d-441d-9b9e-7810c1c8c837 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:44:20 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:44:20 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:44:20 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:44:20 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:44:20 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:44:20 user nova-compute[72382]: DEBUG nova.compute.manager [req-99da2186-f816-4854-b5d8-427c029d3283 req-b647c66a-2bee-4f88-958f-b16684db8fec service nova] [instance: 0c1b05ee-4fc3-44b9-b689-52d07841da4c] Received event network-vif-unplugged-b339298b-9a14-4a36-a53e-7d1e6a2d85ff {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:44:20 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-99da2186-f816-4854-b5d8-427c029d3283 req-b647c66a-2bee-4f88-958f-b16684db8fec service nova] Acquiring lock "0c1b05ee-4fc3-44b9-b689-52d07841da4c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:44:20 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-99da2186-f816-4854-b5d8-427c029d3283 req-b647c66a-2bee-4f88-958f-b16684db8fec service nova] Lock "0c1b05ee-4fc3-44b9-b689-52d07841da4c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:44:20 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-99da2186-f816-4854-b5d8-427c029d3283 req-b647c66a-2bee-4f88-958f-b16684db8fec service nova] Lock "0c1b05ee-4fc3-44b9-b689-52d07841da4c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:44:20 user nova-compute[72382]: DEBUG nova.compute.manager [req-99da2186-f816-4854-b5d8-427c029d3283 req-b647c66a-2bee-4f88-958f-b16684db8fec service nova] [instance: 0c1b05ee-4fc3-44b9-b689-52d07841da4c] No waiting events found dispatching network-vif-unplugged-b339298b-9a14-4a36-a53e-7d1e6a2d85ff {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:44:20 user nova-compute[72382]: WARNING nova.compute.manager [req-99da2186-f816-4854-b5d8-427c029d3283 req-b647c66a-2bee-4f88-958f-b16684db8fec service nova] [instance: 0c1b05ee-4fc3-44b9-b689-52d07841da4c] Received unexpected event network-vif-unplugged-b339298b-9a14-4a36-a53e-7d1e6a2d85ff for instance with vm_state active and task_state reboot_started.
Aug 09 15:44:21 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-91cbb44f-770a-4375-9428-a384d3106f53 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] [instance: 0c1b05ee-4fc3-44b9-b689-52d07841da4c] Instance shutdown successfully.
Aug 09 15:44:21 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:44:21 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:44:21 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:44:21 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:44:21 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:44:21 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Auditing locally available compute resources for user (node: user) {{(pid=72382) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 15:44:22 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:44:22 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:44:22 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:44:22 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:44:22 user nova-compute[72382]: DEBUG nova.compute.manager [req-c950eb5a-f3a3-4a75-9fe5-c847d6407b3a req-2e5580be-f64f-499e-b1c7-e1f63f9bf59e service nova] [instance: 0c1b05ee-4fc3-44b9-b689-52d07841da4c] Received event network-vif-plugged-b339298b-9a14-4a36-a53e-7d1e6a2d85ff {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:44:22 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-c950eb5a-f3a3-4a75-9fe5-c847d6407b3a req-2e5580be-f64f-499e-b1c7-e1f63f9bf59e service nova] Acquiring lock "0c1b05ee-4fc3-44b9-b689-52d07841da4c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:44:22 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-c950eb5a-f3a3-4a75-9fe5-c847d6407b3a req-2e5580be-f64f-499e-b1c7-e1f63f9bf59e service nova] Lock "0c1b05ee-4fc3-44b9-b689-52d07841da4c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:44:22 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-c950eb5a-f3a3-4a75-9fe5-c847d6407b3a req-2e5580be-f64f-499e-b1c7-e1f63f9bf59e service nova] Lock "0c1b05ee-4fc3-44b9-b689-52d07841da4c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:44:22 user nova-compute[72382]: DEBUG nova.compute.manager [req-c950eb5a-f3a3-4a75-9fe5-c847d6407b3a req-2e5580be-f64f-499e-b1c7-e1f63f9bf59e service nova] [instance: 0c1b05ee-4fc3-44b9-b689-52d07841da4c] No waiting events found dispatching network-vif-plugged-b339298b-9a14-4a36-a53e-7d1e6a2d85ff {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:44:22 user nova-compute[72382]: WARNING nova.compute.manager [req-c950eb5a-f3a3-4a75-9fe5-c847d6407b3a req-2e5580be-f64f-499e-b1c7-e1f63f9bf59e service nova] [instance: 0c1b05ee-4fc3-44b9-b689-52d07841da4c] Received unexpected event network-vif-plugged-b339298b-9a14-4a36-a53e-7d1e6a2d85ff for instance with vm_state active and task_state reboot_started.
Aug 09 15:44:22 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-c16b6fec-8de4-4717-9845-40b8fe4345c8 tempest-TestServerVolumeAttachScenarioOldVersion-787688685 tempest-TestServerVolumeAttachScenarioOldVersion-787688685-project-member] Acquiring lock "5c914d94-5bfd-4984-8937-37bdf02e9674" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:44:22 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-c16b6fec-8de4-4717-9845-40b8fe4345c8 tempest-TestServerVolumeAttachScenarioOldVersion-787688685 tempest-TestServerVolumeAttachScenarioOldVersion-787688685-project-member] Lock "5c914d94-5bfd-4984-8937-37bdf02e9674" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:44:22 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-c16b6fec-8de4-4717-9845-40b8fe4345c8 tempest-TestServerVolumeAttachScenarioOldVersion-787688685 tempest-TestServerVolumeAttachScenarioOldVersion-787688685-project-member] Acquiring lock "5c914d94-5bfd-4984-8937-37bdf02e9674-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:44:22 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-c16b6fec-8de4-4717-9845-40b8fe4345c8 tempest-TestServerVolumeAttachScenarioOldVersion-787688685 tempest-TestServerVolumeAttachScenarioOldVersion-787688685-project-member] Lock "5c914d94-5bfd-4984-8937-37bdf02e9674-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:44:22 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-c16b6fec-8de4-4717-9845-40b8fe4345c8 tempest-TestServerVolumeAttachScenarioOldVersion-787688685 tempest-TestServerVolumeAttachScenarioOldVersion-787688685-project-member] Lock "5c914d94-5bfd-4984-8937-37bdf02e9674-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:44:22 user nova-compute[72382]: INFO nova.compute.manager [None req-c16b6fec-8de4-4717-9845-40b8fe4345c8 tempest-TestServerVolumeAttachScenarioOldVersion-787688685 tempest-TestServerVolumeAttachScenarioOldVersion-787688685-project-member] [instance: 5c914d94-5bfd-4984-8937-37bdf02e9674] Terminating instance
Aug 09 15:44:22 user nova-compute[72382]: DEBUG nova.compute.manager [None req-c16b6fec-8de4-4717-9845-40b8fe4345c8 tempest-TestServerVolumeAttachScenarioOldVersion-787688685 tempest-TestServerVolumeAttachScenarioOldVersion-787688685-project-member] [instance: 5c914d94-5bfd-4984-8937-37bdf02e9674] Start destroying the instance on the hypervisor. {{(pid=72382) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 15:44:22 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:44:22 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:44:23 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:44:23 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:44:23 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:44:23 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:44:23 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:44:23 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:44:23 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:44:23 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:44:23 user nova-compute[72382]: INFO nova.virt.libvirt.driver [-] [instance: 5c914d94-5bfd-4984-8937-37bdf02e9674] Instance destroyed successfully.
Aug 09 15:44:23 user nova-compute[72382]: DEBUG nova.objects.instance [None req-c16b6fec-8de4-4717-9845-40b8fe4345c8 tempest-TestServerVolumeAttachScenarioOldVersion-787688685 tempest-TestServerVolumeAttachScenarioOldVersion-787688685-project-member] Lazy-loading 'resources' on Instance uuid 5c914d94-5bfd-4984-8937-37bdf02e9674 {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:44:23 user nova-compute[72382]: DEBUG nova.virt.libvirt.vif [None req-c16b6fec-8de4-4717-9845-40b8fe4345c8 tempest-TestServerVolumeAttachScenarioOldVersion-787688685 tempest-TestServerVolumeAttachScenarioOldVersion-787688685-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T15:41:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1605899925',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1605899925',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1605899',id=46,image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK4B9xaCIZerorj9Fvsw1WllwqEYvVTXL3D94j/E97x0EmsRhRlUlcbuXKO3snnMCRPhifzERLvpn7ECLZDzzc8v/7KlrftxNJkcaplrYZmxLvF+zkksn66csb2TO5pwBA==',key_name='tempest-keypair-233444206',keypairs=<?>,launch_index=0,launched_at=2023-08-09T15:41:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1f0a8014c8bb4f4b80617a5516539994',ramdisk_id='',reservation_id='r-0rz2h6vx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-787688685',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-787688685-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T15:41:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='05b8aec03cb54887a02ac4a0c6a1c80a',uuid=5c914d94-5bfd-4984-8937-37bdf02e9674,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0ac76bca-773f-4a75-8811-c9839f549726", "address": "fa:16:3e:4a:5b:a7", "network": {"id": "67846b1f-41a7-4942-b9d2-0e41417d5ecf", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1653397054-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f0a8014c8bb4f4b80617a5516539994", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ac76bca-77", "ovs_interfaceid": "0ac76bca-773f-4a75-8811-c9839f549726", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 15:44:23 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-c16b6fec-8de4-4717-9845-40b8fe4345c8 tempest-TestServerVolumeAttachScenarioOldVersion-787688685 tempest-TestServerVolumeAttachScenarioOldVersion-787688685-project-member] Converting VIF {"id": "0ac76bca-773f-4a75-8811-c9839f549726", "address": "fa:16:3e:4a:5b:a7", "network": {"id": "67846b1f-41a7-4942-b9d2-0e41417d5ecf", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1653397054-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f0a8014c8bb4f4b80617a5516539994", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ac76bca-77", "ovs_interfaceid": "0ac76bca-773f-4a75-8811-c9839f549726", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 15:44:23 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-c16b6fec-8de4-4717-9845-40b8fe4345c8 tempest-TestServerVolumeAttachScenarioOldVersion-787688685 tempest-TestServerVolumeAttachScenarioOldVersion-787688685-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4a:5b:a7,bridge_name='br-int',has_traffic_filtering=True,id=0ac76bca-773f-4a75-8811-c9839f549726,network=Network(67846b1f-41a7-4942-b9d2-0e41417d5ecf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ac76bca-77') {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 15:44:23 user nova-compute[72382]: DEBUG os_vif [None req-c16b6fec-8de4-4717-9845-40b8fe4345c8 tempest-TestServerVolumeAttachScenarioOldVersion-787688685 tempest-TestServerVolumeAttachScenarioOldVersion-787688685-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4a:5b:a7,bridge_name='br-int',has_traffic_filtering=True,id=0ac76bca-773f-4a75-8811-c9839f549726,network=Network(67846b1f-41a7-4942-b9d2-0e41417d5ecf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ac76bca-77') {{(pid=72382) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 15:44:23 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:44:23 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0ac76bca-77, bridge=br-int, if_exists=True) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:44:23 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:44:23 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:44:23 user nova-compute[72382]: INFO os_vif [None req-c16b6fec-8de4-4717-9845-40b8fe4345c8 tempest-TestServerVolumeAttachScenarioOldVersion-787688685 tempest-TestServerVolumeAttachScenarioOldVersion-787688685-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4a:5b:a7,bridge_name='br-int',has_traffic_filtering=True,id=0ac76bca-773f-4a75-8811-c9839f549726,network=Network(67846b1f-41a7-4942-b9d2-0e41417d5ecf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ac76bca-77')
Aug 09 15:44:23 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-c16b6fec-8de4-4717-9845-40b8fe4345c8 tempest-TestServerVolumeAttachScenarioOldVersion-787688685 tempest-TestServerVolumeAttachScenarioOldVersion-787688685-project-member] [instance: 5c914d94-5bfd-4984-8937-37bdf02e9674] Deleting instance files /opt/stack/data/nova/instances/5c914d94-5bfd-4984-8937-37bdf02e9674_del
Aug 09 15:44:23 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-c16b6fec-8de4-4717-9845-40b8fe4345c8 tempest-TestServerVolumeAttachScenarioOldVersion-787688685 tempest-TestServerVolumeAttachScenarioOldVersion-787688685-project-member] [instance: 5c914d94-5bfd-4984-8937-37bdf02e9674] Deletion of /opt/stack/data/nova/instances/5c914d94-5bfd-4984-8937-37bdf02e9674_del complete
Aug 09 15:44:23 user nova-compute[72382]: DEBUG nova.compute.manager [req-f7c7ad8b-f9b0-47b5-8e8a-b4eb4af617f2 req-2982df4d-556f-4e96-b716-d94326c1ffc7 service nova] [instance: 5c914d94-5bfd-4984-8937-37bdf02e9674] Received event network-vif-unplugged-0ac76bca-773f-4a75-8811-c9839f549726 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:44:23 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-f7c7ad8b-f9b0-47b5-8e8a-b4eb4af617f2 req-2982df4d-556f-4e96-b716-d94326c1ffc7 service nova] Acquiring lock "5c914d94-5bfd-4984-8937-37bdf02e9674-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:44:23 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-f7c7ad8b-f9b0-47b5-8e8a-b4eb4af617f2 req-2982df4d-556f-4e96-b716-d94326c1ffc7 service nova] Lock "5c914d94-5bfd-4984-8937-37bdf02e9674-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:44:23 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-f7c7ad8b-f9b0-47b5-8e8a-b4eb4af617f2 req-2982df4d-556f-4e96-b716-d94326c1ffc7 service nova] Lock "5c914d94-5bfd-4984-8937-37bdf02e9674-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:44:23 user nova-compute[72382]: DEBUG nova.compute.manager [req-f7c7ad8b-f9b0-47b5-8e8a-b4eb4af617f2 req-2982df4d-556f-4e96-b716-d94326c1ffc7 service nova] [instance: 5c914d94-5bfd-4984-8937-37bdf02e9674] No waiting events found dispatching network-vif-unplugged-0ac76bca-773f-4a75-8811-c9839f549726 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:44:23 user nova-compute[72382]: DEBUG nova.compute.manager [req-f7c7ad8b-f9b0-47b5-8e8a-b4eb4af617f2 req-2982df4d-556f-4e96-b716-d94326c1ffc7 service nova] [instance: 5c914d94-5bfd-4984-8937-37bdf02e9674] Received event network-vif-unplugged-0ac76bca-773f-4a75-8811-c9839f549726 for instance with task_state deleting. {{(pid=72382) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 15:44:23 user nova-compute[72382]: INFO nova.compute.manager [None req-c16b6fec-8de4-4717-9845-40b8fe4345c8 tempest-TestServerVolumeAttachScenarioOldVersion-787688685 tempest-TestServerVolumeAttachScenarioOldVersion-787688685-project-member] [instance: 5c914d94-5bfd-4984-8937-37bdf02e9674] Took 0.98 seconds to destroy the instance on the hypervisor.
Aug 09 15:44:23 user nova-compute[72382]: DEBUG oslo.service.loopingcall [None req-c16b6fec-8de4-4717-9845-40b8fe4345c8 tempest-TestServerVolumeAttachScenarioOldVersion-787688685 tempest-TestServerVolumeAttachScenarioOldVersion-787688685-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72382) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 15:44:23 user nova-compute[72382]: DEBUG nova.compute.manager [-] [instance: 5c914d94-5bfd-4984-8937-37bdf02e9674] Deallocating network for instance {{(pid=72382) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 15:44:23 user nova-compute[72382]: DEBUG nova.network.neutron [-] [instance: 5c914d94-5bfd-4984-8937-37bdf02e9674] deallocate_for_instance() {{(pid=72382) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 15:44:23 user nova-compute[72382]: WARNING nova.virt.libvirt.driver [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Error from libvirt while getting description of instance-0000002e: [Error Code 42] Domain not found: no domain with matching uuid '5c914d94-5bfd-4984-8937-37bdf02e9674' (instance-0000002e): libvirt.libvirtError: Domain not found: no domain with matching uuid '5c914d94-5bfd-4984-8937-37bdf02e9674' (instance-0000002e)
Aug 09 15:44:23 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c1b05ee-4fc3-44b9-b689-52d07841da4c/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:44:23 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c1b05ee-4fc3-44b9-b689-52d07841da4c/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:44:23 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c1b05ee-4fc3-44b9-b689-52d07841da4c/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:44:24 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c1b05ee-4fc3-44b9-b689-52d07841da4c/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:44:24 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72382) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 15:44:24 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72382) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 15:44:24 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d27c5a4-9a88-423b-9c48-9224e8248f8c/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:44:24 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d27c5a4-9a88-423b-9c48-9224e8248f8c/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:44:24 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d27c5a4-9a88-423b-9c48-9224e8248f8c/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:44:24 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d27c5a4-9a88-423b-9c48-9224e8248f8c/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:44:25 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:44:25 user nova-compute[72382]: DEBUG nova.compute.manager [req-7a9d228e-10b6-4c50-8b14-acd439c945d1 req-508163e0-633f-4c91-989e-ed5b75477d56 service nova] [instance: 0c1b05ee-4fc3-44b9-b689-52d07841da4c] Received event network-vif-plugged-b339298b-9a14-4a36-a53e-7d1e6a2d85ff {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:44:25 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-7a9d228e-10b6-4c50-8b14-acd439c945d1 req-508163e0-633f-4c91-989e-ed5b75477d56 service nova] Acquiring lock "0c1b05ee-4fc3-44b9-b689-52d07841da4c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:44:25 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-7a9d228e-10b6-4c50-8b14-acd439c945d1 req-508163e0-633f-4c91-989e-ed5b75477d56 service nova] Lock "0c1b05ee-4fc3-44b9-b689-52d07841da4c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:44:25 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-7a9d228e-10b6-4c50-8b14-acd439c945d1 req-508163e0-633f-4c91-989e-ed5b75477d56 service nova] Lock "0c1b05ee-4fc3-44b9-b689-52d07841da4c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:44:25 user nova-compute[72382]: DEBUG nova.compute.manager [req-7a9d228e-10b6-4c50-8b14-acd439c945d1 req-508163e0-633f-4c91-989e-ed5b75477d56 service nova] [instance: 0c1b05ee-4fc3-44b9-b689-52d07841da4c] No waiting events found dispatching network-vif-plugged-b339298b-9a14-4a36-a53e-7d1e6a2d85ff {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:44:25 user nova-compute[72382]: WARNING nova.compute.manager [req-7a9d228e-10b6-4c50-8b14-acd439c945d1 req-508163e0-633f-4c91-989e-ed5b75477d56 service nova] [instance: 0c1b05ee-4fc3-44b9-b689-52d07841da4c] Received unexpected event network-vif-plugged-b339298b-9a14-4a36-a53e-7d1e6a2d85ff for instance with vm_state active and task_state reboot_started.
Aug 09 15:44:25 user nova-compute[72382]: DEBUG nova.compute.manager [req-7a9d228e-10b6-4c50-8b14-acd439c945d1 req-508163e0-633f-4c91-989e-ed5b75477d56 service nova] [instance: 0c1b05ee-4fc3-44b9-b689-52d07841da4c] Received event network-vif-plugged-b339298b-9a14-4a36-a53e-7d1e6a2d85ff {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:44:25 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-7a9d228e-10b6-4c50-8b14-acd439c945d1 req-508163e0-633f-4c91-989e-ed5b75477d56 service nova] Acquiring lock "0c1b05ee-4fc3-44b9-b689-52d07841da4c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:44:25 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-7a9d228e-10b6-4c50-8b14-acd439c945d1 req-508163e0-633f-4c91-989e-ed5b75477d56 service nova] Lock "0c1b05ee-4fc3-44b9-b689-52d07841da4c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:44:25 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-7a9d228e-10b6-4c50-8b14-acd439c945d1 req-508163e0-633f-4c91-989e-ed5b75477d56 service nova] Lock "0c1b05ee-4fc3-44b9-b689-52d07841da4c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:44:25 user nova-compute[72382]: DEBUG nova.compute.manager [req-7a9d228e-10b6-4c50-8b14-acd439c945d1 req-508163e0-633f-4c91-989e-ed5b75477d56 service nova] [instance: 0c1b05ee-4fc3-44b9-b689-52d07841da4c] No waiting events found dispatching network-vif-plugged-b339298b-9a14-4a36-a53e-7d1e6a2d85ff {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:44:25 user nova-compute[72382]: WARNING nova.compute.manager [req-7a9d228e-10b6-4c50-8b14-acd439c945d1 req-508163e0-633f-4c91-989e-ed5b75477d56 service nova] [instance: 0c1b05ee-4fc3-44b9-b689-52d07841da4c] Received unexpected event network-vif-plugged-b339298b-9a14-4a36-a53e-7d1e6a2d85ff for instance with vm_state active and task_state reboot_started.
Aug 09 15:44:25 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Removed pending event for 0c1b05ee-4fc3-44b9-b689-52d07841da4c due to event {{(pid=72382) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 09 15:44:25 user nova-compute[72382]: DEBUG nova.virt.driver [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Emitting event <LifecycleEvent: 1691595864.8175023, 0c1b05ee-4fc3-44b9-b689-52d07841da4c => Resumed> {{(pid=72382) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 15:44:25 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 0c1b05ee-4fc3-44b9-b689-52d07841da4c] VM Resumed (Lifecycle Event)
Aug 09 15:44:25 user nova-compute[72382]: DEBUG nova.network.neutron [-] [instance: 5c914d94-5bfd-4984-8937-37bdf02e9674] Updating instance_info_cache with network_info: [] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:44:25 user nova-compute[72382]: WARNING nova.virt.libvirt.driver [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 15:44:25 user nova-compute[72382]: WARNING nova.virt.libvirt.driver [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 15:44:25 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Hypervisor/Node resource view: name=user free_ram=8410MB free_disk=25.278827667236328GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72382) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 15:44:25 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:44:25 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:44:25 user nova-compute[72382]: INFO nova.compute.manager [-] [instance: 5c914d94-5bfd-4984-8937-37bdf02e9674] Took 1.48 seconds to deallocate network for instance.
Aug 09 15:44:25 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 0c1b05ee-4fc3-44b9-b689-52d07841da4c] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:44:25 user nova-compute[72382]: INFO nova.virt.libvirt.driver [-] [instance: 0c1b05ee-4fc3-44b9-b689-52d07841da4c] Instance running successfully.
Aug 09 15:44:25 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-91cbb44f-770a-4375-9428-a384d3106f53 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] [instance: 0c1b05ee-4fc3-44b9-b689-52d07841da4c] Instance soft rebooted successfully.
Aug 09 15:44:25 user nova-compute[72382]: DEBUG nova.compute.manager [None req-91cbb44f-770a-4375-9428-a384d3106f53 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] [instance: 0c1b05ee-4fc3-44b9-b689-52d07841da4c] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:44:25 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 0c1b05ee-4fc3-44b9-b689-52d07841da4c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started, current DB power_state: 1, VM power_state: 1 {{(pid=72382) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 15:44:25 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 0c1b05ee-4fc3-44b9-b689-52d07841da4c] During sync_power_state the instance has a pending task (reboot_started). Skip.
Aug 09 15:44:25 user nova-compute[72382]: DEBUG nova.virt.driver [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Emitting event <LifecycleEvent: 1691595864.818289, 0c1b05ee-4fc3-44b9-b689-52d07841da4c => Started> {{(pid=72382) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 15:44:25 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 0c1b05ee-4fc3-44b9-b689-52d07841da4c] VM Started (Lifecycle Event)
Aug 09 15:44:25 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 0c1b05ee-4fc3-44b9-b689-52d07841da4c] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:44:25 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 0c1b05ee-4fc3-44b9-b689-52d07841da4c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: reboot_started, current DB power_state: 1, VM power_state: 1 {{(pid=72382) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 15:44:25 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-c16b6fec-8de4-4717-9845-40b8fe4345c8 tempest-TestServerVolumeAttachScenarioOldVersion-787688685 tempest-TestServerVolumeAttachScenarioOldVersion-787688685-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:44:25 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance 3855b76f-87cc-4be0-982c-4cc5cf5cd8aa actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:44:25 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance 5c914d94-5bfd-4984-8937-37bdf02e9674 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:44:25 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance 4d27c5a4-9a88-423b-9c48-9224e8248f8c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:44:25 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance 0c1b05ee-4fc3-44b9-b689-52d07841da4c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:44:25 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=72382) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 15:44:25 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=72382) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 15:44:25 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-91cbb44f-770a-4375-9428-a384d3106f53 tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Lock "0c1b05ee-4fc3-44b9-b689-52d07841da4c" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 8.020s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:44:25 user nova-compute[72382]: DEBUG nova.compute.provider_tree [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Inventory has not changed in ProviderTree for provider: 7b15b0e5-df4d-49db-833b-2855d21d10ae {{(pid=72382) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 15:44:25 user nova-compute[72382]: DEBUG nova.scheduler.client.report [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Inventory has not changed for provider 7b15b0e5-df4d-49db-833b-2855d21d10ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72382) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 15:44:25 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Compute_service record updated for user:user {{(pid=72382) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 15:44:25 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.375s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:44:25 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-c16b6fec-8de4-4717-9845-40b8fe4345c8 tempest-TestServerVolumeAttachScenarioOldVersion-787688685 tempest-TestServerVolumeAttachScenarioOldVersion-787688685-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.264s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:44:25 user nova-compute[72382]: DEBUG nova.compute.provider_tree [None req-c16b6fec-8de4-4717-9845-40b8fe4345c8 tempest-TestServerVolumeAttachScenarioOldVersion-787688685 tempest-TestServerVolumeAttachScenarioOldVersion-787688685-project-member] Inventory has not changed in ProviderTree for provider: 7b15b0e5-df4d-49db-833b-2855d21d10ae {{(pid=72382) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 15:44:25 user nova-compute[72382]: DEBUG nova.scheduler.client.report [None req-c16b6fec-8de4-4717-9845-40b8fe4345c8 tempest-TestServerVolumeAttachScenarioOldVersion-787688685 tempest-TestServerVolumeAttachScenarioOldVersion-787688685-project-member] Inventory has not changed for provider 7b15b0e5-df4d-49db-833b-2855d21d10ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72382) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 15:44:25 user nova-compute[72382]: DEBUG nova.compute.manager [req-5a127ed6-f599-4d0a-b86d-a36c083b813d req-2858fe15-a2c2-492f-846c-d1bbb6da5707 service nova] [instance: 5c914d94-5bfd-4984-8937-37bdf02e9674] Received event network-vif-plugged-0ac76bca-773f-4a75-8811-c9839f549726 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:44:25 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-5a127ed6-f599-4d0a-b86d-a36c083b813d req-2858fe15-a2c2-492f-846c-d1bbb6da5707 service nova] Acquiring lock "5c914d94-5bfd-4984-8937-37bdf02e9674-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:44:25 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-5a127ed6-f599-4d0a-b86d-a36c083b813d req-2858fe15-a2c2-492f-846c-d1bbb6da5707 service nova] Lock "5c914d94-5bfd-4984-8937-37bdf02e9674-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:44:25 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-5a127ed6-f599-4d0a-b86d-a36c083b813d req-2858fe15-a2c2-492f-846c-d1bbb6da5707 service nova] Lock "5c914d94-5bfd-4984-8937-37bdf02e9674-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:44:25 user nova-compute[72382]: DEBUG nova.compute.manager [req-5a127ed6-f599-4d0a-b86d-a36c083b813d req-2858fe15-a2c2-492f-846c-d1bbb6da5707 service nova] [instance: 5c914d94-5bfd-4984-8937-37bdf02e9674] No waiting events found dispatching network-vif-plugged-0ac76bca-773f-4a75-8811-c9839f549726 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:44:25 user nova-compute[72382]: WARNING nova.compute.manager [req-5a127ed6-f599-4d0a-b86d-a36c083b813d req-2858fe15-a2c2-492f-846c-d1bbb6da5707 service nova] [instance: 5c914d94-5bfd-4984-8937-37bdf02e9674] Received unexpected event network-vif-plugged-0ac76bca-773f-4a75-8811-c9839f549726 for instance with vm_state deleted and task_state None.
Aug 09 15:44:25 user nova-compute[72382]: DEBUG nova.compute.manager [req-5a127ed6-f599-4d0a-b86d-a36c083b813d req-2858fe15-a2c2-492f-846c-d1bbb6da5707 service nova] [instance: 5c914d94-5bfd-4984-8937-37bdf02e9674] Received event network-vif-deleted-0ac76bca-773f-4a75-8811-c9839f549726 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:44:25 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-c16b6fec-8de4-4717-9845-40b8fe4345c8 tempest-TestServerVolumeAttachScenarioOldVersion-787688685 tempest-TestServerVolumeAttachScenarioOldVersion-787688685-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.190s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:44:25 user nova-compute[72382]: INFO nova.scheduler.client.report [None req-c16b6fec-8de4-4717-9845-40b8fe4345c8 tempest-TestServerVolumeAttachScenarioOldVersion-787688685 tempest-TestServerVolumeAttachScenarioOldVersion-787688685-project-member] Deleted allocations for instance 5c914d94-5bfd-4984-8937-37bdf02e9674
Aug 09 15:44:25 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-c16b6fec-8de4-4717-9845-40b8fe4345c8 tempest-TestServerVolumeAttachScenarioOldVersion-787688685 tempest-TestServerVolumeAttachScenarioOldVersion-787688685-project-member] Lock "5c914d94-5bfd-4984-8937-37bdf02e9674" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.172s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:44:26 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:44:26 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:44:26 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:44:27 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:44:27 user nova-compute[72382]: DEBUG nova.compute.manager [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72382) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 15:44:28 user nova-compute[72382]: DEBUG nova.compute.manager [req-ebe39ed8-2ba7-476e-bd19-8788357e5b7d req-dca34e89-835a-4b49-94c4-d2fa5b15b035 service nova] [instance: 3855b76f-87cc-4be0-982c-4cc5cf5cd8aa] Received event network-changed-b7c16d4a-24b4-4ba6-860a-d180123dd204 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:44:28 user nova-compute[72382]: DEBUG nova.compute.manager [req-ebe39ed8-2ba7-476e-bd19-8788357e5b7d req-dca34e89-835a-4b49-94c4-d2fa5b15b035 service nova] [instance: 3855b76f-87cc-4be0-982c-4cc5cf5cd8aa] Refreshing instance network info cache due to event network-changed-b7c16d4a-24b4-4ba6-860a-d180123dd204. {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 15:44:28 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-ebe39ed8-2ba7-476e-bd19-8788357e5b7d req-dca34e89-835a-4b49-94c4-d2fa5b15b035 service nova] Acquiring lock "refresh_cache-3855b76f-87cc-4be0-982c-4cc5cf5cd8aa" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 15:44:28 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-ebe39ed8-2ba7-476e-bd19-8788357e5b7d req-dca34e89-835a-4b49-94c4-d2fa5b15b035 service nova] Acquired lock "refresh_cache-3855b76f-87cc-4be0-982c-4cc5cf5cd8aa" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 15:44:28 user nova-compute[72382]: DEBUG nova.network.neutron [req-ebe39ed8-2ba7-476e-bd19-8788357e5b7d req-dca34e89-835a-4b49-94c4-d2fa5b15b035 service nova] [instance: 3855b76f-87cc-4be0-982c-4cc5cf5cd8aa] Refreshing network info cache for port b7c16d4a-24b4-4ba6-860a-d180123dd204 {{(pid=72382) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 15:44:28 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:44:28 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-5421b32a-2634-485b-ac57-e07bf145ea5c tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Acquiring lock "3855b76f-87cc-4be0-982c-4cc5cf5cd8aa" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:44:28 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-5421b32a-2634-485b-ac57-e07bf145ea5c tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Lock "3855b76f-87cc-4be0-982c-4cc5cf5cd8aa" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:44:28 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-5421b32a-2634-485b-ac57-e07bf145ea5c tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Acquiring lock "3855b76f-87cc-4be0-982c-4cc5cf5cd8aa-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:44:28 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-5421b32a-2634-485b-ac57-e07bf145ea5c tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Lock "3855b76f-87cc-4be0-982c-4cc5cf5cd8aa-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:44:28 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-5421b32a-2634-485b-ac57-e07bf145ea5c tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Lock "3855b76f-87cc-4be0-982c-4cc5cf5cd8aa-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:44:28 user nova-compute[72382]: INFO nova.compute.manager [None req-5421b32a-2634-485b-ac57-e07bf145ea5c tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: 3855b76f-87cc-4be0-982c-4cc5cf5cd8aa] Terminating instance
Aug 09 15:44:28 user nova-compute[72382]: DEBUG nova.compute.manager [None req-5421b32a-2634-485b-ac57-e07bf145ea5c tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: 3855b76f-87cc-4be0-982c-4cc5cf5cd8aa] Start destroying the instance on the hypervisor. {{(pid=72382) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 15:44:28 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:44:28 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:44:28 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:44:28 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:44:28 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:44:29 user nova-compute[72382]: DEBUG nova.network.neutron [req-ebe39ed8-2ba7-476e-bd19-8788357e5b7d req-dca34e89-835a-4b49-94c4-d2fa5b15b035 service nova] [instance: 3855b76f-87cc-4be0-982c-4cc5cf5cd8aa] Updated VIF entry in instance network info cache for port b7c16d4a-24b4-4ba6-860a-d180123dd204. {{(pid=72382) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 15:44:29 user nova-compute[72382]: DEBUG nova.network.neutron [req-ebe39ed8-2ba7-476e-bd19-8788357e5b7d req-dca34e89-835a-4b49-94c4-d2fa5b15b035 service nova] [instance: 3855b76f-87cc-4be0-982c-4cc5cf5cd8aa] Updating instance_info_cache with network_info: [{"id": "b7c16d4a-24b4-4ba6-860a-d180123dd204", "address": "fa:16:3e:01:6f:fa", "network": {"id": "a78e6cb6-feb7-4f64-a3c0-4900594b6e37", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-338007968-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70310b1af40b4d239fe5ea362972554b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7c16d4a-24", "ovs_interfaceid": "b7c16d4a-24b4-4ba6-860a-d180123dd204", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:44:29 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-ebe39ed8-2ba7-476e-bd19-8788357e5b7d req-dca34e89-835a-4b49-94c4-d2fa5b15b035 service nova] Releasing lock "refresh_cache-3855b76f-87cc-4be0-982c-4cc5cf5cd8aa" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 15:44:29 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:44:29 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:44:29 user nova-compute[72382]: INFO nova.virt.libvirt.driver [-] [instance: 3855b76f-87cc-4be0-982c-4cc5cf5cd8aa] Instance destroyed successfully.
Aug 09 15:44:29 user nova-compute[72382]: DEBUG nova.objects.instance [None req-5421b32a-2634-485b-ac57-e07bf145ea5c tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Lazy-loading 'resources' on Instance uuid 3855b76f-87cc-4be0-982c-4cc5cf5cd8aa {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:44:29 user nova-compute[72382]: DEBUG nova.virt.libvirt.vif [None req-5421b32a-2634-485b-ac57-e07bf145ea5c tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T15:39:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-384154320',display_name='tempest-TestVolumeBootPattern-server-384154320',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-384154320',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE2Ft4ugcR+xm9FJQARVlCQBYm313gUcmopkZOKz9jwU+uIeLmDWZczJQzSvB2hHfGE3d6cxNwerl6nmxRdqMq6zUG8hCLpv56gJB1tj7Wzv5bBbh5m7r3DF8/P9Gg51AA==',key_name='tempest-TestVolumeBootPattern-1990844198',keypairs=<?>,launch_index=0,launched_at=2023-08-09T15:39:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='70310b1af40b4d239fe5ea362972554b',ramdisk_id='',reservation_id='r-j7vw3np4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-451643589',owner_user_name='tempest-TestVolumeBootPattern-451643589-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T15:39:45Z,user_data=None,user_id='280bcf2afd7245a7bcd605e0db79c569',uuid=3855b76f-87cc-4be0-982c-4cc5cf5cd8aa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b7c16d4a-24b4-4ba6-860a-d180123dd204", "address": "fa:16:3e:01:6f:fa", "network": {"id": "a78e6cb6-feb7-4f64-a3c0-4900594b6e37", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-338007968-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70310b1af40b4d239fe5ea362972554b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7c16d4a-24", "ovs_interfaceid": "b7c16d4a-24b4-4ba6-860a-d180123dd204", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 15:44:29 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-5421b32a-2634-485b-ac57-e07bf145ea5c tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Converting VIF {"id": "b7c16d4a-24b4-4ba6-860a-d180123dd204", "address": "fa:16:3e:01:6f:fa", "network": {"id": "a78e6cb6-feb7-4f64-a3c0-4900594b6e37", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-338007968-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70310b1af40b4d239fe5ea362972554b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7c16d4a-24", "ovs_interfaceid": "b7c16d4a-24b4-4ba6-860a-d180123dd204", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 15:44:29 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-5421b32a-2634-485b-ac57-e07bf145ea5c tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:01:6f:fa,bridge_name='br-int',has_traffic_filtering=True,id=b7c16d4a-24b4-4ba6-860a-d180123dd204,network=Network(a78e6cb6-feb7-4f64-a3c0-4900594b6e37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7c16d4a-24') {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 15:44:29 user nova-compute[72382]: DEBUG os_vif [None req-5421b32a-2634-485b-ac57-e07bf145ea5c tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:01:6f:fa,bridge_name='br-int',has_traffic_filtering=True,id=b7c16d4a-24b4-4ba6-860a-d180123dd204,network=Network(a78e6cb6-feb7-4f64-a3c0-4900594b6e37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7c16d4a-24') {{(pid=72382) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 15:44:29 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:44:29 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb7c16d4a-24, bridge=br-int, if_exists=True) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:44:29 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:44:29 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:44:29 user nova-compute[72382]: INFO os_vif [None req-5421b32a-2634-485b-ac57-e07bf145ea5c tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:01:6f:fa,bridge_name='br-int',has_traffic_filtering=True,id=b7c16d4a-24b4-4ba6-860a-d180123dd204,network=Network(a78e6cb6-feb7-4f64-a3c0-4900594b6e37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7c16d4a-24')
Aug 09 15:44:29 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5421b32a-2634-485b-ac57-e07bf145ea5c tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: 3855b76f-87cc-4be0-982c-4cc5cf5cd8aa] calling os-brick to detach iSCSI Volume {{(pid=72382) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 15:44:29 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-5421b32a-2634-485b-ac57-e07bf145ea5c tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2a0c768340>, {'target_iqns': ['iqn.2010-10.org.openstack:3f58579c-f69a-4bee-b16e-970e5a8f590c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sJYkmfxN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 15:44:29 user nova-compute[72382]: WARNING os_brick.initiator.connectors.base [None req-5421b32a-2634-485b-ac57-e07bf145ea5c tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 15:44:29 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-5421b32a-2634-485b-ac57-e07bf145ea5c tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 15:44:29 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-5421b32a-2634-485b-ac57-e07bf145ea5c tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 15:44:29 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-5421b32a-2634-485b-ac57-e07bf145ea5c tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3f58579c-f69a-4bee-b16e-970e5a8f590c', 0)] {{(pid=72382) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 15:44:29 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:44:29 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.042s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:44:29 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2471553-ccda-464d-8779-96f806af93c3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3f58579c-f69a-4bee-b16e-970e5a8f590c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9503780b-a02c-404a-986e-922be3e3f527\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:44:29 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:44:29 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:44:29 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a725391-61c0-4892-8beb-bd769f277146]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f58579c-f69a-4bee-b16e-970e5a8f590c (non-flash)\ntcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9503780b-a02c-404a-986e-922be3e3f527 (non-flash)\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:44:29 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-5421b32a-2634-485b-ac57-e07bf145ea5c tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f58579c-f69a-4bee-b16e-970e5a8f590c (non-flash)
Aug 09 15:44:29 user nova-compute[72382]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9503780b-a02c-404a-986e-922be3e3f527 (non-flash)
Aug 09 15:44:29 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 15:44:29 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-5421b32a-2634-485b-ac57-e07bf145ea5c tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f58579c-f69a-4bee-b16e-970e5a8f590c (non-flash)
Aug 09 15:44:29 user nova-compute[72382]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9503780b-a02c-404a-986e-922be3e3f527 (non-flash)
Aug 09 15:44:29 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 15:44:29 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-5421b32a-2634-485b-ac57-e07bf145ea5c tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2a0c1c6290>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3f58579c-f69a-4bee-b16e-970e5a8f590c'): ({'sdb'}, set())}) {{(pid=72382) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 15:44:29 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-5421b32a-2634-485b-ac57-e07bf145ea5c tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Removing single pathed devices sdb {{(pid=72382) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 15:44:29 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:44:29 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:44:29 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[40854589-6416-42c6-9de5-07123751e00d]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:44:29 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:44:29 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:44:29 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[45113b90-e392-4531-b6e5-ec256d0ffdd5]: (4, ('ok\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:44:29 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-5421b32a-2634-485b-ac57-e07bf145ea5c tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Flushing IO for device /dev/sdb {{(pid=72382) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 15:44:29 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:44:29 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:44:29 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[83acf66e-fd44-4339-b5d3-8f7ed040ca56]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:44:29 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-5421b32a-2634-485b-ac57-e07bf145ea5c tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72382) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 15:44:29 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:44:29 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.055s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:44:29 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[57f97bf9-1561-431b-8a22-6293ff512b2e]: (4, ('1', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:44:29 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-5421b32a-2634-485b-ac57-e07bf145ea5c tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72382) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 15:44:29 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-5421b32a-2634-485b-ac57-e07bf145ea5c tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] SCSI volumes sdb have been removed. {{(pid=72382) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 15:44:29 user nova-compute[72382]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO2ea97126-4a20ca848fe7dcec', '/dev/disk/by-id/scsi-23461323063613834', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_2ea97126') {{(pid=83725) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Aug 09 15:44:29 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[f000da79-edc3-44af-8ac1-f4ab99be18c4]: (4, None) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:44:29 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-5421b32a-2634-485b-ac57-e07bf145ea5c tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3f58579c-f69a-4bee-b16e-970e5a8f590c')] {{(pid=72382) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 15:44:29 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f58579c-f69a-4bee-b16e-970e5a8f590c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:44:29 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f58579c-f69a-4bee-b16e-970e5a8f590c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:44:29 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[98c5befc-9f59-4704-9a6e-ce19688c517c]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:44:29 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-5421b32a-2634-485b-ac57-e07bf145ea5c tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:44:29 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f58579c-f69a-4bee-b16e-970e5a8f590c -p 172.16.0.220:3260 --logout {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:44:29 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f58579c-f69a-4bee-b16e-970e5a8f590c -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:44:29 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[abe817ca-9c94-4ad1-9f10-c88803186ec3]: (4, ('Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:3f58579c-f69a-4bee-b16e-970e5a8f590c, portal: 172.16.0.220,3260]\nLogout of [sid: 55, target: iqn.2010-10.org.openstack:3f58579c-f69a-4bee-b16e-970e5a8f590c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:44:29 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-5421b32a-2634-485b-ac57-e07bf145ea5c tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:3f58579c-f69a-4bee-b16e-970e5a8f590c, portal: 172.16.0.220,3260]
Aug 09 15:44:29 user nova-compute[72382]: Logout of [sid: 55, target: iqn.2010-10.org.openstack:3f58579c-f69a-4bee-b16e-970e5a8f590c, portal: 172.16.0.220,3260] successful.
Aug 09 15:44:29 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:44:29 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f58579c-f69a-4bee-b16e-970e5a8f590c -p 172.16.0.220:3260 --op delete {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:44:29 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f58579c-f69a-4bee-b16e-970e5a8f590c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:44:29 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb5cba85-1c3c-4ea7-8c70-7c30dc8b6e86]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:44:29 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-5421b32a-2634-485b-ac57-e07bf145ea5c tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:44:29 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-5421b32a-2634-485b-ac57-e07bf145ea5c tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.335s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 15:44:29 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-5421b32a-2634-485b-ac57-e07bf145ea5c tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] <== disconnect_volume: return (337ms) None {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 15:44:29 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5421b32a-2634-485b-ac57-e07bf145ea5c tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: 3855b76f-87cc-4be0-982c-4cc5cf5cd8aa] Disconnected iSCSI Volume {{(pid=72382) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 15:44:29 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-5421b32a-2634-485b-ac57-e07bf145ea5c tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: 3855b76f-87cc-4be0-982c-4cc5cf5cd8aa] Deleting instance files /opt/stack/data/nova/instances/3855b76f-87cc-4be0-982c-4cc5cf5cd8aa_del
Aug 09 15:44:29 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-5421b32a-2634-485b-ac57-e07bf145ea5c tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: 3855b76f-87cc-4be0-982c-4cc5cf5cd8aa] Deletion of /opt/stack/data/nova/instances/3855b76f-87cc-4be0-982c-4cc5cf5cd8aa_del complete
Aug 09 15:44:29 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:44:29 user nova-compute[72382]: DEBUG nova.compute.manager [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Starting heal instance info cache {{(pid=72382) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 15:44:29 user nova-compute[72382]: DEBUG nova.compute.manager [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Rebuilding the list of instances to heal {{(pid=72382) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 09 15:44:29 user nova-compute[72382]: DEBUG nova.compute.manager [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] [instance: 3855b76f-87cc-4be0-982c-4cc5cf5cd8aa] Skipping network cache update for instance because it is being deleted. {{(pid=72382) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9859}}
Aug 09 15:44:30 user nova-compute[72382]: INFO nova.compute.manager [None req-5421b32a-2634-485b-ac57-e07bf145ea5c tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: 3855b76f-87cc-4be0-982c-4cc5cf5cd8aa] Took 1.33 seconds to destroy the instance on the hypervisor.
Aug 09 15:44:30 user nova-compute[72382]: DEBUG oslo.service.loopingcall [None req-5421b32a-2634-485b-ac57-e07bf145ea5c tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72382) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 15:44:30 user nova-compute[72382]: DEBUG nova.compute.manager [-] [instance: 3855b76f-87cc-4be0-982c-4cc5cf5cd8aa] Deallocating network for instance {{(pid=72382) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 15:44:30 user nova-compute[72382]: DEBUG nova.network.neutron [-] [instance: 3855b76f-87cc-4be0-982c-4cc5cf5cd8aa] deallocate_for_instance() {{(pid=72382) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 15:44:30 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:44:30 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Acquiring lock "refresh_cache-4d27c5a4-9a88-423b-9c48-9224e8248f8c" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 15:44:30 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Acquired lock "refresh_cache-4d27c5a4-9a88-423b-9c48-9224e8248f8c" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 15:44:30 user nova-compute[72382]: DEBUG nova.network.neutron [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] [instance: 4d27c5a4-9a88-423b-9c48-9224e8248f8c] Forcefully refreshing network info cache for instance {{(pid=72382) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 15:44:30 user nova-compute[72382]: DEBUG nova.objects.instance [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lazy-loading 'info_cache' on Instance uuid 4d27c5a4-9a88-423b-9c48-9224e8248f8c {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:44:30 user nova-compute[72382]: DEBUG nova.compute.manager [req-ebebbebc-ceab-4a0c-bccf-c4d10fb1a00f req-c343673d-0540-422d-ad16-d61c125cc9ca service nova] [instance: 3855b76f-87cc-4be0-982c-4cc5cf5cd8aa] Received event network-vif-unplugged-b7c16d4a-24b4-4ba6-860a-d180123dd204 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:44:30 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-ebebbebc-ceab-4a0c-bccf-c4d10fb1a00f req-c343673d-0540-422d-ad16-d61c125cc9ca service nova] Acquiring lock "3855b76f-87cc-4be0-982c-4cc5cf5cd8aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:44:30 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-ebebbebc-ceab-4a0c-bccf-c4d10fb1a00f req-c343673d-0540-422d-ad16-d61c125cc9ca service nova] Lock "3855b76f-87cc-4be0-982c-4cc5cf5cd8aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:44:30 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-ebebbebc-ceab-4a0c-bccf-c4d10fb1a00f req-c343673d-0540-422d-ad16-d61c125cc9ca service nova] Lock "3855b76f-87cc-4be0-982c-4cc5cf5cd8aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:44:30 user nova-compute[72382]: DEBUG nova.compute.manager [req-ebebbebc-ceab-4a0c-bccf-c4d10fb1a00f req-c343673d-0540-422d-ad16-d61c125cc9ca service nova] [instance: 3855b76f-87cc-4be0-982c-4cc5cf5cd8aa] No waiting events found dispatching network-vif-unplugged-b7c16d4a-24b4-4ba6-860a-d180123dd204 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:44:30 user nova-compute[72382]: DEBUG nova.compute.manager [req-ebebbebc-ceab-4a0c-bccf-c4d10fb1a00f req-c343673d-0540-422d-ad16-d61c125cc9ca service nova] [instance: 3855b76f-87cc-4be0-982c-4cc5cf5cd8aa] Received event network-vif-unplugged-b7c16d4a-24b4-4ba6-860a-d180123dd204 for instance with task_state deleting. {{(pid=72382) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 15:44:30 user nova-compute[72382]: DEBUG nova.compute.manager [req-ebebbebc-ceab-4a0c-bccf-c4d10fb1a00f req-c343673d-0540-422d-ad16-d61c125cc9ca service nova] [instance: 3855b76f-87cc-4be0-982c-4cc5cf5cd8aa] Received event network-vif-plugged-b7c16d4a-24b4-4ba6-860a-d180123dd204 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:44:30 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-ebebbebc-ceab-4a0c-bccf-c4d10fb1a00f req-c343673d-0540-422d-ad16-d61c125cc9ca service nova] Acquiring lock "3855b76f-87cc-4be0-982c-4cc5cf5cd8aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:44:30 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-ebebbebc-ceab-4a0c-bccf-c4d10fb1a00f req-c343673d-0540-422d-ad16-d61c125cc9ca service nova] Lock "3855b76f-87cc-4be0-982c-4cc5cf5cd8aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:44:30 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-ebebbebc-ceab-4a0c-bccf-c4d10fb1a00f req-c343673d-0540-422d-ad16-d61c125cc9ca service nova] Lock "3855b76f-87cc-4be0-982c-4cc5cf5cd8aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:44:30 user nova-compute[72382]: DEBUG nova.compute.manager [req-ebebbebc-ceab-4a0c-bccf-c4d10fb1a00f req-c343673d-0540-422d-ad16-d61c125cc9ca service nova] [instance: 3855b76f-87cc-4be0-982c-4cc5cf5cd8aa] No waiting events found dispatching network-vif-plugged-b7c16d4a-24b4-4ba6-860a-d180123dd204 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:44:30 user nova-compute[72382]: WARNING nova.compute.manager [req-ebebbebc-ceab-4a0c-bccf-c4d10fb1a00f req-c343673d-0540-422d-ad16-d61c125cc9ca service nova] [instance: 3855b76f-87cc-4be0-982c-4cc5cf5cd8aa] Received unexpected event network-vif-plugged-b7c16d4a-24b4-4ba6-860a-d180123dd204 for instance with vm_state active and task_state deleting.
Aug 09 15:44:31 user nova-compute[72382]: DEBUG nova.network.neutron [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] [instance: 4d27c5a4-9a88-423b-9c48-9224e8248f8c] Updating instance_info_cache with network_info: [{"id": "b14bc813-7a4e-413c-9b5f-4c34080790b6", "address": "fa:16:3e:a6:b1:fa", "network": {"id": "ca2010c6-c431-44c8-8742-22a4fcf15754", "bridge": "br-int", "label": "tempest-TestStampPattern-1529830938-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a826d26871fb474ba904e1550f9ee103", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb14bc813-7a", "ovs_interfaceid": "b14bc813-7a4e-413c-9b5f-4c34080790b6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:44:31 user nova-compute[72382]: DEBUG nova.network.neutron [-] [instance: 3855b76f-87cc-4be0-982c-4cc5cf5cd8aa] Updating instance_info_cache with network_info: [] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:44:31 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Releasing lock "refresh_cache-4d27c5a4-9a88-423b-9c48-9224e8248f8c" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 15:44:31 user nova-compute[72382]: DEBUG nova.compute.manager [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] [instance: 4d27c5a4-9a88-423b-9c48-9224e8248f8c] Updated the network info_cache for instance {{(pid=72382) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 15:44:31 user nova-compute[72382]: INFO nova.compute.manager [-] [instance: 3855b76f-87cc-4be0-982c-4cc5cf5cd8aa] Took 1.11 seconds to deallocate network for instance.
Aug 09 15:44:31 user nova-compute[72382]: DEBUG nova.compute.manager [req-d8396203-e660-4bd3-99a1-0d25244be1ea req-c096aab9-ef01-400d-a7db-cd7634ebbfb7 service nova] [instance: 3855b76f-87cc-4be0-982c-4cc5cf5cd8aa] Received event network-vif-deleted-b7c16d4a-24b4-4ba6-860a-d180123dd204 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:44:31 user nova-compute[72382]: INFO nova.compute.manager [req-d8396203-e660-4bd3-99a1-0d25244be1ea req-c096aab9-ef01-400d-a7db-cd7634ebbfb7 service nova] [instance: 3855b76f-87cc-4be0-982c-4cc5cf5cd8aa] Neutron deleted interface b7c16d4a-24b4-4ba6-860a-d180123dd204; detaching it from the instance and deleting it from the info cache
Aug 09 15:44:31 user nova-compute[72382]: DEBUG nova.network.neutron [req-d8396203-e660-4bd3-99a1-0d25244be1ea req-c096aab9-ef01-400d-a7db-cd7634ebbfb7 service nova] [instance: 3855b76f-87cc-4be0-982c-4cc5cf5cd8aa] Updating instance_info_cache with network_info: [] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:44:31 user nova-compute[72382]: DEBUG nova.compute.manager [req-d8396203-e660-4bd3-99a1-0d25244be1ea req-c096aab9-ef01-400d-a7db-cd7634ebbfb7 service nova] [instance: 3855b76f-87cc-4be0-982c-4cc5cf5cd8aa] Detach interface failed, port_id=b7c16d4a-24b4-4ba6-860a-d180123dd204, reason: Instance 3855b76f-87cc-4be0-982c-4cc5cf5cd8aa could not be found. {{(pid=72382) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 09 15:44:31 user nova-compute[72382]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691595856.1481695, 6cfe9b0a-4ee9-4b4e-a8ac-d492937113ae => Stopped> {{(pid=72382) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 15:44:31 user nova-compute[72382]: INFO nova.compute.manager [-] [instance: 6cfe9b0a-4ee9-4b4e-a8ac-d492937113ae] VM Stopped (Lifecycle Event)
Aug 09 15:44:31 user nova-compute[72382]: DEBUG nova.compute.manager [None req-c939ba64-d101-4168-ae1f-cb817548dcb8 None None] [instance: 6cfe9b0a-4ee9-4b4e-a8ac-d492937113ae] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:44:31 user nova-compute[72382]: INFO nova.compute.manager [None req-5421b32a-2634-485b-ac57-e07bf145ea5c tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] [instance: 3855b76f-87cc-4be0-982c-4cc5cf5cd8aa] Took 0.75 seconds to detach 1 volumes for instance.
Aug 09 15:44:31 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-5421b32a-2634-485b-ac57-e07bf145ea5c tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:44:31 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-5421b32a-2634-485b-ac57-e07bf145ea5c tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:44:32 user nova-compute[72382]: DEBUG nova.compute.provider_tree [None req-5421b32a-2634-485b-ac57-e07bf145ea5c tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Inventory has not changed in ProviderTree for provider: 7b15b0e5-df4d-49db-833b-2855d21d10ae {{(pid=72382) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 15:44:32 user nova-compute[72382]: DEBUG nova.scheduler.client.report [None req-5421b32a-2634-485b-ac57-e07bf145ea5c tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Inventory has not changed for provider 7b15b0e5-df4d-49db-833b-2855d21d10ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72382) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 15:44:32 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-5421b32a-2634-485b-ac57-e07bf145ea5c tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.158s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:44:32 user nova-compute[72382]: INFO nova.scheduler.client.report [None req-5421b32a-2634-485b-ac57-e07bf145ea5c tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Deleted allocations for instance 3855b76f-87cc-4be0-982c-4cc5cf5cd8aa
Aug 09 15:44:32 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-5421b32a-2634-485b-ac57-e07bf145ea5c tempest-TestVolumeBootPattern-451643589 tempest-TestVolumeBootPattern-451643589-project-member] Lock "3855b76f-87cc-4be0-982c-4cc5cf5cd8aa" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.522s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:44:32 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:44:34 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:44:34 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:44:38 user nova-compute[72382]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691595863.5515037, 5c914d94-5bfd-4984-8937-37bdf02e9674 => Stopped> {{(pid=72382) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 15:44:38 user nova-compute[72382]: INFO nova.compute.manager [-] [instance: 5c914d94-5bfd-4984-8937-37bdf02e9674] VM Stopped (Lifecycle Event)
Aug 09 15:44:38 user nova-compute[72382]: DEBUG nova.compute.manager [None req-090b43e8-1343-4c70-9a46-20ab9f0124b4 None None] [instance: 5c914d94-5bfd-4984-8937-37bdf02e9674] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:44:39 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:44:40 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:44:44 user nova-compute[72382]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691595869.4230695, 3855b76f-87cc-4be0-982c-4cc5cf5cd8aa => Stopped> {{(pid=72382) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 15:44:44 user nova-compute[72382]: INFO nova.compute.manager [-] [instance: 3855b76f-87cc-4be0-982c-4cc5cf5cd8aa] VM Stopped (Lifecycle Event)
Aug 09 15:44:44 user nova-compute[72382]: DEBUG nova.compute.manager [None req-97880cc6-457e-4740-ade1-ec87b00e69f9 None None] [instance: 3855b76f-87cc-4be0-982c-4cc5cf5cd8aa] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:44:44 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:44:45 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:44:49 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:44:50 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:44:54 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:44:55 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:44:59 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:45:00 user nova-compute[72382]: DEBUG nova.compute.manager [None req-74b6f569-b3d0-411c-a4f2-16db159cb03b tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] [instance: 4d27c5a4-9a88-423b-9c48-9224e8248f8c] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:45:00 user nova-compute[72382]: INFO nova.compute.manager [None req-74b6f569-b3d0-411c-a4f2-16db159cb03b tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] [instance: 4d27c5a4-9a88-423b-9c48-9224e8248f8c] instance snapshotting
Aug 09 15:45:00 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-74b6f569-b3d0-411c-a4f2-16db159cb03b tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] [instance: 4d27c5a4-9a88-423b-9c48-9224e8248f8c] Beginning live snapshot process
Aug 09 15:45:00 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-74b6f569-b3d0-411c-a4f2-16db159cb03b tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d27c5a4-9a88-423b-9c48-9224e8248f8c/disk --force-share --output=json -f qcow2 {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:45:00 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-74b6f569-b3d0-411c-a4f2-16db159cb03b tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d27c5a4-9a88-423b-9c48-9224e8248f8c/disk --force-share --output=json -f qcow2" returned: 0 in 0.139s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:45:00 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-74b6f569-b3d0-411c-a4f2-16db159cb03b tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d27c5a4-9a88-423b-9c48-9224e8248f8c/disk --force-share --output=json -f qcow2 {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:45:00 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-74b6f569-b3d0-411c-a4f2-16db159cb03b tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d27c5a4-9a88-423b-9c48-9224e8248f8c/disk --force-share --output=json -f qcow2" returned: 0 in 0.140s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:45:00 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-74b6f569-b3d0-411c-a4f2-16db159cb03b tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:45:00 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-74b6f569-b3d0-411c-a4f2-16db159cb03b tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b --force-share --output=json" returned: 0 in 0.133s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:45:00 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-74b6f569-b3d0-411c-a4f2-16db159cb03b tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpvie4g4xs/a9a66293c81d4b87a9d23c0039f5ae4c.delta 1073741824 {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:45:01 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-74b6f569-b3d0-411c-a4f2-16db159cb03b tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpvie4g4xs/a9a66293c81d4b87a9d23c0039f5ae4c.delta 1073741824" returned: 0 in 0.055s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:45:01 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-74b6f569-b3d0-411c-a4f2-16db159cb03b tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] [instance: 4d27c5a4-9a88-423b-9c48-9224e8248f8c] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 09 15:45:01 user nova-compute[72382]: DEBUG nova.virt.libvirt.guest [None req-74b6f569-b3d0-411c-a4f2-16db159cb03b tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=72382) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 09 15:45:02 user nova-compute[72382]: DEBUG nova.virt.libvirt.guest [None req-74b6f569-b3d0-411c-a4f2-16db159cb03b tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=72382) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 09 15:45:02 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-74b6f569-b3d0-411c-a4f2-16db159cb03b tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] [instance: 4d27c5a4-9a88-423b-9c48-9224e8248f8c] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 09 15:45:02 user nova-compute[72382]: DEBUG nova.privsep.utils [None req-74b6f569-b3d0-411c-a4f2-16db159cb03b tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72382) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 09 15:45:02 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-74b6f569-b3d0-411c-a4f2-16db159cb03b tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpvie4g4xs/a9a66293c81d4b87a9d23c0039f5ae4c.delta /opt/stack/data/nova/instances/snapshots/tmpvie4g4xs/a9a66293c81d4b87a9d23c0039f5ae4c {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:45:03 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-74b6f569-b3d0-411c-a4f2-16db159cb03b tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpvie4g4xs/a9a66293c81d4b87a9d23c0039f5ae4c.delta /opt/stack/data/nova/instances/snapshots/tmpvie4g4xs/a9a66293c81d4b87a9d23c0039f5ae4c" returned: 0 in 0.660s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:45:03 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-74b6f569-b3d0-411c-a4f2-16db159cb03b tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] [instance: 4d27c5a4-9a88-423b-9c48-9224e8248f8c] Snapshot extracted, beginning image upload
Aug 09 15:45:04 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:45:05 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-74b6f569-b3d0-411c-a4f2-16db159cb03b tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] [instance: 4d27c5a4-9a88-423b-9c48-9224e8248f8c] Snapshot image upload complete
Aug 09 15:45:05 user nova-compute[72382]: INFO nova.compute.manager [None req-74b6f569-b3d0-411c-a4f2-16db159cb03b tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] [instance: 4d27c5a4-9a88-423b-9c48-9224e8248f8c] Took 5.22 seconds to snapshot the instance on the hypervisor.
Aug 09 15:45:08 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-50ef47fb-9ba7-401d-8ff3-d3bccd05c0b2 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] Acquiring lock "fe1af384-aa97-4c21-8440-8b0ebb711d50" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:45:08 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-50ef47fb-9ba7-401d-8ff3-d3bccd05c0b2 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] Lock "fe1af384-aa97-4c21-8440-8b0ebb711d50" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:45:08 user nova-compute[72382]: DEBUG nova.compute.manager [None req-50ef47fb-9ba7-401d-8ff3-d3bccd05c0b2 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] [instance: fe1af384-aa97-4c21-8440-8b0ebb711d50] Starting instance... {{(pid=72382) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 15:45:08 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-50ef47fb-9ba7-401d-8ff3-d3bccd05c0b2 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:45:08 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-50ef47fb-9ba7-401d-8ff3-d3bccd05c0b2 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:45:08 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-50ef47fb-9ba7-401d-8ff3-d3bccd05c0b2 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72382) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 15:45:08 user nova-compute[72382]: INFO nova.compute.claims [None req-50ef47fb-9ba7-401d-8ff3-d3bccd05c0b2 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] [instance: fe1af384-aa97-4c21-8440-8b0ebb711d50] Claim successful on node user
Aug 09 15:45:08 user nova-compute[72382]: DEBUG nova.compute.provider_tree [None req-50ef47fb-9ba7-401d-8ff3-d3bccd05c0b2 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] Inventory has not changed in ProviderTree for provider: 7b15b0e5-df4d-49db-833b-2855d21d10ae {{(pid=72382) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 15:45:08 user nova-compute[72382]: DEBUG nova.scheduler.client.report [None req-50ef47fb-9ba7-401d-8ff3-d3bccd05c0b2 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] Inventory has not changed for provider 7b15b0e5-df4d-49db-833b-2855d21d10ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72382) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 15:45:08 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-50ef47fb-9ba7-401d-8ff3-d3bccd05c0b2 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.349s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:45:08 user nova-compute[72382]: DEBUG nova.compute.manager [None req-50ef47fb-9ba7-401d-8ff3-d3bccd05c0b2 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] [instance: fe1af384-aa97-4c21-8440-8b0ebb711d50] Start building networks asynchronously for instance. {{(pid=72382) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 15:45:08 user nova-compute[72382]: DEBUG nova.compute.manager [None req-50ef47fb-9ba7-401d-8ff3-d3bccd05c0b2 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] [instance: fe1af384-aa97-4c21-8440-8b0ebb711d50] Allocating IP information in the background. {{(pid=72382) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 15:45:08 user nova-compute[72382]: DEBUG nova.network.neutron [None req-50ef47fb-9ba7-401d-8ff3-d3bccd05c0b2 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] [instance: fe1af384-aa97-4c21-8440-8b0ebb711d50] allocate_for_instance() {{(pid=72382) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 15:45:08 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-50ef47fb-9ba7-401d-8ff3-d3bccd05c0b2 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] [instance: fe1af384-aa97-4c21-8440-8b0ebb711d50] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 15:45:08 user nova-compute[72382]: DEBUG nova.compute.manager [None req-50ef47fb-9ba7-401d-8ff3-d3bccd05c0b2 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] [instance: fe1af384-aa97-4c21-8440-8b0ebb711d50] Start building block device mappings for instance. {{(pid=72382) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 15:45:08 user nova-compute[72382]: DEBUG nova.policy [None req-50ef47fb-9ba7-401d-8ff3-d3bccd05c0b2 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '273d16c265ae4868a371889eae528d02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826d26871fb474ba904e1550f9ee103', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72382) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 15:45:08 user nova-compute[72382]: DEBUG nova.compute.manager [None req-50ef47fb-9ba7-401d-8ff3-d3bccd05c0b2 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] [instance: fe1af384-aa97-4c21-8440-8b0ebb711d50] Start spawning the instance on the hypervisor. {{(pid=72382) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 15:45:08 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-50ef47fb-9ba7-401d-8ff3-d3bccd05c0b2 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] [instance: fe1af384-aa97-4c21-8440-8b0ebb711d50] Creating instance directory {{(pid=72382) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 15:45:08 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-50ef47fb-9ba7-401d-8ff3-d3bccd05c0b2 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] [instance: fe1af384-aa97-4c21-8440-8b0ebb711d50] Creating image(s)
Aug 09 15:45:08 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-50ef47fb-9ba7-401d-8ff3-d3bccd05c0b2 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] Acquiring lock "/opt/stack/data/nova/instances/fe1af384-aa97-4c21-8440-8b0ebb711d50/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:45:08 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-50ef47fb-9ba7-401d-8ff3-d3bccd05c0b2 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] Lock "/opt/stack/data/nova/instances/fe1af384-aa97-4c21-8440-8b0ebb711d50/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:45:08 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-50ef47fb-9ba7-401d-8ff3-d3bccd05c0b2 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] Lock "/opt/stack/data/nova/instances/fe1af384-aa97-4c21-8440-8b0ebb711d50/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:45:08 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-50ef47fb-9ba7-401d-8ff3-d3bccd05c0b2 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] Acquiring lock "fa19097ff9efd459c9bd1dd3a1c694bbd3a9f791" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:45:08 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-50ef47fb-9ba7-401d-8ff3-d3bccd05c0b2 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] Lock "fa19097ff9efd459c9bd1dd3a1c694bbd3a9f791" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:45:09 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-50ef47fb-9ba7-401d-8ff3-d3bccd05c0b2 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa19097ff9efd459c9bd1dd3a1c694bbd3a9f791.part --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:45:09 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:45:09 user nova-compute[72382]: DEBUG nova.network.neutron [None req-50ef47fb-9ba7-401d-8ff3-d3bccd05c0b2 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] [instance: fe1af384-aa97-4c21-8440-8b0ebb711d50] Successfully created port: 2e30f2fa-a90a-4b8d-adbf-d428a802fd0f {{(pid=72382) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 15:45:09 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-50ef47fb-9ba7-401d-8ff3-d3bccd05c0b2 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa19097ff9efd459c9bd1dd3a1c694bbd3a9f791.part --force-share --output=json" returned: 0 in 0.163s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:45:09 user nova-compute[72382]: DEBUG nova.virt.images [None req-50ef47fb-9ba7-401d-8ff3-d3bccd05c0b2 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] 31ab184b-ee75-44d1-ba85-f61c03de5eba was qcow2, converting to raw {{(pid=72382) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 09 15:45:09 user nova-compute[72382]: DEBUG nova.privsep.utils [None req-50ef47fb-9ba7-401d-8ff3-d3bccd05c0b2 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72382) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 09 15:45:09 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-50ef47fb-9ba7-401d-8ff3-d3bccd05c0b2 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/fa19097ff9efd459c9bd1dd3a1c694bbd3a9f791.part /opt/stack/data/nova/instances/_base/fa19097ff9efd459c9bd1dd3a1c694bbd3a9f791.converted {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:45:11 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-50ef47fb-9ba7-401d-8ff3-d3bccd05c0b2 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/fa19097ff9efd459c9bd1dd3a1c694bbd3a9f791.part /opt/stack/data/nova/instances/_base/fa19097ff9efd459c9bd1dd3a1c694bbd3a9f791.converted" returned: 0 in 1.174s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:45:11 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-50ef47fb-9ba7-401d-8ff3-d3bccd05c0b2 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa19097ff9efd459c9bd1dd3a1c694bbd3a9f791.converted --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:45:11 user nova-compute[72382]: DEBUG nova.network.neutron [None req-50ef47fb-9ba7-401d-8ff3-d3bccd05c0b2 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] [instance: fe1af384-aa97-4c21-8440-8b0ebb711d50] Successfully updated port: 2e30f2fa-a90a-4b8d-adbf-d428a802fd0f {{(pid=72382) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 15:45:11 user nova-compute[72382]: DEBUG nova.compute.manager [req-ae8efee2-6dad-4f73-82d1-5ae6efaa1ff4 req-86ed3111-7a59-47fe-a3d0-822b84cdc2d1 service nova] [instance: fe1af384-aa97-4c21-8440-8b0ebb711d50] Received event network-changed-2e30f2fa-a90a-4b8d-adbf-d428a802fd0f {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:45:11 user nova-compute[72382]: DEBUG nova.compute.manager [req-ae8efee2-6dad-4f73-82d1-5ae6efaa1ff4 req-86ed3111-7a59-47fe-a3d0-822b84cdc2d1 service nova] [instance: fe1af384-aa97-4c21-8440-8b0ebb711d50] Refreshing instance network info cache due to event network-changed-2e30f2fa-a90a-4b8d-adbf-d428a802fd0f. {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 15:45:11 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-ae8efee2-6dad-4f73-82d1-5ae6efaa1ff4 req-86ed3111-7a59-47fe-a3d0-822b84cdc2d1 service nova] Acquiring lock "refresh_cache-fe1af384-aa97-4c21-8440-8b0ebb711d50" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 15:45:11 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-ae8efee2-6dad-4f73-82d1-5ae6efaa1ff4 req-86ed3111-7a59-47fe-a3d0-822b84cdc2d1 service nova] Acquired lock "refresh_cache-fe1af384-aa97-4c21-8440-8b0ebb711d50" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 15:45:11 user nova-compute[72382]: DEBUG nova.network.neutron [req-ae8efee2-6dad-4f73-82d1-5ae6efaa1ff4 req-86ed3111-7a59-47fe-a3d0-822b84cdc2d1 service nova] [instance: fe1af384-aa97-4c21-8440-8b0ebb711d50] Refreshing network info cache for port 2e30f2fa-a90a-4b8d-adbf-d428a802fd0f {{(pid=72382) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 15:45:11 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-50ef47fb-9ba7-401d-8ff3-d3bccd05c0b2 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] Acquiring lock "refresh_cache-fe1af384-aa97-4c21-8440-8b0ebb711d50" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 15:45:11 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-50ef47fb-9ba7-401d-8ff3-d3bccd05c0b2 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa19097ff9efd459c9bd1dd3a1c694bbd3a9f791.converted --force-share --output=json" returned: 0 in 0.150s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:45:11 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-50ef47fb-9ba7-401d-8ff3-d3bccd05c0b2 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] Lock "fa19097ff9efd459c9bd1dd3a1c694bbd3a9f791" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.341s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:45:11 user nova-compute[72382]: DEBUG nova.network.neutron [req-ae8efee2-6dad-4f73-82d1-5ae6efaa1ff4 req-86ed3111-7a59-47fe-a3d0-822b84cdc2d1 service nova] [instance: fe1af384-aa97-4c21-8440-8b0ebb711d50] Instance cache missing network info. {{(pid=72382) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 15:45:11 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-50ef47fb-9ba7-401d-8ff3-d3bccd05c0b2 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa19097ff9efd459c9bd1dd3a1c694bbd3a9f791 --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:45:11 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-50ef47fb-9ba7-401d-8ff3-d3bccd05c0b2 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa19097ff9efd459c9bd1dd3a1c694bbd3a9f791 --force-share --output=json" returned: 0 in 0.175s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:45:11 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-50ef47fb-9ba7-401d-8ff3-d3bccd05c0b2 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] Acquiring lock "fa19097ff9efd459c9bd1dd3a1c694bbd3a9f791" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:45:11 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-50ef47fb-9ba7-401d-8ff3-d3bccd05c0b2 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] Lock "fa19097ff9efd459c9bd1dd3a1c694bbd3a9f791" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:45:11 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-50ef47fb-9ba7-401d-8ff3-d3bccd05c0b2 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa19097ff9efd459c9bd1dd3a1c694bbd3a9f791 --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:45:11 user nova-compute[72382]: DEBUG nova.network.neutron [req-ae8efee2-6dad-4f73-82d1-5ae6efaa1ff4 req-86ed3111-7a59-47fe-a3d0-822b84cdc2d1 service nova] [instance: fe1af384-aa97-4c21-8440-8b0ebb711d50] Updating instance_info_cache with network_info: [] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:45:11 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-ae8efee2-6dad-4f73-82d1-5ae6efaa1ff4 req-86ed3111-7a59-47fe-a3d0-822b84cdc2d1 service nova] Releasing lock "refresh_cache-fe1af384-aa97-4c21-8440-8b0ebb711d50" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 15:45:11 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-50ef47fb-9ba7-401d-8ff3-d3bccd05c0b2 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] Acquired lock "refresh_cache-fe1af384-aa97-4c21-8440-8b0ebb711d50" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 15:45:11 user nova-compute[72382]: DEBUG nova.network.neutron [None req-50ef47fb-9ba7-401d-8ff3-d3bccd05c0b2 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] [instance: fe1af384-aa97-4c21-8440-8b0ebb711d50] Building network info cache for instance {{(pid=72382) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 15:45:11 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-50ef47fb-9ba7-401d-8ff3-d3bccd05c0b2 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa19097ff9efd459c9bd1dd3a1c694bbd3a9f791 --force-share --output=json" returned: 0 in 0.194s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:45:11 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-50ef47fb-9ba7-401d-8ff3-d3bccd05c0b2 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fa19097ff9efd459c9bd1dd3a1c694bbd3a9f791,backing_fmt=raw /opt/stack/data/nova/instances/fe1af384-aa97-4c21-8440-8b0ebb711d50/disk 1073741824 {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:45:11 user nova-compute[72382]: DEBUG nova.network.neutron [None req-50ef47fb-9ba7-401d-8ff3-d3bccd05c0b2 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] [instance: fe1af384-aa97-4c21-8440-8b0ebb711d50] Instance cache missing network info. {{(pid=72382) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 15:45:11 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-50ef47fb-9ba7-401d-8ff3-d3bccd05c0b2 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fa19097ff9efd459c9bd1dd3a1c694bbd3a9f791,backing_fmt=raw /opt/stack/data/nova/instances/fe1af384-aa97-4c21-8440-8b0ebb711d50/disk 1073741824" returned: 0 in 0.083s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:45:11 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-50ef47fb-9ba7-401d-8ff3-d3bccd05c0b2 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] Lock "fa19097ff9efd459c9bd1dd3a1c694bbd3a9f791" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.281s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:45:11 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-50ef47fb-9ba7-401d-8ff3-d3bccd05c0b2 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa19097ff9efd459c9bd1dd3a1c694bbd3a9f791 --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:45:11 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-50ef47fb-9ba7-401d-8ff3-d3bccd05c0b2 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa19097ff9efd459c9bd1dd3a1c694bbd3a9f791 --force-share --output=json" returned: 0 in 0.147s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:45:11 user nova-compute[72382]: DEBUG nova.objects.instance [None req-50ef47fb-9ba7-401d-8ff3-d3bccd05c0b2 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] Lazy-loading 'migration_context' on Instance uuid fe1af384-aa97-4c21-8440-8b0ebb711d50 {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:45:11 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-50ef47fb-9ba7-401d-8ff3-d3bccd05c0b2 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] [instance: fe1af384-aa97-4c21-8440-8b0ebb711d50] Created local disks {{(pid=72382) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 15:45:11 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-50ef47fb-9ba7-401d-8ff3-d3bccd05c0b2 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] [instance: fe1af384-aa97-4c21-8440-8b0ebb711d50] Ensure instance console log exists: /opt/stack/data/nova/instances/fe1af384-aa97-4c21-8440-8b0ebb711d50/console.log {{(pid=72382) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 15:45:11 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-50ef47fb-9ba7-401d-8ff3-d3bccd05c0b2 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:45:11 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-50ef47fb-9ba7-401d-8ff3-d3bccd05c0b2 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:45:11 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-50ef47fb-9ba7-401d-8ff3-d3bccd05c0b2 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:45:12 user nova-compute[72382]: DEBUG nova.network.neutron [None req-50ef47fb-9ba7-401d-8ff3-d3bccd05c0b2 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] [instance: fe1af384-aa97-4c21-8440-8b0ebb711d50] Updating instance_info_cache with network_info: [{"id": "2e30f2fa-a90a-4b8d-adbf-d428a802fd0f", "address": "fa:16:3e:64:1a:ee", "network": {"id": "ca2010c6-c431-44c8-8742-22a4fcf15754", "bridge": "br-int", "label": "tempest-TestStampPattern-1529830938-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a826d26871fb474ba904e1550f9ee103", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e30f2fa-a9", "ovs_interfaceid": "2e30f2fa-a90a-4b8d-adbf-d428a802fd0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:45:12 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-50ef47fb-9ba7-401d-8ff3-d3bccd05c0b2 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] Releasing lock "refresh_cache-fe1af384-aa97-4c21-8440-8b0ebb711d50" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 15:45:12 user nova-compute[72382]: DEBUG nova.compute.manager [None req-50ef47fb-9ba7-401d-8ff3-d3bccd05c0b2 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] [instance: fe1af384-aa97-4c21-8440-8b0ebb711d50] Instance network_info: |[{"id": "2e30f2fa-a90a-4b8d-adbf-d428a802fd0f", "address": "fa:16:3e:64:1a:ee", "network": {"id": "ca2010c6-c431-44c8-8742-22a4fcf15754", "bridge": "br-int", "label": "tempest-TestStampPattern-1529830938-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a826d26871fb474ba904e1550f9ee103", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e30f2fa-a9", "ovs_interfaceid": "2e30f2fa-a90a-4b8d-adbf-d428a802fd0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72382) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 15:45:12 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-50ef47fb-9ba7-401d-8ff3-d3bccd05c0b2 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] [instance: fe1af384-aa97-4c21-8440-8b0ebb711d50] Start _get_guest_xml network_info=[{"id": "2e30f2fa-a90a-4b8d-adbf-d428a802fd0f", "address": "fa:16:3e:64:1a:ee", "network": {"id": "ca2010c6-c431-44c8-8742-22a4fcf15754", "bridge": "br-int", "label": "tempest-TestStampPattern-1529830938-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a826d26871fb474ba904e1550f9ee103", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e30f2fa-a9", "ovs_interfaceid": "2e30f2fa-a90a-4b8d-adbf-d428a802fd0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='610ac40c9b2d1c5fe50c10bae0677293',container_format='bare',created_at=2023-08-09T15:45:00Z,direct_url=<?>,disk_format='qcow2',id=31ab184b-ee75-44d1-ba85-f61c03de5eba,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1213507010',owner='a826d26871fb474ba904e1550f9ee103',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-09T15:45:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': '31ab184b-ee75-44d1-ba85-f61c03de5eba'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72382) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 15:45:12 user nova-compute[72382]: WARNING nova.virt.libvirt.driver [None req-50ef47fb-9ba7-401d-8ff3-d3bccd05c0b2 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 15:45:12 user nova-compute[72382]: WARNING nova.virt.libvirt.driver [None req-50ef47fb-9ba7-401d-8ff3-d3bccd05c0b2 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 15:45:12 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-50ef47fb-9ba7-401d-8ff3-d3bccd05c0b2 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72382) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 15:45:12 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-50ef47fb-9ba7-401d-8ff3-d3bccd05c0b2 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] CPU controller missing on host. {{(pid=72382) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 15:45:12 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-50ef47fb-9ba7-401d-8ff3-d3bccd05c0b2 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72382) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 15:45:12 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-50ef47fb-9ba7-401d-8ff3-d3bccd05c0b2 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] CPU controller found on host. {{(pid=72382) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 15:45:12 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-50ef47fb-9ba7-401d-8ff3-d3bccd05c0b2 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72382) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 15:45:12 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-50ef47fb-9ba7-401d-8ff3-d3bccd05c0b2 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T15:11:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='610ac40c9b2d1c5fe50c10bae0677293',container_format='bare',created_at=2023-08-09T15:45:00Z,direct_url=<?>,disk_format='qcow2',id=31ab184b-ee75-44d1-ba85-f61c03de5eba,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1213507010',owner='a826d26871fb474ba904e1550f9ee103',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-09T15:45:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 15:45:12 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-50ef47fb-9ba7-401d-8ff3-d3bccd05c0b2 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] Flavor limits 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 15:45:12 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-50ef47fb-9ba7-401d-8ff3-d3bccd05c0b2 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] Image limits 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 15:45:12 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-50ef47fb-9ba7-401d-8ff3-d3bccd05c0b2 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] Flavor pref 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 15:45:12 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-50ef47fb-9ba7-401d-8ff3-d3bccd05c0b2 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] Image pref 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 15:45:12 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-50ef47fb-9ba7-401d-8ff3-d3bccd05c0b2 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 15:45:12 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-50ef47fb-9ba7-401d-8ff3-d3bccd05c0b2 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 15:45:12 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-50ef47fb-9ba7-401d-8ff3-d3bccd05c0b2 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72382) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 15:45:12 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-50ef47fb-9ba7-401d-8ff3-d3bccd05c0b2 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] Got 1 possible topologies {{(pid=72382) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 15:45:12 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-50ef47fb-9ba7-401d-8ff3-d3bccd05c0b2 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 15:45:12 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-50ef47fb-9ba7-401d-8ff3-d3bccd05c0b2 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 15:45:12 user nova-compute[72382]: DEBUG nova.virt.libvirt.vif [None req-50ef47fb-9ba7-401d-8ff3-d3bccd05c0b2 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T15:45:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-458243491',display_name='tempest-TestStampPattern-server-458243491',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-458243491',id=51,image_ref='31ab184b-ee75-44d1-ba85-f61c03de5eba',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNjio106iFL2RPDY5bqMxL7i3075CQY3HKpCfye/tyKn/rCQ1aG3GTM2r91qUJoQ3mYw8uvX3PtnblDrXm52Mqz8hUv4zCfERch5RpCXfjm7fb1444d3HAmk/t6Po924mA==',key_name='tempest-TestStampPattern-1060048663',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a826d26871fb474ba904e1550f9ee103',ramdisk_id='',reservation_id='r-cj5bpew2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='4d27c5a4-9a88-423b-9c48-9224e8248f8c',image_min_disk='1',image_min_ram='0',image_owner_id='a826d26871fb474ba904e1550f9ee103',image_owner_project_name='tempest-TestStampPattern-1111267616',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1111267616-project-member',image_user_id='273d16c265ae4868a371889eae528d02',network_allocated='True',owner_project_name='tempest-TestStampPattern-1111267616',owner_user_name='tempest-TestStampPattern-1111267616-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T15:45:09Z,user_data=None,user_id='273d16c265ae4868a371889eae528d02',uuid=fe1af384-aa97-4c21-8440-8b0ebb711d50,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2e30f2fa-a90a-4b8d-adbf-d428a802fd0f", "address": "fa:16:3e:64:1a:ee", "network": {"id": "ca2010c6-c431-44c8-8742-22a4fcf15754", "bridge": "br-int", "label": "tempest-TestStampPattern-1529830938-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a826d26871fb474ba904e1550f9ee103", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e30f2fa-a9", "ovs_interfaceid": "2e30f2fa-a90a-4b8d-adbf-d428a802fd0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72382) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 15:45:12 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-50ef47fb-9ba7-401d-8ff3-d3bccd05c0b2 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] Converting VIF {"id": "2e30f2fa-a90a-4b8d-adbf-d428a802fd0f", "address": "fa:16:3e:64:1a:ee", "network": {"id": "ca2010c6-c431-44c8-8742-22a4fcf15754", "bridge": "br-int", "label": "tempest-TestStampPattern-1529830938-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a826d26871fb474ba904e1550f9ee103", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e30f2fa-a9", "ovs_interfaceid": "2e30f2fa-a90a-4b8d-adbf-d428a802fd0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 15:45:12 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-50ef47fb-9ba7-401d-8ff3-d3bccd05c0b2 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:64:1a:ee,bridge_name='br-int',has_traffic_filtering=True,id=2e30f2fa-a90a-4b8d-adbf-d428a802fd0f,network=Network(ca2010c6-c431-44c8-8742-22a4fcf15754),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e30f2fa-a9') {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 15:45:12 user nova-compute[72382]: DEBUG nova.objects.instance [None req-50ef47fb-9ba7-401d-8ff3-d3bccd05c0b2 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] Lazy-loading 'pci_devices' on Instance uuid fe1af384-aa97-4c21-8440-8b0ebb711d50 {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:45:12 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-50ef47fb-9ba7-401d-8ff3-d3bccd05c0b2 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] [instance: fe1af384-aa97-4c21-8440-8b0ebb711d50] End _get_guest_xml xml=<domain type="kvm">
Aug 09 15:45:12 user nova-compute[72382]:   <uuid>fe1af384-aa97-4c21-8440-8b0ebb711d50</uuid>
Aug 09 15:45:12 user nova-compute[72382]:   <name>instance-00000033</name>
Aug 09 15:45:12 user nova-compute[72382]:   <memory>524288</memory>
Aug 09 15:45:12 user nova-compute[72382]:   <vcpu>1</vcpu>
Aug 09 15:45:12 user nova-compute[72382]:   <metadata>
Aug 09 15:45:12 user nova-compute[72382]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 15:45:12 user nova-compute[72382]:       <nova:package version="0.0.0"/>
Aug 09 15:45:12 user nova-compute[72382]:       <nova:name>tempest-TestStampPattern-server-458243491</nova:name>
Aug 09 15:45:12 user nova-compute[72382]:       <nova:creationTime>2023-08-09 15:45:12</nova:creationTime>
Aug 09 15:45:12 user nova-compute[72382]:       <nova:flavor name="m1.tiny">
Aug 09 15:45:12 user nova-compute[72382]:         <nova:memory>512</nova:memory>
Aug 09 15:45:12 user nova-compute[72382]:         <nova:disk>1</nova:disk>
Aug 09 15:45:12 user nova-compute[72382]:         <nova:swap>0</nova:swap>
Aug 09 15:45:12 user nova-compute[72382]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 15:45:12 user nova-compute[72382]:         <nova:vcpus>1</nova:vcpus>
Aug 09 15:45:12 user nova-compute[72382]:       </nova:flavor>
Aug 09 15:45:12 user nova-compute[72382]:       <nova:owner>
Aug 09 15:45:12 user nova-compute[72382]:         <nova:user uuid="273d16c265ae4868a371889eae528d02">tempest-TestStampPattern-1111267616-project-member</nova:user>
Aug 09 15:45:12 user nova-compute[72382]:         <nova:project uuid="a826d26871fb474ba904e1550f9ee103">tempest-TestStampPattern-1111267616</nova:project>
Aug 09 15:45:12 user nova-compute[72382]:       </nova:owner>
Aug 09 15:45:12 user nova-compute[72382]:       <nova:root type="image" uuid="31ab184b-ee75-44d1-ba85-f61c03de5eba"/>
Aug 09 15:45:12 user nova-compute[72382]:       <nova:ports>
Aug 09 15:45:12 user nova-compute[72382]:         <nova:port uuid="2e30f2fa-a90a-4b8d-adbf-d428a802fd0f">
Aug 09 15:45:12 user nova-compute[72382]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 09 15:45:12 user nova-compute[72382]:         </nova:port>
Aug 09 15:45:12 user nova-compute[72382]:       </nova:ports>
Aug 09 15:45:12 user nova-compute[72382]:     </nova:instance>
Aug 09 15:45:12 user nova-compute[72382]:   </metadata>
Aug 09 15:45:12 user nova-compute[72382]:   <sysinfo type="smbios">
Aug 09 15:45:12 user nova-compute[72382]:     <system>
Aug 09 15:45:12 user nova-compute[72382]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 15:45:12 user nova-compute[72382]:       <entry name="product">OpenStack Nova</entry>
Aug 09 15:45:12 user nova-compute[72382]:       <entry name="version">0.0.0</entry>
Aug 09 15:45:12 user nova-compute[72382]:       <entry name="serial">fe1af384-aa97-4c21-8440-8b0ebb711d50</entry>
Aug 09 15:45:12 user nova-compute[72382]:       <entry name="uuid">fe1af384-aa97-4c21-8440-8b0ebb711d50</entry>
Aug 09 15:45:12 user nova-compute[72382]:       <entry name="family">Virtual Machine</entry>
Aug 09 15:45:12 user nova-compute[72382]:     </system>
Aug 09 15:45:12 user nova-compute[72382]:   </sysinfo>
Aug 09 15:45:12 user nova-compute[72382]:   <os>
Aug 09 15:45:12 user nova-compute[72382]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 15:45:12 user nova-compute[72382]:     <boot dev="hd"/>
Aug 09 15:45:12 user nova-compute[72382]:     <smbios mode="sysinfo"/>
Aug 09 15:45:12 user nova-compute[72382]:   </os>
Aug 09 15:45:12 user nova-compute[72382]:   <features>
Aug 09 15:45:12 user nova-compute[72382]:     <acpi/>
Aug 09 15:45:12 user nova-compute[72382]:     <apic/>
Aug 09 15:45:12 user nova-compute[72382]:     <vmcoreinfo/>
Aug 09 15:45:12 user nova-compute[72382]:   </features>
Aug 09 15:45:12 user nova-compute[72382]:   <clock offset="utc">
Aug 09 15:45:12 user nova-compute[72382]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 15:45:12 user nova-compute[72382]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 15:45:12 user nova-compute[72382]:     <timer name="hpet" present="no"/>
Aug 09 15:45:12 user nova-compute[72382]:   </clock>
Aug 09 15:45:12 user nova-compute[72382]:   <cpu mode="custom" match="exact">
Aug 09 15:45:12 user nova-compute[72382]:     <model>Nehalem</model>
Aug 09 15:45:12 user nova-compute[72382]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 15:45:12 user nova-compute[72382]:   </cpu>
Aug 09 15:45:12 user nova-compute[72382]:   <devices>
Aug 09 15:45:12 user nova-compute[72382]:     <disk type="file" device="disk">
Aug 09 15:45:12 user nova-compute[72382]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 15:45:12 user nova-compute[72382]:       <source file="/opt/stack/data/nova/instances/fe1af384-aa97-4c21-8440-8b0ebb711d50/disk"/>
Aug 09 15:45:12 user nova-compute[72382]:       <target dev="vda" bus="virtio"/>
Aug 09 15:45:12 user nova-compute[72382]:     </disk>
Aug 09 15:45:12 user nova-compute[72382]:     <interface type="ethernet">
Aug 09 15:45:12 user nova-compute[72382]:       <mac address="fa:16:3e:64:1a:ee"/>
Aug 09 15:45:12 user nova-compute[72382]:       <model type="virtio"/>
Aug 09 15:45:12 user nova-compute[72382]:       <mtu size="1442"/>
Aug 09 15:45:12 user nova-compute[72382]:       <target dev="tap2e30f2fa-a9"/>
Aug 09 15:45:12 user nova-compute[72382]:     </interface>
Aug 09 15:45:12 user nova-compute[72382]:     <serial type="pty">
Aug 09 15:45:12 user nova-compute[72382]:       <log file="/opt/stack/data/nova/instances/fe1af384-aa97-4c21-8440-8b0ebb711d50/console.log" append="off"/>
Aug 09 15:45:12 user nova-compute[72382]:     </serial>
Aug 09 15:45:12 user nova-compute[72382]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 15:45:12 user nova-compute[72382]:     <video>
Aug 09 15:45:12 user nova-compute[72382]:       <model type="virtio"/>
Aug 09 15:45:12 user nova-compute[72382]:     </video>
Aug 09 15:45:12 user nova-compute[72382]:     <rng model="virtio">
Aug 09 15:45:12 user nova-compute[72382]:       <backend model="random">/dev/urandom</backend>
Aug 09 15:45:12 user nova-compute[72382]:     </rng>
Aug 09 15:45:12 user nova-compute[72382]:     <controller type="usb" index="0" model="none"/>
Aug 09 15:45:12 user nova-compute[72382]:     <memballoon model="virtio">
Aug 09 15:45:12 user nova-compute[72382]:       <stats period="10"/>
Aug 09 15:45:12 user nova-compute[72382]:     </memballoon>
Aug 09 15:45:12 user nova-compute[72382]:   </devices>
Aug 09 15:45:12 user nova-compute[72382]: </domain>
Aug 09 15:45:12 user nova-compute[72382]:  {{(pid=72382) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 15:45:12 user nova-compute[72382]: DEBUG nova.virt.libvirt.vif [None req-50ef47fb-9ba7-401d-8ff3-d3bccd05c0b2 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T15:45:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-458243491',display_name='tempest-TestStampPattern-server-458243491',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-458243491',id=51,image_ref='31ab184b-ee75-44d1-ba85-f61c03de5eba',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNjio106iFL2RPDY5bqMxL7i3075CQY3HKpCfye/tyKn/rCQ1aG3GTM2r91qUJoQ3mYw8uvX3PtnblDrXm52Mqz8hUv4zCfERch5RpCXfjm7fb1444d3HAmk/t6Po924mA==',key_name='tempest-TestStampPattern-1060048663',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a826d26871fb474ba904e1550f9ee103',ramdisk_id='',reservation_id='r-cj5bpew2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='4d27c5a4-9a88-423b-9c48-9224e8248f8c',image_min_disk='1',image_min_ram='0',image_owner_id='a826d26871fb474ba904e1550f9ee103',image_owner_project_name='tempest-TestStampPattern-1111267616',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1111267616-project-member',image_user_id='273d16c265ae4868a371889eae528d02',network_allocated='True',owner_project_name='tempest-TestStampPattern-1111267616',owner_user_name='tempest-TestStampPattern-1111267616-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T15:45:09Z,user_data=None,user_id='273d16c265ae4868a371889eae528d02',uuid=fe1af384-aa97-4c21-8440-8b0ebb711d50,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2e30f2fa-a90a-4b8d-adbf-d428a802fd0f", "address": "fa:16:3e:64:1a:ee", "network": {"id": "ca2010c6-c431-44c8-8742-22a4fcf15754", "bridge": "br-int", "label": "tempest-TestStampPattern-1529830938-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a826d26871fb474ba904e1550f9ee103", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e30f2fa-a9", "ovs_interfaceid": "2e30f2fa-a90a-4b8d-adbf-d428a802fd0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 15:45:12 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-50ef47fb-9ba7-401d-8ff3-d3bccd05c0b2 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] Converting VIF {"id": "2e30f2fa-a90a-4b8d-adbf-d428a802fd0f", "address": "fa:16:3e:64:1a:ee", "network": {"id": "ca2010c6-c431-44c8-8742-22a4fcf15754", "bridge": "br-int", "label": "tempest-TestStampPattern-1529830938-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a826d26871fb474ba904e1550f9ee103", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e30f2fa-a9", "ovs_interfaceid": "2e30f2fa-a90a-4b8d-adbf-d428a802fd0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 15:45:12 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-50ef47fb-9ba7-401d-8ff3-d3bccd05c0b2 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:64:1a:ee,bridge_name='br-int',has_traffic_filtering=True,id=2e30f2fa-a90a-4b8d-adbf-d428a802fd0f,network=Network(ca2010c6-c431-44c8-8742-22a4fcf15754),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e30f2fa-a9') {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 15:45:12 user nova-compute[72382]: DEBUG os_vif [None req-50ef47fb-9ba7-401d-8ff3-d3bccd05c0b2 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:64:1a:ee,bridge_name='br-int',has_traffic_filtering=True,id=2e30f2fa-a90a-4b8d-adbf-d428a802fd0f,network=Network(ca2010c6-c431-44c8-8742-22a4fcf15754),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e30f2fa-a9') {{(pid=72382) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 15:45:12 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:45:12 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:45:12 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 15:45:12 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:45:12 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2e30f2fa-a9, may_exist=True, interface_attrs={}) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:45:12 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2e30f2fa-a9, col_values=(('external_ids', {'iface-id': '2e30f2fa-a90a-4b8d-adbf-d428a802fd0f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:64:1a:ee', 'vm-uuid': 'fe1af384-aa97-4c21-8440-8b0ebb711d50'}),), if_exists=True) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:45:12 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:45:12 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:45:12 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:45:12 user nova-compute[72382]: INFO os_vif [None req-50ef47fb-9ba7-401d-8ff3-d3bccd05c0b2 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:64:1a:ee,bridge_name='br-int',has_traffic_filtering=True,id=2e30f2fa-a90a-4b8d-adbf-d428a802fd0f,network=Network(ca2010c6-c431-44c8-8742-22a4fcf15754),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e30f2fa-a9')
Aug 09 15:45:12 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-50ef47fb-9ba7-401d-8ff3-d3bccd05c0b2 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] No BDM found with device name vda, not building metadata. {{(pid=72382) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 15:45:12 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-50ef47fb-9ba7-401d-8ff3-d3bccd05c0b2 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] No VIF found with MAC fa:16:3e:64:1a:ee, not building metadata {{(pid=72382) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 15:45:13 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:45:13 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:45:13 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:45:13 user nova-compute[72382]: DEBUG nova.compute.manager [req-c9745f2e-bd24-4958-9eb8-76b47b218d86 req-61878704-9803-4ff0-b10a-c63d0a73d602 service nova] [instance: fe1af384-aa97-4c21-8440-8b0ebb711d50] Received event network-vif-plugged-2e30f2fa-a90a-4b8d-adbf-d428a802fd0f {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:45:13 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-c9745f2e-bd24-4958-9eb8-76b47b218d86 req-61878704-9803-4ff0-b10a-c63d0a73d602 service nova] Acquiring lock "fe1af384-aa97-4c21-8440-8b0ebb711d50-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:45:13 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-c9745f2e-bd24-4958-9eb8-76b47b218d86 req-61878704-9803-4ff0-b10a-c63d0a73d602 service nova] Lock "fe1af384-aa97-4c21-8440-8b0ebb711d50-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:45:13 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-c9745f2e-bd24-4958-9eb8-76b47b218d86 req-61878704-9803-4ff0-b10a-c63d0a73d602 service nova] Lock "fe1af384-aa97-4c21-8440-8b0ebb711d50-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:45:13 user nova-compute[72382]: DEBUG nova.compute.manager [req-c9745f2e-bd24-4958-9eb8-76b47b218d86 req-61878704-9803-4ff0-b10a-c63d0a73d602 service nova] [instance: fe1af384-aa97-4c21-8440-8b0ebb711d50] No waiting events found dispatching network-vif-plugged-2e30f2fa-a90a-4b8d-adbf-d428a802fd0f {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:45:13 user nova-compute[72382]: WARNING nova.compute.manager [req-c9745f2e-bd24-4958-9eb8-76b47b218d86 req-61878704-9803-4ff0-b10a-c63d0a73d602 service nova] [instance: fe1af384-aa97-4c21-8440-8b0ebb711d50] Received unexpected event network-vif-plugged-2e30f2fa-a90a-4b8d-adbf-d428a802fd0f for instance with vm_state building and task_state spawning.
Aug 09 15:45:13 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:45:14 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:45:15 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:45:16 user nova-compute[72382]: DEBUG nova.compute.manager [req-3652d7ab-5fb2-4c74-adcc-ff6011b0a8da req-b3b9fcdd-e8c6-44b0-88b6-cca712f9eaf3 service nova] [instance: fe1af384-aa97-4c21-8440-8b0ebb711d50] Received event network-vif-plugged-2e30f2fa-a90a-4b8d-adbf-d428a802fd0f {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:45:16 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-3652d7ab-5fb2-4c74-adcc-ff6011b0a8da req-b3b9fcdd-e8c6-44b0-88b6-cca712f9eaf3 service nova] Acquiring lock "fe1af384-aa97-4c21-8440-8b0ebb711d50-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:45:16 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-3652d7ab-5fb2-4c74-adcc-ff6011b0a8da req-b3b9fcdd-e8c6-44b0-88b6-cca712f9eaf3 service nova] Lock "fe1af384-aa97-4c21-8440-8b0ebb711d50-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:45:16 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-3652d7ab-5fb2-4c74-adcc-ff6011b0a8da req-b3b9fcdd-e8c6-44b0-88b6-cca712f9eaf3 service nova] Lock "fe1af384-aa97-4c21-8440-8b0ebb711d50-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:45:16 user nova-compute[72382]: DEBUG nova.compute.manager [req-3652d7ab-5fb2-4c74-adcc-ff6011b0a8da req-b3b9fcdd-e8c6-44b0-88b6-cca712f9eaf3 service nova] [instance: fe1af384-aa97-4c21-8440-8b0ebb711d50] No waiting events found dispatching network-vif-plugged-2e30f2fa-a90a-4b8d-adbf-d428a802fd0f {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:45:16 user nova-compute[72382]: WARNING nova.compute.manager [req-3652d7ab-5fb2-4c74-adcc-ff6011b0a8da req-b3b9fcdd-e8c6-44b0-88b6-cca712f9eaf3 service nova] [instance: fe1af384-aa97-4c21-8440-8b0ebb711d50] Received unexpected event network-vif-plugged-2e30f2fa-a90a-4b8d-adbf-d428a802fd0f for instance with vm_state building and task_state spawning.
Aug 09 15:45:16 user nova-compute[72382]: DEBUG nova.virt.driver [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Emitting event <LifecycleEvent: 1691595916.5750158, fe1af384-aa97-4c21-8440-8b0ebb711d50 => Resumed> {{(pid=72382) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 15:45:16 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: fe1af384-aa97-4c21-8440-8b0ebb711d50] VM Resumed (Lifecycle Event)
Aug 09 15:45:16 user nova-compute[72382]: DEBUG nova.compute.manager [None req-50ef47fb-9ba7-401d-8ff3-d3bccd05c0b2 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] [instance: fe1af384-aa97-4c21-8440-8b0ebb711d50] Instance event wait completed in 0 seconds for  {{(pid=72382) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 15:45:16 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-50ef47fb-9ba7-401d-8ff3-d3bccd05c0b2 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] [instance: fe1af384-aa97-4c21-8440-8b0ebb711d50] Guest created on hypervisor {{(pid=72382) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 15:45:16 user nova-compute[72382]: INFO nova.virt.libvirt.driver [-] [instance: fe1af384-aa97-4c21-8440-8b0ebb711d50] Instance spawned successfully.
Aug 09 15:45:16 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-50ef47fb-9ba7-401d-8ff3-d3bccd05c0b2 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] [instance: fe1af384-aa97-4c21-8440-8b0ebb711d50] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 15:45:16 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-50ef47fb-9ba7-401d-8ff3-d3bccd05c0b2 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] [instance: fe1af384-aa97-4c21-8440-8b0ebb711d50] Found default for hw_input_bus of None {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:45:16 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-50ef47fb-9ba7-401d-8ff3-d3bccd05c0b2 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] [instance: fe1af384-aa97-4c21-8440-8b0ebb711d50] Found default for hw_pointer_model of None {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:45:16 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: fe1af384-aa97-4c21-8440-8b0ebb711d50] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:45:16 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: fe1af384-aa97-4c21-8440-8b0ebb711d50] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72382) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 15:45:16 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: fe1af384-aa97-4c21-8440-8b0ebb711d50] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 15:45:16 user nova-compute[72382]: DEBUG nova.virt.driver [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Emitting event <LifecycleEvent: 1691595916.5765202, fe1af384-aa97-4c21-8440-8b0ebb711d50 => Started> {{(pid=72382) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 15:45:16 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: fe1af384-aa97-4c21-8440-8b0ebb711d50] VM Started (Lifecycle Event)
Aug 09 15:45:16 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: fe1af384-aa97-4c21-8440-8b0ebb711d50] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:45:16 user nova-compute[72382]: INFO nova.compute.manager [None req-50ef47fb-9ba7-401d-8ff3-d3bccd05c0b2 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] [instance: fe1af384-aa97-4c21-8440-8b0ebb711d50] Took 7.74 seconds to spawn the instance on the hypervisor.
Aug 09 15:45:16 user nova-compute[72382]: DEBUG nova.compute.manager [None req-50ef47fb-9ba7-401d-8ff3-d3bccd05c0b2 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] [instance: fe1af384-aa97-4c21-8440-8b0ebb711d50] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:45:16 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: fe1af384-aa97-4c21-8440-8b0ebb711d50] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72382) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 15:45:16 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: fe1af384-aa97-4c21-8440-8b0ebb711d50] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 15:45:16 user nova-compute[72382]: INFO nova.compute.manager [None req-50ef47fb-9ba7-401d-8ff3-d3bccd05c0b2 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] [instance: fe1af384-aa97-4c21-8440-8b0ebb711d50] Took 8.50 seconds to build instance.
Aug 09 15:45:16 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-50ef47fb-9ba7-401d-8ff3-d3bccd05c0b2 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] Lock "fe1af384-aa97-4c21-8440-8b0ebb711d50" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.593s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:45:17 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:45:17 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:45:22 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:45:22 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:45:23 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:45:23 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:45:23 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:45:23 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:45:23 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:45:23 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Auditing locally available compute resources for user (node: user) {{(pid=72382) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 15:45:24 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe1af384-aa97-4c21-8440-8b0ebb711d50/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:45:24 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe1af384-aa97-4c21-8440-8b0ebb711d50/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:45:24 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe1af384-aa97-4c21-8440-8b0ebb711d50/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:45:24 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe1af384-aa97-4c21-8440-8b0ebb711d50/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:45:24 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d27c5a4-9a88-423b-9c48-9224e8248f8c/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:45:24 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d27c5a4-9a88-423b-9c48-9224e8248f8c/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:45:24 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d27c5a4-9a88-423b-9c48-9224e8248f8c/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:45:24 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d27c5a4-9a88-423b-9c48-9224e8248f8c/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:45:24 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c1b05ee-4fc3-44b9-b689-52d07841da4c/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:45:24 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c1b05ee-4fc3-44b9-b689-52d07841da4c/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:45:24 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c1b05ee-4fc3-44b9-b689-52d07841da4c/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:45:24 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c1b05ee-4fc3-44b9-b689-52d07841da4c/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:45:24 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72382) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 15:45:25 user nova-compute[72382]: WARNING nova.virt.libvirt.driver [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 15:45:25 user nova-compute[72382]: WARNING nova.virt.libvirt.driver [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 15:45:25 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Hypervisor/Node resource view: name=user free_ram=8384MB free_disk=25.150039672851562GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72382) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 15:45:25 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:45:25 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:45:25 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance 4d27c5a4-9a88-423b-9c48-9224e8248f8c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:45:25 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance 0c1b05ee-4fc3-44b9-b689-52d07841da4c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:45:25 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance fe1af384-aa97-4c21-8440-8b0ebb711d50 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:45:25 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=72382) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 15:45:25 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=72382) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 15:45:25 user nova-compute[72382]: DEBUG nova.compute.provider_tree [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Inventory has not changed in ProviderTree for provider: 7b15b0e5-df4d-49db-833b-2855d21d10ae {{(pid=72382) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 15:45:25 user nova-compute[72382]: DEBUG nova.scheduler.client.report [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Inventory has not changed for provider 7b15b0e5-df4d-49db-833b-2855d21d10ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72382) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 15:45:25 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Compute_service record updated for user:user {{(pid=72382) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 15:45:25 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.230s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:45:26 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:45:26 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:45:27 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:45:29 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:45:29 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:45:29 user nova-compute[72382]: DEBUG nova.compute.manager [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72382) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 15:45:30 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:45:30 user nova-compute[72382]: DEBUG nova.compute.manager [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Starting heal instance info cache {{(pid=72382) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 15:45:30 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Acquiring lock "refresh_cache-0c1b05ee-4fc3-44b9-b689-52d07841da4c" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 15:45:30 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Acquired lock "refresh_cache-0c1b05ee-4fc3-44b9-b689-52d07841da4c" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 15:45:30 user nova-compute[72382]: DEBUG nova.network.neutron [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] [instance: 0c1b05ee-4fc3-44b9-b689-52d07841da4c] Forcefully refreshing network info cache for instance {{(pid=72382) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 15:45:31 user nova-compute[72382]: DEBUG nova.network.neutron [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] [instance: 0c1b05ee-4fc3-44b9-b689-52d07841da4c] Updating instance_info_cache with network_info: [{"id": "b339298b-9a14-4a36-a53e-7d1e6a2d85ff", "address": "fa:16:3e:d4:06:6f", "network": {"id": "8d929426-09f7-49b5-a79e-711e20e00750", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1307802727-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93c87775443b4abd987197c4b46693bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb339298b-9a", "ovs_interfaceid": "b339298b-9a14-4a36-a53e-7d1e6a2d85ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:45:31 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Releasing lock "refresh_cache-0c1b05ee-4fc3-44b9-b689-52d07841da4c" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 15:45:31 user nova-compute[72382]: DEBUG nova.compute.manager [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] [instance: 0c1b05ee-4fc3-44b9-b689-52d07841da4c] Updated the network info_cache for instance {{(pid=72382) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 15:45:32 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:45:32 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:45:32 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:45:34 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:45:35 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:45:35 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:45:37 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:45:39 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:45:40 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:45:42 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:45:45 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:45:47 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:45:50 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:45:52 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:45:57 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:46:02 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:46:02 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:46:02 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72382) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 15:46:02 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72382) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 15:46:02 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72382) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 15:46:02 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:46:07 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:46:07 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:46:07 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72382) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 15:46:07 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72382) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 15:46:07 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72382) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 15:46:07 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:46:09 user nova-compute[72382]: DEBUG nova.compute.manager [req-562ff42a-1f95-4c85-8d6e-0e5eaa4a103f req-5f526c37-1f7a-496c-9dba-405338882354 service nova] [instance: 0c1b05ee-4fc3-44b9-b689-52d07841da4c] Received event network-changed-b339298b-9a14-4a36-a53e-7d1e6a2d85ff {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:46:09 user nova-compute[72382]: DEBUG nova.compute.manager [req-562ff42a-1f95-4c85-8d6e-0e5eaa4a103f req-5f526c37-1f7a-496c-9dba-405338882354 service nova] [instance: 0c1b05ee-4fc3-44b9-b689-52d07841da4c] Refreshing instance network info cache due to event network-changed-b339298b-9a14-4a36-a53e-7d1e6a2d85ff. {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 15:46:09 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-562ff42a-1f95-4c85-8d6e-0e5eaa4a103f req-5f526c37-1f7a-496c-9dba-405338882354 service nova] Acquiring lock "refresh_cache-0c1b05ee-4fc3-44b9-b689-52d07841da4c" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 15:46:09 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-562ff42a-1f95-4c85-8d6e-0e5eaa4a103f req-5f526c37-1f7a-496c-9dba-405338882354 service nova] Acquired lock "refresh_cache-0c1b05ee-4fc3-44b9-b689-52d07841da4c" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 15:46:09 user nova-compute[72382]: DEBUG nova.network.neutron [req-562ff42a-1f95-4c85-8d6e-0e5eaa4a103f req-5f526c37-1f7a-496c-9dba-405338882354 service nova] [instance: 0c1b05ee-4fc3-44b9-b689-52d07841da4c] Refreshing network info cache for port b339298b-9a14-4a36-a53e-7d1e6a2d85ff {{(pid=72382) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 15:46:09 user nova-compute[72382]: DEBUG nova.network.neutron [req-562ff42a-1f95-4c85-8d6e-0e5eaa4a103f req-5f526c37-1f7a-496c-9dba-405338882354 service nova] [instance: 0c1b05ee-4fc3-44b9-b689-52d07841da4c] Updated VIF entry in instance network info cache for port b339298b-9a14-4a36-a53e-7d1e6a2d85ff. {{(pid=72382) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 15:46:09 user nova-compute[72382]: DEBUG nova.network.neutron [req-562ff42a-1f95-4c85-8d6e-0e5eaa4a103f req-5f526c37-1f7a-496c-9dba-405338882354 service nova] [instance: 0c1b05ee-4fc3-44b9-b689-52d07841da4c] Updating instance_info_cache with network_info: [{"id": "b339298b-9a14-4a36-a53e-7d1e6a2d85ff", "address": "fa:16:3e:d4:06:6f", "network": {"id": "8d929426-09f7-49b5-a79e-711e20e00750", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1307802727-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93c87775443b4abd987197c4b46693bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb339298b-9a", "ovs_interfaceid": "b339298b-9a14-4a36-a53e-7d1e6a2d85ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:46:10 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-562ff42a-1f95-4c85-8d6e-0e5eaa4a103f req-5f526c37-1f7a-496c-9dba-405338882354 service nova] Releasing lock "refresh_cache-0c1b05ee-4fc3-44b9-b689-52d07841da4c" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 15:46:10 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:46:10 user nova-compute[72382]: DEBUG nova.compute.manager [req-790e5ee8-4ac7-4cd6-b1ac-6c01b5792f92 req-913909ea-ca0a-44fb-8f04-b4428cce891f service nova] [instance: 0c1b05ee-4fc3-44b9-b689-52d07841da4c] Received event network-changed-b339298b-9a14-4a36-a53e-7d1e6a2d85ff {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:46:10 user nova-compute[72382]: DEBUG nova.compute.manager [req-790e5ee8-4ac7-4cd6-b1ac-6c01b5792f92 req-913909ea-ca0a-44fb-8f04-b4428cce891f service nova] [instance: 0c1b05ee-4fc3-44b9-b689-52d07841da4c] Refreshing instance network info cache due to event network-changed-b339298b-9a14-4a36-a53e-7d1e6a2d85ff. {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 15:46:10 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-790e5ee8-4ac7-4cd6-b1ac-6c01b5792f92 req-913909ea-ca0a-44fb-8f04-b4428cce891f service nova] Acquiring lock "refresh_cache-0c1b05ee-4fc3-44b9-b689-52d07841da4c" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 15:46:10 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-790e5ee8-4ac7-4cd6-b1ac-6c01b5792f92 req-913909ea-ca0a-44fb-8f04-b4428cce891f service nova] Acquired lock "refresh_cache-0c1b05ee-4fc3-44b9-b689-52d07841da4c" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 15:46:10 user nova-compute[72382]: DEBUG nova.network.neutron [req-790e5ee8-4ac7-4cd6-b1ac-6c01b5792f92 req-913909ea-ca0a-44fb-8f04-b4428cce891f service nova] [instance: 0c1b05ee-4fc3-44b9-b689-52d07841da4c] Refreshing network info cache for port b339298b-9a14-4a36-a53e-7d1e6a2d85ff {{(pid=72382) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 15:46:10 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-8addd5f6-710f-42b9-95c3-c1c8c1f6543c tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Acquiring lock "0c1b05ee-4fc3-44b9-b689-52d07841da4c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:46:10 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-8addd5f6-710f-42b9-95c3-c1c8c1f6543c tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Lock "0c1b05ee-4fc3-44b9-b689-52d07841da4c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:46:10 user nova-compute[72382]: INFO nova.compute.manager [None req-8addd5f6-710f-42b9-95c3-c1c8c1f6543c tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] [instance: 0c1b05ee-4fc3-44b9-b689-52d07841da4c] Detaching volume 9503780b-a02c-404a-986e-922be3e3f527
Aug 09 15:46:10 user nova-compute[72382]: INFO nova.virt.block_device [None req-8addd5f6-710f-42b9-95c3-c1c8c1f6543c tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] [instance: 0c1b05ee-4fc3-44b9-b689-52d07841da4c] Attempting to driver detach volume 9503780b-a02c-404a-986e-922be3e3f527 from mountpoint /dev/vdb
Aug 09 15:46:10 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-8addd5f6-710f-42b9-95c3-c1c8c1f6543c tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Attempting to detach device vdb from instance 0c1b05ee-4fc3-44b9-b689-52d07841da4c from the persistent domain config. {{(pid=72382) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 15:46:10 user nova-compute[72382]: DEBUG nova.virt.libvirt.guest [None req-8addd5f6-710f-42b9-95c3-c1c8c1f6543c tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 15:46:10 user nova-compute[72382]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 15:46:10 user nova-compute[72382]:   <source dev="/dev/sdc"/>
Aug 09 15:46:10 user nova-compute[72382]:   <target dev="vdb" bus="virtio"/>
Aug 09 15:46:10 user nova-compute[72382]:   <serial>9503780b-a02c-404a-986e-922be3e3f527</serial>
Aug 09 15:46:10 user nova-compute[72382]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 15:46:10 user nova-compute[72382]: </disk>
Aug 09 15:46:10 user nova-compute[72382]:  {{(pid=72382) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 15:46:10 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-8addd5f6-710f-42b9-95c3-c1c8c1f6543c tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Successfully detached device vdb from instance 0c1b05ee-4fc3-44b9-b689-52d07841da4c from the persistent domain config.
Aug 09 15:46:10 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-8addd5f6-710f-42b9-95c3-c1c8c1f6543c tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 0c1b05ee-4fc3-44b9-b689-52d07841da4c from the live domain config. {{(pid=72382) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 15:46:10 user nova-compute[72382]: DEBUG nova.virt.libvirt.guest [None req-8addd5f6-710f-42b9-95c3-c1c8c1f6543c tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 15:46:10 user nova-compute[72382]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 15:46:10 user nova-compute[72382]:   <source dev="/dev/sdc"/>
Aug 09 15:46:10 user nova-compute[72382]:   <target dev="vdb" bus="virtio"/>
Aug 09 15:46:10 user nova-compute[72382]:   <serial>9503780b-a02c-404a-986e-922be3e3f527</serial>
Aug 09 15:46:10 user nova-compute[72382]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 15:46:10 user nova-compute[72382]: </disk>
Aug 09 15:46:10 user nova-compute[72382]:  {{(pid=72382) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 15:46:10 user nova-compute[72382]: DEBUG nova.network.neutron [req-790e5ee8-4ac7-4cd6-b1ac-6c01b5792f92 req-913909ea-ca0a-44fb-8f04-b4428cce891f service nova] [instance: 0c1b05ee-4fc3-44b9-b689-52d07841da4c] Updated VIF entry in instance network info cache for port b339298b-9a14-4a36-a53e-7d1e6a2d85ff. {{(pid=72382) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 15:46:10 user nova-compute[72382]: DEBUG nova.network.neutron [req-790e5ee8-4ac7-4cd6-b1ac-6c01b5792f92 req-913909ea-ca0a-44fb-8f04-b4428cce891f service nova] [instance: 0c1b05ee-4fc3-44b9-b689-52d07841da4c] Updating instance_info_cache with network_info: [{"id": "b339298b-9a14-4a36-a53e-7d1e6a2d85ff", "address": "fa:16:3e:d4:06:6f", "network": {"id": "8d929426-09f7-49b5-a79e-711e20e00750", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1307802727-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93c87775443b4abd987197c4b46693bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb339298b-9a", "ovs_interfaceid": "b339298b-9a14-4a36-a53e-7d1e6a2d85ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:46:10 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-790e5ee8-4ac7-4cd6-b1ac-6c01b5792f92 req-913909ea-ca0a-44fb-8f04-b4428cce891f service nova] Releasing lock "refresh_cache-0c1b05ee-4fc3-44b9-b689-52d07841da4c" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 15:46:11 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Received event <DeviceRemovedEvent: 1691595971.1060827, 0c1b05ee-4fc3-44b9-b689-52d07841da4c => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72382) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 15:46:11 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-8addd5f6-710f-42b9-95c3-c1c8c1f6543c tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 0c1b05ee-4fc3-44b9-b689-52d07841da4c {{(pid=72382) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 15:46:11 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-8addd5f6-710f-42b9-95c3-c1c8c1f6543c tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Successfully detached device vdb from instance 0c1b05ee-4fc3-44b9-b689-52d07841da4c from the live domain config.
Aug 09 15:46:11 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8addd5f6-710f-42b9-95c3-c1c8c1f6543c tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] [instance: 0c1b05ee-4fc3-44b9-b689-52d07841da4c] calling os-brick to detach iSCSI Volume {{(pid=72382) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 15:46:11 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-8addd5f6-710f-42b9-95c3-c1c8c1f6543c tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2a0c768340>, {'target_iqns': ['iqn.2010-10.org.openstack:9503780b-a02c-404a-986e-922be3e3f527'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'voMhRUZV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 15:46:11 user nova-compute[72382]: WARNING os_brick.initiator.connectors.base [None req-8addd5f6-710f-42b9-95c3-c1c8c1f6543c tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 15:46:11 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-8addd5f6-710f-42b9-95c3-c1c8c1f6543c tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 15:46:11 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-8addd5f6-710f-42b9-95c3-c1c8c1f6543c tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 15:46:11 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-8addd5f6-710f-42b9-95c3-c1c8c1f6543c tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9503780b-a02c-404a-986e-922be3e3f527', 0)] {{(pid=72382) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 15:46:11 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:46:11 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:46:11 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[d99db8c2-573f-42ad-b7da-3115e2c69539]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9503780b-a02c-404a-986e-922be3e3f527\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:46:11 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:46:11 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:46:11 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[9deeabc4-1aa1-444f-b2bd-2fe4f805bbca]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9503780b-a02c-404a-986e-922be3e3f527 (non-flash)\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:46:11 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-8addd5f6-710f-42b9-95c3-c1c8c1f6543c tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9503780b-a02c-404a-986e-922be3e3f527 (non-flash)
Aug 09 15:46:11 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 15:46:11 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-8addd5f6-710f-42b9-95c3-c1c8c1f6543c tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9503780b-a02c-404a-986e-922be3e3f527 (non-flash)
Aug 09 15:46:11 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 15:46:11 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-8addd5f6-710f-42b9-95c3-c1c8c1f6543c tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2a0c1c5ab0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9503780b-a02c-404a-986e-922be3e3f527'): ({'sdc'}, set())}) {{(pid=72382) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 15:46:11 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-8addd5f6-710f-42b9-95c3-c1c8c1f6543c tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Removing single pathed devices sdc {{(pid=72382) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 15:46:11 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:46:11 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:46:11 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a3d2bd9-228b-483b-9d26-385b7dc537df]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:46:11 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:46:11 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:46:11 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b212ce8-1911-404b-9565-1681a662e7f2]: (4, ('ok\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:46:11 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-8addd5f6-710f-42b9-95c3-c1c8c1f6543c tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Flushing IO for device /dev/sdc {{(pid=72382) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 15:46:11 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:46:11 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:46:11 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[57867cb8-4b51-46ba-803f-5d41172bb7d4]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:46:11 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-8addd5f6-710f-42b9-95c3-c1c8c1f6543c tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72382) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 15:46:11 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:46:11 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.035s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:46:11 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f9536cc-8750-40e2-ab2e-61fd6ae95309]: (4, ('1', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:46:11 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-8addd5f6-710f-42b9-95c3-c1c8c1f6543c tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72382) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 15:46:11 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-8addd5f6-710f-42b9-95c3-c1c8c1f6543c tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] SCSI volumes sdc have been removed. {{(pid=72382) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 15:46:11 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-8addd5f6-710f-42b9-95c3-c1c8c1f6543c tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9503780b-a02c-404a-986e-922be3e3f527')] {{(pid=72382) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 15:46:11 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9503780b-a02c-404a-986e-922be3e3f527 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:46:11 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9503780b-a02c-404a-986e-922be3e3f527 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:46:11 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[9811d96b-f3bb-4e60-be6e-28a6a11da31c]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:46:11 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-8addd5f6-710f-42b9-95c3-c1c8c1f6543c tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:46:11 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9503780b-a02c-404a-986e-922be3e3f527 -p 172.16.0.220:3260 --logout {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:46:11 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9503780b-a02c-404a-986e-922be3e3f527 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:46:11 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f5f6908-80de-4c3f-89a1-b1a087e23a7a]: (4, ('Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:9503780b-a02c-404a-986e-922be3e3f527, portal: 172.16.0.220,3260]\nLogout of [sid: 60, target: iqn.2010-10.org.openstack:9503780b-a02c-404a-986e-922be3e3f527, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:46:11 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-8addd5f6-710f-42b9-95c3-c1c8c1f6543c tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:9503780b-a02c-404a-986e-922be3e3f527, portal: 172.16.0.220,3260]
Aug 09 15:46:11 user nova-compute[72382]: Logout of [sid: 60, target: iqn.2010-10.org.openstack:9503780b-a02c-404a-986e-922be3e3f527, portal: 172.16.0.220,3260] successful.
Aug 09 15:46:11 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:46:11 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9503780b-a02c-404a-986e-922be3e3f527 -p 172.16.0.220:3260 --op delete {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:46:11 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9503780b-a02c-404a-986e-922be3e3f527 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:46:11 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[83abd4a9-2d41-407a-a334-85fff3eef043]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:46:11 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-8addd5f6-710f-42b9-95c3-c1c8c1f6543c tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:46:11 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-8addd5f6-710f-42b9-95c3-c1c8c1f6543c tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.251s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 15:46:11 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-8addd5f6-710f-42b9-95c3-c1c8c1f6543c tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] <== disconnect_volume: return (252ms) None {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 15:46:11 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8addd5f6-710f-42b9-95c3-c1c8c1f6543c tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] [instance: 0c1b05ee-4fc3-44b9-b689-52d07841da4c] Disconnected iSCSI Volume {{(pid=72382) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 15:46:12 user nova-compute[72382]: DEBUG nova.objects.instance [None req-8addd5f6-710f-42b9-95c3-c1c8c1f6543c tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Lazy-loading 'flavor' on Instance uuid 0c1b05ee-4fc3-44b9-b689-52d07841da4c {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:46:12 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-8addd5f6-710f-42b9-95c3-c1c8c1f6543c tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Lock "0c1b05ee-4fc3-44b9-b689-52d07841da4c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.528s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:46:12 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:46:17 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:46:17 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:46:17 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72382) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 15:46:17 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72382) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 15:46:17 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72382) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 15:46:17 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:46:22 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:46:24 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:46:24 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:46:24 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:46:24 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:46:24 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:46:24 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Auditing locally available compute resources for user (node: user) {{(pid=72382) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 15:46:24 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe1af384-aa97-4c21-8440-8b0ebb711d50/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:46:25 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe1af384-aa97-4c21-8440-8b0ebb711d50/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:46:25 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe1af384-aa97-4c21-8440-8b0ebb711d50/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:46:25 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe1af384-aa97-4c21-8440-8b0ebb711d50/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:46:25 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d27c5a4-9a88-423b-9c48-9224e8248f8c/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:46:25 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d27c5a4-9a88-423b-9c48-9224e8248f8c/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:46:25 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d27c5a4-9a88-423b-9c48-9224e8248f8c/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:46:25 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d27c5a4-9a88-423b-9c48-9224e8248f8c/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:46:25 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c1b05ee-4fc3-44b9-b689-52d07841da4c/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:46:25 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c1b05ee-4fc3-44b9-b689-52d07841da4c/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:46:25 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c1b05ee-4fc3-44b9-b689-52d07841da4c/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:46:25 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c1b05ee-4fc3-44b9-b689-52d07841da4c/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:46:26 user nova-compute[72382]: WARNING nova.virt.libvirt.driver [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 15:46:26 user nova-compute[72382]: WARNING nova.virt.libvirt.driver [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 15:46:26 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Hypervisor/Node resource view: name=user free_ram=8601MB free_disk=25.147090911865234GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72382) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 15:46:26 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:46:26 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:46:26 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance 4d27c5a4-9a88-423b-9c48-9224e8248f8c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:46:26 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance 0c1b05ee-4fc3-44b9-b689-52d07841da4c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:46:26 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance fe1af384-aa97-4c21-8440-8b0ebb711d50 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:46:26 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=72382) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 15:46:26 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=72382) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 15:46:26 user nova-compute[72382]: DEBUG nova.compute.provider_tree [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Inventory has not changed in ProviderTree for provider: 7b15b0e5-df4d-49db-833b-2855d21d10ae {{(pid=72382) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 15:46:26 user nova-compute[72382]: DEBUG nova.scheduler.client.report [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Inventory has not changed for provider 7b15b0e5-df4d-49db-833b-2855d21d10ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72382) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 15:46:26 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Compute_service record updated for user:user {{(pid=72382) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 15:46:26 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.232s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:46:27 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:46:27 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:46:27 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:46:30 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:46:30 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:46:30 user nova-compute[72382]: DEBUG nova.compute.manager [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72382) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 15:46:31 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:46:31 user nova-compute[72382]: DEBUG nova.compute.manager [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Starting heal instance info cache {{(pid=72382) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 15:46:31 user nova-compute[72382]: DEBUG nova.compute.manager [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Rebuilding the list of instances to heal {{(pid=72382) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 09 15:46:32 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Acquiring lock "refresh_cache-4d27c5a4-9a88-423b-9c48-9224e8248f8c" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 15:46:32 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Acquired lock "refresh_cache-4d27c5a4-9a88-423b-9c48-9224e8248f8c" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 15:46:32 user nova-compute[72382]: DEBUG nova.network.neutron [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] [instance: 4d27c5a4-9a88-423b-9c48-9224e8248f8c] Forcefully refreshing network info cache for instance {{(pid=72382) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 15:46:32 user nova-compute[72382]: DEBUG nova.objects.instance [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lazy-loading 'info_cache' on Instance uuid 4d27c5a4-9a88-423b-9c48-9224e8248f8c {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:46:32 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:46:32 user nova-compute[72382]: DEBUG nova.network.neutron [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] [instance: 4d27c5a4-9a88-423b-9c48-9224e8248f8c] Updating instance_info_cache with network_info: [{"id": "b14bc813-7a4e-413c-9b5f-4c34080790b6", "address": "fa:16:3e:a6:b1:fa", "network": {"id": "ca2010c6-c431-44c8-8742-22a4fcf15754", "bridge": "br-int", "label": "tempest-TestStampPattern-1529830938-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a826d26871fb474ba904e1550f9ee103", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb14bc813-7a", "ovs_interfaceid": "b14bc813-7a4e-413c-9b5f-4c34080790b6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:46:32 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Releasing lock "refresh_cache-4d27c5a4-9a88-423b-9c48-9224e8248f8c" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 15:46:32 user nova-compute[72382]: DEBUG nova.compute.manager [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] [instance: 4d27c5a4-9a88-423b-9c48-9224e8248f8c] Updated the network info_cache for instance {{(pid=72382) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 15:46:32 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:46:32 user nova-compute[72382]: DEBUG nova.compute.manager [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Cleaning up deleted instances {{(pid=72382) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 09 15:46:32 user nova-compute[72382]: DEBUG nova.compute.manager [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] There are 0 instances to clean {{(pid=72382) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 09 15:46:34 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:46:35 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:46:35 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:46:35 user nova-compute[72382]: DEBUG nova.compute.manager [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Cleaning up deleted instances with incomplete migration  {{(pid=72382) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 09 15:46:37 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:46:37 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:46:37 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72382) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 15:46:37 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72382) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 15:46:37 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72382) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 15:46:37 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:46:42 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:46:42 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:46:47 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:46:47 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:46:47 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72382) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 15:46:47 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72382) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 15:46:47 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72382) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 15:46:47 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:46:52 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:46:57 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:46:59 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:47:00 user nova-compute[72382]: DEBUG nova.compute.manager [req-a41d730d-da4f-4ae8-9feb-29d3c2505df8 req-d3a3058f-9a77-414f-808b-aad8f104a88b service nova] [instance: fe1af384-aa97-4c21-8440-8b0ebb711d50] Received event network-changed-2e30f2fa-a90a-4b8d-adbf-d428a802fd0f {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:47:00 user nova-compute[72382]: DEBUG nova.compute.manager [req-a41d730d-da4f-4ae8-9feb-29d3c2505df8 req-d3a3058f-9a77-414f-808b-aad8f104a88b service nova] [instance: fe1af384-aa97-4c21-8440-8b0ebb711d50] Refreshing instance network info cache due to event network-changed-2e30f2fa-a90a-4b8d-adbf-d428a802fd0f. {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 15:47:00 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-a41d730d-da4f-4ae8-9feb-29d3c2505df8 req-d3a3058f-9a77-414f-808b-aad8f104a88b service nova] Acquiring lock "refresh_cache-fe1af384-aa97-4c21-8440-8b0ebb711d50" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 15:47:00 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-a41d730d-da4f-4ae8-9feb-29d3c2505df8 req-d3a3058f-9a77-414f-808b-aad8f104a88b service nova] Acquired lock "refresh_cache-fe1af384-aa97-4c21-8440-8b0ebb711d50" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 15:47:00 user nova-compute[72382]: DEBUG nova.network.neutron [req-a41d730d-da4f-4ae8-9feb-29d3c2505df8 req-d3a3058f-9a77-414f-808b-aad8f104a88b service nova] [instance: fe1af384-aa97-4c21-8440-8b0ebb711d50] Refreshing network info cache for port 2e30f2fa-a90a-4b8d-adbf-d428a802fd0f {{(pid=72382) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 15:47:00 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:47:00 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-2b159a2e-ae68-4819-aff4-4f02642d13f9 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] Acquiring lock "fe1af384-aa97-4c21-8440-8b0ebb711d50" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:47:00 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-2b159a2e-ae68-4819-aff4-4f02642d13f9 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] Lock "fe1af384-aa97-4c21-8440-8b0ebb711d50" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:47:00 user nova-compute[72382]: DEBUG nova.objects.instance [None req-2b159a2e-ae68-4819-aff4-4f02642d13f9 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] Lazy-loading 'flavor' on Instance uuid fe1af384-aa97-4c21-8440-8b0ebb711d50 {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:47:00 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-2b159a2e-ae68-4819-aff4-4f02642d13f9 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] Lock "fe1af384-aa97-4c21-8440-8b0ebb711d50" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:47:00 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-2b159a2e-ae68-4819-aff4-4f02642d13f9 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] Acquiring lock "fe1af384-aa97-4c21-8440-8b0ebb711d50" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:47:00 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-2b159a2e-ae68-4819-aff4-4f02642d13f9 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] Lock "fe1af384-aa97-4c21-8440-8b0ebb711d50" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:47:00 user nova-compute[72382]: INFO nova.compute.manager [None req-2b159a2e-ae68-4819-aff4-4f02642d13f9 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] [instance: fe1af384-aa97-4c21-8440-8b0ebb711d50] Attaching volume 84e85ad3-553c-40f5-a345-d6df215fb5c1 to /dev/vdb
Aug 09 15:47:00 user nova-compute[72382]: DEBUG os_brick.utils [None req-2b159a2e-ae68-4819-aff4-4f02642d13f9 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 15:47:00 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:47:00 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:47:00 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[506f996a-8b67-41ca-bced-fd6eae0407e9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d2cfa7015fe\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:47:00 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:47:00 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:47:00 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6e7d75c-8376-4b70-80db-2a9056f276ae]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:47:00 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:47:00 user nova-compute[72382]: DEBUG nova.network.neutron [req-a41d730d-da4f-4ae8-9feb-29d3c2505df8 req-d3a3058f-9a77-414f-808b-aad8f104a88b service nova] [instance: fe1af384-aa97-4c21-8440-8b0ebb711d50] Updated VIF entry in instance network info cache for port 2e30f2fa-a90a-4b8d-adbf-d428a802fd0f. {{(pid=72382) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 15:47:00 user nova-compute[72382]: DEBUG nova.network.neutron [req-a41d730d-da4f-4ae8-9feb-29d3c2505df8 req-d3a3058f-9a77-414f-808b-aad8f104a88b service nova] [instance: fe1af384-aa97-4c21-8440-8b0ebb711d50] Updating instance_info_cache with network_info: [{"id": "2e30f2fa-a90a-4b8d-adbf-d428a802fd0f", "address": "fa:16:3e:64:1a:ee", "network": {"id": "ca2010c6-c431-44c8-8742-22a4fcf15754", "bridge": "br-int", "label": "tempest-TestStampPattern-1529830938-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.219", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a826d26871fb474ba904e1550f9ee103", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e30f2fa-a9", "ovs_interfaceid": "2e30f2fa-a90a-4b8d-adbf-d428a802fd0f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:47:00 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:47:00 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6b3197a-1080-4fd3-bbd8-0e92a14e4b8b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:47:00 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[0407af57-efe4-41df-a207-93644019e80d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:47:00 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-2b159a2e-ae68-4819-aff4-4f02642d13f9 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] Running cmd (subprocess): nvme version {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:47:00 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-2b159a2e-ae68-4819-aff4-4f02642d13f9 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] 'nvme version' failed. Not Retrying. {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 15:47:00 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2b159a2e-ae68-4819-aff4-4f02642d13f9 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] nvme not present on system {{(pid=72382) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 15:47:00 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-a41d730d-da4f-4ae8-9feb-29d3c2505df8 req-d3a3058f-9a77-414f-808b-aad8f104a88b service nova] Releasing lock "refresh_cache-fe1af384-aa97-4c21-8440-8b0ebb711d50" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 15:47:00 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:47:00 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 15:47:00 user nova-compute[72382]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 15:47:00 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb508dea-a68c-4620-99a3-5384536d5a74]: (4, '') {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:47:00 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.lightos [None req-2b159a2e-ae68-4819-aff4-4f02642d13f9 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72382) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 15:47:00 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.lightos [None req-2b159a2e-ae68-4819-aff4-4f02642d13f9 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72382) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 15:47:00 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.lightos [None req-2b159a2e-ae68-4819-aff4-4f02642d13f9 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] LIGHTOS: no hostnqn found. {{(pid=72382) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 15:47:00 user nova-compute[72382]: DEBUG os_brick.utils [None req-2b159a2e-ae68-4819-aff4-4f02642d13f9 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d2cfa7015fe', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 15:47:00 user nova-compute[72382]: DEBUG nova.virt.block_device [None req-2b159a2e-ae68-4819-aff4-4f02642d13f9 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] [instance: fe1af384-aa97-4c21-8440-8b0ebb711d50] Updating existing volume attachment record: d5e2a348-e9b9-498a-8b38-85571be723f5 {{(pid=72382) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 15:47:02 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:47:05 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:47:06 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-3fd9181a-349d-4673-ab20-b3c7581f55ef tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Acquiring lock "0c1b05ee-4fc3-44b9-b689-52d07841da4c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:47:06 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-3fd9181a-349d-4673-ab20-b3c7581f55ef tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Lock "0c1b05ee-4fc3-44b9-b689-52d07841da4c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:47:06 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-3fd9181a-349d-4673-ab20-b3c7581f55ef tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Acquiring lock "0c1b05ee-4fc3-44b9-b689-52d07841da4c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:47:06 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-3fd9181a-349d-4673-ab20-b3c7581f55ef tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Lock "0c1b05ee-4fc3-44b9-b689-52d07841da4c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:47:06 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-3fd9181a-349d-4673-ab20-b3c7581f55ef tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Lock "0c1b05ee-4fc3-44b9-b689-52d07841da4c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:47:06 user nova-compute[72382]: INFO nova.compute.manager [None req-3fd9181a-349d-4673-ab20-b3c7581f55ef tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] [instance: 0c1b05ee-4fc3-44b9-b689-52d07841da4c] Terminating instance
Aug 09 15:47:06 user nova-compute[72382]: DEBUG nova.compute.manager [None req-3fd9181a-349d-4673-ab20-b3c7581f55ef tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] [instance: 0c1b05ee-4fc3-44b9-b689-52d07841da4c] Start destroying the instance on the hypervisor. {{(pid=72382) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 15:47:06 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:47:06 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:47:06 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:47:06 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:47:06 user nova-compute[72382]: DEBUG nova.compute.manager [req-f0a36193-b2ef-4617-a702-06c41efcd31d req-0fe04d5b-db0b-4904-8650-31b06a0310e8 service nova] [instance: 0c1b05ee-4fc3-44b9-b689-52d07841da4c] Received event network-vif-unplugged-b339298b-9a14-4a36-a53e-7d1e6a2d85ff {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:47:06 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-f0a36193-b2ef-4617-a702-06c41efcd31d req-0fe04d5b-db0b-4904-8650-31b06a0310e8 service nova] Acquiring lock "0c1b05ee-4fc3-44b9-b689-52d07841da4c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:47:06 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-f0a36193-b2ef-4617-a702-06c41efcd31d req-0fe04d5b-db0b-4904-8650-31b06a0310e8 service nova] Lock "0c1b05ee-4fc3-44b9-b689-52d07841da4c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:47:06 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-f0a36193-b2ef-4617-a702-06c41efcd31d req-0fe04d5b-db0b-4904-8650-31b06a0310e8 service nova] Lock "0c1b05ee-4fc3-44b9-b689-52d07841da4c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:47:06 user nova-compute[72382]: DEBUG nova.compute.manager [req-f0a36193-b2ef-4617-a702-06c41efcd31d req-0fe04d5b-db0b-4904-8650-31b06a0310e8 service nova] [instance: 0c1b05ee-4fc3-44b9-b689-52d07841da4c] No waiting events found dispatching network-vif-unplugged-b339298b-9a14-4a36-a53e-7d1e6a2d85ff {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:47:06 user nova-compute[72382]: DEBUG nova.compute.manager [req-f0a36193-b2ef-4617-a702-06c41efcd31d req-0fe04d5b-db0b-4904-8650-31b06a0310e8 service nova] [instance: 0c1b05ee-4fc3-44b9-b689-52d07841da4c] Received event network-vif-unplugged-b339298b-9a14-4a36-a53e-7d1e6a2d85ff for instance with task_state deleting. {{(pid=72382) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 15:47:07 user nova-compute[72382]: INFO nova.virt.libvirt.driver [-] [instance: 0c1b05ee-4fc3-44b9-b689-52d07841da4c] Instance destroyed successfully.
Aug 09 15:47:07 user nova-compute[72382]: DEBUG nova.objects.instance [None req-3fd9181a-349d-4673-ab20-b3c7581f55ef tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Lazy-loading 'resources' on Instance uuid 0c1b05ee-4fc3-44b9-b689-52d07841da4c {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:47:07 user nova-compute[72382]: DEBUG nova.virt.libvirt.vif [None req-3fd9181a-349d-4673-ab20-b3c7581f55ef tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T15:42:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1772014179',display_name='tempest-TestMinimumBasicScenario-server-1772014179',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1772014179',id=49,image_ref='1acc9c2a-7ce4-4608-9bd6-0fad9daed3a6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA0Q7q04BVtFxGwVhvVPP37gEOF8Ej3PCxEU0HRUacrq6aiMHnSYiLIplHUzjNSR09VO3ZAOR9JDYeWh9QUge+3OwvRdDFkfbjvfVygyBrvBfOOD23ZlsyvcAc+lY1yEdQ==',key_name='tempest-TestMinimumBasicScenario-1554981330',keypairs=<?>,launch_index=0,launched_at=2023-08-09T15:42:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='93c87775443b4abd987197c4b46693bc',ramdisk_id='',reservation_id='r-d86xbslt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1acc9c2a-7ce4-4608-9bd6-0fad9daed3a6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-389394165',owner_user_name='tempest-TestMinimumBasicScenario-389394165-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T15:44:25Z,user_data=None,user_id='12ac8eca784e480d86c8fff801e73d2d',uuid=0c1b05ee-4fc3-44b9-b689-52d07841da4c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b339298b-9a14-4a36-a53e-7d1e6a2d85ff", "address": "fa:16:3e:d4:06:6f", "network": {"id": "8d929426-09f7-49b5-a79e-711e20e00750", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1307802727-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93c87775443b4abd987197c4b46693bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb339298b-9a", "ovs_interfaceid": "b339298b-9a14-4a36-a53e-7d1e6a2d85ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 15:47:07 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-3fd9181a-349d-4673-ab20-b3c7581f55ef tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Converting VIF {"id": "b339298b-9a14-4a36-a53e-7d1e6a2d85ff", "address": "fa:16:3e:d4:06:6f", "network": {"id": "8d929426-09f7-49b5-a79e-711e20e00750", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1307802727-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93c87775443b4abd987197c4b46693bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb339298b-9a", "ovs_interfaceid": "b339298b-9a14-4a36-a53e-7d1e6a2d85ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 15:47:07 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-3fd9181a-349d-4673-ab20-b3c7581f55ef tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d4:06:6f,bridge_name='br-int',has_traffic_filtering=True,id=b339298b-9a14-4a36-a53e-7d1e6a2d85ff,network=Network(8d929426-09f7-49b5-a79e-711e20e00750),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb339298b-9a') {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 15:47:07 user nova-compute[72382]: DEBUG os_vif [None req-3fd9181a-349d-4673-ab20-b3c7581f55ef tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d4:06:6f,bridge_name='br-int',has_traffic_filtering=True,id=b339298b-9a14-4a36-a53e-7d1e6a2d85ff,network=Network(8d929426-09f7-49b5-a79e-711e20e00750),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb339298b-9a') {{(pid=72382) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 15:47:07 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:47:07 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb339298b-9a, bridge=br-int, if_exists=True) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:47:07 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:47:07 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:47:07 user nova-compute[72382]: INFO os_vif [None req-3fd9181a-349d-4673-ab20-b3c7581f55ef tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d4:06:6f,bridge_name='br-int',has_traffic_filtering=True,id=b339298b-9a14-4a36-a53e-7d1e6a2d85ff,network=Network(8d929426-09f7-49b5-a79e-711e20e00750),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb339298b-9a')
Aug 09 15:47:07 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-3fd9181a-349d-4673-ab20-b3c7581f55ef tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] [instance: 0c1b05ee-4fc3-44b9-b689-52d07841da4c] Deleting instance files /opt/stack/data/nova/instances/0c1b05ee-4fc3-44b9-b689-52d07841da4c_del
Aug 09 15:47:07 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-3fd9181a-349d-4673-ab20-b3c7581f55ef tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] [instance: 0c1b05ee-4fc3-44b9-b689-52d07841da4c] Deletion of /opt/stack/data/nova/instances/0c1b05ee-4fc3-44b9-b689-52d07841da4c_del complete
Aug 09 15:47:07 user nova-compute[72382]: INFO nova.compute.manager [None req-3fd9181a-349d-4673-ab20-b3c7581f55ef tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] [instance: 0c1b05ee-4fc3-44b9-b689-52d07841da4c] Took 0.86 seconds to destroy the instance on the hypervisor.
Aug 09 15:47:07 user nova-compute[72382]: DEBUG oslo.service.loopingcall [None req-3fd9181a-349d-4673-ab20-b3c7581f55ef tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72382) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 15:47:07 user nova-compute[72382]: DEBUG nova.compute.manager [-] [instance: 0c1b05ee-4fc3-44b9-b689-52d07841da4c] Deallocating network for instance {{(pid=72382) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 15:47:07 user nova-compute[72382]: DEBUG nova.network.neutron [-] [instance: 0c1b05ee-4fc3-44b9-b689-52d07841da4c] deallocate_for_instance() {{(pid=72382) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 15:47:07 user nova-compute[72382]: DEBUG nova.network.neutron [-] [instance: 0c1b05ee-4fc3-44b9-b689-52d07841da4c] Updating instance_info_cache with network_info: [] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:47:07 user nova-compute[72382]: INFO nova.compute.manager [-] [instance: 0c1b05ee-4fc3-44b9-b689-52d07841da4c] Took 0.44 seconds to deallocate network for instance.
Aug 09 15:47:07 user nova-compute[72382]: DEBUG nova.compute.manager [req-9a95987b-cf3a-4272-a4df-916f966fed1d req-948bf0ed-e4a6-4029-b1de-10b01996a1de service nova] [instance: 0c1b05ee-4fc3-44b9-b689-52d07841da4c] Received event network-vif-deleted-b339298b-9a14-4a36-a53e-7d1e6a2d85ff {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:47:07 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-3fd9181a-349d-4673-ab20-b3c7581f55ef tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:47:07 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-3fd9181a-349d-4673-ab20-b3c7581f55ef tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:47:07 user nova-compute[72382]: DEBUG nova.scheduler.client.report [None req-3fd9181a-349d-4673-ab20-b3c7581f55ef tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Refreshing inventories for resource provider 7b15b0e5-df4d-49db-833b-2855d21d10ae {{(pid=72382) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 09 15:47:08 user nova-compute[72382]: DEBUG nova.scheduler.client.report [None req-3fd9181a-349d-4673-ab20-b3c7581f55ef tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Updating ProviderTree inventory for provider 7b15b0e5-df4d-49db-833b-2855d21d10ae from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72382) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 09 15:47:08 user nova-compute[72382]: DEBUG nova.compute.provider_tree [None req-3fd9181a-349d-4673-ab20-b3c7581f55ef tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Updating inventory in ProviderTree for provider 7b15b0e5-df4d-49db-833b-2855d21d10ae with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72382) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 09 15:47:08 user nova-compute[72382]: DEBUG nova.scheduler.client.report [None req-3fd9181a-349d-4673-ab20-b3c7581f55ef tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Refreshing aggregate associations for resource provider 7b15b0e5-df4d-49db-833b-2855d21d10ae, aggregates: None {{(pid=72382) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 09 15:47:08 user nova-compute[72382]: DEBUG nova.scheduler.client.report [None req-3fd9181a-349d-4673-ab20-b3c7581f55ef tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Refreshing trait associations for resource provider 7b15b0e5-df4d-49db-833b-2855d21d10ae, traits: COMPUTE_DEVICE_TAGGING,COMPUTE_NODE,COMPUTE_VOLUME_EXTEND,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE42,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_MMX,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE2 {{(pid=72382) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 09 15:47:08 user nova-compute[72382]: DEBUG nova.compute.provider_tree [None req-3fd9181a-349d-4673-ab20-b3c7581f55ef tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Inventory has not changed in ProviderTree for provider: 7b15b0e5-df4d-49db-833b-2855d21d10ae {{(pid=72382) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 15:47:08 user nova-compute[72382]: DEBUG nova.scheduler.client.report [None req-3fd9181a-349d-4673-ab20-b3c7581f55ef tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Inventory has not changed for provider 7b15b0e5-df4d-49db-833b-2855d21d10ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72382) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 15:47:08 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-3fd9181a-349d-4673-ab20-b3c7581f55ef tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.433s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:47:08 user nova-compute[72382]: INFO nova.scheduler.client.report [None req-3fd9181a-349d-4673-ab20-b3c7581f55ef tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Deleted allocations for instance 0c1b05ee-4fc3-44b9-b689-52d07841da4c
Aug 09 15:47:08 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-3fd9181a-349d-4673-ab20-b3c7581f55ef tempest-TestMinimumBasicScenario-389394165 tempest-TestMinimumBasicScenario-389394165-project-member] Lock "0c1b05ee-4fc3-44b9-b689-52d07841da4c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.906s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:47:08 user nova-compute[72382]: DEBUG nova.compute.manager [req-d1bc644b-653c-45c6-ae43-b74a73ef3c93 req-e818494c-e07b-4f94-a7c6-5abdeb968d37 service nova] [instance: 0c1b05ee-4fc3-44b9-b689-52d07841da4c] Received event network-vif-plugged-b339298b-9a14-4a36-a53e-7d1e6a2d85ff {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:47:08 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-d1bc644b-653c-45c6-ae43-b74a73ef3c93 req-e818494c-e07b-4f94-a7c6-5abdeb968d37 service nova] Acquiring lock "0c1b05ee-4fc3-44b9-b689-52d07841da4c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:47:08 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-d1bc644b-653c-45c6-ae43-b74a73ef3c93 req-e818494c-e07b-4f94-a7c6-5abdeb968d37 service nova] Lock "0c1b05ee-4fc3-44b9-b689-52d07841da4c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:47:08 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-d1bc644b-653c-45c6-ae43-b74a73ef3c93 req-e818494c-e07b-4f94-a7c6-5abdeb968d37 service nova] Lock "0c1b05ee-4fc3-44b9-b689-52d07841da4c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:47:08 user nova-compute[72382]: DEBUG nova.compute.manager [req-d1bc644b-653c-45c6-ae43-b74a73ef3c93 req-e818494c-e07b-4f94-a7c6-5abdeb968d37 service nova] [instance: 0c1b05ee-4fc3-44b9-b689-52d07841da4c] No waiting events found dispatching network-vif-plugged-b339298b-9a14-4a36-a53e-7d1e6a2d85ff {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:47:08 user nova-compute[72382]: WARNING nova.compute.manager [req-d1bc644b-653c-45c6-ae43-b74a73ef3c93 req-e818494c-e07b-4f94-a7c6-5abdeb968d37 service nova] [instance: 0c1b05ee-4fc3-44b9-b689-52d07841da4c] Received unexpected event network-vif-plugged-b339298b-9a14-4a36-a53e-7d1e6a2d85ff for instance with vm_state deleted and task_state None.
Aug 09 15:47:09 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2b159a2e-ae68-4819-aff4-4f02642d13f9 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] [instance: fe1af384-aa97-4c21-8440-8b0ebb711d50] Calling os-brick to attach iSCSI Volume {{(pid=72382) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 15:47:09 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b159a2e-ae68-4819-aff4-4f02642d13f9 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2a0c768340>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:84e85ad3-553c-40f5-a345-d6df215fb5c1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IsVzqJEA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 15:47:09 user nova-compute[72382]: WARNING os_brick.initiator.connectors.base [None req-2b159a2e-ae68-4819-aff4-4f02642d13f9 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 15:47:09 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-2b159a2e-ae68-4819-aff4-4f02642d13f9 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 15:47:09 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-2b159a2e-ae68-4819-aff4-4f02642d13f9 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 15:47:09 user nova-compute[72382]: WARNING os_brick.initiator.connectors.base [None req-2b159a2e-ae68-4819-aff4-4f02642d13f9 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 15:47:09 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-2b159a2e-ae68-4819-aff4-4f02642d13f9 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:84e85ad3-553c-40f5-a345-d6df215fb5c1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 15:47:09 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-2b159a2e-ae68-4819-aff4-4f02642d13f9 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:84e85ad3-553c-40f5-a345-d6df215fb5c1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 15:47:09 user nova-compute[72382]: INFO os_brick.initiator.connectors.iscsi [None req-2b159a2e-ae68-4819-aff4-4f02642d13f9 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 15:47:09 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84e85ad3-553c-40f5-a345-d6df215fb5c1 -p 172.16.0.220:3260 {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:47:09 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84e85ad3-553c-40f5-a345-d6df215fb5c1 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:47:09 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[5274d0c8-cf65-4af5-aa30-6c919c02ffeb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:47:09 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b159a2e-ae68-4819-aff4-4f02642d13f9 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 15:47:09 user nova-compute[72382]:  {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:47:09 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84e85ad3-553c-40f5-a345-d6df215fb5c1 -p 172.16.0.220:3260 --interface default --op new {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:47:09 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84e85ad3-553c-40f5-a345-d6df215fb5c1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:47:09 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[085f0932-2c12-4263-a93c-ab894d7e6b16]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:84e85ad3-553c-40f5-a345-d6df215fb5c1] added\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:47:09 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b159a2e-ae68-4819-aff4-4f02642d13f9 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:84e85ad3-553c-40f5-a345-d6df215fb5c1] added
Aug 09 15:47:09 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:47:09 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84e85ad3-553c-40f5-a345-d6df215fb5c1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:47:09 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84e85ad3-553c-40f5-a345-d6df215fb5c1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:47:09 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[51d251e8-6d26-44af-949c-aa350872616f]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:47:09 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b159a2e-ae68-4819-aff4-4f02642d13f9 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:47:09 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84e85ad3-553c-40f5-a345-d6df215fb5c1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:47:09 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84e85ad3-553c-40f5-a345-d6df215fb5c1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:47:09 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf476d11-99b0-42e4-9a63-5c00424a537a]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:47:09 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b159a2e-ae68-4819-aff4-4f02642d13f9 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:47:09 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84e85ad3-553c-40f5-a345-d6df215fb5c1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IsVzqJEA {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:47:09 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84e85ad3-553c-40f5-a345-d6df215fb5c1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IsVzqJEA" returned: 0 in 0.021s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:47:09 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[675231eb-367d-4ec5-b357-4db528542cdb]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:47:09 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b159a2e-ae68-4819-aff4-4f02642d13f9 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IsVzqJEA'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:47:09 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84e85ad3-553c-40f5-a345-d6df215fb5c1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:47:09 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84e85ad3-553c-40f5-a345-d6df215fb5c1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:47:09 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a023457-08b3-4589-ad62-facc6c623779]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:47:09 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b159a2e-ae68-4819-aff4-4f02642d13f9 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:47:09 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:47:09 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:47:09 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[e74dfe08-45d0-456a-8b81-a9f452b31379]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:47:09 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b159a2e-ae68-4819-aff4-4f02642d13f9 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 09 15:47:09 user nova-compute[72382]:  {{(pid=72382) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 15:47:09 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b159a2e-ae68-4819-aff4-4f02642d13f9 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 09 15:47:09 user nova-compute[72382]:  {{(pid=72382) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 15:47:09 user nova-compute[72382]: WARNING os_brick.initiator.connectors.iscsi [None req-2b159a2e-ae68-4819-aff4-4f02642d13f9 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 09 15:47:09 user nova-compute[72382]: 
Aug 09 15:47:09 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84e85ad3-553c-40f5-a345-d6df215fb5c1 -p 172.16.0.220:3260 --login {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:47:09 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84e85ad3-553c-40f5-a345-d6df215fb5c1 -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:47:09 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[678d7c00-afcd-4aeb-bd10-fac08acc67e1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:84e85ad3-553c-40f5-a345-d6df215fb5c1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:84e85ad3-553c-40f5-a345-d6df215fb5c1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:47:09 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b159a2e-ae68-4819-aff4-4f02642d13f9 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:84e85ad3-553c-40f5-a345-d6df215fb5c1, portal: 172.16.0.220,3260]
Aug 09 15:47:09 user nova-compute[72382]: Login to [iface: default, target: iqn.2010-10.org.openstack:84e85ad3-553c-40f5-a345-d6df215fb5c1, portal: 172.16.0.220,3260] successful.
Aug 09 15:47:09 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:47:09 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84e85ad3-553c-40f5-a345-d6df215fb5c1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:47:09 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84e85ad3-553c-40f5-a345-d6df215fb5c1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:47:09 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[25460258-2bb1-4ef9-9970-2ea917728e31]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:47:09 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b159a2e-ae68-4819-aff4-4f02642d13f9 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:47:09 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:47:09 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:47:09 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[f40beb33-645a-461c-a190-d91883f71f3b]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84e85ad3-553c-40f5-a345-d6df215fb5c1 (non-flash)\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:47:09 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b159a2e-ae68-4819-aff4-4f02642d13f9 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84e85ad3-553c-40f5-a345-d6df215fb5c1 (non-flash)
Aug 09 15:47:09 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 15:47:09 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b159a2e-ae68-4819-aff4-4f02642d13f9 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84e85ad3-553c-40f5-a345-d6df215fb5c1 (non-flash)
Aug 09 15:47:09 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 15:47:09 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-2b159a2e-ae68-4819-aff4-4f02642d13f9 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:84e85ad3-553c-40f5-a345-d6df215fb5c1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.258s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 15:47:09 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b159a2e-ae68-4819-aff4-4f02642d13f9 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] Connected to 172.16.0.220:3260 {{(pid=72382) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 15:47:09 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-2b159a2e-ae68-4819-aff4-4f02642d13f9 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] HCTL ('33', '-', '-', 0) found on session 61 with lun 0 {{(pid=72382) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 15:47:09 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-2b159a2e-ae68-4819-aff4-4f02642d13f9 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72382) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 15:47:09 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:47:09 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:47:09 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[18233d3f-13e8-4806-a54a-53a27898c682]: (4, ('- - 0', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:47:09 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-2b159a2e-ae68-4819-aff4-4f02642d13f9 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] Searching for a device in session 61 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72382) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 15:47:09 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b159a2e-ae68-4819-aff4-4f02642d13f9 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IsVzqJEA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72382) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 15:47:10 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:47:10 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-2b159a2e-ae68-4819-aff4-4f02642d13f9 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.291s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 15:47:10 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b159a2e-ae68-4819-aff4-4f02642d13f9 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] <== connect_volume: return (1292ms) {'type': 'block', 'scsi_wwn': '23836386336313961', 'path': '/dev/sdb'} {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 15:47:10 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2b159a2e-ae68-4819-aff4-4f02642d13f9 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] [instance: fe1af384-aa97-4c21-8440-8b0ebb711d50] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23836386336313961', 'path': '/dev/sdb'} {{(pid=72382) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 15:47:10 user nova-compute[72382]: DEBUG nova.objects.instance [None req-2b159a2e-ae68-4819-aff4-4f02642d13f9 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] Lazy-loading 'flavor' on Instance uuid fe1af384-aa97-4c21-8440-8b0ebb711d50 {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:47:10 user nova-compute[72382]: DEBUG nova.virt.libvirt.guest [None req-2b159a2e-ae68-4819-aff4-4f02642d13f9 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 15:47:10 user nova-compute[72382]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 15:47:10 user nova-compute[72382]:   <source dev="/dev/sdb"/>
Aug 09 15:47:10 user nova-compute[72382]:   <target dev="vdb" bus="virtio"/>
Aug 09 15:47:10 user nova-compute[72382]:   <serial>84e85ad3-553c-40f5-a345-d6df215fb5c1</serial>
Aug 09 15:47:10 user nova-compute[72382]: </disk>
Aug 09 15:47:10 user nova-compute[72382]:  {{(pid=72382) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 15:47:10 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-2b159a2e-ae68-4819-aff4-4f02642d13f9 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] No BDM found with device name vda, not building metadata. {{(pid=72382) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 15:47:10 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-2b159a2e-ae68-4819-aff4-4f02642d13f9 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72382) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 15:47:10 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-2b159a2e-ae68-4819-aff4-4f02642d13f9 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] No VIF found with MAC fa:16:3e:64:1a:ee, not building metadata {{(pid=72382) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 15:47:10 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-2b159a2e-ae68-4819-aff4-4f02642d13f9 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] Lock "fe1af384-aa97-4c21-8440-8b0ebb711d50" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.169s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:47:12 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:47:12 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5e89314-1a77-47e2-8673-cd981c8e1ba9 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] Acquiring lock "fe1af384-aa97-4c21-8440-8b0ebb711d50" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:47:12 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5e89314-1a77-47e2-8673-cd981c8e1ba9 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] Lock "fe1af384-aa97-4c21-8440-8b0ebb711d50" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:47:12 user nova-compute[72382]: INFO nova.compute.manager [None req-e5e89314-1a77-47e2-8673-cd981c8e1ba9 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] [instance: fe1af384-aa97-4c21-8440-8b0ebb711d50] Detaching volume 84e85ad3-553c-40f5-a345-d6df215fb5c1
Aug 09 15:47:12 user nova-compute[72382]: INFO nova.virt.block_device [None req-e5e89314-1a77-47e2-8673-cd981c8e1ba9 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] [instance: fe1af384-aa97-4c21-8440-8b0ebb711d50] Attempting to driver detach volume 84e85ad3-553c-40f5-a345-d6df215fb5c1 from mountpoint /dev/vdb
Aug 09 15:47:12 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-e5e89314-1a77-47e2-8673-cd981c8e1ba9 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] Attempting to detach device vdb from instance fe1af384-aa97-4c21-8440-8b0ebb711d50 from the persistent domain config. {{(pid=72382) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 15:47:12 user nova-compute[72382]: DEBUG nova.virt.libvirt.guest [None req-e5e89314-1a77-47e2-8673-cd981c8e1ba9 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 15:47:12 user nova-compute[72382]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 15:47:12 user nova-compute[72382]:   <source dev="/dev/sdb"/>
Aug 09 15:47:12 user nova-compute[72382]:   <target dev="vdb" bus="virtio"/>
Aug 09 15:47:12 user nova-compute[72382]:   <serial>84e85ad3-553c-40f5-a345-d6df215fb5c1</serial>
Aug 09 15:47:12 user nova-compute[72382]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 15:47:12 user nova-compute[72382]: </disk>
Aug 09 15:47:12 user nova-compute[72382]:  {{(pid=72382) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 15:47:12 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-e5e89314-1a77-47e2-8673-cd981c8e1ba9 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] Successfully detached device vdb from instance fe1af384-aa97-4c21-8440-8b0ebb711d50 from the persistent domain config.
Aug 09 15:47:12 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-e5e89314-1a77-47e2-8673-cd981c8e1ba9 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance fe1af384-aa97-4c21-8440-8b0ebb711d50 from the live domain config. {{(pid=72382) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 15:47:12 user nova-compute[72382]: DEBUG nova.virt.libvirt.guest [None req-e5e89314-1a77-47e2-8673-cd981c8e1ba9 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 15:47:12 user nova-compute[72382]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 15:47:12 user nova-compute[72382]:   <source dev="/dev/sdb"/>
Aug 09 15:47:12 user nova-compute[72382]:   <target dev="vdb" bus="virtio"/>
Aug 09 15:47:12 user nova-compute[72382]:   <serial>84e85ad3-553c-40f5-a345-d6df215fb5c1</serial>
Aug 09 15:47:12 user nova-compute[72382]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 15:47:12 user nova-compute[72382]: </disk>
Aug 09 15:47:12 user nova-compute[72382]:  {{(pid=72382) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 15:47:13 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Received event <DeviceRemovedEvent: 1691596033.1108017, fe1af384-aa97-4c21-8440-8b0ebb711d50 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72382) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 15:47:13 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-e5e89314-1a77-47e2-8673-cd981c8e1ba9 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance fe1af384-aa97-4c21-8440-8b0ebb711d50 {{(pid=72382) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 15:47:13 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-e5e89314-1a77-47e2-8673-cd981c8e1ba9 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] Successfully detached device vdb from instance fe1af384-aa97-4c21-8440-8b0ebb711d50 from the live domain config.
Aug 09 15:47:13 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e5e89314-1a77-47e2-8673-cd981c8e1ba9 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] [instance: fe1af384-aa97-4c21-8440-8b0ebb711d50] calling os-brick to detach iSCSI Volume {{(pid=72382) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 15:47:13 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5e89314-1a77-47e2-8673-cd981c8e1ba9 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2a0c768340>, {'target_iqns': ['iqn.2010-10.org.openstack:84e85ad3-553c-40f5-a345-d6df215fb5c1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IsVzqJEA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 15:47:13 user nova-compute[72382]: WARNING os_brick.initiator.connectors.base [None req-e5e89314-1a77-47e2-8673-cd981c8e1ba9 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 15:47:13 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-e5e89314-1a77-47e2-8673-cd981c8e1ba9 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 15:47:13 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-e5e89314-1a77-47e2-8673-cd981c8e1ba9 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 15:47:13 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5e89314-1a77-47e2-8673-cd981c8e1ba9 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:84e85ad3-553c-40f5-a345-d6df215fb5c1', 0)] {{(pid=72382) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 15:47:13 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:47:13 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:47:13 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ead560f-eded-4f66-bfaf-471c8c1ca550]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:84e85ad3-553c-40f5-a345-d6df215fb5c1\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:47:13 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:47:13 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:47:13 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[edf7a1e1-20d1-4f77-9b87-c25db1a7d11b]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84e85ad3-553c-40f5-a345-d6df215fb5c1 (non-flash)\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:47:13 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5e89314-1a77-47e2-8673-cd981c8e1ba9 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84e85ad3-553c-40f5-a345-d6df215fb5c1 (non-flash)
Aug 09 15:47:13 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 15:47:13 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5e89314-1a77-47e2-8673-cd981c8e1ba9 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84e85ad3-553c-40f5-a345-d6df215fb5c1 (non-flash)
Aug 09 15:47:13 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 15:47:13 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5e89314-1a77-47e2-8673-cd981c8e1ba9 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2a241efd00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:84e85ad3-553c-40f5-a345-d6df215fb5c1'): ({'sdb'}, set())}) {{(pid=72382) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 15:47:13 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-e5e89314-1a77-47e2-8673-cd981c8e1ba9 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] Removing single pathed devices sdb {{(pid=72382) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 15:47:13 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:47:13 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:47:13 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fdf94a2-e725-4279-946c-fac283a8abae]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:47:13 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:47:13 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:47:13 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[f74de0c9-227c-4b7d-8a58-d94696a23af6]: (4, ('ok\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:47:13 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-e5e89314-1a77-47e2-8673-cd981c8e1ba9 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] Flushing IO for device /dev/sdb {{(pid=72382) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 15:47:13 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:47:13 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:47:13 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bc339c4-da44-4110-a74c-09f3e3887d52]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:47:13 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-e5e89314-1a77-47e2-8673-cd981c8e1ba9 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72382) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 15:47:13 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:47:13 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:47:13 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[64a50f76-aa2a-4570-92be-5e73805776ba]: (4, ('1', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:47:13 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-e5e89314-1a77-47e2-8673-cd981c8e1ba9 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72382) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 15:47:13 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-e5e89314-1a77-47e2-8673-cd981c8e1ba9 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] SCSI volumes sdb have been removed. {{(pid=72382) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 15:47:13 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5e89314-1a77-47e2-8673-cd981c8e1ba9 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:84e85ad3-553c-40f5-a345-d6df215fb5c1')] {{(pid=72382) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 15:47:13 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84e85ad3-553c-40f5-a345-d6df215fb5c1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:47:13 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84e85ad3-553c-40f5-a345-d6df215fb5c1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:47:13 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe7eac21-03a1-44d7-aeaf-841ea001412e]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:47:13 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5e89314-1a77-47e2-8673-cd981c8e1ba9 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:47:13 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84e85ad3-553c-40f5-a345-d6df215fb5c1 -p 172.16.0.220:3260 --logout {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:47:13 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84e85ad3-553c-40f5-a345-d6df215fb5c1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.047s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:47:13 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2014aee-6109-4082-89d4-493c0775c318]: (4, ('Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:84e85ad3-553c-40f5-a345-d6df215fb5c1, portal: 172.16.0.220,3260]\nLogout of [sid: 61, target: iqn.2010-10.org.openstack:84e85ad3-553c-40f5-a345-d6df215fb5c1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:47:13 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5e89314-1a77-47e2-8673-cd981c8e1ba9 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:84e85ad3-553c-40f5-a345-d6df215fb5c1, portal: 172.16.0.220,3260]
Aug 09 15:47:13 user nova-compute[72382]: Logout of [sid: 61, target: iqn.2010-10.org.openstack:84e85ad3-553c-40f5-a345-d6df215fb5c1, portal: 172.16.0.220,3260] successful.
Aug 09 15:47:13 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:47:13 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84e85ad3-553c-40f5-a345-d6df215fb5c1 -p 172.16.0.220:3260 --op delete {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:47:13 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84e85ad3-553c-40f5-a345-d6df215fb5c1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:47:13 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[dae98c23-3807-4e51-8866-f091533c73f7]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:47:13 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5e89314-1a77-47e2-8673-cd981c8e1ba9 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:47:13 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-e5e89314-1a77-47e2-8673-cd981c8e1ba9 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.247s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 15:47:13 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5e89314-1a77-47e2-8673-cd981c8e1ba9 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] <== disconnect_volume: return (248ms) None {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 15:47:13 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e5e89314-1a77-47e2-8673-cd981c8e1ba9 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] [instance: fe1af384-aa97-4c21-8440-8b0ebb711d50] Disconnected iSCSI Volume {{(pid=72382) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 15:47:14 user nova-compute[72382]: DEBUG nova.objects.instance [None req-e5e89314-1a77-47e2-8673-cd981c8e1ba9 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] Lazy-loading 'flavor' on Instance uuid fe1af384-aa97-4c21-8440-8b0ebb711d50 {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:47:14 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5e89314-1a77-47e2-8673-cd981c8e1ba9 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] Lock "fe1af384-aa97-4c21-8440-8b0ebb711d50" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.530s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:47:15 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:47:17 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:47:22 user nova-compute[72382]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691596027.2236724, 0c1b05ee-4fc3-44b9-b689-52d07841da4c => Stopped> {{(pid=72382) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 15:47:22 user nova-compute[72382]: INFO nova.compute.manager [-] [instance: 0c1b05ee-4fc3-44b9-b689-52d07841da4c] VM Stopped (Lifecycle Event)
Aug 09 15:47:22 user nova-compute[72382]: DEBUG nova.compute.manager [None req-d2ff4fca-7a1a-4125-bdd8-b9bacdb5df3e None None] [instance: 0c1b05ee-4fc3-44b9-b689-52d07841da4c] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:47:22 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:47:25 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:47:26 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:47:26 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:47:26 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:47:26 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:47:26 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:47:26 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:47:26 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Auditing locally available compute resources for user (node: user) {{(pid=72382) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 15:47:27 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe1af384-aa97-4c21-8440-8b0ebb711d50/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:47:27 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe1af384-aa97-4c21-8440-8b0ebb711d50/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:47:27 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe1af384-aa97-4c21-8440-8b0ebb711d50/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:47:27 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:47:27 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe1af384-aa97-4c21-8440-8b0ebb711d50/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:47:27 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d27c5a4-9a88-423b-9c48-9224e8248f8c/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:47:27 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d27c5a4-9a88-423b-9c48-9224e8248f8c/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:47:27 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d27c5a4-9a88-423b-9c48-9224e8248f8c/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:47:27 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d27c5a4-9a88-423b-9c48-9224e8248f8c/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:47:28 user nova-compute[72382]: WARNING nova.virt.libvirt.driver [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 15:47:28 user nova-compute[72382]: WARNING nova.virt.libvirt.driver [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 15:47:28 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Hypervisor/Node resource view: name=user free_ram=8696MB free_disk=25.173751831054688GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72382) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 15:47:28 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:47:28 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:47:28 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance 4d27c5a4-9a88-423b-9c48-9224e8248f8c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:47:28 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance fe1af384-aa97-4c21-8440-8b0ebb711d50 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:47:28 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72382) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 15:47:28 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72382) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 15:47:28 user nova-compute[72382]: DEBUG nova.compute.provider_tree [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Inventory has not changed in ProviderTree for provider: 7b15b0e5-df4d-49db-833b-2855d21d10ae {{(pid=72382) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 15:47:28 user nova-compute[72382]: DEBUG nova.scheduler.client.report [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Inventory has not changed for provider 7b15b0e5-df4d-49db-833b-2855d21d10ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72382) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 15:47:28 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Compute_service record updated for user:user {{(pid=72382) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 15:47:28 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.216s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:47:32 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:47:34 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:47:34 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:47:34 user nova-compute[72382]: DEBUG nova.compute.manager [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Starting heal instance info cache {{(pid=72382) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 15:47:34 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Acquiring lock "refresh_cache-fe1af384-aa97-4c21-8440-8b0ebb711d50" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 15:47:34 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Acquired lock "refresh_cache-fe1af384-aa97-4c21-8440-8b0ebb711d50" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 15:47:34 user nova-compute[72382]: DEBUG nova.network.neutron [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] [instance: fe1af384-aa97-4c21-8440-8b0ebb711d50] Forcefully refreshing network info cache for instance {{(pid=72382) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 15:47:34 user nova-compute[72382]: DEBUG nova.network.neutron [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] [instance: fe1af384-aa97-4c21-8440-8b0ebb711d50] Updating instance_info_cache with network_info: [{"id": "2e30f2fa-a90a-4b8d-adbf-d428a802fd0f", "address": "fa:16:3e:64:1a:ee", "network": {"id": "ca2010c6-c431-44c8-8742-22a4fcf15754", "bridge": "br-int", "label": "tempest-TestStampPattern-1529830938-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.219", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a826d26871fb474ba904e1550f9ee103", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e30f2fa-a9", "ovs_interfaceid": "2e30f2fa-a90a-4b8d-adbf-d428a802fd0f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:47:34 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Releasing lock "refresh_cache-fe1af384-aa97-4c21-8440-8b0ebb711d50" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 15:47:34 user nova-compute[72382]: DEBUG nova.compute.manager [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] [instance: fe1af384-aa97-4c21-8440-8b0ebb711d50] Updated the network info_cache for instance {{(pid=72382) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 15:47:34 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:47:34 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:47:34 user nova-compute[72382]: DEBUG nova.compute.manager [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72382) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 15:47:35 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:47:35 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:47:36 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:47:37 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:47:42 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:47:47 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:47:52 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:47:57 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:47:57 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:47:59 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:48:02 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:48:03 user nova-compute[72382]: DEBUG nova.compute.manager [req-b0ccb80d-79e0-4b04-8ef9-cfa89a0b4d90 req-fc5b0037-5dae-49d0-9755-e58836f9b888 service nova] [instance: fe1af384-aa97-4c21-8440-8b0ebb711d50] Received event network-changed-2e30f2fa-a90a-4b8d-adbf-d428a802fd0f {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:48:03 user nova-compute[72382]: DEBUG nova.compute.manager [req-b0ccb80d-79e0-4b04-8ef9-cfa89a0b4d90 req-fc5b0037-5dae-49d0-9755-e58836f9b888 service nova] [instance: fe1af384-aa97-4c21-8440-8b0ebb711d50] Refreshing instance network info cache due to event network-changed-2e30f2fa-a90a-4b8d-adbf-d428a802fd0f. {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 15:48:03 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-b0ccb80d-79e0-4b04-8ef9-cfa89a0b4d90 req-fc5b0037-5dae-49d0-9755-e58836f9b888 service nova] Acquiring lock "refresh_cache-fe1af384-aa97-4c21-8440-8b0ebb711d50" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 15:48:03 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-b0ccb80d-79e0-4b04-8ef9-cfa89a0b4d90 req-fc5b0037-5dae-49d0-9755-e58836f9b888 service nova] Acquired lock "refresh_cache-fe1af384-aa97-4c21-8440-8b0ebb711d50" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 15:48:03 user nova-compute[72382]: DEBUG nova.network.neutron [req-b0ccb80d-79e0-4b04-8ef9-cfa89a0b4d90 req-fc5b0037-5dae-49d0-9755-e58836f9b888 service nova] [instance: fe1af384-aa97-4c21-8440-8b0ebb711d50] Refreshing network info cache for port 2e30f2fa-a90a-4b8d-adbf-d428a802fd0f {{(pid=72382) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 15:48:03 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-cb8777ea-2870-4b60-adb7-2dd2e6de2c60 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] Acquiring lock "fe1af384-aa97-4c21-8440-8b0ebb711d50" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:48:03 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-cb8777ea-2870-4b60-adb7-2dd2e6de2c60 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] Lock "fe1af384-aa97-4c21-8440-8b0ebb711d50" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:48:03 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-cb8777ea-2870-4b60-adb7-2dd2e6de2c60 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] Acquiring lock "fe1af384-aa97-4c21-8440-8b0ebb711d50-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:48:03 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-cb8777ea-2870-4b60-adb7-2dd2e6de2c60 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] Lock "fe1af384-aa97-4c21-8440-8b0ebb711d50-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:48:03 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-cb8777ea-2870-4b60-adb7-2dd2e6de2c60 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] Lock "fe1af384-aa97-4c21-8440-8b0ebb711d50-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:48:03 user nova-compute[72382]: INFO nova.compute.manager [None req-cb8777ea-2870-4b60-adb7-2dd2e6de2c60 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] [instance: fe1af384-aa97-4c21-8440-8b0ebb711d50] Terminating instance
Aug 09 15:48:03 user nova-compute[72382]: DEBUG nova.compute.manager [None req-cb8777ea-2870-4b60-adb7-2dd2e6de2c60 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] [instance: fe1af384-aa97-4c21-8440-8b0ebb711d50] Start destroying the instance on the hypervisor. {{(pid=72382) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 15:48:03 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:48:03 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:48:03 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:48:03 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:48:03 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:48:03 user nova-compute[72382]: DEBUG nova.compute.manager [req-a1477bbc-52c0-4b61-b9cb-61b8efe08669 req-4ed0bec9-5455-4f81-a0e5-d54519559f72 service nova] [instance: fe1af384-aa97-4c21-8440-8b0ebb711d50] Received event network-vif-unplugged-2e30f2fa-a90a-4b8d-adbf-d428a802fd0f {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:48:03 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-a1477bbc-52c0-4b61-b9cb-61b8efe08669 req-4ed0bec9-5455-4f81-a0e5-d54519559f72 service nova] Acquiring lock "fe1af384-aa97-4c21-8440-8b0ebb711d50-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:48:03 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-a1477bbc-52c0-4b61-b9cb-61b8efe08669 req-4ed0bec9-5455-4f81-a0e5-d54519559f72 service nova] Lock "fe1af384-aa97-4c21-8440-8b0ebb711d50-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:48:03 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-a1477bbc-52c0-4b61-b9cb-61b8efe08669 req-4ed0bec9-5455-4f81-a0e5-d54519559f72 service nova] Lock "fe1af384-aa97-4c21-8440-8b0ebb711d50-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:48:03 user nova-compute[72382]: DEBUG nova.compute.manager [req-a1477bbc-52c0-4b61-b9cb-61b8efe08669 req-4ed0bec9-5455-4f81-a0e5-d54519559f72 service nova] [instance: fe1af384-aa97-4c21-8440-8b0ebb711d50] No waiting events found dispatching network-vif-unplugged-2e30f2fa-a90a-4b8d-adbf-d428a802fd0f {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:48:03 user nova-compute[72382]: DEBUG nova.compute.manager [req-a1477bbc-52c0-4b61-b9cb-61b8efe08669 req-4ed0bec9-5455-4f81-a0e5-d54519559f72 service nova] [instance: fe1af384-aa97-4c21-8440-8b0ebb711d50] Received event network-vif-unplugged-2e30f2fa-a90a-4b8d-adbf-d428a802fd0f for instance with task_state deleting. {{(pid=72382) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 15:48:04 user nova-compute[72382]: INFO nova.virt.libvirt.driver [-] [instance: fe1af384-aa97-4c21-8440-8b0ebb711d50] Instance destroyed successfully.
Aug 09 15:48:04 user nova-compute[72382]: DEBUG nova.objects.instance [None req-cb8777ea-2870-4b60-adb7-2dd2e6de2c60 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] Lazy-loading 'resources' on Instance uuid fe1af384-aa97-4c21-8440-8b0ebb711d50 {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:48:04 user nova-compute[72382]: DEBUG nova.virt.libvirt.vif [None req-cb8777ea-2870-4b60-adb7-2dd2e6de2c60 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T15:45:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-458243491',display_name='tempest-TestStampPattern-server-458243491',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-458243491',id=51,image_ref='31ab184b-ee75-44d1-ba85-f61c03de5eba',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNjio106iFL2RPDY5bqMxL7i3075CQY3HKpCfye/tyKn/rCQ1aG3GTM2r91qUJoQ3mYw8uvX3PtnblDrXm52Mqz8hUv4zCfERch5RpCXfjm7fb1444d3HAmk/t6Po924mA==',key_name='tempest-TestStampPattern-1060048663',keypairs=<?>,launch_index=0,launched_at=2023-08-09T15:45:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a826d26871fb474ba904e1550f9ee103',ramdisk_id='',reservation_id='r-cj5bpew2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='4d27c5a4-9a88-423b-9c48-9224e8248f8c',image_min_disk='1',image_min_ram='0',image_owner_id='a826d26871fb474ba904e1550f9ee103',image_owner_project_name='tempest-TestStampPattern-1111267616',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1111267616-project-member',image_user_id='273d16c265ae4868a371889eae528d02',owner_project_name='tempest-TestStampPattern-1111267616',owner_user_name='tempest-TestStampPattern-1111267616-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T15:45:17Z,user_data=None,user_id='273d16c265ae4868a371889eae528d02',uuid=fe1af384-aa97-4c21-8440-8b0ebb711d50,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2e30f2fa-a90a-4b8d-adbf-d428a802fd0f", "address": "fa:16:3e:64:1a:ee", "network": {"id": "ca2010c6-c431-44c8-8742-22a4fcf15754", "bridge": "br-int", "label": "tempest-TestStampPattern-1529830938-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.219", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a826d26871fb474ba904e1550f9ee103", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e30f2fa-a9", "ovs_interfaceid": "2e30f2fa-a90a-4b8d-adbf-d428a802fd0f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 15:48:04 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-cb8777ea-2870-4b60-adb7-2dd2e6de2c60 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] Converting VIF {"id": "2e30f2fa-a90a-4b8d-adbf-d428a802fd0f", "address": "fa:16:3e:64:1a:ee", "network": {"id": "ca2010c6-c431-44c8-8742-22a4fcf15754", "bridge": "br-int", "label": "tempest-TestStampPattern-1529830938-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.219", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a826d26871fb474ba904e1550f9ee103", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e30f2fa-a9", "ovs_interfaceid": "2e30f2fa-a90a-4b8d-adbf-d428a802fd0f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 15:48:04 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-cb8777ea-2870-4b60-adb7-2dd2e6de2c60 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:64:1a:ee,bridge_name='br-int',has_traffic_filtering=True,id=2e30f2fa-a90a-4b8d-adbf-d428a802fd0f,network=Network(ca2010c6-c431-44c8-8742-22a4fcf15754),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e30f2fa-a9') {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 15:48:04 user nova-compute[72382]: DEBUG os_vif [None req-cb8777ea-2870-4b60-adb7-2dd2e6de2c60 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:64:1a:ee,bridge_name='br-int',has_traffic_filtering=True,id=2e30f2fa-a90a-4b8d-adbf-d428a802fd0f,network=Network(ca2010c6-c431-44c8-8742-22a4fcf15754),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e30f2fa-a9') {{(pid=72382) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 15:48:04 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:48:04 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2e30f2fa-a9, bridge=br-int, if_exists=True) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:48:04 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:48:04 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:48:04 user nova-compute[72382]: INFO os_vif [None req-cb8777ea-2870-4b60-adb7-2dd2e6de2c60 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:64:1a:ee,bridge_name='br-int',has_traffic_filtering=True,id=2e30f2fa-a90a-4b8d-adbf-d428a802fd0f,network=Network(ca2010c6-c431-44c8-8742-22a4fcf15754),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e30f2fa-a9')
Aug 09 15:48:04 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-cb8777ea-2870-4b60-adb7-2dd2e6de2c60 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] [instance: fe1af384-aa97-4c21-8440-8b0ebb711d50] Deleting instance files /opt/stack/data/nova/instances/fe1af384-aa97-4c21-8440-8b0ebb711d50_del
Aug 09 15:48:04 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-cb8777ea-2870-4b60-adb7-2dd2e6de2c60 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] [instance: fe1af384-aa97-4c21-8440-8b0ebb711d50] Deletion of /opt/stack/data/nova/instances/fe1af384-aa97-4c21-8440-8b0ebb711d50_del complete
Aug 09 15:48:04 user nova-compute[72382]: INFO nova.compute.manager [None req-cb8777ea-2870-4b60-adb7-2dd2e6de2c60 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] [instance: fe1af384-aa97-4c21-8440-8b0ebb711d50] Took 0.88 seconds to destroy the instance on the hypervisor.
Aug 09 15:48:04 user nova-compute[72382]: DEBUG oslo.service.loopingcall [None req-cb8777ea-2870-4b60-adb7-2dd2e6de2c60 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72382) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 15:48:04 user nova-compute[72382]: DEBUG nova.compute.manager [-] [instance: fe1af384-aa97-4c21-8440-8b0ebb711d50] Deallocating network for instance {{(pid=72382) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 15:48:04 user nova-compute[72382]: DEBUG nova.network.neutron [-] [instance: fe1af384-aa97-4c21-8440-8b0ebb711d50] deallocate_for_instance() {{(pid=72382) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 15:48:04 user nova-compute[72382]: DEBUG nova.network.neutron [req-b0ccb80d-79e0-4b04-8ef9-cfa89a0b4d90 req-fc5b0037-5dae-49d0-9755-e58836f9b888 service nova] [instance: fe1af384-aa97-4c21-8440-8b0ebb711d50] Updated VIF entry in instance network info cache for port 2e30f2fa-a90a-4b8d-adbf-d428a802fd0f. {{(pid=72382) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 15:48:04 user nova-compute[72382]: DEBUG nova.network.neutron [req-b0ccb80d-79e0-4b04-8ef9-cfa89a0b4d90 req-fc5b0037-5dae-49d0-9755-e58836f9b888 service nova] [instance: fe1af384-aa97-4c21-8440-8b0ebb711d50] Updating instance_info_cache with network_info: [{"id": "2e30f2fa-a90a-4b8d-adbf-d428a802fd0f", "address": "fa:16:3e:64:1a:ee", "network": {"id": "ca2010c6-c431-44c8-8742-22a4fcf15754", "bridge": "br-int", "label": "tempest-TestStampPattern-1529830938-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a826d26871fb474ba904e1550f9ee103", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e30f2fa-a9", "ovs_interfaceid": "2e30f2fa-a90a-4b8d-adbf-d428a802fd0f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:48:04 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-b0ccb80d-79e0-4b04-8ef9-cfa89a0b4d90 req-fc5b0037-5dae-49d0-9755-e58836f9b888 service nova] Releasing lock "refresh_cache-fe1af384-aa97-4c21-8440-8b0ebb711d50" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 15:48:04 user nova-compute[72382]: DEBUG nova.network.neutron [-] [instance: fe1af384-aa97-4c21-8440-8b0ebb711d50] Updating instance_info_cache with network_info: [] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:48:04 user nova-compute[72382]: INFO nova.compute.manager [-] [instance: fe1af384-aa97-4c21-8440-8b0ebb711d50] Took 0.51 seconds to deallocate network for instance.
Aug 09 15:48:04 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-cb8777ea-2870-4b60-adb7-2dd2e6de2c60 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:48:04 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-cb8777ea-2870-4b60-adb7-2dd2e6de2c60 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:48:04 user nova-compute[72382]: DEBUG nova.compute.provider_tree [None req-cb8777ea-2870-4b60-adb7-2dd2e6de2c60 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] Inventory has not changed in ProviderTree for provider: 7b15b0e5-df4d-49db-833b-2855d21d10ae {{(pid=72382) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 15:48:04 user nova-compute[72382]: DEBUG nova.scheduler.client.report [None req-cb8777ea-2870-4b60-adb7-2dd2e6de2c60 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] Inventory has not changed for provider 7b15b0e5-df4d-49db-833b-2855d21d10ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72382) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 15:48:05 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-cb8777ea-2870-4b60-adb7-2dd2e6de2c60 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.129s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:48:05 user nova-compute[72382]: INFO nova.scheduler.client.report [None req-cb8777ea-2870-4b60-adb7-2dd2e6de2c60 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] Deleted allocations for instance fe1af384-aa97-4c21-8440-8b0ebb711d50
Aug 09 15:48:05 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-cb8777ea-2870-4b60-adb7-2dd2e6de2c60 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] Lock "fe1af384-aa97-4c21-8440-8b0ebb711d50" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.711s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:48:06 user nova-compute[72382]: DEBUG nova.compute.manager [req-0aac59a6-a935-4c47-9e0b-60402a2ec3e7 req-67b0fc85-7a20-4af2-a38e-8209661983f3 service nova] [instance: fe1af384-aa97-4c21-8440-8b0ebb711d50] Received event network-vif-plugged-2e30f2fa-a90a-4b8d-adbf-d428a802fd0f {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:48:06 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-0aac59a6-a935-4c47-9e0b-60402a2ec3e7 req-67b0fc85-7a20-4af2-a38e-8209661983f3 service nova] Acquiring lock "fe1af384-aa97-4c21-8440-8b0ebb711d50-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:48:06 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-0aac59a6-a935-4c47-9e0b-60402a2ec3e7 req-67b0fc85-7a20-4af2-a38e-8209661983f3 service nova] Lock "fe1af384-aa97-4c21-8440-8b0ebb711d50-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:48:06 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-0aac59a6-a935-4c47-9e0b-60402a2ec3e7 req-67b0fc85-7a20-4af2-a38e-8209661983f3 service nova] Lock "fe1af384-aa97-4c21-8440-8b0ebb711d50-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:48:06 user nova-compute[72382]: DEBUG nova.compute.manager [req-0aac59a6-a935-4c47-9e0b-60402a2ec3e7 req-67b0fc85-7a20-4af2-a38e-8209661983f3 service nova] [instance: fe1af384-aa97-4c21-8440-8b0ebb711d50] No waiting events found dispatching network-vif-plugged-2e30f2fa-a90a-4b8d-adbf-d428a802fd0f {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:48:06 user nova-compute[72382]: WARNING nova.compute.manager [req-0aac59a6-a935-4c47-9e0b-60402a2ec3e7 req-67b0fc85-7a20-4af2-a38e-8209661983f3 service nova] [instance: fe1af384-aa97-4c21-8440-8b0ebb711d50] Received unexpected event network-vif-plugged-2e30f2fa-a90a-4b8d-adbf-d428a802fd0f for instance with vm_state deleted and task_state None.
Aug 09 15:48:06 user nova-compute[72382]: DEBUG nova.compute.manager [req-0aac59a6-a935-4c47-9e0b-60402a2ec3e7 req-67b0fc85-7a20-4af2-a38e-8209661983f3 service nova] [instance: fe1af384-aa97-4c21-8440-8b0ebb711d50] Received event network-vif-deleted-2e30f2fa-a90a-4b8d-adbf-d428a802fd0f {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:48:09 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:48:14 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:48:19 user nova-compute[72382]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691596084.1778681, fe1af384-aa97-4c21-8440-8b0ebb711d50 => Stopped> {{(pid=72382) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 15:48:19 user nova-compute[72382]: INFO nova.compute.manager [-] [instance: fe1af384-aa97-4c21-8440-8b0ebb711d50] VM Stopped (Lifecycle Event)
Aug 09 15:48:19 user nova-compute[72382]: DEBUG nova.compute.manager [None req-f54c1aa2-85a9-42ce-8b29-db00d32c008d None None] [instance: fe1af384-aa97-4c21-8440-8b0ebb711d50] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:48:19 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:48:19 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:48:19 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72382) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 15:48:19 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72382) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 15:48:19 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72382) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 15:48:19 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:48:24 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:48:26 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:48:26 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:48:26 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:48:26 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:48:26 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Auditing locally available compute resources for user (node: user) {{(pid=72382) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 15:48:26 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d27c5a4-9a88-423b-9c48-9224e8248f8c/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:48:27 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d27c5a4-9a88-423b-9c48-9224e8248f8c/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:48:27 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d27c5a4-9a88-423b-9c48-9224e8248f8c/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:48:27 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d27c5a4-9a88-423b-9c48-9224e8248f8c/disk --force-share --output=json" returned: 0 in 0.128s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:48:27 user nova-compute[72382]: WARNING nova.virt.libvirt.driver [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 15:48:27 user nova-compute[72382]: WARNING nova.virt.libvirt.driver [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 15:48:27 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Hypervisor/Node resource view: name=user free_ram=8773MB free_disk=25.205760955810547GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72382) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 15:48:27 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:48:27 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:48:27 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance 4d27c5a4-9a88-423b-9c48-9224e8248f8c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:48:27 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72382) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 15:48:27 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72382) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 15:48:27 user nova-compute[72382]: DEBUG nova.compute.provider_tree [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Inventory has not changed in ProviderTree for provider: 7b15b0e5-df4d-49db-833b-2855d21d10ae {{(pid=72382) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 15:48:27 user nova-compute[72382]: DEBUG nova.scheduler.client.report [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Inventory has not changed for provider 7b15b0e5-df4d-49db-833b-2855d21d10ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72382) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 15:48:27 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Compute_service record updated for user:user {{(pid=72382) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 15:48:27 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.296s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:48:28 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:48:28 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:48:28 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:48:29 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:48:32 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:48:32 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:48:32 user nova-compute[72382]: DEBUG nova.compute.manager [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72382) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 15:48:33 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:48:33 user nova-compute[72382]: DEBUG nova.compute.manager [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Starting heal instance info cache {{(pid=72382) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 15:48:33 user nova-compute[72382]: DEBUG nova.compute.manager [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Rebuilding the list of instances to heal {{(pid=72382) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 09 15:48:33 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Acquiring lock "refresh_cache-4d27c5a4-9a88-423b-9c48-9224e8248f8c" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 15:48:33 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Acquired lock "refresh_cache-4d27c5a4-9a88-423b-9c48-9224e8248f8c" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 15:48:33 user nova-compute[72382]: DEBUG nova.network.neutron [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] [instance: 4d27c5a4-9a88-423b-9c48-9224e8248f8c] Forcefully refreshing network info cache for instance {{(pid=72382) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 15:48:33 user nova-compute[72382]: DEBUG nova.objects.instance [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lazy-loading 'info_cache' on Instance uuid 4d27c5a4-9a88-423b-9c48-9224e8248f8c {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:48:34 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:48:34 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:48:34 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72382) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 15:48:34 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72382) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 15:48:34 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72382) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 15:48:34 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:48:34 user nova-compute[72382]: DEBUG nova.network.neutron [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] [instance: 4d27c5a4-9a88-423b-9c48-9224e8248f8c] Updating instance_info_cache with network_info: [{"id": "b14bc813-7a4e-413c-9b5f-4c34080790b6", "address": "fa:16:3e:a6:b1:fa", "network": {"id": "ca2010c6-c431-44c8-8742-22a4fcf15754", "bridge": "br-int", "label": "tempest-TestStampPattern-1529830938-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a826d26871fb474ba904e1550f9ee103", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb14bc813-7a", "ovs_interfaceid": "b14bc813-7a4e-413c-9b5f-4c34080790b6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:48:34 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Releasing lock "refresh_cache-4d27c5a4-9a88-423b-9c48-9224e8248f8c" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 15:48:34 user nova-compute[72382]: DEBUG nova.compute.manager [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] [instance: 4d27c5a4-9a88-423b-9c48-9224e8248f8c] Updated the network info_cache for instance {{(pid=72382) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 15:48:37 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:48:37 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:48:39 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:48:44 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:48:49 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:48:54 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:48:59 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:48:59 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:48:59 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72382) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 15:48:59 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72382) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 15:48:59 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72382) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 15:48:59 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:49:04 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:49:06 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:49:06 user nova-compute[72382]: DEBUG nova.compute.manager [req-cc7c8300-8a5c-419b-b9f3-365109f0acb3 req-e49a3d7d-73a1-4c02-b9a0-ddd4c3ebe894 service nova] [instance: 4d27c5a4-9a88-423b-9c48-9224e8248f8c] Received event network-changed-b14bc813-7a4e-413c-9b5f-4c34080790b6 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:49:06 user nova-compute[72382]: DEBUG nova.compute.manager [req-cc7c8300-8a5c-419b-b9f3-365109f0acb3 req-e49a3d7d-73a1-4c02-b9a0-ddd4c3ebe894 service nova] [instance: 4d27c5a4-9a88-423b-9c48-9224e8248f8c] Refreshing instance network info cache due to event network-changed-b14bc813-7a4e-413c-9b5f-4c34080790b6. {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 15:49:06 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-cc7c8300-8a5c-419b-b9f3-365109f0acb3 req-e49a3d7d-73a1-4c02-b9a0-ddd4c3ebe894 service nova] Acquiring lock "refresh_cache-4d27c5a4-9a88-423b-9c48-9224e8248f8c" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 15:49:06 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-cc7c8300-8a5c-419b-b9f3-365109f0acb3 req-e49a3d7d-73a1-4c02-b9a0-ddd4c3ebe894 service nova] Acquired lock "refresh_cache-4d27c5a4-9a88-423b-9c48-9224e8248f8c" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 15:49:06 user nova-compute[72382]: DEBUG nova.network.neutron [req-cc7c8300-8a5c-419b-b9f3-365109f0acb3 req-e49a3d7d-73a1-4c02-b9a0-ddd4c3ebe894 service nova] [instance: 4d27c5a4-9a88-423b-9c48-9224e8248f8c] Refreshing network info cache for port b14bc813-7a4e-413c-9b5f-4c34080790b6 {{(pid=72382) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 15:49:07 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-8c2076fa-fd3a-49b5-bf85-0bab6d804188 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] Acquiring lock "4d27c5a4-9a88-423b-9c48-9224e8248f8c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:49:07 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-8c2076fa-fd3a-49b5-bf85-0bab6d804188 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] Lock "4d27c5a4-9a88-423b-9c48-9224e8248f8c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:49:07 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-8c2076fa-fd3a-49b5-bf85-0bab6d804188 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] Acquiring lock "4d27c5a4-9a88-423b-9c48-9224e8248f8c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:49:07 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-8c2076fa-fd3a-49b5-bf85-0bab6d804188 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] Lock "4d27c5a4-9a88-423b-9c48-9224e8248f8c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:49:07 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-8c2076fa-fd3a-49b5-bf85-0bab6d804188 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] Lock "4d27c5a4-9a88-423b-9c48-9224e8248f8c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:49:07 user nova-compute[72382]: INFO nova.compute.manager [None req-8c2076fa-fd3a-49b5-bf85-0bab6d804188 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] [instance: 4d27c5a4-9a88-423b-9c48-9224e8248f8c] Terminating instance
Aug 09 15:49:07 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8c2076fa-fd3a-49b5-bf85-0bab6d804188 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] [instance: 4d27c5a4-9a88-423b-9c48-9224e8248f8c] Start destroying the instance on the hypervisor. {{(pid=72382) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 15:49:07 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:49:07 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:49:07 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:49:07 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:49:07 user nova-compute[72382]: DEBUG nova.compute.manager [req-68cdce0c-f8a3-470b-9c18-6209bb2264b4 req-82817610-5443-4a70-84bc-03d09782c731 service nova] [instance: 4d27c5a4-9a88-423b-9c48-9224e8248f8c] Received event network-vif-unplugged-b14bc813-7a4e-413c-9b5f-4c34080790b6 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:49:07 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-68cdce0c-f8a3-470b-9c18-6209bb2264b4 req-82817610-5443-4a70-84bc-03d09782c731 service nova] Acquiring lock "4d27c5a4-9a88-423b-9c48-9224e8248f8c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:49:07 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-68cdce0c-f8a3-470b-9c18-6209bb2264b4 req-82817610-5443-4a70-84bc-03d09782c731 service nova] Lock "4d27c5a4-9a88-423b-9c48-9224e8248f8c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:49:07 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-68cdce0c-f8a3-470b-9c18-6209bb2264b4 req-82817610-5443-4a70-84bc-03d09782c731 service nova] Lock "4d27c5a4-9a88-423b-9c48-9224e8248f8c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:49:07 user nova-compute[72382]: DEBUG nova.compute.manager [req-68cdce0c-f8a3-470b-9c18-6209bb2264b4 req-82817610-5443-4a70-84bc-03d09782c731 service nova] [instance: 4d27c5a4-9a88-423b-9c48-9224e8248f8c] No waiting events found dispatching network-vif-unplugged-b14bc813-7a4e-413c-9b5f-4c34080790b6 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:49:07 user nova-compute[72382]: DEBUG nova.compute.manager [req-68cdce0c-f8a3-470b-9c18-6209bb2264b4 req-82817610-5443-4a70-84bc-03d09782c731 service nova] [instance: 4d27c5a4-9a88-423b-9c48-9224e8248f8c] Received event network-vif-unplugged-b14bc813-7a4e-413c-9b5f-4c34080790b6 for instance with task_state deleting. {{(pid=72382) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 15:49:07 user nova-compute[72382]: DEBUG nova.network.neutron [req-cc7c8300-8a5c-419b-b9f3-365109f0acb3 req-e49a3d7d-73a1-4c02-b9a0-ddd4c3ebe894 service nova] [instance: 4d27c5a4-9a88-423b-9c48-9224e8248f8c] Updated VIF entry in instance network info cache for port b14bc813-7a4e-413c-9b5f-4c34080790b6. {{(pid=72382) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 15:49:07 user nova-compute[72382]: DEBUG nova.network.neutron [req-cc7c8300-8a5c-419b-b9f3-365109f0acb3 req-e49a3d7d-73a1-4c02-b9a0-ddd4c3ebe894 service nova] [instance: 4d27c5a4-9a88-423b-9c48-9224e8248f8c] Updating instance_info_cache with network_info: [{"id": "b14bc813-7a4e-413c-9b5f-4c34080790b6", "address": "fa:16:3e:a6:b1:fa", "network": {"id": "ca2010c6-c431-44c8-8742-22a4fcf15754", "bridge": "br-int", "label": "tempest-TestStampPattern-1529830938-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a826d26871fb474ba904e1550f9ee103", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb14bc813-7a", "ovs_interfaceid": "b14bc813-7a4e-413c-9b5f-4c34080790b6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:49:07 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-cc7c8300-8a5c-419b-b9f3-365109f0acb3 req-e49a3d7d-73a1-4c02-b9a0-ddd4c3ebe894 service nova] Releasing lock "refresh_cache-4d27c5a4-9a88-423b-9c48-9224e8248f8c" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 15:49:07 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:49:07 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:49:07 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:49:07 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:49:07 user nova-compute[72382]: INFO nova.virt.libvirt.driver [-] [instance: 4d27c5a4-9a88-423b-9c48-9224e8248f8c] Instance destroyed successfully.
Aug 09 15:49:07 user nova-compute[72382]: DEBUG nova.objects.instance [None req-8c2076fa-fd3a-49b5-bf85-0bab6d804188 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] Lazy-loading 'resources' on Instance uuid 4d27c5a4-9a88-423b-9c48-9224e8248f8c {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:49:07 user nova-compute[72382]: DEBUG nova.virt.libvirt.vif [None req-8c2076fa-fd3a-49b5-bf85-0bab6d804188 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T15:41:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1127199979',display_name='tempest-TestStampPattern-server-1127199979',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1127199979',id=48,image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNjio106iFL2RPDY5bqMxL7i3075CQY3HKpCfye/tyKn/rCQ1aG3GTM2r91qUJoQ3mYw8uvX3PtnblDrXm52Mqz8hUv4zCfERch5RpCXfjm7fb1444d3HAmk/t6Po924mA==',key_name='tempest-TestStampPattern-1060048663',keypairs=<?>,launch_index=0,launched_at=2023-08-09T15:42:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a826d26871fb474ba904e1550f9ee103',ramdisk_id='',reservation_id='r-9l71hd2g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-1111267616',owner_user_name='tempest-TestStampPattern-1111267616-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T15:45:06Z,user_data=None,user_id='273d16c265ae4868a371889eae528d02',uuid=4d27c5a4-9a88-423b-9c48-9224e8248f8c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b14bc813-7a4e-413c-9b5f-4c34080790b6", "address": "fa:16:3e:a6:b1:fa", "network": {"id": "ca2010c6-c431-44c8-8742-22a4fcf15754", "bridge": "br-int", "label": "tempest-TestStampPattern-1529830938-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a826d26871fb474ba904e1550f9ee103", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb14bc813-7a", "ovs_interfaceid": "b14bc813-7a4e-413c-9b5f-4c34080790b6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 15:49:07 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-8c2076fa-fd3a-49b5-bf85-0bab6d804188 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] Converting VIF {"id": "b14bc813-7a4e-413c-9b5f-4c34080790b6", "address": "fa:16:3e:a6:b1:fa", "network": {"id": "ca2010c6-c431-44c8-8742-22a4fcf15754", "bridge": "br-int", "label": "tempest-TestStampPattern-1529830938-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a826d26871fb474ba904e1550f9ee103", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb14bc813-7a", "ovs_interfaceid": "b14bc813-7a4e-413c-9b5f-4c34080790b6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 15:49:07 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-8c2076fa-fd3a-49b5-bf85-0bab6d804188 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a6:b1:fa,bridge_name='br-int',has_traffic_filtering=True,id=b14bc813-7a4e-413c-9b5f-4c34080790b6,network=Network(ca2010c6-c431-44c8-8742-22a4fcf15754),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb14bc813-7a') {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 15:49:07 user nova-compute[72382]: DEBUG os_vif [None req-8c2076fa-fd3a-49b5-bf85-0bab6d804188 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a6:b1:fa,bridge_name='br-int',has_traffic_filtering=True,id=b14bc813-7a4e-413c-9b5f-4c34080790b6,network=Network(ca2010c6-c431-44c8-8742-22a4fcf15754),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb14bc813-7a') {{(pid=72382) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 15:49:07 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:49:07 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb14bc813-7a, bridge=br-int, if_exists=True) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:49:07 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:49:07 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:49:07 user nova-compute[72382]: INFO os_vif [None req-8c2076fa-fd3a-49b5-bf85-0bab6d804188 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a6:b1:fa,bridge_name='br-int',has_traffic_filtering=True,id=b14bc813-7a4e-413c-9b5f-4c34080790b6,network=Network(ca2010c6-c431-44c8-8742-22a4fcf15754),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb14bc813-7a')
Aug 09 15:49:07 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-8c2076fa-fd3a-49b5-bf85-0bab6d804188 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] [instance: 4d27c5a4-9a88-423b-9c48-9224e8248f8c] Deleting instance files /opt/stack/data/nova/instances/4d27c5a4-9a88-423b-9c48-9224e8248f8c_del
Aug 09 15:49:07 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-8c2076fa-fd3a-49b5-bf85-0bab6d804188 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] [instance: 4d27c5a4-9a88-423b-9c48-9224e8248f8c] Deletion of /opt/stack/data/nova/instances/4d27c5a4-9a88-423b-9c48-9224e8248f8c_del complete
Aug 09 15:49:07 user nova-compute[72382]: INFO nova.compute.manager [None req-8c2076fa-fd3a-49b5-bf85-0bab6d804188 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] [instance: 4d27c5a4-9a88-423b-9c48-9224e8248f8c] Took 0.90 seconds to destroy the instance on the hypervisor.
Aug 09 15:49:07 user nova-compute[72382]: DEBUG oslo.service.loopingcall [None req-8c2076fa-fd3a-49b5-bf85-0bab6d804188 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72382) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 15:49:07 user nova-compute[72382]: DEBUG nova.compute.manager [-] [instance: 4d27c5a4-9a88-423b-9c48-9224e8248f8c] Deallocating network for instance {{(pid=72382) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 15:49:07 user nova-compute[72382]: DEBUG nova.network.neutron [-] [instance: 4d27c5a4-9a88-423b-9c48-9224e8248f8c] deallocate_for_instance() {{(pid=72382) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 15:49:08 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:49:08 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:49:08 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:49:08 user nova-compute[72382]: DEBUG nova.network.neutron [-] [instance: 4d27c5a4-9a88-423b-9c48-9224e8248f8c] Updating instance_info_cache with network_info: [] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:49:08 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:49:08 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:49:08 user nova-compute[72382]: INFO nova.compute.manager [-] [instance: 4d27c5a4-9a88-423b-9c48-9224e8248f8c] Took 0.52 seconds to deallocate network for instance.
Aug 09 15:49:08 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:49:08 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-8c2076fa-fd3a-49b5-bf85-0bab6d804188 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:49:08 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-8c2076fa-fd3a-49b5-bf85-0bab6d804188 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:49:08 user nova-compute[72382]: DEBUG nova.compute.provider_tree [None req-8c2076fa-fd3a-49b5-bf85-0bab6d804188 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] Inventory has not changed in ProviderTree for provider: 7b15b0e5-df4d-49db-833b-2855d21d10ae {{(pid=72382) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 15:49:08 user nova-compute[72382]: DEBUG nova.scheduler.client.report [None req-8c2076fa-fd3a-49b5-bf85-0bab6d804188 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] Inventory has not changed for provider 7b15b0e5-df4d-49db-833b-2855d21d10ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72382) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 15:49:08 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-8c2076fa-fd3a-49b5-bf85-0bab6d804188 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.127s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:49:08 user nova-compute[72382]: INFO nova.scheduler.client.report [None req-8c2076fa-fd3a-49b5-bf85-0bab6d804188 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] Deleted allocations for instance 4d27c5a4-9a88-423b-9c48-9224e8248f8c
Aug 09 15:49:08 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-8c2076fa-fd3a-49b5-bf85-0bab6d804188 tempest-TestStampPattern-1111267616 tempest-TestStampPattern-1111267616-project-member] Lock "4d27c5a4-9a88-423b-9c48-9224e8248f8c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.743s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:49:08 user nova-compute[72382]: DEBUG nova.compute.manager [req-e5ed4f34-f12e-49a6-852c-14d2b794c9d1 req-7aad0354-d8de-4e18-b1a8-2e05a58126f5 service nova] [instance: 4d27c5a4-9a88-423b-9c48-9224e8248f8c] Received event network-vif-deleted-b14bc813-7a4e-413c-9b5f-4c34080790b6 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:49:09 user nova-compute[72382]: DEBUG nova.compute.manager [req-61287fcc-ac46-4200-b5b5-d90e23ca8c31 req-432b712d-f324-4cf1-8e8b-d63995f5843b service nova] [instance: 4d27c5a4-9a88-423b-9c48-9224e8248f8c] Received event network-vif-plugged-b14bc813-7a4e-413c-9b5f-4c34080790b6 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:49:09 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-61287fcc-ac46-4200-b5b5-d90e23ca8c31 req-432b712d-f324-4cf1-8e8b-d63995f5843b service nova] Acquiring lock "4d27c5a4-9a88-423b-9c48-9224e8248f8c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:49:09 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-61287fcc-ac46-4200-b5b5-d90e23ca8c31 req-432b712d-f324-4cf1-8e8b-d63995f5843b service nova] Lock "4d27c5a4-9a88-423b-9c48-9224e8248f8c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:49:09 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-61287fcc-ac46-4200-b5b5-d90e23ca8c31 req-432b712d-f324-4cf1-8e8b-d63995f5843b service nova] Lock "4d27c5a4-9a88-423b-9c48-9224e8248f8c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:49:09 user nova-compute[72382]: DEBUG nova.compute.manager [req-61287fcc-ac46-4200-b5b5-d90e23ca8c31 req-432b712d-f324-4cf1-8e8b-d63995f5843b service nova] [instance: 4d27c5a4-9a88-423b-9c48-9224e8248f8c] No waiting events found dispatching network-vif-plugged-b14bc813-7a4e-413c-9b5f-4c34080790b6 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:49:09 user nova-compute[72382]: WARNING nova.compute.manager [req-61287fcc-ac46-4200-b5b5-d90e23ca8c31 req-432b712d-f324-4cf1-8e8b-d63995f5843b service nova] [instance: 4d27c5a4-9a88-423b-9c48-9224e8248f8c] Received unexpected event network-vif-plugged-b14bc813-7a4e-413c-9b5f-4c34080790b6 for instance with vm_state deleted and task_state None.
Aug 09 15:49:09 user nova-compute[72382]: DEBUG nova.compute.manager [req-61287fcc-ac46-4200-b5b5-d90e23ca8c31 req-432b712d-f324-4cf1-8e8b-d63995f5843b service nova] [instance: 4d27c5a4-9a88-423b-9c48-9224e8248f8c] Received event network-vif-plugged-b14bc813-7a4e-413c-9b5f-4c34080790b6 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:49:09 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-61287fcc-ac46-4200-b5b5-d90e23ca8c31 req-432b712d-f324-4cf1-8e8b-d63995f5843b service nova] Acquiring lock "4d27c5a4-9a88-423b-9c48-9224e8248f8c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:49:09 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-61287fcc-ac46-4200-b5b5-d90e23ca8c31 req-432b712d-f324-4cf1-8e8b-d63995f5843b service nova] Lock "4d27c5a4-9a88-423b-9c48-9224e8248f8c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:49:09 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-61287fcc-ac46-4200-b5b5-d90e23ca8c31 req-432b712d-f324-4cf1-8e8b-d63995f5843b service nova] Lock "4d27c5a4-9a88-423b-9c48-9224e8248f8c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:49:09 user nova-compute[72382]: DEBUG nova.compute.manager [req-61287fcc-ac46-4200-b5b5-d90e23ca8c31 req-432b712d-f324-4cf1-8e8b-d63995f5843b service nova] [instance: 4d27c5a4-9a88-423b-9c48-9224e8248f8c] No waiting events found dispatching network-vif-plugged-b14bc813-7a4e-413c-9b5f-4c34080790b6 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:49:09 user nova-compute[72382]: WARNING nova.compute.manager [req-61287fcc-ac46-4200-b5b5-d90e23ca8c31 req-432b712d-f324-4cf1-8e8b-d63995f5843b service nova] [instance: 4d27c5a4-9a88-423b-9c48-9224e8248f8c] Received unexpected event network-vif-plugged-b14bc813-7a4e-413c-9b5f-4c34080790b6 for instance with vm_state deleted and task_state None.
Aug 09 15:49:09 user nova-compute[72382]: DEBUG nova.compute.manager [req-61287fcc-ac46-4200-b5b5-d90e23ca8c31 req-432b712d-f324-4cf1-8e8b-d63995f5843b service nova] [instance: 4d27c5a4-9a88-423b-9c48-9224e8248f8c] Received event network-vif-plugged-b14bc813-7a4e-413c-9b5f-4c34080790b6 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:49:09 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-61287fcc-ac46-4200-b5b5-d90e23ca8c31 req-432b712d-f324-4cf1-8e8b-d63995f5843b service nova] Acquiring lock "4d27c5a4-9a88-423b-9c48-9224e8248f8c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:49:09 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-61287fcc-ac46-4200-b5b5-d90e23ca8c31 req-432b712d-f324-4cf1-8e8b-d63995f5843b service nova] Lock "4d27c5a4-9a88-423b-9c48-9224e8248f8c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:49:09 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-61287fcc-ac46-4200-b5b5-d90e23ca8c31 req-432b712d-f324-4cf1-8e8b-d63995f5843b service nova] Lock "4d27c5a4-9a88-423b-9c48-9224e8248f8c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:49:09 user nova-compute[72382]: DEBUG nova.compute.manager [req-61287fcc-ac46-4200-b5b5-d90e23ca8c31 req-432b712d-f324-4cf1-8e8b-d63995f5843b service nova] [instance: 4d27c5a4-9a88-423b-9c48-9224e8248f8c] No waiting events found dispatching network-vif-plugged-b14bc813-7a4e-413c-9b5f-4c34080790b6 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:49:09 user nova-compute[72382]: WARNING nova.compute.manager [req-61287fcc-ac46-4200-b5b5-d90e23ca8c31 req-432b712d-f324-4cf1-8e8b-d63995f5843b service nova] [instance: 4d27c5a4-9a88-423b-9c48-9224e8248f8c] Received unexpected event network-vif-plugged-b14bc813-7a4e-413c-9b5f-4c34080790b6 for instance with vm_state deleted and task_state None.
Aug 09 15:49:09 user nova-compute[72382]: DEBUG nova.compute.manager [req-61287fcc-ac46-4200-b5b5-d90e23ca8c31 req-432b712d-f324-4cf1-8e8b-d63995f5843b service nova] [instance: 4d27c5a4-9a88-423b-9c48-9224e8248f8c] Received event network-vif-plugged-b14bc813-7a4e-413c-9b5f-4c34080790b6 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:49:09 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-61287fcc-ac46-4200-b5b5-d90e23ca8c31 req-432b712d-f324-4cf1-8e8b-d63995f5843b service nova] Acquiring lock "4d27c5a4-9a88-423b-9c48-9224e8248f8c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:49:09 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-61287fcc-ac46-4200-b5b5-d90e23ca8c31 req-432b712d-f324-4cf1-8e8b-d63995f5843b service nova] Lock "4d27c5a4-9a88-423b-9c48-9224e8248f8c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:49:09 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-61287fcc-ac46-4200-b5b5-d90e23ca8c31 req-432b712d-f324-4cf1-8e8b-d63995f5843b service nova] Lock "4d27c5a4-9a88-423b-9c48-9224e8248f8c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:49:09 user nova-compute[72382]: DEBUG nova.compute.manager [req-61287fcc-ac46-4200-b5b5-d90e23ca8c31 req-432b712d-f324-4cf1-8e8b-d63995f5843b service nova] [instance: 4d27c5a4-9a88-423b-9c48-9224e8248f8c] No waiting events found dispatching network-vif-plugged-b14bc813-7a4e-413c-9b5f-4c34080790b6 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:49:09 user nova-compute[72382]: WARNING nova.compute.manager [req-61287fcc-ac46-4200-b5b5-d90e23ca8c31 req-432b712d-f324-4cf1-8e8b-d63995f5843b service nova] [instance: 4d27c5a4-9a88-423b-9c48-9224e8248f8c] Received unexpected event network-vif-plugged-b14bc813-7a4e-413c-9b5f-4c34080790b6 for instance with vm_state deleted and task_state None.
Aug 09 15:49:12 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:49:17 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:49:17 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:49:17 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72382) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 15:49:17 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72382) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 15:49:17 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72382) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 15:49:17 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:49:22 user nova-compute[72382]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691596147.8370042, 4d27c5a4-9a88-423b-9c48-9224e8248f8c => Stopped> {{(pid=72382) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 15:49:22 user nova-compute[72382]: INFO nova.compute.manager [-] [instance: 4d27c5a4-9a88-423b-9c48-9224e8248f8c] VM Stopped (Lifecycle Event)
Aug 09 15:49:22 user nova-compute[72382]: DEBUG nova.compute.manager [None req-4ab65b7b-9f25-4cfa-b010-bb129e5ca562 None None] [instance: 4d27c5a4-9a88-423b-9c48-9224e8248f8c] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:49:22 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:49:22 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:49:22 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72382) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 15:49:22 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72382) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 15:49:22 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72382) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 15:49:22 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:49:27 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:49:27 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:49:27 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:49:27 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72382) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 15:49:27 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72382) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 15:49:27 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:49:27 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72382) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 15:49:27 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:49:27 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:49:27 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:49:27 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:49:27 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Auditing locally available compute resources for user (node: user) {{(pid=72382) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 15:49:28 user nova-compute[72382]: WARNING nova.virt.libvirt.driver [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 15:49:28 user nova-compute[72382]: WARNING nova.virt.libvirt.driver [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 15:49:28 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Hypervisor/Node resource view: name=user free_ram=8918MB free_disk=25.329452514648438GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72382) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 15:49:28 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:49:28 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:49:28 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72382) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 15:49:28 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72382) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 15:49:28 user nova-compute[72382]: DEBUG nova.compute.provider_tree [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Inventory has not changed in ProviderTree for provider: 7b15b0e5-df4d-49db-833b-2855d21d10ae {{(pid=72382) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 15:49:28 user nova-compute[72382]: DEBUG nova.scheduler.client.report [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Inventory has not changed for provider 7b15b0e5-df4d-49db-833b-2855d21d10ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72382) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 15:49:28 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Compute_service record updated for user:user {{(pid=72382) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 15:49:28 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.140s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:49:29 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:49:29 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:49:29 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:49:32 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4998-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:49:32 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:49:32 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72382) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 15:49:32 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72382) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 15:49:32 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72382) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 15:49:32 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:49:33 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:49:33 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:49:33 user nova-compute[72382]: DEBUG nova.compute.manager [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Starting heal instance info cache {{(pid=72382) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 15:49:33 user nova-compute[72382]: DEBUG nova.compute.manager [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Rebuilding the list of instances to heal {{(pid=72382) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 09 15:49:33 user nova-compute[72382]: DEBUG nova.compute.manager [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Didn't find any instances for network info cache update. {{(pid=72382) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 09 15:49:34 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:49:34 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:49:34 user nova-compute[72382]: DEBUG nova.compute.manager [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72382) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 15:49:37 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:49:37 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:49:37 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:49:37 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72382) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 15:49:37 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72382) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 15:49:37 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72382) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 15:49:37 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:49:39 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:49:42 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:49:42 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:49:42 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72382) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 15:49:42 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72382) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 15:49:42 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72382) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 15:49:42 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:49:47 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:49:47 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:49:47 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72382) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 15:49:47 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72382) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 15:49:47 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72382) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 15:49:47 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:49:52 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:49:52 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:49:52 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72382) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 15:49:52 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72382) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 15:49:52 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72382) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 15:49:52 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:49:57 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:49:57 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:49:57 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72382) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 15:49:57 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72382) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 15:49:57 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72382) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 15:49:57 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:50:02 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:50:03 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:50:06 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:50:07 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:50:09 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:50:12 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:50:17 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:50:17 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:50:17 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72382) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 15:50:17 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72382) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 15:50:17 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72382) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 15:50:17 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:50:22 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:50:27 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:50:27 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:50:27 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72382) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 15:50:27 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72382) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 15:50:27 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72382) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 15:50:27 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:50:29 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:50:29 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:50:29 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:50:29 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:50:29 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:50:29 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:50:29 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Auditing locally available compute resources for user (node: user) {{(pid=72382) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 15:50:30 user nova-compute[72382]: WARNING nova.virt.libvirt.driver [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 15:50:30 user nova-compute[72382]: WARNING nova.virt.libvirt.driver [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 15:50:30 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Hypervisor/Node resource view: name=user free_ram=8804MB free_disk=25.327816009521484GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72382) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 15:50:30 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:50:30 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:50:30 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72382) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 15:50:30 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72382) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 15:50:30 user nova-compute[72382]: DEBUG nova.compute.provider_tree [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Inventory has not changed in ProviderTree for provider: 7b15b0e5-df4d-49db-833b-2855d21d10ae {{(pid=72382) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 15:50:30 user nova-compute[72382]: DEBUG nova.scheduler.client.report [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Inventory has not changed for provider 7b15b0e5-df4d-49db-833b-2855d21d10ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72382) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 15:50:30 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Compute_service record updated for user:user {{(pid=72382) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 15:50:30 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.146s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:50:31 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:50:32 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:50:33 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:50:33 user nova-compute[72382]: DEBUG nova.compute.manager [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Starting heal instance info cache {{(pid=72382) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 15:50:33 user nova-compute[72382]: DEBUG nova.compute.manager [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Rebuilding the list of instances to heal {{(pid=72382) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 09 15:50:33 user nova-compute[72382]: DEBUG nova.compute.manager [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Didn't find any instances for network info cache update. {{(pid=72382) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 09 15:50:34 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:50:34 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:50:34 user nova-compute[72382]: DEBUG nova.compute.manager [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72382) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 15:50:36 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:50:37 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:50:39 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:50:39 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:50:39 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:50:40 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:50:42 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:50:45 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:50:45 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:50:47 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:50:48 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:50:50 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:50:52 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:50:54 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-eb39e943-09b4-481e-afd1-dc1fa87df594 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] Acquiring lock "5e3853b8-8138-4ab1-8b1c-e853f0a81f5c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:50:54 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-eb39e943-09b4-481e-afd1-dc1fa87df594 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] Lock "5e3853b8-8138-4ab1-8b1c-e853f0a81f5c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:50:54 user nova-compute[72382]: DEBUG nova.compute.manager [None req-eb39e943-09b4-481e-afd1-dc1fa87df594 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] [instance: 5e3853b8-8138-4ab1-8b1c-e853f0a81f5c] Starting instance... {{(pid=72382) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 15:50:54 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-eb39e943-09b4-481e-afd1-dc1fa87df594 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:50:54 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-eb39e943-09b4-481e-afd1-dc1fa87df594 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:50:54 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-eb39e943-09b4-481e-afd1-dc1fa87df594 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72382) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 15:50:54 user nova-compute[72382]: INFO nova.compute.claims [None req-eb39e943-09b4-481e-afd1-dc1fa87df594 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] [instance: 5e3853b8-8138-4ab1-8b1c-e853f0a81f5c] Claim successful on node user
Aug 09 15:50:54 user nova-compute[72382]: DEBUG nova.compute.provider_tree [None req-eb39e943-09b4-481e-afd1-dc1fa87df594 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] Inventory has not changed in ProviderTree for provider: 7b15b0e5-df4d-49db-833b-2855d21d10ae {{(pid=72382) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 15:50:54 user nova-compute[72382]: DEBUG nova.scheduler.client.report [None req-eb39e943-09b4-481e-afd1-dc1fa87df594 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] Inventory has not changed for provider 7b15b0e5-df4d-49db-833b-2855d21d10ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72382) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 15:50:54 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-eb39e943-09b4-481e-afd1-dc1fa87df594 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.311s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:50:54 user nova-compute[72382]: DEBUG nova.compute.manager [None req-eb39e943-09b4-481e-afd1-dc1fa87df594 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] [instance: 5e3853b8-8138-4ab1-8b1c-e853f0a81f5c] Start building networks asynchronously for instance. {{(pid=72382) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 15:50:54 user nova-compute[72382]: DEBUG nova.compute.manager [None req-eb39e943-09b4-481e-afd1-dc1fa87df594 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] [instance: 5e3853b8-8138-4ab1-8b1c-e853f0a81f5c] Allocating IP information in the background. {{(pid=72382) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 15:50:54 user nova-compute[72382]: DEBUG nova.network.neutron [None req-eb39e943-09b4-481e-afd1-dc1fa87df594 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] [instance: 5e3853b8-8138-4ab1-8b1c-e853f0a81f5c] allocate_for_instance() {{(pid=72382) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 15:50:54 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-eb39e943-09b4-481e-afd1-dc1fa87df594 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] [instance: 5e3853b8-8138-4ab1-8b1c-e853f0a81f5c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 15:50:54 user nova-compute[72382]: DEBUG nova.compute.manager [None req-eb39e943-09b4-481e-afd1-dc1fa87df594 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] [instance: 5e3853b8-8138-4ab1-8b1c-e853f0a81f5c] Start building block device mappings for instance. {{(pid=72382) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 15:50:55 user nova-compute[72382]: DEBUG nova.policy [None req-eb39e943-09b4-481e-afd1-dc1fa87df594 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '57aaf2effda74772a3fa5f6e5a2a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f62d7fd59f9436295c98e08de857253', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72382) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 15:50:55 user nova-compute[72382]: DEBUG nova.compute.manager [None req-eb39e943-09b4-481e-afd1-dc1fa87df594 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] [instance: 5e3853b8-8138-4ab1-8b1c-e853f0a81f5c] Start spawning the instance on the hypervisor. {{(pid=72382) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 15:50:55 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-eb39e943-09b4-481e-afd1-dc1fa87df594 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] [instance: 5e3853b8-8138-4ab1-8b1c-e853f0a81f5c] Creating instance directory {{(pid=72382) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 15:50:55 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-eb39e943-09b4-481e-afd1-dc1fa87df594 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] [instance: 5e3853b8-8138-4ab1-8b1c-e853f0a81f5c] Creating image(s)
Aug 09 15:50:55 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-eb39e943-09b4-481e-afd1-dc1fa87df594 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] Acquiring lock "/opt/stack/data/nova/instances/5e3853b8-8138-4ab1-8b1c-e853f0a81f5c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:50:55 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-eb39e943-09b4-481e-afd1-dc1fa87df594 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] Lock "/opt/stack/data/nova/instances/5e3853b8-8138-4ab1-8b1c-e853f0a81f5c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:50:55 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-eb39e943-09b4-481e-afd1-dc1fa87df594 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] Lock "/opt/stack/data/nova/instances/5e3853b8-8138-4ab1-8b1c-e853f0a81f5c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:50:55 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-eb39e943-09b4-481e-afd1-dc1fa87df594 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:50:55 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:50:55 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-eb39e943-09b4-481e-afd1-dc1fa87df594 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b --force-share --output=json" returned: 0 in 0.199s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:50:55 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-eb39e943-09b4-481e-afd1-dc1fa87df594 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] Acquiring lock "383812ff437283e0191ed5b9ecc04c27f1162b0b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:50:55 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-eb39e943-09b4-481e-afd1-dc1fa87df594 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] Lock "383812ff437283e0191ed5b9ecc04c27f1162b0b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:50:55 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-eb39e943-09b4-481e-afd1-dc1fa87df594 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:50:55 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-eb39e943-09b4-481e-afd1-dc1fa87df594 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b --force-share --output=json" returned: 0 in 0.170s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:50:55 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-eb39e943-09b4-481e-afd1-dc1fa87df594 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b,backing_fmt=raw /opt/stack/data/nova/instances/5e3853b8-8138-4ab1-8b1c-e853f0a81f5c/disk 1073741824 {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:50:55 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-eb39e943-09b4-481e-afd1-dc1fa87df594 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b,backing_fmt=raw /opt/stack/data/nova/instances/5e3853b8-8138-4ab1-8b1c-e853f0a81f5c/disk 1073741824" returned: 0 in 0.065s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:50:55 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-eb39e943-09b4-481e-afd1-dc1fa87df594 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] Lock "383812ff437283e0191ed5b9ecc04c27f1162b0b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.242s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:50:55 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-eb39e943-09b4-481e-afd1-dc1fa87df594 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:50:55 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-eb39e943-09b4-481e-afd1-dc1fa87df594 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b --force-share --output=json" returned: 0 in 0.156s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:50:55 user nova-compute[72382]: DEBUG nova.virt.disk.api [None req-eb39e943-09b4-481e-afd1-dc1fa87df594 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5e3853b8-8138-4ab1-8b1c-e853f0a81f5c/disk. size=1073741824 {{(pid=72382) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 15:50:55 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-eb39e943-09b4-481e-afd1-dc1fa87df594 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e3853b8-8138-4ab1-8b1c-e853f0a81f5c/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:50:55 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-eb39e943-09b4-481e-afd1-dc1fa87df594 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e3853b8-8138-4ab1-8b1c-e853f0a81f5c/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:50:55 user nova-compute[72382]: DEBUG nova.virt.disk.api [None req-eb39e943-09b4-481e-afd1-dc1fa87df594 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] Cannot resize image /opt/stack/data/nova/instances/5e3853b8-8138-4ab1-8b1c-e853f0a81f5c/disk to a smaller size. {{(pid=72382) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 15:50:55 user nova-compute[72382]: DEBUG nova.objects.instance [None req-eb39e943-09b4-481e-afd1-dc1fa87df594 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] Lazy-loading 'migration_context' on Instance uuid 5e3853b8-8138-4ab1-8b1c-e853f0a81f5c {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:50:55 user nova-compute[72382]: DEBUG nova.network.neutron [None req-eb39e943-09b4-481e-afd1-dc1fa87df594 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] [instance: 5e3853b8-8138-4ab1-8b1c-e853f0a81f5c] Successfully created port: e8fcea04-f9ce-4285-8e81-41a2042cbfb0 {{(pid=72382) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 15:50:55 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-eb39e943-09b4-481e-afd1-dc1fa87df594 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] [instance: 5e3853b8-8138-4ab1-8b1c-e853f0a81f5c] Created local disks {{(pid=72382) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 15:50:55 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-eb39e943-09b4-481e-afd1-dc1fa87df594 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] [instance: 5e3853b8-8138-4ab1-8b1c-e853f0a81f5c] Ensure instance console log exists: /opt/stack/data/nova/instances/5e3853b8-8138-4ab1-8b1c-e853f0a81f5c/console.log {{(pid=72382) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 15:50:55 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-eb39e943-09b4-481e-afd1-dc1fa87df594 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:50:55 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-eb39e943-09b4-481e-afd1-dc1fa87df594 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:50:55 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-eb39e943-09b4-481e-afd1-dc1fa87df594 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:50:56 user nova-compute[72382]: DEBUG nova.network.neutron [None req-eb39e943-09b4-481e-afd1-dc1fa87df594 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] [instance: 5e3853b8-8138-4ab1-8b1c-e853f0a81f5c] Successfully updated port: e8fcea04-f9ce-4285-8e81-41a2042cbfb0 {{(pid=72382) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 15:50:56 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-eb39e943-09b4-481e-afd1-dc1fa87df594 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] Acquiring lock "refresh_cache-5e3853b8-8138-4ab1-8b1c-e853f0a81f5c" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 15:50:56 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-eb39e943-09b4-481e-afd1-dc1fa87df594 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] Acquired lock "refresh_cache-5e3853b8-8138-4ab1-8b1c-e853f0a81f5c" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 15:50:56 user nova-compute[72382]: DEBUG nova.network.neutron [None req-eb39e943-09b4-481e-afd1-dc1fa87df594 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] [instance: 5e3853b8-8138-4ab1-8b1c-e853f0a81f5c] Building network info cache for instance {{(pid=72382) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 15:50:56 user nova-compute[72382]: DEBUG nova.compute.manager [req-0445cde5-aaf9-442b-a1aa-cb3df3096892 req-03ccb9ba-e987-499b-8b23-b14362f648d4 service nova] [instance: 5e3853b8-8138-4ab1-8b1c-e853f0a81f5c] Received event network-changed-e8fcea04-f9ce-4285-8e81-41a2042cbfb0 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:50:56 user nova-compute[72382]: DEBUG nova.compute.manager [req-0445cde5-aaf9-442b-a1aa-cb3df3096892 req-03ccb9ba-e987-499b-8b23-b14362f648d4 service nova] [instance: 5e3853b8-8138-4ab1-8b1c-e853f0a81f5c] Refreshing instance network info cache due to event network-changed-e8fcea04-f9ce-4285-8e81-41a2042cbfb0. {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 15:50:56 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-0445cde5-aaf9-442b-a1aa-cb3df3096892 req-03ccb9ba-e987-499b-8b23-b14362f648d4 service nova] Acquiring lock "refresh_cache-5e3853b8-8138-4ab1-8b1c-e853f0a81f5c" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 15:50:56 user nova-compute[72382]: DEBUG nova.network.neutron [None req-eb39e943-09b4-481e-afd1-dc1fa87df594 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] [instance: 5e3853b8-8138-4ab1-8b1c-e853f0a81f5c] Instance cache missing network info. {{(pid=72382) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 15:50:57 user nova-compute[72382]: DEBUG nova.network.neutron [None req-eb39e943-09b4-481e-afd1-dc1fa87df594 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] [instance: 5e3853b8-8138-4ab1-8b1c-e853f0a81f5c] Updating instance_info_cache with network_info: [{"id": "e8fcea04-f9ce-4285-8e81-41a2042cbfb0", "address": "fa:16:3e:5d:ca:7b", "network": {"id": "45acf55d-48f5-4a7d-a01c-0aa68e330e1a", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-992217983-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f62d7fd59f9436295c98e08de857253", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8fcea04-f9", "ovs_interfaceid": "e8fcea04-f9ce-4285-8e81-41a2042cbfb0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:50:57 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-eb39e943-09b4-481e-afd1-dc1fa87df594 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] Releasing lock "refresh_cache-5e3853b8-8138-4ab1-8b1c-e853f0a81f5c" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 15:50:57 user nova-compute[72382]: DEBUG nova.compute.manager [None req-eb39e943-09b4-481e-afd1-dc1fa87df594 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] [instance: 5e3853b8-8138-4ab1-8b1c-e853f0a81f5c] Instance network_info: |[{"id": "e8fcea04-f9ce-4285-8e81-41a2042cbfb0", "address": "fa:16:3e:5d:ca:7b", "network": {"id": "45acf55d-48f5-4a7d-a01c-0aa68e330e1a", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-992217983-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f62d7fd59f9436295c98e08de857253", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8fcea04-f9", "ovs_interfaceid": "e8fcea04-f9ce-4285-8e81-41a2042cbfb0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72382) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 15:50:57 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-0445cde5-aaf9-442b-a1aa-cb3df3096892 req-03ccb9ba-e987-499b-8b23-b14362f648d4 service nova] Acquired lock "refresh_cache-5e3853b8-8138-4ab1-8b1c-e853f0a81f5c" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 15:50:57 user nova-compute[72382]: DEBUG nova.network.neutron [req-0445cde5-aaf9-442b-a1aa-cb3df3096892 req-03ccb9ba-e987-499b-8b23-b14362f648d4 service nova] [instance: 5e3853b8-8138-4ab1-8b1c-e853f0a81f5c] Refreshing network info cache for port e8fcea04-f9ce-4285-8e81-41a2042cbfb0 {{(pid=72382) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 15:50:57 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-eb39e943-09b4-481e-afd1-dc1fa87df594 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] [instance: 5e3853b8-8138-4ab1-8b1c-e853f0a81f5c] Start _get_guest_xml network_info=[{"id": "e8fcea04-f9ce-4285-8e81-41a2042cbfb0", "address": "fa:16:3e:5d:ca:7b", "network": {"id": "45acf55d-48f5-4a7d-a01c-0aa68e330e1a", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-992217983-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f62d7fd59f9436295c98e08de857253", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8fcea04-f9", "ovs_interfaceid": "e8fcea04-f9ce-4285-8e81-41a2042cbfb0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T15:11:25Z,direct_url=<?>,disk_format='qcow2',id=a79f2cea-eb27-4631-aaf3-05e7d9e411b4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a638990e12cc4d6eabb6d55e13be6bdf',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T15:11:27Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'a79f2cea-eb27-4631-aaf3-05e7d9e411b4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72382) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 15:50:57 user nova-compute[72382]: WARNING nova.virt.libvirt.driver [None req-eb39e943-09b4-481e-afd1-dc1fa87df594 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 15:50:57 user nova-compute[72382]: WARNING nova.virt.libvirt.driver [None req-eb39e943-09b4-481e-afd1-dc1fa87df594 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 15:50:57 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-eb39e943-09b4-481e-afd1-dc1fa87df594 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72382) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 15:50:57 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-eb39e943-09b4-481e-afd1-dc1fa87df594 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] CPU controller missing on host. {{(pid=72382) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 15:50:57 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-eb39e943-09b4-481e-afd1-dc1fa87df594 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72382) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 15:50:57 user nova-compute[72382]: DEBUG nova.virt.libvirt.host [None req-eb39e943-09b4-481e-afd1-dc1fa87df594 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] CPU controller found on host. {{(pid=72382) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 15:50:57 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-eb39e943-09b4-481e-afd1-dc1fa87df594 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72382) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 15:50:57 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-eb39e943-09b4-481e-afd1-dc1fa87df594 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T15:11:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T15:11:25Z,direct_url=<?>,disk_format='qcow2',id=a79f2cea-eb27-4631-aaf3-05e7d9e411b4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a638990e12cc4d6eabb6d55e13be6bdf',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T15:11:27Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 15:50:57 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-eb39e943-09b4-481e-afd1-dc1fa87df594 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] Flavor limits 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 15:50:57 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-eb39e943-09b4-481e-afd1-dc1fa87df594 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] Image limits 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 15:50:57 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-eb39e943-09b4-481e-afd1-dc1fa87df594 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] Flavor pref 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 15:50:57 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-eb39e943-09b4-481e-afd1-dc1fa87df594 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] Image pref 0:0:0 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 15:50:57 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-eb39e943-09b4-481e-afd1-dc1fa87df594 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 15:50:57 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-eb39e943-09b4-481e-afd1-dc1fa87df594 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 15:50:57 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-eb39e943-09b4-481e-afd1-dc1fa87df594 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72382) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 15:50:57 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-eb39e943-09b4-481e-afd1-dc1fa87df594 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] Got 1 possible topologies {{(pid=72382) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 15:50:57 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-eb39e943-09b4-481e-afd1-dc1fa87df594 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 15:50:57 user nova-compute[72382]: DEBUG nova.virt.hardware [None req-eb39e943-09b4-481e-afd1-dc1fa87df594 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72382) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 15:50:57 user nova-compute[72382]: DEBUG nova.virt.libvirt.vif [None req-eb39e943-09b4-481e-afd1-dc1fa87df594 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T15:50:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-561988152',display_name='tempest-SnapshotDataIntegrityTests-server-561988152',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-561988152',id=52,image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKghkMBbN5vdI0aTQ34VsjrkX3lRB/SiX6+S3R+QZxUFQrO74skN4Z2exCOeujwMVC+Ye5PY/rUEIwS3xfLHO3JMJ1NzWtupnh1iVzGenp+3SRi5mp45Uzg3mEbs6saONA==',key_name='tempest-keypair-1600143604',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6f62d7fd59f9436295c98e08de857253',ramdisk_id='',reservation_id='r-7pw4v9wt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-201807448',owner_user_name='tempest-SnapshotDataIntegrityTests-201807448-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T15:50:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='57aaf2effda74772a3fa5f6e5a2a1964',uuid=5e3853b8-8138-4ab1-8b1c-e853f0a81f5c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e8fcea04-f9ce-4285-8e81-41a2042cbfb0", "address": "fa:16:3e:5d:ca:7b", "network": {"id": "45acf55d-48f5-4a7d-a01c-0aa68e330e1a", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-992217983-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f62d7fd59f9436295c98e08de857253", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8fcea04-f9", "ovs_interfaceid": "e8fcea04-f9ce-4285-8e81-41a2042cbfb0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72382) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 15:50:57 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-eb39e943-09b4-481e-afd1-dc1fa87df594 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] Converting VIF {"id": "e8fcea04-f9ce-4285-8e81-41a2042cbfb0", "address": "fa:16:3e:5d:ca:7b", "network": {"id": "45acf55d-48f5-4a7d-a01c-0aa68e330e1a", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-992217983-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f62d7fd59f9436295c98e08de857253", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8fcea04-f9", "ovs_interfaceid": "e8fcea04-f9ce-4285-8e81-41a2042cbfb0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 15:50:57 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-eb39e943-09b4-481e-afd1-dc1fa87df594 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:ca:7b,bridge_name='br-int',has_traffic_filtering=True,id=e8fcea04-f9ce-4285-8e81-41a2042cbfb0,network=Network(45acf55d-48f5-4a7d-a01c-0aa68e330e1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8fcea04-f9') {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 15:50:57 user nova-compute[72382]: DEBUG nova.objects.instance [None req-eb39e943-09b4-481e-afd1-dc1fa87df594 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] Lazy-loading 'pci_devices' on Instance uuid 5e3853b8-8138-4ab1-8b1c-e853f0a81f5c {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:50:57 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-eb39e943-09b4-481e-afd1-dc1fa87df594 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] [instance: 5e3853b8-8138-4ab1-8b1c-e853f0a81f5c] End _get_guest_xml xml=<domain type="kvm">
Aug 09 15:50:57 user nova-compute[72382]:   <uuid>5e3853b8-8138-4ab1-8b1c-e853f0a81f5c</uuid>
Aug 09 15:50:57 user nova-compute[72382]:   <name>instance-00000034</name>
Aug 09 15:50:57 user nova-compute[72382]:   <memory>524288</memory>
Aug 09 15:50:57 user nova-compute[72382]:   <vcpu>1</vcpu>
Aug 09 15:50:57 user nova-compute[72382]:   <metadata>
Aug 09 15:50:57 user nova-compute[72382]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 15:50:57 user nova-compute[72382]:       <nova:package version="0.0.0"/>
Aug 09 15:50:57 user nova-compute[72382]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-561988152</nova:name>
Aug 09 15:50:57 user nova-compute[72382]:       <nova:creationTime>2023-08-09 15:50:57</nova:creationTime>
Aug 09 15:50:57 user nova-compute[72382]:       <nova:flavor name="m1.tiny">
Aug 09 15:50:57 user nova-compute[72382]:         <nova:memory>512</nova:memory>
Aug 09 15:50:57 user nova-compute[72382]:         <nova:disk>1</nova:disk>
Aug 09 15:50:57 user nova-compute[72382]:         <nova:swap>0</nova:swap>
Aug 09 15:50:57 user nova-compute[72382]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 15:50:57 user nova-compute[72382]:         <nova:vcpus>1</nova:vcpus>
Aug 09 15:50:57 user nova-compute[72382]:       </nova:flavor>
Aug 09 15:50:57 user nova-compute[72382]:       <nova:owner>
Aug 09 15:50:57 user nova-compute[72382]:         <nova:user uuid="57aaf2effda74772a3fa5f6e5a2a1964">tempest-SnapshotDataIntegrityTests-201807448-project-member</nova:user>
Aug 09 15:50:57 user nova-compute[72382]:         <nova:project uuid="6f62d7fd59f9436295c98e08de857253">tempest-SnapshotDataIntegrityTests-201807448</nova:project>
Aug 09 15:50:57 user nova-compute[72382]:       </nova:owner>
Aug 09 15:50:57 user nova-compute[72382]:       <nova:root type="image" uuid="a79f2cea-eb27-4631-aaf3-05e7d9e411b4"/>
Aug 09 15:50:57 user nova-compute[72382]:       <nova:ports>
Aug 09 15:50:57 user nova-compute[72382]:         <nova:port uuid="e8fcea04-f9ce-4285-8e81-41a2042cbfb0">
Aug 09 15:50:57 user nova-compute[72382]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 09 15:50:57 user nova-compute[72382]:         </nova:port>
Aug 09 15:50:57 user nova-compute[72382]:       </nova:ports>
Aug 09 15:50:57 user nova-compute[72382]:     </nova:instance>
Aug 09 15:50:57 user nova-compute[72382]:   </metadata>
Aug 09 15:50:57 user nova-compute[72382]:   <sysinfo type="smbios">
Aug 09 15:50:57 user nova-compute[72382]:     <system>
Aug 09 15:50:57 user nova-compute[72382]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 15:50:57 user nova-compute[72382]:       <entry name="product">OpenStack Nova</entry>
Aug 09 15:50:57 user nova-compute[72382]:       <entry name="version">0.0.0</entry>
Aug 09 15:50:57 user nova-compute[72382]:       <entry name="serial">5e3853b8-8138-4ab1-8b1c-e853f0a81f5c</entry>
Aug 09 15:50:57 user nova-compute[72382]:       <entry name="uuid">5e3853b8-8138-4ab1-8b1c-e853f0a81f5c</entry>
Aug 09 15:50:57 user nova-compute[72382]:       <entry name="family">Virtual Machine</entry>
Aug 09 15:50:57 user nova-compute[72382]:     </system>
Aug 09 15:50:57 user nova-compute[72382]:   </sysinfo>
Aug 09 15:50:57 user nova-compute[72382]:   <os>
Aug 09 15:50:57 user nova-compute[72382]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 15:50:57 user nova-compute[72382]:     <boot dev="hd"/>
Aug 09 15:50:57 user nova-compute[72382]:     <smbios mode="sysinfo"/>
Aug 09 15:50:57 user nova-compute[72382]:   </os>
Aug 09 15:50:57 user nova-compute[72382]:   <features>
Aug 09 15:50:57 user nova-compute[72382]:     <acpi/>
Aug 09 15:50:57 user nova-compute[72382]:     <apic/>
Aug 09 15:50:57 user nova-compute[72382]:     <vmcoreinfo/>
Aug 09 15:50:57 user nova-compute[72382]:   </features>
Aug 09 15:50:57 user nova-compute[72382]:   <clock offset="utc">
Aug 09 15:50:57 user nova-compute[72382]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 15:50:57 user nova-compute[72382]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 15:50:57 user nova-compute[72382]:     <timer name="hpet" present="no"/>
Aug 09 15:50:57 user nova-compute[72382]:   </clock>
Aug 09 15:50:57 user nova-compute[72382]:   <cpu mode="custom" match="exact">
Aug 09 15:50:57 user nova-compute[72382]:     <model>Nehalem</model>
Aug 09 15:50:57 user nova-compute[72382]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 15:50:57 user nova-compute[72382]:   </cpu>
Aug 09 15:50:57 user nova-compute[72382]:   <devices>
Aug 09 15:50:57 user nova-compute[72382]:     <disk type="file" device="disk">
Aug 09 15:50:57 user nova-compute[72382]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 15:50:57 user nova-compute[72382]:       <source file="/opt/stack/data/nova/instances/5e3853b8-8138-4ab1-8b1c-e853f0a81f5c/disk"/>
Aug 09 15:50:57 user nova-compute[72382]:       <target dev="vda" bus="virtio"/>
Aug 09 15:50:57 user nova-compute[72382]:     </disk>
Aug 09 15:50:57 user nova-compute[72382]:     <interface type="ethernet">
Aug 09 15:50:57 user nova-compute[72382]:       <mac address="fa:16:3e:5d:ca:7b"/>
Aug 09 15:50:57 user nova-compute[72382]:       <model type="virtio"/>
Aug 09 15:50:57 user nova-compute[72382]:       <mtu size="1442"/>
Aug 09 15:50:57 user nova-compute[72382]:       <target dev="tape8fcea04-f9"/>
Aug 09 15:50:57 user nova-compute[72382]:     </interface>
Aug 09 15:50:57 user nova-compute[72382]:     <serial type="pty">
Aug 09 15:50:57 user nova-compute[72382]:       <log file="/opt/stack/data/nova/instances/5e3853b8-8138-4ab1-8b1c-e853f0a81f5c/console.log" append="off"/>
Aug 09 15:50:57 user nova-compute[72382]:     </serial>
Aug 09 15:50:57 user nova-compute[72382]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 15:50:57 user nova-compute[72382]:     <video>
Aug 09 15:50:57 user nova-compute[72382]:       <model type="virtio"/>
Aug 09 15:50:57 user nova-compute[72382]:     </video>
Aug 09 15:50:57 user nova-compute[72382]:     <rng model="virtio">
Aug 09 15:50:57 user nova-compute[72382]:       <backend model="random">/dev/urandom</backend>
Aug 09 15:50:57 user nova-compute[72382]:     </rng>
Aug 09 15:50:57 user nova-compute[72382]:     <controller type="usb" index="0" model="none"/>
Aug 09 15:50:57 user nova-compute[72382]:     <memballoon model="virtio">
Aug 09 15:50:57 user nova-compute[72382]:       <stats period="10"/>
Aug 09 15:50:57 user nova-compute[72382]:     </memballoon>
Aug 09 15:50:57 user nova-compute[72382]:   </devices>
Aug 09 15:50:57 user nova-compute[72382]: </domain>
Aug 09 15:50:57 user nova-compute[72382]:  {{(pid=72382) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 15:50:57 user nova-compute[72382]: DEBUG nova.virt.libvirt.vif [None req-eb39e943-09b4-481e-afd1-dc1fa87df594 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T15:50:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-561988152',display_name='tempest-SnapshotDataIntegrityTests-server-561988152',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-561988152',id=52,image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKghkMBbN5vdI0aTQ34VsjrkX3lRB/SiX6+S3R+QZxUFQrO74skN4Z2exCOeujwMVC+Ye5PY/rUEIwS3xfLHO3JMJ1NzWtupnh1iVzGenp+3SRi5mp45Uzg3mEbs6saONA==',key_name='tempest-keypair-1600143604',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6f62d7fd59f9436295c98e08de857253',ramdisk_id='',reservation_id='r-7pw4v9wt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-201807448',owner_user_name='tempest-SnapshotDataIntegrityTests-201807448-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T15:50:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='57aaf2effda74772a3fa5f6e5a2a1964',uuid=5e3853b8-8138-4ab1-8b1c-e853f0a81f5c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e8fcea04-f9ce-4285-8e81-41a2042cbfb0", "address": "fa:16:3e:5d:ca:7b", "network": {"id": "45acf55d-48f5-4a7d-a01c-0aa68e330e1a", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-992217983-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f62d7fd59f9436295c98e08de857253", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8fcea04-f9", "ovs_interfaceid": "e8fcea04-f9ce-4285-8e81-41a2042cbfb0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 15:50:57 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-eb39e943-09b4-481e-afd1-dc1fa87df594 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] Converting VIF {"id": "e8fcea04-f9ce-4285-8e81-41a2042cbfb0", "address": "fa:16:3e:5d:ca:7b", "network": {"id": "45acf55d-48f5-4a7d-a01c-0aa68e330e1a", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-992217983-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f62d7fd59f9436295c98e08de857253", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8fcea04-f9", "ovs_interfaceid": "e8fcea04-f9ce-4285-8e81-41a2042cbfb0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 15:50:57 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-eb39e943-09b4-481e-afd1-dc1fa87df594 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:ca:7b,bridge_name='br-int',has_traffic_filtering=True,id=e8fcea04-f9ce-4285-8e81-41a2042cbfb0,network=Network(45acf55d-48f5-4a7d-a01c-0aa68e330e1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8fcea04-f9') {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 15:50:57 user nova-compute[72382]: DEBUG os_vif [None req-eb39e943-09b4-481e-afd1-dc1fa87df594 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:ca:7b,bridge_name='br-int',has_traffic_filtering=True,id=e8fcea04-f9ce-4285-8e81-41a2042cbfb0,network=Network(45acf55d-48f5-4a7d-a01c-0aa68e330e1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8fcea04-f9') {{(pid=72382) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 15:50:57 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:50:57 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:50:57 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 15:50:57 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:50:57 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape8fcea04-f9, may_exist=True, interface_attrs={}) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:50:57 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape8fcea04-f9, col_values=(('external_ids', {'iface-id': 'e8fcea04-f9ce-4285-8e81-41a2042cbfb0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5d:ca:7b', 'vm-uuid': '5e3853b8-8138-4ab1-8b1c-e853f0a81f5c'}),), if_exists=True) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:50:57 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:50:57 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:50:57 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:50:57 user nova-compute[72382]: INFO os_vif [None req-eb39e943-09b4-481e-afd1-dc1fa87df594 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:ca:7b,bridge_name='br-int',has_traffic_filtering=True,id=e8fcea04-f9ce-4285-8e81-41a2042cbfb0,network=Network(45acf55d-48f5-4a7d-a01c-0aa68e330e1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8fcea04-f9')
Aug 09 15:50:57 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-eb39e943-09b4-481e-afd1-dc1fa87df594 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] No BDM found with device name vda, not building metadata. {{(pid=72382) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 15:50:57 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-eb39e943-09b4-481e-afd1-dc1fa87df594 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] No VIF found with MAC fa:16:3e:5d:ca:7b, not building metadata {{(pid=72382) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 15:50:57 user nova-compute[72382]: DEBUG nova.network.neutron [req-0445cde5-aaf9-442b-a1aa-cb3df3096892 req-03ccb9ba-e987-499b-8b23-b14362f648d4 service nova] [instance: 5e3853b8-8138-4ab1-8b1c-e853f0a81f5c] Updated VIF entry in instance network info cache for port e8fcea04-f9ce-4285-8e81-41a2042cbfb0. {{(pid=72382) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 15:50:57 user nova-compute[72382]: DEBUG nova.network.neutron [req-0445cde5-aaf9-442b-a1aa-cb3df3096892 req-03ccb9ba-e987-499b-8b23-b14362f648d4 service nova] [instance: 5e3853b8-8138-4ab1-8b1c-e853f0a81f5c] Updating instance_info_cache with network_info: [{"id": "e8fcea04-f9ce-4285-8e81-41a2042cbfb0", "address": "fa:16:3e:5d:ca:7b", "network": {"id": "45acf55d-48f5-4a7d-a01c-0aa68e330e1a", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-992217983-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f62d7fd59f9436295c98e08de857253", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8fcea04-f9", "ovs_interfaceid": "e8fcea04-f9ce-4285-8e81-41a2042cbfb0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:50:57 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-0445cde5-aaf9-442b-a1aa-cb3df3096892 req-03ccb9ba-e987-499b-8b23-b14362f648d4 service nova] Releasing lock "refresh_cache-5e3853b8-8138-4ab1-8b1c-e853f0a81f5c" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 15:50:57 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:50:57 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:50:57 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:50:57 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:50:57 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:50:57 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:50:57 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:50:57 user nova-compute[72382]: DEBUG nova.virt.libvirt.imagecache [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Verify base images {{(pid=72382) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Aug 09 15:50:57 user nova-compute[72382]: DEBUG nova.virt.libvirt.imagecache [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Image id a79f2cea-eb27-4631-aaf3-05e7d9e411b4 yields fingerprint 383812ff437283e0191ed5b9ecc04c27f1162b0b {{(pid=72382) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Aug 09 15:50:57 user nova-compute[72382]: INFO nova.virt.libvirt.imagecache [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] image a79f2cea-eb27-4631-aaf3-05e7d9e411b4 at (/opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b): checking
Aug 09 15:50:57 user nova-compute[72382]: DEBUG nova.virt.libvirt.imagecache [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] image a79f2cea-eb27-4631-aaf3-05e7d9e411b4 at (/opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b): image is in use {{(pid=72382) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Aug 09 15:50:57 user nova-compute[72382]: DEBUG nova.virt.libvirt.imagecache [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=72382) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Aug 09 15:50:57 user nova-compute[72382]: DEBUG nova.virt.libvirt.imagecache [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] 5e3853b8-8138-4ab1-8b1c-e853f0a81f5c is a valid instance name {{(pid=72382) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Aug 09 15:50:57 user nova-compute[72382]: DEBUG nova.virt.libvirt.imagecache [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] 5e3853b8-8138-4ab1-8b1c-e853f0a81f5c has a disk file {{(pid=72382) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Aug 09 15:50:57 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e3853b8-8138-4ab1-8b1c-e853f0a81f5c/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:50:58 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e3853b8-8138-4ab1-8b1c-e853f0a81f5c/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:50:58 user nova-compute[72382]: DEBUG nova.virt.libvirt.imagecache [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance 5e3853b8-8138-4ab1-8b1c-e853f0a81f5c is backed by 383812ff437283e0191ed5b9ecc04c27f1162b0b {{(pid=72382) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Aug 09 15:50:58 user nova-compute[72382]: WARNING nova.virt.libvirt.imagecache [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Unknown base file: /opt/stack/data/nova/instances/_base/a6d49bd7165865a8e14e8df0bdc9c9aa25a1c1eb
Aug 09 15:50:58 user nova-compute[72382]: WARNING nova.virt.libvirt.imagecache [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Unknown base file: /opt/stack/data/nova/instances/_base/97ba3ec2a011ee0bfacf71a14aeed71ea64663d4
Aug 09 15:50:58 user nova-compute[72382]: WARNING nova.virt.libvirt.imagecache [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Unknown base file: /opt/stack/data/nova/instances/_base/435c65483e1a876fffea900a5130565343079966
Aug 09 15:50:58 user nova-compute[72382]: WARNING nova.virt.libvirt.imagecache [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Unknown base file: /opt/stack/data/nova/instances/_base/6d4a387337d71e926fbfd3dd254a25e005bc7820
Aug 09 15:50:58 user nova-compute[72382]: WARNING nova.virt.libvirt.imagecache [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Unknown base file: /opt/stack/data/nova/instances/_base/92bc25e5f2690987729e59abf1455719f9df9668
Aug 09 15:50:58 user nova-compute[72382]: WARNING nova.virt.libvirt.imagecache [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Unknown base file: /opt/stack/data/nova/instances/_base/833a4b5481e57761a95d6384779cacacf7c5926a
Aug 09 15:50:58 user nova-compute[72382]: WARNING nova.virt.libvirt.imagecache [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Unknown base file: /opt/stack/data/nova/instances/_base/1e07b87ed1ce10fc0f4fae6000fff51bd0d2dde9
Aug 09 15:50:58 user nova-compute[72382]: WARNING nova.virt.libvirt.imagecache [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Unknown base file: /opt/stack/data/nova/instances/_base/eeff274e00b96a48abd49754175a87239faf62c7
Aug 09 15:50:58 user nova-compute[72382]: WARNING nova.virt.libvirt.imagecache [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Unknown base file: /opt/stack/data/nova/instances/_base/fa19097ff9efd459c9bd1dd3a1c694bbd3a9f791
Aug 09 15:50:58 user nova-compute[72382]: INFO nova.virt.libvirt.imagecache [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Active base files: /opt/stack/data/nova/instances/_base/383812ff437283e0191ed5b9ecc04c27f1162b0b
Aug 09 15:50:58 user nova-compute[72382]: INFO nova.virt.libvirt.imagecache [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Removable base files: /opt/stack/data/nova/instances/_base/a6d49bd7165865a8e14e8df0bdc9c9aa25a1c1eb /opt/stack/data/nova/instances/_base/97ba3ec2a011ee0bfacf71a14aeed71ea64663d4 /opt/stack/data/nova/instances/_base/435c65483e1a876fffea900a5130565343079966 /opt/stack/data/nova/instances/_base/6d4a387337d71e926fbfd3dd254a25e005bc7820 /opt/stack/data/nova/instances/_base/92bc25e5f2690987729e59abf1455719f9df9668 /opt/stack/data/nova/instances/_base/833a4b5481e57761a95d6384779cacacf7c5926a /opt/stack/data/nova/instances/_base/1e07b87ed1ce10fc0f4fae6000fff51bd0d2dde9 /opt/stack/data/nova/instances/_base/eeff274e00b96a48abd49754175a87239faf62c7 /opt/stack/data/nova/instances/_base/fa19097ff9efd459c9bd1dd3a1c694bbd3a9f791
Aug 09 15:50:58 user nova-compute[72382]: INFO nova.virt.libvirt.imagecache [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/a6d49bd7165865a8e14e8df0bdc9c9aa25a1c1eb
Aug 09 15:50:58 user nova-compute[72382]: INFO nova.virt.libvirt.imagecache [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/97ba3ec2a011ee0bfacf71a14aeed71ea64663d4
Aug 09 15:50:58 user nova-compute[72382]: INFO nova.virt.libvirt.imagecache [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/435c65483e1a876fffea900a5130565343079966
Aug 09 15:50:58 user nova-compute[72382]: INFO nova.virt.libvirt.imagecache [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/6d4a387337d71e926fbfd3dd254a25e005bc7820
Aug 09 15:50:58 user nova-compute[72382]: INFO nova.virt.libvirt.imagecache [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/92bc25e5f2690987729e59abf1455719f9df9668
Aug 09 15:50:58 user nova-compute[72382]: INFO nova.virt.libvirt.imagecache [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/833a4b5481e57761a95d6384779cacacf7c5926a
Aug 09 15:50:58 user nova-compute[72382]: INFO nova.virt.libvirt.imagecache [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/1e07b87ed1ce10fc0f4fae6000fff51bd0d2dde9
Aug 09 15:50:58 user nova-compute[72382]: INFO nova.virt.libvirt.imagecache [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/eeff274e00b96a48abd49754175a87239faf62c7
Aug 09 15:50:58 user nova-compute[72382]: INFO nova.virt.libvirt.imagecache [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/fa19097ff9efd459c9bd1dd3a1c694bbd3a9f791
Aug 09 15:50:58 user nova-compute[72382]: DEBUG nova.virt.libvirt.imagecache [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Verification complete {{(pid=72382) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Aug 09 15:50:58 user nova-compute[72382]: DEBUG nova.virt.libvirt.imagecache [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Verify swap images {{(pid=72382) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Aug 09 15:50:58 user nova-compute[72382]: DEBUG nova.virt.libvirt.imagecache [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Verify ephemeral images {{(pid=72382) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Aug 09 15:50:58 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:50:58 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:50:58 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:50:59 user nova-compute[72382]: DEBUG nova.compute.manager [req-42148b0b-8c46-442e-aee8-42b4efb192d4 req-01d9aba8-63c9-4f74-b179-6cf51efa84a5 service nova] [instance: 5e3853b8-8138-4ab1-8b1c-e853f0a81f5c] Received event network-vif-plugged-e8fcea04-f9ce-4285-8e81-41a2042cbfb0 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:50:59 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-42148b0b-8c46-442e-aee8-42b4efb192d4 req-01d9aba8-63c9-4f74-b179-6cf51efa84a5 service nova] Acquiring lock "5e3853b8-8138-4ab1-8b1c-e853f0a81f5c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:50:59 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-42148b0b-8c46-442e-aee8-42b4efb192d4 req-01d9aba8-63c9-4f74-b179-6cf51efa84a5 service nova] Lock "5e3853b8-8138-4ab1-8b1c-e853f0a81f5c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:50:59 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-42148b0b-8c46-442e-aee8-42b4efb192d4 req-01d9aba8-63c9-4f74-b179-6cf51efa84a5 service nova] Lock "5e3853b8-8138-4ab1-8b1c-e853f0a81f5c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:50:59 user nova-compute[72382]: DEBUG nova.compute.manager [req-42148b0b-8c46-442e-aee8-42b4efb192d4 req-01d9aba8-63c9-4f74-b179-6cf51efa84a5 service nova] [instance: 5e3853b8-8138-4ab1-8b1c-e853f0a81f5c] No waiting events found dispatching network-vif-plugged-e8fcea04-f9ce-4285-8e81-41a2042cbfb0 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:50:59 user nova-compute[72382]: WARNING nova.compute.manager [req-42148b0b-8c46-442e-aee8-42b4efb192d4 req-01d9aba8-63c9-4f74-b179-6cf51efa84a5 service nova] [instance: 5e3853b8-8138-4ab1-8b1c-e853f0a81f5c] Received unexpected event network-vif-plugged-e8fcea04-f9ce-4285-8e81-41a2042cbfb0 for instance with vm_state building and task_state spawning.
Aug 09 15:50:59 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:50:59 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:50:59 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:51:00 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:51:01 user nova-compute[72382]: DEBUG nova.compute.manager [req-2c3cc2ab-014a-4dcc-a57d-fbbacdbc81d5 req-32b10200-1911-49f6-9587-6705de8cb19b service nova] [instance: 5e3853b8-8138-4ab1-8b1c-e853f0a81f5c] Received event network-vif-plugged-e8fcea04-f9ce-4285-8e81-41a2042cbfb0 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:51:01 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-2c3cc2ab-014a-4dcc-a57d-fbbacdbc81d5 req-32b10200-1911-49f6-9587-6705de8cb19b service nova] Acquiring lock "5e3853b8-8138-4ab1-8b1c-e853f0a81f5c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:51:01 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-2c3cc2ab-014a-4dcc-a57d-fbbacdbc81d5 req-32b10200-1911-49f6-9587-6705de8cb19b service nova] Lock "5e3853b8-8138-4ab1-8b1c-e853f0a81f5c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:51:01 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-2c3cc2ab-014a-4dcc-a57d-fbbacdbc81d5 req-32b10200-1911-49f6-9587-6705de8cb19b service nova] Lock "5e3853b8-8138-4ab1-8b1c-e853f0a81f5c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:51:01 user nova-compute[72382]: DEBUG nova.compute.manager [req-2c3cc2ab-014a-4dcc-a57d-fbbacdbc81d5 req-32b10200-1911-49f6-9587-6705de8cb19b service nova] [instance: 5e3853b8-8138-4ab1-8b1c-e853f0a81f5c] No waiting events found dispatching network-vif-plugged-e8fcea04-f9ce-4285-8e81-41a2042cbfb0 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:51:01 user nova-compute[72382]: WARNING nova.compute.manager [req-2c3cc2ab-014a-4dcc-a57d-fbbacdbc81d5 req-32b10200-1911-49f6-9587-6705de8cb19b service nova] [instance: 5e3853b8-8138-4ab1-8b1c-e853f0a81f5c] Received unexpected event network-vif-plugged-e8fcea04-f9ce-4285-8e81-41a2042cbfb0 for instance with vm_state building and task_state spawning.
Aug 09 15:51:01 user nova-compute[72382]: DEBUG nova.virt.driver [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Emitting event <LifecycleEvent: 1691596261.454935, 5e3853b8-8138-4ab1-8b1c-e853f0a81f5c => Resumed> {{(pid=72382) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 15:51:01 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 5e3853b8-8138-4ab1-8b1c-e853f0a81f5c] VM Resumed (Lifecycle Event)
Aug 09 15:51:01 user nova-compute[72382]: DEBUG nova.compute.manager [None req-eb39e943-09b4-481e-afd1-dc1fa87df594 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] [instance: 5e3853b8-8138-4ab1-8b1c-e853f0a81f5c] Instance event wait completed in 0 seconds for  {{(pid=72382) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 15:51:01 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-eb39e943-09b4-481e-afd1-dc1fa87df594 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] [instance: 5e3853b8-8138-4ab1-8b1c-e853f0a81f5c] Guest created on hypervisor {{(pid=72382) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 15:51:01 user nova-compute[72382]: INFO nova.virt.libvirt.driver [-] [instance: 5e3853b8-8138-4ab1-8b1c-e853f0a81f5c] Instance spawned successfully.
Aug 09 15:51:01 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-eb39e943-09b4-481e-afd1-dc1fa87df594 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] [instance: 5e3853b8-8138-4ab1-8b1c-e853f0a81f5c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 15:51:01 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 5e3853b8-8138-4ab1-8b1c-e853f0a81f5c] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:51:01 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 5e3853b8-8138-4ab1-8b1c-e853f0a81f5c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72382) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 15:51:01 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-eb39e943-09b4-481e-afd1-dc1fa87df594 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] [instance: 5e3853b8-8138-4ab1-8b1c-e853f0a81f5c] Found default for hw_cdrom_bus of ide {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:51:01 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-eb39e943-09b4-481e-afd1-dc1fa87df594 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] [instance: 5e3853b8-8138-4ab1-8b1c-e853f0a81f5c] Found default for hw_disk_bus of virtio {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:51:01 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-eb39e943-09b4-481e-afd1-dc1fa87df594 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] [instance: 5e3853b8-8138-4ab1-8b1c-e853f0a81f5c] Found default for hw_input_bus of None {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:51:01 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-eb39e943-09b4-481e-afd1-dc1fa87df594 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] [instance: 5e3853b8-8138-4ab1-8b1c-e853f0a81f5c] Found default for hw_pointer_model of None {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:51:01 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-eb39e943-09b4-481e-afd1-dc1fa87df594 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] [instance: 5e3853b8-8138-4ab1-8b1c-e853f0a81f5c] Found default for hw_video_model of virtio {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:51:01 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-eb39e943-09b4-481e-afd1-dc1fa87df594 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] [instance: 5e3853b8-8138-4ab1-8b1c-e853f0a81f5c] Found default for hw_vif_model of virtio {{(pid=72382) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 15:51:01 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 5e3853b8-8138-4ab1-8b1c-e853f0a81f5c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 15:51:01 user nova-compute[72382]: DEBUG nova.virt.driver [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Emitting event <LifecycleEvent: 1691596261.4567068, 5e3853b8-8138-4ab1-8b1c-e853f0a81f5c => Started> {{(pid=72382) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 15:51:01 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 5e3853b8-8138-4ab1-8b1c-e853f0a81f5c] VM Started (Lifecycle Event)
Aug 09 15:51:01 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 5e3853b8-8138-4ab1-8b1c-e853f0a81f5c] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:51:01 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 5e3853b8-8138-4ab1-8b1c-e853f0a81f5c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72382) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 15:51:01 user nova-compute[72382]: INFO nova.compute.manager [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] [instance: 5e3853b8-8138-4ab1-8b1c-e853f0a81f5c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 15:51:01 user nova-compute[72382]: INFO nova.compute.manager [None req-eb39e943-09b4-481e-afd1-dc1fa87df594 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] [instance: 5e3853b8-8138-4ab1-8b1c-e853f0a81f5c] Took 6.52 seconds to spawn the instance on the hypervisor.
Aug 09 15:51:01 user nova-compute[72382]: DEBUG nova.compute.manager [None req-eb39e943-09b4-481e-afd1-dc1fa87df594 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] [instance: 5e3853b8-8138-4ab1-8b1c-e853f0a81f5c] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:51:01 user nova-compute[72382]: INFO nova.compute.manager [None req-eb39e943-09b4-481e-afd1-dc1fa87df594 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] [instance: 5e3853b8-8138-4ab1-8b1c-e853f0a81f5c] Took 7.35 seconds to build instance.
Aug 09 15:51:01 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-eb39e943-09b4-481e-afd1-dc1fa87df594 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] Lock "5e3853b8-8138-4ab1-8b1c-e853f0a81f5c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.470s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:51:02 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:51:05 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:51:07 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:51:10 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:51:10 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:51:12 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:51:17 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:51:20 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:51:22 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:51:25 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:51:27 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:51:30 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:51:30 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:51:30 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:51:30 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:51:30 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:51:30 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Auditing locally available compute resources for user (node: user) {{(pid=72382) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 15:51:30 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:51:30 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e3853b8-8138-4ab1-8b1c-e853f0a81f5c/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:51:30 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e3853b8-8138-4ab1-8b1c-e853f0a81f5c/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:51:30 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e3853b8-8138-4ab1-8b1c-e853f0a81f5c/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:51:30 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e3853b8-8138-4ab1-8b1c-e853f0a81f5c/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:51:31 user nova-compute[72382]: WARNING nova.virt.libvirt.driver [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 15:51:31 user nova-compute[72382]: WARNING nova.virt.libvirt.driver [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 15:51:31 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Hypervisor/Node resource view: name=user free_ram=8603MB free_disk=25.28398895263672GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72382) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 15:51:31 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:51:31 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:51:31 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance 5e3853b8-8138-4ab1-8b1c-e853f0a81f5c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:51:31 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72382) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 15:51:31 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72382) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 15:51:31 user nova-compute[72382]: DEBUG nova.compute.provider_tree [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Inventory has not changed in ProviderTree for provider: 7b15b0e5-df4d-49db-833b-2855d21d10ae {{(pid=72382) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 15:51:31 user nova-compute[72382]: DEBUG nova.scheduler.client.report [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Inventory has not changed for provider 7b15b0e5-df4d-49db-833b-2855d21d10ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72382) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 15:51:31 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Compute_service record updated for user:user {{(pid=72382) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 15:51:31 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.231s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:51:32 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:51:32 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:51:32 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:51:34 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:51:34 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:51:34 user nova-compute[72382]: DEBUG nova.compute.manager [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Starting heal instance info cache {{(pid=72382) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 15:51:34 user nova-compute[72382]: DEBUG nova.compute.manager [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Rebuilding the list of instances to heal {{(pid=72382) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 09 15:51:35 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:51:35 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Acquiring lock "refresh_cache-5e3853b8-8138-4ab1-8b1c-e853f0a81f5c" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 15:51:35 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Acquired lock "refresh_cache-5e3853b8-8138-4ab1-8b1c-e853f0a81f5c" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 15:51:35 user nova-compute[72382]: DEBUG nova.network.neutron [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] [instance: 5e3853b8-8138-4ab1-8b1c-e853f0a81f5c] Forcefully refreshing network info cache for instance {{(pid=72382) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 15:51:35 user nova-compute[72382]: DEBUG nova.objects.instance [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lazy-loading 'info_cache' on Instance uuid 5e3853b8-8138-4ab1-8b1c-e853f0a81f5c {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:51:35 user nova-compute[72382]: DEBUG nova.network.neutron [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] [instance: 5e3853b8-8138-4ab1-8b1c-e853f0a81f5c] Updating instance_info_cache with network_info: [{"id": "e8fcea04-f9ce-4285-8e81-41a2042cbfb0", "address": "fa:16:3e:5d:ca:7b", "network": {"id": "45acf55d-48f5-4a7d-a01c-0aa68e330e1a", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-992217983-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f62d7fd59f9436295c98e08de857253", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8fcea04-f9", "ovs_interfaceid": "e8fcea04-f9ce-4285-8e81-41a2042cbfb0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:51:35 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Releasing lock "refresh_cache-5e3853b8-8138-4ab1-8b1c-e853f0a81f5c" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 15:51:35 user nova-compute[72382]: DEBUG nova.compute.manager [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] [instance: 5e3853b8-8138-4ab1-8b1c-e853f0a81f5c] Updated the network info_cache for instance {{(pid=72382) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 15:51:35 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:51:35 user nova-compute[72382]: DEBUG nova.compute.manager [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Cleaning up deleted instances {{(pid=72382) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 09 15:51:35 user nova-compute[72382]: DEBUG nova.compute.manager [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] There are 0 instances to clean {{(pid=72382) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 09 15:51:36 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:51:36 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:51:36 user nova-compute[72382]: DEBUG nova.compute.manager [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72382) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 15:51:37 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:51:41 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:51:41 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:51:42 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:51:45 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:51:45 user nova-compute[72382]: DEBUG nova.compute.manager [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Cleaning up deleted instances with incomplete migration  {{(pid=72382) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 09 15:51:47 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:51:47 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:51:47 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72382) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 15:51:47 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72382) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 15:51:47 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72382) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 15:51:47 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:51:52 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:51:52 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:51:57 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:51:57 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:51:57 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72382) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 15:51:57 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72382) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 15:51:57 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72382) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 15:51:57 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:52:02 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:52:07 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:52:07 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:52:07 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72382) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 15:52:07 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72382) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 15:52:07 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:52:07 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72382) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 15:52:12 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:52:17 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:52:17 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:52:17 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72382) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 15:52:17 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72382) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 15:52:17 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72382) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 15:52:17 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:52:22 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:52:23 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._sync_power_states {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:52:23 user nova-compute[72382]: DEBUG nova.compute.manager [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Triggering sync for uuid 5e3853b8-8138-4ab1-8b1c-e853f0a81f5c {{(pid=72382) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 09 15:52:23 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Acquiring lock "5e3853b8-8138-4ab1-8b1c-e853f0a81f5c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:52:23 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "5e3853b8-8138-4ab1-8b1c-e853f0a81f5c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:52:23 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "5e3853b8-8138-4ab1-8b1c-e853f0a81f5c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.026s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:52:27 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:52:30 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:52:31 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:52:31 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:52:31 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:52:31 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:52:31 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Auditing locally available compute resources for user (node: user) {{(pid=72382) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 15:52:31 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e3853b8-8138-4ab1-8b1c-e853f0a81f5c/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:52:32 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e3853b8-8138-4ab1-8b1c-e853f0a81f5c/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:52:32 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e3853b8-8138-4ab1-8b1c-e853f0a81f5c/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:52:32 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e3853b8-8138-4ab1-8b1c-e853f0a81f5c/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:52:32 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:52:32 user nova-compute[72382]: WARNING nova.virt.libvirt.driver [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 15:52:32 user nova-compute[72382]: WARNING nova.virt.libvirt.driver [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 15:52:32 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Hypervisor/Node resource view: name=user free_ram=8856MB free_disk=25.281982421875GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72382) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 15:52:32 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:52:32 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:52:33 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance 5e3853b8-8138-4ab1-8b1c-e853f0a81f5c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:52:33 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72382) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 15:52:33 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72382) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 15:52:33 user nova-compute[72382]: DEBUG nova.scheduler.client.report [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Refreshing inventories for resource provider 7b15b0e5-df4d-49db-833b-2855d21d10ae {{(pid=72382) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 09 15:52:33 user nova-compute[72382]: DEBUG nova.scheduler.client.report [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Updating ProviderTree inventory for provider 7b15b0e5-df4d-49db-833b-2855d21d10ae from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72382) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 09 15:52:33 user nova-compute[72382]: DEBUG nova.compute.provider_tree [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Updating inventory in ProviderTree for provider 7b15b0e5-df4d-49db-833b-2855d21d10ae with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72382) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 09 15:52:33 user nova-compute[72382]: DEBUG nova.scheduler.client.report [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Refreshing aggregate associations for resource provider 7b15b0e5-df4d-49db-833b-2855d21d10ae, aggregates: None {{(pid=72382) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 09 15:52:33 user nova-compute[72382]: DEBUG nova.scheduler.client.report [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Refreshing trait associations for resource provider 7b15b0e5-df4d-49db-833b-2855d21d10ae, traits: COMPUTE_DEVICE_TAGGING,COMPUTE_NODE,COMPUTE_VOLUME_EXTEND,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE42,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_MMX,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE2 {{(pid=72382) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 09 15:52:33 user nova-compute[72382]: DEBUG nova.compute.provider_tree [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Inventory has not changed in ProviderTree for provider: 7b15b0e5-df4d-49db-833b-2855d21d10ae {{(pid=72382) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 15:52:33 user nova-compute[72382]: DEBUG nova.scheduler.client.report [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Inventory has not changed for provider 7b15b0e5-df4d-49db-833b-2855d21d10ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72382) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 15:52:33 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Compute_service record updated for user:user {{(pid=72382) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 15:52:33 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.536s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:52:34 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:52:34 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:52:34 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:52:34 user nova-compute[72382]: DEBUG nova.compute.manager [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Starting heal instance info cache {{(pid=72382) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 15:52:34 user nova-compute[72382]: DEBUG nova.compute.manager [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Rebuilding the list of instances to heal {{(pid=72382) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 09 15:52:35 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Acquiring lock "refresh_cache-5e3853b8-8138-4ab1-8b1c-e853f0a81f5c" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 15:52:35 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Acquired lock "refresh_cache-5e3853b8-8138-4ab1-8b1c-e853f0a81f5c" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 15:52:35 user nova-compute[72382]: DEBUG nova.network.neutron [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] [instance: 5e3853b8-8138-4ab1-8b1c-e853f0a81f5c] Forcefully refreshing network info cache for instance {{(pid=72382) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 15:52:35 user nova-compute[72382]: DEBUG nova.objects.instance [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lazy-loading 'info_cache' on Instance uuid 5e3853b8-8138-4ab1-8b1c-e853f0a81f5c {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:52:35 user nova-compute[72382]: DEBUG nova.network.neutron [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] [instance: 5e3853b8-8138-4ab1-8b1c-e853f0a81f5c] Updating instance_info_cache with network_info: [{"id": "e8fcea04-f9ce-4285-8e81-41a2042cbfb0", "address": "fa:16:3e:5d:ca:7b", "network": {"id": "45acf55d-48f5-4a7d-a01c-0aa68e330e1a", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-992217983-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f62d7fd59f9436295c98e08de857253", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8fcea04-f9", "ovs_interfaceid": "e8fcea04-f9ce-4285-8e81-41a2042cbfb0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:52:35 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Releasing lock "refresh_cache-5e3853b8-8138-4ab1-8b1c-e853f0a81f5c" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 15:52:35 user nova-compute[72382]: DEBUG nova.compute.manager [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] [instance: 5e3853b8-8138-4ab1-8b1c-e853f0a81f5c] Updated the network info_cache for instance {{(pid=72382) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 15:52:36 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:52:36 user nova-compute[72382]: DEBUG nova.compute.manager [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72382) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 15:52:37 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:52:37 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:52:37 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72382) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 15:52:37 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72382) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 15:52:37 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72382) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 15:52:37 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:52:38 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:52:41 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:52:41 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:52:42 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:52:42 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:52:42 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72382) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 15:52:42 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72382) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 15:52:42 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72382) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 15:52:42 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:52:45 user nova-compute[72382]: DEBUG nova.compute.manager [req-e5039f66-b85d-45ba-b2ce-37c520e480bb req-8ecc32cc-eb5f-48ac-b791-4448e434276b service nova] [instance: 5e3853b8-8138-4ab1-8b1c-e853f0a81f5c] Received event network-changed-e8fcea04-f9ce-4285-8e81-41a2042cbfb0 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:52:45 user nova-compute[72382]: DEBUG nova.compute.manager [req-e5039f66-b85d-45ba-b2ce-37c520e480bb req-8ecc32cc-eb5f-48ac-b791-4448e434276b service nova] [instance: 5e3853b8-8138-4ab1-8b1c-e853f0a81f5c] Refreshing instance network info cache due to event network-changed-e8fcea04-f9ce-4285-8e81-41a2042cbfb0. {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 15:52:45 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-e5039f66-b85d-45ba-b2ce-37c520e480bb req-8ecc32cc-eb5f-48ac-b791-4448e434276b service nova] Acquiring lock "refresh_cache-5e3853b8-8138-4ab1-8b1c-e853f0a81f5c" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 15:52:45 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-e5039f66-b85d-45ba-b2ce-37c520e480bb req-8ecc32cc-eb5f-48ac-b791-4448e434276b service nova] Acquired lock "refresh_cache-5e3853b8-8138-4ab1-8b1c-e853f0a81f5c" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 15:52:45 user nova-compute[72382]: DEBUG nova.network.neutron [req-e5039f66-b85d-45ba-b2ce-37c520e480bb req-8ecc32cc-eb5f-48ac-b791-4448e434276b service nova] [instance: 5e3853b8-8138-4ab1-8b1c-e853f0a81f5c] Refreshing network info cache for port e8fcea04-f9ce-4285-8e81-41a2042cbfb0 {{(pid=72382) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 15:52:45 user nova-compute[72382]: DEBUG nova.network.neutron [req-e5039f66-b85d-45ba-b2ce-37c520e480bb req-8ecc32cc-eb5f-48ac-b791-4448e434276b service nova] [instance: 5e3853b8-8138-4ab1-8b1c-e853f0a81f5c] Updated VIF entry in instance network info cache for port e8fcea04-f9ce-4285-8e81-41a2042cbfb0. {{(pid=72382) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 15:52:45 user nova-compute[72382]: DEBUG nova.network.neutron [req-e5039f66-b85d-45ba-b2ce-37c520e480bb req-8ecc32cc-eb5f-48ac-b791-4448e434276b service nova] [instance: 5e3853b8-8138-4ab1-8b1c-e853f0a81f5c] Updating instance_info_cache with network_info: [{"id": "e8fcea04-f9ce-4285-8e81-41a2042cbfb0", "address": "fa:16:3e:5d:ca:7b", "network": {"id": "45acf55d-48f5-4a7d-a01c-0aa68e330e1a", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-992217983-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f62d7fd59f9436295c98e08de857253", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8fcea04-f9", "ovs_interfaceid": "e8fcea04-f9ce-4285-8e81-41a2042cbfb0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:52:46 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-e5039f66-b85d-45ba-b2ce-37c520e480bb req-8ecc32cc-eb5f-48ac-b791-4448e434276b service nova] Releasing lock "refresh_cache-5e3853b8-8138-4ab1-8b1c-e853f0a81f5c" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 15:52:47 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:52:50 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-6e924dbb-795e-47b2-9f11-82c143c01747 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] Acquiring lock "5e3853b8-8138-4ab1-8b1c-e853f0a81f5c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:52:50 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-6e924dbb-795e-47b2-9f11-82c143c01747 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] Lock "5e3853b8-8138-4ab1-8b1c-e853f0a81f5c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:52:50 user nova-compute[72382]: DEBUG nova.objects.instance [None req-6e924dbb-795e-47b2-9f11-82c143c01747 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] Lazy-loading 'flavor' on Instance uuid 5e3853b8-8138-4ab1-8b1c-e853f0a81f5c {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:52:50 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-6e924dbb-795e-47b2-9f11-82c143c01747 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] Lock "5e3853b8-8138-4ab1-8b1c-e853f0a81f5c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:52:50 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:52:50 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-6e924dbb-795e-47b2-9f11-82c143c01747 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] Acquiring lock "5e3853b8-8138-4ab1-8b1c-e853f0a81f5c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:52:50 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-6e924dbb-795e-47b2-9f11-82c143c01747 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] Lock "5e3853b8-8138-4ab1-8b1c-e853f0a81f5c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:52:50 user nova-compute[72382]: INFO nova.compute.manager [None req-6e924dbb-795e-47b2-9f11-82c143c01747 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] [instance: 5e3853b8-8138-4ab1-8b1c-e853f0a81f5c] Attaching volume b3dc8d00-9445-4d73-aa38-71502be3ad16 to /dev/vdb
Aug 09 15:52:50 user nova-compute[72382]: DEBUG os_brick.utils [None req-6e924dbb-795e-47b2-9f11-82c143c01747 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 15:52:50 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:52:50 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:52:50 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[6af75db7-06f2-447b-8a82-fd0ed27d42fe]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d2cfa7015fe\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:52:50 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:52:50 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:52:50 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[88c9f3b3-86a9-4d6b-913b-14a1aa1f8a55]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:52:50 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:52:50 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:52:50 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[640c420a-817d-4c87-823c-73b4851d6a42]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:52:50 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[70d871fc-c574-4f8c-885c-4376f0eebe93]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:52:50 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-6e924dbb-795e-47b2-9f11-82c143c01747 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] Running cmd (subprocess): nvme version {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:52:50 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-6e924dbb-795e-47b2-9f11-82c143c01747 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] 'nvme version' failed. Not Retrying. {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 15:52:50 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6e924dbb-795e-47b2-9f11-82c143c01747 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] nvme not present on system {{(pid=72382) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 15:52:50 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:52:50 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 15:52:50 user nova-compute[72382]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 15:52:50 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[9004f574-1d5d-458a-8427-3f902925e0d2]: (4, '') {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:52:50 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.lightos [None req-6e924dbb-795e-47b2-9f11-82c143c01747 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72382) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 15:52:50 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.lightos [None req-6e924dbb-795e-47b2-9f11-82c143c01747 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72382) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 15:52:50 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.lightos [None req-6e924dbb-795e-47b2-9f11-82c143c01747 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] LIGHTOS: no hostnqn found. {{(pid=72382) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 15:52:50 user nova-compute[72382]: DEBUG os_brick.utils [None req-6e924dbb-795e-47b2-9f11-82c143c01747 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d2cfa7015fe', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 15:52:50 user nova-compute[72382]: DEBUG nova.virt.block_device [None req-6e924dbb-795e-47b2-9f11-82c143c01747 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] [instance: 5e3853b8-8138-4ab1-8b1c-e853f0a81f5c] Updating existing volume attachment record: 88a7cf9f-d794-4160-bd41-3bad923fb43a {{(pid=72382) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 15:52:52 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:52:55 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:52:57 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:52:58 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6e924dbb-795e-47b2-9f11-82c143c01747 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] [instance: 5e3853b8-8138-4ab1-8b1c-e853f0a81f5c] Calling os-brick to attach iSCSI Volume {{(pid=72382) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 15:52:58 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e924dbb-795e-47b2-9f11-82c143c01747 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2a0c768340>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:b3dc8d00-9445-4d73-aa38-71502be3ad16'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hzVDbkOn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 15:52:58 user nova-compute[72382]: WARNING os_brick.initiator.connectors.base [None req-6e924dbb-795e-47b2-9f11-82c143c01747 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 15:52:58 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-6e924dbb-795e-47b2-9f11-82c143c01747 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 15:52:58 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-6e924dbb-795e-47b2-9f11-82c143c01747 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 15:52:58 user nova-compute[72382]: WARNING os_brick.initiator.connectors.base [None req-6e924dbb-795e-47b2-9f11-82c143c01747 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 15:52:58 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-6e924dbb-795e-47b2-9f11-82c143c01747 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b3dc8d00-9445-4d73-aa38-71502be3ad16" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 15:52:58 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-6e924dbb-795e-47b2-9f11-82c143c01747 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b3dc8d00-9445-4d73-aa38-71502be3ad16" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 15:52:58 user nova-compute[72382]: INFO os_brick.initiator.connectors.iscsi [None req-6e924dbb-795e-47b2-9f11-82c143c01747 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 15:52:58 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3dc8d00-9445-4d73-aa38-71502be3ad16 -p 172.16.0.220:3260 {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:52:58 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3dc8d00-9445-4d73-aa38-71502be3ad16 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:52:58 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[e23345b5-382a-4f8e-8041-2d5839ac9099]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:52:58 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e924dbb-795e-47b2-9f11-82c143c01747 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 15:52:58 user nova-compute[72382]:  {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:52:58 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3dc8d00-9445-4d73-aa38-71502be3ad16 -p 172.16.0.220:3260 --interface default --op new {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:52:58 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3dc8d00-9445-4d73-aa38-71502be3ad16 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:52:58 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2b4a6e8-7692-4556-a4b3-0cc3ce3b56be]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b3dc8d00-9445-4d73-aa38-71502be3ad16] added\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:52:58 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e924dbb-795e-47b2-9f11-82c143c01747 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b3dc8d00-9445-4d73-aa38-71502be3ad16] added
Aug 09 15:52:58 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:52:58 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3dc8d00-9445-4d73-aa38-71502be3ad16 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:52:58 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3dc8d00-9445-4d73-aa38-71502be3ad16 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:52:58 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[34f872c5-68fb-4e79-97da-3259a208e40c]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:52:58 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e924dbb-795e-47b2-9f11-82c143c01747 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:52:58 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3dc8d00-9445-4d73-aa38-71502be3ad16 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:52:58 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3dc8d00-9445-4d73-aa38-71502be3ad16 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:52:58 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdf74815-ca7f-4fd7-9ded-d0917e8116d4]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:52:58 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e924dbb-795e-47b2-9f11-82c143c01747 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:52:58 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3dc8d00-9445-4d73-aa38-71502be3ad16 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hzVDbkOn {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:52:58 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3dc8d00-9445-4d73-aa38-71502be3ad16 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hzVDbkOn" returned: 0 in 0.017s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:52:58 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[8714e147-208d-4a00-b44d-f88f1b69f8bc]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:52:58 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e924dbb-795e-47b2-9f11-82c143c01747 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hzVDbkOn'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:52:58 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3dc8d00-9445-4d73-aa38-71502be3ad16 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:52:58 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3dc8d00-9445-4d73-aa38-71502be3ad16 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:52:58 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e7558f7-6592-4130-97d8-c7a2c9d6afb7]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:52:58 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e924dbb-795e-47b2-9f11-82c143c01747 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:52:58 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:52:58 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:52:58 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb8c480b-488d-44c7-aa30-72c2e03dec03]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:52:58 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e924dbb-795e-47b2-9f11-82c143c01747 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 09 15:52:58 user nova-compute[72382]:  {{(pid=72382) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 15:52:58 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e924dbb-795e-47b2-9f11-82c143c01747 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 09 15:52:58 user nova-compute[72382]:  {{(pid=72382) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 15:52:58 user nova-compute[72382]: WARNING os_brick.initiator.connectors.iscsi [None req-6e924dbb-795e-47b2-9f11-82c143c01747 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 09 15:52:58 user nova-compute[72382]: 
Aug 09 15:52:58 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3dc8d00-9445-4d73-aa38-71502be3ad16 -p 172.16.0.220:3260 --login {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:52:58 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3dc8d00-9445-4d73-aa38-71502be3ad16 -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:52:58 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[830f06d4-9ba7-4300-aee2-60328ad84266]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b3dc8d00-9445-4d73-aa38-71502be3ad16, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b3dc8d00-9445-4d73-aa38-71502be3ad16, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:52:58 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e924dbb-795e-47b2-9f11-82c143c01747 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b3dc8d00-9445-4d73-aa38-71502be3ad16, portal: 172.16.0.220,3260]
Aug 09 15:52:58 user nova-compute[72382]: Login to [iface: default, target: iqn.2010-10.org.openstack:b3dc8d00-9445-4d73-aa38-71502be3ad16, portal: 172.16.0.220,3260] successful.
Aug 09 15:52:58 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:52:58 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3dc8d00-9445-4d73-aa38-71502be3ad16 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:52:58 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3dc8d00-9445-4d73-aa38-71502be3ad16 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:52:58 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[86f61d05-946f-4069-af95-90dc6cb2fbad]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:52:58 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e924dbb-795e-47b2-9f11-82c143c01747 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:52:58 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:52:58 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:52:58 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[2df2903f-bbbd-4b50-846e-c0d0118860b1]: (4, ('tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3dc8d00-9445-4d73-aa38-71502be3ad16 (non-flash)\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:52:58 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e924dbb-795e-47b2-9f11-82c143c01747 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3dc8d00-9445-4d73-aa38-71502be3ad16 (non-flash)
Aug 09 15:52:58 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 15:52:58 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e924dbb-795e-47b2-9f11-82c143c01747 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] iscsi session list stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3dc8d00-9445-4d73-aa38-71502be3ad16 (non-flash)
Aug 09 15:52:58 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 15:52:58 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-6e924dbb-795e-47b2-9f11-82c143c01747 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b3dc8d00-9445-4d73-aa38-71502be3ad16" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.255s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 15:52:58 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e924dbb-795e-47b2-9f11-82c143c01747 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] Connected to 172.16.0.220:3260 {{(pid=72382) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 15:52:58 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-6e924dbb-795e-47b2-9f11-82c143c01747 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] HCTL ('33', '-', '-', 0) found on session 67 with lun 0 {{(pid=72382) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 15:52:58 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-6e924dbb-795e-47b2-9f11-82c143c01747 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72382) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 15:52:58 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:52:58 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:52:58 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e513a77-2604-4ebd-9e7b-3ea7739b5e71]: (4, ('- - 0', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:52:58 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-6e924dbb-795e-47b2-9f11-82c143c01747 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] Searching for a device in session 67 and hctl ['33', '*', '*', 0] yield: None {{(pid=72382) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 15:52:59 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-6e924dbb-795e-47b2-9f11-82c143c01747 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] Searching for a device in session 67 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72382) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 15:52:59 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e924dbb-795e-47b2-9f11-82c143c01747 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hzVDbkOn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72382) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 15:52:59 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-6e924dbb-795e-47b2-9f11-82c143c01747 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.284s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 15:52:59 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e924dbb-795e-47b2-9f11-82c143c01747 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] <== connect_volume: return (1285ms) {'type': 'block', 'scsi_wwn': '23532666266613937', 'path': '/dev/sdb'} {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 15:52:59 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6e924dbb-795e-47b2-9f11-82c143c01747 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] [instance: 5e3853b8-8138-4ab1-8b1c-e853f0a81f5c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23532666266613937', 'path': '/dev/sdb'} {{(pid=72382) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 15:52:59 user nova-compute[72382]: DEBUG nova.objects.instance [None req-6e924dbb-795e-47b2-9f11-82c143c01747 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] Lazy-loading 'flavor' on Instance uuid 5e3853b8-8138-4ab1-8b1c-e853f0a81f5c {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:52:59 user nova-compute[72382]: DEBUG nova.virt.libvirt.guest [None req-6e924dbb-795e-47b2-9f11-82c143c01747 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 15:52:59 user nova-compute[72382]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 15:52:59 user nova-compute[72382]:   <source dev="/dev/sdb"/>
Aug 09 15:52:59 user nova-compute[72382]:   <target dev="vdb" bus="virtio"/>
Aug 09 15:52:59 user nova-compute[72382]:   <serial>b3dc8d00-9445-4d73-aa38-71502be3ad16</serial>
Aug 09 15:52:59 user nova-compute[72382]: </disk>
Aug 09 15:52:59 user nova-compute[72382]:  {{(pid=72382) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 15:53:00 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-6e924dbb-795e-47b2-9f11-82c143c01747 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] No BDM found with device name vda, not building metadata. {{(pid=72382) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 15:53:00 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-6e924dbb-795e-47b2-9f11-82c143c01747 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72382) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 15:53:00 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-6e924dbb-795e-47b2-9f11-82c143c01747 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] No VIF found with MAC fa:16:3e:5d:ca:7b, not building metadata {{(pid=72382) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 15:53:00 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-6e924dbb-795e-47b2-9f11-82c143c01747 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] Lock "5e3853b8-8138-4ab1-8b1c-e853f0a81f5c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.851s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:53:00 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:53:02 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:53:05 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:53:07 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:53:10 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:53:12 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:53:17 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:53:20 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:53:22 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:53:23 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-d9f258f7-a773-4a8c-b7fd-6ce9f6b758b4 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] Acquiring lock "5e3853b8-8138-4ab1-8b1c-e853f0a81f5c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:53:23 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-d9f258f7-a773-4a8c-b7fd-6ce9f6b758b4 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] Lock "5e3853b8-8138-4ab1-8b1c-e853f0a81f5c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:53:23 user nova-compute[72382]: INFO nova.compute.manager [None req-d9f258f7-a773-4a8c-b7fd-6ce9f6b758b4 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] [instance: 5e3853b8-8138-4ab1-8b1c-e853f0a81f5c] Detaching volume b3dc8d00-9445-4d73-aa38-71502be3ad16
Aug 09 15:53:23 user nova-compute[72382]: INFO nova.virt.block_device [None req-d9f258f7-a773-4a8c-b7fd-6ce9f6b758b4 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] [instance: 5e3853b8-8138-4ab1-8b1c-e853f0a81f5c] Attempting to driver detach volume b3dc8d00-9445-4d73-aa38-71502be3ad16 from mountpoint /dev/vdb
Aug 09 15:53:23 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-d9f258f7-a773-4a8c-b7fd-6ce9f6b758b4 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] Attempting to detach device vdb from instance 5e3853b8-8138-4ab1-8b1c-e853f0a81f5c from the persistent domain config. {{(pid=72382) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 15:53:23 user nova-compute[72382]: DEBUG nova.virt.libvirt.guest [None req-d9f258f7-a773-4a8c-b7fd-6ce9f6b758b4 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 15:53:23 user nova-compute[72382]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 15:53:23 user nova-compute[72382]:   <source dev="/dev/sdb"/>
Aug 09 15:53:23 user nova-compute[72382]:   <target dev="vdb" bus="virtio"/>
Aug 09 15:53:23 user nova-compute[72382]:   <serial>b3dc8d00-9445-4d73-aa38-71502be3ad16</serial>
Aug 09 15:53:23 user nova-compute[72382]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 15:53:23 user nova-compute[72382]: </disk>
Aug 09 15:53:23 user nova-compute[72382]:  {{(pid=72382) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 15:53:23 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-d9f258f7-a773-4a8c-b7fd-6ce9f6b758b4 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] Successfully detached device vdb from instance 5e3853b8-8138-4ab1-8b1c-e853f0a81f5c from the persistent domain config.
Aug 09 15:53:23 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-d9f258f7-a773-4a8c-b7fd-6ce9f6b758b4 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 5e3853b8-8138-4ab1-8b1c-e853f0a81f5c from the live domain config. {{(pid=72382) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 15:53:23 user nova-compute[72382]: DEBUG nova.virt.libvirt.guest [None req-d9f258f7-a773-4a8c-b7fd-6ce9f6b758b4 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 15:53:23 user nova-compute[72382]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 15:53:23 user nova-compute[72382]:   <source dev="/dev/sdb"/>
Aug 09 15:53:23 user nova-compute[72382]:   <target dev="vdb" bus="virtio"/>
Aug 09 15:53:23 user nova-compute[72382]:   <serial>b3dc8d00-9445-4d73-aa38-71502be3ad16</serial>
Aug 09 15:53:23 user nova-compute[72382]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 15:53:23 user nova-compute[72382]: </disk>
Aug 09 15:53:23 user nova-compute[72382]:  {{(pid=72382) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 15:53:24 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Received event <DeviceRemovedEvent: 1691596404.007569, 5e3853b8-8138-4ab1-8b1c-e853f0a81f5c => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72382) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 15:53:24 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-d9f258f7-a773-4a8c-b7fd-6ce9f6b758b4 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 5e3853b8-8138-4ab1-8b1c-e853f0a81f5c {{(pid=72382) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 15:53:24 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-d9f258f7-a773-4a8c-b7fd-6ce9f6b758b4 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] Successfully detached device vdb from instance 5e3853b8-8138-4ab1-8b1c-e853f0a81f5c from the live domain config.
Aug 09 15:53:24 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d9f258f7-a773-4a8c-b7fd-6ce9f6b758b4 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] [instance: 5e3853b8-8138-4ab1-8b1c-e853f0a81f5c] calling os-brick to detach iSCSI Volume {{(pid=72382) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 15:53:24 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9f258f7-a773-4a8c-b7fd-6ce9f6b758b4 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2a0c768340>, {'target_iqns': ['iqn.2010-10.org.openstack:b3dc8d00-9445-4d73-aa38-71502be3ad16'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hzVDbkOn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 15:53:24 user nova-compute[72382]: WARNING os_brick.initiator.connectors.base [None req-d9f258f7-a773-4a8c-b7fd-6ce9f6b758b4 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 15:53:24 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-d9f258f7-a773-4a8c-b7fd-6ce9f6b758b4 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 15:53:24 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-d9f258f7-a773-4a8c-b7fd-6ce9f6b758b4 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 15:53:24 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9f258f7-a773-4a8c-b7fd-6ce9f6b758b4 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b3dc8d00-9445-4d73-aa38-71502be3ad16', 0)] {{(pid=72382) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 15:53:24 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:53:24 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:53:24 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa0d9c63-3b5c-46e6-b365-c89da87009ed]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b3dc8d00-9445-4d73-aa38-71502be3ad16\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:53:24 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:53:24 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:53:24 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[abf9377e-2621-4ac0-aa32-c22e1ea2edc3]: (4, ('tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3dc8d00-9445-4d73-aa38-71502be3ad16 (non-flash)\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:53:24 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9f258f7-a773-4a8c-b7fd-6ce9f6b758b4 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3dc8d00-9445-4d73-aa38-71502be3ad16 (non-flash)
Aug 09 15:53:24 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 15:53:24 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9f258f7-a773-4a8c-b7fd-6ce9f6b758b4 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] iscsi session list stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3dc8d00-9445-4d73-aa38-71502be3ad16 (non-flash)
Aug 09 15:53:24 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 15:53:24 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9f258f7-a773-4a8c-b7fd-6ce9f6b758b4 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2a0c1a0b80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b3dc8d00-9445-4d73-aa38-71502be3ad16'): ({'sdb'}, set())}) {{(pid=72382) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 15:53:24 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-d9f258f7-a773-4a8c-b7fd-6ce9f6b758b4 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] Removing single pathed devices sdb {{(pid=72382) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 15:53:24 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:53:24 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:53:24 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4738b40-e22b-465e-8db0-7d0c7296cade]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:53:24 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:53:24 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:53:24 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdd77f21-7f92-40a5-b63d-2eb940bb4eff]: (4, ('ok\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:53:24 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-d9f258f7-a773-4a8c-b7fd-6ce9f6b758b4 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] Flushing IO for device /dev/sdb {{(pid=72382) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 15:53:24 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:53:24 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:53:24 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[01cee55b-65c7-4342-8853-7e5781bb21db]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:53:24 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-d9f258f7-a773-4a8c-b7fd-6ce9f6b758b4 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72382) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 15:53:24 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:53:24 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.035s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:53:24 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f41248a-e088-47b2-aaa6-e99932daad09]: (4, ('1', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:53:24 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-d9f258f7-a773-4a8c-b7fd-6ce9f6b758b4 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72382) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 15:53:24 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-d9f258f7-a773-4a8c-b7fd-6ce9f6b758b4 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] SCSI volumes sdb have been removed. {{(pid=72382) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 15:53:24 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9f258f7-a773-4a8c-b7fd-6ce9f6b758b4 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b3dc8d00-9445-4d73-aa38-71502be3ad16')] {{(pid=72382) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 15:53:24 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3dc8d00-9445-4d73-aa38-71502be3ad16 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:53:24 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3dc8d00-9445-4d73-aa38-71502be3ad16 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:53:24 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[908df7d6-8fa5-482e-9c84-5e2fe972f760]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:53:24 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9f258f7-a773-4a8c-b7fd-6ce9f6b758b4 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:53:24 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3dc8d00-9445-4d73-aa38-71502be3ad16 -p 172.16.0.220:3260 --logout {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:53:24 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3dc8d00-9445-4d73-aa38-71502be3ad16 -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:53:24 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3e60a7e-2705-4368-9d53-f4b102d42510]: (4, ('Logging out of session [sid: 67, target: iqn.2010-10.org.openstack:b3dc8d00-9445-4d73-aa38-71502be3ad16, portal: 172.16.0.220,3260]\nLogout of [sid: 67, target: iqn.2010-10.org.openstack:b3dc8d00-9445-4d73-aa38-71502be3ad16, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:53:24 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9f258f7-a773-4a8c-b7fd-6ce9f6b758b4 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 67, target: iqn.2010-10.org.openstack:b3dc8d00-9445-4d73-aa38-71502be3ad16, portal: 172.16.0.220,3260]
Aug 09 15:53:24 user nova-compute[72382]: Logout of [sid: 67, target: iqn.2010-10.org.openstack:b3dc8d00-9445-4d73-aa38-71502be3ad16, portal: 172.16.0.220,3260] successful.
Aug 09 15:53:24 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:53:24 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3dc8d00-9445-4d73-aa38-71502be3ad16 -p 172.16.0.220:3260 --op delete {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:53:24 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3dc8d00-9445-4d73-aa38-71502be3ad16 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:53:24 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[68246d0f-ef3e-435c-b8cf-8a12b6020635]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:53:24 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9f258f7-a773-4a8c-b7fd-6ce9f6b758b4 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:53:24 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-d9f258f7-a773-4a8c-b7fd-6ce9f6b758b4 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.250s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 15:53:24 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9f258f7-a773-4a8c-b7fd-6ce9f6b758b4 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] <== disconnect_volume: return (250ms) None {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 15:53:24 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d9f258f7-a773-4a8c-b7fd-6ce9f6b758b4 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] [instance: 5e3853b8-8138-4ab1-8b1c-e853f0a81f5c] Disconnected iSCSI Volume {{(pid=72382) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 15:53:24 user nova-compute[72382]: DEBUG nova.objects.instance [None req-d9f258f7-a773-4a8c-b7fd-6ce9f6b758b4 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] Lazy-loading 'flavor' on Instance uuid 5e3853b8-8138-4ab1-8b1c-e853f0a81f5c {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:53:25 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-d9f258f7-a773-4a8c-b7fd-6ce9f6b758b4 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] Lock "5e3853b8-8138-4ab1-8b1c-e853f0a81f5c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.542s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:53:27 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:53:32 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:53:32 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:53:32 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72382) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 15:53:32 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72382) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 15:53:32 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72382) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 15:53:32 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:53:32 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:53:32 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:53:32 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:53:32 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:53:32 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:53:32 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Auditing locally available compute resources for user (node: user) {{(pid=72382) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 15:53:32 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e3853b8-8138-4ab1-8b1c-e853f0a81f5c/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:53:33 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e3853b8-8138-4ab1-8b1c-e853f0a81f5c/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:53:33 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e3853b8-8138-4ab1-8b1c-e853f0a81f5c/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:53:33 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e3853b8-8138-4ab1-8b1c-e853f0a81f5c/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:53:33 user nova-compute[72382]: WARNING nova.virt.libvirt.driver [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 15:53:33 user nova-compute[72382]: WARNING nova.virt.libvirt.driver [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 15:53:33 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Hypervisor/Node resource view: name=user free_ram=8862MB free_disk=25.280532836914062GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72382) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 15:53:33 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:53:33 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:53:33 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance 5e3853b8-8138-4ab1-8b1c-e853f0a81f5c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:53:33 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72382) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 15:53:33 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72382) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 15:53:33 user nova-compute[72382]: DEBUG nova.compute.provider_tree [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Inventory has not changed in ProviderTree for provider: 7b15b0e5-df4d-49db-833b-2855d21d10ae {{(pid=72382) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 15:53:33 user nova-compute[72382]: DEBUG nova.scheduler.client.report [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Inventory has not changed for provider 7b15b0e5-df4d-49db-833b-2855d21d10ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72382) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 15:53:33 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Compute_service record updated for user:user {{(pid=72382) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 15:53:33 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.155s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:53:34 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:53:35 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:53:35 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:53:35 user nova-compute[72382]: DEBUG nova.compute.manager [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Starting heal instance info cache {{(pid=72382) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 15:53:35 user nova-compute[72382]: DEBUG nova.compute.manager [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Rebuilding the list of instances to heal {{(pid=72382) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 09 15:53:35 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Acquiring lock "refresh_cache-5e3853b8-8138-4ab1-8b1c-e853f0a81f5c" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 15:53:35 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Acquired lock "refresh_cache-5e3853b8-8138-4ab1-8b1c-e853f0a81f5c" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 15:53:35 user nova-compute[72382]: DEBUG nova.network.neutron [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] [instance: 5e3853b8-8138-4ab1-8b1c-e853f0a81f5c] Forcefully refreshing network info cache for instance {{(pid=72382) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 15:53:35 user nova-compute[72382]: DEBUG nova.objects.instance [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lazy-loading 'info_cache' on Instance uuid 5e3853b8-8138-4ab1-8b1c-e853f0a81f5c {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:53:36 user nova-compute[72382]: DEBUG nova.network.neutron [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] [instance: 5e3853b8-8138-4ab1-8b1c-e853f0a81f5c] Updating instance_info_cache with network_info: [{"id": "e8fcea04-f9ce-4285-8e81-41a2042cbfb0", "address": "fa:16:3e:5d:ca:7b", "network": {"id": "45acf55d-48f5-4a7d-a01c-0aa68e330e1a", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-992217983-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f62d7fd59f9436295c98e08de857253", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8fcea04-f9", "ovs_interfaceid": "e8fcea04-f9ce-4285-8e81-41a2042cbfb0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:53:37 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Releasing lock "refresh_cache-5e3853b8-8138-4ab1-8b1c-e853f0a81f5c" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 15:53:37 user nova-compute[72382]: DEBUG nova.compute.manager [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] [instance: 5e3853b8-8138-4ab1-8b1c-e853f0a81f5c] Updated the network info_cache for instance {{(pid=72382) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 15:53:37 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:53:37 user nova-compute[72382]: DEBUG nova.compute.manager [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72382) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 15:53:37 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:53:39 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:53:39 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:53:42 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:53:42 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:53:42 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:53:47 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4998-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:53:47 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:53:47 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72382) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 15:53:47 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72382) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 15:53:47 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72382) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 15:53:47 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:53:52 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:53:57 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:54:02 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:54:07 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:54:07 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:54:07 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72382) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 15:54:07 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72382) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 15:54:07 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72382) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 15:54:07 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:54:12 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:54:12 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:54:12 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72382) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 15:54:12 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72382) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 15:54:12 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72382) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 15:54:12 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:54:17 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-449509c5-de2b-4507-b2d9-d7551681e15a tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] Acquiring lock "5e3853b8-8138-4ab1-8b1c-e853f0a81f5c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:54:17 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-449509c5-de2b-4507-b2d9-d7551681e15a tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] Lock "5e3853b8-8138-4ab1-8b1c-e853f0a81f5c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:54:17 user nova-compute[72382]: DEBUG nova.objects.instance [None req-449509c5-de2b-4507-b2d9-d7551681e15a tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] Lazy-loading 'flavor' on Instance uuid 5e3853b8-8138-4ab1-8b1c-e853f0a81f5c {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:54:17 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-449509c5-de2b-4507-b2d9-d7551681e15a tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] Lock "5e3853b8-8138-4ab1-8b1c-e853f0a81f5c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:54:17 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-449509c5-de2b-4507-b2d9-d7551681e15a tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] Acquiring lock "5e3853b8-8138-4ab1-8b1c-e853f0a81f5c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:54:17 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-449509c5-de2b-4507-b2d9-d7551681e15a tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] Lock "5e3853b8-8138-4ab1-8b1c-e853f0a81f5c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:54:17 user nova-compute[72382]: INFO nova.compute.manager [None req-449509c5-de2b-4507-b2d9-d7551681e15a tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] [instance: 5e3853b8-8138-4ab1-8b1c-e853f0a81f5c] Attaching volume af9734e0-013c-4116-812a-20292563714b to /dev/vdb
Aug 09 15:54:17 user nova-compute[72382]: DEBUG os_brick.utils [None req-449509c5-de2b-4507-b2d9-d7551681e15a tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 15:54:17 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:54:17 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:54:17 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fc1c8e9-db5e-4996-8d88-0abd2253f2ba]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d2cfa7015fe\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:54:17 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:54:17 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:54:17 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[4926d7e0-ee4d-4266-8d3a-6ecec29a9d7d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:54:17 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:54:17 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:54:17 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:54:17 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d9caf3c-5a7c-4c45-9b68-5ed37b1fd4c1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:54:17 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e6088de-2b11-4897-8efd-f5aad121a306]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:54:17 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-449509c5-de2b-4507-b2d9-d7551681e15a tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] Running cmd (subprocess): nvme version {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:54:17 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-449509c5-de2b-4507-b2d9-d7551681e15a tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] 'nvme version' failed. Not Retrying. {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 15:54:17 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.nvmeof [None req-449509c5-de2b-4507-b2d9-d7551681e15a tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] nvme not present on system {{(pid=72382) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 15:54:17 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:54:17 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 15:54:17 user nova-compute[72382]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 15:54:17 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b96b720-5fc1-475a-b3e1-4de43cfe9ef0]: (4, '') {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:54:17 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.lightos [None req-449509c5-de2b-4507-b2d9-d7551681e15a tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72382) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 15:54:17 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.lightos [None req-449509c5-de2b-4507-b2d9-d7551681e15a tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72382) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 15:54:17 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.lightos [None req-449509c5-de2b-4507-b2d9-d7551681e15a tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] LIGHTOS: no hostnqn found. {{(pid=72382) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 15:54:17 user nova-compute[72382]: DEBUG os_brick.utils [None req-449509c5-de2b-4507-b2d9-d7551681e15a tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d2cfa7015fe', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 15:54:17 user nova-compute[72382]: DEBUG nova.virt.block_device [None req-449509c5-de2b-4507-b2d9-d7551681e15a tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] [instance: 5e3853b8-8138-4ab1-8b1c-e853f0a81f5c] Updating existing volume attachment record: d5d4d1a4-ef72-484e-bcb4-5ca25496c135 {{(pid=72382) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 15:54:20 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:54:22 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:54:25 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-449509c5-de2b-4507-b2d9-d7551681e15a tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] [instance: 5e3853b8-8138-4ab1-8b1c-e853f0a81f5c] Calling os-brick to attach iSCSI Volume {{(pid=72382) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 15:54:25 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-449509c5-de2b-4507-b2d9-d7551681e15a tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2a0c768340>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:af9734e0-013c-4116-812a-20292563714b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'efRmcZLV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 15:54:25 user nova-compute[72382]: WARNING os_brick.initiator.connectors.base [None req-449509c5-de2b-4507-b2d9-d7551681e15a tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 15:54:25 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-449509c5-de2b-4507-b2d9-d7551681e15a tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 15:54:25 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-449509c5-de2b-4507-b2d9-d7551681e15a tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 15:54:25 user nova-compute[72382]: WARNING os_brick.initiator.connectors.base [None req-449509c5-de2b-4507-b2d9-d7551681e15a tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 15:54:25 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-449509c5-de2b-4507-b2d9-d7551681e15a tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:af9734e0-013c-4116-812a-20292563714b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 15:54:25 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-449509c5-de2b-4507-b2d9-d7551681e15a tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:af9734e0-013c-4116-812a-20292563714b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 15:54:25 user nova-compute[72382]: INFO os_brick.initiator.connectors.iscsi [None req-449509c5-de2b-4507-b2d9-d7551681e15a tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 15:54:25 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af9734e0-013c-4116-812a-20292563714b -p 172.16.0.220:3260 {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:54:25 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af9734e0-013c-4116-812a-20292563714b -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:54:25 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[e031905f-d8f7-404f-8a52-1ff5b7909fca]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:54:25 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-449509c5-de2b-4507-b2d9-d7551681e15a tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 15:54:25 user nova-compute[72382]:  {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:54:25 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af9734e0-013c-4116-812a-20292563714b -p 172.16.0.220:3260 --interface default --op new {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:54:25 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af9734e0-013c-4116-812a-20292563714b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:54:25 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[815bc36c-9b42-4b77-9703-5e1b50680ad0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:af9734e0-013c-4116-812a-20292563714b] added\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:54:25 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-449509c5-de2b-4507-b2d9-d7551681e15a tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:af9734e0-013c-4116-812a-20292563714b] added
Aug 09 15:54:25 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:54:25 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af9734e0-013c-4116-812a-20292563714b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:54:25 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af9734e0-013c-4116-812a-20292563714b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:54:25 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5e48a33-5fd2-43a1-9f00-7b50ff5187b6]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:54:25 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-449509c5-de2b-4507-b2d9-d7551681e15a tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:54:25 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af9734e0-013c-4116-812a-20292563714b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:54:25 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af9734e0-013c-4116-812a-20292563714b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:54:25 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddcbd24f-0d3f-4480-8b79-b9a9491d9b0a]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:54:25 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-449509c5-de2b-4507-b2d9-d7551681e15a tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:54:25 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af9734e0-013c-4116-812a-20292563714b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v efRmcZLV {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:54:25 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af9734e0-013c-4116-812a-20292563714b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v efRmcZLV" returned: 0 in 0.020s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:54:25 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b410179-a159-4e95-8bdc-3d8eca7502ee]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:54:25 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-449509c5-de2b-4507-b2d9-d7551681e15a tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'efRmcZLV'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:54:25 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af9734e0-013c-4116-812a-20292563714b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:54:25 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af9734e0-013c-4116-812a-20292563714b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:54:25 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3607de0-126f-44f2-a779-e4339b829ae9]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:54:25 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-449509c5-de2b-4507-b2d9-d7551681e15a tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:54:25 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:54:25 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:54:25 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[16d70223-0a0b-407a-af46-3a6e220934c0]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:54:25 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-449509c5-de2b-4507-b2d9-d7551681e15a tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 09 15:54:25 user nova-compute[72382]:  {{(pid=72382) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 15:54:25 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-449509c5-de2b-4507-b2d9-d7551681e15a tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 09 15:54:25 user nova-compute[72382]:  {{(pid=72382) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 15:54:25 user nova-compute[72382]: WARNING os_brick.initiator.connectors.iscsi [None req-449509c5-de2b-4507-b2d9-d7551681e15a tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 09 15:54:25 user nova-compute[72382]: 
Aug 09 15:54:25 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af9734e0-013c-4116-812a-20292563714b -p 172.16.0.220:3260 --login {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:54:26 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af9734e0-013c-4116-812a-20292563714b -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:54:26 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[8897c3eb-319d-42b9-8884-c13f96aa54e4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:af9734e0-013c-4116-812a-20292563714b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:af9734e0-013c-4116-812a-20292563714b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:54:26 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-449509c5-de2b-4507-b2d9-d7551681e15a tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:af9734e0-013c-4116-812a-20292563714b, portal: 172.16.0.220,3260]
Aug 09 15:54:26 user nova-compute[72382]: Login to [iface: default, target: iqn.2010-10.org.openstack:af9734e0-013c-4116-812a-20292563714b, portal: 172.16.0.220,3260] successful.
Aug 09 15:54:26 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:54:26 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af9734e0-013c-4116-812a-20292563714b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:54:26 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af9734e0-013c-4116-812a-20292563714b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:54:26 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[87ac77fd-2cac-4336-a68c-0089485c7b3f]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:54:26 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-449509c5-de2b-4507-b2d9-d7551681e15a tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:54:26 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:54:26 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:54:26 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e9affea-fbdc-4e5b-b47a-402412cf4f04]: (4, ('tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af9734e0-013c-4116-812a-20292563714b (non-flash)\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:54:26 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-449509c5-de2b-4507-b2d9-d7551681e15a tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af9734e0-013c-4116-812a-20292563714b (non-flash)
Aug 09 15:54:26 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 15:54:26 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-449509c5-de2b-4507-b2d9-d7551681e15a tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] iscsi session list stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af9734e0-013c-4116-812a-20292563714b (non-flash)
Aug 09 15:54:26 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 15:54:26 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-449509c5-de2b-4507-b2d9-d7551681e15a tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:af9734e0-013c-4116-812a-20292563714b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.275s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 15:54:26 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-449509c5-de2b-4507-b2d9-d7551681e15a tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] Connected to 172.16.0.220:3260 {{(pid=72382) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 15:54:26 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-449509c5-de2b-4507-b2d9-d7551681e15a tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] HCTL ('33', '-', '-', 0) found on session 68 with lun 0 {{(pid=72382) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 15:54:26 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-449509c5-de2b-4507-b2d9-d7551681e15a tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72382) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 15:54:26 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:54:26 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:54:26 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf950dad-031c-4d01-812b-4e3897f9094e]: (4, ('- - 0', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:54:26 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-449509c5-de2b-4507-b2d9-d7551681e15a tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] Searching for a device in session 68 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72382) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 15:54:26 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-449509c5-de2b-4507-b2d9-d7551681e15a tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'efRmcZLV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72382) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 15:54:27 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-449509c5-de2b-4507-b2d9-d7551681e15a tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.307s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 15:54:27 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-449509c5-de2b-4507-b2d9-d7551681e15a tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] <== connect_volume: return (1309ms) {'type': 'block', 'scsi_wwn': '26532666662663166', 'path': '/dev/sdb'} {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 15:54:27 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-449509c5-de2b-4507-b2d9-d7551681e15a tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] [instance: 5e3853b8-8138-4ab1-8b1c-e853f0a81f5c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26532666662663166', 'path': '/dev/sdb'} {{(pid=72382) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 15:54:27 user nova-compute[72382]: DEBUG nova.objects.instance [None req-449509c5-de2b-4507-b2d9-d7551681e15a tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] Lazy-loading 'flavor' on Instance uuid 5e3853b8-8138-4ab1-8b1c-e853f0a81f5c {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:54:27 user nova-compute[72382]: DEBUG nova.virt.libvirt.guest [None req-449509c5-de2b-4507-b2d9-d7551681e15a tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 15:54:27 user nova-compute[72382]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 15:54:27 user nova-compute[72382]:   <source dev="/dev/sdb"/>
Aug 09 15:54:27 user nova-compute[72382]:   <target dev="vdb" bus="virtio"/>
Aug 09 15:54:27 user nova-compute[72382]:   <serial>af9734e0-013c-4116-812a-20292563714b</serial>
Aug 09 15:54:27 user nova-compute[72382]: </disk>
Aug 09 15:54:27 user nova-compute[72382]:  {{(pid=72382) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 15:54:27 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-449509c5-de2b-4507-b2d9-d7551681e15a tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] No BDM found with device name vda, not building metadata. {{(pid=72382) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 15:54:27 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-449509c5-de2b-4507-b2d9-d7551681e15a tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72382) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 15:54:27 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-449509c5-de2b-4507-b2d9-d7551681e15a tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] No VIF found with MAC fa:16:3e:5d:ca:7b, not building metadata {{(pid=72382) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 15:54:27 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-449509c5-de2b-4507-b2d9-d7551681e15a tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] Lock "5e3853b8-8138-4ab1-8b1c-e853f0a81f5c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.898s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:54:27 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:54:27 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:54:27 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72382) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 15:54:27 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72382) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 15:54:27 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72382) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 15:54:27 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:54:30 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e1b806ac-b9a8-41a4-8947-bb8461830e47 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] Acquiring lock "5e3853b8-8138-4ab1-8b1c-e853f0a81f5c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:54:30 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e1b806ac-b9a8-41a4-8947-bb8461830e47 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] Lock "5e3853b8-8138-4ab1-8b1c-e853f0a81f5c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:54:30 user nova-compute[72382]: INFO nova.compute.manager [None req-e1b806ac-b9a8-41a4-8947-bb8461830e47 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] [instance: 5e3853b8-8138-4ab1-8b1c-e853f0a81f5c] Detaching volume af9734e0-013c-4116-812a-20292563714b
Aug 09 15:54:30 user nova-compute[72382]: INFO nova.virt.block_device [None req-e1b806ac-b9a8-41a4-8947-bb8461830e47 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] [instance: 5e3853b8-8138-4ab1-8b1c-e853f0a81f5c] Attempting to driver detach volume af9734e0-013c-4116-812a-20292563714b from mountpoint /dev/vdb
Aug 09 15:54:30 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:54:30 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-e1b806ac-b9a8-41a4-8947-bb8461830e47 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] Attempting to detach device vdb from instance 5e3853b8-8138-4ab1-8b1c-e853f0a81f5c from the persistent domain config. {{(pid=72382) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 15:54:30 user nova-compute[72382]: DEBUG nova.virt.libvirt.guest [None req-e1b806ac-b9a8-41a4-8947-bb8461830e47 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 15:54:30 user nova-compute[72382]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 15:54:30 user nova-compute[72382]:   <source dev="/dev/sdb"/>
Aug 09 15:54:30 user nova-compute[72382]:   <target dev="vdb" bus="virtio"/>
Aug 09 15:54:30 user nova-compute[72382]:   <serial>af9734e0-013c-4116-812a-20292563714b</serial>
Aug 09 15:54:30 user nova-compute[72382]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 15:54:30 user nova-compute[72382]: </disk>
Aug 09 15:54:30 user nova-compute[72382]:  {{(pid=72382) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 15:54:30 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-e1b806ac-b9a8-41a4-8947-bb8461830e47 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] Successfully detached device vdb from instance 5e3853b8-8138-4ab1-8b1c-e853f0a81f5c from the persistent domain config.
Aug 09 15:54:30 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-e1b806ac-b9a8-41a4-8947-bb8461830e47 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 5e3853b8-8138-4ab1-8b1c-e853f0a81f5c from the live domain config. {{(pid=72382) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 15:54:30 user nova-compute[72382]: DEBUG nova.virt.libvirt.guest [None req-e1b806ac-b9a8-41a4-8947-bb8461830e47 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 15:54:30 user nova-compute[72382]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 15:54:30 user nova-compute[72382]:   <source dev="/dev/sdb"/>
Aug 09 15:54:30 user nova-compute[72382]:   <target dev="vdb" bus="virtio"/>
Aug 09 15:54:30 user nova-compute[72382]:   <serial>af9734e0-013c-4116-812a-20292563714b</serial>
Aug 09 15:54:30 user nova-compute[72382]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 15:54:30 user nova-compute[72382]: </disk>
Aug 09 15:54:30 user nova-compute[72382]:  {{(pid=72382) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 15:54:30 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Received event <DeviceRemovedEvent: 1691596470.6863554, 5e3853b8-8138-4ab1-8b1c-e853f0a81f5c => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72382) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 15:54:30 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-e1b806ac-b9a8-41a4-8947-bb8461830e47 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 5e3853b8-8138-4ab1-8b1c-e853f0a81f5c {{(pid=72382) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 15:54:30 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-e1b806ac-b9a8-41a4-8947-bb8461830e47 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] Successfully detached device vdb from instance 5e3853b8-8138-4ab1-8b1c-e853f0a81f5c from the live domain config.
Aug 09 15:54:30 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e1b806ac-b9a8-41a4-8947-bb8461830e47 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] [instance: 5e3853b8-8138-4ab1-8b1c-e853f0a81f5c] calling os-brick to detach iSCSI Volume {{(pid=72382) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 15:54:30 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1b806ac-b9a8-41a4-8947-bb8461830e47 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2a0c768340>, {'target_iqns': ['iqn.2010-10.org.openstack:af9734e0-013c-4116-812a-20292563714b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'efRmcZLV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 15:54:30 user nova-compute[72382]: WARNING os_brick.initiator.connectors.base [None req-e1b806ac-b9a8-41a4-8947-bb8461830e47 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 15:54:30 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-e1b806ac-b9a8-41a4-8947-bb8461830e47 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 15:54:30 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-e1b806ac-b9a8-41a4-8947-bb8461830e47 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 15:54:30 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1b806ac-b9a8-41a4-8947-bb8461830e47 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:af9734e0-013c-4116-812a-20292563714b', 0)] {{(pid=72382) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 15:54:30 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:54:30 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:54:30 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb9aea27-7d9e-497b-889e-40b137f83f2f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:af9734e0-013c-4116-812a-20292563714b\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:54:30 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:54:30 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:54:30 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[117b0ea3-8aab-4e89-9ceb-4951e553005a]: (4, ('tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af9734e0-013c-4116-812a-20292563714b (non-flash)\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:54:30 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1b806ac-b9a8-41a4-8947-bb8461830e47 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af9734e0-013c-4116-812a-20292563714b (non-flash)
Aug 09 15:54:30 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 15:54:30 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1b806ac-b9a8-41a4-8947-bb8461830e47 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] iscsi session list stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af9734e0-013c-4116-812a-20292563714b (non-flash)
Aug 09 15:54:30 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 15:54:30 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1b806ac-b9a8-41a4-8947-bb8461830e47 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2a0c1a2e60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:af9734e0-013c-4116-812a-20292563714b'): ({'sdb'}, set())}) {{(pid=72382) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 15:54:30 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-e1b806ac-b9a8-41a4-8947-bb8461830e47 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] Removing single pathed devices sdb {{(pid=72382) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 15:54:30 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:54:30 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:54:30 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ac05b85-7481-4343-b898-61de447ea0d1]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:54:30 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:54:30 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:54:30 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[6972eb06-b520-4b94-9951-2a8726ccb699]: (4, ('ok\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:54:30 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-e1b806ac-b9a8-41a4-8947-bb8461830e47 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] Flushing IO for device /dev/sdb {{(pid=72382) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 15:54:30 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:54:30 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:54:30 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[10af0c89-0d90-4e7b-9125-ca6a8476ce27]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:54:30 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-e1b806ac-b9a8-41a4-8947-bb8461830e47 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72382) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 15:54:30 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:54:30 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.055s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:54:30 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[803dad1c-7b7e-43f5-8139-af3be8c262ed]: (4, ('1', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:54:30 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-e1b806ac-b9a8-41a4-8947-bb8461830e47 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72382) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 15:54:30 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-e1b806ac-b9a8-41a4-8947-bb8461830e47 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] SCSI volumes sdb have been removed. {{(pid=72382) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 15:54:30 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1b806ac-b9a8-41a4-8947-bb8461830e47 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:af9734e0-013c-4116-812a-20292563714b')] {{(pid=72382) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 15:54:30 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af9734e0-013c-4116-812a-20292563714b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:54:30 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af9734e0-013c-4116-812a-20292563714b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:54:30 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[3654e879-dd8e-43c2-982c-61dcc6cb3ea3]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:54:30 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1b806ac-b9a8-41a4-8947-bb8461830e47 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:54:30 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af9734e0-013c-4116-812a-20292563714b -p 172.16.0.220:3260 --logout {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:54:30 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af9734e0-013c-4116-812a-20292563714b -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:54:30 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[1782995d-9b74-4078-946c-0ee7d07bd877]: (4, ('Logging out of session [sid: 68, target: iqn.2010-10.org.openstack:af9734e0-013c-4116-812a-20292563714b, portal: 172.16.0.220,3260]\nLogout of [sid: 68, target: iqn.2010-10.org.openstack:af9734e0-013c-4116-812a-20292563714b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:54:30 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1b806ac-b9a8-41a4-8947-bb8461830e47 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 68, target: iqn.2010-10.org.openstack:af9734e0-013c-4116-812a-20292563714b, portal: 172.16.0.220,3260]
Aug 09 15:54:30 user nova-compute[72382]: Logout of [sid: 68, target: iqn.2010-10.org.openstack:af9734e0-013c-4116-812a-20292563714b, portal: 172.16.0.220,3260] successful.
Aug 09 15:54:30 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:54:30 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af9734e0-013c-4116-812a-20292563714b -p 172.16.0.220:3260 --op delete {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:54:30 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af9734e0-013c-4116-812a-20292563714b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:54:30 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[0505bd05-608e-4806-a90a-0b4a949bfb23]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:54:30 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1b806ac-b9a8-41a4-8947-bb8461830e47 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:54:30 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-e1b806ac-b9a8-41a4-8947-bb8461830e47 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.290s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 15:54:30 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1b806ac-b9a8-41a4-8947-bb8461830e47 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] <== disconnect_volume: return (290ms) None {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 15:54:30 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e1b806ac-b9a8-41a4-8947-bb8461830e47 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] [instance: 5e3853b8-8138-4ab1-8b1c-e853f0a81f5c] Disconnected iSCSI Volume {{(pid=72382) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 15:54:31 user nova-compute[72382]: DEBUG nova.objects.instance [None req-e1b806ac-b9a8-41a4-8947-bb8461830e47 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] Lazy-loading 'flavor' on Instance uuid 5e3853b8-8138-4ab1-8b1c-e853f0a81f5c {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:54:31 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e1b806ac-b9a8-41a4-8947-bb8461830e47 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] Lock "5e3853b8-8138-4ab1-8b1c-e853f0a81f5c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.592s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:54:32 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:54:33 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:54:33 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:54:33 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:54:33 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:54:33 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Auditing locally available compute resources for user (node: user) {{(pid=72382) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 15:54:33 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e3853b8-8138-4ab1-8b1c-e853f0a81f5c/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:54:34 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e3853b8-8138-4ab1-8b1c-e853f0a81f5c/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:54:34 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e3853b8-8138-4ab1-8b1c-e853f0a81f5c/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:54:34 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e3853b8-8138-4ab1-8b1c-e853f0a81f5c/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:54:34 user nova-compute[72382]: WARNING nova.virt.libvirt.driver [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 15:54:34 user nova-compute[72382]: WARNING nova.virt.libvirt.driver [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 15:54:34 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Hypervisor/Node resource view: name=user free_ram=8828MB free_disk=25.27960968017578GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72382) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 15:54:34 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:54:34 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:54:34 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance 5e3853b8-8138-4ab1-8b1c-e853f0a81f5c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:54:34 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72382) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 15:54:34 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72382) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 15:54:34 user nova-compute[72382]: DEBUG nova.compute.provider_tree [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Inventory has not changed in ProviderTree for provider: 7b15b0e5-df4d-49db-833b-2855d21d10ae {{(pid=72382) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 15:54:34 user nova-compute[72382]: DEBUG nova.scheduler.client.report [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Inventory has not changed for provider 7b15b0e5-df4d-49db-833b-2855d21d10ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72382) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 15:54:34 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Compute_service record updated for user:user {{(pid=72382) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 15:54:34 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.195s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:54:35 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:54:35 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:54:36 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:54:37 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:54:37 user nova-compute[72382]: DEBUG nova.compute.manager [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Starting heal instance info cache {{(pid=72382) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 15:54:37 user nova-compute[72382]: DEBUG nova.compute.manager [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Rebuilding the list of instances to heal {{(pid=72382) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 09 15:54:37 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:54:37 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Acquiring lock "refresh_cache-5e3853b8-8138-4ab1-8b1c-e853f0a81f5c" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 15:54:37 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Acquired lock "refresh_cache-5e3853b8-8138-4ab1-8b1c-e853f0a81f5c" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 15:54:37 user nova-compute[72382]: DEBUG nova.network.neutron [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] [instance: 5e3853b8-8138-4ab1-8b1c-e853f0a81f5c] Forcefully refreshing network info cache for instance {{(pid=72382) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 15:54:37 user nova-compute[72382]: DEBUG nova.objects.instance [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lazy-loading 'info_cache' on Instance uuid 5e3853b8-8138-4ab1-8b1c-e853f0a81f5c {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:54:38 user nova-compute[72382]: DEBUG nova.network.neutron [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] [instance: 5e3853b8-8138-4ab1-8b1c-e853f0a81f5c] Updating instance_info_cache with network_info: [{"id": "e8fcea04-f9ce-4285-8e81-41a2042cbfb0", "address": "fa:16:3e:5d:ca:7b", "network": {"id": "45acf55d-48f5-4a7d-a01c-0aa68e330e1a", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-992217983-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f62d7fd59f9436295c98e08de857253", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8fcea04-f9", "ovs_interfaceid": "e8fcea04-f9ce-4285-8e81-41a2042cbfb0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:54:38 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Releasing lock "refresh_cache-5e3853b8-8138-4ab1-8b1c-e853f0a81f5c" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 15:54:38 user nova-compute[72382]: DEBUG nova.compute.manager [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] [instance: 5e3853b8-8138-4ab1-8b1c-e853f0a81f5c] Updated the network info_cache for instance {{(pid=72382) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 15:54:38 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:54:38 user nova-compute[72382]: DEBUG nova.compute.manager [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72382) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 15:54:41 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:54:42 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:54:43 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:54:44 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:54:47 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:54:47 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:54:47 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72382) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 15:54:47 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72382) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 15:54:47 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72382) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 15:54:47 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:54:52 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:54:52 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:54:52 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72382) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 15:54:52 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72382) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 15:54:52 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72382) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 15:54:52 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:54:57 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:55:02 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:55:02 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:55:02 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72382) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 15:55:02 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72382) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 15:55:02 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72382) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 15:55:02 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:55:07 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:55:12 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:55:17 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:55:17 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:55:17 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72382) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 15:55:17 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72382) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 15:55:17 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72382) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 15:55:17 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:55:22 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:55:22 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:55:22 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72382) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 15:55:22 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72382) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 15:55:22 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72382) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 15:55:22 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:55:24 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-b2a7d329-b257-4e31-8a42-cc0972320d97 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] Acquiring lock "5e3853b8-8138-4ab1-8b1c-e853f0a81f5c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:55:24 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-b2a7d329-b257-4e31-8a42-cc0972320d97 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] Lock "5e3853b8-8138-4ab1-8b1c-e853f0a81f5c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:55:24 user nova-compute[72382]: DEBUG nova.objects.instance [None req-b2a7d329-b257-4e31-8a42-cc0972320d97 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] Lazy-loading 'flavor' on Instance uuid 5e3853b8-8138-4ab1-8b1c-e853f0a81f5c {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:55:24 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-b2a7d329-b257-4e31-8a42-cc0972320d97 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] Lock "5e3853b8-8138-4ab1-8b1c-e853f0a81f5c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.063s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:55:24 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-b2a7d329-b257-4e31-8a42-cc0972320d97 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] Acquiring lock "5e3853b8-8138-4ab1-8b1c-e853f0a81f5c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:55:24 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-b2a7d329-b257-4e31-8a42-cc0972320d97 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] Lock "5e3853b8-8138-4ab1-8b1c-e853f0a81f5c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:55:24 user nova-compute[72382]: INFO nova.compute.manager [None req-b2a7d329-b257-4e31-8a42-cc0972320d97 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] [instance: 5e3853b8-8138-4ab1-8b1c-e853f0a81f5c] Attaching volume 22214636-7c8f-417d-91a4-c9ded380fbab to /dev/vdb
Aug 09 15:55:24 user nova-compute[72382]: DEBUG os_brick.utils [None req-b2a7d329-b257-4e31-8a42-cc0972320d97 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 15:55:24 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:55:24 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:55:24 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f1b3934-c95a-4897-b5fc-552bac1a139a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d2cfa7015fe\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:55:24 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:55:24 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:55:24 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[772b789e-97f5-48d2-8739-f9cc001101c2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:55:24 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:55:24 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:55:24 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[97c42fb1-03df-42dc-a735-e21ee0c0edf3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:55:24 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[944a42e8-5541-4183-a2b3-86d7840e9f60]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:55:24 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-b2a7d329-b257-4e31-8a42-cc0972320d97 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] Running cmd (subprocess): nvme version {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:55:24 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-b2a7d329-b257-4e31-8a42-cc0972320d97 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] 'nvme version' failed. Not Retrying. {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 15:55:24 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b2a7d329-b257-4e31-8a42-cc0972320d97 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] nvme not present on system {{(pid=72382) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 15:55:24 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:55:24 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 15:55:24 user nova-compute[72382]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 15:55:24 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aa4edd2-efaf-47fa-adc2-85c13982f1de]: (4, '') {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:55:24 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.lightos [None req-b2a7d329-b257-4e31-8a42-cc0972320d97 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72382) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 15:55:24 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.lightos [None req-b2a7d329-b257-4e31-8a42-cc0972320d97 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72382) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 15:55:24 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.lightos [None req-b2a7d329-b257-4e31-8a42-cc0972320d97 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] LIGHTOS: no hostnqn found. {{(pid=72382) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 15:55:24 user nova-compute[72382]: DEBUG os_brick.utils [None req-b2a7d329-b257-4e31-8a42-cc0972320d97 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d2cfa7015fe', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 15:55:24 user nova-compute[72382]: DEBUG nova.virt.block_device [None req-b2a7d329-b257-4e31-8a42-cc0972320d97 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] [instance: 5e3853b8-8138-4ab1-8b1c-e853f0a81f5c] Updating existing volume attachment record: 742b90a1-04ec-47f7-b8ab-ec85974f4539 {{(pid=72382) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 15:55:25 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:55:27 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:55:32 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b2a7d329-b257-4e31-8a42-cc0972320d97 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] [instance: 5e3853b8-8138-4ab1-8b1c-e853f0a81f5c] Calling os-brick to attach iSCSI Volume {{(pid=72382) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 15:55:32 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2a7d329-b257-4e31-8a42-cc0972320d97 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2a0c768340>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:22214636-7c8f-417d-91a4-c9ded380fbab'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iIarmpJb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 15:55:32 user nova-compute[72382]: WARNING os_brick.initiator.connectors.base [None req-b2a7d329-b257-4e31-8a42-cc0972320d97 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 15:55:32 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-b2a7d329-b257-4e31-8a42-cc0972320d97 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 15:55:32 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-b2a7d329-b257-4e31-8a42-cc0972320d97 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 15:55:32 user nova-compute[72382]: WARNING os_brick.initiator.connectors.base [None req-b2a7d329-b257-4e31-8a42-cc0972320d97 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 15:55:32 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-b2a7d329-b257-4e31-8a42-cc0972320d97 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:22214636-7c8f-417d-91a4-c9ded380fbab" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 15:55:32 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-b2a7d329-b257-4e31-8a42-cc0972320d97 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:22214636-7c8f-417d-91a4-c9ded380fbab" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 15:55:32 user nova-compute[72382]: INFO os_brick.initiator.connectors.iscsi [None req-b2a7d329-b257-4e31-8a42-cc0972320d97 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 15:55:32 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22214636-7c8f-417d-91a4-c9ded380fbab -p 172.16.0.220:3260 {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:55:32 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22214636-7c8f-417d-91a4-c9ded380fbab -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:55:32 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[e49544ad-09a5-4a7c-83ce-52976fbe5ef0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:55:32 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2a7d329-b257-4e31-8a42-cc0972320d97 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 15:55:32 user nova-compute[72382]:  {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:55:32 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22214636-7c8f-417d-91a4-c9ded380fbab -p 172.16.0.220:3260 --interface default --op new {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:55:32 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22214636-7c8f-417d-91a4-c9ded380fbab -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:55:32 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f9a39a2-e2e7-4615-893b-1db9b6905120]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:22214636-7c8f-417d-91a4-c9ded380fbab] added\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:55:32 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2a7d329-b257-4e31-8a42-cc0972320d97 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:22214636-7c8f-417d-91a4-c9ded380fbab] added
Aug 09 15:55:32 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:55:32 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22214636-7c8f-417d-91a4-c9ded380fbab -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:55:32 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22214636-7c8f-417d-91a4-c9ded380fbab -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:55:32 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[367a2c0d-09f3-4fc0-9795-40ec483a9d61]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:55:32 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2a7d329-b257-4e31-8a42-cc0972320d97 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:55:32 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22214636-7c8f-417d-91a4-c9ded380fbab -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:55:32 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22214636-7c8f-417d-91a4-c9ded380fbab -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:55:32 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[05e8f77c-d716-475c-b6f7-ee70175a0f66]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:55:32 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2a7d329-b257-4e31-8a42-cc0972320d97 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:55:32 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22214636-7c8f-417d-91a4-c9ded380fbab -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iIarmpJb {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:55:32 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22214636-7c8f-417d-91a4-c9ded380fbab -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iIarmpJb" returned: 0 in 0.018s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:55:32 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[097b83e9-75cb-4062-a276-1e0d9e13f806]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:55:32 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2a7d329-b257-4e31-8a42-cc0972320d97 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'iIarmpJb'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:55:32 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22214636-7c8f-417d-91a4-c9ded380fbab -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:55:32 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22214636-7c8f-417d-91a4-c9ded380fbab -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:55:32 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9e04ff9-0407-45f8-a0f5-98d4e6f11c06]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:55:32 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2a7d329-b257-4e31-8a42-cc0972320d97 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:55:32 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:55:32 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:55:32 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f5a7938-bfc1-4b02-ac2e-82b6b2967c03]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:55:32 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2a7d329-b257-4e31-8a42-cc0972320d97 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 09 15:55:32 user nova-compute[72382]:  {{(pid=72382) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 15:55:32 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2a7d329-b257-4e31-8a42-cc0972320d97 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 09 15:55:32 user nova-compute[72382]:  {{(pid=72382) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 15:55:32 user nova-compute[72382]: WARNING os_brick.initiator.connectors.iscsi [None req-b2a7d329-b257-4e31-8a42-cc0972320d97 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 09 15:55:32 user nova-compute[72382]: 
Aug 09 15:55:32 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22214636-7c8f-417d-91a4-c9ded380fbab -p 172.16.0.220:3260 --login {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:55:32 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22214636-7c8f-417d-91a4-c9ded380fbab -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:55:32 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0483dc6-cb62-4b15-bed9-369494e5c50e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:22214636-7c8f-417d-91a4-c9ded380fbab, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:22214636-7c8f-417d-91a4-c9ded380fbab, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:55:32 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2a7d329-b257-4e31-8a42-cc0972320d97 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:22214636-7c8f-417d-91a4-c9ded380fbab, portal: 172.16.0.220,3260]
Aug 09 15:55:32 user nova-compute[72382]: Login to [iface: default, target: iqn.2010-10.org.openstack:22214636-7c8f-417d-91a4-c9ded380fbab, portal: 172.16.0.220,3260] successful.
Aug 09 15:55:32 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:55:32 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22214636-7c8f-417d-91a4-c9ded380fbab -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:55:32 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22214636-7c8f-417d-91a4-c9ded380fbab -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:55:32 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c05469f-6f02-460a-b663-f6c6f39f37ec]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:55:32 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2a7d329-b257-4e31-8a42-cc0972320d97 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:55:32 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:55:32 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:55:32 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[2724a2c3-4130-46a7-a856-55590bbe1aeb]: (4, ('tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22214636-7c8f-417d-91a4-c9ded380fbab (non-flash)\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:55:32 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2a7d329-b257-4e31-8a42-cc0972320d97 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22214636-7c8f-417d-91a4-c9ded380fbab (non-flash)
Aug 09 15:55:32 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 15:55:32 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2a7d329-b257-4e31-8a42-cc0972320d97 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] iscsi session list stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22214636-7c8f-417d-91a4-c9ded380fbab (non-flash)
Aug 09 15:55:32 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 15:55:32 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-b2a7d329-b257-4e31-8a42-cc0972320d97 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:22214636-7c8f-417d-91a4-c9ded380fbab" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.263s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 15:55:32 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2a7d329-b257-4e31-8a42-cc0972320d97 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] Connected to 172.16.0.220:3260 {{(pid=72382) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 15:55:32 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-b2a7d329-b257-4e31-8a42-cc0972320d97 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] HCTL ('33', '-', '-', 0) found on session 69 with lun 0 {{(pid=72382) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 15:55:32 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-b2a7d329-b257-4e31-8a42-cc0972320d97 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72382) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 15:55:32 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:55:32 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.024s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:55:32 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1ab4a28-61e7-4ea0-991b-a16eaca9897e]: (4, ('- - 0', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:55:32 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-b2a7d329-b257-4e31-8a42-cc0972320d97 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] Searching for a device in session 69 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72382) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 15:55:32 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2a7d329-b257-4e31-8a42-cc0972320d97 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iIarmpJb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72382) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 15:55:32 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:55:32 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:55:32 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72382) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 15:55:32 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72382) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 15:55:32 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72382) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 15:55:32 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:55:33 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-b2a7d329-b257-4e31-8a42-cc0972320d97 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.301s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 15:55:33 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2a7d329-b257-4e31-8a42-cc0972320d97 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] <== connect_volume: return (1303ms) {'type': 'block', 'scsi_wwn': '23938306534323866', 'path': '/dev/sdb'} {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 15:55:33 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b2a7d329-b257-4e31-8a42-cc0972320d97 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] [instance: 5e3853b8-8138-4ab1-8b1c-e853f0a81f5c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23938306534323866', 'path': '/dev/sdb'} {{(pid=72382) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 15:55:33 user nova-compute[72382]: DEBUG nova.objects.instance [None req-b2a7d329-b257-4e31-8a42-cc0972320d97 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] Lazy-loading 'flavor' on Instance uuid 5e3853b8-8138-4ab1-8b1c-e853f0a81f5c {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:55:33 user nova-compute[72382]: DEBUG nova.virt.libvirt.guest [None req-b2a7d329-b257-4e31-8a42-cc0972320d97 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 15:55:33 user nova-compute[72382]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 15:55:33 user nova-compute[72382]:   <source dev="/dev/sdb"/>
Aug 09 15:55:33 user nova-compute[72382]:   <target dev="vdb" bus="virtio"/>
Aug 09 15:55:33 user nova-compute[72382]:   <serial>22214636-7c8f-417d-91a4-c9ded380fbab</serial>
Aug 09 15:55:33 user nova-compute[72382]: </disk>
Aug 09 15:55:33 user nova-compute[72382]:  {{(pid=72382) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 15:55:34 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-b2a7d329-b257-4e31-8a42-cc0972320d97 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] No BDM found with device name vda, not building metadata. {{(pid=72382) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 15:55:34 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-b2a7d329-b257-4e31-8a42-cc0972320d97 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72382) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 15:55:34 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-b2a7d329-b257-4e31-8a42-cc0972320d97 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] No VIF found with MAC fa:16:3e:5d:ca:7b, not building metadata {{(pid=72382) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 15:55:34 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-b2a7d329-b257-4e31-8a42-cc0972320d97 tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] Lock "5e3853b8-8138-4ab1-8b1c-e853f0a81f5c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.857s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:55:35 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:55:35 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:55:35 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:55:35 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:55:35 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:55:35 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Auditing locally available compute resources for user (node: user) {{(pid=72382) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 15:55:35 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e3853b8-8138-4ab1-8b1c-e853f0a81f5c/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:55:36 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e3853b8-8138-4ab1-8b1c-e853f0a81f5c/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:55:36 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e3853b8-8138-4ab1-8b1c-e853f0a81f5c/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:55:36 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e3853b8-8138-4ab1-8b1c-e853f0a81f5c/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:55:36 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72382) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 15:55:36 user nova-compute[72382]: WARNING nova.virt.libvirt.driver [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 15:55:36 user nova-compute[72382]: WARNING nova.virt.libvirt.driver [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 15:55:36 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Hypervisor/Node resource view: name=user free_ram=8833MB free_disk=25.278663635253906GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72382) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 15:55:36 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:55:36 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:55:36 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance 5e3853b8-8138-4ab1-8b1c-e853f0a81f5c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:55:36 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72382) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 15:55:36 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72382) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 15:55:36 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-26ed8a99-3539-4777-96b3-6d42b9a9225d tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] Acquiring lock "5e3853b8-8138-4ab1-8b1c-e853f0a81f5c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:55:36 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-26ed8a99-3539-4777-96b3-6d42b9a9225d tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] Lock "5e3853b8-8138-4ab1-8b1c-e853f0a81f5c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:55:36 user nova-compute[72382]: INFO nova.compute.manager [None req-26ed8a99-3539-4777-96b3-6d42b9a9225d tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] [instance: 5e3853b8-8138-4ab1-8b1c-e853f0a81f5c] Detaching volume 22214636-7c8f-417d-91a4-c9ded380fbab
Aug 09 15:55:36 user nova-compute[72382]: DEBUG nova.compute.provider_tree [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Inventory has not changed in ProviderTree for provider: 7b15b0e5-df4d-49db-833b-2855d21d10ae {{(pid=72382) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 15:55:36 user nova-compute[72382]: INFO nova.virt.block_device [None req-26ed8a99-3539-4777-96b3-6d42b9a9225d tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] [instance: 5e3853b8-8138-4ab1-8b1c-e853f0a81f5c] Attempting to driver detach volume 22214636-7c8f-417d-91a4-c9ded380fbab from mountpoint /dev/vdb
Aug 09 15:55:36 user nova-compute[72382]: DEBUG nova.scheduler.client.report [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Inventory has not changed for provider 7b15b0e5-df4d-49db-833b-2855d21d10ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72382) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 15:55:36 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Compute_service record updated for user:user {{(pid=72382) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 15:55:36 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.192s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:55:36 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-26ed8a99-3539-4777-96b3-6d42b9a9225d tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] Attempting to detach device vdb from instance 5e3853b8-8138-4ab1-8b1c-e853f0a81f5c from the persistent domain config. {{(pid=72382) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 15:55:36 user nova-compute[72382]: DEBUG nova.virt.libvirt.guest [None req-26ed8a99-3539-4777-96b3-6d42b9a9225d tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 15:55:36 user nova-compute[72382]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 15:55:36 user nova-compute[72382]:   <source dev="/dev/sdb"/>
Aug 09 15:55:36 user nova-compute[72382]:   <target dev="vdb" bus="virtio"/>
Aug 09 15:55:36 user nova-compute[72382]:   <serial>22214636-7c8f-417d-91a4-c9ded380fbab</serial>
Aug 09 15:55:36 user nova-compute[72382]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 15:55:36 user nova-compute[72382]: </disk>
Aug 09 15:55:36 user nova-compute[72382]:  {{(pid=72382) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 15:55:36 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-26ed8a99-3539-4777-96b3-6d42b9a9225d tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] Successfully detached device vdb from instance 5e3853b8-8138-4ab1-8b1c-e853f0a81f5c from the persistent domain config.
Aug 09 15:55:36 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-26ed8a99-3539-4777-96b3-6d42b9a9225d tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 5e3853b8-8138-4ab1-8b1c-e853f0a81f5c from the live domain config. {{(pid=72382) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 15:55:36 user nova-compute[72382]: DEBUG nova.virt.libvirt.guest [None req-26ed8a99-3539-4777-96b3-6d42b9a9225d tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 15:55:36 user nova-compute[72382]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 15:55:36 user nova-compute[72382]:   <source dev="/dev/sdb"/>
Aug 09 15:55:36 user nova-compute[72382]:   <target dev="vdb" bus="virtio"/>
Aug 09 15:55:36 user nova-compute[72382]:   <serial>22214636-7c8f-417d-91a4-c9ded380fbab</serial>
Aug 09 15:55:36 user nova-compute[72382]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 15:55:36 user nova-compute[72382]: </disk>
Aug 09 15:55:36 user nova-compute[72382]:  {{(pid=72382) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 15:55:37 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Received event <DeviceRemovedEvent: 1691596537.3410082, 5e3853b8-8138-4ab1-8b1c-e853f0a81f5c => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72382) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 15:55:37 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-26ed8a99-3539-4777-96b3-6d42b9a9225d tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 5e3853b8-8138-4ab1-8b1c-e853f0a81f5c {{(pid=72382) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 15:55:37 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-26ed8a99-3539-4777-96b3-6d42b9a9225d tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] Successfully detached device vdb from instance 5e3853b8-8138-4ab1-8b1c-e853f0a81f5c from the live domain config.
Aug 09 15:55:37 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-26ed8a99-3539-4777-96b3-6d42b9a9225d tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] [instance: 5e3853b8-8138-4ab1-8b1c-e853f0a81f5c] calling os-brick to detach iSCSI Volume {{(pid=72382) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 15:55:37 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-26ed8a99-3539-4777-96b3-6d42b9a9225d tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2a0c768340>, {'target_iqns': ['iqn.2010-10.org.openstack:22214636-7c8f-417d-91a4-c9ded380fbab'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iIarmpJb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 15:55:37 user nova-compute[72382]: WARNING os_brick.initiator.connectors.base [None req-26ed8a99-3539-4777-96b3-6d42b9a9225d tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 15:55:37 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-26ed8a99-3539-4777-96b3-6d42b9a9225d tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 15:55:37 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-26ed8a99-3539-4777-96b3-6d42b9a9225d tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 15:55:37 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-26ed8a99-3539-4777-96b3-6d42b9a9225d tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:22214636-7c8f-417d-91a4-c9ded380fbab', 0)] {{(pid=72382) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 15:55:37 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:55:37 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:55:37 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[11a4020a-9d50-4712-aa9d-df3f6bb5886b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:22214636-7c8f-417d-91a4-c9ded380fbab\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:55:37 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:55:37 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:55:37 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[5916aa23-577c-4f03-9327-2ec613b0aeea]: (4, ('tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22214636-7c8f-417d-91a4-c9ded380fbab (non-flash)\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:55:37 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-26ed8a99-3539-4777-96b3-6d42b9a9225d tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22214636-7c8f-417d-91a4-c9ded380fbab (non-flash)
Aug 09 15:55:37 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 15:55:37 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-26ed8a99-3539-4777-96b3-6d42b9a9225d tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] iscsi session list stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22214636-7c8f-417d-91a4-c9ded380fbab (non-flash)
Aug 09 15:55:37 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 15:55:37 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-26ed8a99-3539-4777-96b3-6d42b9a9225d tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2a0c1c4ee0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:22214636-7c8f-417d-91a4-c9ded380fbab'): ({'sdb'}, set())}) {{(pid=72382) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 15:55:37 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-26ed8a99-3539-4777-96b3-6d42b9a9225d tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] Removing single pathed devices sdb {{(pid=72382) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 15:55:37 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:55:37 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:55:37 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb2172cd-870b-4cff-8ce6-e4ab243b3806]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:55:37 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:55:37 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:55:37 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[7761b541-f5f9-4894-8488-edeb804651ce]: (4, ('ok\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:55:37 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-26ed8a99-3539-4777-96b3-6d42b9a9225d tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] Flushing IO for device /dev/sdb {{(pid=72382) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 15:55:37 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:55:37 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:55:37 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b7b85e1-cc43-4fbd-bd4c-e1e06bd6b0b0]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:55:37 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-26ed8a99-3539-4777-96b3-6d42b9a9225d tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72382) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 15:55:37 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:55:37 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.036s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:55:37 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[fec2aaf7-ae96-4b01-8f1a-8cb05ace5b64]: (4, ('1', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:55:37 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-26ed8a99-3539-4777-96b3-6d42b9a9225d tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72382) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 15:55:37 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-26ed8a99-3539-4777-96b3-6d42b9a9225d tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] SCSI volumes sdb have been removed. {{(pid=72382) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 15:55:37 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-26ed8a99-3539-4777-96b3-6d42b9a9225d tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:22214636-7c8f-417d-91a4-c9ded380fbab')] {{(pid=72382) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 15:55:37 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22214636-7c8f-417d-91a4-c9ded380fbab -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:55:37 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22214636-7c8f-417d-91a4-c9ded380fbab -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:55:37 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0dffbbf-18fc-4a60-bf92-752b8598ea25]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:55:37 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-26ed8a99-3539-4777-96b3-6d42b9a9225d tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:55:37 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22214636-7c8f-417d-91a4-c9ded380fbab -p 172.16.0.220:3260 --logout {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:55:37 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22214636-7c8f-417d-91a4-c9ded380fbab -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:55:37 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[968cecf5-9028-4772-88fd-626f355cffa8]: (4, ('Logging out of session [sid: 69, target: iqn.2010-10.org.openstack:22214636-7c8f-417d-91a4-c9ded380fbab, portal: 172.16.0.220,3260]\nLogout of [sid: 69, target: iqn.2010-10.org.openstack:22214636-7c8f-417d-91a4-c9ded380fbab, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:55:37 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-26ed8a99-3539-4777-96b3-6d42b9a9225d tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 69, target: iqn.2010-10.org.openstack:22214636-7c8f-417d-91a4-c9ded380fbab, portal: 172.16.0.220,3260]
Aug 09 15:55:37 user nova-compute[72382]: Logout of [sid: 69, target: iqn.2010-10.org.openstack:22214636-7c8f-417d-91a4-c9ded380fbab, portal: 172.16.0.220,3260] successful.
Aug 09 15:55:37 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:55:37 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22214636-7c8f-417d-91a4-c9ded380fbab -p 172.16.0.220:3260 --op delete {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:55:37 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22214636-7c8f-417d-91a4-c9ded380fbab -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:55:37 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[b916ac53-9501-4495-9a34-eb8edc19326c]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:55:37 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-26ed8a99-3539-4777-96b3-6d42b9a9225d tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:55:37 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-26ed8a99-3539-4777-96b3-6d42b9a9225d tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.264s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 15:55:37 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-26ed8a99-3539-4777-96b3-6d42b9a9225d tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] <== disconnect_volume: return (265ms) None {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 15:55:37 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-26ed8a99-3539-4777-96b3-6d42b9a9225d tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] [instance: 5e3853b8-8138-4ab1-8b1c-e853f0a81f5c] Disconnected iSCSI Volume {{(pid=72382) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 15:55:37 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:55:37 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:55:37 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:55:37 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:55:37 user nova-compute[72382]: DEBUG nova.compute.manager [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Starting heal instance info cache {{(pid=72382) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 15:55:37 user nova-compute[72382]: DEBUG nova.compute.manager [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Rebuilding the list of instances to heal {{(pid=72382) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 09 15:55:37 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:55:38 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Acquiring lock "refresh_cache-5e3853b8-8138-4ab1-8b1c-e853f0a81f5c" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 15:55:38 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Acquired lock "refresh_cache-5e3853b8-8138-4ab1-8b1c-e853f0a81f5c" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 15:55:38 user nova-compute[72382]: DEBUG nova.network.neutron [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] [instance: 5e3853b8-8138-4ab1-8b1c-e853f0a81f5c] Forcefully refreshing network info cache for instance {{(pid=72382) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 15:55:38 user nova-compute[72382]: DEBUG nova.objects.instance [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lazy-loading 'info_cache' on Instance uuid 5e3853b8-8138-4ab1-8b1c-e853f0a81f5c {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:55:38 user nova-compute[72382]: DEBUG nova.objects.instance [None req-26ed8a99-3539-4777-96b3-6d42b9a9225d tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] Lazy-loading 'flavor' on Instance uuid 5e3853b8-8138-4ab1-8b1c-e853f0a81f5c {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:55:38 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-26ed8a99-3539-4777-96b3-6d42b9a9225d tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] Lock "5e3853b8-8138-4ab1-8b1c-e853f0a81f5c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.611s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:55:38 user nova-compute[72382]: DEBUG nova.network.neutron [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] [instance: 5e3853b8-8138-4ab1-8b1c-e853f0a81f5c] Updating instance_info_cache with network_info: [{"id": "e8fcea04-f9ce-4285-8e81-41a2042cbfb0", "address": "fa:16:3e:5d:ca:7b", "network": {"id": "45acf55d-48f5-4a7d-a01c-0aa68e330e1a", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-992217983-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f62d7fd59f9436295c98e08de857253", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8fcea04-f9", "ovs_interfaceid": "e8fcea04-f9ce-4285-8e81-41a2042cbfb0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:55:38 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Releasing lock "refresh_cache-5e3853b8-8138-4ab1-8b1c-e853f0a81f5c" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 15:55:38 user nova-compute[72382]: DEBUG nova.compute.manager [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] [instance: 5e3853b8-8138-4ab1-8b1c-e853f0a81f5c] Updated the network info_cache for instance {{(pid=72382) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 15:55:38 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:55:38 user nova-compute[72382]: DEBUG nova.compute.manager [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72382) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 15:55:40 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:55:40 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:55:42 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:55:43 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:55:43 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:55:46 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:55:47 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:55:52 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:55:57 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:55:57 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:55:57 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72382) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 15:55:57 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72382) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 15:55:57 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72382) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 15:55:57 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:56:02 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:56:07 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:56:12 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:56:12 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:56:12 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72382) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 15:56:12 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72382) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 15:56:12 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72382) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 15:56:12 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:56:17 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:56:22 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:56:27 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:56:31 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-664f6791-0ce5-4985-a716-0179144f53ff tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] Acquiring lock "5e3853b8-8138-4ab1-8b1c-e853f0a81f5c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:56:31 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-664f6791-0ce5-4985-a716-0179144f53ff tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] Lock "5e3853b8-8138-4ab1-8b1c-e853f0a81f5c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:56:31 user nova-compute[72382]: DEBUG nova.objects.instance [None req-664f6791-0ce5-4985-a716-0179144f53ff tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] Lazy-loading 'flavor' on Instance uuid 5e3853b8-8138-4ab1-8b1c-e853f0a81f5c {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:56:31 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-664f6791-0ce5-4985-a716-0179144f53ff tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] Lock "5e3853b8-8138-4ab1-8b1c-e853f0a81f5c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:56:31 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-664f6791-0ce5-4985-a716-0179144f53ff tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] Acquiring lock "5e3853b8-8138-4ab1-8b1c-e853f0a81f5c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:56:31 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-664f6791-0ce5-4985-a716-0179144f53ff tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] Lock "5e3853b8-8138-4ab1-8b1c-e853f0a81f5c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:56:31 user nova-compute[72382]: INFO nova.compute.manager [None req-664f6791-0ce5-4985-a716-0179144f53ff tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] [instance: 5e3853b8-8138-4ab1-8b1c-e853f0a81f5c] Attaching volume ac717408-3aab-4341-a609-3d10aebd6090 to /dev/vdb
Aug 09 15:56:31 user nova-compute[72382]: DEBUG os_brick.utils [None req-664f6791-0ce5-4985-a716-0179144f53ff tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 15:56:31 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:56:31 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:56:31 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e1c1614-7e9b-4c27-b315-f99a9a659094]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d2cfa7015fe\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:56:31 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:56:31 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:56:31 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[3316663e-db8b-45f1-a0eb-9cce24ca5119]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:56:31 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:56:31 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:56:31 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a9d8fab-3a99-45f9-b31c-bba640e37e15]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:56:31 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[13cf2d3f-00a3-4c9a-9d25-53226a8d0131]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:56:31 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-664f6791-0ce5-4985-a716-0179144f53ff tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] Running cmd (subprocess): nvme version {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:56:31 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-664f6791-0ce5-4985-a716-0179144f53ff tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] 'nvme version' failed. Not Retrying. {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 15:56:31 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.nvmeof [None req-664f6791-0ce5-4985-a716-0179144f53ff tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] nvme not present on system {{(pid=72382) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 15:56:31 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:56:31 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 15:56:31 user nova-compute[72382]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 15:56:31 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8b7cb7f-2c0e-49a1-a575-331da2e32ff5]: (4, '') {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:56:31 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.lightos [None req-664f6791-0ce5-4985-a716-0179144f53ff tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72382) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 15:56:31 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.lightos [None req-664f6791-0ce5-4985-a716-0179144f53ff tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72382) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 15:56:31 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.lightos [None req-664f6791-0ce5-4985-a716-0179144f53ff tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] LIGHTOS: no hostnqn found. {{(pid=72382) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 15:56:31 user nova-compute[72382]: DEBUG os_brick.utils [None req-664f6791-0ce5-4985-a716-0179144f53ff tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d2cfa7015fe', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 15:56:31 user nova-compute[72382]: DEBUG nova.virt.block_device [None req-664f6791-0ce5-4985-a716-0179144f53ff tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] [instance: 5e3853b8-8138-4ab1-8b1c-e853f0a81f5c] Updating existing volume attachment record: 397487aa-e877-4481-9f87-6b433bb835f8 {{(pid=72382) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 15:56:32 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:56:35 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:56:35 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:56:35 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:56:35 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:56:35 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:56:35 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Auditing locally available compute resources for user (node: user) {{(pid=72382) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 15:56:35 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e3853b8-8138-4ab1-8b1c-e853f0a81f5c/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:56:36 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e3853b8-8138-4ab1-8b1c-e853f0a81f5c/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:56:36 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e3853b8-8138-4ab1-8b1c-e853f0a81f5c/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:56:36 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e3853b8-8138-4ab1-8b1c-e853f0a81f5c/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:56:36 user nova-compute[72382]: WARNING nova.virt.libvirt.driver [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 15:56:36 user nova-compute[72382]: WARNING nova.virt.libvirt.driver [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 15:56:36 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Hypervisor/Node resource view: name=user free_ram=8829MB free_disk=25.27777862548828GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72382) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 15:56:36 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:56:36 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:56:36 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance 5e3853b8-8138-4ab1-8b1c-e853f0a81f5c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:56:36 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72382) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 15:56:36 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72382) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 15:56:36 user nova-compute[72382]: DEBUG nova.compute.provider_tree [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Inventory has not changed in ProviderTree for provider: 7b15b0e5-df4d-49db-833b-2855d21d10ae {{(pid=72382) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 15:56:36 user nova-compute[72382]: DEBUG nova.scheduler.client.report [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Inventory has not changed for provider 7b15b0e5-df4d-49db-833b-2855d21d10ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72382) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 15:56:36 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Compute_service record updated for user:user {{(pid=72382) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 15:56:36 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.168s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:56:37 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:56:38 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:56:38 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:56:38 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:56:38 user nova-compute[72382]: DEBUG nova.compute.manager [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Starting heal instance info cache {{(pid=72382) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 15:56:38 user nova-compute[72382]: DEBUG nova.compute.manager [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Rebuilding the list of instances to heal {{(pid=72382) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 09 15:56:39 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Acquiring lock "refresh_cache-5e3853b8-8138-4ab1-8b1c-e853f0a81f5c" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 15:56:39 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Acquired lock "refresh_cache-5e3853b8-8138-4ab1-8b1c-e853f0a81f5c" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 15:56:39 user nova-compute[72382]: DEBUG nova.network.neutron [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] [instance: 5e3853b8-8138-4ab1-8b1c-e853f0a81f5c] Forcefully refreshing network info cache for instance {{(pid=72382) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 15:56:39 user nova-compute[72382]: DEBUG nova.objects.instance [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lazy-loading 'info_cache' on Instance uuid 5e3853b8-8138-4ab1-8b1c-e853f0a81f5c {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:56:39 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-664f6791-0ce5-4985-a716-0179144f53ff tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] [instance: 5e3853b8-8138-4ab1-8b1c-e853f0a81f5c] Calling os-brick to attach iSCSI Volume {{(pid=72382) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 15:56:39 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-664f6791-0ce5-4985-a716-0179144f53ff tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2a0c768340>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:ac717408-3aab-4341-a609-3d10aebd6090'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uQSvHhpN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 15:56:39 user nova-compute[72382]: WARNING os_brick.initiator.connectors.base [None req-664f6791-0ce5-4985-a716-0179144f53ff tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 15:56:39 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-664f6791-0ce5-4985-a716-0179144f53ff tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 15:56:39 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-664f6791-0ce5-4985-a716-0179144f53ff tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 15:56:39 user nova-compute[72382]: WARNING os_brick.initiator.connectors.base [None req-664f6791-0ce5-4985-a716-0179144f53ff tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 15:56:39 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-664f6791-0ce5-4985-a716-0179144f53ff tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ac717408-3aab-4341-a609-3d10aebd6090" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 15:56:39 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-664f6791-0ce5-4985-a716-0179144f53ff tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ac717408-3aab-4341-a609-3d10aebd6090" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 15:56:39 user nova-compute[72382]: INFO os_brick.initiator.connectors.iscsi [None req-664f6791-0ce5-4985-a716-0179144f53ff tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 15:56:39 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac717408-3aab-4341-a609-3d10aebd6090 -p 172.16.0.220:3260 {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:56:39 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac717408-3aab-4341-a609-3d10aebd6090 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:56:39 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[af4cc1cf-da16-4f01-b370-8c8edac7cb1f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:56:39 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-664f6791-0ce5-4985-a716-0179144f53ff tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 15:56:39 user nova-compute[72382]:  {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:56:39 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac717408-3aab-4341-a609-3d10aebd6090 -p 172.16.0.220:3260 --interface default --op new {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:56:39 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac717408-3aab-4341-a609-3d10aebd6090 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:56:39 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bf6f2c5-0408-42fc-bd72-0eedbfe4093d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ac717408-3aab-4341-a609-3d10aebd6090] added\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:56:39 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-664f6791-0ce5-4985-a716-0179144f53ff tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ac717408-3aab-4341-a609-3d10aebd6090] added
Aug 09 15:56:39 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:56:39 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac717408-3aab-4341-a609-3d10aebd6090 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:56:39 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac717408-3aab-4341-a609-3d10aebd6090 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:56:39 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[10dd0a4b-d84f-4294-85a1-f5d7969ca8c7]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:56:39 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-664f6791-0ce5-4985-a716-0179144f53ff tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:56:39 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac717408-3aab-4341-a609-3d10aebd6090 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:56:39 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac717408-3aab-4341-a609-3d10aebd6090 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:56:39 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eaa3c04-a573-492b-8435-79fac3638343]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:56:39 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-664f6791-0ce5-4985-a716-0179144f53ff tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:56:39 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac717408-3aab-4341-a609-3d10aebd6090 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uQSvHhpN {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:56:39 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac717408-3aab-4341-a609-3d10aebd6090 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uQSvHhpN" returned: 0 in 0.021s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:56:39 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d5a63f2-633a-4fd4-ae9d-72f4d20565dd]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:56:39 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-664f6791-0ce5-4985-a716-0179144f53ff tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'uQSvHhpN'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:56:39 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac717408-3aab-4341-a609-3d10aebd6090 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:56:39 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac717408-3aab-4341-a609-3d10aebd6090 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:56:39 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfc2d315-91ed-43d4-9691-ae6e48348333]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:56:39 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-664f6791-0ce5-4985-a716-0179144f53ff tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:56:39 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:56:39 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:56:39 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[4288b9ca-3dd9-4c75-8ccf-adde3c5f16ba]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:56:39 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-664f6791-0ce5-4985-a716-0179144f53ff tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 09 15:56:39 user nova-compute[72382]:  {{(pid=72382) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 15:56:39 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-664f6791-0ce5-4985-a716-0179144f53ff tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 09 15:56:39 user nova-compute[72382]:  {{(pid=72382) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 15:56:39 user nova-compute[72382]: WARNING os_brick.initiator.connectors.iscsi [None req-664f6791-0ce5-4985-a716-0179144f53ff tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 09 15:56:39 user nova-compute[72382]: 
Aug 09 15:56:39 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac717408-3aab-4341-a609-3d10aebd6090 -p 172.16.0.220:3260 --login {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:56:39 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac717408-3aab-4341-a609-3d10aebd6090 -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:56:39 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[868dc907-0762-4abf-8baa-10939f5c5abc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ac717408-3aab-4341-a609-3d10aebd6090, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ac717408-3aab-4341-a609-3d10aebd6090, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:56:39 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-664f6791-0ce5-4985-a716-0179144f53ff tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ac717408-3aab-4341-a609-3d10aebd6090, portal: 172.16.0.220,3260]
Aug 09 15:56:39 user nova-compute[72382]: Login to [iface: default, target: iqn.2010-10.org.openstack:ac717408-3aab-4341-a609-3d10aebd6090, portal: 172.16.0.220,3260] successful.
Aug 09 15:56:39 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:56:39 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac717408-3aab-4341-a609-3d10aebd6090 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:56:39 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac717408-3aab-4341-a609-3d10aebd6090 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:56:39 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6543edf-0d7e-49f9-944e-15d746580d76]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:56:39 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-664f6791-0ce5-4985-a716-0179144f53ff tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:56:39 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:56:39 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:56:39 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[02311b94-9489-4119-aad1-dcdfb8d3c656]: (4, ('tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac717408-3aab-4341-a609-3d10aebd6090 (non-flash)\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:56:39 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-664f6791-0ce5-4985-a716-0179144f53ff tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac717408-3aab-4341-a609-3d10aebd6090 (non-flash)
Aug 09 15:56:39 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 15:56:39 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-664f6791-0ce5-4985-a716-0179144f53ff tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] iscsi session list stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac717408-3aab-4341-a609-3d10aebd6090 (non-flash)
Aug 09 15:56:39 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 15:56:39 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-664f6791-0ce5-4985-a716-0179144f53ff tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ac717408-3aab-4341-a609-3d10aebd6090" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.264s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 15:56:39 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-664f6791-0ce5-4985-a716-0179144f53ff tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] Connected to 172.16.0.220:3260 {{(pid=72382) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 15:56:39 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-664f6791-0ce5-4985-a716-0179144f53ff tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] HCTL ('33', '-', '-', 0) found on session 70 with lun 0 {{(pid=72382) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 15:56:39 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-664f6791-0ce5-4985-a716-0179144f53ff tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72382) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 15:56:39 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:56:39 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:56:39 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[07c56485-a088-4da1-a44f-39163029cd5b]: (4, ('- - 0', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:56:39 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-664f6791-0ce5-4985-a716-0179144f53ff tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] Searching for a device in session 70 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72382) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 15:56:39 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-664f6791-0ce5-4985-a716-0179144f53ff tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uQSvHhpN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72382) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 15:56:39 user nova-compute[72382]: DEBUG nova.network.neutron [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] [instance: 5e3853b8-8138-4ab1-8b1c-e853f0a81f5c] Updating instance_info_cache with network_info: [{"id": "e8fcea04-f9ce-4285-8e81-41a2042cbfb0", "address": "fa:16:3e:5d:ca:7b", "network": {"id": "45acf55d-48f5-4a7d-a01c-0aa68e330e1a", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-992217983-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f62d7fd59f9436295c98e08de857253", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8fcea04-f9", "ovs_interfaceid": "e8fcea04-f9ce-4285-8e81-41a2042cbfb0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:56:39 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Releasing lock "refresh_cache-5e3853b8-8138-4ab1-8b1c-e853f0a81f5c" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 15:56:39 user nova-compute[72382]: DEBUG nova.compute.manager [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] [instance: 5e3853b8-8138-4ab1-8b1c-e853f0a81f5c] Updated the network info_cache for instance {{(pid=72382) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 15:56:39 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:56:40 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-664f6791-0ce5-4985-a716-0179144f53ff tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.302s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 15:56:40 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-664f6791-0ce5-4985-a716-0179144f53ff tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] <== connect_volume: return (1304ms) {'type': 'block', 'scsi_wwn': '26462353837373536', 'path': '/dev/sdb'} {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 15:56:40 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-664f6791-0ce5-4985-a716-0179144f53ff tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] [instance: 5e3853b8-8138-4ab1-8b1c-e853f0a81f5c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26462353837373536', 'path': '/dev/sdb'} {{(pid=72382) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 15:56:40 user nova-compute[72382]: DEBUG nova.objects.instance [None req-664f6791-0ce5-4985-a716-0179144f53ff tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] Lazy-loading 'flavor' on Instance uuid 5e3853b8-8138-4ab1-8b1c-e853f0a81f5c {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:56:40 user nova-compute[72382]: DEBUG nova.virt.libvirt.guest [None req-664f6791-0ce5-4985-a716-0179144f53ff tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 15:56:40 user nova-compute[72382]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 15:56:40 user nova-compute[72382]:   <source dev="/dev/sdb"/>
Aug 09 15:56:40 user nova-compute[72382]:   <target dev="vdb" bus="virtio"/>
Aug 09 15:56:40 user nova-compute[72382]:   <serial>ac717408-3aab-4341-a609-3d10aebd6090</serial>
Aug 09 15:56:40 user nova-compute[72382]: </disk>
Aug 09 15:56:40 user nova-compute[72382]:  {{(pid=72382) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 15:56:40 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:56:40 user nova-compute[72382]: DEBUG nova.compute.manager [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72382) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 15:56:40 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-664f6791-0ce5-4985-a716-0179144f53ff tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] No BDM found with device name vda, not building metadata. {{(pid=72382) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 15:56:40 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-664f6791-0ce5-4985-a716-0179144f53ff tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72382) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 15:56:40 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-664f6791-0ce5-4985-a716-0179144f53ff tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] No VIF found with MAC fa:16:3e:5d:ca:7b, not building metadata {{(pid=72382) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 15:56:41 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-664f6791-0ce5-4985-a716-0179144f53ff tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] Lock "5e3853b8-8138-4ab1-8b1c-e853f0a81f5c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.834s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:56:42 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:56:42 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:56:42 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72382) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 15:56:42 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72382) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 15:56:42 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72382) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 15:56:42 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:56:43 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-a2e8e29d-5cb7-4049-b496-9ea8dbb953fb tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] Acquiring lock "5e3853b8-8138-4ab1-8b1c-e853f0a81f5c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:56:43 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-a2e8e29d-5cb7-4049-b496-9ea8dbb953fb tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] Lock "5e3853b8-8138-4ab1-8b1c-e853f0a81f5c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:56:43 user nova-compute[72382]: INFO nova.compute.manager [None req-a2e8e29d-5cb7-4049-b496-9ea8dbb953fb tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] [instance: 5e3853b8-8138-4ab1-8b1c-e853f0a81f5c] Detaching volume ac717408-3aab-4341-a609-3d10aebd6090
Aug 09 15:56:43 user nova-compute[72382]: INFO nova.virt.block_device [None req-a2e8e29d-5cb7-4049-b496-9ea8dbb953fb tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] [instance: 5e3853b8-8138-4ab1-8b1c-e853f0a81f5c] Attempting to driver detach volume ac717408-3aab-4341-a609-3d10aebd6090 from mountpoint /dev/vdb
Aug 09 15:56:43 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-a2e8e29d-5cb7-4049-b496-9ea8dbb953fb tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] Attempting to detach device vdb from instance 5e3853b8-8138-4ab1-8b1c-e853f0a81f5c from the persistent domain config. {{(pid=72382) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 15:56:43 user nova-compute[72382]: DEBUG nova.virt.libvirt.guest [None req-a2e8e29d-5cb7-4049-b496-9ea8dbb953fb tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 15:56:43 user nova-compute[72382]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 15:56:43 user nova-compute[72382]:   <source dev="/dev/sdb"/>
Aug 09 15:56:43 user nova-compute[72382]:   <target dev="vdb" bus="virtio"/>
Aug 09 15:56:43 user nova-compute[72382]:   <serial>ac717408-3aab-4341-a609-3d10aebd6090</serial>
Aug 09 15:56:43 user nova-compute[72382]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 15:56:43 user nova-compute[72382]: </disk>
Aug 09 15:56:43 user nova-compute[72382]:  {{(pid=72382) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 15:56:43 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-a2e8e29d-5cb7-4049-b496-9ea8dbb953fb tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] Successfully detached device vdb from instance 5e3853b8-8138-4ab1-8b1c-e853f0a81f5c from the persistent domain config.
Aug 09 15:56:43 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-a2e8e29d-5cb7-4049-b496-9ea8dbb953fb tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 5e3853b8-8138-4ab1-8b1c-e853f0a81f5c from the live domain config. {{(pid=72382) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 15:56:43 user nova-compute[72382]: DEBUG nova.virt.libvirt.guest [None req-a2e8e29d-5cb7-4049-b496-9ea8dbb953fb tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 15:56:43 user nova-compute[72382]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 15:56:43 user nova-compute[72382]:   <source dev="/dev/sdb"/>
Aug 09 15:56:43 user nova-compute[72382]:   <target dev="vdb" bus="virtio"/>
Aug 09 15:56:43 user nova-compute[72382]:   <serial>ac717408-3aab-4341-a609-3d10aebd6090</serial>
Aug 09 15:56:43 user nova-compute[72382]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 15:56:43 user nova-compute[72382]: </disk>
Aug 09 15:56:43 user nova-compute[72382]:  {{(pid=72382) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 15:56:44 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-8214e7d4-1039-40a9-a48f-bbcadd9d45db None None] Received event <DeviceRemovedEvent: 1691596604.0721147, 5e3853b8-8138-4ab1-8b1c-e853f0a81f5c => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72382) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 15:56:44 user nova-compute[72382]: DEBUG nova.virt.libvirt.driver [None req-a2e8e29d-5cb7-4049-b496-9ea8dbb953fb tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 5e3853b8-8138-4ab1-8b1c-e853f0a81f5c {{(pid=72382) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 15:56:44 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-a2e8e29d-5cb7-4049-b496-9ea8dbb953fb tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] Successfully detached device vdb from instance 5e3853b8-8138-4ab1-8b1c-e853f0a81f5c from the live domain config.
Aug 09 15:56:44 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a2e8e29d-5cb7-4049-b496-9ea8dbb953fb tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] [instance: 5e3853b8-8138-4ab1-8b1c-e853f0a81f5c] calling os-brick to detach iSCSI Volume {{(pid=72382) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 15:56:44 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2e8e29d-5cb7-4049-b496-9ea8dbb953fb tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2a0c768340>, {'target_iqns': ['iqn.2010-10.org.openstack:ac717408-3aab-4341-a609-3d10aebd6090'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uQSvHhpN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 15:56:44 user nova-compute[72382]: WARNING os_brick.initiator.connectors.base [None req-a2e8e29d-5cb7-4049-b496-9ea8dbb953fb tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 15:56:44 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-a2e8e29d-5cb7-4049-b496-9ea8dbb953fb tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 15:56:44 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-a2e8e29d-5cb7-4049-b496-9ea8dbb953fb tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 15:56:44 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2e8e29d-5cb7-4049-b496-9ea8dbb953fb tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ac717408-3aab-4341-a609-3d10aebd6090', 0)] {{(pid=72382) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 15:56:44 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:56:44 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:56:44 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e6ddc72-6413-47b0-b550-cb8bd3c29af6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ac717408-3aab-4341-a609-3d10aebd6090\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:56:44 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:56:44 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:56:44 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d32269b-d061-4df8-a6ac-1e1b31251ab5]: (4, ('tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac717408-3aab-4341-a609-3d10aebd6090 (non-flash)\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:56:44 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2e8e29d-5cb7-4049-b496-9ea8dbb953fb tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac717408-3aab-4341-a609-3d10aebd6090 (non-flash)
Aug 09 15:56:44 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 15:56:44 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2e8e29d-5cb7-4049-b496-9ea8dbb953fb tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] iscsi session list stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac717408-3aab-4341-a609-3d10aebd6090 (non-flash)
Aug 09 15:56:44 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 15:56:44 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2e8e29d-5cb7-4049-b496-9ea8dbb953fb tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2a0c3d6200>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ac717408-3aab-4341-a609-3d10aebd6090'): ({'sdb'}, set())}) {{(pid=72382) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 15:56:44 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-a2e8e29d-5cb7-4049-b496-9ea8dbb953fb tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] Removing single pathed devices sdb {{(pid=72382) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 15:56:44 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:56:44 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:56:44 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e23b245-7df1-441b-9330-51cd9b0a9dc1]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:56:44 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:56:44 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:56:44 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[71048862-4b30-4b98-b63d-9f3d52583cd2]: (4, ('ok\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:56:44 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-a2e8e29d-5cb7-4049-b496-9ea8dbb953fb tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] Flushing IO for device /dev/sdb {{(pid=72382) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 15:56:44 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:56:44 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.018s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:56:44 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[c19467b7-fabb-4e30-a918-55ad32d0b29b]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:56:44 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-a2e8e29d-5cb7-4049-b496-9ea8dbb953fb tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72382) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 15:56:44 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:56:44 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.040s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:56:44 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[20eedd47-b620-4cfc-b1c9-98a74a8507bc]: (4, ('1', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:56:44 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-a2e8e29d-5cb7-4049-b496-9ea8dbb953fb tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72382) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 15:56:44 user nova-compute[72382]: DEBUG os_brick.initiator.linuxscsi [None req-a2e8e29d-5cb7-4049-b496-9ea8dbb953fb tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] SCSI volumes sdb have been removed. {{(pid=72382) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 15:56:44 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2e8e29d-5cb7-4049-b496-9ea8dbb953fb tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ac717408-3aab-4341-a609-3d10aebd6090')] {{(pid=72382) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 15:56:44 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac717408-3aab-4341-a609-3d10aebd6090 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:56:44 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac717408-3aab-4341-a609-3d10aebd6090 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:56:44 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ef58f59-efb0-4947-a962-adda9ac4c977]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:56:44 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2e8e29d-5cb7-4049-b496-9ea8dbb953fb tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:56:44 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac717408-3aab-4341-a609-3d10aebd6090 -p 172.16.0.220:3260 --logout {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:56:44 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac717408-3aab-4341-a609-3d10aebd6090 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:56:44 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[67a40bac-b0d4-4f04-aa5c-6c724439dc7a]: (4, ('Logging out of session [sid: 70, target: iqn.2010-10.org.openstack:ac717408-3aab-4341-a609-3d10aebd6090, portal: 172.16.0.220,3260]\nLogout of [sid: 70, target: iqn.2010-10.org.openstack:ac717408-3aab-4341-a609-3d10aebd6090, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:56:44 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2e8e29d-5cb7-4049-b496-9ea8dbb953fb tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 70, target: iqn.2010-10.org.openstack:ac717408-3aab-4341-a609-3d10aebd6090, portal: 172.16.0.220,3260]
Aug 09 15:56:44 user nova-compute[72382]: Logout of [sid: 70, target: iqn.2010-10.org.openstack:ac717408-3aab-4341-a609-3d10aebd6090, portal: 172.16.0.220,3260] successful.
Aug 09 15:56:44 user nova-compute[72382]:  stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:56:44 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac717408-3aab-4341-a609-3d10aebd6090 -p 172.16.0.220:3260 --op delete {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:56:44 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac717408-3aab-4341-a609-3d10aebd6090 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=83725) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:56:44 user nova-compute[72382]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2ac7243-b27d-485f-ada6-b1618cf78203]: (4, ('', '')) {{(pid=83725) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 15:56:44 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2e8e29d-5cb7-4049-b496-9ea8dbb953fb tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72382) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 15:56:44 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.base [None req-a2e8e29d-5cb7-4049-b496-9ea8dbb953fb tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.288s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 15:56:44 user nova-compute[72382]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2e8e29d-5cb7-4049-b496-9ea8dbb953fb tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] <== disconnect_volume: return (289ms) None {{(pid=72382) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 15:56:44 user nova-compute[72382]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a2e8e29d-5cb7-4049-b496-9ea8dbb953fb tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] [instance: 5e3853b8-8138-4ab1-8b1c-e853f0a81f5c] Disconnected iSCSI Volume {{(pid=72382) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 15:56:44 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:56:45 user nova-compute[72382]: DEBUG nova.objects.instance [None req-a2e8e29d-5cb7-4049-b496-9ea8dbb953fb tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] Lazy-loading 'flavor' on Instance uuid 5e3853b8-8138-4ab1-8b1c-e853f0a81f5c {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:56:45 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-a2e8e29d-5cb7-4049-b496-9ea8dbb953fb tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] Lock "5e3853b8-8138-4ab1-8b1c-e853f0a81f5c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.640s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:56:45 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:56:45 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:56:46 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:56:46 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:56:46 user nova-compute[72382]: DEBUG nova.compute.manager [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Cleaning up deleted instances {{(pid=72382) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 09 15:56:46 user nova-compute[72382]: DEBUG nova.compute.manager [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] There are 0 instances to clean {{(pid=72382) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 09 15:56:47 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:56:52 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:56:53 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:56:53 user nova-compute[72382]: DEBUG nova.compute.manager [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Cleaning up deleted instances with incomplete migration  {{(pid=72382) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 09 15:56:57 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:56:59 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:57:02 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:57:07 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:57:12 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:57:18 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:57:18 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:57:18 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72382) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 15:57:18 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72382) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 15:57:18 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72382) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 15:57:18 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:57:23 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:57:28 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:57:33 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:57:33 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:57:33 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72382) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 15:57:33 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72382) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 15:57:33 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72382) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 15:57:33 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:57:37 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:57:37 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:57:37 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:57:37 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:57:37 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Auditing locally available compute resources for user (node: user) {{(pid=72382) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 15:57:37 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e3853b8-8138-4ab1-8b1c-e853f0a81f5c/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:57:38 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:57:38 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e3853b8-8138-4ab1-8b1c-e853f0a81f5c/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:57:38 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e3853b8-8138-4ab1-8b1c-e853f0a81f5c/disk --force-share --output=json {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 15:57:38 user nova-compute[72382]: DEBUG oslo_concurrency.processutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e3853b8-8138-4ab1-8b1c-e853f0a81f5c/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72382) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 15:57:38 user nova-compute[72382]: WARNING nova.virt.libvirt.driver [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 15:57:38 user nova-compute[72382]: WARNING nova.virt.libvirt.driver [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 15:57:38 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Hypervisor/Node resource view: name=user free_ram=8856MB free_disk=25.27688980102539GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72382) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 15:57:38 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:57:38 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:57:38 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Instance 5e3853b8-8138-4ab1-8b1c-e853f0a81f5c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72382) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 15:57:38 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72382) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 15:57:38 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72382) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 15:57:38 user nova-compute[72382]: DEBUG nova.scheduler.client.report [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Refreshing inventories for resource provider 7b15b0e5-df4d-49db-833b-2855d21d10ae {{(pid=72382) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 09 15:57:38 user nova-compute[72382]: DEBUG nova.scheduler.client.report [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Updating ProviderTree inventory for provider 7b15b0e5-df4d-49db-833b-2855d21d10ae from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72382) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 09 15:57:38 user nova-compute[72382]: DEBUG nova.compute.provider_tree [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Updating inventory in ProviderTree for provider 7b15b0e5-df4d-49db-833b-2855d21d10ae with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72382) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 09 15:57:38 user nova-compute[72382]: DEBUG nova.scheduler.client.report [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Refreshing aggregate associations for resource provider 7b15b0e5-df4d-49db-833b-2855d21d10ae, aggregates: None {{(pid=72382) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 09 15:57:38 user nova-compute[72382]: DEBUG nova.scheduler.client.report [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Refreshing trait associations for resource provider 7b15b0e5-df4d-49db-833b-2855d21d10ae, traits: COMPUTE_DEVICE_TAGGING,COMPUTE_NODE,COMPUTE_VOLUME_EXTEND,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE42,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_MMX,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE2 {{(pid=72382) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 09 15:57:39 user nova-compute[72382]: DEBUG nova.compute.provider_tree [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Inventory has not changed in ProviderTree for provider: 7b15b0e5-df4d-49db-833b-2855d21d10ae {{(pid=72382) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 15:57:39 user nova-compute[72382]: DEBUG nova.scheduler.client.report [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Inventory has not changed for provider 7b15b0e5-df4d-49db-833b-2855d21d10ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72382) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 15:57:39 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Compute_service record updated for user:user {{(pid=72382) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 15:57:39 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.422s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:57:40 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:57:40 user nova-compute[72382]: DEBUG nova.compute.manager [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Starting heal instance info cache {{(pid=72382) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 15:57:40 user nova-compute[72382]: DEBUG nova.compute.manager [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Rebuilding the list of instances to heal {{(pid=72382) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 09 15:57:40 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Acquiring lock "refresh_cache-5e3853b8-8138-4ab1-8b1c-e853f0a81f5c" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 15:57:40 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Acquired lock "refresh_cache-5e3853b8-8138-4ab1-8b1c-e853f0a81f5c" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 15:57:40 user nova-compute[72382]: DEBUG nova.network.neutron [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] [instance: 5e3853b8-8138-4ab1-8b1c-e853f0a81f5c] Forcefully refreshing network info cache for instance {{(pid=72382) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 15:57:40 user nova-compute[72382]: DEBUG nova.objects.instance [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lazy-loading 'info_cache' on Instance uuid 5e3853b8-8138-4ab1-8b1c-e853f0a81f5c {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:57:40 user nova-compute[72382]: DEBUG nova.network.neutron [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] [instance: 5e3853b8-8138-4ab1-8b1c-e853f0a81f5c] Updating instance_info_cache with network_info: [{"id": "e8fcea04-f9ce-4285-8e81-41a2042cbfb0", "address": "fa:16:3e:5d:ca:7b", "network": {"id": "45acf55d-48f5-4a7d-a01c-0aa68e330e1a", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-992217983-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f62d7fd59f9436295c98e08de857253", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8fcea04-f9", "ovs_interfaceid": "e8fcea04-f9ce-4285-8e81-41a2042cbfb0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:57:40 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Releasing lock "refresh_cache-5e3853b8-8138-4ab1-8b1c-e853f0a81f5c" {{(pid=72382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 15:57:40 user nova-compute[72382]: DEBUG nova.compute.manager [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] [instance: 5e3853b8-8138-4ab1-8b1c-e853f0a81f5c] Updated the network info_cache for instance {{(pid=72382) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 15:57:40 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:57:40 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:57:41 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:57:41 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:57:41 user nova-compute[72382]: DEBUG nova.compute.manager [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72382) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 15:57:43 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:57:43 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:57:43 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72382) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 15:57:43 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72382) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 15:57:43 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72382) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 15:57:43 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:57:44 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:57:45 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:57:46 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:57:47 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:57:48 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:57:53 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:57:58 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:58:03 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:58:08 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:58:09 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-c74d6fb8-2a2c-403c-b831-e3820079c60c tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] Acquiring lock "5e3853b8-8138-4ab1-8b1c-e853f0a81f5c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:58:09 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-c74d6fb8-2a2c-403c-b831-e3820079c60c tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] Lock "5e3853b8-8138-4ab1-8b1c-e853f0a81f5c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:58:09 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-c74d6fb8-2a2c-403c-b831-e3820079c60c tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] Acquiring lock "5e3853b8-8138-4ab1-8b1c-e853f0a81f5c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:58:09 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-c74d6fb8-2a2c-403c-b831-e3820079c60c tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] Lock "5e3853b8-8138-4ab1-8b1c-e853f0a81f5c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:58:09 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-c74d6fb8-2a2c-403c-b831-e3820079c60c tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] Lock "5e3853b8-8138-4ab1-8b1c-e853f0a81f5c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:58:09 user nova-compute[72382]: INFO nova.compute.manager [None req-c74d6fb8-2a2c-403c-b831-e3820079c60c tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] [instance: 5e3853b8-8138-4ab1-8b1c-e853f0a81f5c] Terminating instance
Aug 09 15:58:09 user nova-compute[72382]: DEBUG nova.compute.manager [None req-c74d6fb8-2a2c-403c-b831-e3820079c60c tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] [instance: 5e3853b8-8138-4ab1-8b1c-e853f0a81f5c] Start destroying the instance on the hypervisor. {{(pid=72382) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 15:58:09 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:58:09 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:58:09 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:58:09 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:58:10 user nova-compute[72382]: DEBUG nova.compute.manager [req-a6ef0ade-f27d-465f-b08a-34d1c7a8d8a9 req-7f84edcc-7c0d-43f4-bd83-7f1b960f6125 service nova] [instance: 5e3853b8-8138-4ab1-8b1c-e853f0a81f5c] Received event network-vif-unplugged-e8fcea04-f9ce-4285-8e81-41a2042cbfb0 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:58:10 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-a6ef0ade-f27d-465f-b08a-34d1c7a8d8a9 req-7f84edcc-7c0d-43f4-bd83-7f1b960f6125 service nova] Acquiring lock "5e3853b8-8138-4ab1-8b1c-e853f0a81f5c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:58:10 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-a6ef0ade-f27d-465f-b08a-34d1c7a8d8a9 req-7f84edcc-7c0d-43f4-bd83-7f1b960f6125 service nova] Lock "5e3853b8-8138-4ab1-8b1c-e853f0a81f5c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:58:10 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-a6ef0ade-f27d-465f-b08a-34d1c7a8d8a9 req-7f84edcc-7c0d-43f4-bd83-7f1b960f6125 service nova] Lock "5e3853b8-8138-4ab1-8b1c-e853f0a81f5c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:58:10 user nova-compute[72382]: DEBUG nova.compute.manager [req-a6ef0ade-f27d-465f-b08a-34d1c7a8d8a9 req-7f84edcc-7c0d-43f4-bd83-7f1b960f6125 service nova] [instance: 5e3853b8-8138-4ab1-8b1c-e853f0a81f5c] No waiting events found dispatching network-vif-unplugged-e8fcea04-f9ce-4285-8e81-41a2042cbfb0 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:58:10 user nova-compute[72382]: DEBUG nova.compute.manager [req-a6ef0ade-f27d-465f-b08a-34d1c7a8d8a9 req-7f84edcc-7c0d-43f4-bd83-7f1b960f6125 service nova] [instance: 5e3853b8-8138-4ab1-8b1c-e853f0a81f5c] Received event network-vif-unplugged-e8fcea04-f9ce-4285-8e81-41a2042cbfb0 for instance with task_state deleting. {{(pid=72382) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 15:58:10 user nova-compute[72382]: INFO nova.virt.libvirt.driver [-] [instance: 5e3853b8-8138-4ab1-8b1c-e853f0a81f5c] Instance destroyed successfully.
Aug 09 15:58:10 user nova-compute[72382]: DEBUG nova.objects.instance [None req-c74d6fb8-2a2c-403c-b831-e3820079c60c tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] Lazy-loading 'resources' on Instance uuid 5e3853b8-8138-4ab1-8b1c-e853f0a81f5c {{(pid=72382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 15:58:10 user nova-compute[72382]: DEBUG nova.virt.libvirt.vif [None req-c74d6fb8-2a2c-403c-b831-e3820079c60c tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T15:50:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-561988152',display_name='tempest-SnapshotDataIntegrityTests-server-561988152',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-561988152',id=52,image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKghkMBbN5vdI0aTQ34VsjrkX3lRB/SiX6+S3R+QZxUFQrO74skN4Z2exCOeujwMVC+Ye5PY/rUEIwS3xfLHO3JMJ1NzWtupnh1iVzGenp+3SRi5mp45Uzg3mEbs6saONA==',key_name='tempest-keypair-1600143604',keypairs=<?>,launch_index=0,launched_at=2023-08-09T15:51:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6f62d7fd59f9436295c98e08de857253',ramdisk_id='',reservation_id='r-7pw4v9wt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a79f2cea-eb27-4631-aaf3-05e7d9e411b4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-201807448',owner_user_name='tempest-SnapshotDataIntegrityTests-201807448-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T15:51:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='57aaf2effda74772a3fa5f6e5a2a1964',uuid=5e3853b8-8138-4ab1-8b1c-e853f0a81f5c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e8fcea04-f9ce-4285-8e81-41a2042cbfb0", "address": "fa:16:3e:5d:ca:7b", "network": {"id": "45acf55d-48f5-4a7d-a01c-0aa68e330e1a", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-992217983-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f62d7fd59f9436295c98e08de857253", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8fcea04-f9", "ovs_interfaceid": "e8fcea04-f9ce-4285-8e81-41a2042cbfb0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 15:58:10 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-c74d6fb8-2a2c-403c-b831-e3820079c60c tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] Converting VIF {"id": "e8fcea04-f9ce-4285-8e81-41a2042cbfb0", "address": "fa:16:3e:5d:ca:7b", "network": {"id": "45acf55d-48f5-4a7d-a01c-0aa68e330e1a", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-992217983-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f62d7fd59f9436295c98e08de857253", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8fcea04-f9", "ovs_interfaceid": "e8fcea04-f9ce-4285-8e81-41a2042cbfb0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 15:58:10 user nova-compute[72382]: DEBUG nova.network.os_vif_util [None req-c74d6fb8-2a2c-403c-b831-e3820079c60c tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5d:ca:7b,bridge_name='br-int',has_traffic_filtering=True,id=e8fcea04-f9ce-4285-8e81-41a2042cbfb0,network=Network(45acf55d-48f5-4a7d-a01c-0aa68e330e1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8fcea04-f9') {{(pid=72382) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 15:58:10 user nova-compute[72382]: DEBUG os_vif [None req-c74d6fb8-2a2c-403c-b831-e3820079c60c tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5d:ca:7b,bridge_name='br-int',has_traffic_filtering=True,id=e8fcea04-f9ce-4285-8e81-41a2042cbfb0,network=Network(45acf55d-48f5-4a7d-a01c-0aa68e330e1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8fcea04-f9') {{(pid=72382) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 15:58:10 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:58:10 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape8fcea04-f9, bridge=br-int, if_exists=True) {{(pid=72382) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 15:58:10 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:58:10 user nova-compute[72382]: INFO os_vif [None req-c74d6fb8-2a2c-403c-b831-e3820079c60c tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5d:ca:7b,bridge_name='br-int',has_traffic_filtering=True,id=e8fcea04-f9ce-4285-8e81-41a2042cbfb0,network=Network(45acf55d-48f5-4a7d-a01c-0aa68e330e1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8fcea04-f9')
Aug 09 15:58:10 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-c74d6fb8-2a2c-403c-b831-e3820079c60c tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] [instance: 5e3853b8-8138-4ab1-8b1c-e853f0a81f5c] Deleting instance files /opt/stack/data/nova/instances/5e3853b8-8138-4ab1-8b1c-e853f0a81f5c_del
Aug 09 15:58:10 user nova-compute[72382]: INFO nova.virt.libvirt.driver [None req-c74d6fb8-2a2c-403c-b831-e3820079c60c tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] [instance: 5e3853b8-8138-4ab1-8b1c-e853f0a81f5c] Deletion of /opt/stack/data/nova/instances/5e3853b8-8138-4ab1-8b1c-e853f0a81f5c_del complete
Aug 09 15:58:10 user nova-compute[72382]: INFO nova.compute.manager [None req-c74d6fb8-2a2c-403c-b831-e3820079c60c tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] [instance: 5e3853b8-8138-4ab1-8b1c-e853f0a81f5c] Took 0.90 seconds to destroy the instance on the hypervisor.
Aug 09 15:58:10 user nova-compute[72382]: DEBUG oslo.service.loopingcall [None req-c74d6fb8-2a2c-403c-b831-e3820079c60c tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72382) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 15:58:10 user nova-compute[72382]: DEBUG nova.compute.manager [-] [instance: 5e3853b8-8138-4ab1-8b1c-e853f0a81f5c] Deallocating network for instance {{(pid=72382) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 15:58:10 user nova-compute[72382]: DEBUG nova.network.neutron [-] [instance: 5e3853b8-8138-4ab1-8b1c-e853f0a81f5c] deallocate_for_instance() {{(pid=72382) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 15:58:11 user nova-compute[72382]: DEBUG nova.network.neutron [-] [instance: 5e3853b8-8138-4ab1-8b1c-e853f0a81f5c] Updating instance_info_cache with network_info: [] {{(pid=72382) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 15:58:11 user nova-compute[72382]: INFO nova.compute.manager [-] [instance: 5e3853b8-8138-4ab1-8b1c-e853f0a81f5c] Took 1.01 seconds to deallocate network for instance.
Aug 09 15:58:11 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-c74d6fb8-2a2c-403c-b831-e3820079c60c tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:58:11 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-c74d6fb8-2a2c-403c-b831-e3820079c60c tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:58:11 user nova-compute[72382]: DEBUG nova.compute.manager [req-406b7dfe-2387-496f-beb1-bec006b332d2 req-728bb3ec-151b-4bd4-af74-7bee5ed64e4a service nova] [instance: 5e3853b8-8138-4ab1-8b1c-e853f0a81f5c] Received event network-vif-deleted-e8fcea04-f9ce-4285-8e81-41a2042cbfb0 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:58:11 user nova-compute[72382]: DEBUG nova.compute.provider_tree [None req-c74d6fb8-2a2c-403c-b831-e3820079c60c tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] Inventory has not changed in ProviderTree for provider: 7b15b0e5-df4d-49db-833b-2855d21d10ae {{(pid=72382) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 15:58:11 user nova-compute[72382]: DEBUG nova.scheduler.client.report [None req-c74d6fb8-2a2c-403c-b831-e3820079c60c tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] Inventory has not changed for provider 7b15b0e5-df4d-49db-833b-2855d21d10ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72382) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 15:58:11 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-c74d6fb8-2a2c-403c-b831-e3820079c60c tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.187s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:58:11 user nova-compute[72382]: INFO nova.scheduler.client.report [None req-c74d6fb8-2a2c-403c-b831-e3820079c60c tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] Deleted allocations for instance 5e3853b8-8138-4ab1-8b1c-e853f0a81f5c
Aug 09 15:58:11 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-c74d6fb8-2a2c-403c-b831-e3820079c60c tempest-SnapshotDataIntegrityTests-201807448 tempest-SnapshotDataIntegrityTests-201807448-project-member] Lock "5e3853b8-8138-4ab1-8b1c-e853f0a81f5c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.291s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:58:12 user nova-compute[72382]: DEBUG nova.compute.manager [req-e610fbf2-12fa-4ec1-a30b-d34ef8f92b3b req-420d4e5e-7c06-4aca-b62e-8ccadbe76046 service nova] [instance: 5e3853b8-8138-4ab1-8b1c-e853f0a81f5c] Received event network-vif-plugged-e8fcea04-f9ce-4285-8e81-41a2042cbfb0 {{(pid=72382) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 15:58:12 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-e610fbf2-12fa-4ec1-a30b-d34ef8f92b3b req-420d4e5e-7c06-4aca-b62e-8ccadbe76046 service nova] Acquiring lock "5e3853b8-8138-4ab1-8b1c-e853f0a81f5c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:58:12 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-e610fbf2-12fa-4ec1-a30b-d34ef8f92b3b req-420d4e5e-7c06-4aca-b62e-8ccadbe76046 service nova] Lock "5e3853b8-8138-4ab1-8b1c-e853f0a81f5c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:58:12 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [req-e610fbf2-12fa-4ec1-a30b-d34ef8f92b3b req-420d4e5e-7c06-4aca-b62e-8ccadbe76046 service nova] Lock "5e3853b8-8138-4ab1-8b1c-e853f0a81f5c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:58:12 user nova-compute[72382]: DEBUG nova.compute.manager [req-e610fbf2-12fa-4ec1-a30b-d34ef8f92b3b req-420d4e5e-7c06-4aca-b62e-8ccadbe76046 service nova] [instance: 5e3853b8-8138-4ab1-8b1c-e853f0a81f5c] No waiting events found dispatching network-vif-plugged-e8fcea04-f9ce-4285-8e81-41a2042cbfb0 {{(pid=72382) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 15:58:12 user nova-compute[72382]: WARNING nova.compute.manager [req-e610fbf2-12fa-4ec1-a30b-d34ef8f92b3b req-420d4e5e-7c06-4aca-b62e-8ccadbe76046 service nova] [instance: 5e3853b8-8138-4ab1-8b1c-e853f0a81f5c] Received unexpected event network-vif-plugged-e8fcea04-f9ce-4285-8e81-41a2042cbfb0 for instance with vm_state deleted and task_state None.
Aug 09 15:58:15 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:58:20 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:58:25 user nova-compute[72382]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691596690.4286354, 5e3853b8-8138-4ab1-8b1c-e853f0a81f5c => Stopped> {{(pid=72382) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 15:58:25 user nova-compute[72382]: INFO nova.compute.manager [-] [instance: 5e3853b8-8138-4ab1-8b1c-e853f0a81f5c] VM Stopped (Lifecycle Event)
Aug 09 15:58:25 user nova-compute[72382]: DEBUG nova.compute.manager [None req-8152c1ff-a294-48d7-8173-73ae63ad6945 None None] [instance: 5e3853b8-8138-4ab1-8b1c-e853f0a81f5c] Checking state {{(pid=72382) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 15:58:25 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:58:25 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:58:25 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72382) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 15:58:25 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72382) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 15:58:25 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72382) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 15:58:25 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:58:30 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:58:35 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:58:35 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:58:35 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72382) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 15:58:35 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72382) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 15:58:35 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72382) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 15:58:35 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:58:37 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:58:37 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:58:37 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:58:37 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:58:37 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Auditing locally available compute resources for user (node: user) {{(pid=72382) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 15:58:38 user nova-compute[72382]: WARNING nova.virt.libvirt.driver [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 15:58:38 user nova-compute[72382]: WARNING nova.virt.libvirt.driver [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 15:58:38 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Hypervisor/Node resource view: name=user free_ram=9003MB free_disk=25.296207427978516GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72382) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 15:58:38 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 15:58:38 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 15:58:38 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72382) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 15:58:38 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72382) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 15:58:38 user nova-compute[72382]: DEBUG nova.compute.provider_tree [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Inventory has not changed in ProviderTree for provider: 7b15b0e5-df4d-49db-833b-2855d21d10ae {{(pid=72382) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 15:58:38 user nova-compute[72382]: DEBUG nova.scheduler.client.report [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Inventory has not changed for provider 7b15b0e5-df4d-49db-833b-2855d21d10ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72382) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 15:58:38 user nova-compute[72382]: DEBUG nova.compute.resource_tracker [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Compute_service record updated for user:user {{(pid=72382) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 15:58:38 user nova-compute[72382]: DEBUG oslo_concurrency.lockutils [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.181s {{(pid=72382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 15:58:40 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:58:40 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:58:40 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72382) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 15:58:40 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72382) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 15:58:40 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72382) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 15:58:40 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:58:40 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:58:40 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:58:40 user nova-compute[72382]: DEBUG nova.compute.manager [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Starting heal instance info cache {{(pid=72382) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 15:58:40 user nova-compute[72382]: DEBUG nova.compute.manager [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Rebuilding the list of instances to heal {{(pid=72382) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 09 15:58:40 user nova-compute[72382]: DEBUG nova.compute.manager [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Didn't find any instances for network info cache update. {{(pid=72382) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 09 15:58:40 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:58:42 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:58:42 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:58:42 user nova-compute[72382]: DEBUG nova.compute.manager [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72382) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 15:58:45 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:58:46 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:58:46 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:58:47 user nova-compute[72382]: DEBUG oslo_service.periodic_task [None req-e5119168-5d18-4841-ba69-69f979f5d80f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72382) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 15:58:50 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:58:55 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:59:00 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:59:01 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:59:04 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:59:05 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:59:07 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:59:10 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:59:15 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:59:20 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 15:59:25 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 15:59:30 user nova-compute[72382]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72382) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}